# Qwen3 Coder 480B-A35B: Attention side of an attention–FFN split | ServingStudio Models

Deployment `Qwen3-Coder-480B-A35B-Instruct/qwen3_attn_tp` of Qwen3 Coder 480B-A35B (`Qwen/Qwen3-Coder-480B-A35B-Instruct`, family Qwen). Arch `qwen3_attn_tp`; Disaggregated attention side; GPU NVIDIA H200. Interactive page, with its cost tree and live prediction: https://servingstudio.cs.washington.edu/models.html?preset=Qwen3-Coder-480B-A35B-Instruct%2Fqwen3_attn_tp. All models: https://servingstudio.cs.washington.edu/models.md.

## Configurations

The preset has one configuration.

| Parameters | GPUs per replica | Case form | Groups | max_model_len | Can be timed |
| --- | --- | --- | --- | --- | --- |
| (none) | 4 | `attn` | 1 | 262,144 | yes |

## Timing a batch

`POST https://servingstudio.cs.washington.edu/api/public/v1/predict` with the preset id, one configuration's `params` and 1 to 64 `cases`. A case is `{"groups": [...]}`, one object per group (the table's Groups column), each with the fields of the configuration's case form. The answer gives each case's time per section and per node of its cost tree. The servingstudio-timing-predict skill walks through it: https://servingstudio.cs.washington.edu/skills/servingstudio-timing-predict.md.

```json
{"preset":"Qwen3-Coder-480B-A35B-Instruct/qwen3_attn_tp","params":{},"cases":["…"]}
```

Fields of a group for case form `attn`:

| Field | Type | Required | Meaning |
| --- | --- | --- | --- |
| `prefill_chunk_pairs` | int_pair_list | no | Prefill requests, one `[prefix_len, append_len]` each: the tokens already in the KV cache and the tokens this iteration computes (`prefix_len` 0 for a fresh prompt). |
| `decode_kv_lens` | int_list | no | Decode requests, one KV length each: the context its new token attends to. Give this or `decode_count`, not both. |
| `decode_count` | int | no | Shorthand for `decode_kv_lens`: this many decode requests, each `average_decode_length` long. |
| `average_decode_length` | int | no | The KV length of each `decode_count` request; required with it. |

## Kernels of configuration (none)

Each section's leaf slots, in order: the kernel kind each calls and the backends measured for it. Other configurations share the shape but not every size.

### Section `attn`

| Slot | Kernel | Backends |
| --- | --- | --- |
| `afd.attn.kv_cache_append` | [kv_cache_append](https://servingstudio.cs.washington.edu/kernels/kv_cache_append.md) | `vllm_cuda` |
| `afd.attn.prefill` | [flashinfer_attn_prefill](https://servingstudio.cs.washington.edu/kernels/flashinfer_attn_prefill.md) | `fa3` |
| `afd.attn.decode` | [flashinfer_attn_decode](https://servingstudio.cs.washington.edu/kernels/flashinfer_attn_decode.md) | `fa2` |

## API

- This deployment in the model list: https://servingstudio.cs.washington.edu/api/public/v1/models
- The kernels of one configuration: https://servingstudio.cs.washington.edu/api/public/v1/models/Qwen3-Coder-480B-A35B-Instruct/qwen3_attn_tp/tree

---

This page as Markdown: https://servingstudio.cs.washington.edu/models/Qwen3-Coder-480B-A35B-Instruct/qwen3_attn_tp.md. A guide to the whole site for AI agents: [llms.txt](https://servingstudio.cs.washington.edu/llms.txt).
