# GLM-5.3-Flash NVFP4: vLLM, DP attention, EP MoE | ServingStudio Models

Deployment `GLM-5.3-Flash-NVFP4/glm53_flash_vllm_nvfp4_dp_attn_ep_moe` of GLM-5.3-Flash NVFP4 (`nvidia/GLM-5.3-Flash-NVFP4`, family GLM). Arch `glm53_flash_vllm_nvfp4_dp_attn_ep_moe`; Whole iteration; GPU NVIDIA B200. Interactive page, with its cost tree and live prediction: https://servingstudio.cs.washington.edu/models.html?preset=GLM-5.3-Flash-NVFP4%2Fglm53_flash_vllm_nvfp4_dp_attn_ep_moe. All models: https://servingstudio.cs.washington.edu/models.md.

## Configurations

The preset sweeps `ep_size`, `max_model_len`, `workload`; each configuration (member) is one value of each.

| Parameters | GPUs per replica | Case form | Groups | max_model_len | Can be timed |
| --- | --- | --- | --- | --- | --- |
| ep_size 4, max_model_len 8192, workload balanced_c32 | 4 | `iter` | 4 | 8,192 | yes |
| ep_size 4, max_model_len 65536, workload balanced_c32 | 4 | `iter` | 4 | 65,536 | yes |
| ep_size 4, max_model_len 131072, workload balanced_c32 | 4 | `iter` | 4 | 131,072 | yes |
| ep_size 4, max_model_len 262144, workload balanced_c32 | 4 | `iter` | 4 | 262,144 | yes |
| ep_size 4, max_model_len 524288, workload balanced_c32 | 4 | `iter` | 4 | 524,288 | yes |
| ep_size 4, max_model_len 1048576, workload balanced_c32 | 4 | `iter` | 4 | 1,048,576 | yes |
| ep_size 8, max_model_len 8192, workload balanced_c32 | 8 | `iter` | 8 | 8,192 | yes |
| ep_size 8, max_model_len 65536, workload balanced_c32 | 8 | `iter` | 8 | 65,536 | yes |
| ep_size 8, max_model_len 131072, workload balanced_c32 | 8 | `iter` | 8 | 131,072 | yes |
| ep_size 8, max_model_len 262144, workload balanced_c32 | 8 | `iter` | 8 | 262,144 | yes |
| ep_size 8, max_model_len 524288, workload balanced_c32 | 8 | `iter` | 8 | 524,288 | yes |
| ep_size 8, max_model_len 1048576, workload balanced_c32 | 8 | `iter` | 8 | 1,048,576 | yes |

## Timing a batch

`POST https://servingstudio.cs.washington.edu/api/public/v1/predict` with the preset id, one configuration's `params` and 1 to 64 `cases`. A case is `{"groups": [...]}`, one object per group (the table's Groups column), each with the fields of the configuration's case form. The answer gives each case's time per section and per node of its cost tree. The servingstudio-timing-predict skill walks through it: https://servingstudio.cs.washington.edu/skills/servingstudio-timing-predict.md.

```json
{"preset":"GLM-5.3-Flash-NVFP4/glm53_flash_vllm_nvfp4_dp_attn_ep_moe","params":{"ep_size":4,"max_model_len":8192,"workload":"balanced_c32"},"cases":["…"]}
```

Fields of a group for case form `iter`:

| Field | Type | Required | Meaning |
| --- | --- | --- | --- |
| `prefill_chunk_pairs` | int_pair_list | no | Prefill requests, one `[prefix_len, append_len]` each: the tokens already in the KV cache and the tokens this iteration computes (`prefix_len` 0 for a fresh prompt). |
| `decode_kv_lens` | int_list | no | Decode requests, one KV length each: the context its new token attends to. Give this or `decode_count`, not both. |
| `decode_count` | int | no | Shorthand for `decode_kv_lens`: this many decode requests, each `average_decode_length` long. |
| `average_decode_length` | int | no | The KV length of each `decode_count` request; required with it. |

## Kernels of configuration ep_size 4, max_model_len 8192, workload balanced_c32

Each section's leaf slots, in order: the kernel kind each calls and the backends measured for it. Other configurations share the shape but not every size.

### Section `iter`

| Slot | Kernel | Backends |
| --- | --- | --- |
| `unified.embedding` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.hc_expand` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.embedding` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.hc_expand` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.embedding` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.hc_expand` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.embedding` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.hc_expand` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.first_kda_dense.attn_mhc_pre` | [mhc_pre_rms_norm](https://servingstudio.cs.washington.edu/kernels/mhc_pre_rms_norm.md) | `vllm_tilelang` |
| `unified.first_kda_dense.kda.in_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.first_kda_dense.kda.f_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.first_kda_dense.kda.g_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.first_kda_dense.kda.short_conv_prefill` | [gdn_causal_conv_prefill](https://servingstudio.cs.washington.edu/kernels/gdn_causal_conv_prefill.md) | `vllm_triton` |
| `unified.first_kda_dense.kda.short_conv_decode` | [gdn_causal_conv_decode](https://servingstudio.cs.washington.edu/kernels/gdn_causal_conv_decode.md) | `vllm_triton` |
| `unified.first_kda_dense.kda.prefill_glue` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.first_kda_dense.kda.state_gather` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.first_kda_dense.kda.chunk_prefill` | [kda_chunk_prefill](https://servingstudio.cs.washington.edu/kernels/kda_chunk_prefill.md) | `vllm_triton` |
| `unified.first_kda_dense.kda.recurrent_decode` | [kda_recurrent_decode](https://servingstudio.cs.washington.edu/kernels/kda_recurrent_decode.md) | `vllm_triton` |
| `unified.first_kda_dense.kda.state_scatter` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.first_kda_dense.kda.gated_norm` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.first_kda_dense.kda.o_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.first_kda_dense.ffn_mhc_post_pre` | [mhc_fused_post_pre_rms_norm](https://servingstudio.cs.washington.edu/kernels/mhc_fused_post_pre_rms_norm.md) | `vllm_tilelang` |
| `unified.first_kda_dense.dense_ffn.gate_up_input_quant` | [nvfp4_quant](https://servingstudio.cs.washington.edu/kernels/nvfp4_quant.md) | `vllm_cuda` |
| `unified.first_kda_dense.dense_ffn.gate_up` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `flashinfer_cutedsl` |
| `unified.first_kda_dense.dense_ffn.act_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.first_kda_dense.dense_ffn.down_input_quant` | [nvfp4_quant](https://servingstudio.cs.washington.edu/kernels/nvfp4_quant.md) | `vllm_cuda` |
| `unified.first_kda_dense.dense_ffn.down` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `flashinfer_cutedsl` |
| `unified.first_kda_dense.attn_mhc_pre` | [mhc_pre_rms_norm](https://servingstudio.cs.washington.edu/kernels/mhc_pre_rms_norm.md) | `vllm_tilelang` |
| `unified.first_kda_dense.kda.in_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.first_kda_dense.kda.f_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.first_kda_dense.kda.g_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.first_kda_dense.kda.short_conv_prefill` | [gdn_causal_conv_prefill](https://servingstudio.cs.washington.edu/kernels/gdn_causal_conv_prefill.md) | `vllm_triton` |
| `unified.first_kda_dense.kda.short_conv_decode` | [gdn_causal_conv_decode](https://servingstudio.cs.washington.edu/kernels/gdn_causal_conv_decode.md) | `vllm_triton` |
| `unified.first_kda_dense.kda.prefill_glue` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.first_kda_dense.kda.state_gather` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.first_kda_dense.kda.chunk_prefill` | [kda_chunk_prefill](https://servingstudio.cs.washington.edu/kernels/kda_chunk_prefill.md) | `vllm_triton` |
| `unified.first_kda_dense.kda.recurrent_decode` | [kda_recurrent_decode](https://servingstudio.cs.washington.edu/kernels/kda_recurrent_decode.md) | `vllm_triton` |
| `unified.first_kda_dense.kda.state_scatter` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.first_kda_dense.kda.gated_norm` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.first_kda_dense.kda.o_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.first_kda_dense.ffn_mhc_post_pre` | [mhc_fused_post_pre_rms_norm](https://servingstudio.cs.washington.edu/kernels/mhc_fused_post_pre_rms_norm.md) | `vllm_tilelang` |
| `unified.first_kda_dense.dense_ffn.gate_up_input_quant` | [nvfp4_quant](https://servingstudio.cs.washington.edu/kernels/nvfp4_quant.md) | `vllm_cuda` |
| `unified.first_kda_dense.dense_ffn.gate_up` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `flashinfer_cutedsl` |
| `unified.first_kda_dense.dense_ffn.act_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.first_kda_dense.dense_ffn.down_input_quant` | [nvfp4_quant](https://servingstudio.cs.washington.edu/kernels/nvfp4_quant.md) | `vllm_cuda` |
| `unified.first_kda_dense.dense_ffn.down` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `flashinfer_cutedsl` |
| `unified.first_kda_dense.attn_mhc_pre` | [mhc_pre_rms_norm](https://servingstudio.cs.washington.edu/kernels/mhc_pre_rms_norm.md) | `vllm_tilelang` |
| `unified.first_kda_dense.kda.in_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.first_kda_dense.kda.f_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.first_kda_dense.kda.g_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.first_kda_dense.kda.short_conv_prefill` | [gdn_causal_conv_prefill](https://servingstudio.cs.washington.edu/kernels/gdn_causal_conv_prefill.md) | `vllm_triton` |
| `unified.first_kda_dense.kda.short_conv_decode` | [gdn_causal_conv_decode](https://servingstudio.cs.washington.edu/kernels/gdn_causal_conv_decode.md) | `vllm_triton` |
| `unified.first_kda_dense.kda.prefill_glue` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.first_kda_dense.kda.state_gather` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.first_kda_dense.kda.chunk_prefill` | [kda_chunk_prefill](https://servingstudio.cs.washington.edu/kernels/kda_chunk_prefill.md) | `vllm_triton` |
| `unified.first_kda_dense.kda.recurrent_decode` | [kda_recurrent_decode](https://servingstudio.cs.washington.edu/kernels/kda_recurrent_decode.md) | `vllm_triton` |
| `unified.first_kda_dense.kda.state_scatter` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.first_kda_dense.kda.gated_norm` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.first_kda_dense.kda.o_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.first_kda_dense.ffn_mhc_post_pre` | [mhc_fused_post_pre_rms_norm](https://servingstudio.cs.washington.edu/kernels/mhc_fused_post_pre_rms_norm.md) | `vllm_tilelang` |
| `unified.first_kda_dense.dense_ffn.gate_up_input_quant` | [nvfp4_quant](https://servingstudio.cs.washington.edu/kernels/nvfp4_quant.md) | `vllm_cuda` |
| `unified.first_kda_dense.dense_ffn.gate_up` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `flashinfer_cutedsl` |
| `unified.first_kda_dense.dense_ffn.act_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.first_kda_dense.dense_ffn.down_input_quant` | [nvfp4_quant](https://servingstudio.cs.washington.edu/kernels/nvfp4_quant.md) | `vllm_cuda` |
| `unified.first_kda_dense.dense_ffn.down` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `flashinfer_cutedsl` |
| `unified.first_kda_dense.attn_mhc_pre` | [mhc_pre_rms_norm](https://servingstudio.cs.washington.edu/kernels/mhc_pre_rms_norm.md) | `vllm_tilelang` |
| `unified.first_kda_dense.kda.in_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.first_kda_dense.kda.f_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.first_kda_dense.kda.g_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.first_kda_dense.kda.short_conv_prefill` | [gdn_causal_conv_prefill](https://servingstudio.cs.washington.edu/kernels/gdn_causal_conv_prefill.md) | `vllm_triton` |
| `unified.first_kda_dense.kda.short_conv_decode` | [gdn_causal_conv_decode](https://servingstudio.cs.washington.edu/kernels/gdn_causal_conv_decode.md) | `vllm_triton` |
| `unified.first_kda_dense.kda.prefill_glue` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.first_kda_dense.kda.state_gather` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.first_kda_dense.kda.chunk_prefill` | [kda_chunk_prefill](https://servingstudio.cs.washington.edu/kernels/kda_chunk_prefill.md) | `vllm_triton` |
| `unified.first_kda_dense.kda.recurrent_decode` | [kda_recurrent_decode](https://servingstudio.cs.washington.edu/kernels/kda_recurrent_decode.md) | `vllm_triton` |
| `unified.first_kda_dense.kda.state_scatter` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.first_kda_dense.kda.gated_norm` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.first_kda_dense.kda.o_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.first_kda_dense.ffn_mhc_post_pre` | [mhc_fused_post_pre_rms_norm](https://servingstudio.cs.washington.edu/kernels/mhc_fused_post_pre_rms_norm.md) | `vllm_tilelang` |
| `unified.first_kda_dense.dense_ffn.gate_up_input_quant` | [nvfp4_quant](https://servingstudio.cs.washington.edu/kernels/nvfp4_quant.md) | `vllm_cuda` |
| `unified.first_kda_dense.dense_ffn.gate_up` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `flashinfer_cutedsl` |
| `unified.first_kda_dense.dense_ffn.act_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.first_kda_dense.dense_ffn.down_input_quant` | [nvfp4_quant](https://servingstudio.cs.washington.edu/kernels/nvfp4_quant.md) | `vllm_cuda` |
| `unified.first_kda_dense.dense_ffn.down` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `flashinfer_cutedsl` |
| `unified.kda_dense.attn_mhc_post_pre` | [mhc_fused_post_pre_rms_norm](https://servingstudio.cs.washington.edu/kernels/mhc_fused_post_pre_rms_norm.md) | `vllm_tilelang` |
| `unified.kda_dense.kda.in_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.kda_dense.kda.f_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.kda_dense.kda.g_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.kda_dense.kda.short_conv_prefill` | [gdn_causal_conv_prefill](https://servingstudio.cs.washington.edu/kernels/gdn_causal_conv_prefill.md) | `vllm_triton` |
| `unified.kda_dense.kda.short_conv_decode` | [gdn_causal_conv_decode](https://servingstudio.cs.washington.edu/kernels/gdn_causal_conv_decode.md) | `vllm_triton` |
| `unified.kda_dense.kda.prefill_glue` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_dense.kda.state_gather` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_dense.kda.chunk_prefill` | [kda_chunk_prefill](https://servingstudio.cs.washington.edu/kernels/kda_chunk_prefill.md) | `vllm_triton` |
| `unified.kda_dense.kda.recurrent_decode` | [kda_recurrent_decode](https://servingstudio.cs.washington.edu/kernels/kda_recurrent_decode.md) | `vllm_triton` |
| `unified.kda_dense.kda.state_scatter` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_dense.kda.gated_norm` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_dense.kda.o_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.kda_dense.ffn_mhc_post_pre` | [mhc_fused_post_pre_rms_norm](https://servingstudio.cs.washington.edu/kernels/mhc_fused_post_pre_rms_norm.md) | `vllm_tilelang` |
| `unified.kda_dense.dense_ffn.gate_up_input_quant` | [nvfp4_quant](https://servingstudio.cs.washington.edu/kernels/nvfp4_quant.md) | `vllm_cuda` |
| `unified.kda_dense.dense_ffn.gate_up` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `flashinfer_cutedsl` |
| `unified.kda_dense.dense_ffn.act_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_dense.dense_ffn.down_input_quant` | [nvfp4_quant](https://servingstudio.cs.washington.edu/kernels/nvfp4_quant.md) | `vllm_cuda` |
| `unified.kda_dense.dense_ffn.down` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `flashinfer_cutedsl` |
| `unified.kda_dense.attn_mhc_post_pre` | [mhc_fused_post_pre_rms_norm](https://servingstudio.cs.washington.edu/kernels/mhc_fused_post_pre_rms_norm.md) | `vllm_tilelang` |
| `unified.kda_dense.kda.in_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.kda_dense.kda.f_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.kda_dense.kda.g_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.kda_dense.kda.short_conv_prefill` | [gdn_causal_conv_prefill](https://servingstudio.cs.washington.edu/kernels/gdn_causal_conv_prefill.md) | `vllm_triton` |
| `unified.kda_dense.kda.short_conv_decode` | [gdn_causal_conv_decode](https://servingstudio.cs.washington.edu/kernels/gdn_causal_conv_decode.md) | `vllm_triton` |
| `unified.kda_dense.kda.prefill_glue` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_dense.kda.state_gather` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_dense.kda.chunk_prefill` | [kda_chunk_prefill](https://servingstudio.cs.washington.edu/kernels/kda_chunk_prefill.md) | `vllm_triton` |
| `unified.kda_dense.kda.recurrent_decode` | [kda_recurrent_decode](https://servingstudio.cs.washington.edu/kernels/kda_recurrent_decode.md) | `vllm_triton` |
| `unified.kda_dense.kda.state_scatter` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_dense.kda.gated_norm` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_dense.kda.o_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.kda_dense.ffn_mhc_post_pre` | [mhc_fused_post_pre_rms_norm](https://servingstudio.cs.washington.edu/kernels/mhc_fused_post_pre_rms_norm.md) | `vllm_tilelang` |
| `unified.kda_dense.dense_ffn.gate_up_input_quant` | [nvfp4_quant](https://servingstudio.cs.washington.edu/kernels/nvfp4_quant.md) | `vllm_cuda` |
| `unified.kda_dense.dense_ffn.gate_up` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `flashinfer_cutedsl` |
| `unified.kda_dense.dense_ffn.act_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_dense.dense_ffn.down_input_quant` | [nvfp4_quant](https://servingstudio.cs.washington.edu/kernels/nvfp4_quant.md) | `vllm_cuda` |
| `unified.kda_dense.dense_ffn.down` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `flashinfer_cutedsl` |
| `unified.kda_dense.attn_mhc_post_pre` | [mhc_fused_post_pre_rms_norm](https://servingstudio.cs.washington.edu/kernels/mhc_fused_post_pre_rms_norm.md) | `vllm_tilelang` |
| `unified.kda_dense.kda.in_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.kda_dense.kda.f_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.kda_dense.kda.g_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.kda_dense.kda.short_conv_prefill` | [gdn_causal_conv_prefill](https://servingstudio.cs.washington.edu/kernels/gdn_causal_conv_prefill.md) | `vllm_triton` |
| `unified.kda_dense.kda.short_conv_decode` | [gdn_causal_conv_decode](https://servingstudio.cs.washington.edu/kernels/gdn_causal_conv_decode.md) | `vllm_triton` |
| `unified.kda_dense.kda.prefill_glue` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_dense.kda.state_gather` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_dense.kda.chunk_prefill` | [kda_chunk_prefill](https://servingstudio.cs.washington.edu/kernels/kda_chunk_prefill.md) | `vllm_triton` |
| `unified.kda_dense.kda.recurrent_decode` | [kda_recurrent_decode](https://servingstudio.cs.washington.edu/kernels/kda_recurrent_decode.md) | `vllm_triton` |
| `unified.kda_dense.kda.state_scatter` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_dense.kda.gated_norm` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_dense.kda.o_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.kda_dense.ffn_mhc_post_pre` | [mhc_fused_post_pre_rms_norm](https://servingstudio.cs.washington.edu/kernels/mhc_fused_post_pre_rms_norm.md) | `vllm_tilelang` |
| `unified.kda_dense.dense_ffn.gate_up_input_quant` | [nvfp4_quant](https://servingstudio.cs.washington.edu/kernels/nvfp4_quant.md) | `vllm_cuda` |
| `unified.kda_dense.dense_ffn.gate_up` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `flashinfer_cutedsl` |
| `unified.kda_dense.dense_ffn.act_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_dense.dense_ffn.down_input_quant` | [nvfp4_quant](https://servingstudio.cs.washington.edu/kernels/nvfp4_quant.md) | `vllm_cuda` |
| `unified.kda_dense.dense_ffn.down` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `flashinfer_cutedsl` |
| `unified.kda_dense.attn_mhc_post_pre` | [mhc_fused_post_pre_rms_norm](https://servingstudio.cs.washington.edu/kernels/mhc_fused_post_pre_rms_norm.md) | `vllm_tilelang` |
| `unified.kda_dense.kda.in_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.kda_dense.kda.f_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.kda_dense.kda.g_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.kda_dense.kda.short_conv_prefill` | [gdn_causal_conv_prefill](https://servingstudio.cs.washington.edu/kernels/gdn_causal_conv_prefill.md) | `vllm_triton` |
| `unified.kda_dense.kda.short_conv_decode` | [gdn_causal_conv_decode](https://servingstudio.cs.washington.edu/kernels/gdn_causal_conv_decode.md) | `vllm_triton` |
| `unified.kda_dense.kda.prefill_glue` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_dense.kda.state_gather` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_dense.kda.chunk_prefill` | [kda_chunk_prefill](https://servingstudio.cs.washington.edu/kernels/kda_chunk_prefill.md) | `vllm_triton` |
| `unified.kda_dense.kda.recurrent_decode` | [kda_recurrent_decode](https://servingstudio.cs.washington.edu/kernels/kda_recurrent_decode.md) | `vllm_triton` |
| `unified.kda_dense.kda.state_scatter` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_dense.kda.gated_norm` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_dense.kda.o_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.kda_dense.ffn_mhc_post_pre` | [mhc_fused_post_pre_rms_norm](https://servingstudio.cs.washington.edu/kernels/mhc_fused_post_pre_rms_norm.md) | `vllm_tilelang` |
| `unified.kda_dense.dense_ffn.gate_up_input_quant` | [nvfp4_quant](https://servingstudio.cs.washington.edu/kernels/nvfp4_quant.md) | `vllm_cuda` |
| `unified.kda_dense.dense_ffn.gate_up` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `flashinfer_cutedsl` |
| `unified.kda_dense.dense_ffn.act_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_dense.dense_ffn.down_input_quant` | [nvfp4_quant](https://servingstudio.cs.washington.edu/kernels/nvfp4_quant.md) | `vllm_cuda` |
| `unified.kda_dense.dense_ffn.down` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `flashinfer_cutedsl` |
| `unified.dsa_moe.attn_mhc_post_pre` | [mhc_fused_post_pre_rms_norm](https://servingstudio.cs.washington.edu/kernels/mhc_fused_post_pre_rms_norm.md) | `vllm_tilelang` |
| `unified.dsa_moe.dsa.fused_qkv_a` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.dsa_moe.dsa.q_kv_a_norm` | [q_kv_rms_norm](https://servingstudio.cs.washington.edu/kernels/q_kv_rms_norm.md) | `vllm_triton` |
| `unified.dsa_moe.dsa.q_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.dsa_moe.dsa.indexer.wq_b` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.dsa_moe.dsa.indexer.wk_weights` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.dsa_moe.dsa.indexer.head_weights` | [gemm_fp32_output](https://servingstudio.cs.washington.edu/kernels/gemm_fp32_output.md) | `torch_cublas` |
| `unified.dsa_moe.dsa.indexer.k_norm` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.dsa.indexer.q_fwht_quant` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.dsa.indexer.weight_scale` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.dsa.indexer.kpool_gate_score` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.dsa_moe.dsa.indexer.prefill_gather` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.dsa.indexer.kpool_decode_update` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.dsa.indexer.kpool_prefill_write` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.dsa.indexer.kpool_tail_seed` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.dsa.indexer.mqa_logits_decode` | [dsa_paged_mqa_logits_decode](https://servingstudio.cs.washington.edu/kernels/dsa_paged_mqa_logits_decode.md) | `deepgemm_fp8` |
| `unified.dsa_moe.dsa.indexer.topk_decode` | [dsa_persistent_topk_decode](https://servingstudio.cs.washington.edu/kernels/dsa_persistent_topk_decode.md) | `vllm_cuda` |
| `unified.dsa_moe.dsa.indexer.mqa_logits_prefill` | [dsa_mqa_logits_prefill](https://servingstudio.cs.washington.edu/kernels/dsa_mqa_logits_prefill.md) | `deepgemm_fp8` |
| `unified.dsa_moe.dsa.indexer.topk_prefill` | [dsa_topk_prefill](https://servingstudio.cs.washington.edu/kernels/dsa_topk_prefill.md) | `vllm_cuda` |
| `unified.dsa_moe.dsa.indexer.expand_pools` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.dsa.q_absorb` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_q_absorb_no_rope` |
| `unified.dsa_moe.dsa.q_concat` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.dsa.q_fp8_quant` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.dsa.sparse_mla.mla_cache_append` | [mla_cache_append](https://servingstudio.cs.washington.edu/kernels/mla_cache_append.md) | `vllm_cuda` |
| `unified.dsa_moe.dsa.sparse_mla.index_remap` | [dsa_sparse_index_remap](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_index_remap.md) | `vllm_triton` |
| `unified.dsa_moe.dsa.sparse_mla.prefill` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `flashinfer_trtllm_fp8` |
| `unified.dsa_moe.dsa.sparse_mla.decode` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `flashinfer_trtllm_fp8` |
| `unified.dsa_moe.dsa.output_copy` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.dsa.v_up` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_v_up_unpadded` |
| `unified.dsa_moe.dsa.o_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.dsa_moe.dsa.glue` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.dsa.prefill_glue` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.ffn_mhc_post_pre` | [mhc_fused_post_pre_rms_norm](https://servingstudio.cs.washington.edu/kernels/mhc_fused_post_pre_rms_norm.md) | `vllm_tilelang` |
| `unified.dsa_moe.moe.router.gate` | [gemm_fp32_output](https://servingstudio.cs.washington.edu/kernels/gemm_fp32_output.md) | `torch_cublas` |
| `unified.dsa_moe.moe.router.gate_recompute` | [gemm_fp32_output](https://servingstudio.cs.washington.edu/kernels/gemm_fp32_output.md) | `torch_cublas` |
| `unified.dsa_moe.moe.router_select` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.moe.input_glue` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.moe.shared_expert.gate_up` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.dsa_moe.moe.shared_expert.act_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.moe.shared_expert.down` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.dsa_moe.moe.dispatch_quant` | [nvfp4_quant](https://servingstudio.cs.washington.edu/kernels/nvfp4_quant.md) | `vllm_cuda` |
| `unified.dsa_moe.attn_mhc_post_pre` | [mhc_fused_post_pre_rms_norm](https://servingstudio.cs.washington.edu/kernels/mhc_fused_post_pre_rms_norm.md) | `vllm_tilelang` |
| `unified.dsa_moe.dsa.fused_qkv_a` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.dsa_moe.dsa.q_kv_a_norm` | [q_kv_rms_norm](https://servingstudio.cs.washington.edu/kernels/q_kv_rms_norm.md) | `vllm_triton` |
| `unified.dsa_moe.dsa.q_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.dsa_moe.dsa.indexer.wq_b` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.dsa_moe.dsa.indexer.wk_weights` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.dsa_moe.dsa.indexer.head_weights` | [gemm_fp32_output](https://servingstudio.cs.washington.edu/kernels/gemm_fp32_output.md) | `torch_cublas` |
| `unified.dsa_moe.dsa.indexer.k_norm` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.dsa.indexer.q_fwht_quant` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.dsa.indexer.weight_scale` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.dsa.indexer.kpool_gate_score` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.dsa_moe.dsa.indexer.prefill_gather` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.dsa.indexer.kpool_decode_update` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.dsa.indexer.kpool_prefill_write` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.dsa.indexer.kpool_tail_seed` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.dsa.indexer.mqa_logits_decode` | [dsa_paged_mqa_logits_decode](https://servingstudio.cs.washington.edu/kernels/dsa_paged_mqa_logits_decode.md) | `deepgemm_fp8` |
| `unified.dsa_moe.dsa.indexer.topk_decode` | [dsa_persistent_topk_decode](https://servingstudio.cs.washington.edu/kernels/dsa_persistent_topk_decode.md) | `vllm_cuda` |
| `unified.dsa_moe.dsa.indexer.mqa_logits_prefill` | [dsa_mqa_logits_prefill](https://servingstudio.cs.washington.edu/kernels/dsa_mqa_logits_prefill.md) | `deepgemm_fp8` |
| `unified.dsa_moe.dsa.indexer.topk_prefill` | [dsa_topk_prefill](https://servingstudio.cs.washington.edu/kernels/dsa_topk_prefill.md) | `vllm_cuda` |
| `unified.dsa_moe.dsa.indexer.expand_pools` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.dsa.q_absorb` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_q_absorb_no_rope` |
| `unified.dsa_moe.dsa.q_concat` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.dsa.q_fp8_quant` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.dsa.sparse_mla.mla_cache_append` | [mla_cache_append](https://servingstudio.cs.washington.edu/kernels/mla_cache_append.md) | `vllm_cuda` |
| `unified.dsa_moe.dsa.sparse_mla.index_remap` | [dsa_sparse_index_remap](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_index_remap.md) | `vllm_triton` |
| `unified.dsa_moe.dsa.sparse_mla.prefill` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `flashinfer_trtllm_fp8` |
| `unified.dsa_moe.dsa.sparse_mla.decode` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `flashinfer_trtllm_fp8` |
| `unified.dsa_moe.dsa.output_copy` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.dsa.v_up` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_v_up_unpadded` |
| `unified.dsa_moe.dsa.o_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.dsa_moe.dsa.glue` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.dsa.prefill_glue` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.ffn_mhc_post_pre` | [mhc_fused_post_pre_rms_norm](https://servingstudio.cs.washington.edu/kernels/mhc_fused_post_pre_rms_norm.md) | `vllm_tilelang` |
| `unified.dsa_moe.moe.router.gate` | [gemm_fp32_output](https://servingstudio.cs.washington.edu/kernels/gemm_fp32_output.md) | `torch_cublas` |
| `unified.dsa_moe.moe.router.gate_recompute` | [gemm_fp32_output](https://servingstudio.cs.washington.edu/kernels/gemm_fp32_output.md) | `torch_cublas` |
| `unified.dsa_moe.moe.router_select` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.moe.input_glue` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.moe.shared_expert.gate_up` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.dsa_moe.moe.shared_expert.act_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.moe.shared_expert.down` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.dsa_moe.moe.dispatch_quant` | [nvfp4_quant](https://servingstudio.cs.washington.edu/kernels/nvfp4_quant.md) | `vllm_cuda` |
| `unified.dsa_moe.attn_mhc_post_pre` | [mhc_fused_post_pre_rms_norm](https://servingstudio.cs.washington.edu/kernels/mhc_fused_post_pre_rms_norm.md) | `vllm_tilelang` |
| `unified.dsa_moe.dsa.fused_qkv_a` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.dsa_moe.dsa.q_kv_a_norm` | [q_kv_rms_norm](https://servingstudio.cs.washington.edu/kernels/q_kv_rms_norm.md) | `vllm_triton` |
| `unified.dsa_moe.dsa.q_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.dsa_moe.dsa.indexer.wq_b` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.dsa_moe.dsa.indexer.wk_weights` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.dsa_moe.dsa.indexer.head_weights` | [gemm_fp32_output](https://servingstudio.cs.washington.edu/kernels/gemm_fp32_output.md) | `torch_cublas` |
| `unified.dsa_moe.dsa.indexer.k_norm` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.dsa.indexer.q_fwht_quant` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.dsa.indexer.weight_scale` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.dsa.indexer.kpool_gate_score` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.dsa_moe.dsa.indexer.prefill_gather` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.dsa.indexer.kpool_decode_update` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.dsa.indexer.kpool_prefill_write` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.dsa.indexer.kpool_tail_seed` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.dsa.indexer.mqa_logits_decode` | [dsa_paged_mqa_logits_decode](https://servingstudio.cs.washington.edu/kernels/dsa_paged_mqa_logits_decode.md) | `deepgemm_fp8` |
| `unified.dsa_moe.dsa.indexer.topk_decode` | [dsa_persistent_topk_decode](https://servingstudio.cs.washington.edu/kernels/dsa_persistent_topk_decode.md) | `vllm_cuda` |
| `unified.dsa_moe.dsa.indexer.mqa_logits_prefill` | [dsa_mqa_logits_prefill](https://servingstudio.cs.washington.edu/kernels/dsa_mqa_logits_prefill.md) | `deepgemm_fp8` |
| `unified.dsa_moe.dsa.indexer.topk_prefill` | [dsa_topk_prefill](https://servingstudio.cs.washington.edu/kernels/dsa_topk_prefill.md) | `vllm_cuda` |
| `unified.dsa_moe.dsa.indexer.expand_pools` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.dsa.q_absorb` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_q_absorb_no_rope` |
| `unified.dsa_moe.dsa.q_concat` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.dsa.q_fp8_quant` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.dsa.sparse_mla.mla_cache_append` | [mla_cache_append](https://servingstudio.cs.washington.edu/kernels/mla_cache_append.md) | `vllm_cuda` |
| `unified.dsa_moe.dsa.sparse_mla.index_remap` | [dsa_sparse_index_remap](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_index_remap.md) | `vllm_triton` |
| `unified.dsa_moe.dsa.sparse_mla.prefill` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `flashinfer_trtllm_fp8` |
| `unified.dsa_moe.dsa.sparse_mla.decode` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `flashinfer_trtllm_fp8` |
| `unified.dsa_moe.dsa.output_copy` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.dsa.v_up` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_v_up_unpadded` |
| `unified.dsa_moe.dsa.o_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.dsa_moe.dsa.glue` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.dsa.prefill_glue` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.ffn_mhc_post_pre` | [mhc_fused_post_pre_rms_norm](https://servingstudio.cs.washington.edu/kernels/mhc_fused_post_pre_rms_norm.md) | `vllm_tilelang` |
| `unified.dsa_moe.moe.router.gate` | [gemm_fp32_output](https://servingstudio.cs.washington.edu/kernels/gemm_fp32_output.md) | `torch_cublas` |
| `unified.dsa_moe.moe.router.gate_recompute` | [gemm_fp32_output](https://servingstudio.cs.washington.edu/kernels/gemm_fp32_output.md) | `torch_cublas` |
| `unified.dsa_moe.moe.router_select` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.moe.input_glue` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.moe.shared_expert.gate_up` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.dsa_moe.moe.shared_expert.act_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.moe.shared_expert.down` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.dsa_moe.moe.dispatch_quant` | [nvfp4_quant](https://servingstudio.cs.washington.edu/kernels/nvfp4_quant.md) | `vllm_cuda` |
| `unified.dsa_moe.attn_mhc_post_pre` | [mhc_fused_post_pre_rms_norm](https://servingstudio.cs.washington.edu/kernels/mhc_fused_post_pre_rms_norm.md) | `vllm_tilelang` |
| `unified.dsa_moe.dsa.fused_qkv_a` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.dsa_moe.dsa.q_kv_a_norm` | [q_kv_rms_norm](https://servingstudio.cs.washington.edu/kernels/q_kv_rms_norm.md) | `vllm_triton` |
| `unified.dsa_moe.dsa.q_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.dsa_moe.dsa.indexer.wq_b` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.dsa_moe.dsa.indexer.wk_weights` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.dsa_moe.dsa.indexer.head_weights` | [gemm_fp32_output](https://servingstudio.cs.washington.edu/kernels/gemm_fp32_output.md) | `torch_cublas` |
| `unified.dsa_moe.dsa.indexer.k_norm` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.dsa.indexer.q_fwht_quant` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.dsa.indexer.weight_scale` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.dsa.indexer.kpool_gate_score` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.dsa_moe.dsa.indexer.prefill_gather` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.dsa.indexer.kpool_decode_update` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.dsa.indexer.kpool_prefill_write` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.dsa.indexer.kpool_tail_seed` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.dsa.indexer.mqa_logits_decode` | [dsa_paged_mqa_logits_decode](https://servingstudio.cs.washington.edu/kernels/dsa_paged_mqa_logits_decode.md) | `deepgemm_fp8` |
| `unified.dsa_moe.dsa.indexer.topk_decode` | [dsa_persistent_topk_decode](https://servingstudio.cs.washington.edu/kernels/dsa_persistent_topk_decode.md) | `vllm_cuda` |
| `unified.dsa_moe.dsa.indexer.mqa_logits_prefill` | [dsa_mqa_logits_prefill](https://servingstudio.cs.washington.edu/kernels/dsa_mqa_logits_prefill.md) | `deepgemm_fp8` |
| `unified.dsa_moe.dsa.indexer.topk_prefill` | [dsa_topk_prefill](https://servingstudio.cs.washington.edu/kernels/dsa_topk_prefill.md) | `vllm_cuda` |
| `unified.dsa_moe.dsa.indexer.expand_pools` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.dsa.q_absorb` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_q_absorb_no_rope` |
| `unified.dsa_moe.dsa.q_concat` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.dsa.q_fp8_quant` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.dsa.sparse_mla.mla_cache_append` | [mla_cache_append](https://servingstudio.cs.washington.edu/kernels/mla_cache_append.md) | `vllm_cuda` |
| `unified.dsa_moe.dsa.sparse_mla.index_remap` | [dsa_sparse_index_remap](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_index_remap.md) | `vllm_triton` |
| `unified.dsa_moe.dsa.sparse_mla.prefill` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `flashinfer_trtllm_fp8` |
| `unified.dsa_moe.dsa.sparse_mla.decode` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `flashinfer_trtllm_fp8` |
| `unified.dsa_moe.dsa.output_copy` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.dsa.v_up` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_v_up_unpadded` |
| `unified.dsa_moe.dsa.o_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.dsa_moe.dsa.glue` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.dsa.prefill_glue` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.ffn_mhc_post_pre` | [mhc_fused_post_pre_rms_norm](https://servingstudio.cs.washington.edu/kernels/mhc_fused_post_pre_rms_norm.md) | `vllm_tilelang` |
| `unified.dsa_moe.moe.router.gate` | [gemm_fp32_output](https://servingstudio.cs.washington.edu/kernels/gemm_fp32_output.md) | `torch_cublas` |
| `unified.dsa_moe.moe.router.gate_recompute` | [gemm_fp32_output](https://servingstudio.cs.washington.edu/kernels/gemm_fp32_output.md) | `torch_cublas` |
| `unified.dsa_moe.moe.router_select` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.moe.input_glue` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.moe.shared_expert.gate_up` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.dsa_moe.moe.shared_expert.act_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.moe.shared_expert.down` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.dsa_moe.moe.dispatch_quant` | [nvfp4_quant](https://servingstudio.cs.washington.edu/kernels/nvfp4_quant.md) | `vllm_cuda` |
| `unified.dsa_moe.moe.dispatch_all_gather` | [moe_ep_quantized_all_gather](https://servingstudio.cs.washington.edu/kernels/moe_ep_quantized_all_gather.md) | `vllm_pynccl` |
| `unified.dsa_moe.moe.routed_rank0.fused_moe` | [nvfp4_fused_moe](https://servingstudio.cs.washington.edu/kernels/nvfp4_fused_moe.md) | `flashinfer_trtllm_routed_sm100` |
| `unified.dsa_moe.moe.routed_rank1.fused_moe` | [nvfp4_fused_moe](https://servingstudio.cs.washington.edu/kernels/nvfp4_fused_moe.md) | `flashinfer_trtllm_routed_sm100` |
| `unified.dsa_moe.moe.routed_rank2.fused_moe` | [nvfp4_fused_moe](https://servingstudio.cs.washington.edu/kernels/nvfp4_fused_moe.md) | `flashinfer_trtllm_routed_sm100` |
| `unified.dsa_moe.moe.routed_rank3.fused_moe` | [nvfp4_fused_moe](https://servingstudio.cs.washington.edu/kernels/nvfp4_fused_moe.md) | `flashinfer_trtllm_routed_sm100` |
| `unified.dsa_moe.moe.combine_reduce_scatter` | [moe_ep_reduce_scatter](https://servingstudio.cs.washington.edu/kernels/moe_ep_reduce_scatter.md) | `vllm_pynccl` |
| `unified.dsa_moe.moe.shared_expert.gate_up` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.dsa_moe.moe.shared_expert.act_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.moe.shared_expert.down` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.dsa_moe.moe.shared_expert.gate_up` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.dsa_moe.moe.shared_expert.act_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.moe.shared_expert.down` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.dsa_moe.moe.shared_expert.gate_up` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.dsa_moe.moe.shared_expert.act_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.moe.shared_expert.down` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.dsa_moe.moe.shared_expert.gate_up` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.dsa_moe.moe.shared_expert.act_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.moe.shared_expert.down` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.dsa_moe.moe.combine_glue` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.moe.combine_glue` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.moe.combine_glue` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.dsa_moe.moe.combine_glue` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_moe.attn_mhc_post_pre` | [mhc_fused_post_pre_rms_norm](https://servingstudio.cs.washington.edu/kernels/mhc_fused_post_pre_rms_norm.md) | `vllm_tilelang` |
| `unified.kda_moe.kda.in_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.kda_moe.kda.f_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.kda_moe.kda.g_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.kda_moe.kda.short_conv_prefill` | [gdn_causal_conv_prefill](https://servingstudio.cs.washington.edu/kernels/gdn_causal_conv_prefill.md) | `vllm_triton` |
| `unified.kda_moe.kda.short_conv_decode` | [gdn_causal_conv_decode](https://servingstudio.cs.washington.edu/kernels/gdn_causal_conv_decode.md) | `vllm_triton` |
| `unified.kda_moe.kda.prefill_glue` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_moe.kda.state_gather` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_moe.kda.chunk_prefill` | [kda_chunk_prefill](https://servingstudio.cs.washington.edu/kernels/kda_chunk_prefill.md) | `vllm_triton` |
| `unified.kda_moe.kda.recurrent_decode` | [kda_recurrent_decode](https://servingstudio.cs.washington.edu/kernels/kda_recurrent_decode.md) | `vllm_triton` |
| `unified.kda_moe.kda.state_scatter` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_moe.kda.gated_norm` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_moe.kda.o_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.kda_moe.ffn_mhc_post_pre` | [mhc_fused_post_pre_rms_norm](https://servingstudio.cs.washington.edu/kernels/mhc_fused_post_pre_rms_norm.md) | `vllm_tilelang` |
| `unified.kda_moe.moe.router.gate` | [gemm_fp32_output](https://servingstudio.cs.washington.edu/kernels/gemm_fp32_output.md) | `torch_cublas` |
| `unified.kda_moe.moe.router.gate_recompute` | [gemm_fp32_output](https://servingstudio.cs.washington.edu/kernels/gemm_fp32_output.md) | `torch_cublas` |
| `unified.kda_moe.moe.router_select` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_moe.moe.input_glue` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_moe.moe.shared_expert.gate_up` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.kda_moe.moe.shared_expert.act_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_moe.moe.shared_expert.down` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.kda_moe.moe.dispatch_quant` | [nvfp4_quant](https://servingstudio.cs.washington.edu/kernels/nvfp4_quant.md) | `vllm_cuda` |
| `unified.kda_moe.attn_mhc_post_pre` | [mhc_fused_post_pre_rms_norm](https://servingstudio.cs.washington.edu/kernels/mhc_fused_post_pre_rms_norm.md) | `vllm_tilelang` |
| `unified.kda_moe.kda.in_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.kda_moe.kda.f_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.kda_moe.kda.g_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.kda_moe.kda.short_conv_prefill` | [gdn_causal_conv_prefill](https://servingstudio.cs.washington.edu/kernels/gdn_causal_conv_prefill.md) | `vllm_triton` |
| `unified.kda_moe.kda.short_conv_decode` | [gdn_causal_conv_decode](https://servingstudio.cs.washington.edu/kernels/gdn_causal_conv_decode.md) | `vllm_triton` |
| `unified.kda_moe.kda.prefill_glue` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_moe.kda.state_gather` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_moe.kda.chunk_prefill` | [kda_chunk_prefill](https://servingstudio.cs.washington.edu/kernels/kda_chunk_prefill.md) | `vllm_triton` |
| `unified.kda_moe.kda.recurrent_decode` | [kda_recurrent_decode](https://servingstudio.cs.washington.edu/kernels/kda_recurrent_decode.md) | `vllm_triton` |
| `unified.kda_moe.kda.state_scatter` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_moe.kda.gated_norm` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_moe.kda.o_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.kda_moe.ffn_mhc_post_pre` | [mhc_fused_post_pre_rms_norm](https://servingstudio.cs.washington.edu/kernels/mhc_fused_post_pre_rms_norm.md) | `vllm_tilelang` |
| `unified.kda_moe.moe.router.gate` | [gemm_fp32_output](https://servingstudio.cs.washington.edu/kernels/gemm_fp32_output.md) | `torch_cublas` |
| `unified.kda_moe.moe.router.gate_recompute` | [gemm_fp32_output](https://servingstudio.cs.washington.edu/kernels/gemm_fp32_output.md) | `torch_cublas` |
| `unified.kda_moe.moe.router_select` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_moe.moe.input_glue` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_moe.moe.shared_expert.gate_up` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.kda_moe.moe.shared_expert.act_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_moe.moe.shared_expert.down` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.kda_moe.moe.dispatch_quant` | [nvfp4_quant](https://servingstudio.cs.washington.edu/kernels/nvfp4_quant.md) | `vllm_cuda` |
| `unified.kda_moe.attn_mhc_post_pre` | [mhc_fused_post_pre_rms_norm](https://servingstudio.cs.washington.edu/kernels/mhc_fused_post_pre_rms_norm.md) | `vllm_tilelang` |
| `unified.kda_moe.kda.in_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.kda_moe.kda.f_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.kda_moe.kda.g_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.kda_moe.kda.short_conv_prefill` | [gdn_causal_conv_prefill](https://servingstudio.cs.washington.edu/kernels/gdn_causal_conv_prefill.md) | `vllm_triton` |
| `unified.kda_moe.kda.short_conv_decode` | [gdn_causal_conv_decode](https://servingstudio.cs.washington.edu/kernels/gdn_causal_conv_decode.md) | `vllm_triton` |
| `unified.kda_moe.kda.prefill_glue` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_moe.kda.state_gather` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_moe.kda.chunk_prefill` | [kda_chunk_prefill](https://servingstudio.cs.washington.edu/kernels/kda_chunk_prefill.md) | `vllm_triton` |
| `unified.kda_moe.kda.recurrent_decode` | [kda_recurrent_decode](https://servingstudio.cs.washington.edu/kernels/kda_recurrent_decode.md) | `vllm_triton` |
| `unified.kda_moe.kda.state_scatter` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_moe.kda.gated_norm` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_moe.kda.o_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.kda_moe.ffn_mhc_post_pre` | [mhc_fused_post_pre_rms_norm](https://servingstudio.cs.washington.edu/kernels/mhc_fused_post_pre_rms_norm.md) | `vllm_tilelang` |
| `unified.kda_moe.moe.router.gate` | [gemm_fp32_output](https://servingstudio.cs.washington.edu/kernels/gemm_fp32_output.md) | `torch_cublas` |
| `unified.kda_moe.moe.router.gate_recompute` | [gemm_fp32_output](https://servingstudio.cs.washington.edu/kernels/gemm_fp32_output.md) | `torch_cublas` |
| `unified.kda_moe.moe.router_select` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_moe.moe.input_glue` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_moe.moe.shared_expert.gate_up` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.kda_moe.moe.shared_expert.act_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_moe.moe.shared_expert.down` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.kda_moe.moe.dispatch_quant` | [nvfp4_quant](https://servingstudio.cs.washington.edu/kernels/nvfp4_quant.md) | `vllm_cuda` |
| `unified.kda_moe.attn_mhc_post_pre` | [mhc_fused_post_pre_rms_norm](https://servingstudio.cs.washington.edu/kernels/mhc_fused_post_pre_rms_norm.md) | `vllm_tilelang` |
| `unified.kda_moe.kda.in_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.kda_moe.kda.f_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.kda_moe.kda.g_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.kda_moe.kda.short_conv_prefill` | [gdn_causal_conv_prefill](https://servingstudio.cs.washington.edu/kernels/gdn_causal_conv_prefill.md) | `vllm_triton` |
| `unified.kda_moe.kda.short_conv_decode` | [gdn_causal_conv_decode](https://servingstudio.cs.washington.edu/kernels/gdn_causal_conv_decode.md) | `vllm_triton` |
| `unified.kda_moe.kda.prefill_glue` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_moe.kda.state_gather` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_moe.kda.chunk_prefill` | [kda_chunk_prefill](https://servingstudio.cs.washington.edu/kernels/kda_chunk_prefill.md) | `vllm_triton` |
| `unified.kda_moe.kda.recurrent_decode` | [kda_recurrent_decode](https://servingstudio.cs.washington.edu/kernels/kda_recurrent_decode.md) | `vllm_triton` |
| `unified.kda_moe.kda.state_scatter` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_moe.kda.gated_norm` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_moe.kda.o_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.kda_moe.ffn_mhc_post_pre` | [mhc_fused_post_pre_rms_norm](https://servingstudio.cs.washington.edu/kernels/mhc_fused_post_pre_rms_norm.md) | `vllm_tilelang` |
| `unified.kda_moe.moe.router.gate` | [gemm_fp32_output](https://servingstudio.cs.washington.edu/kernels/gemm_fp32_output.md) | `torch_cublas` |
| `unified.kda_moe.moe.router.gate_recompute` | [gemm_fp32_output](https://servingstudio.cs.washington.edu/kernels/gemm_fp32_output.md) | `torch_cublas` |
| `unified.kda_moe.moe.router_select` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_moe.moe.input_glue` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_moe.moe.shared_expert.gate_up` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.kda_moe.moe.shared_expert.act_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_moe.moe.shared_expert.down` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.kda_moe.moe.dispatch_quant` | [nvfp4_quant](https://servingstudio.cs.washington.edu/kernels/nvfp4_quant.md) | `vllm_cuda` |
| `unified.kda_moe.moe.dispatch_all_gather` | [moe_ep_quantized_all_gather](https://servingstudio.cs.washington.edu/kernels/moe_ep_quantized_all_gather.md) | `vllm_pynccl` |
| `unified.kda_moe.moe.routed_rank0.fused_moe` | [nvfp4_fused_moe](https://servingstudio.cs.washington.edu/kernels/nvfp4_fused_moe.md) | `flashinfer_trtllm_routed_sm100` |
| `unified.kda_moe.moe.routed_rank1.fused_moe` | [nvfp4_fused_moe](https://servingstudio.cs.washington.edu/kernels/nvfp4_fused_moe.md) | `flashinfer_trtllm_routed_sm100` |
| `unified.kda_moe.moe.routed_rank2.fused_moe` | [nvfp4_fused_moe](https://servingstudio.cs.washington.edu/kernels/nvfp4_fused_moe.md) | `flashinfer_trtllm_routed_sm100` |
| `unified.kda_moe.moe.routed_rank3.fused_moe` | [nvfp4_fused_moe](https://servingstudio.cs.washington.edu/kernels/nvfp4_fused_moe.md) | `flashinfer_trtllm_routed_sm100` |
| `unified.kda_moe.moe.combine_reduce_scatter` | [moe_ep_reduce_scatter](https://servingstudio.cs.washington.edu/kernels/moe_ep_reduce_scatter.md) | `vllm_pynccl` |
| `unified.kda_moe.moe.shared_expert.gate_up` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.kda_moe.moe.shared_expert.act_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_moe.moe.shared_expert.down` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.kda_moe.moe.shared_expert.gate_up` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.kda_moe.moe.shared_expert.act_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_moe.moe.shared_expert.down` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.kda_moe.moe.shared_expert.gate_up` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.kda_moe.moe.shared_expert.act_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_moe.moe.shared_expert.down` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.kda_moe.moe.shared_expert.gate_up` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.kda_moe.moe.shared_expert.act_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_moe.moe.shared_expert.down` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.kda_moe.moe.combine_glue` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_moe.moe.combine_glue` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_moe.moe.combine_glue` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.kda_moe.moe.combine_glue` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.final_mhc_post` | [mhc_fused_post_pre_rms_norm](https://servingstudio.cs.washington.edu/kernels/mhc_fused_post_pre_rms_norm.md) | `vllm_tilelang` |
| `unified.hc_contract_mean` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.final_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `vllm_cuda` |
| `unified.lm_head` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.final_mhc_post` | [mhc_fused_post_pre_rms_norm](https://servingstudio.cs.washington.edu/kernels/mhc_fused_post_pre_rms_norm.md) | `vllm_tilelang` |
| `unified.hc_contract_mean` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.final_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `vllm_cuda` |
| `unified.lm_head` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.final_mhc_post` | [mhc_fused_post_pre_rms_norm](https://servingstudio.cs.washington.edu/kernels/mhc_fused_post_pre_rms_norm.md) | `vllm_tilelang` |
| `unified.hc_contract_mean` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.final_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `vllm_cuda` |
| `unified.lm_head` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |
| `unified.final_mhc_post` | [mhc_fused_post_pre_rms_norm](https://servingstudio.cs.washington.edu/kernels/mhc_fused_post_pre_rms_norm.md) | `vllm_tilelang` |
| `unified.hc_contract_mean` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.final_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `vllm_cuda` |
| `unified.lm_head` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear_vllm` |

## Simulations that run it

- [`GLM-5.3-Flash-NVFP4/glm53_flash_vllm_nvfp4_dp_attn_ep_moe_chunked_prefill`](https://servingstudio.cs.washington.edu/simulate.html?preset=GLM-5.3-Flash-NVFP4%2Fglm53_flash_vllm_nvfp4_dp_attn_ep_moe_chunked_prefill): unified deployment, 12 configurations

## API

- This deployment in the model list: https://servingstudio.cs.washington.edu/api/public/v1/models
- The kernels of one configuration: https://servingstudio.cs.washington.edu/api/public/v1/models/GLM-5.3-Flash-NVFP4/glm53_flash_vllm_nvfp4_dp_attn_ep_moe/tree?ep_size=4&max_model_len=8192&workload=balanced_c32

---

This page as Markdown: https://servingstudio.cs.washington.edu/models/GLM-5.3-Flash-NVFP4/glm53_flash_vllm_nvfp4_dp_attn_ep_moe.md. A guide to the whole site for AI agents: [llms.txt](https://servingstudio.cs.washington.edu/llms.txt).
