# GLM-5.2 FP8: vLLM, DP attention, EP | ServingStudio Models

Deployment `GLM-5.2-FP8/glm52_vllm_dsa_moe` of GLM-5.2 FP8 (`zai-org/GLM-5.2-FP8`, family GLM). Arch `glm52_vllm_dsa_moe`; Whole iteration; GPU NVIDIA H200. Interactive page, with its cost tree and live prediction: https://servingstudio.cs.washington.edu/models.html?preset=GLM-5.2-FP8%2Fglm52_vllm_dsa_moe. All models: https://servingstudio.cs.washington.edu/models.md.

## Configurations

The preset sweeps `workload`; each configuration (member) is one value of each.

| Parameters | GPUs per replica | Case form | Groups | max_model_len | Can be timed |
| --- | --- | --- | --- | --- | --- |
| workload ctx8k_out1k | 8 | `iter` | 8 | 1,048,576 | yes |
| workload uniform | 8 | `iter` | 8 | 1,048,576 | yes |

## Timing a batch

`POST https://servingstudio.cs.washington.edu/api/public/v1/predict` with the preset id, one configuration's `params` and 1 to 64 `cases`. A case is `{"groups": [...]}`, one object per group (the table's Groups column), each with the fields of the configuration's case form. The answer gives each case's time per section and per node of its cost tree. The servingstudio-timing-predict skill walks through it: https://servingstudio.cs.washington.edu/skills/servingstudio-timing-predict.md.

```json
{"preset":"GLM-5.2-FP8/glm52_vllm_dsa_moe","params":{"workload":"ctx8k_out1k"},"cases":["…"]}
```

Fields of a group for case form `iter`:

| Field | Type | Required | Meaning |
| --- | --- | --- | --- |
| `prefill_chunk_pairs` | int_pair_list | no | Prefill requests, one `[prefix_len, append_len]` each: the tokens already in the KV cache and the tokens this iteration computes (`prefix_len` 0 for a fresh prompt). |
| `decode_kv_lens` | int_list | no | Decode requests, one KV length each: the context its new token attends to. Give this or `decode_count`, not both. |
| `decode_count` | int | no | Shorthand for `decode_kv_lens`: this many decode requests, each `average_decode_length` long. |
| `average_decode_length` | int | no | The KV length of each `decode_count` request; required with it. |

## Kernels of configuration workload ctx8k_out1k

Each section's leaf slots, in order: the kernel kind each calls and the backends measured for it. Other configurations share the shape but not every size.

### Section `iter`

| Slot | Kernel | Backends |
| --- | --- | --- |
| `unified.main.embedding` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.main.embedding` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.main.embedding` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.main.embedding` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.main.embedding` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.main.embedding` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.main.embedding` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.main.embedding` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.input_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.fused_qkv_a_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.fused_qkv_a_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.attention.q_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.dense_full_index.attention.q_b_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.q_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.attention.kv_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.dense_full_index.attention.main_rope` | [vllm_mla_rope](https://servingstudio.cs.washington.edu/kernels/vllm_mla_rope.md) | `vllm_inductor` |
| `unified.body.dense_full_index.attention.indexer_q_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.indexer.q_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.attention.indexer.wk_weights_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.attention.indexer.k_layernorm` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.rope` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.q_quant` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.weight_scale` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.index_cache_append` | [dsa_index_cache_append](https://servingstudio.cs.washington.edu/kernels/dsa_index_cache_append.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.indexer.topk_buffer_fill` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.prefill_cache_gather` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.prefill_logits` | [dsa_mqa_logits_prefill](https://servingstudio.cs.washington.edu/kernels/dsa_mqa_logits_prefill.md) | `deepgemm_fp8` |
| `unified.body.dense_full_index.attention.indexer.prefill_topk` | [dsa_topk_prefill](https://servingstudio.cs.washington.edu/kernels/dsa_topk_prefill.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.indexer.decode_pack` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.decode_logits` | [dsa_paged_mqa_logits_decode](https://servingstudio.cs.washington.edu/kernels/dsa_paged_mqa_logits_decode.md) | `deepgemm_fp8` |
| `unified.body.dense_full_index.attention.indexer.decode_topk` | [dsa_persistent_topk_decode](https://servingstudio.cs.washington.edu/kernels/dsa_persistent_topk_decode.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.indexer.decode_unpack` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.q_absorb` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_q_absorb` |
| `unified.body.dense_full_index.attention.sparse_mla.query_concat` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.sparse_mla.mla_cache_append` | [mla_cache_append](https://servingstudio.cs.washington.edu/kernels/mla_cache_append.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.sparse_mla.index_remap` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.sparse_mla.prefill` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.dense_full_index.attention.sparse_mla.decode` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.dense_full_index.attention.v_up` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_v_up` |
| `unified.body.dense_full_index.attention.o_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.o_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.attention.input_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.fused_qkv_a_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.fused_qkv_a_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.attention.q_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.dense_full_index.attention.q_b_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.q_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.attention.kv_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.dense_full_index.attention.main_rope` | [vllm_mla_rope](https://servingstudio.cs.washington.edu/kernels/vllm_mla_rope.md) | `vllm_inductor` |
| `unified.body.dense_full_index.attention.indexer_q_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.indexer.q_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.attention.indexer.wk_weights_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.attention.indexer.k_layernorm` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.rope` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.q_quant` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.weight_scale` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.index_cache_append` | [dsa_index_cache_append](https://servingstudio.cs.washington.edu/kernels/dsa_index_cache_append.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.indexer.topk_buffer_fill` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.prefill_cache_gather` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.prefill_logits` | [dsa_mqa_logits_prefill](https://servingstudio.cs.washington.edu/kernels/dsa_mqa_logits_prefill.md) | `deepgemm_fp8` |
| `unified.body.dense_full_index.attention.indexer.prefill_topk` | [dsa_topk_prefill](https://servingstudio.cs.washington.edu/kernels/dsa_topk_prefill.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.indexer.decode_pack` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.decode_logits` | [dsa_paged_mqa_logits_decode](https://servingstudio.cs.washington.edu/kernels/dsa_paged_mqa_logits_decode.md) | `deepgemm_fp8` |
| `unified.body.dense_full_index.attention.indexer.decode_topk` | [dsa_persistent_topk_decode](https://servingstudio.cs.washington.edu/kernels/dsa_persistent_topk_decode.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.indexer.decode_unpack` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.q_absorb` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_q_absorb` |
| `unified.body.dense_full_index.attention.sparse_mla.query_concat` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.sparse_mla.mla_cache_append` | [mla_cache_append](https://servingstudio.cs.washington.edu/kernels/mla_cache_append.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.sparse_mla.index_remap` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.sparse_mla.prefill` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.dense_full_index.attention.sparse_mla.decode` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.dense_full_index.attention.v_up` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_v_up` |
| `unified.body.dense_full_index.attention.o_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.o_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.attention.input_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.fused_qkv_a_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.fused_qkv_a_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.attention.q_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.dense_full_index.attention.q_b_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.q_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.attention.kv_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.dense_full_index.attention.main_rope` | [vllm_mla_rope](https://servingstudio.cs.washington.edu/kernels/vllm_mla_rope.md) | `vllm_inductor` |
| `unified.body.dense_full_index.attention.indexer_q_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.indexer.q_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.attention.indexer.wk_weights_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.attention.indexer.k_layernorm` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.rope` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.q_quant` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.weight_scale` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.index_cache_append` | [dsa_index_cache_append](https://servingstudio.cs.washington.edu/kernels/dsa_index_cache_append.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.indexer.topk_buffer_fill` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.prefill_cache_gather` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.prefill_logits` | [dsa_mqa_logits_prefill](https://servingstudio.cs.washington.edu/kernels/dsa_mqa_logits_prefill.md) | `deepgemm_fp8` |
| `unified.body.dense_full_index.attention.indexer.prefill_topk` | [dsa_topk_prefill](https://servingstudio.cs.washington.edu/kernels/dsa_topk_prefill.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.indexer.decode_pack` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.decode_logits` | [dsa_paged_mqa_logits_decode](https://servingstudio.cs.washington.edu/kernels/dsa_paged_mqa_logits_decode.md) | `deepgemm_fp8` |
| `unified.body.dense_full_index.attention.indexer.decode_topk` | [dsa_persistent_topk_decode](https://servingstudio.cs.washington.edu/kernels/dsa_persistent_topk_decode.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.indexer.decode_unpack` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.q_absorb` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_q_absorb` |
| `unified.body.dense_full_index.attention.sparse_mla.query_concat` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.sparse_mla.mla_cache_append` | [mla_cache_append](https://servingstudio.cs.washington.edu/kernels/mla_cache_append.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.sparse_mla.index_remap` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.sparse_mla.prefill` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.dense_full_index.attention.sparse_mla.decode` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.dense_full_index.attention.v_up` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_v_up` |
| `unified.body.dense_full_index.attention.o_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.o_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.attention.input_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.fused_qkv_a_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.fused_qkv_a_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.attention.q_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.dense_full_index.attention.q_b_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.q_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.attention.kv_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.dense_full_index.attention.main_rope` | [vllm_mla_rope](https://servingstudio.cs.washington.edu/kernels/vllm_mla_rope.md) | `vllm_inductor` |
| `unified.body.dense_full_index.attention.indexer_q_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.indexer.q_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.attention.indexer.wk_weights_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.attention.indexer.k_layernorm` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.rope` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.q_quant` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.weight_scale` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.index_cache_append` | [dsa_index_cache_append](https://servingstudio.cs.washington.edu/kernels/dsa_index_cache_append.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.indexer.topk_buffer_fill` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.prefill_cache_gather` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.prefill_logits` | [dsa_mqa_logits_prefill](https://servingstudio.cs.washington.edu/kernels/dsa_mqa_logits_prefill.md) | `deepgemm_fp8` |
| `unified.body.dense_full_index.attention.indexer.prefill_topk` | [dsa_topk_prefill](https://servingstudio.cs.washington.edu/kernels/dsa_topk_prefill.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.indexer.decode_pack` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.decode_logits` | [dsa_paged_mqa_logits_decode](https://servingstudio.cs.washington.edu/kernels/dsa_paged_mqa_logits_decode.md) | `deepgemm_fp8` |
| `unified.body.dense_full_index.attention.indexer.decode_topk` | [dsa_persistent_topk_decode](https://servingstudio.cs.washington.edu/kernels/dsa_persistent_topk_decode.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.indexer.decode_unpack` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.q_absorb` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_q_absorb` |
| `unified.body.dense_full_index.attention.sparse_mla.query_concat` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.sparse_mla.mla_cache_append` | [mla_cache_append](https://servingstudio.cs.washington.edu/kernels/mla_cache_append.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.sparse_mla.index_remap` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.sparse_mla.prefill` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.dense_full_index.attention.sparse_mla.decode` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.dense_full_index.attention.v_up` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_v_up` |
| `unified.body.dense_full_index.attention.o_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.o_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.attention.input_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.fused_qkv_a_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.fused_qkv_a_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.attention.q_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.dense_full_index.attention.q_b_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.q_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.attention.kv_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.dense_full_index.attention.main_rope` | [vllm_mla_rope](https://servingstudio.cs.washington.edu/kernels/vllm_mla_rope.md) | `vllm_inductor` |
| `unified.body.dense_full_index.attention.indexer_q_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.indexer.q_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.attention.indexer.wk_weights_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.attention.indexer.k_layernorm` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.rope` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.q_quant` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.weight_scale` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.index_cache_append` | [dsa_index_cache_append](https://servingstudio.cs.washington.edu/kernels/dsa_index_cache_append.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.indexer.topk_buffer_fill` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.prefill_cache_gather` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.prefill_logits` | [dsa_mqa_logits_prefill](https://servingstudio.cs.washington.edu/kernels/dsa_mqa_logits_prefill.md) | `deepgemm_fp8` |
| `unified.body.dense_full_index.attention.indexer.prefill_topk` | [dsa_topk_prefill](https://servingstudio.cs.washington.edu/kernels/dsa_topk_prefill.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.indexer.decode_pack` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.decode_logits` | [dsa_paged_mqa_logits_decode](https://servingstudio.cs.washington.edu/kernels/dsa_paged_mqa_logits_decode.md) | `deepgemm_fp8` |
| `unified.body.dense_full_index.attention.indexer.decode_topk` | [dsa_persistent_topk_decode](https://servingstudio.cs.washington.edu/kernels/dsa_persistent_topk_decode.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.indexer.decode_unpack` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.q_absorb` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_q_absorb` |
| `unified.body.dense_full_index.attention.sparse_mla.query_concat` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.sparse_mla.mla_cache_append` | [mla_cache_append](https://servingstudio.cs.washington.edu/kernels/mla_cache_append.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.sparse_mla.index_remap` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.sparse_mla.prefill` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.dense_full_index.attention.sparse_mla.decode` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.dense_full_index.attention.v_up` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_v_up` |
| `unified.body.dense_full_index.attention.o_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.o_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.attention.input_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.fused_qkv_a_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.fused_qkv_a_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.attention.q_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.dense_full_index.attention.q_b_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.q_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.attention.kv_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.dense_full_index.attention.main_rope` | [vllm_mla_rope](https://servingstudio.cs.washington.edu/kernels/vllm_mla_rope.md) | `vllm_inductor` |
| `unified.body.dense_full_index.attention.indexer_q_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.indexer.q_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.attention.indexer.wk_weights_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.attention.indexer.k_layernorm` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.rope` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.q_quant` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.weight_scale` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.index_cache_append` | [dsa_index_cache_append](https://servingstudio.cs.washington.edu/kernels/dsa_index_cache_append.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.indexer.topk_buffer_fill` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.prefill_cache_gather` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.prefill_logits` | [dsa_mqa_logits_prefill](https://servingstudio.cs.washington.edu/kernels/dsa_mqa_logits_prefill.md) | `deepgemm_fp8` |
| `unified.body.dense_full_index.attention.indexer.prefill_topk` | [dsa_topk_prefill](https://servingstudio.cs.washington.edu/kernels/dsa_topk_prefill.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.indexer.decode_pack` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.decode_logits` | [dsa_paged_mqa_logits_decode](https://servingstudio.cs.washington.edu/kernels/dsa_paged_mqa_logits_decode.md) | `deepgemm_fp8` |
| `unified.body.dense_full_index.attention.indexer.decode_topk` | [dsa_persistent_topk_decode](https://servingstudio.cs.washington.edu/kernels/dsa_persistent_topk_decode.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.indexer.decode_unpack` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.q_absorb` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_q_absorb` |
| `unified.body.dense_full_index.attention.sparse_mla.query_concat` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.sparse_mla.mla_cache_append` | [mla_cache_append](https://servingstudio.cs.washington.edu/kernels/mla_cache_append.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.sparse_mla.index_remap` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.sparse_mla.prefill` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.dense_full_index.attention.sparse_mla.decode` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.dense_full_index.attention.v_up` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_v_up` |
| `unified.body.dense_full_index.attention.o_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.o_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.attention.input_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.fused_qkv_a_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.fused_qkv_a_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.attention.q_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.dense_full_index.attention.q_b_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.q_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.attention.kv_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.dense_full_index.attention.main_rope` | [vllm_mla_rope](https://servingstudio.cs.washington.edu/kernels/vllm_mla_rope.md) | `vllm_inductor` |
| `unified.body.dense_full_index.attention.indexer_q_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.indexer.q_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.attention.indexer.wk_weights_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.attention.indexer.k_layernorm` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.rope` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.q_quant` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.weight_scale` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.index_cache_append` | [dsa_index_cache_append](https://servingstudio.cs.washington.edu/kernels/dsa_index_cache_append.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.indexer.topk_buffer_fill` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.prefill_cache_gather` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.prefill_logits` | [dsa_mqa_logits_prefill](https://servingstudio.cs.washington.edu/kernels/dsa_mqa_logits_prefill.md) | `deepgemm_fp8` |
| `unified.body.dense_full_index.attention.indexer.prefill_topk` | [dsa_topk_prefill](https://servingstudio.cs.washington.edu/kernels/dsa_topk_prefill.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.indexer.decode_pack` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.decode_logits` | [dsa_paged_mqa_logits_decode](https://servingstudio.cs.washington.edu/kernels/dsa_paged_mqa_logits_decode.md) | `deepgemm_fp8` |
| `unified.body.dense_full_index.attention.indexer.decode_topk` | [dsa_persistent_topk_decode](https://servingstudio.cs.washington.edu/kernels/dsa_persistent_topk_decode.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.indexer.decode_unpack` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.q_absorb` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_q_absorb` |
| `unified.body.dense_full_index.attention.sparse_mla.query_concat` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.sparse_mla.mla_cache_append` | [mla_cache_append](https://servingstudio.cs.washington.edu/kernels/mla_cache_append.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.sparse_mla.index_remap` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.sparse_mla.prefill` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.dense_full_index.attention.sparse_mla.decode` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.dense_full_index.attention.v_up` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_v_up` |
| `unified.body.dense_full_index.attention.o_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.o_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.attention.input_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.fused_qkv_a_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.fused_qkv_a_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.attention.q_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.dense_full_index.attention.q_b_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.q_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.attention.kv_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.dense_full_index.attention.main_rope` | [vllm_mla_rope](https://servingstudio.cs.washington.edu/kernels/vllm_mla_rope.md) | `vllm_inductor` |
| `unified.body.dense_full_index.attention.indexer_q_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.indexer.q_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.attention.indexer.wk_weights_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.attention.indexer.k_layernorm` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.rope` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.q_quant` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.weight_scale` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.index_cache_append` | [dsa_index_cache_append](https://servingstudio.cs.washington.edu/kernels/dsa_index_cache_append.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.indexer.topk_buffer_fill` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.prefill_cache_gather` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.prefill_logits` | [dsa_mqa_logits_prefill](https://servingstudio.cs.washington.edu/kernels/dsa_mqa_logits_prefill.md) | `deepgemm_fp8` |
| `unified.body.dense_full_index.attention.indexer.prefill_topk` | [dsa_topk_prefill](https://servingstudio.cs.washington.edu/kernels/dsa_topk_prefill.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.indexer.decode_pack` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.indexer.decode_logits` | [dsa_paged_mqa_logits_decode](https://servingstudio.cs.washington.edu/kernels/dsa_paged_mqa_logits_decode.md) | `deepgemm_fp8` |
| `unified.body.dense_full_index.attention.indexer.decode_topk` | [dsa_persistent_topk_decode](https://servingstudio.cs.washington.edu/kernels/dsa_persistent_topk_decode.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.indexer.decode_unpack` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.q_absorb` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_q_absorb` |
| `unified.body.dense_full_index.attention.sparse_mla.query_concat` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.sparse_mla.mla_cache_append` | [mla_cache_append](https://servingstudio.cs.washington.edu/kernels/mla_cache_append.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.sparse_mla.index_remap` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.attention.sparse_mla.prefill` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.dense_full_index.attention.sparse_mla.decode` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.dense_full_index.attention.v_up` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_v_up` |
| `unified.body.dense_full_index.attention.o_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.dense_full_index.attention.o_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.ffn.post_attn_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.dense_full_index.ffn.gate_up_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.dense_full_index.ffn.gate_up_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.ffn.silu_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.ffn.down_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.dense_full_index.ffn.down_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.ffn.post_attn_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.dense_full_index.ffn.gate_up_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.dense_full_index.ffn.gate_up_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.ffn.silu_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.ffn.down_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.dense_full_index.ffn.down_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.ffn.post_attn_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.dense_full_index.ffn.gate_up_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.dense_full_index.ffn.gate_up_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.ffn.silu_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.ffn.down_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.dense_full_index.ffn.down_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.ffn.post_attn_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.dense_full_index.ffn.gate_up_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.dense_full_index.ffn.gate_up_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.ffn.silu_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.ffn.down_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.dense_full_index.ffn.down_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.ffn.post_attn_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.dense_full_index.ffn.gate_up_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.dense_full_index.ffn.gate_up_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.ffn.silu_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.ffn.down_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.dense_full_index.ffn.down_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.ffn.post_attn_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.dense_full_index.ffn.gate_up_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.dense_full_index.ffn.gate_up_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.ffn.silu_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.ffn.down_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.dense_full_index.ffn.down_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.ffn.post_attn_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.dense_full_index.ffn.gate_up_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.dense_full_index.ffn.gate_up_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.ffn.silu_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.ffn.down_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.dense_full_index.ffn.down_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.ffn.post_attn_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.dense_full_index.ffn.gate_up_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.dense_full_index.ffn.gate_up_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.dense_full_index.ffn.silu_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.dense_full_index.ffn.down_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.dense_full_index.ffn.down_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_initial_index_share.attention.input_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.attention.fused_qkv_a_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.attention.fused_qkv_a_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_initial_index_share.attention.q_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.sparse_initial_index_share.attention.q_b_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.attention.q_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_initial_index_share.attention.kv_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.sparse_initial_index_share.attention.main_rope` | [vllm_mla_rope](https://servingstudio.cs.washington.edu/kernels/vllm_mla_rope.md) | `vllm_inductor` |
| `unified.body.sparse_initial_index_share.attention.q_absorb` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_q_absorb` |
| `unified.body.sparse_initial_index_share.attention.sparse_mla.query_concat` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.attention.sparse_mla.mla_cache_append` | [mla_cache_append](https://servingstudio.cs.washington.edu/kernels/mla_cache_append.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.attention.sparse_mla.index_remap` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.attention.sparse_mla.prefill` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.sparse_initial_index_share.attention.sparse_mla.decode` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.sparse_initial_index_share.attention.v_up` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_v_up` |
| `unified.body.sparse_initial_index_share.attention.o_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.attention.o_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_initial_index_share.attention.input_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.attention.fused_qkv_a_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.attention.fused_qkv_a_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_initial_index_share.attention.q_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.sparse_initial_index_share.attention.q_b_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.attention.q_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_initial_index_share.attention.kv_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.sparse_initial_index_share.attention.main_rope` | [vllm_mla_rope](https://servingstudio.cs.washington.edu/kernels/vllm_mla_rope.md) | `vllm_inductor` |
| `unified.body.sparse_initial_index_share.attention.q_absorb` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_q_absorb` |
| `unified.body.sparse_initial_index_share.attention.sparse_mla.query_concat` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.attention.sparse_mla.mla_cache_append` | [mla_cache_append](https://servingstudio.cs.washington.edu/kernels/mla_cache_append.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.attention.sparse_mla.index_remap` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.attention.sparse_mla.prefill` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.sparse_initial_index_share.attention.sparse_mla.decode` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.sparse_initial_index_share.attention.v_up` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_v_up` |
| `unified.body.sparse_initial_index_share.attention.o_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.attention.o_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_initial_index_share.attention.input_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.attention.fused_qkv_a_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.attention.fused_qkv_a_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_initial_index_share.attention.q_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.sparse_initial_index_share.attention.q_b_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.attention.q_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_initial_index_share.attention.kv_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.sparse_initial_index_share.attention.main_rope` | [vllm_mla_rope](https://servingstudio.cs.washington.edu/kernels/vllm_mla_rope.md) | `vllm_inductor` |
| `unified.body.sparse_initial_index_share.attention.q_absorb` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_q_absorb` |
| `unified.body.sparse_initial_index_share.attention.sparse_mla.query_concat` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.attention.sparse_mla.mla_cache_append` | [mla_cache_append](https://servingstudio.cs.washington.edu/kernels/mla_cache_append.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.attention.sparse_mla.index_remap` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.attention.sparse_mla.prefill` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.sparse_initial_index_share.attention.sparse_mla.decode` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.sparse_initial_index_share.attention.v_up` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_v_up` |
| `unified.body.sparse_initial_index_share.attention.o_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.attention.o_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_initial_index_share.attention.input_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.attention.fused_qkv_a_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.attention.fused_qkv_a_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_initial_index_share.attention.q_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.sparse_initial_index_share.attention.q_b_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.attention.q_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_initial_index_share.attention.kv_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.sparse_initial_index_share.attention.main_rope` | [vllm_mla_rope](https://servingstudio.cs.washington.edu/kernels/vllm_mla_rope.md) | `vllm_inductor` |
| `unified.body.sparse_initial_index_share.attention.q_absorb` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_q_absorb` |
| `unified.body.sparse_initial_index_share.attention.sparse_mla.query_concat` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.attention.sparse_mla.mla_cache_append` | [mla_cache_append](https://servingstudio.cs.washington.edu/kernels/mla_cache_append.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.attention.sparse_mla.index_remap` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.attention.sparse_mla.prefill` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.sparse_initial_index_share.attention.sparse_mla.decode` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.sparse_initial_index_share.attention.v_up` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_v_up` |
| `unified.body.sparse_initial_index_share.attention.o_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.attention.o_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_initial_index_share.attention.input_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.attention.fused_qkv_a_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.attention.fused_qkv_a_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_initial_index_share.attention.q_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.sparse_initial_index_share.attention.q_b_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.attention.q_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_initial_index_share.attention.kv_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.sparse_initial_index_share.attention.main_rope` | [vllm_mla_rope](https://servingstudio.cs.washington.edu/kernels/vllm_mla_rope.md) | `vllm_inductor` |
| `unified.body.sparse_initial_index_share.attention.q_absorb` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_q_absorb` |
| `unified.body.sparse_initial_index_share.attention.sparse_mla.query_concat` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.attention.sparse_mla.mla_cache_append` | [mla_cache_append](https://servingstudio.cs.washington.edu/kernels/mla_cache_append.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.attention.sparse_mla.index_remap` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.attention.sparse_mla.prefill` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.sparse_initial_index_share.attention.sparse_mla.decode` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.sparse_initial_index_share.attention.v_up` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_v_up` |
| `unified.body.sparse_initial_index_share.attention.o_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.attention.o_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_initial_index_share.attention.input_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.attention.fused_qkv_a_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.attention.fused_qkv_a_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_initial_index_share.attention.q_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.sparse_initial_index_share.attention.q_b_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.attention.q_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_initial_index_share.attention.kv_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.sparse_initial_index_share.attention.main_rope` | [vllm_mla_rope](https://servingstudio.cs.washington.edu/kernels/vllm_mla_rope.md) | `vllm_inductor` |
| `unified.body.sparse_initial_index_share.attention.q_absorb` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_q_absorb` |
| `unified.body.sparse_initial_index_share.attention.sparse_mla.query_concat` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.attention.sparse_mla.mla_cache_append` | [mla_cache_append](https://servingstudio.cs.washington.edu/kernels/mla_cache_append.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.attention.sparse_mla.index_remap` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.attention.sparse_mla.prefill` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.sparse_initial_index_share.attention.sparse_mla.decode` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.sparse_initial_index_share.attention.v_up` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_v_up` |
| `unified.body.sparse_initial_index_share.attention.o_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.attention.o_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_initial_index_share.attention.input_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.attention.fused_qkv_a_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.attention.fused_qkv_a_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_initial_index_share.attention.q_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.sparse_initial_index_share.attention.q_b_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.attention.q_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_initial_index_share.attention.kv_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.sparse_initial_index_share.attention.main_rope` | [vllm_mla_rope](https://servingstudio.cs.washington.edu/kernels/vllm_mla_rope.md) | `vllm_inductor` |
| `unified.body.sparse_initial_index_share.attention.q_absorb` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_q_absorb` |
| `unified.body.sparse_initial_index_share.attention.sparse_mla.query_concat` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.attention.sparse_mla.mla_cache_append` | [mla_cache_append](https://servingstudio.cs.washington.edu/kernels/mla_cache_append.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.attention.sparse_mla.index_remap` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.attention.sparse_mla.prefill` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.sparse_initial_index_share.attention.sparse_mla.decode` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.sparse_initial_index_share.attention.v_up` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_v_up` |
| `unified.body.sparse_initial_index_share.attention.o_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.attention.o_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_initial_index_share.attention.input_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.attention.fused_qkv_a_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.attention.fused_qkv_a_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_initial_index_share.attention.q_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.sparse_initial_index_share.attention.q_b_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.attention.q_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_initial_index_share.attention.kv_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.sparse_initial_index_share.attention.main_rope` | [vllm_mla_rope](https://servingstudio.cs.washington.edu/kernels/vllm_mla_rope.md) | `vllm_inductor` |
| `unified.body.sparse_initial_index_share.attention.q_absorb` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_q_absorb` |
| `unified.body.sparse_initial_index_share.attention.sparse_mla.query_concat` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.attention.sparse_mla.mla_cache_append` | [mla_cache_append](https://servingstudio.cs.washington.edu/kernels/mla_cache_append.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.attention.sparse_mla.index_remap` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.attention.sparse_mla.prefill` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.sparse_initial_index_share.attention.sparse_mla.decode` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.sparse_initial_index_share.attention.v_up` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_v_up` |
| `unified.body.sparse_initial_index_share.attention.o_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.attention.o_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_initial_index_share.moe.router.post_attn_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.moe.router.router_fp32_cast` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.moe.router.router_gemm_bf16_proxy` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_initial_index_share.moe.router.router_select` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.moe.router.post_attn_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.moe.router.router_fp32_cast` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.moe.router.router_gemm_bf16_proxy` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_initial_index_share.moe.router.router_select` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.moe.router.post_attn_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.moe.router.router_fp32_cast` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.moe.router.router_gemm_bf16_proxy` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_initial_index_share.moe.router.router_select` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.moe.router.post_attn_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.moe.router.router_fp32_cast` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.moe.router.router_gemm_bf16_proxy` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_initial_index_share.moe.router.router_select` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.moe.router.post_attn_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.moe.router.router_fp32_cast` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.moe.router.router_gemm_bf16_proxy` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_initial_index_share.moe.router.router_select` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.moe.router.post_attn_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.moe.router.router_fp32_cast` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.moe.router.router_gemm_bf16_proxy` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_initial_index_share.moe.router.router_select` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.moe.router.post_attn_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.moe.router.router_fp32_cast` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.moe.router.router_gemm_bf16_proxy` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_initial_index_share.moe.router.router_select` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.moe.router.post_attn_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.moe.router.router_fp32_cast` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.moe.router.router_gemm_bf16_proxy` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_initial_index_share.moe.router.router_select` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.moe.dispatch.prepare` | [moe_alltoall_prepare](https://servingstudio.cs.washington.edu/kernels/moe_alltoall_prepare.md) | `flashinfer_mnnvl` |
| `unified.body.sparse_initial_index_share.moe.dispatch` | [moe_alltoall](https://servingstudio.cs.washington.edu/kernels/moe_alltoall.md) | `flashinfer_mnnvl` |
| `unified.body.sparse_initial_index_share.moe.expand_input_rows` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.moe.expand_input_rows` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.moe.expand_input_rows` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.moe.expand_input_rows` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.moe.expand_input_rows` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.moe.expand_input_rows` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.moe.expand_input_rows` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.moe.expand_input_rows` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.moe.routed_experts.gate_up.input_quant` | [fp8_block_quant](https://servingstudio.cs.washington.edu/kernels/fp8_block_quant.md) | `flashinfer_trtllm` |
| `unified.body.sparse_initial_index_share.moe.routed_experts.gate_up.gemm` | [fp8_blockscale_grouped_gemm](https://servingstudio.cs.washington.edu/kernels/fp8_blockscale_grouped_gemm.md) | `flashinfer_trtllm` |
| `unified.body.sparse_initial_index_share.moe.routed_experts.activation` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.moe.routed_experts.down.input_quant` | [fp8_block_quant](https://servingstudio.cs.washington.edu/kernels/fp8_block_quant.md) | `flashinfer_trtllm` |
| `unified.body.sparse_initial_index_share.moe.routed_experts.down.gemm` | [fp8_blockscale_grouped_gemm](https://servingstudio.cs.washington.edu/kernels/fp8_blockscale_grouped_gemm.md) | `flashinfer_trtllm` |
| `unified.body.sparse_initial_index_share.moe.routed_experts.gate_up.input_quant` | [fp8_block_quant](https://servingstudio.cs.washington.edu/kernels/fp8_block_quant.md) | `flashinfer_trtllm` |
| `unified.body.sparse_initial_index_share.moe.routed_experts.gate_up.gemm` | [fp8_blockscale_grouped_gemm](https://servingstudio.cs.washington.edu/kernels/fp8_blockscale_grouped_gemm.md) | `flashinfer_trtllm` |
| `unified.body.sparse_initial_index_share.moe.routed_experts.activation` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.moe.routed_experts.down.input_quant` | [fp8_block_quant](https://servingstudio.cs.washington.edu/kernels/fp8_block_quant.md) | `flashinfer_trtllm` |
| `unified.body.sparse_initial_index_share.moe.routed_experts.down.gemm` | [fp8_blockscale_grouped_gemm](https://servingstudio.cs.washington.edu/kernels/fp8_blockscale_grouped_gemm.md) | `flashinfer_trtllm` |
| `unified.body.sparse_initial_index_share.moe.routed_experts.gate_up.input_quant` | [fp8_block_quant](https://servingstudio.cs.washington.edu/kernels/fp8_block_quant.md) | `flashinfer_trtllm` |
| `unified.body.sparse_initial_index_share.moe.routed_experts.gate_up.gemm` | [fp8_blockscale_grouped_gemm](https://servingstudio.cs.washington.edu/kernels/fp8_blockscale_grouped_gemm.md) | `flashinfer_trtllm` |
| `unified.body.sparse_initial_index_share.moe.routed_experts.activation` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.moe.routed_experts.down.input_quant` | [fp8_block_quant](https://servingstudio.cs.washington.edu/kernels/fp8_block_quant.md) | `flashinfer_trtllm` |
| `unified.body.sparse_initial_index_share.moe.routed_experts.down.gemm` | [fp8_blockscale_grouped_gemm](https://servingstudio.cs.washington.edu/kernels/fp8_blockscale_grouped_gemm.md) | `flashinfer_trtllm` |
| `unified.body.sparse_initial_index_share.moe.routed_experts.gate_up.input_quant` | [fp8_block_quant](https://servingstudio.cs.washington.edu/kernels/fp8_block_quant.md) | `flashinfer_trtllm` |
| `unified.body.sparse_initial_index_share.moe.routed_experts.gate_up.gemm` | [fp8_blockscale_grouped_gemm](https://servingstudio.cs.washington.edu/kernels/fp8_blockscale_grouped_gemm.md) | `flashinfer_trtllm` |
| `unified.body.sparse_initial_index_share.moe.routed_experts.activation` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.moe.routed_experts.down.input_quant` | [fp8_block_quant](https://servingstudio.cs.washington.edu/kernels/fp8_block_quant.md) | `flashinfer_trtllm` |
| `unified.body.sparse_initial_index_share.moe.routed_experts.down.gemm` | [fp8_blockscale_grouped_gemm](https://servingstudio.cs.washington.edu/kernels/fp8_blockscale_grouped_gemm.md) | `flashinfer_trtllm` |
| `unified.body.sparse_initial_index_share.moe.routed_experts.gate_up.input_quant` | [fp8_block_quant](https://servingstudio.cs.washington.edu/kernels/fp8_block_quant.md) | `flashinfer_trtllm` |
| `unified.body.sparse_initial_index_share.moe.routed_experts.gate_up.gemm` | [fp8_blockscale_grouped_gemm](https://servingstudio.cs.washington.edu/kernels/fp8_blockscale_grouped_gemm.md) | `flashinfer_trtllm` |
| `unified.body.sparse_initial_index_share.moe.routed_experts.activation` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.moe.routed_experts.down.input_quant` | [fp8_block_quant](https://servingstudio.cs.washington.edu/kernels/fp8_block_quant.md) | `flashinfer_trtllm` |
| `unified.body.sparse_initial_index_share.moe.routed_experts.down.gemm` | [fp8_blockscale_grouped_gemm](https://servingstudio.cs.washington.edu/kernels/fp8_blockscale_grouped_gemm.md) | `flashinfer_trtllm` |
| `unified.body.sparse_initial_index_share.moe.routed_experts.gate_up.input_quant` | [fp8_block_quant](https://servingstudio.cs.washington.edu/kernels/fp8_block_quant.md) | `flashinfer_trtllm` |
| `unified.body.sparse_initial_index_share.moe.routed_experts.gate_up.gemm` | [fp8_blockscale_grouped_gemm](https://servingstudio.cs.washington.edu/kernels/fp8_blockscale_grouped_gemm.md) | `flashinfer_trtllm` |
| `unified.body.sparse_initial_index_share.moe.routed_experts.activation` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.moe.routed_experts.down.input_quant` | [fp8_block_quant](https://servingstudio.cs.washington.edu/kernels/fp8_block_quant.md) | `flashinfer_trtllm` |
| `unified.body.sparse_initial_index_share.moe.routed_experts.down.gemm` | [fp8_blockscale_grouped_gemm](https://servingstudio.cs.washington.edu/kernels/fp8_blockscale_grouped_gemm.md) | `flashinfer_trtllm` |
| `unified.body.sparse_initial_index_share.moe.routed_experts.gate_up.input_quant` | [fp8_block_quant](https://servingstudio.cs.washington.edu/kernels/fp8_block_quant.md) | `flashinfer_trtllm` |
| `unified.body.sparse_initial_index_share.moe.routed_experts.gate_up.gemm` | [fp8_blockscale_grouped_gemm](https://servingstudio.cs.washington.edu/kernels/fp8_blockscale_grouped_gemm.md) | `flashinfer_trtllm` |
| `unified.body.sparse_initial_index_share.moe.routed_experts.activation` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.moe.routed_experts.down.input_quant` | [fp8_block_quant](https://servingstudio.cs.washington.edu/kernels/fp8_block_quant.md) | `flashinfer_trtllm` |
| `unified.body.sparse_initial_index_share.moe.routed_experts.down.gemm` | [fp8_blockscale_grouped_gemm](https://servingstudio.cs.washington.edu/kernels/fp8_blockscale_grouped_gemm.md) | `flashinfer_trtllm` |
| `unified.body.sparse_initial_index_share.moe.routed_experts.gate_up.input_quant` | [fp8_block_quant](https://servingstudio.cs.washington.edu/kernels/fp8_block_quant.md) | `flashinfer_trtllm` |
| `unified.body.sparse_initial_index_share.moe.routed_experts.gate_up.gemm` | [fp8_blockscale_grouped_gemm](https://servingstudio.cs.washington.edu/kernels/fp8_blockscale_grouped_gemm.md) | `flashinfer_trtllm` |
| `unified.body.sparse_initial_index_share.moe.routed_experts.activation` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.moe.routed_experts.down.input_quant` | [fp8_block_quant](https://servingstudio.cs.washington.edu/kernels/fp8_block_quant.md) | `flashinfer_trtllm` |
| `unified.body.sparse_initial_index_share.moe.routed_experts.down.gemm` | [fp8_blockscale_grouped_gemm](https://servingstudio.cs.washington.edu/kernels/fp8_blockscale_grouped_gemm.md) | `flashinfer_trtllm` |
| `unified.body.sparse_initial_index_share.moe.finalization` | [moe_finalize_routing](https://servingstudio.cs.washington.edu/kernels/moe_finalize_routing.md) | `flashinfer_trtllm` |
| `unified.body.sparse_initial_index_share.moe.finalization` | [moe_finalize_routing](https://servingstudio.cs.washington.edu/kernels/moe_finalize_routing.md) | `flashinfer_trtllm` |
| `unified.body.sparse_initial_index_share.moe.finalization` | [moe_finalize_routing](https://servingstudio.cs.washington.edu/kernels/moe_finalize_routing.md) | `flashinfer_trtllm` |
| `unified.body.sparse_initial_index_share.moe.finalization` | [moe_finalize_routing](https://servingstudio.cs.washington.edu/kernels/moe_finalize_routing.md) | `flashinfer_trtllm` |
| `unified.body.sparse_initial_index_share.moe.finalization` | [moe_finalize_routing](https://servingstudio.cs.washington.edu/kernels/moe_finalize_routing.md) | `flashinfer_trtllm` |
| `unified.body.sparse_initial_index_share.moe.finalization` | [moe_finalize_routing](https://servingstudio.cs.washington.edu/kernels/moe_finalize_routing.md) | `flashinfer_trtllm` |
| `unified.body.sparse_initial_index_share.moe.finalization` | [moe_finalize_routing](https://servingstudio.cs.washington.edu/kernels/moe_finalize_routing.md) | `flashinfer_trtllm` |
| `unified.body.sparse_initial_index_share.moe.finalization` | [moe_finalize_routing](https://servingstudio.cs.washington.edu/kernels/moe_finalize_routing.md) | `flashinfer_trtllm` |
| `unified.body.sparse_initial_index_share.moe.combine.output_fill` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.moe.combine` | [moe_alltoall](https://servingstudio.cs.washington.edu/kernels/moe_alltoall.md) | `flashinfer_mnnvl` |
| `unified.body.sparse_initial_index_share.moe.combine.reduce` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.moe.shared_expert.gate_up_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.moe.shared_expert.gate_up_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_initial_index_share.moe.shared_expert.silu_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.moe.shared_expert.down_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.moe.shared_expert.down_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_initial_index_share.moe.shared_expert.gate_up_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.moe.shared_expert.gate_up_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_initial_index_share.moe.shared_expert.silu_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.moe.shared_expert.down_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.moe.shared_expert.down_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_initial_index_share.moe.shared_expert.gate_up_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.moe.shared_expert.gate_up_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_initial_index_share.moe.shared_expert.silu_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.moe.shared_expert.down_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.moe.shared_expert.down_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_initial_index_share.moe.shared_expert.gate_up_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.moe.shared_expert.gate_up_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_initial_index_share.moe.shared_expert.silu_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.moe.shared_expert.down_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.moe.shared_expert.down_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_initial_index_share.moe.shared_expert.gate_up_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.moe.shared_expert.gate_up_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_initial_index_share.moe.shared_expert.silu_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.moe.shared_expert.down_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.moe.shared_expert.down_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_initial_index_share.moe.shared_expert.gate_up_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.moe.shared_expert.gate_up_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_initial_index_share.moe.shared_expert.silu_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.moe.shared_expert.down_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.moe.shared_expert.down_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_initial_index_share.moe.shared_expert.gate_up_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.moe.shared_expert.gate_up_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_initial_index_share.moe.shared_expert.silu_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.moe.shared_expert.down_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.moe.shared_expert.down_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_initial_index_share.moe.shared_expert.gate_up_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.moe.shared_expert.gate_up_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_initial_index_share.moe.shared_expert.silu_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_initial_index_share.moe.shared_expert.down_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_initial_index_share.moe.shared_expert.down_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.attention.input_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.fused_qkv_a_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.fused_qkv_a_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.attention.q_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.sparse_cycle_full_index.attention.q_b_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.q_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.attention.kv_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.sparse_cycle_full_index.attention.main_rope` | [vllm_mla_rope](https://servingstudio.cs.washington.edu/kernels/vllm_mla_rope.md) | `vllm_inductor` |
| `unified.body.sparse_cycle_full_index.attention.indexer_q_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.indexer.q_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.attention.indexer.wk_weights_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.attention.indexer.k_layernorm` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.rope` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.q_quant` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.weight_scale` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.index_cache_append` | [dsa_index_cache_append](https://servingstudio.cs.washington.edu/kernels/dsa_index_cache_append.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.indexer.topk_buffer_fill` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.prefill_cache_gather` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.prefill_logits` | [dsa_mqa_logits_prefill](https://servingstudio.cs.washington.edu/kernels/dsa_mqa_logits_prefill.md) | `deepgemm_fp8` |
| `unified.body.sparse_cycle_full_index.attention.indexer.prefill_topk` | [dsa_topk_prefill](https://servingstudio.cs.washington.edu/kernels/dsa_topk_prefill.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.indexer.decode_pack` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.decode_logits` | [dsa_paged_mqa_logits_decode](https://servingstudio.cs.washington.edu/kernels/dsa_paged_mqa_logits_decode.md) | `deepgemm_fp8` |
| `unified.body.sparse_cycle_full_index.attention.indexer.decode_topk` | [dsa_persistent_topk_decode](https://servingstudio.cs.washington.edu/kernels/dsa_persistent_topk_decode.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.indexer.decode_unpack` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.q_absorb` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_q_absorb` |
| `unified.body.sparse_cycle_full_index.attention.sparse_mla.query_concat` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.sparse_mla.mla_cache_append` | [mla_cache_append](https://servingstudio.cs.washington.edu/kernels/mla_cache_append.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.sparse_mla.index_remap` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.sparse_mla.prefill` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.sparse_cycle_full_index.attention.sparse_mla.decode` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.sparse_cycle_full_index.attention.v_up` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_v_up` |
| `unified.body.sparse_cycle_full_index.attention.o_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.o_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.attention.input_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.fused_qkv_a_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.fused_qkv_a_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.attention.q_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.sparse_cycle_full_index.attention.q_b_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.q_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.attention.kv_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.sparse_cycle_full_index.attention.main_rope` | [vllm_mla_rope](https://servingstudio.cs.washington.edu/kernels/vllm_mla_rope.md) | `vllm_inductor` |
| `unified.body.sparse_cycle_full_index.attention.indexer_q_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.indexer.q_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.attention.indexer.wk_weights_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.attention.indexer.k_layernorm` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.rope` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.q_quant` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.weight_scale` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.index_cache_append` | [dsa_index_cache_append](https://servingstudio.cs.washington.edu/kernels/dsa_index_cache_append.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.indexer.topk_buffer_fill` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.prefill_cache_gather` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.prefill_logits` | [dsa_mqa_logits_prefill](https://servingstudio.cs.washington.edu/kernels/dsa_mqa_logits_prefill.md) | `deepgemm_fp8` |
| `unified.body.sparse_cycle_full_index.attention.indexer.prefill_topk` | [dsa_topk_prefill](https://servingstudio.cs.washington.edu/kernels/dsa_topk_prefill.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.indexer.decode_pack` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.decode_logits` | [dsa_paged_mqa_logits_decode](https://servingstudio.cs.washington.edu/kernels/dsa_paged_mqa_logits_decode.md) | `deepgemm_fp8` |
| `unified.body.sparse_cycle_full_index.attention.indexer.decode_topk` | [dsa_persistent_topk_decode](https://servingstudio.cs.washington.edu/kernels/dsa_persistent_topk_decode.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.indexer.decode_unpack` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.q_absorb` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_q_absorb` |
| `unified.body.sparse_cycle_full_index.attention.sparse_mla.query_concat` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.sparse_mla.mla_cache_append` | [mla_cache_append](https://servingstudio.cs.washington.edu/kernels/mla_cache_append.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.sparse_mla.index_remap` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.sparse_mla.prefill` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.sparse_cycle_full_index.attention.sparse_mla.decode` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.sparse_cycle_full_index.attention.v_up` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_v_up` |
| `unified.body.sparse_cycle_full_index.attention.o_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.o_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.attention.input_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.fused_qkv_a_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.fused_qkv_a_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.attention.q_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.sparse_cycle_full_index.attention.q_b_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.q_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.attention.kv_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.sparse_cycle_full_index.attention.main_rope` | [vllm_mla_rope](https://servingstudio.cs.washington.edu/kernels/vllm_mla_rope.md) | `vllm_inductor` |
| `unified.body.sparse_cycle_full_index.attention.indexer_q_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.indexer.q_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.attention.indexer.wk_weights_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.attention.indexer.k_layernorm` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.rope` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.q_quant` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.weight_scale` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.index_cache_append` | [dsa_index_cache_append](https://servingstudio.cs.washington.edu/kernels/dsa_index_cache_append.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.indexer.topk_buffer_fill` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.prefill_cache_gather` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.prefill_logits` | [dsa_mqa_logits_prefill](https://servingstudio.cs.washington.edu/kernels/dsa_mqa_logits_prefill.md) | `deepgemm_fp8` |
| `unified.body.sparse_cycle_full_index.attention.indexer.prefill_topk` | [dsa_topk_prefill](https://servingstudio.cs.washington.edu/kernels/dsa_topk_prefill.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.indexer.decode_pack` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.decode_logits` | [dsa_paged_mqa_logits_decode](https://servingstudio.cs.washington.edu/kernels/dsa_paged_mqa_logits_decode.md) | `deepgemm_fp8` |
| `unified.body.sparse_cycle_full_index.attention.indexer.decode_topk` | [dsa_persistent_topk_decode](https://servingstudio.cs.washington.edu/kernels/dsa_persistent_topk_decode.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.indexer.decode_unpack` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.q_absorb` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_q_absorb` |
| `unified.body.sparse_cycle_full_index.attention.sparse_mla.query_concat` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.sparse_mla.mla_cache_append` | [mla_cache_append](https://servingstudio.cs.washington.edu/kernels/mla_cache_append.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.sparse_mla.index_remap` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.sparse_mla.prefill` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.sparse_cycle_full_index.attention.sparse_mla.decode` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.sparse_cycle_full_index.attention.v_up` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_v_up` |
| `unified.body.sparse_cycle_full_index.attention.o_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.o_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.attention.input_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.fused_qkv_a_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.fused_qkv_a_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.attention.q_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.sparse_cycle_full_index.attention.q_b_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.q_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.attention.kv_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.sparse_cycle_full_index.attention.main_rope` | [vllm_mla_rope](https://servingstudio.cs.washington.edu/kernels/vllm_mla_rope.md) | `vllm_inductor` |
| `unified.body.sparse_cycle_full_index.attention.indexer_q_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.indexer.q_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.attention.indexer.wk_weights_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.attention.indexer.k_layernorm` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.rope` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.q_quant` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.weight_scale` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.index_cache_append` | [dsa_index_cache_append](https://servingstudio.cs.washington.edu/kernels/dsa_index_cache_append.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.indexer.topk_buffer_fill` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.prefill_cache_gather` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.prefill_logits` | [dsa_mqa_logits_prefill](https://servingstudio.cs.washington.edu/kernels/dsa_mqa_logits_prefill.md) | `deepgemm_fp8` |
| `unified.body.sparse_cycle_full_index.attention.indexer.prefill_topk` | [dsa_topk_prefill](https://servingstudio.cs.washington.edu/kernels/dsa_topk_prefill.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.indexer.decode_pack` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.decode_logits` | [dsa_paged_mqa_logits_decode](https://servingstudio.cs.washington.edu/kernels/dsa_paged_mqa_logits_decode.md) | `deepgemm_fp8` |
| `unified.body.sparse_cycle_full_index.attention.indexer.decode_topk` | [dsa_persistent_topk_decode](https://servingstudio.cs.washington.edu/kernels/dsa_persistent_topk_decode.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.indexer.decode_unpack` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.q_absorb` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_q_absorb` |
| `unified.body.sparse_cycle_full_index.attention.sparse_mla.query_concat` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.sparse_mla.mla_cache_append` | [mla_cache_append](https://servingstudio.cs.washington.edu/kernels/mla_cache_append.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.sparse_mla.index_remap` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.sparse_mla.prefill` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.sparse_cycle_full_index.attention.sparse_mla.decode` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.sparse_cycle_full_index.attention.v_up` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_v_up` |
| `unified.body.sparse_cycle_full_index.attention.o_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.o_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.attention.input_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.fused_qkv_a_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.fused_qkv_a_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.attention.q_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.sparse_cycle_full_index.attention.q_b_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.q_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.attention.kv_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.sparse_cycle_full_index.attention.main_rope` | [vllm_mla_rope](https://servingstudio.cs.washington.edu/kernels/vllm_mla_rope.md) | `vllm_inductor` |
| `unified.body.sparse_cycle_full_index.attention.indexer_q_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.indexer.q_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.attention.indexer.wk_weights_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.attention.indexer.k_layernorm` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.rope` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.q_quant` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.weight_scale` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.index_cache_append` | [dsa_index_cache_append](https://servingstudio.cs.washington.edu/kernels/dsa_index_cache_append.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.indexer.topk_buffer_fill` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.prefill_cache_gather` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.prefill_logits` | [dsa_mqa_logits_prefill](https://servingstudio.cs.washington.edu/kernels/dsa_mqa_logits_prefill.md) | `deepgemm_fp8` |
| `unified.body.sparse_cycle_full_index.attention.indexer.prefill_topk` | [dsa_topk_prefill](https://servingstudio.cs.washington.edu/kernels/dsa_topk_prefill.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.indexer.decode_pack` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.decode_logits` | [dsa_paged_mqa_logits_decode](https://servingstudio.cs.washington.edu/kernels/dsa_paged_mqa_logits_decode.md) | `deepgemm_fp8` |
| `unified.body.sparse_cycle_full_index.attention.indexer.decode_topk` | [dsa_persistent_topk_decode](https://servingstudio.cs.washington.edu/kernels/dsa_persistent_topk_decode.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.indexer.decode_unpack` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.q_absorb` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_q_absorb` |
| `unified.body.sparse_cycle_full_index.attention.sparse_mla.query_concat` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.sparse_mla.mla_cache_append` | [mla_cache_append](https://servingstudio.cs.washington.edu/kernels/mla_cache_append.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.sparse_mla.index_remap` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.sparse_mla.prefill` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.sparse_cycle_full_index.attention.sparse_mla.decode` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.sparse_cycle_full_index.attention.v_up` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_v_up` |
| `unified.body.sparse_cycle_full_index.attention.o_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.o_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.attention.input_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.fused_qkv_a_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.fused_qkv_a_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.attention.q_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.sparse_cycle_full_index.attention.q_b_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.q_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.attention.kv_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.sparse_cycle_full_index.attention.main_rope` | [vllm_mla_rope](https://servingstudio.cs.washington.edu/kernels/vllm_mla_rope.md) | `vllm_inductor` |
| `unified.body.sparse_cycle_full_index.attention.indexer_q_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.indexer.q_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.attention.indexer.wk_weights_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.attention.indexer.k_layernorm` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.rope` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.q_quant` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.weight_scale` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.index_cache_append` | [dsa_index_cache_append](https://servingstudio.cs.washington.edu/kernels/dsa_index_cache_append.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.indexer.topk_buffer_fill` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.prefill_cache_gather` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.prefill_logits` | [dsa_mqa_logits_prefill](https://servingstudio.cs.washington.edu/kernels/dsa_mqa_logits_prefill.md) | `deepgemm_fp8` |
| `unified.body.sparse_cycle_full_index.attention.indexer.prefill_topk` | [dsa_topk_prefill](https://servingstudio.cs.washington.edu/kernels/dsa_topk_prefill.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.indexer.decode_pack` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.decode_logits` | [dsa_paged_mqa_logits_decode](https://servingstudio.cs.washington.edu/kernels/dsa_paged_mqa_logits_decode.md) | `deepgemm_fp8` |
| `unified.body.sparse_cycle_full_index.attention.indexer.decode_topk` | [dsa_persistent_topk_decode](https://servingstudio.cs.washington.edu/kernels/dsa_persistent_topk_decode.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.indexer.decode_unpack` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.q_absorb` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_q_absorb` |
| `unified.body.sparse_cycle_full_index.attention.sparse_mla.query_concat` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.sparse_mla.mla_cache_append` | [mla_cache_append](https://servingstudio.cs.washington.edu/kernels/mla_cache_append.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.sparse_mla.index_remap` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.sparse_mla.prefill` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.sparse_cycle_full_index.attention.sparse_mla.decode` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.sparse_cycle_full_index.attention.v_up` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_v_up` |
| `unified.body.sparse_cycle_full_index.attention.o_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.o_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.attention.input_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.fused_qkv_a_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.fused_qkv_a_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.attention.q_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.sparse_cycle_full_index.attention.q_b_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.q_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.attention.kv_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.sparse_cycle_full_index.attention.main_rope` | [vllm_mla_rope](https://servingstudio.cs.washington.edu/kernels/vllm_mla_rope.md) | `vllm_inductor` |
| `unified.body.sparse_cycle_full_index.attention.indexer_q_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.indexer.q_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.attention.indexer.wk_weights_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.attention.indexer.k_layernorm` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.rope` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.q_quant` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.weight_scale` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.index_cache_append` | [dsa_index_cache_append](https://servingstudio.cs.washington.edu/kernels/dsa_index_cache_append.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.indexer.topk_buffer_fill` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.prefill_cache_gather` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.prefill_logits` | [dsa_mqa_logits_prefill](https://servingstudio.cs.washington.edu/kernels/dsa_mqa_logits_prefill.md) | `deepgemm_fp8` |
| `unified.body.sparse_cycle_full_index.attention.indexer.prefill_topk` | [dsa_topk_prefill](https://servingstudio.cs.washington.edu/kernels/dsa_topk_prefill.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.indexer.decode_pack` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.decode_logits` | [dsa_paged_mqa_logits_decode](https://servingstudio.cs.washington.edu/kernels/dsa_paged_mqa_logits_decode.md) | `deepgemm_fp8` |
| `unified.body.sparse_cycle_full_index.attention.indexer.decode_topk` | [dsa_persistent_topk_decode](https://servingstudio.cs.washington.edu/kernels/dsa_persistent_topk_decode.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.indexer.decode_unpack` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.q_absorb` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_q_absorb` |
| `unified.body.sparse_cycle_full_index.attention.sparse_mla.query_concat` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.sparse_mla.mla_cache_append` | [mla_cache_append](https://servingstudio.cs.washington.edu/kernels/mla_cache_append.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.sparse_mla.index_remap` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.sparse_mla.prefill` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.sparse_cycle_full_index.attention.sparse_mla.decode` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.sparse_cycle_full_index.attention.v_up` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_v_up` |
| `unified.body.sparse_cycle_full_index.attention.o_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.o_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.attention.input_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.fused_qkv_a_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.fused_qkv_a_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.attention.q_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.sparse_cycle_full_index.attention.q_b_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.q_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.attention.kv_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.sparse_cycle_full_index.attention.main_rope` | [vllm_mla_rope](https://servingstudio.cs.washington.edu/kernels/vllm_mla_rope.md) | `vllm_inductor` |
| `unified.body.sparse_cycle_full_index.attention.indexer_q_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.indexer.q_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.attention.indexer.wk_weights_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.attention.indexer.k_layernorm` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.rope` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.q_quant` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.weight_scale` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.index_cache_append` | [dsa_index_cache_append](https://servingstudio.cs.washington.edu/kernels/dsa_index_cache_append.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.indexer.topk_buffer_fill` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.prefill_cache_gather` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.prefill_logits` | [dsa_mqa_logits_prefill](https://servingstudio.cs.washington.edu/kernels/dsa_mqa_logits_prefill.md) | `deepgemm_fp8` |
| `unified.body.sparse_cycle_full_index.attention.indexer.prefill_topk` | [dsa_topk_prefill](https://servingstudio.cs.washington.edu/kernels/dsa_topk_prefill.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.indexer.decode_pack` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.indexer.decode_logits` | [dsa_paged_mqa_logits_decode](https://servingstudio.cs.washington.edu/kernels/dsa_paged_mqa_logits_decode.md) | `deepgemm_fp8` |
| `unified.body.sparse_cycle_full_index.attention.indexer.decode_topk` | [dsa_persistent_topk_decode](https://servingstudio.cs.washington.edu/kernels/dsa_persistent_topk_decode.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.indexer.decode_unpack` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.q_absorb` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_q_absorb` |
| `unified.body.sparse_cycle_full_index.attention.sparse_mla.query_concat` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.sparse_mla.mla_cache_append` | [mla_cache_append](https://servingstudio.cs.washington.edu/kernels/mla_cache_append.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.sparse_mla.index_remap` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.attention.sparse_mla.prefill` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.sparse_cycle_full_index.attention.sparse_mla.decode` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.sparse_cycle_full_index.attention.v_up` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_v_up` |
| `unified.body.sparse_cycle_full_index.attention.o_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.attention.o_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.moe.router.post_attn_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.moe.router.router_fp32_cast` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.moe.router.router_gemm_bf16_proxy` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.moe.router.router_select` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.moe.router.post_attn_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.moe.router.router_fp32_cast` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.moe.router.router_gemm_bf16_proxy` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.moe.router.router_select` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.moe.router.post_attn_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.moe.router.router_fp32_cast` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.moe.router.router_gemm_bf16_proxy` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.moe.router.router_select` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.moe.router.post_attn_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.moe.router.router_fp32_cast` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.moe.router.router_gemm_bf16_proxy` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.moe.router.router_select` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.moe.router.post_attn_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.moe.router.router_fp32_cast` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.moe.router.router_gemm_bf16_proxy` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.moe.router.router_select` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.moe.router.post_attn_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.moe.router.router_fp32_cast` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.moe.router.router_gemm_bf16_proxy` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.moe.router.router_select` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.moe.router.post_attn_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.moe.router.router_fp32_cast` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.moe.router.router_gemm_bf16_proxy` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.moe.router.router_select` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.moe.router.post_attn_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.moe.router.router_fp32_cast` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.moe.router.router_gemm_bf16_proxy` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.moe.router.router_select` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.moe.dispatch.prepare` | [moe_alltoall_prepare](https://servingstudio.cs.washington.edu/kernels/moe_alltoall_prepare.md) | `flashinfer_mnnvl` |
| `unified.body.sparse_cycle_full_index.moe.dispatch` | [moe_alltoall](https://servingstudio.cs.washington.edu/kernels/moe_alltoall.md) | `flashinfer_mnnvl` |
| `unified.body.sparse_cycle_full_index.moe.expand_input_rows` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.moe.expand_input_rows` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.moe.expand_input_rows` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.moe.expand_input_rows` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.moe.expand_input_rows` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.moe.expand_input_rows` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.moe.expand_input_rows` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.moe.expand_input_rows` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.moe.routed_experts.gate_up.input_quant` | [fp8_block_quant](https://servingstudio.cs.washington.edu/kernels/fp8_block_quant.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_full_index.moe.routed_experts.gate_up.gemm` | [fp8_blockscale_grouped_gemm](https://servingstudio.cs.washington.edu/kernels/fp8_blockscale_grouped_gemm.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_full_index.moe.routed_experts.activation` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.moe.routed_experts.down.input_quant` | [fp8_block_quant](https://servingstudio.cs.washington.edu/kernels/fp8_block_quant.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_full_index.moe.routed_experts.down.gemm` | [fp8_blockscale_grouped_gemm](https://servingstudio.cs.washington.edu/kernels/fp8_blockscale_grouped_gemm.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_full_index.moe.routed_experts.gate_up.input_quant` | [fp8_block_quant](https://servingstudio.cs.washington.edu/kernels/fp8_block_quant.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_full_index.moe.routed_experts.gate_up.gemm` | [fp8_blockscale_grouped_gemm](https://servingstudio.cs.washington.edu/kernels/fp8_blockscale_grouped_gemm.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_full_index.moe.routed_experts.activation` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.moe.routed_experts.down.input_quant` | [fp8_block_quant](https://servingstudio.cs.washington.edu/kernels/fp8_block_quant.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_full_index.moe.routed_experts.down.gemm` | [fp8_blockscale_grouped_gemm](https://servingstudio.cs.washington.edu/kernels/fp8_blockscale_grouped_gemm.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_full_index.moe.routed_experts.gate_up.input_quant` | [fp8_block_quant](https://servingstudio.cs.washington.edu/kernels/fp8_block_quant.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_full_index.moe.routed_experts.gate_up.gemm` | [fp8_blockscale_grouped_gemm](https://servingstudio.cs.washington.edu/kernels/fp8_blockscale_grouped_gemm.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_full_index.moe.routed_experts.activation` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.moe.routed_experts.down.input_quant` | [fp8_block_quant](https://servingstudio.cs.washington.edu/kernels/fp8_block_quant.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_full_index.moe.routed_experts.down.gemm` | [fp8_blockscale_grouped_gemm](https://servingstudio.cs.washington.edu/kernels/fp8_blockscale_grouped_gemm.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_full_index.moe.routed_experts.gate_up.input_quant` | [fp8_block_quant](https://servingstudio.cs.washington.edu/kernels/fp8_block_quant.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_full_index.moe.routed_experts.gate_up.gemm` | [fp8_blockscale_grouped_gemm](https://servingstudio.cs.washington.edu/kernels/fp8_blockscale_grouped_gemm.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_full_index.moe.routed_experts.activation` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.moe.routed_experts.down.input_quant` | [fp8_block_quant](https://servingstudio.cs.washington.edu/kernels/fp8_block_quant.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_full_index.moe.routed_experts.down.gemm` | [fp8_blockscale_grouped_gemm](https://servingstudio.cs.washington.edu/kernels/fp8_blockscale_grouped_gemm.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_full_index.moe.routed_experts.gate_up.input_quant` | [fp8_block_quant](https://servingstudio.cs.washington.edu/kernels/fp8_block_quant.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_full_index.moe.routed_experts.gate_up.gemm` | [fp8_blockscale_grouped_gemm](https://servingstudio.cs.washington.edu/kernels/fp8_blockscale_grouped_gemm.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_full_index.moe.routed_experts.activation` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.moe.routed_experts.down.input_quant` | [fp8_block_quant](https://servingstudio.cs.washington.edu/kernels/fp8_block_quant.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_full_index.moe.routed_experts.down.gemm` | [fp8_blockscale_grouped_gemm](https://servingstudio.cs.washington.edu/kernels/fp8_blockscale_grouped_gemm.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_full_index.moe.routed_experts.gate_up.input_quant` | [fp8_block_quant](https://servingstudio.cs.washington.edu/kernels/fp8_block_quant.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_full_index.moe.routed_experts.gate_up.gemm` | [fp8_blockscale_grouped_gemm](https://servingstudio.cs.washington.edu/kernels/fp8_blockscale_grouped_gemm.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_full_index.moe.routed_experts.activation` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.moe.routed_experts.down.input_quant` | [fp8_block_quant](https://servingstudio.cs.washington.edu/kernels/fp8_block_quant.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_full_index.moe.routed_experts.down.gemm` | [fp8_blockscale_grouped_gemm](https://servingstudio.cs.washington.edu/kernels/fp8_blockscale_grouped_gemm.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_full_index.moe.routed_experts.gate_up.input_quant` | [fp8_block_quant](https://servingstudio.cs.washington.edu/kernels/fp8_block_quant.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_full_index.moe.routed_experts.gate_up.gemm` | [fp8_blockscale_grouped_gemm](https://servingstudio.cs.washington.edu/kernels/fp8_blockscale_grouped_gemm.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_full_index.moe.routed_experts.activation` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.moe.routed_experts.down.input_quant` | [fp8_block_quant](https://servingstudio.cs.washington.edu/kernels/fp8_block_quant.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_full_index.moe.routed_experts.down.gemm` | [fp8_blockscale_grouped_gemm](https://servingstudio.cs.washington.edu/kernels/fp8_blockscale_grouped_gemm.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_full_index.moe.routed_experts.gate_up.input_quant` | [fp8_block_quant](https://servingstudio.cs.washington.edu/kernels/fp8_block_quant.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_full_index.moe.routed_experts.gate_up.gemm` | [fp8_blockscale_grouped_gemm](https://servingstudio.cs.washington.edu/kernels/fp8_blockscale_grouped_gemm.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_full_index.moe.routed_experts.activation` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.moe.routed_experts.down.input_quant` | [fp8_block_quant](https://servingstudio.cs.washington.edu/kernels/fp8_block_quant.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_full_index.moe.routed_experts.down.gemm` | [fp8_blockscale_grouped_gemm](https://servingstudio.cs.washington.edu/kernels/fp8_blockscale_grouped_gemm.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_full_index.moe.finalization` | [moe_finalize_routing](https://servingstudio.cs.washington.edu/kernels/moe_finalize_routing.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_full_index.moe.finalization` | [moe_finalize_routing](https://servingstudio.cs.washington.edu/kernels/moe_finalize_routing.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_full_index.moe.finalization` | [moe_finalize_routing](https://servingstudio.cs.washington.edu/kernels/moe_finalize_routing.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_full_index.moe.finalization` | [moe_finalize_routing](https://servingstudio.cs.washington.edu/kernels/moe_finalize_routing.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_full_index.moe.finalization` | [moe_finalize_routing](https://servingstudio.cs.washington.edu/kernels/moe_finalize_routing.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_full_index.moe.finalization` | [moe_finalize_routing](https://servingstudio.cs.washington.edu/kernels/moe_finalize_routing.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_full_index.moe.finalization` | [moe_finalize_routing](https://servingstudio.cs.washington.edu/kernels/moe_finalize_routing.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_full_index.moe.finalization` | [moe_finalize_routing](https://servingstudio.cs.washington.edu/kernels/moe_finalize_routing.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_full_index.moe.combine.output_fill` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.moe.combine` | [moe_alltoall](https://servingstudio.cs.washington.edu/kernels/moe_alltoall.md) | `flashinfer_mnnvl` |
| `unified.body.sparse_cycle_full_index.moe.combine.reduce` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.moe.shared_expert.gate_up_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.moe.shared_expert.gate_up_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.moe.shared_expert.silu_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.moe.shared_expert.down_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.moe.shared_expert.down_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.moe.shared_expert.gate_up_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.moe.shared_expert.gate_up_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.moe.shared_expert.silu_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.moe.shared_expert.down_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.moe.shared_expert.down_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.moe.shared_expert.gate_up_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.moe.shared_expert.gate_up_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.moe.shared_expert.silu_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.moe.shared_expert.down_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.moe.shared_expert.down_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.moe.shared_expert.gate_up_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.moe.shared_expert.gate_up_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.moe.shared_expert.silu_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.moe.shared_expert.down_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.moe.shared_expert.down_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.moe.shared_expert.gate_up_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.moe.shared_expert.gate_up_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.moe.shared_expert.silu_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.moe.shared_expert.down_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.moe.shared_expert.down_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.moe.shared_expert.gate_up_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.moe.shared_expert.gate_up_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.moe.shared_expert.silu_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.moe.shared_expert.down_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.moe.shared_expert.down_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.moe.shared_expert.gate_up_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.moe.shared_expert.gate_up_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.moe.shared_expert.silu_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.moe.shared_expert.down_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.moe.shared_expert.down_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.moe.shared_expert.gate_up_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.moe.shared_expert.gate_up_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_full_index.moe.shared_expert.silu_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_full_index.moe.shared_expert.down_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_full_index.moe.shared_expert.down_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_index_share.attention.input_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.attention.fused_qkv_a_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.attention.fused_qkv_a_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_index_share.attention.q_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.sparse_cycle_index_share.attention.q_b_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.attention.q_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_index_share.attention.kv_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.sparse_cycle_index_share.attention.main_rope` | [vllm_mla_rope](https://servingstudio.cs.washington.edu/kernels/vllm_mla_rope.md) | `vllm_inductor` |
| `unified.body.sparse_cycle_index_share.attention.q_absorb` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_q_absorb` |
| `unified.body.sparse_cycle_index_share.attention.sparse_mla.query_concat` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.attention.sparse_mla.mla_cache_append` | [mla_cache_append](https://servingstudio.cs.washington.edu/kernels/mla_cache_append.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.attention.sparse_mla.index_remap` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.attention.sparse_mla.prefill` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.sparse_cycle_index_share.attention.sparse_mla.decode` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.sparse_cycle_index_share.attention.v_up` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_v_up` |
| `unified.body.sparse_cycle_index_share.attention.o_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.attention.o_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_index_share.attention.input_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.attention.fused_qkv_a_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.attention.fused_qkv_a_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_index_share.attention.q_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.sparse_cycle_index_share.attention.q_b_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.attention.q_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_index_share.attention.kv_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.sparse_cycle_index_share.attention.main_rope` | [vllm_mla_rope](https://servingstudio.cs.washington.edu/kernels/vllm_mla_rope.md) | `vllm_inductor` |
| `unified.body.sparse_cycle_index_share.attention.q_absorb` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_q_absorb` |
| `unified.body.sparse_cycle_index_share.attention.sparse_mla.query_concat` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.attention.sparse_mla.mla_cache_append` | [mla_cache_append](https://servingstudio.cs.washington.edu/kernels/mla_cache_append.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.attention.sparse_mla.index_remap` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.attention.sparse_mla.prefill` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.sparse_cycle_index_share.attention.sparse_mla.decode` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.sparse_cycle_index_share.attention.v_up` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_v_up` |
| `unified.body.sparse_cycle_index_share.attention.o_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.attention.o_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_index_share.attention.input_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.attention.fused_qkv_a_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.attention.fused_qkv_a_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_index_share.attention.q_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.sparse_cycle_index_share.attention.q_b_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.attention.q_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_index_share.attention.kv_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.sparse_cycle_index_share.attention.main_rope` | [vllm_mla_rope](https://servingstudio.cs.washington.edu/kernels/vllm_mla_rope.md) | `vllm_inductor` |
| `unified.body.sparse_cycle_index_share.attention.q_absorb` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_q_absorb` |
| `unified.body.sparse_cycle_index_share.attention.sparse_mla.query_concat` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.attention.sparse_mla.mla_cache_append` | [mla_cache_append](https://servingstudio.cs.washington.edu/kernels/mla_cache_append.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.attention.sparse_mla.index_remap` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.attention.sparse_mla.prefill` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.sparse_cycle_index_share.attention.sparse_mla.decode` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.sparse_cycle_index_share.attention.v_up` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_v_up` |
| `unified.body.sparse_cycle_index_share.attention.o_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.attention.o_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_index_share.attention.input_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.attention.fused_qkv_a_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.attention.fused_qkv_a_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_index_share.attention.q_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.sparse_cycle_index_share.attention.q_b_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.attention.q_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_index_share.attention.kv_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.sparse_cycle_index_share.attention.main_rope` | [vllm_mla_rope](https://servingstudio.cs.washington.edu/kernels/vllm_mla_rope.md) | `vllm_inductor` |
| `unified.body.sparse_cycle_index_share.attention.q_absorb` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_q_absorb` |
| `unified.body.sparse_cycle_index_share.attention.sparse_mla.query_concat` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.attention.sparse_mla.mla_cache_append` | [mla_cache_append](https://servingstudio.cs.washington.edu/kernels/mla_cache_append.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.attention.sparse_mla.index_remap` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.attention.sparse_mla.prefill` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.sparse_cycle_index_share.attention.sparse_mla.decode` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.sparse_cycle_index_share.attention.v_up` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_v_up` |
| `unified.body.sparse_cycle_index_share.attention.o_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.attention.o_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_index_share.attention.input_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.attention.fused_qkv_a_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.attention.fused_qkv_a_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_index_share.attention.q_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.sparse_cycle_index_share.attention.q_b_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.attention.q_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_index_share.attention.kv_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.sparse_cycle_index_share.attention.main_rope` | [vllm_mla_rope](https://servingstudio.cs.washington.edu/kernels/vllm_mla_rope.md) | `vllm_inductor` |
| `unified.body.sparse_cycle_index_share.attention.q_absorb` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_q_absorb` |
| `unified.body.sparse_cycle_index_share.attention.sparse_mla.query_concat` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.attention.sparse_mla.mla_cache_append` | [mla_cache_append](https://servingstudio.cs.washington.edu/kernels/mla_cache_append.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.attention.sparse_mla.index_remap` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.attention.sparse_mla.prefill` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.sparse_cycle_index_share.attention.sparse_mla.decode` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.sparse_cycle_index_share.attention.v_up` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_v_up` |
| `unified.body.sparse_cycle_index_share.attention.o_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.attention.o_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_index_share.attention.input_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.attention.fused_qkv_a_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.attention.fused_qkv_a_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_index_share.attention.q_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.sparse_cycle_index_share.attention.q_b_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.attention.q_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_index_share.attention.kv_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.sparse_cycle_index_share.attention.main_rope` | [vllm_mla_rope](https://servingstudio.cs.washington.edu/kernels/vllm_mla_rope.md) | `vllm_inductor` |
| `unified.body.sparse_cycle_index_share.attention.q_absorb` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_q_absorb` |
| `unified.body.sparse_cycle_index_share.attention.sparse_mla.query_concat` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.attention.sparse_mla.mla_cache_append` | [mla_cache_append](https://servingstudio.cs.washington.edu/kernels/mla_cache_append.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.attention.sparse_mla.index_remap` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.attention.sparse_mla.prefill` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.sparse_cycle_index_share.attention.sparse_mla.decode` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.sparse_cycle_index_share.attention.v_up` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_v_up` |
| `unified.body.sparse_cycle_index_share.attention.o_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.attention.o_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_index_share.attention.input_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.attention.fused_qkv_a_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.attention.fused_qkv_a_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_index_share.attention.q_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.sparse_cycle_index_share.attention.q_b_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.attention.q_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_index_share.attention.kv_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.sparse_cycle_index_share.attention.main_rope` | [vllm_mla_rope](https://servingstudio.cs.washington.edu/kernels/vllm_mla_rope.md) | `vllm_inductor` |
| `unified.body.sparse_cycle_index_share.attention.q_absorb` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_q_absorb` |
| `unified.body.sparse_cycle_index_share.attention.sparse_mla.query_concat` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.attention.sparse_mla.mla_cache_append` | [mla_cache_append](https://servingstudio.cs.washington.edu/kernels/mla_cache_append.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.attention.sparse_mla.index_remap` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.attention.sparse_mla.prefill` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.sparse_cycle_index_share.attention.sparse_mla.decode` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.sparse_cycle_index_share.attention.v_up` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_v_up` |
| `unified.body.sparse_cycle_index_share.attention.o_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.attention.o_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_index_share.attention.input_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.attention.fused_qkv_a_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.attention.fused_qkv_a_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_index_share.attention.q_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.sparse_cycle_index_share.attention.q_b_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.attention.q_b_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_index_share.attention.kv_a_rms_norm` | [rms_norm](https://servingstudio.cs.washington.edu/kernels/rms_norm.md) | `flashinfer` |
| `unified.body.sparse_cycle_index_share.attention.main_rope` | [vllm_mla_rope](https://servingstudio.cs.washington.edu/kernels/vllm_mla_rope.md) | `vllm_inductor` |
| `unified.body.sparse_cycle_index_share.attention.q_absorb` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_q_absorb` |
| `unified.body.sparse_cycle_index_share.attention.sparse_mla.query_concat` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.attention.sparse_mla.mla_cache_append` | [mla_cache_append](https://servingstudio.cs.washington.edu/kernels/mla_cache_append.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.attention.sparse_mla.index_remap` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.attention.sparse_mla.prefill` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.sparse_cycle_index_share.attention.sparse_mla.decode` | [dsa_sparse_mla_attention](https://servingstudio.cs.washington.edu/kernels/dsa_sparse_mla_attention.md) | `vllm_flashmla_bf16` |
| `unified.body.sparse_cycle_index_share.attention.v_up` | [batched_gemm](https://servingstudio.cs.washington.edu/kernels/batched_gemm.md) | `torch_mla_v_up` |
| `unified.body.sparse_cycle_index_share.attention.o_proj_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.attention.o_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_index_share.moe.router.post_attn_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.moe.router.router_fp32_cast` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.moe.router.router_gemm_bf16_proxy` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_index_share.moe.router.router_select` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.moe.router.post_attn_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.moe.router.router_fp32_cast` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.moe.router.router_gemm_bf16_proxy` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_index_share.moe.router.router_select` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.moe.router.post_attn_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.moe.router.router_fp32_cast` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.moe.router.router_gemm_bf16_proxy` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_index_share.moe.router.router_select` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.moe.router.post_attn_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.moe.router.router_fp32_cast` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.moe.router.router_gemm_bf16_proxy` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_index_share.moe.router.router_select` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.moe.router.post_attn_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.moe.router.router_fp32_cast` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.moe.router.router_gemm_bf16_proxy` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_index_share.moe.router.router_select` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.moe.router.post_attn_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.moe.router.router_fp32_cast` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.moe.router.router_gemm_bf16_proxy` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_index_share.moe.router.router_select` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.moe.router.post_attn_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.moe.router.router_fp32_cast` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.moe.router.router_gemm_bf16_proxy` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_index_share.moe.router.router_select` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.moe.router.post_attn_add_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.moe.router.router_fp32_cast` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.moe.router.router_gemm_bf16_proxy` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_index_share.moe.router.router_select` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.moe.dispatch.prepare` | [moe_alltoall_prepare](https://servingstudio.cs.washington.edu/kernels/moe_alltoall_prepare.md) | `flashinfer_mnnvl` |
| `unified.body.sparse_cycle_index_share.moe.dispatch` | [moe_alltoall](https://servingstudio.cs.washington.edu/kernels/moe_alltoall.md) | `flashinfer_mnnvl` |
| `unified.body.sparse_cycle_index_share.moe.expand_input_rows` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.moe.expand_input_rows` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.moe.expand_input_rows` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.moe.expand_input_rows` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.moe.expand_input_rows` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.moe.expand_input_rows` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.moe.expand_input_rows` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.moe.expand_input_rows` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.moe.routed_experts.gate_up.input_quant` | [fp8_block_quant](https://servingstudio.cs.washington.edu/kernels/fp8_block_quant.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_index_share.moe.routed_experts.gate_up.gemm` | [fp8_blockscale_grouped_gemm](https://servingstudio.cs.washington.edu/kernels/fp8_blockscale_grouped_gemm.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_index_share.moe.routed_experts.activation` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.moe.routed_experts.down.input_quant` | [fp8_block_quant](https://servingstudio.cs.washington.edu/kernels/fp8_block_quant.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_index_share.moe.routed_experts.down.gemm` | [fp8_blockscale_grouped_gemm](https://servingstudio.cs.washington.edu/kernels/fp8_blockscale_grouped_gemm.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_index_share.moe.routed_experts.gate_up.input_quant` | [fp8_block_quant](https://servingstudio.cs.washington.edu/kernels/fp8_block_quant.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_index_share.moe.routed_experts.gate_up.gemm` | [fp8_blockscale_grouped_gemm](https://servingstudio.cs.washington.edu/kernels/fp8_blockscale_grouped_gemm.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_index_share.moe.routed_experts.activation` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.moe.routed_experts.down.input_quant` | [fp8_block_quant](https://servingstudio.cs.washington.edu/kernels/fp8_block_quant.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_index_share.moe.routed_experts.down.gemm` | [fp8_blockscale_grouped_gemm](https://servingstudio.cs.washington.edu/kernels/fp8_blockscale_grouped_gemm.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_index_share.moe.routed_experts.gate_up.input_quant` | [fp8_block_quant](https://servingstudio.cs.washington.edu/kernels/fp8_block_quant.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_index_share.moe.routed_experts.gate_up.gemm` | [fp8_blockscale_grouped_gemm](https://servingstudio.cs.washington.edu/kernels/fp8_blockscale_grouped_gemm.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_index_share.moe.routed_experts.activation` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.moe.routed_experts.down.input_quant` | [fp8_block_quant](https://servingstudio.cs.washington.edu/kernels/fp8_block_quant.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_index_share.moe.routed_experts.down.gemm` | [fp8_blockscale_grouped_gemm](https://servingstudio.cs.washington.edu/kernels/fp8_blockscale_grouped_gemm.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_index_share.moe.routed_experts.gate_up.input_quant` | [fp8_block_quant](https://servingstudio.cs.washington.edu/kernels/fp8_block_quant.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_index_share.moe.routed_experts.gate_up.gemm` | [fp8_blockscale_grouped_gemm](https://servingstudio.cs.washington.edu/kernels/fp8_blockscale_grouped_gemm.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_index_share.moe.routed_experts.activation` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.moe.routed_experts.down.input_quant` | [fp8_block_quant](https://servingstudio.cs.washington.edu/kernels/fp8_block_quant.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_index_share.moe.routed_experts.down.gemm` | [fp8_blockscale_grouped_gemm](https://servingstudio.cs.washington.edu/kernels/fp8_blockscale_grouped_gemm.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_index_share.moe.routed_experts.gate_up.input_quant` | [fp8_block_quant](https://servingstudio.cs.washington.edu/kernels/fp8_block_quant.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_index_share.moe.routed_experts.gate_up.gemm` | [fp8_blockscale_grouped_gemm](https://servingstudio.cs.washington.edu/kernels/fp8_blockscale_grouped_gemm.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_index_share.moe.routed_experts.activation` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.moe.routed_experts.down.input_quant` | [fp8_block_quant](https://servingstudio.cs.washington.edu/kernels/fp8_block_quant.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_index_share.moe.routed_experts.down.gemm` | [fp8_blockscale_grouped_gemm](https://servingstudio.cs.washington.edu/kernels/fp8_blockscale_grouped_gemm.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_index_share.moe.routed_experts.gate_up.input_quant` | [fp8_block_quant](https://servingstudio.cs.washington.edu/kernels/fp8_block_quant.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_index_share.moe.routed_experts.gate_up.gemm` | [fp8_blockscale_grouped_gemm](https://servingstudio.cs.washington.edu/kernels/fp8_blockscale_grouped_gemm.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_index_share.moe.routed_experts.activation` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.moe.routed_experts.down.input_quant` | [fp8_block_quant](https://servingstudio.cs.washington.edu/kernels/fp8_block_quant.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_index_share.moe.routed_experts.down.gemm` | [fp8_blockscale_grouped_gemm](https://servingstudio.cs.washington.edu/kernels/fp8_blockscale_grouped_gemm.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_index_share.moe.routed_experts.gate_up.input_quant` | [fp8_block_quant](https://servingstudio.cs.washington.edu/kernels/fp8_block_quant.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_index_share.moe.routed_experts.gate_up.gemm` | [fp8_blockscale_grouped_gemm](https://servingstudio.cs.washington.edu/kernels/fp8_blockscale_grouped_gemm.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_index_share.moe.routed_experts.activation` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.moe.routed_experts.down.input_quant` | [fp8_block_quant](https://servingstudio.cs.washington.edu/kernels/fp8_block_quant.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_index_share.moe.routed_experts.down.gemm` | [fp8_blockscale_grouped_gemm](https://servingstudio.cs.washington.edu/kernels/fp8_blockscale_grouped_gemm.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_index_share.moe.routed_experts.gate_up.input_quant` | [fp8_block_quant](https://servingstudio.cs.washington.edu/kernels/fp8_block_quant.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_index_share.moe.routed_experts.gate_up.gemm` | [fp8_blockscale_grouped_gemm](https://servingstudio.cs.washington.edu/kernels/fp8_blockscale_grouped_gemm.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_index_share.moe.routed_experts.activation` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.moe.routed_experts.down.input_quant` | [fp8_block_quant](https://servingstudio.cs.washington.edu/kernels/fp8_block_quant.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_index_share.moe.routed_experts.down.gemm` | [fp8_blockscale_grouped_gemm](https://servingstudio.cs.washington.edu/kernels/fp8_blockscale_grouped_gemm.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_index_share.moe.finalization` | [moe_finalize_routing](https://servingstudio.cs.washington.edu/kernels/moe_finalize_routing.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_index_share.moe.finalization` | [moe_finalize_routing](https://servingstudio.cs.washington.edu/kernels/moe_finalize_routing.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_index_share.moe.finalization` | [moe_finalize_routing](https://servingstudio.cs.washington.edu/kernels/moe_finalize_routing.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_index_share.moe.finalization` | [moe_finalize_routing](https://servingstudio.cs.washington.edu/kernels/moe_finalize_routing.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_index_share.moe.finalization` | [moe_finalize_routing](https://servingstudio.cs.washington.edu/kernels/moe_finalize_routing.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_index_share.moe.finalization` | [moe_finalize_routing](https://servingstudio.cs.washington.edu/kernels/moe_finalize_routing.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_index_share.moe.finalization` | [moe_finalize_routing](https://servingstudio.cs.washington.edu/kernels/moe_finalize_routing.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_index_share.moe.finalization` | [moe_finalize_routing](https://servingstudio.cs.washington.edu/kernels/moe_finalize_routing.md) | `flashinfer_trtllm` |
| `unified.body.sparse_cycle_index_share.moe.combine.output_fill` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.moe.combine` | [moe_alltoall](https://servingstudio.cs.washington.edu/kernels/moe_alltoall.md) | `flashinfer_mnnvl` |
| `unified.body.sparse_cycle_index_share.moe.combine.reduce` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.moe.shared_expert.gate_up_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.moe.shared_expert.gate_up_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_index_share.moe.shared_expert.silu_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.moe.shared_expert.down_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.moe.shared_expert.down_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_index_share.moe.shared_expert.gate_up_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.moe.shared_expert.gate_up_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_index_share.moe.shared_expert.silu_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.moe.shared_expert.down_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.moe.shared_expert.down_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_index_share.moe.shared_expert.gate_up_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.moe.shared_expert.gate_up_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_index_share.moe.shared_expert.silu_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.moe.shared_expert.down_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.moe.shared_expert.down_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_index_share.moe.shared_expert.gate_up_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.moe.shared_expert.gate_up_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_index_share.moe.shared_expert.silu_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.moe.shared_expert.down_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.moe.shared_expert.down_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_index_share.moe.shared_expert.gate_up_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.moe.shared_expert.gate_up_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_index_share.moe.shared_expert.silu_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.moe.shared_expert.down_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.moe.shared_expert.down_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_index_share.moe.shared_expert.gate_up_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.moe.shared_expert.gate_up_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_index_share.moe.shared_expert.silu_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.moe.shared_expert.down_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.moe.shared_expert.down_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_index_share.moe.shared_expert.gate_up_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.moe.shared_expert.gate_up_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_index_share.moe.shared_expert.silu_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.moe.shared_expert.down_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.moe.shared_expert.down_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_index_share.moe.shared_expert.gate_up_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.moe.shared_expert.gate_up_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.body.sparse_cycle_index_share.moe.shared_expert.silu_and_mul` | [elementwise](https://servingstudio.cs.washington.edu/kernels/elementwise.md) | `triton` |
| `unified.body.sparse_cycle_index_share.moe.shared_expert.down_input_quant` | [fp8_per_token_group_quant](https://servingstudio.cs.washington.edu/kernels/fp8_per_token_group_quant.md) | `vllm_cuda` |
| `unified.body.sparse_cycle_index_share.moe.shared_expert.down_proj` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `deepgemm` |
| `unified.main.final_residual_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.main.final_residual_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.main.final_residual_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.main.final_residual_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.main.final_residual_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.main.final_residual_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.main.final_residual_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.main.final_residual_rms_norm` | [residual_rms_norm](https://servingstudio.cs.washington.edu/kernels/residual_rms_norm.md) | `vllm_cuda` |
| `unified.main.lm_head` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear` |
| `unified.main.lm_head` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear` |
| `unified.main.lm_head` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear` |
| `unified.main.lm_head` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear` |
| `unified.main.lm_head` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear` |
| `unified.main.lm_head` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear` |
| `unified.main.lm_head` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear` |
| `unified.main.lm_head` | [single_gemm](https://servingstudio.cs.washington.edu/kernels/single_gemm.md) | `torch_linear` |

## Simulations that run it

- [`GLM-5.2-FP8/glm52_vllm_dsa_moe_hp_unified`](https://servingstudio.cs.washington.edu/simulate.html?preset=GLM-5.2-FP8%2Fglm52_vllm_dsa_moe_hp_unified): unified deployment, 2 configurations

## API

- This deployment in the model list: https://servingstudio.cs.washington.edu/api/public/v1/models
- The kernels of one configuration: https://servingstudio.cs.washington.edu/api/public/v1/models/GLM-5.2-FP8/glm52_vllm_dsa_moe/tree?workload=ctx8k_out1k

---

This page as Markdown: https://servingstudio.cs.washington.edu/models/GLM-5.2-FP8/glm52_vllm_dsa_moe.md. A guide to the whole site for AI agents: [llms.txt](https://servingstudio.cs.washington.edu/llms.txt).
