Kernel Library | ServingStudio

Explore measured GPU performance across the kernels, shapes, and backends that power LLM serving.

Interactive page: https://servingstudio.cs.washington.edu/kernels.html. The page reads its lists from ServingStudio Sim's public API at https://servingstudio.cs.washington.edu/api/public/v1 (OpenAPI: https://servingstudio.cs.washington.edu/api/public/v1/openapi.json). An agent can use it through the servingstudio-kernel-performance skill.

This text was generated when the site was built, from Sim commit db977adc881595c5b48aa070bddc7cd6f33db130; the API has the current lists.

The Kernel Library lists 100 kernel kinds measured on NVIDIA B200, NVIDIA H200, last measured 2026-11-07. Each kind is one operation; its rows are measurements, one per combination of argument values, GPU and backend. Read the rows of a kind from /api/public/v1/kernels/{kind}/rows (?format=csv for CSV).

GEMM

Attention

MoE

Communication

Normalization

Quantization

Other


This page as Markdown: https://servingstudio.cs.washington.edu/kernels.md. A guide to the whole site for AI agents: llms.txt.