[ServingStudio](https://servingstudio.cs.washington.edu/)

# Blog

Filter by topic

Search posts

## Latest posts

3 posts

Release

### SSEngine-GLM5.3-Flash: Pipeline-Parallel Prefill with Tiered Prefix Caching for Agentic Workloads

An open-source prefill engine for GLM-5.3-Flash on four B200 GPUs that combines pipeline parallelism, a prefix cache across HBM, DRAM and SSD, and a shortest-remaining-prefill-first scheduler.

November 17, 2026 Kan Zhu, Mathew Jacob, Ben Lundell, Parul Verma, Marty Butler, Stephanie Wang, Arvind Krishnamurthy, Baris Kasikci 38 min read

[https://servingstudio.cs.washington.edu/blog/ssengine-glm53-flash/](https://servingstudio.cs.washington.edu/blog/ssengine-glm53-flash/)

Model Perf

### Beyond GQA: Characterizing Modern Attention Variants with ServingStudio

How the attention designs of today's open models trade memory, bytes read per step and compute against GQA, with measured B200 kernel times.

November 13, 2026 Kan Zhu, Tan Ngo, Michael Gu, Mathew Jacob, Stephanie Wang, Arvind Krishnamurthy, Baris Kasikci 17 min read

[https://servingstudio.cs.washington.edu/blog/attention-variants/](https://servingstudio.cs.washington.edu/blog/attention-variants/)

Release Use Cases

### Introducing ServingStudio: An Integrated Workbench for Simulating, Analyzing, and Optimizing LLM Serving Systems

Compare serving configurations using measured GPU timings, then let an agent implement and validate promising optimizations in real serving frameworks.

September 24, 2026 Kan Zhu, Michael Gu, Sheetal Sriram, Mathew Jacob, Keisuke Kamahori, Vic Li, Yi Pan, Dedong Xie, Stephanie Wang, Arvind Krishnamurthy, Baris Kasikci 7 min read

[https://servingstudio.cs.washington.edu/blog/introducing-servingstudio/](https://servingstudio.cs.washington.edu/blog/introducing-servingstudio/)

[ServingStudio](https://servingstudio.cs.washington.edu/) Simulate, understand, and optimize LLM serving. [Page source](https://github.com/SyFI-ServingStudio/ServingStudioIntro)

---

This page as Markdown: https://servingstudio.cs.washington.edu/blog.md. A guide to the whole site for AI agents: [llms.txt](https://servingstudio.cs.washington.edu/llms.txt).
