The Serving Stack
Start hereCollectionsNewsletter
Sign in

mla

1 post

OPEN-MODEL LABS · 01STANDARD ATTENTION · 4.8 MiBLATENT (MLA) · 68.6 KiB71×LESS KV PER TOKEN
open-model-labsdeepseekmoe

DeepSeek: From V1 to V4, the Models and the Breakthroughs

DeepSeek's models in order, the idea behind each one (MoE, latent attention, FP8 training, RL reasoning, sparse attention), and what each changed for everyone else.

by The Serving Stack

Inference Notes

Once a week: what changed in serving AI models, and what it means if you build, run or pay for them, in about five minutes.

The Serving Stack

Inference Engineering, In Depth

Navigate

HomeStart hereCollectionsNewsletterAll articles

Collections

Inference EnginesHow an LLM Request Becomes TokensLLMs, ExplainedThe GPU for Inference EngineersQuantization in PracticeServing in Production

Links

RSS Feed

Legal

Privacy PolicyTerms of ServiceCookie Policy
© 2026 The Serving Stack. All rights reserved.