The Serving Stack
Start hereCollectionsNewsletter
Sign in

tool-use

1 post

BUILDING WITH AI · 01CACHED HISTORY+ NEW TOOL OUTPUT21 TURNS, 90% READ FROM CACHE
building-with-aiagentstool-use

A 27B Model as Your Local Agent: What It Can and Can't Do

Real coding-agent turns replayed on a 27B model on one desk-side GPU: what the prefix cache saves, how many agents fit, how well it calls tools.

by The Serving Stack

Inference Notes

Once a week: what changed in serving AI models, and what it means if you build, run or pay for them, in about five minutes.

The Serving Stack

Inference Engineering, In Depth

Navigate

HomeStart hereCollectionsNewsletterAll articles

Collections

Inference EnginesHow an LLM Request Becomes TokensLLMs, ExplainedThe GPU for Inference EngineersQuantization in PracticeServing in Production

Links

RSS Feed

Legal

Privacy PolicyTerms of ServiceCookie Policy
© 2026 The Serving Stack. All rights reserved.