Jake Lawrence · AI Systems / ML Infrastructure · AI Systems theme
An LLM that produces the right answer at 100x the necessary cost has an infrastructure problem, not an intelligence problem.
Applies cost-based query planning from database systems to LLM inference. Uses contextual bandits to route between execution plans for constrained decoding.
LLM-QP classifies queries by execution cost. Every routing decision is a classification decision with consequences the user never sees.
Two missing infrastructure layers. SAGEN builds awareness; LLM-QP builds cost-efficiency. Both are classification systems.
LLM-QP tries to close the gap between valid and affordable output. The Beautiful Unfinished asks whether that gap can ever fully close.
This is field data, not commentary: dated, sourced, and versioned. Subscribe and the next release, correction or new thread reaches you when it lands. It is the one list for the whole site, so you will get the rest of the work too. No schedule, easy out.
Back to the release table · See it on the network · Machine-readable catalog
I build the AI tools and automations a team adopts, and the full-stack apps and data pipelines under them, and ship them to production. Tell me the problem in a sentence and I'll give you an honest read on fit within a day.
Work with me →