Jake Lawrence · AI Systems / ML Infrastructure · AI Systems theme
An LLM that produces the right answer at 100x the necessary cost has an infrastructure problem, not an intelligence problem.
Applies cost-based query planning from database systems to LLM inference. Uses contextual bandits to route between execution plans for constrained decoding.
LLM-QP classifies queries by execution cost. Every routing decision is a classification decision with consequences the user never sees.
Two missing infrastructure layers. SAGEN builds awareness; LLM-QP builds cost-efficiency. Both are classification systems.
LLM-QP tries to close the gap between valid and affordable output. The Beautiful Unfinished asks whether that gap can ever fully close.
Back to the release table · See it on the network · Machine-readable catalog
I design and ship AI tools, full-stack apps, and data pipelines — end to end, to production. Tell me the problem in a sentence; I'll give you an honest read on fit within a day.
Work with me →