Field notes
Things I learned building Torana.
Experiments, architectural detours, and the occasional “how did this become a plugin runtime?”
I wanted cheaper AI chats. I built a proxy instead.
How a compaction experiment became a local-first, programmable proxy—and what I want to build with it.
I built a context compactor, then built the accounting that told me not to ship it
75 sessions across three arms, 4.81 MB removed by deterministic compaction, and a paired cost interval that crosses zero. A provider-specific experiment in context compaction.
26 July 2026 · context · prompt caching · negative result