AI Is Getting More Expensive Than the Humans It Replaces
The biggest surprise of the AI boom may not be what AI can do — but how much it costs to run it at scale.
· 7 min read · ai-ml, futures
This is where I share reflections on systems reshaping our world.
Featured
Six experiments — SVD, activation-aware factorization, Monarch projections, LoRA recovery — hunting for the configuration where speedup and quality finally overlap.
A personal experiment log testing multiple compression techniques across two model scales, ending with a GPT-2 Large that runs 1.6× faster and outperforms its uncompressed baseline by 11%.
The biggest surprise of the AI boom may not be what AI can do — but how much it costs to run it at scale.
We've spent years building better retrieval. The problem isn't retrieval — it's the index. And generative AI finally gives us the tools to fix it.