What if AI is too Expensive?

The past few years have seen the rapid proliferation of large language model-based AI solutions. LLMs have been treated like existing cloud services which are low cost even at large scale. Recent developments are shedding light on the fact that LLMs might be quite a bitter costlier than many believed. In this episode of Talk to Me Petey D, I share my 10 predictions of what will happen if LLM AI costs rise significantly.

1. Frontier to more cost-effective models
2. RAG to fine-tuning SLMs
3. Model routing
4. GOFAI (rules, expert systems) and traditional software
5. Harness + Model pairing
6. Edge inference
7. More human in the loop vs autonomous agents
8. Reexamine task automation and human vs automation costs
9. AI Budget governance
10.  ROI – measure what matters, not just usage and activity