Why did AI costs increase even though token prices dropped 99.7%?

The Jevons Paradox: cheaper tokens led to 50-500x more usage through agentic workflows, chain-of-thought, RAG pipelines, and multi-step agents. Token prices fell but total consumption exploded, tripling enterprise AI spend to $37B.

What percentage of AI costs are outside of inference?

72% of AI costs sit outside inference — in data pipelines, orchestration, vector databases, monitoring, and workflow tooling. Most teams only optimize the 28% they can see (token costs) and miss the majority of their spend.

How much do agentic AI workflows multiply token usage?

Agentic workflows multiply token consumption 50-500x compared to single-shot prompts. Each agent step, tool call, retry, and chain-of-thought iteration consumes additional tokens, turning cheap per-token prices into large bills.

How can I reduce my AI infrastructure costs?

Focus on workflow-level visibility, not just token prices. Profile your full cost stack including orchestration, data pipelines, and retries. Consider model inference optimization, self-hosting for high-volume workloads, and architectural changes like caching and prompt compression.

Tokens got 99.7% cheaper. So why did your AI bill triple?

Back to Home

Slide 2 - The Numbers

99.7%

Token price collapse

Unit token pricing dropped dramatically.

3×

Average AI bill increase

Total monthly AI invoices still surged.

72%

Spend outside inference

Most cost sits beyond model token usage.

Slide 3 - The Insight

Core Reality

Inference invoice is only 20-40% of real AI cost.

The model bill is visible, so teams optimize it first. The bigger cost centers are often hidden in the systems around the model.

Where the other 60-80% hides

Orchestration and agent workflow overhead
Retries, fallbacks, and failure recovery loops
Idle infra and overprovisioned concurrency
Retrieval, chunking, and vector-store inefficiency
Observability, guardrails, and tooling tax
Human operations and incident-response burden

Slide 4 - CTA

Get the Free Report.

Submit your details and we will send a verification email before granting access to the report.

Related research

Read the May 2026 AI Economics Report.

The companion economics report expands this cost story with provider margins, hyperscaler capex, sustainability risk, and builder guidance for 2026 AI budgets.

Open AI Economics Report