Skip to content
← All posts
ProductOctober 22, 2026

Before You Cap Your Team's AI Spend, Find Out What You Could Save

A founder recently celebrated their team’s $16k Claude Code bill on LinkedIn, and set a target to spend $60k for the next month. His team was moving faster and getting more done. But my question is how much of that spend was actually necessary. Unless you know the kind of work that went into generating them, the number is arbitrary. That $16,000 could mean that his team build and shipped something ambitions in a fraction of the time it would have taken otherwise or they could have spent thousands on routine tasks that didn’t require the most expensive model or it can sit somewhere in between.

LinkedIn post by Julio-Cezar Scerbina, co-founder and CEO at Alven: We spent $16k on Claude Code last month. Jensen Huang says $500k engineers should be using at least $250k in tokens. Next month, we're aiming to spend $60k. I'm starting to believe the winners in any category will be the ones who spend the most tokens. We have 6 agents running non-stop. The goal: become the first unicorn with fewer than 10 people.
A founder’s monthly Claude Code bill, posted as a milestone. Next month’s target is nearly four times higher.

Spending more on AI isn’t necessarily bad. The biggest question is: did that spend produce valuable work? Did you use a hammer for the job that required the hammer or a sledgehammer for a nail? Could you have done that work for $10,000 instead? Most teams don’t know the answer to that question because they measure the actual spend rather than how much they need to spend.

Engineers want to build, and switching models breaks their flow

Think about an engineer who’s been working on a complicated feature all morning. They’re using Fable because they need its reasoning capabilities to work through architecture decisions, troubleshoot a difficult bug, and figure out how everything fits together. But once they work through the problem, they move on to reading files, checking Git status, updating documentation, and preparing a summary of their changes. And they’re still using Fable.

They could switch to a lighter-weight model for those smaller tasks, but that breaks the momentum they’ve built. Stopping to think about model selection is another interruption they don’t need. We shouldn’t be asking engineers to stop in the middle of a productive session and calculate how much each request is costing the company. But if we multiply those decisions across an engineering team, hundreds of sessions, and thousands of requests, the cost adds up, even when nobody is doing anything particularly unreasonable.

The solution is to manage AI spending in a way that doesn’t disrupt engineers’ workflow.

Before you set a spend cap, forecast where the team is headed

In July, the Financial Times reported on Amazon’s $1.8 million Claude overrun that ran 860% over budget and went unnoticed for five months. The knee-jerk reaction is to add spend caps. Sure, they have their place along with chargebacks and approval processes, but those controls don’t tell you whether the models your team is using are the right ones for the work or give you room for improvements in forecasting and planning. The key is to anticipate potential overruns and manage spending proactively rather than reactively.

You don’t have to put an arbitrary cap on your team’s spending or add friction to their workflow. You should be looking at where the team is headed in terms of spend and making informed decisions based on forecasts rather than reacting to overruns after the fact. By anticipating potential overruns, you avoid reactionary decisions and can take proactive measures to optimize resource allocation, adjust priorities, or provide guidance to the team without disrupting their flow.

Spend by team forecast chart from paper console. Headline: Forecast $2.04M, $144k under budget. Subtitle: without routing, the same traffic would cost $2.43M this month and cross the budget line before Oct 29. A solid line for spend with routing runs from Oct 1 to a today marker at Oct 16, then continues as a dashed forecast to $2.04M on Oct 31, staying under the red budget line at $2.18M. A gray dashed line for spend without routing climbs faster and crosses the budget line around Oct 27, ending at $2.43M. Summary strip: forecast with routing $2.04M, budget $2.18M, under budget $144k, without routing $2.43M.
SOURCE paper console · team spend forecast · illustrative dataTeam spend forecast against the budget line. With routing, the month lands $144k under budget. Without it, the same traffic crosses the line before Oct 29.

Imagine your organization has a monthly AI budget of $10,000. By looking at what your teams have spent so far and their current rate of usage, you should be able to forecast whether you’ll stay within budget or risk an overrun. Team-level forecasts also make it possible to identify when one team is approaching its budget, when spending suddenly spikes, or when a disproportionate amount of usage is coming from a handful of engineers.

That creates an opportunity for a much better conversation. Instead of telling a team they’ve spent too much and need to cut back, you can show them where they’re headed, understand what’s driving the spending, and look for opportunities to improve before there’s a problem.

What if the work did not need that much spend? Introducing Routable Spend

Forecasting your team’s spend only solves one part of the problem though. Routable spend is money spent on powerful AI models for work that a lighter-weight model could handle just as well. Understanding that number can help you identify opportunities for improvement.

For instance, let’s say your engineer is using Fable to build a new feature. They need its reasoning capabilities to work through some complicated architecture decisions, but they’re also using it to read files, check Git status, and update documentation. Those requests don’t necessarily need the same model. And because tapes captures your agent sessions, including the prompts, model choices, tool calls, and costs, Paper can use that history to identify spending associated with work that might be better suited to a more efficient model.

Consider a simple example. An engineer needs to summarize an incident for a public status page:

“Summarize this incident thread into three bullets for the status page: checkout latency spiked at 09:40, rollback of payments-api v412 at 10:05, latency back to normal by 10:20.”

In one column, we see the request send and get the actual cost. To determine the potential savings, we compare it with an alternative routing approach. In the case below,the router selects Qwen 3.5 Small for a 98% cost reduction.

Paper Playground comparison. Headline: Same prompt. Same three bullets. 98% less to produce them. Prompt: summarize this incident thread into three bullets for the status page, with the 09:40 latency spike, the 10:05 rollback of payments-api v412, and recovery by 10:20. Semantic routing, routed to baseten qwen-3.5-small: 210 tokens in, 74 out, $0.0001, 0.8 seconds. Pinned model, anthropic claude-fable-5-1: 210 tokens in, 168 out, $0.0042, 3.4 seconds. Both routes return the same three bullets: 09:40 checkout latency increased for some travelers, 10:05 we rolled back the latest payments service release, 10:20 checkout performance is back to normal and we are monitoring. Summary: semantic routing $0.0001, Fable pinned $0.0042, saved by routing 98% less. One shared prompt, $0.0041 difference, illustrative request costs.
SOURCE Paper Playground · illustrative request costsThe same incident-summary prompt, routed and pinned, side by side. Both return the same three bullets. The routed request costs 98% less and returns about four times faster.

You can use real session data to understand which tasks are good candidates, evaluate alternatives, and make model decisions based on evidence. As you look at your organization’s Routable Spend, you might discover that 10% of your frontier model spend is routable and could be optimized by routing to more efficient models.

Make the right model the easy choice

Even the companies investing heavily in AI are starting to recognize the value of making smarter model decisions. In May 2026, Marc Benioff said he expects Salesforce to spend $300 million on Anthropic tokens this year, nearly all of it on coding, and in the same conversation argued for an intermediary layer that sends hard reasoning to Claude and simpler tasks to cheaper models.

That’s what an AI gateway with Paper makes possible. Once your team has identified opportunities and tested which models work best for different kinds of requests, you can translate those decisions into routing policies. Instead of asking engineers to choose a model every time they send a request, the gateway can make that decision for them. This is a big part of how we think about Paper Compute as the control plane for AI enablement.

tapes captures the work your agents are doing. Paper Console helps teams understand their spending and identify opportunities to improve it. The Gateway gives teams a place to apply model choices and policies consistently.

Spend where it matters: AI Enablement

For a long time, controlling costs has meant setting limits. Give a team a budget, tell them how much they’re allowed to spend, and make someone responsible when they exceed it. But as AI becomes part of everyday engineering work, there’s an opportunity to approach spending differently.

Start by understanding what your teams are doing and where their spending is headed. Identify the work that could run on more efficient models, test those alternatives, and apply routing policies that make the right choices easier.

Then keep measuring.

The goal is to create an environment where engineers can use the tools they need without constantly thinking about model pricing, while engineering leaders have the visibility to understand costs and make informed decisions before budgets become a problem.

That $16,000 Claude Code bill from the beginning of this story might have been worth every penny. Or there might have been thousands of dollars in spending that could have been avoided. Wouldn’t you want to know? The goal is to stop paying for intelligence you don’t need, so you can afford it when you do.

Found this useful? Share it.
ShareY

Frequently asked questions

What is routable spend?+
Routable spend is the portion of your frontier-model spend that a less expensive model could likely have handled: harness-generated overhead turns, short read-only tool calls that read a file or check repository status, and similar routine requests. It is a screening estimate of candidate spend for optimization.
How is routable spend different from an AI spend cap?+
A spend cap limits how much a team can spend. Routable spend tells you how much of what you already spent was necessary. Caps act on the total. Routable spend acts on the mix of models behind the total, so the same work can cost less without asking engineers to do less of it. Most teams benefit from measuring routable spend before deciding where a cap should sit.
Why do engineers default to the most expensive model for everything?+
Because switching costs attention. An engineer deep in a problem moves between architecture decisions, debugging, documentation, summaries, and routine tool calls without stopping to reprice each one. The frontier model works for all of them, so it becomes the default. The cost shows up later, on the bill, multiplied across a team. Routing policies move that decision out of the engineer's flow and into infrastructure.
Does semantic routing hurt output quality?+
It can, if the policy is set by price alone. The right test is whether the cheaper model meets the same requirements for that kind of request, which is why you compare outputs side by side on real prompts before routing a category of work. Complex reasoning and difficult engineering tasks often still justify a frontier model. Routine summaries, read-only calls, and harness overhead often do not.
How does a spend forecast help before the bill arrives?+
A bill tells you what happened. A forecast projects where a team's spend is heading against its budget line, so a lead can see a likely overrun weeks early and investigate while there is still time to act. Amazon's $1.8 million Claude overrun went undetected for five months. Team-level tracking and alerts turn that kind of surprise into a conversation you can have in advance.
What does Paper Compute do for AI cost management?+
Paper Compute is a control plane for AI enablement. tapes captures agent sessions, the console makes that work and its cost visible, including spend forecasts and routable spend, the Playground lets you compare semantic routing against a pinned frontier model on the same prompt, and the gateway applies routing policies so the right model becomes the easy choice. Teams using the self-hosted options keep deployment and data inside their own infrastructure.

Start with paper

Turn every session into knowledge at team scale.

Get started