After this explainer you canExplain what happens between your question and the answer, why every answer has a running cost, and compare what different models cost.

The short answerEvery request runs the trained model on chips in a data centre to produce an answer. This step is called inference: training happens once, inference happens every time someone uses the model.

In simple words

  • Inference means using a trained model to answer a request.
  • It runs on chips such as GPUs, in large data centres.
  • Businesses pay per token, so speed and price matter.
  • Data centres need a lot of electricity, which keeps them in the news.
One request, start to finishIllustration + live data

Cost of 1,000 such answers

  1. Claude Haiku 5.5$0.350
  2. DeepSeek V4.1 Flashopen weights$0.900
  3. GLM-5.3open weights$3.60
  4. Grok 4.7$5.00
  5. Gemini 4 Carbon$7.00
  6. Claude Fable 5.2$28.00
  7. GPT-6 Astra$35.00

List prices per million tokens from each company’s pricing page, as in our model comparison of November 16, 2026. Output tokens cost more than input, so long answers cost more quickly. Reasoning models also bill their hidden thinking as output. As a guide, Google counts 100 tokens as about 60 to 80 English words.

The journey is a simplified picture of serving. The prices are real list prices from our model comparison.

Words to know

Prompt
What you type or send to a model.
Data centre
A building full of computers that run models.
Inference
Using a trained model to get an answer.

Training once, inference every time

A model is trained once, at great cost. After that, every question, image or agent step needs the model to run again. That is inference.

Because it happens for every user and every step, the cost of inference decides how cheap, fast and widely used AI can be.

Tokens and prices

AI services measure work in tokens. For Google’s Gemini models, 100 tokens are about 60 to 80 English words.

Businesses often use a model through an API, a connection that lets their own software use it. They pay for the tokens they send in and the tokens the model writes back, and prices differ a lot between models.

Reasoning models also think before they answer, and those hidden thinking tokens are billed as output too. Our model comparison lists prices next to independent test results, so you can see what you get for the money.

Chips and data centres

Models run on specialised chips: Nvidia’s GPUs (graphics processing units), Google’s TPUs (tensor processing units) and a growing number of custom chips. Thousands of them sit in data centres that need a lot of power and cooling.

That is why chip export rules, power deals and new data centres appear in the news so often.

Labels on what comes out

Some laws cover the output itself. In the EU, AI that creates text, images, video or sound must mark its output in a way computers can detect. California requires hidden data in AI-made images, video and audio that shows where they came from.

Try it yourself

In the cost calculator above, set the answer to 4,000 tokens. Which models cost at least ten times more than the cheapest one?

Check yourself3 quick questions
  1. A model was trained last year. Today, a million people ask it questions. Which step runs a million times today?

  2. You send the same questions to two models. Model A’s price per token is ten times Model B’s, and the answers are the same length. What happens to your bill?

  3. Why do chip export rules and power deals keep appearing in AI news?

Sources

This explainer was generated by AI systems under the editorial rules of Silicon AI News and checked against the sources it lists. The live parts come from our checked stories, trackers, model comparison and rules checker.