After this explainer you canExplain what happens between your question and the answer, why every answer has a running cost, and compare what different models cost.

The short answerWhen you ask a question, it travels over the internet to a data centre, a building full of computers. Special chips run the model there and send the answer back in seconds.

In simple words

  • Using a trained model to get an answer is called inference.
  • It runs on special chips in big data centres.
  • Businesses that use AI models pay for every token, in the question and in the answer.
  • Data centres use a lot of electricity.
One request, start to finishIllustration + live data

Cost of 1,000 such answers

  1. Claude Haiku 5.5$0.350
  2. DeepSeek V4.1 Flashopen weights$0.900
  3. GLM-5.3open weights$3.60
  4. Grok 4.7$5.00
  5. Gemini 4 Carbon$7.00
  6. Claude Fable 5.2$28.00
  7. GPT-6 Astra$35.00

List prices per million tokens from each company’s pricing page, as in our model comparison of November 16, 2026. Output tokens cost more than input, so long answers cost more quickly. Reasoning models also bill their hidden thinking as output. As a guide, Google counts 100 tokens as about 60 to 80 English words.

The journey is a simplified picture of serving. The prices are real list prices from our model comparison.

Words to know

Prompt
What you type or send to a model.
Data centre
A building full of computers that run models.
Inference
Using a trained model to get an answer.

Your question takes a trip

Your question, also called a prompt, goes over the internet to a data centre, a building full of computers. The model runs there and sends back the answer, piece by piece. That is why answers often appear word by word on your screen.

The model was trained once, before you used it. Running it to answer you is called inference, and it happens every time anyone asks anything.

Some small models can also run on a phone or laptop, so your words stay on your device.

Paying by the piece

AI companies charge businesses and developers by tokens, small pieces of text. Longer questions and longer answers cost more, and some models cost far more than others.

Chat apps usually charge people a monthly fee instead, or nothing.

Data centres need a lot of electricity

The chips that run models need a lot of electricity and cooling. That is why power deals, chips and new data centres appear in AI news so often.

Try it yourself

In the cost calculator above, set the answer to 4,000 tokens. Which models cost at least ten times more than the cheapest one?

Check yourself3 quick questions
  1. Why does a chat app’s answer often appear on your screen word by word?

  2. Two companies use the same AI model and pay for each token. Which one pays more for one answer?

  3. A tech company plans a huge new data centre. Why does it also make a deal to buy electricity?

Sources

This explainer was generated by AI systems under the editorial rules of Silicon AI News and checked against the sources it lists. The live parts come from our checked stories, trackers, model comparison and rules checker.