Inference
By HubAI editorial team · Source checked: 24 October 2026What does it mean?
Running a trained model on an input to produce a prediction or output. Inference is the operational use of the model, not the process of teaching its weights.
Picture this
An app sends a passage to a deployed model and receives a summary. That request uses inference, even if no training happens on your passage.
Where you’ll come across it
Everyday AI applications, production model serving and cost planning. Include retries, long outputs and any tool calls when measuring the whole task.
What it doesn’t mean
A fast model response does not necessarily mean a fast finished job. Retrieval, network delays, tools and human review can dominate the time you actually spend.
Compare on a job, not a label
A short exercise · use fictional or non-sensitive material.
- Choose a small set of non-sensitive tasks, including an awkward case and a missing-information case.
- Keep the inputs and scoring checklist the same when you compare two model setups.
- Record useful completions, corrections and elapsed time. Keep the model name and settings with the results.
Is the improvement still useful after you include checking and correction time?
Did that make it clearer?
Likes are a private on-page choice, not a public rating. For a correction or complaint, send the pre-filled form to our editorial inbox. Nothing is sent until you submit it.Check the source
Written and explained by HubAI. The reference below lets you go deeper; it is not an endorsement of a particular product.
Technical reference: developers.google.com ↗