Benchmark
By HubAI editorial team · Source checked: 24 October 2026What does it mean?
A standardised test or dataset used to compare systems. It measures performance on its chosen tasks under particular conditions, not every job a customer might need.
Picture this
A coding model scores well on a public test, but your team also checks its ability to change an unfamiliar repository without breaking existing tests.
Where you’ll come across it
Shortlisting models and tracking broad progress. Read the methodology, configuration and whether the result came from the supplier or an independent evaluator.
What it doesn’t mean
A leaderboard is not a purchasing decision. Test contamination, narrow task coverage and different tool access can make apparently simple comparisons misleading.
Keep a tiny scorecard
A short exercise · use fictional or non-sensitive material.
- Choose five representative fictional tasks and define what counts as correct before running them.
- Record success, correction needed and time to a usable result for each attempt.
- Repeat after one change, keeping the task set fixed. Treat this as an exploratory check, not a reliable benchmark.
What failed, and would that failure matter to the person using the result?
Did that make it clearer?
Likes are a private on-page choice, not a public rating. For a correction or complaint, send the pre-filled form to our editorial inbox. Nothing is sent until you submit it.Check the source
Written and explained by HubAI. The reference below lets you go deeper; it is not an endorsement of a particular product.
Technical reference: developers.google.com ↗