What the scores measure
These are external agent–model evaluations, not tests inside Copilot. A shared benchmark name does not imply identical tools, effort or compute budgets. Details retain published uncertainty and agent labels.
Published engineering benchmarks and Copilot prices, in one view.
These are external agent–model evaluations, not tests inside Copilot. A shared benchmark name does not imply identical tools, effort or compute budgets. Details retain published uncertainty and agent labels.
By default the lens weights five topics. Each topic score is a model's average standing (0–100, rank-based among the selectable Copilot models with a result) on that topic's benchmarks, as in the Overview; the company score is the weighted mean of the topic scores a model has, and needs scores covering at least half of the weight. Advanced mode weights individual benchmarks on their raw scale instead: Σ(capability weight × selected benchmark score) ÷ Σ(capability weights). Each capability uses one fixed benchmark, so adding benchmarks does not add votes. Task success rates use percentages; LiveBench Coding (1.0 and 2.0) uses its 0–100 score. These measure different things; advanced mode applies no rescaling. A missing selected result suppresses the score. Versions, subsets and prompt settings stay separate. Cost is separate. Equal weights are a starting point, not an approved policy.
USD per million tokens at GitHub's default context tier. Input and output are shown separately. Model details include cache and long-context rates. Seat fees, allowances and workload token counts are separate.
GitHub pricing ↗Catalog covers GitHub’s named supported models plus listed utility models. Actual access depends on plan, client and enterprise policy; your tenant has not been connected. This page does not enable or disable models. Dates marked “not published” are not inferred from crawl dates. Check availability ↗