Work & agents

13 benchmarks
AA-Briefcase190 scored models

Score vs. cost per task · each point is a model

Most attractive regionLeast attractive regionPareto frontierAnthropicSpaceXAIOpenAIAlibabaMeta
$0.00$7.88$15.76$23.65$31.530%491.9983.81,475.71,967.6Cost per task (USD)AA-BriefcaseClaude Opus 5.5 (max with fallback) · Anthropic Cost per task: $21.05 AA-Briefcase: 1,821.9Claude Sonnet 5.5 (max with fallback) · Anthropic Cost per task: $29.19 AA-Briefcase: 1,810.9Claude Opus 5.5 (xhigh with fallback) · Anthropic Cost per task: $12.27 AA-Briefcase: 1,779.5Claude Sonnet 5.5 (xhigh with fallback) · Anthropic Cost per task: $9.63 AA-Briefcase: 1,745.7Claude Opus 5.5 (high with fallback) · Anthropic Cost per task: $6.27 AA-Briefcase: 1,704.5Grok 4.7 (xhigh) · SpaceXAI Cost per task: $9.30 AA-Briefcase: 1,657.2Claude Fable 5.1 (xhigh with fallback) · Anthropic Cost per task: $17.79 AA-Briefcase: 1,650Claude Fable 5.1 (max with fallback) · Anthropic Cost per task: $22.71 AA-Briefcase: 1,646.1Claude Opus 5.5 (medium with fallback) · Anthropic Cost per task: $4.40 AA-Briefcase: 1,642.1Grok 4.7 (high) · SpaceXAI Cost per task: $7.42 AA-Briefcase: 1,636.7Claude Sonnet 5.5 (high with fallback) · Anthropic Cost per task: $3.95 AA-Briefcase: 1,634Claude Opus 5 (max) · Anthropic Cost per task: $17.79 AA-Briefcase: 1,633.4Claude Opus 5 (xhigh) · Anthropic Cost per task: $14.26 AA-Briefcase: 1,624.6Qwen3.8 Max (0902) · Alibaba Cost per task: $19.58 AA-Briefcase: 1,609.7Muse Spark 1.3 (max) · Meta Cost per task: $4.06 AA-Briefcase: 1,589.2Qwen3.8-Flash-Next · Alibaba Cost per task: $1.60 AA-Briefcase: 1,586.6Claude Fable 5.1 (high with fallback) · Anthropic Cost per task: $11.40 AA-Briefcase: 1,578.2GPT-6.1 Sol (max) · OpenAI Cost per task: $2.31 AA-Briefcase: 1,564.2GPT-6 Astra (max) · OpenAI Cost per task: $9.50 AA-Briefcase: 1,562Claude Opus 5 (high) · Anthropic Cost per task: $10.41 AA-Briefcase: 1,556.7Grok 4.6 (xhigh) · SpaceXAI Cost per task: $6.53 AA-Briefcase: 1,545.1Grok 4.6 (high) · SpaceXAI Cost per task: $5.01 AA-Briefcase: 1,534.1GPT-6 Astra (xhigh) · OpenAI Cost per task: $6.56 AA-Briefcase: 1,533.7Claude Fable 5.1 (medium with fallback) · Anthropic Cost per task: $8.58 AA-Briefcase: 1,531.2Claude Fable 5 (with fallback) · Anthropic Cost per task: $22.30 AA-Briefcase: 1,529.6Claude Opus 5.5 …
25 of 180 models with both measures

Results

190 models
NameLabScore$/Test$/TaskI/OTime
Claude Opus 5.5 (max with fallback)
Anthropic
1,821.85$21.046$5.98210.98B / 259.89M38.1m
Claude Sonnet 5.5 (max with fallback)
Anthropic
1,810.9$29.194$7.60318.54B / 410.58M45m
Claude Opus 5.5 (xhigh with fallback)
Anthropic
1,779.5$12.266$3.4595.96B / 99.67M25.3m
Claude Sonnet 5.5 (xhigh with fallback)
Anthropic
1,745.67$9.631$2.7435.95B / 104.14M23.5m
Claude Opus 5.5 (high with fallback)
Anthropic
1,704.5$6.271$1.8232.62B / 52.52M15.6m
Grok 4.7 (xhigh)
SpaceXAI
1,657.2$9.303$3.7384.19B / 240.41M37.2m
Claude Fable 5.1 (xhigh with fallback)
Anthropic
1,650.01$17.794$5.9784.19B / 120.52M28.2m
Claude Fable 5.1 (max with fallback)
Anthropic
1,646.09$22.713$7.635.63B / 188.47M29m
Claude Opus 5.5 (medium with fallback)
Anthropic
1,642.05$4.398$1.3361.8B / 38.16M11.7m
Grok 4.7 (high)
SpaceXAI
1,636.7$7.415$2.7263.17B / 197.67M30.7m
Claude Sonnet 5.5 (high with fallback)
Anthropic
1,633.97$3.955$1.081.96B / 49.51M13.7m
Claude Opus 5 (max)
Anthropic
1,633.44$17.793$5.8585.52B / 140.36M34.6m
Claude Opus 5 (xhigh)
Anthropic
1,624.56$14.261$4.8784.44B / 110.51M29.1m
Qwen3.8 Max (0902)
Alibaba
1,609.69$19.577$5.4099.9B / 191.96M119.3m
Muse Spark 1.3 (max)
Meta
1,589.18$4.059$1.6055.54B / 167.96M9.4m
Qwen3.8-Flash-Next
Alibaba
1,586.58$1.605$0.37212.85B / 244.95M67.3m
Claude Fable 5.1 (high with fallback)
Anthropic
1,578.19$11.399$3.9132.44B / 61.99M19.3m
GPT-6.1 Sol (max)
OpenAI
1,564.21$2.313$0.7241.38B / 67.2M28.6m
GPT-6 Astra (max)
OpenAI
1,562.01$9.502$3.2581.17B / 60.01M19.7m
Claude Opus 5 (high)
Anthropic
1,556.66$10.409$3.6133.14B / 80.53M22.4m
Grok 4.6 (xhigh)
SpaceXAI
1,545.11$6.531$2.3242.47B / 97.25M25.6m
Grok 4.6 (high)
SpaceXAI
1,534.13$5.009$1.8592.1B / 94.19M23.3m
GPT-6 Astra (xhigh)
OpenAI
1,533.73$6.564$2.309934.38M / 37.9M14.5m
Claude Fable 5.1 (medium with fallback)
Anthropic
1,531.2$8.58$2.9831.77B / 44.21M15.5m
Claude Fable 5 (with fallback)
Anthropic
1,529.62$22.303$8.7463.36B / 125.97M23.8m
MiMo-V2.6-Pro
Xiaomi
1,519.54$0.380$0.1334.43B / 143.69M65.3m
GPT-6.1 Sol (xhigh)
OpenAI
1,506.81$1.039$0.393934.47M / 36.01M11.2m
GLM-5.3 (max)
Z AI
1,504.38$5.649$2.0065.41B / 208.64M26m
MiMo-V2.6-Flash
Xiaomi
1,498.59$0.152$0.0625.49B / 244.21M46.1m
GPT-6 Astra (high)
OpenAI
1,493.87$4.764$1.721737.87M / 26.19M10.8m
1–30 of 190
1 / 7

Open a model to inspect its complete benchmark record and source fields.