primer/agent-eval

Agent eval navigation

Design System benchmark

Each metric is the Benchmark result across all capabilities, followed by the percent change from Control in parentheses. Models are ranked by test performance, followed by resource usage. Latest results: .

ModelEffortTestsOutput tokensPremium requestsSession timeAPI time
gemini-3.5-flashmedium30/39 (+400.0%)18,042 (-46.8%)70 (0%)11m 19.9s (-24.1%)8m 41.7s (-0.1%)
gpt-5.6-solmedium28/39 (+250.0%)36,073 (+121.6%)5 (0%)13m 44.7s (+102.0%)8m 45.8s (+154.4%)
claude-sonnet-5medium26/39 (+73.3%)25,039 (-3.9%)5 (0%)8m 39.7s (+6.3%)5m 31.4s (+6.6%)
claude-opus-5medium19/39 (+137.5%)46,867 (+71.7%)75 (0%)17m 24.9s (+85.8%)10m 42.3s (+77.7%)
gpt-5.6-terramedium14/39 (+133.3%)23,968 (+58.3%)5 (0%)9m 6.2s (+53.1%)5m 26.6s (+92.4%)

Strong lines show Benchmark results and muted lines show Control over time.

Tests passed

100%50%0%09-0409-07Run date

Output tokens

50,470.428,8507,229.609-0409-07Run date

Premium requests

8241009-0409-07Run date

Session time

1,516.5s866.2s215.9s09-0409-07Run date

API time

1,260.4s665.5s70.6s09-0409-07Run date

Change from Control

Benchmark results are shown first, followed by the percent change from Control in parentheses.

Model
claude-opus-5 (medium)20/39 (+185.7%)19/39 (+137.5%)
claude-sonnet-5 (medium)19/39 (+35.7%)26/39 (+73.3%)
gemini-3.5-flash (medium)15/39 (+25%)30/39 (+400%)
gpt-5.6-sol (medium)17/39 (+88.9%)28/39 (+250%)
gpt-5.6-terra (medium)8/39 (+33.3%)14/39 (+133.3%)
View raw trend data
DateModelTests passedOutput tokensPremium requestsSession timeAPI time
claude-opus-5 (medium)20/39 (+185.7%)39,786 (+43%)75 (0%)14m 27.2s (+45.6%)9m 14.8s (+53.6%)
claude-sonnet-5 (medium)19/39 (+35.7%)26,191 (-0.3%)5 (0%)8m 46.3s (-1.8%)5m 9.2s (+0.6%)
gemini-3.5-flash (medium)15/39 (+25%)30,623 (+53.2%)70 (0%)23m 28.1s (+14.1%)19m 21.3s (+89%)
gpt-5.6-sol (medium)17/39 (+88.9%)22,244 (+10.3%)5 (0%)9m 59.9s (+19%)6m 33.7s (+54.3%)
gpt-5.6-terra (medium)8/39 (+33.3%)23,699 (+118.8%)5 (0%)9m 2.9s (+67.4%)5m 32.3s (+93.9%)
claude-opus-5 (medium)19/39 (+137.5%)46,867 (+71.7%)75 (0%)17m 24.9s (+85.8%)10m 42.3s (+77.7%)
claude-sonnet-5 (medium)26/39 (+73.3%)25,039 (-3.9%)5 (0%)8m 39.7s (+6.3%)5m 31.4s (+6.6%)
gemini-3.5-flash (medium)30/39 (+400%)18,042 (-46.8%)70 (0%)11m 19.9s (-24.1%)8m 41.7s (-0.1%)
gpt-5.6-sol (medium)28/39 (+250%)36,073 (+121.6%)5 (0%)13m 44.7s (+102%)8m 45.8s (+154.4%)
gpt-5.6-terra (medium)14/39 (+133.3%)23,968 (+58.3%)5 (0%)9m 6.2s (+53.1%)5m 26.6s (+92.4%)