GodelNumbering1h agoHN ↗A friend created this eval. Currently it is the most unsaturated evals I've seen with gpt-6 Astra leading massively. Results:GPT-6 Astra · Max 2,568 ± 140 $0.15 66sGPT-6 Astra · High 2,227 ± 138 $0.033 10sClaude Opus 5 · High 2,076 ± 139 $0.09 26sGPT-5.6 Sol · Max 1,929 ± 207 $0.081 79sGPT-5.6 Sol · High 1,846 ± 207 $0.034 27sGemini 3.1 Pro · High 1,797 ± 178 $0.063 41sDeepSeek V4.1 Flash · Max 1,707 ± 206 $0.022 140sGemini 3.8 Flash · High 1,616 ± 206 $0.025 13sDeepSeek V4 Flash 0731 · Max 1,449 ± 227 $0.016 160sMuse Spark 1.3 Contributor · High 1,449 ± 227 $0.002 46s
A friend created this eval. Currently it is the most unsaturated evals I've seen with gpt-6 Astra leading massively. Results:
GPT-6 Astra · Max 2,568 ± 140 $0.15 66s
GPT-6 Astra · High 2,227 ± 138 $0.033 10s
Claude Opus 5 · High 2,076 ± 139 $0.09 26s
GPT-5.6 Sol · Max 1,929 ± 207 $0.081 79s
GPT-5.6 Sol · High 1,846 ± 207 $0.034 27s
Gemini 3.1 Pro · High 1,797 ± 178 $0.063 41s
DeepSeek V4.1 Flash · Max 1,707 ± 206 $0.022 140s
Gemini 3.8 Flash · High 1,616 ± 206 $0.025 13s
DeepSeek V4 Flash 0731 · Max 1,449 ± 227 $0.016 160s
Muse Spark 1.3 Contributor · High 1,449 ± 227 $0.002 46s