Commit 2037ebb0ba325ddd9d68a000d7485f1375d857a8 · Python 3.9.6 Tasks 60 · Maximum 1200 · SHA-256 7f98fe629f881598c3e4cf501ecf2374419b61b2325878caf3d83823fac25a94 Model | Scored rows | API errors | Saved raw | Replayed raw | Different rows deepseek/deepseek-v3.2 | 60 | 0 | 740 | 740 | 0 glm-4-plus | 60 | 0 | 680 | 680 | 0 glm-5 | 60 | 0 | 733 | 733 | 0 glm-z1-airx | 60 | 0 | 709 | 709 | 0 glm-z1-flash | 60 | 0 | 624 | 624 | 0 minimax/minimax-m2.7 | 60 | 0 | 700 | 700 | 0 qwen/qwen3-max-thinking | 60 | 0 | 696 | 696 | 0 x-ai/grok-4.20 | 60 | 0 | 554 | 554 | 0 xiaomi/mimo-v2-pro | 60 | 0 | 721 | 721 | 0 540 saved task scores replayed; 0 differences. Differences between archived task rows and the file's summary fields: glm-5 Defect Discovery: rows 65, summary 59 glm-5 tokens: rows 290,408, summary 283,552 glm-5 summed request latency (s): rows 8,670.52, summary 8,223.17