AI article

It knows you changed jobs. It still writes to your old manager.

Community description: This is a submission for the Kaggle Benchmarking Challenge What I Benchmarked Assistants...

Dev.to | Sep 28, 2026 | Harsh Singh

Automated excerpt

Claude Opus 5, Claude Sonnet 5, Claude Haiku 4. 5 Gemini 3. 8 Flash, Gemma 4 31B Gemini 3. 7 Flash also shows up in the results as a bonus: Kaggle runs its default model every time a task is pushed. Judges: Gemini 2. 5 Pro, GPT-5. 4 and Claude Opus 4. 5. Within each lab the bigger model caught more stale premises: Claude Opus 5 got 20 of 20 against Haiku 4. 5's 11, GPT-6 Astra 18 against GPT-5. 4 mini's 0, Gemini 3. 8 Flash 20 against Gemma 4's 17.

Selected automatically from source text; not independently written or fact-checked. Read the original for full context.

Read the original article

More AI news