Posted inAI News
Qwen 3.8 Max Catches Claude Opus but Hallucinates More
Qwen 3.8 Max ties Claude Opus 4.8 at 56 points, yet a task costs $1.14 against $0.86 on Kimi K3 and its hallucination rate climbs to 40%.
Articles tagged AI benchmark — Page 2
Coding Agents: The Fastest One Also Costs the Most
Coding agents compared across 30 real tasks: Claude Code finishes in 122 seconds but bills $0.195 per task, against $0.073 on OpenCode.
Posted inAI News
Sakana Fugu Tops Benchmarks but Runs Slow
Sakana Fugu orchestrates several models and matches Fable 5 on benchmarks, but Ethan Mollick calls it very slow, around thirty minutes per coding test.
Posted inAI News
Tencent Study: AI Agents Finish 14% of Real Tasks
The Tencent Study from Youtu Lab shows GPT-4 only completes 14 percent of WebArena tasks, and agents miss more than half of their own skills.