Android Bench 2.0 focuses on long-horizon tasks, agent evaluations - 9to5Google

Automated excerpt

Google’s development of Android Bench continues today with a version 2. 0 that reflects how AI can handle more complex development tasks. Android Bench 2. 0 targets “tasks of great complexity that take an engineer multiple days or even a week to complete,” such as adding new features, building apps from scratch, and converting cross-platform apps to Android. Google shared insights like how “porting cross-platform apps to Android remains an open challenge—no model hits a 100% pass rate, and frontier models reach at most a 80% completion rate.

Selected automatically from source text; not independently written or fact-checked. Read the original for full context.