How good are frontier models at physics?

Automated excerpt

For each subfield of physics, faculty and graduate researchers with relevant expertise carefully review problem statements, reference solutions, and model responses to distinguish genuine model errors from grader errors, incorrect reference solutions, and ambiguous or underspecified questions. Most audited cases initially evaluated as incorrect reflect these benchmarking issues rather than errors in the models' physics reasoning. These findings suggest that current benchmarks substantially understate frontier models' ability to solve well-posed physics problems.

Selected automatically from source text; not independently written or fact-checked. Read the original for full context.