Blog

15 March 2024

A collection of resources for evaluating potentially dangerous autonomous capabilities of frontier models.

29 February 2024

METR has published a standard way to define tasks for evaluating the capabilities of AI agents.

07 February 2024

A summary of what METR accomplished in 2023 – our first full year of operation.

16 December 2023

METR (formerly ARC Evals) is looking for (1) ideas, (2) detailed specifications, and (3) well-tested implementations for tasks to measure performance of autonomous LLM agents.

04 December 2023

ARC Evals is wrapping up our incubation period at ARC, and spinning off into our own standalone nonprofit.

26 September 2023

We describe the basic components of Responsible Scaling Policies (RSPs) as well as why we find them promising for reducing catastrophic risks from AI.