Models improve rapidly where verification is automated, and slowly where verification requires expensive human judgment. The towers on the jagged frontier are domains with cheap verification. The recesses are domains where each evaluation costs minutes of expert attention rather than microseconds of compute. This explains why the frontier stays jagged over time: the domains with automated verification pull ahead faster, while the domains that depend on human feedback improve at human speed.
Vidare till källan: langkilde.se