A The ARC Atlas

Part Ⅲ · The ideas underneath

What does ARC mean by intelligence?

ARC-AGI is both a benchmark and an argument: skill is not intelligence. This chapter examines that claim, the priors ARC permits, 6 frameworks for machine generalization, the o3 debate, and the questions the theory still cannot answer.

1
Definition: efficiency
4
Core Knowledge priors
6
Rival frameworks
5
Deep open questions

The founding thesis

Skill is not intelligence.

Most AI benchmarks reward skill at a particular task. But skill reflects both learning ability and what a system already knows or has experienced, so enough data, compute, or hand-coded priors can produce superhuman performance without general learning ability.

Chollet's 2019 move was to define the thing worth measuring instead: intelligence is skill-acquisition efficiency — how efficiently a system converts fixed priors and a little experience into skill on tasks it has never seen. A system that needs three examples is more intelligent than one that needs a million, even if both end up equally skilled.

That reframes AGI from a vague aspiration into a measurable gap between human and machine generalization. Everything downstream — ARC-AGI-1, -2, -3, and every method in this Atlas — is an attempt to close it, or to redraw it when the machines catch up.

Intelligence skill acquired on novel tasks priors + experience + generalization difficulty

Intelligence is skill-acquisition efficiency: how efficiently a system turns fixed priors plus a little experience into skill on tasks it has never seen. Measuring a benchmark score alone confuses the map for the territory.

PriorsWhat the system starts knowing. Hand-code enough of them and you can "buy" skill without any general ability to learn.
ExperienceHow much data or interaction it's given. A system needing a million examples is less intelligent than one needing three.
Generalization difficultyThe algorithmic distance from what it already knows to the new task. ARC keeps this high by making every task novel.

The fair starting set

Core Knowledge — the proposed starting priors.

ARC excludes language and trivia, but assumes four systems that developmental psychologyThe four priors draw on the Core Knowledge literature (Spelke & Kinzler): systems observed in infants before language. Chollet's proposal is that limiting ARC to these priors emphasizes fluid reasoning over accumulated knowledge. describes as early-emerging. The boundary remains debatableEven ARC's discrete grid, fixed colour palette, and reading conventions may introduce cultural priors that a truly prior-free test would not grant..

Objectness & physics

Things are cohesive, persist, move on continuous paths, and don't pass through each other. The world is made of objects.

Agentness & goals

Some things act toward goals. You can attribute intent, and predict behaviour from it.

Number & counting

Small quantities, one-to-one correspondence, more/less, and elementary arithmetic — without being taught.

Geometry & topology

Distance, orientation, symmetry, connectivity, containment, and inside/outside — the shape of space.

What other people think

How do you get generalization?

ARC demands fluid generalization, but the field disagrees on how to produce it. These 6 frameworks span a spectrum from "scale and memorize" to "reason and synthesize."The spectrum is a teaching device, not a census of tribes. The strongest systems blend camps: o3 pairs enormous pretraining (scaling) with heavy test-time search (program synthesis), and test-time training grafts on-the-fly adaptation onto a frozen network. Each proposes a different mechanism and a different account of the others’ limits.

← Scale & memorize Reason & synthesize →
1

Scaling / the Bitter Lesson

The foil

Richard Sutton's "bitter lesson"; the 2019–2024 pretraining mainstream

General methods that scale with compute and data eventually beat hand-crafted knowledge. Enough scale, and the abstractions emerge on their own.

On ARCARC was designed to resist exactly this — no memorized web data helps — and its five-year durability through the scaling era is the theory's strongest evidence that bought skill is not general intelligence.

Argues againstSkill-acquisition efficiency. Scale buys skill on a task without showing any ability to learn a new one.

№01 In the Atlas
2

Connectionism / deep learning

Transduction

Jack Cole & Mohamed Osman (MindsAI); the deep-learning-for-ARC camp

ARC is substantially perceptual, not only symbolic. Keep the optimizer active at inference through test-time fine-tuning rather than relying on a frozen model.

On ARCThis lineage reached 58% and won the 2023 ARCathon by treating both the network and the optimizer as part of inference — learned, on-the-fly abstraction, not symbolic search.

Argues against"Program synthesis is the only viable path." A voted neural answer, though, has no explanation or correctness guarantee.

№24 In the Atlas
3

Test-time adaptation

The empirical winner

Akyürek et al. (MIT); the ARChitects; the MindsAI lineage

Don't ship a frozen model. Adapt to the task in front of you at inference — rewrite the weights, or search a latent — then throw the update away. Adaptation is a distinct axis of test-time compute.

On ARCIt was the story of 2024: no frozen, no-adaptation method cleared ~11% on ARC-AGI-1, while per-task fine-tuning reached the mid-50s. Yet there is still no satisfying theory of why it beats in-context learning.

Argues againstThe frozen-weights orthodoxy — but its ARC-AGI-1 gains collapse to single digits on ARC-AGI-2, and per-task cost may not survive an agent loop.

№08 In the Atlas
4

Compression = intelligence

MDL / Solomonoff

Marcus Hutter & Shane Legg (AIXI); demonstrated on ARC by CompressARC

Intelligence is compression. Prefer the shortest description that regenerates the data: by Occam's razor, simpler explanations are more likely to generalize.

On ARCCompressARC solves ~20% of ARC-AGI-1 with a 76K-param network, no pretraining, and no search — purely by compressing the single puzzle. Lower-bit solutions empirically correlate with correct ones.

Argues againstInduction and transduction may both be crude approximations of this one objective — but it caps at ~20–34%, so is it capacity, optimization, or prior mismatch?

№16 In the Atlas
5

Program synthesis / neuro-symbolic

Induction

Kevin Ellis & Josh Tenenbaum (DreamCoder); Chollet's endorsed direction

Solve a task by synthesizing an explicit, inspectable program over Core-Knowledge primitives — a rule you can read and verify — rather than fitting an opaque function. Learn the library of primitives itself, as DreamCoder does.

On ARCInfer a compact, verifiable transformation rule from ~3–5 demonstrations and compose it from reusable abstractions.

Argues againstFitted-function statistics — but every hand-built DSL supplies substantial prior knowledge, so the library should be discovered rather than fixed by hand.

№18 In the Atlas
6

World-model induction, verified by replay

The agentic bet

The interactive-agent direction; this Atlas's companion project

A world model should be an induced program accepted only when it exactly replays every observed transition — discovering both the rules and the goal from interaction, and verifying against reality rather than picking from a library that already encodes the answer.

On ARCThe operational meaning of efficient generalization: induce a compact, correct model of a task's dynamics from few observations. ARC-AGI-3's determinism makes such exact, verifiable models tractable.

Argues againstSearch-heavy recombination and opaque neural world models — a program that replays the past may still be wrong on unseen states.

№03 In the Atlas

The 2024 flashpoint

Is o3 AGI?

In December 2024, o3 scored 87.5% on ARC-AGI-1 — the benchmark built to be unbeatable. Is that AGI? The field's answer, including the ARC Prize's own, is no. Here is the ledger.

The case for "a step toward AGI"The counter

o3 near-solved the benchmark built to resist machines — a genuine step-function jump in novel-task adaptation.

Skill is not intelligence. Mastery of one bounded problem class is not the capacity to acquire competence in unfamiliar ones.

It adapts to each task with guided search over chains-of-thought, not a single memorized answer.

"Massive trialling of combinations of predefined operations" can look like intelligence without being it — and it needs a pre-enumerable operation set and cheap pre-testing that open worlds don't provide.

ARC-AGI-1 is Chollet's own yardstick, and o3 cleared it.

ARC-AGI-1 is one narrow slice: a single grid representation, solvable by recombination. The diversity-of-worlds axis is left almost entirely untested.

The score is real and reproducible on a held-out private set.

Knowledge-dependent overfitting: ARC's own conventions may now be latent in base models, inflating scores without demonstrating novel-task generalization.

Cost is an engineering detail that will fall with time.

It ran from ~$20 to thousands of dollars per task versus ~$5 for a human. Under the efficiency definition, brute-forcing with unlimited compute no longer looks like intelligence.

The positive proposal that survives the ledger: intelligence is the capacity to achieve diverse goals in diverse worlds with minimal prior knowledge. ARC-AGI-2 makes efficiency a first-class axis; ARC-AGI-3 makes the agent infer both the rules and the goal. Both push the definition past a single high score. By July 2026, newer frontier models had surpassed o3 on ARC-AGI-1 and also scored strongly on ARC-AGI-2, while ARC-AGI-3 remained much farther from its human baseline. The live question is whether those gains are efficient, transferable, and robust across benchmark changes.

Why efficiency is part of the definition

ARC-AGI-2's most consequential idea is not a harder puzzle — it's putting cost on the leaderboard. If a system reaches a given accuracy for a fraction of the compute, it is credited as more intelligent. Dollar-per-task becomes a proxy for the efficiency term in the definition itself.

This reframes what counts as a correct answer. A program that solves the task but took a million samples and thousands of dollars is not a satisfying solution — efficiency is part of correctness, not an afterthought. It is the same principle ARC-AGI-3 carries to its extreme, scoring an agent on how few actions it needs relative to a human on first contact.

The deepest questions

What we still can't answer.

Underneath all the engineering sits an unanswered scientific question, and a handful of others whose answers would move the field most.The deepest one is baked into the measure itself: generalization difficulty is an algorithmic-complexity term, and algorithmic complexity is uncomputable. Every real ARC score is a coarse, practical stand-in for a quantity nobody can calculate exactly. The marks the ones that turn on the nature of generalization itself.

  1. 1

    What is the minimal ingredient for human-like, sample-efficient, out-of-distribution generalization?

    Humans solve ARC tasks for pennies and a handful of examples; the best machines spend dollars and thousands of samples. The gap is efficiency, not just accuracy — and there is no formal account of what produces it.

  2. 2

    Is compression / MDL the correct objective that induction and transduction both approximate?

    If lower-bit solutions really are more correct, MDL would unify the three solution families and give the field a principled target — but CompressARC caps near 20–34%. Is that a capacity limit, an optimization limit, or a prior mismatch?

  3. 3

    Why is test-time adaptation so much stronger than in-context learning?

    TTT was the dominant lever of 2024, yet there is no satisfying theory of the mechanism — better weight-space priors, escaping attention bottlenecks, or implicit search? And can it be made cheap enough for an interactive agent loop?

  4. 4

    How much innate prior is necessary — and how much is too much?

    Every hand-built DSL supplies prior knowledge. Can Core Knowledge be learned rather than hard-coded, and would that change what ARC measures?

  5. 5

    Do reasoning models acquire generalization, or expensively simulate it?

    Does o3 succeed by acquiring the ability ARC demands, or by a search that mimics it? Telling the difference is the whole "is this intelligence?" question — and it turns on economy of priors and breadth of transfer, not peak score.

See how current methods approach these questions, and how far each has gone, in Part Ⅹ · Methods & Techniques.

↩ Back to Part Ⅱ · The Atlas

YouTube first · local synths follow

ARC Radio

01 / 12 🦉 8-Bit Chiptune Playlist 🦉 Retro Video Game Music for Nostalgic Vibes YouTube · external stream

The 4 requested YouTube selections play first and require a network connection; their titles refresh from YouTube when they load. 8 original AI-composed retro-game loops follow and are generated live in your browser. Audio keeps playing when you close this panel and stops only when you press Pause.

Field notes · reader review

Help improve this guide

Found a wrong score, broken link, missing paper, or unclear passage? Tell us what you noticed.

How useful is it? optional
- / 5
What kind of note? optional

No account, no tracking. Sent straight to the maintainer.