Skip to content
SearchFR · Français
Get started
Registry

Not evaluated

OEIS Open: general LLMs solve 147 of 492 formalised OEIS conjectures

OEIS Open: general LLMs solve 147 of 492 Lean-formalised OEIS conjectures

The gist

Adamczewski and co-authors (arXiv 2608.11941, 2026-08) report that general language models solve 147 of 492 OEIS conjectures formalised in Lean, about 30%. Status: not yet evaluated.

DiscoverIA status on October 11, 2026: not evaluated, meaning no third-party evaluation found.

Status detailsDetails

AI draft, not reviewedWhat has not been reviewed?

Text written by an AI (DiscoverIA pipeline), on . The status and its sources come from the registry; only the explanatory text has not been reviewed. A reported error is corrected, then the text is reviewed.

FollowReport

Cite this entry

A single status snapshot since Oct 11, 2026: a citation always points to a dated snapshot.

Cite snapshot 1, Oct 11, 2026

APA citation with the dated link

DiscoverIA. (2026, October 11). OEIS Open: general LLMs solve 147 of 492 Lean-formalised OEIS conjectures [Status: Not evaluated, snapshot 1]. DiscoverIA registry. https://discoveria.ai/entry/oeis-open-benchmark#releve-1

BibTeX @misc, key discoveria-oeis-open-benchmark-r1

@misc{discoveria-oeis-open-benchmark-r1,
  author       = {{DiscoverIA}},
  title        = {OEIS Open: general LLMs solve 147 of 492 Lean-formalised OEIS conjectures},
  howpublished = {DiscoverIA registry, entry oeis-open-benchmark},
  note         = {Status “Not evaluated”, snapshot 1, recorded on October 11, 2026. Benchmark},
  year         = {2026},
  url          = {https://discoveria.ai/entry/oeis-open-benchmark#releve-1},
  urldate      = {2026-10-11}
}

Dated link opens this snapshot in the history

https://discoveria.ai/entry/oeis-open-benchmark#releve-1

To understand ≈ 20 s reading time, estimated

What it changes

An open benchmark provides a shared measure for comparing models on conjectures about number sequences, checked by Lean. If the figures held, about 30% of these conjectures would already be within reach of general-purpose models.

What remains unclear

The results are checked by the authors themselves, with no named third party. They depend on a per-attempt compute budget that this entry does not detail. The date is known only to the month.

In the glossary : Benchmark

Read the paper

OEIS Open: How many conjectures can language models turn into theorems?

What it establishes : Adamczewski measures the share of Lean-formalised OEIS conjectures that general-purpose language models can prove with minimal tools: Claude Opus 4.8 solves 30%, GPT-5.5 26% and Gemini 3.5 Flash 22%.

Where to start : The abstract, then Figure 1 (Section 3.1), which compares the models with AlphaProof Nexus. Section 2.3 gives the score recomputed with the Comparator checker (144 out of 492), Section 4.1 the risk of misformalisation.

Written by an AI · reviewed by a human

Version read: v2 of Aug 13, 2026.Open access, according to OpenAlex, checked on Oct 23, 2026.

For experts

Sources, method, key facts, status history, report an error

Status

Not evaluated

Recorded on · arxiv.org

Step 1 of 4 on the scale: not evaluated. Next step: under review.

  1. Announced
  2. Recordednot evaluated
  3. nextTo follow
What this status means

Source reading : Source read word for word (level 3 of 3)

The result is declared neither right nor wrong.

To move to “Under review”: a public review under way. To “Peer reviewed”: a journal publication or a review by named experts.

Full history

Proofs
code d'évaluation open source, Lean

Sources

Method

DiscoverIA status: not evaluated, meaning that no third-party evaluation has been found in the sources read. Set on October 11, 2026 from arxiv.org (page read, quotation checked word for word: “resolve 147 of these conjectures with a budget of”).

Limits

The claimant supplies a Lean proof; as of this date, DiscoverIA has found no independent verification of this proof or of the result.

Key facts

Claimed by
Adamczewski et al. (arXiv 2608.11941)
announced on Aug 2026
Nature
benchmark
Field
Mathematics (mathematics / benchmark)
Checked by
authors
Sources
1 : 1 read word for word
This entry
AI draft, not reviewed

Status history

Only one observation so far.

  1. 01

    First observation:Not evaluatedCurrent status

    Source: arxiv.orgread word for word

An observation is added; none is ever erased.

Report an error or suggest a source

How DiscoverIA uses your address and how to exercise your rights: privacy policy.

Is your result listed?What each status requires, correcting this entry, replying to it.