Open Weight Thoughts
All articles

· 7 min read

Mathematicians Will Become Directors of Proof Search, Not Just Writers of Proofs

By D. Shevchenko

  • opinion
  • guides

I think AI will change how mathematics is actually done, not merely make mathematicians faster at typesetting proofs. The central shift will be that strong mathematicians spend less of their time manually carrying a promising argument through its individual steps and more of it directing machines toward the right conjectures, representations, lemmas, and verification environments.

That claim will irritate people who hear in it the familiar, lazy prediction that AI replaces expertise. It does not. Mathematics is not a factory line in which the proof is the only output and every intermediate step is interchangeable labor. But proof construction has always contained a large operational component: expanding definitions, finding the right library result, testing cases, selecting an induction hypothesis, checking that a construction satisfies annoying side conditions, and repairing arguments that are correct in spirit but incomplete in detail. These are precisely the parts that become tractable when language models are coupled to search, code execution, and formal proof checkers.

The important evidence is not fluent chatbots

We should not infer a revolution in mathematics from a model producing a persuasive-looking solution in natural language. That is a parlor trick until there is a verifier. The consequential work is happening where generation is attached to an objective check: a proof assistant accepts the proof term, a program evaluator scores a candidate construction, or a symbolic system confirms an invariant. Lean illustrates why this matters. Its small kernel checks proof terms, while its tactic system can be aggressively automated; a buggy tactic can fail, but it does not get to redefine truth. Mathlib has already demonstrated that a large shared library of mechanically checked mathematics is a practical engineering substrate rather than a philosophical thought experiment.

Once you have that substrate, the workflow starts to resemble software development more than the romantic image of a lone mathematician filling a notebook. A human states an objective in a formal language, exposes the relevant abstractions, provides useful intermediate interfaces, and asks automation to explore. The machine returns failed branches, counterexamples, candidate lemmas, and sometimes a finished certificate. The human then changes the decomposition. This is not “ask an LLM to prove Fermat’s Last Theorem.” It is an iterative loop in which the person owns the problem formulation and the system cheaply explores the consequences.

The recent results worth taking seriously fit this pattern. AlphaProof and AlphaGeometry reached silver-medal-level performance on the 2024 International Mathematical Olympiad problems, but AlphaProof worked in a formal setting and AlphaGeometry used a specialized symbolic deduction engine alongside a language model. That is a lesson, not an implementation detail: reliable mathematical performance comes from putting generative models inside systems with structure and checks. Likewise, FunSearch produced improved constructions for variants of the cap set problem by evolving executable functions evaluated by a scoring program. The contribution was not an omniscient model that understood all of combinatorics. It was a search process where candidate ideas could be tested relentlessly.

Directing the search is a real intellectual job

For software engineers, the closest analogy is not code completion. It is designing a compiler pipeline, a property-based test harness, and a search space for synthesis. If you specify the wrong property, the system can optimize itself into nonsense with remarkable efficiency. If you choose an impoverished representation, it will never find the elegant route that was available in a different basis. If your theorem statement omits a condition, a formalizer may correctly prove something useless. The hard work moves upward: selecting what should be formalized, deciding which definitions expose the structure, and building a verifier whose rewards correspond to mathematical value.

That upward move favors mathematicians who can alternate between intuition and rigor. An AI can enumerate a thousand candidate inequalities. A researcher must notice that all the good candidates are shadows of a more general invariant. An AI can close dozens of Lean goals after it has been given the right local lemmas. A researcher must decide which lemma turns a fragile proof into a reusable theory. In other words, the future mathematician is not a passive manager assigning tickets to agents. They are a language designer for ideas: defining the objects, constraints, analogies, and feedback loops through which discovery becomes possible.

This is also why the first major beneficiaries may be fields with unusually crisp feedback. Combinatorics, finite algebra, geometry, formal verification, and parts of number theory offer many opportunities to test constructions or mechanically check derivations. Areas driven by vague analogies, new definitions, and difficult choices about what is worth studying will change more slowly. But “more slowly” is not “not at all.” As formal libraries grow, the frontier between informal exploration and machine-checkable consequence will keep moving.

The strongest objection: proof is not clerical work

The best counterargument is stronger than “LLMs hallucinate.” It says that mathematical proofs are not tedious transcripts of reasoning; the act of working through details is often how mathematicians discover the key concept. Hand proofs build taste. They reveal which hypotheses matter, which notation is misleading, and where an argument breaks. If researchers outsource the steps too early, they may produce formally valid but conceptually empty work, become dependent on opaque systems, and train a generation that can direct search without understanding mathematics.

I accept the diagnosis and reject the conclusion. We should absolutely resist a workflow where people paste natural-language claims into a proprietary black box and mistake a confident answer for insight. But that is an argument for better tools and better training, not for preserving manual proof labor as a virtue in itself. We did not stop using compilers because assembly teaches useful lessons. We teach lower-level concepts, retain debuggability, and use abstraction to attempt larger systems. Mathematics should do the same: teach proof deeply, require people to inspect and explain machine-generated arguments, and then let verification and search remove work that is repetitive once the important insight has arrived.

The open-weight and open-source communities have a particular responsibility here. Mathematical AI should not become a service where the only visible artifact is a chatbot answer and the only judge is a vendor benchmark. We need reproducible search pipelines, open formal corpora, inspectable proof traces, local models that can work against public theorem libraries, and benchmarks that reward verified novelty rather than polished solutions to contaminated contest sets. The valuable unit of progress should be a reusable formal artifact: a theorem, a construction, a counterexample, or a proof strategy that another researcher can run, inspect, and extend.

Universities and research groups should start treating proof assistants, program search, and model-guided formalization as standard mathematical infrastructure. Train students to prove by hand and to formalize; fund shared libraries as seriously as shared instruments; publish machine-checkable companions to papers; and make AI systems earn trust by emitting certificates instead of prose. That is how mathematics gets more ambitious without becoming less human: not by asking models to think for us, but by building systems that let human judgment spend its time where judgment is irreplaceable.

Sources & citations

  1. [1]Lean Language Reference: trusted kernel and tactics
  2. [2]Lean documentation: Mathlib and mechanically checked mathematics
  3. [3]Google DeepMind: AlphaProof and AlphaGeometry at IMO 2024
  4. [4]Google Research: Olympiad-Level Formal Mathematical Reasoning with Reinforcement Learning
  5. [5]Nature: Mathematical discoveries from program search with large language models
Mathematicians Will Become Directors of Proof Search, Not Just Writers of Proofs | Open Weight Thoughts