SCOPE

SCOPE: Scientific Contribution, Originality, Provenance, and Evidence. What Counts as Discovery in the Age of AI?

Mariya I. Vasileva, Jeremy Avigad, Alex Meiburg, Claudio Mayrink Verdun,
Anja Šurina, Siqiao Mu, Leo Shaposhnik

About the workshop

When an AI system produces a new mathematical proof, proposes an experimentally validated hypothesis, or carries out a computational research project, what should count as its contribution to science?

The answer affects more than authorship. It shapes what researchers investigate, what reviewers accept as evidence, how institutions allocate credit, and whether scientific communities can understand and build on the resulting work. As AI takes on a larger role in research, these questions require discussion among the people developing the systems and the communities whose practices they may change.

SCOPE will bring together researchers developing AI systems, scientists using and evaluating their outputs, and scholars who study how science is done. Together, we will examine what AI contributes to research, what evidence supports its results, what humans need to understand, how credit should be allocated, and how findings should be published. We will begin with mathematics and draw on empirical science and machine learning to explore which principles can be shared across disciplines and where differences in research practices call for different standards.

Why this discussion now?

Recent developments in mathematics make this discussion immediate. On October 6, 2026, OpenAI released a collection of mathematics manuscripts generated by an internal model, along with details of the research process and formalizations of selected proofs (OpenAI, 2026). The release exposed disagreement over what constitutes mathematical progress. In a statement republished on Terence Tao's blog, the Association for Human Mathematics rejected the claim that this publication model advances mathematics, describing the mass release as a “demonstration of power” and calling for science that “centers human understanding” (Association for Human Mathematics Communications Working Group, 2026). The independent Advisory Group on Mathematics and Artificial Intelligence likewise distinguishes the release of mathematical results from the work needed to understand and integrate them into established knowledge, while continuing to engage with AI labs (Advisory Group on Mathematics and Artificial Intelligence, 2026b).

At the heart of this disagreement is the question: how should scientific communities assess a result's validity, its contribution to understanding, and the conditions under which it was produced and released?

The same questions extend to empirical science and machine learning. AI research systems now carry out idea generation, computational experimentation, and manuscript preparation (Lu et al., 2026), while AI co-scientist systems have been developed to propose biomedical hypotheses for experimental investigation (Gottweis et al., 2025). These efforts pursue a longstanding ambition to develop AI capable of scientific discovery (Kitano, 2021). They also make it essential to distinguish evidence for a scientific finding from evidence for the capabilities of the system involved. A useful discovery may depend on substantial human judgment, and a technically impressive system may produce results of limited scientific significance.

Researchers differ in how they envision this transition. Tao (2026) examines mathematical values and practices in the age of AI, while Szegedy (2026) anticipates changes in the kinds of mathematical work that receive recognition. Jimenez et al. (2026) argue for developing AI scientists alongside institutional reforms that support verification and accountability. Messeri & Crockett (2024) warn that greater productivity can coexist with illusions of understanding and a narrowing of scientific inquiry.

The debate concerns both what counts as scientific progress and how researchers participate in it: whether valid new results are sufficient, what role human understanding should play, and whether scientific communities can collaborate with frontier AI labs while retaining their independence. SCOPE will examine these questions without assuming that more automation is necessarily desirable, or that current research practices should remain unchanged.

Invited speakers and panelists

The participants below connect the workshop's questions to mathematical practice, empirical science, AI evaluation, and the development of autonomous research systems.

Discussion questions

The workshop will address six questions, drawing on different perspectives across research communities.

What makes an AI-produced result a scientific contribution?

Are correctness and novelty sufficient for scientific progress, or must a contribution also deepen understanding, explain a phenomenon, or enable further inquiry? Can a problem be considered solved before researchers understand the ideas underlying its solution? How should we distinguish producing a valid result from making that result usable as shared scientific knowledge? Should the process by which a result is produced affect its scientific value, the credit it warrants, or both?

What evidence should support a claim of discovery?

What independent checks are needed before an AI-produced result is accepted as an advance? What should be disclosed about prior work, human intervention, unsuccessful attempts, and computational resources? Research on leakage in machine-learning-based science shows how apparently strong results can rest on flawed evaluation (Kapoor & Narayanan, 2023). How should standards of evidence differ for a scientific claim and a claim about the AI system that produced it? Meiburg (2026a) reports that some Comparator challenge specifications allow changes to definitions that should be fixed. How can evaluators establish both that a proof is valid and that it proves the intended statement under the intended assumptions?

What must humans understand and take responsibility for?

When is verification sufficient, and when is an explanation essential? Must an author understand every step, the main ideas, or the grounds for trusting contributions supplied by others? The mathematics release recommendations emphasize the distinction between verified output and human understanding (Advisory Group on Mathematics and Artificial Intelligence, 2026a). Who should answer questions, investigate errors, and provide corrections when understanding is distributed across people and systems?

How should authorship and credit be allocated?

Should AI systems appear as authors, be cited as tools, or be identified through contribution statements? How should records distinguish problem selection, generation, validation, formalization, interpretation, and exposition? What credit is due to prior research and data, or to people who check and explain a result after its release? How should attribution relate to accountability?

How should AI-generated work enter the scientific record?

Should existing venues revise their disclosure and review practices, or should dedicated repositories or publication tracks serve particular kinds of work? What should distinguish a deposited result, a verified claim, and a contribution that a community can understand and build upon? When AI systems produce results faster than experts can assess them, who should undertake, fund, and receive credit for verification, explanation, and correction (Advisory Group on Mathematics and Artificial Intelligence, 2026a)? Building on Leonelli (2023), how should publication practices preserve provenance and make the resulting knowledge usable? What responsibilities should accompany a large-scale release?

What should research evaluation reward?

If AI makes some outputs easier to produce, how should publication, hiring, funding, and model evaluation respond? How can they recognize problem formulation, careful validation, explanation, and work that enables subsequent discoveries? When measures such as theorem counts become optimization targets, how can evaluation still capture growth in understanding, the discovery of new questions, and the development of researchers' expertise (Meiburg, 2026b)? Ecology highlights the importance of field observation, domain expertise, and participation in AI-enabled research (Beery, 2026). Who should determine research priorities when frontier capabilities and computational resources are concentrated in a small number of laboratories? How can researchers retain the freedom to formulate their own questions, rather than primarily validating or explaining results selected by AI developers (Advisory Group on Mathematics and Artificial Intelligence, 2026b)? What would equitable participation require for early-career researchers and communities with limited access to data, compute, and AI tools?

Tentative one-day program

The program comprises two keynotes, one in the morning and one in the afternoon, four invited talks, four contributed talks, a dedicated 90-minute poster session, and a one-hour panel.

TimeSessionProposed focus / format
09:00–09:15Welcome and introductionWorkshop questions and agenda
09:15–09:55Keynote: François CharlesWhen does a mathematical result become mathematical knowledge?
09:55–10:20Invited talk: Tengyu MaHow can we measure novelty and creativity in AI-generated research ideas?
10:20–10:35Coffee break☕ Informal conversation
11:00–11:30Contributed talks ITwo papers: 10-minute talk + 5-minute Q&A each
11:30–12:15Lunch break🍽️ Lunch and informal exchange
12:15–13:45Poster sessionAll accepted papers; discussion with authors
13:45–14:25Keynote: Pushmeet KohliHow do we establish that an AI system has made a scientific discovery?
14:25–14:50Invited talk: Marinka ZitnikWhen does an AI-generated hypothesis become a scientific finding?
14:50–15:05Coffee break☕ Informal conversation
15:05–15:30Invited talk: Sara BeeryWhat can AI help us learn about the natural world?
15:30–16:00Contributed talks IITwo papers: 10-minute talk + 5-minute Q&A each
16:00–16:15BreakInformal conversation
16:15–17:15Panel discussionWho remains accountable when AI does the research? Moderated debate and audience questions
17:15–17:30Closing remarksQuestions, disagreements, and possible next steps

The proposed panel brings together François Charles, Hiroaki Kitano, Licia Verde, and Sayash Kapoor, with a moderator from the organizing team, who will gather questions from the panelists beforehand to identify where their perspectives offer grounds for a healthy debate. Drawing on mathematical practice, research automation, AI evaluation, and empirical science, the discussion will explore where these perspectives agree and where they lead to different expectations of evidence, understanding, and responsibility. At least 15 minutes will be reserved for audience questions.

Organizing team

Our organizing team brings together researchers from mathematics, physics, and AI, whose complementary expertise, academic and industry perspectives, and experience organizing research events and building communities will shape both the scientific program and the running of the workshop.

What we hope to achieve

Contributions will examine claims of novelty, creativity, and discovery through arguments, analysis, and empirical evidence.

We aim to clarify where existing scientific standards remain adequate, where they may need revision, and which requirements depend on the discipline or type of contribution. For the ICLR community, this includes identifying what would make evaluations of scientific AI more informative about novelty, validity, human involvement, and usefulness to subsequent research. The intended outcome is a better-grounded agenda for research and practice, with the reasoning behind both agreement and disagreement made explicit.

SCOPE brings together communities with different methods, standards of evidence, and views about AI's role in research. Our organizing team includes faculty, industry researchers, and doctoral researchers, while the confirmed speakers contribute perspectives from mathematics, machine learning, cosmology, biomedicine, and ecology.

These decisions directly concern the ICLR community. They influence how research agents are trained and evaluated, what counts as successful scientific assistance, and which human contributions remain visible in reported results. Physical grounding and experimental validation, emphasized by Anandkumar (2026), illustrate why the generation of plausible ideas alone cannot establish scientific progress. SCOPE will examine how standards for contribution should inform model evaluation, disclosure of human involvement, and the evidence used to substantiate discovery claims.

Topics we hope to cover

We will invite contributions on what should count as scientific contribution when AI participates in research. The workshop takes mathematics as its starting point, with contributions from other scientific disciplines and machine learning providing complementary tests of shared principles. We welcome clear arguments, contrasting perspectives, and evidence that can advance discussion across these communities.

Contributions may address one or more of the following topics:

  • Scientific contribution, originality, and creativity: distinguishing novelty, significance, explanation, and useful synthesis.

  • Evidence for discovery: verification, replication, prior-art assessment, data leakage, and the disclosure of human intervention.

  • Human understanding and responsibility: the relationship between correctness, explanation, oversight, and accountability.

  • Authorship and credit: attribution to humans and AI systems, contribution statements, and recognition for validation and interpretation.

  • Provenance and publication: responsible release, independent review, and responsibility for verifying, explaining, and correcting AI-generated results.

  • Research incentives, autonomy, and access: who sets research priorities, how validation and interpretation are rewarded, and how scientific communities can participate independently of frontier AI laboratories.

Contributions may include:

  • Evaluations of novelty, creativity, and scientific discovery that distinguish new findings from retrieval, recombination, or benchmark optimization.

  • Position papers and think pieces that develop a well-supported argument about scientific contribution, originality, provenance, or standards of evidence.

  • Studies of self-improving agents for scientific discovery, including whether improvements transfer to new scientific problems and how human input and resource use affect the results.

  • Studies of tools and environments for scientific experimentation, including how they support reproducibility, independent verification, and documentation of human and AI contributions.

  • Comparative studies of human, AI-assisted, and autonomous research workflows, including negative results and failures that reveal limits of current evaluations.

The call for contributions will open on November 29, conditional on acceptance.

Get involved

We’re looking for reviewers and area chairs from mathematics, the sciences, and machine learning, as well as sponsors who can help make SCOPE accessible to more participants. If the workshop’s questions connect with your work, we’d love to hear from you.

If the workshop is accepted, reviewing will run from late January to mid-February 2027, with no more than five papers per reviewer.

Reviewers
We welcome researchers at every career stage, including PhD students who have published in a related area. We’ll match submissions to your expertise and availability.
Area chairs
We’re looking for faculty and senior researchers to oversee a small set of submissions in their area, read the reviews, contribute their own assessment, and recommend decisions. We especially welcome expertise in mathematics and formal verification, the experimental and observational sciences, AI evaluation and reproducibility, and the philosophy and sociology of science.
Sponsors
We’d be happy to hear from organizations interested in supporting travel and registration for students and researchers with limited institutional funding. Your support would help people take part who might otherwise be unable to attend.

Express interest

References

  1. Advisory Group on Mathematics and Artificial Intelligence. Responsible release of AI-generated mathematics. September 29, 2026a. URL https://agmai.org/general-sep29/.
  2. Advisory Group on Mathematics and Artificial Intelligence. On OpenAI's release of mathematical results, October 2026b. URL https://agmai.org/. October 6.
  3. Anima Anandkumar. How do we build AI to push the frontiers of scientific discovery? Dædalus, 155(1–2):216–228, 2026. doi:10.1162/DAED.a.983. URL https://www.amacad.org/publication/daedalus/how-do-we-build-ai-push-frontiers-scientific-discovery.
  4. Association for Human Mathematics Communications Working Group. AHM statement on OpenAI's October 6 release of mathematical documents, October 2026. URL https://terrytao.wordpress.com/2026/10/07/ahm-statement-on-openais-october-6-release-of-mathematical-documents/. October 7. Guest statement republished on Terence Tao's blog.
  5. Sara Beery. AI & ecology: From tool to transformation. Dædalus, 155(1–2):364–367, 2026. doi:10.1162/DAED.a.996. URL https://www.amacad.org/publication/daedalus/ai-ecology-tool-to-transformation.
  6. Juraj Gottweis, Wei-Hung Weng, Alexander Daryin, Tao Tu, Anil Palepu, Petar Sirkovic, Artiom Myaskovsky, Felix Weissenberger, Keran Rong, Ryutaro Tanno, Khaled Saab, Dan Popovici, Jacob Blum, Fan Zhang, Katherine Chou, Avinatan Hassidim, Burak Gokturk, Amin Vahdat, Pushmeet Kohli, Yossi Matias, Andrew Carroll, Kavita Kulkarni, Nenad Tomasev, Yuan Guan, Vikram Dhillon, Eeshit Dhaval Vaishnav, Byron Lee, Tiago R. D. Costa, José R. Penadés, Gary Peltz, Yunhan Xu, Annalisa Pawlosky, Alan Karthikesalingam, and Vivek Natarajan. Towards an AI co-scientist. arXiv preprint arXiv:2502.18864v1, 2025. URL https://arxiv.org/abs/2502.18864v1.
  7. Raul Jimenez, Boris Bolliet, Francisco Villaescusa-Navarro, Rabih Zbib, Benjamin Wandelt, David N. Spergel, Thomas Meier, Jessica Montgomery, Hana Aliee, and Licia Verde. AI scientists as engines of discovery: A case for development within reformed institutions. arXiv preprint arXiv:2606.22859, 2026. URL https://arxiv.org/abs/2606.22859.
  8. Sayash Kapoor and Arvind Narayanan. Leakage and the reproducibility crisis in machine-learning-based science. Patterns, 4(9):100804, 2023. doi:10.1016/j.patter.2023.100804.
  9. Hiroaki Kitano. Nobel Turing Challenge: Creating the engine for scientific discovery. npj Systems Biology and Applications, 7:29, 2021. doi:10.1038/s41540-021-00189-3.
  10. Sabina Leonelli. Philosophy of Open Science. Elements in the Philosophy of Science. Cambridge University Press, 2023. doi:10.1017/9781009416368.
  11. Chris Lu, Cong Lu, Robert Tjarko Lange, Yutaro Yamada, Shengran Hu, Jakob Foerster, David Ha, and Jeff Clune. Towards end-to-end automation of AI research. Nature, 651(8107):914–919, 2026. doi:10.1038/s41586-026-10265-5.
  12. Alex Meiburg. [On Comparator challenge specifications]. Oh Hai There, October 8, 2026a. URL https://blog.ohaithe.re/post/829974396980641792/id-like-to-alert-people-that-several-of-the. Untitled blog post; descriptive title supplied.
  13. Alex Meiburg. Thoughts on AI solving “math”. Oh Hai There, October 8, 2026b. URL https://blog.ohaithe.re/post/829972087725817856/thoughts-on-ai-solving-math.
  14. Lisa Messeri and M. J. Crockett. Artificial intelligence and illusions of understanding in scientific research. Nature, 627(8002):49–58, 2024. doi:10.1038/s41586-024-07146-0.
  15. OpenAI. Sharing AI progress in mathematics. October 6, 2026. URL https://openai.com/index/sharing-ai-progress-in-mathematics/.
  16. Christian Szegedy. Is mathematics over, or just graduating? Essay, October 3, 2026. URL https://docs.google.com/document/d/e/2PACX-1vTSh-pyNP3Gi99WMmsinnLmE9V5CDI0HEm6WGbIPMNt3V5SGlClHF8-BetotKHOImrvQDSXmFdiOw8D/pub.
  17. Terence Tao. Mathematics in the age of AI. arXiv preprint arXiv:2608.16753, 2026. URL https://arxiv.org/abs/2608.16753.
  18. Kaiyue Wen, Tengyu Ma, and Percy Liang. Priced guidance: Can language models generate future research ideas? arXiv preprint arXiv:2610.04976, 2026. URL https://arxiv.org/abs/2610.04976.

Contact

Mariya I. Vasileva · Lead organizer and designated ICLR contact