中文

AI FOR SCIENCE · ARGUMENTS

Commentary

Arguments worth tracking across AI for Science, from first-hand accounts to technical challenges and formal scientific exchange.

2026

: commentary +6

Tools over theories

Argument: Reviewing Alexander Krauss's study of 761 major discoveries, almost all made possible by a recently developed tool or method, Conor Griffin of Google DeepMind argues that funders should back toolmakers and the databases AI depends on, such as the Protein Data Bank, and use AI to upgrade and invent scientific instruments.

Why read: Read it for a question to put to any AI-for-science plan: which instrument, method or dataset does it improve, and who maintains it? Griffin also gives four objections to Krauss, starting with survivorship bias, since most tools ever built presumably led nowhere. It runs on Google DeepMind's policy blog.

Neuroscience gave AI its start. What happens now?

Argument: A computational neuroscientist long at Google Brain and Meta Reality Labs, David Sussillo doubts brain research will change AI's course soon: recordings reach a tiny fraction of neurons. For now AI helps neuroscience; a foundation model trained on high-quality neural data, a virtual mouse brain or a similar moonshot, could reverse that.

Why read: Read it for a concrete test of when brain data could matter to AI: a model of a whole brain that can be probed as fast as an AI model. Short of that or a similar moonshot, he expects AI labs simply to hire the neuroscientists. It is an interview, opinion with few examples.

AI-hallucinated citations should be treated as research misconduct

Argument: Jan Pisek of the University of Tartu points to a Tallinn court that fined plaintiffs for a filing citing studies an AI invented, holding users responsible for AI material they submit. Academia should do the same: authors answer for every reference, hallucinated citations are misconduct, and arXiv's new penalties are timely.

Why read: Read it for a standard borrowed from the courts: whoever submits AI output answers for it, whatever tool produced it. It is a short letter that leans on one Estonian case.

This week in AI-for-science: 307 papers, one question: what happens when the data move?

Argument: Jorge Bravo-Abad reads a week of 307 papers and argues that a model's most useful result is how it does on data unlike its training set. Name the shift a claim depends on (new chemistry, site, patient group, year or intervention), make that shift the test, and report it before any random-split score.

Why read: Read it for checks to copy: on chemistry held out of training, uncertainty-picked samples did no better than random ones; once related rock samples were kept apart, logistic regression matched deep learning. And when a model ranks experiments, test a low-ranked candidate too, or a hit cannot show the ranking works.

Commentary: Citation graphs may underestimate neuroscience’s influence on AI

Argument: Answering Renato Duarte's citation analysis, Anthony Zador of Cold Spring Harbor Laboratory argues that citations record only an idea's last handoffs: ideas such as recurrent circuits and attention stop being cited once absorbed, and in his spot check two thirds of machine-learning references were five years old or less. The better measure, he says, is intellectual history.

Why read: Read it beside Duarte for why Duarte's numbers can read low: Merton's 'obliteration by incorporation', worked through the transformer's descent from recurrent networks. Zador proposes tracing the people who moved between the fields, John Hopfield, Geoffrey Hinton, Demis Hassabis, but brings no data beyond one spot check.

Examining the bridge between neuroscience and AI

Argument: Across citations among about 458 million OpenAlex papers, Renato Duarte of the University of Coimbra finds neuroscience citing AI far more since 2006, mostly for tools to analyse neural data, while the newest landmark both fields share dates from 2003. Neuroscience must now offer AI new results.

Why read: Read it for a measured answer to whether AI and neuroscience feed each other: what crosses from AI is mostly software, and the bridge rests on a few institutions, Alphabet and Microsoft first. He warns that 2024-25 counts are unstable while OpenAlex rebuilds.

Featured exchangeAll exchanges →
05

Navier–Stokes: claim, credit, community

A capability claim, a priority dispute and the mathematical community’s response arrived in one week, before any independent verification. Nine days on, none has been published, Clay has awarded no prize, and the argument has moved from a blog thread to a Nature editorial asking for disclosure, opt-in and audit.

Unresolved: verification pending, and now a policy ask

A 10-year-old CNN outperforms frontier LLMs for skin cancer diagnosis

Argument: Magnus Lynch, a dermatologist, gave 200 biopsy-proven lesions to GPT-6 Astra, Claude Fable 5.1 and an Inception v3 network fine-tuned on public skin images. The CNN named the right one of six diagnoses for 125, the two LLMs for 84 and 85. He concludes a small, old, specialised network beats both.

Why read: Read it for the triage table: the LLMs kept 97 and 96 of 100 lesions that needed care but cleared only 32 and 22 of 100 harmless ones. The CNN cleared 76 at its preset threshold, where it also cleared 18 of 30 melanomas; set to match the LLMs' caution, it cleared 1 or 2. Each LLM ran once.

Disadvantages of Designating Mathematicians for AI Output Releases

Argument: The Advisory Group on Mathematics and AI recommends that AI labs stop picking mathematicians to receive, check and present their output. Even when everything is public at once, the lab is choosing for the field who leads the work, through its own networks, and those names end up vouching for the release.

Why read: Read it for four costs of a lab handing its mathematical results to experts it chose: unequal access, a choice taken from the field, selection through the lab's networks, and borrowed reputation. Its alternative is neutral repositories, with labs paying for follow-up work and independent nonprofits deciding who gets it.

Why read together: Read in full at source (agmai.org general recommendations and the group's home page). The survey replies and the PDF were not read. Tao's 30 September post only points to this document.

AI Is Getting Good at Math. Here’s Why.

Argument: Ankit Maloo argues that this year's AI proofs share a pattern: models push every plausible idea to the end and a checker discards the false proofs. They win where a problem needs few key insights and few options per step, staying on paths humans drop after weeks without visible progress.

Why read: Read it for a rule you can use before a result appears: expect AI to finish work whose key leaps people already made, where only long, hard derivation remains. He also argues that failed attempts teach only when they are published. He works from the labs' write-ups and mathematicians' commentary, not new data.

The AI debate is missing half the system

Argument: Pietro Michelucci of the Human Computation Institute argues that AI safety proposals, such as AI executives' advice to the UN Security Council, focus on the model and largely overlook risks from how AI interacts with people and institutions. No component is fully trustworthy, so the whole human-AI system must stay safe when parts fail.

Why read: Read it for a method from human computation: hidden questions with known answers keep a running trust score, and anyone below a threshold keeps working but no longer sways the output. He would apply it to AI agents' access to tools and data, though he notes performance cannot always be checked against known outcomes.

Mathematics is a subject for the young

Argument: NYU mathematician Tristan Buckmaster, who released a forced-Euler result with Levent Alpöge the night before OpenAI's Navier–Stokes announcement, argues that AI companies see researchers' half-formed ideas in chat sessions while competing with them using models the public cannot use. Academics, he says, need data protections and open-weight models of their own.

Why read: Take away a list to demand of an AI provider: zero data retention with audits, training only on opt-in data, no capturing a whole session when a user rates one reply, and, for credit, reward for exposition and no penalty for disclosing AI use. He is a party to the priority dispute with OpenAI; his account of its October release is his own.

How a new wave of science philanthropists can have the greatest impact

Argument: Nature argues that tech donors, a group AI company listings could soon enlarge, bring useful freedom to science funding: long bets and fast pivots. But unlike public funders they are not obliged to report what their grants produced, and Nature says they should; without that, nobody can tell which approaches worked.

Why read: Read beside Ben Reinhardt's case for venture-style philanthropy, it supplies what that case leaves out: rounds and credit for early backers coordinate funders, but only published results let others learn from them. Its lesson for new donors is the Gates Foundation's Grand Challenges, slower to pay off than planned.

The Age of Reasoning

Argument: Four Metis Reasoning founders, Thore Graepel among them, trace hallucination, reasoning nobody can audit and knowledge nobody can edit to one cause: training fuses what a model knows with how it reasons. Their fix is AlphaGo's parts: an explicit record of what is known, a judge that admits a claim only on evidence, and uncertainty reduction as the objective.

Why read: Take away what it says a trace must record to be auditable: each claim's evidential status, the evidence that licensed the change, and why a withdrawn premise was dropped. That is a test any agent claiming auditability can be held to. The separation thesis (knowledge apart from reasoning, evidence as the gate) is set out in a page. A launch paper, with no system and no benchmark.

Rounds, SAFEs, and Glory

Argument: Ben Reinhardt argues philanthropy funds risky, startup-like nonprofits badly because it lacks venture capital's coordination tools: rounds, stage norms, credit for early backers, exits. The norm against funders claiming early wins leaves no reason to back risky work early. He proposes philanthropic SAFEs, shareable diligence reports, impact portfolios and syndicates.

Why read: Take away the diagnosis that philanthropy's gap lies in coordination and credit, and an appendix that prices research projects by stage, from about $100-500k for an idea to $50-200M+ for deployment. Reinhardt runs a research nonprofit that raises this kind of money.

The next bottleneck in AI for science

Argument: Mihai Codreanu, who co-led Google's AI-in-science study, tells Annelies Gamble the constraint has moved downstream: scientists save about 7 hours a week, yet 44% say their main bottleneck moved, 41% report a growing backlog of untested hypotheses, and nearly half of those saving time spend over a quarter of it checking AI output.

Why read: Read it for three ideas: a verification tax that in lab and physical sciences is the experiment itself; a possible streetlight effect, with about half of respondents saying AI encourages safer projects; and his test for real discovery, longitudinal data on whether a result later proves useful to others and opens new directions, beyond the tasks AI already speeds up. Every figure is self-reported.

An experimental AI-math challenge: using tenth discriminant bounds to explore arguments ruling out Siegel zeroes

Argument: Mathematician Terence Tao proposes handing AI a tedious step: from each new proof that rules out Siegel zeros, a decades-old number-theory obstacle, work out an explicit limit on a hypothetical tenth exception to a list Gauss found. The limits could help compare the proofs' strength. AI use must be disclosed.

Why read: Read it for a working pattern of AI used to deepen understanding rather than replace it: give it work tedious for people, on a problem already solved, and use the output to compare arguments and perhaps find new ones. It is an open call, so no results are in yet.

↳ Read with Math 2.0

A World Model of Life: Biohub’s Alex Rives on Virtual Cells, Measurement and the $1.8B Data Push

Argument: Alex Rives, Biohub's head of science, says today's so-called virtual cells cannot simulate a cell or replace experiments, above all because much inside a cell cannot yet be measured. Within about five years, Rives suggests, a model could predict the range of states a cell moves to after an intervention.

Why read: Read it for why protein models worked and cell models have not: proteins come with sequences from all of evolution, close to unlimited data, while cell data is scarce, so model design still matters and lab experiments must check the model. Rives speaks for Biohub's $1.8B data push.

How to Increase America’s AI Lead Over China

Argument: Tim Fist, Georgia Adamson and Konstantin Pilz put the US lead over China's top models at about 6.5 months, set mostly by China's chip access and distillation of US models. Existing executive powers (export controls, an antitrust safe harbour against distillation, anti-smuggling checks) could, they estimate, roughly double it by end-2027.

Why read: Read it for a model that turns compute and distillation into months of lead, and its answer to the sales objection: with demand outside China above supply through at least 2027, restricted chips would sell elsewhere. It assumes equal capability per unit of compute, which the authors call a key limitation.

AI for Science: six lessons from 60 papers

Argument: Jorge Bravo-Abad draws six rules from 60 papers on where to spend effort. Report how often a design works, not just the best: 36% of 135 designed zinc proteases cut their target. Try correcting an existing model as a baseline, and test as the model will next be used.

Why read: Read it for checks that carry across fields: in one evaluation AlphaFold 3's confidence scores ranked screening hits worse than docking, and a proteomics model trained on 100 million spectra lagged existing methods on much of a benchmark from older instruments. It is a reading digest, so each rule rests on a few papers.

A Recipe for Cells

Argument: Niko McCarty tallies an E. coli cell (two million proteins, 10 billion ATP to build another) and argues the list is not a recipe. No cell has been built from scratch, he suspects, because we lack its fault tolerance and regulation; builders should make many variants and let selection pick.

Why read: Read it for concrete cases of why an inventory is not an understanding: noisy gene expression in identical cells, a starving population rescued by about a dozen chance mutations, sensors that read fold-changes rather than amounts. It is a popular-science chapter with no AI in it.

Will it be a golden age or a dark age for mathematics (and science)?

Argument: Francesco Maggi argues that AI proofs are real, but where they lead is a choice. In the dark version output soars while knowledge gathers in a few companies and slips beyond human understanding. He asks which of OpenAI's 4,000 problems failed, and calls on universities, societies and funders to jointly build and govern competitive LLMs.

Why read: Read it for a mathematician's case that moves the debate from credit to infrastructure: if academics need proprietary models to compete with the firms that own them, those firms decide which questions get the best tools. He also passes on colleagues' sense that a strong result no longer shows a student's own ability.

Starting a new journal

Argument: A new mathematics journal planned by Shaoming Guo and colleagues sets two values beyond open access: how much a paper deepens understanding counts for more than being first, and a paper is accepted only once its proofs are formally verified in Lean, because proofs developed with LLMs can hide subtle errors.

Why read: Read it for one concrete way a journal could meet LLM-assisted proofs: accept a paper only after Lean has checked it, so a machine catches subtle errors before publication. The post is short and asks mathematicians to propose other journal designs.

How to Formalize All of Mathematics

Argument: Jeremy Avigad, Kevin Buzzard and five other formalizers argue that a formal proof library is worth something only if mathematicians can build on it. They warn against formalizing everything fast and badly (Claude's 13-million-line Fermat proof, they judge, probably has little lasting value) and back AI-written libraries that follow Mathlib's design and values.

Why read: Read it for a working model of AI formalization done for use: Tau Ceti and Formal Frontier, where AI agents write Lean code and other AIs review it, and Palomar, a registry where each project declares how much AI did. Both libraries are incubated by the Mathlib Initiative.

On AI statements in mathematics papers

Argument: Hendrik De Bie, a Ghent University mathematician, checked all 152 new arXiv papers in two fields over one September week: 56% said nothing about AI, 35% reported using it for the mathematics. Every paper, he argues, should state its AI use, even none, and name the model and the theorems it touched.

Why read: Read it for a check any field can copy: count one week's new papers by what they disclose, then write to the authors. His recommendations double as a template for an AI methods statement: which model, which section, what role, and any funding or early access from AI companies. It covers two fields over one week.

Who proves that a scientific discovery made by AI is right?

Argument: At a Shanghai roundtable, four young researchers argue that AI proposes candidates far faster than labs can test them, so verification decides what a result is worth. Tong Xie, citing the corrected A-Lab paper, says the model that proposes a material must not also judge it, and the test must be fixed before the data arrive.

Why read: Take away Xie's three tests for calling something an AI discovery: someone other than the developer checks it, the prediction comes before the experiment, and the result lies outside what is already known. And the cost of testing sets the bar: a model whose predictions take years to test must state where it applies.

Making AI work in healthcare

Argument: Nature Medicine argues clinical AI has outrun its evidence: over 90% of US health systems deploy AI tools, yet 53% or fewer find them highly useful. Benchmark scores do not carry over into care, so tools must be judged before, during and after deployment, by what they do for patients and staff.

Why read: Read it for a list of what goes wrong after a model passes its benchmarks: an eye clinic where the AI worked only when built into every step of care, a records assistant whose performance drifted, clinicians who stopped using a tool within four weeks. It introduces an issue; the cases are in the pieces it links.

Steering AI Beyond Automation

Argument: Economist Gabriel Unger and computer scientist Arvind Narayanan argue that AI is being built almost entirely to replace human work (by economic incentive and by the habits of computer science) and set out an agenda for the other direction. First on it: white-box agents, which show their sources, assumptions and intermediate steps.

Why read: Read it for why that is harder in a lab: coding agents can show their work partly because public repositories record every step, and law, medicine and many sciences have no such public record, so collecting a field's process traces is itself infrastructure. Speed enough to work alongside, collaboration past taking turns, and scoring a human-model pair are the rest of the agenda. Science gets one line in the essay.

How LLMs Deal With Fraudulent Papers

Argument: Drug-discovery chemist Derek Lowe reads a preprint that gave 30 language models text from 42 retracted, fraudulent or pseudoscientific papers and asked for a follow-up study: 95% of the answers they gave went along with the premise. Agents meant to mine the literature assume it is reliable, and it is getting less so.

Why read: Read it for a check any team building a literature agent can run: hand it a retracted paper and see whether it plans the next experiment anyway. In one example, a model cites a jailed surgeon's fatal tracheal grafts as successes. His line that no model reasons goes past what the preprint measured.

Lab-in-the-Loop at Compute Speed — Ian Quigley, Leash Bio

Argument: Ian Quigley, CEO of Leash Bio, argues that public binding data such as ChEMBL teach models who made a molecule, not how it binds: a guess at the chemist alone predicts activity as well as the structure does. So Leash measures binding itself, with pocket mutants that separate memorising from learning.

Why read: Read it for a check any team can run on its own data: if a model can guess who made a molecule, or which instrument ran the assay, it may be learning the lab rather than the chemistry. The figures are Leash's own, given in conversation.

Warrants, dinosaur bones, and resolving conjectures with AI

Argument: Joseph Tooby-Smith, a Bath lecturer in proof assistants, says a conjecture settled by AI in Lean with little human help is no proof but a "warrant": belief without understanding, a dinosaur bone found by luck. Publish it, say what it is, and leave the work and credit of a real proof intact.

Why read: It gives a name, the warrant, to the gap between a result a machine has checked and one a person understands, a distinction worth carrying into any reading of AI-assisted proofs. What to do once a warrant is in hand he leaves to each finder.

The rise of agentic AI in drug discovery from static tools to autonomous virtual scientists

Argument: Tingjun Hou, Chang-Yu Hsieh and colleagues rank drug-discovery AI systems on six levels, from fixed tools to a "virtual scientist" that sets its own questions. They call claims of autonomous discovery premature and ask agent papers to show the gain came from the agent design, not a stronger model.

Why read: Read it for a reporting checklist for any agent paper: test against a non-agent pipeline with the same model and tools, and report human interventions by severity, errors the agent fixed itself, sub-tasks completed and cost against an expert. Most of it surveys existing systems.

Ten years, tens of millions of cells

Argument: Ten years into the Human Cell Atlas, Nature Biotechnology argues the question is no longer whether human cells can be mapped but what the map is for. Having supplied much of the data behind today's foundation models, it now aims at 10 billion cells and AI that predicts a cell's response to a deleted gene or a drug.

Why read: Read it for where much of the data under single-cell foundation models came from: a decade of shared standards, metadata and benchmarks agreed across a consortium now over 4,000 members, groundwork the new virtual-cell funding assumes. Written for an anniversary, it lists aims for the next phase, not results.

The sky we stopped watching

Argument: Manish Ranjan argues that AI weather models learn from past measurements, so they forecast best where stations are dense and worst where they are sparse, widening the gap for poor countries. Chips get cheaper; an unmeasured storm is lost for good. Commercial AI forecasters should return a share of revenue to observation networks.

Why read: Read it for the point that measurement, not computing, is now the scarce input to AI forecasting, and that a free AI forecast can remove the budget case for the gauges that check it. It is a policy column; its figures are cited from others' studies.

This is normal bad work

Argument: Sophie Huiberts, a CNRS researcher who proves theorems about the simplex method, says whoever publishes a proof owes the field a clear write-up that credits old ideas. OpenAI's maths files do neither, so they are easy rejects, not a watershed, and they scoop OpenAI's own customers.

Why read: Read it for a working mathematician's standard for publishing a proof: whoever or whatever found it, someone has to write it up and credit the ideas it uses. Its claims about errors and about experts soon finding the same results rest on one linked post and one example.

Illustration beyond Proof

Argument: Now that AI has made proofs plentiful, Kate Stange and Edmund Harriss argue, mathematics should credit illustration as research, not decoration: a picture can show structure nobody has explored, a proof can certify what the picture shows, and art's group critique offers a way to judge the rest.

Why read: It brings a recent case into the credit debate: an AI found a 3D aperiodic tile, the man who prompted it posted a 61-page paper he did not fully follow, and Chaim Goodman-Strauss cut the argument to eight pages built around a diagram of the tile. The essay asks for illustration to be credited and leaves open how to measure it.

Math 2.0

Argument: Terence Tao says AI has made proofs plentiful, so solving open problems no longer stands in well for what mathematics is after: human understanding, within the field and in its uses. Pushing AI to solve problems and nothing else is now harmful, he argues; it should also explain opaque proofs, survey problems at scale and build libraries such as Mathlib.

Why read: It gives a reader a check to apply to any AI-maths headline: solved problems reach press releases and failures do not, so an assessment should report compute and failures alongside the successes. These are lecture slides, so the case is sketched rather than worked through.

Why AlphaFold Didn’t Solve Protein Folding

Argument: Pushmeet Kohli of Google DeepMind says AlphaFold learned to reproduce structures deposited in the Protein Data Bank, not how proteins really move, and that DeepMind's own cell-model work found cell-by-gene data not yet good enough for a virtual cell. Sal Candido of Biohub adds that scaling pays only once the data carry what the problem needs.

Why read: The people who built these models say plainly that "solved" was narrower than the headlines, and that the next gains depend on collecting the data a problem needs, chosen as carefully as the model. It was said on a 30-minute panel launching a data initiative both their organisations back.

You Can’t Speedrun Yourself

Argument: Alex Chalmers argues that AI produces the visible output of skilled work while skipping the slow practice that builds judgment, and that from outside a practice no one can reliably tell drudgery from formation. Institutions that reward only output risk slowly losing the ability to catch errors, train successors and raise their standards.

Why read: It speaks directly to research training, and the Terence Tao line he quotes puts it in one image: AI is a helicopter that skips the journey, and the journey is where the skill was built. It is a philosophical essay, so it offers caution rather than a way to measure the loss.

AI for science this week: From prediction to proof, and back to the lab

Argument: Before blaming a model, check that the test can see success. Jorge Bravo-Abad cites a cell-perturbation benchmark where half the treated cells, used to predict the other half, lose to a plain average on about 95% of perturbations, scored by mean squared error. Output counts as evidence only with a fitting check: a control, an assay, a proof checker.

Why read: A habit to take from it: before weighing a result, name the claim that would change a decision and the comparison that could establish it. The weekly reading list applies that habit to other groups' papers, each with its limit stated.

What mathematicians should know about the Lean Theorem Prover: questions of reliability and AI

Argument: A Lean proof is only as trustworthy as Lean, argues Thomas Hales, a Pittsburgh mathematician who once found a soundness bug in the HOL Light prover. This summer AI found kernel bugs that let false statements be proved, all since fixed, and Lean's type theory still has no complete consistency proof written out by people.

Why read: It explains something most readers of AI proofs take on trust: the Lean checker those proofs rely on has theoretical foundations mathematicians have rarely examined. He welcomes an AI-built, verified kernel but wants people to write the theory and check what each statement says. The closing scenario of a planted bug is a thought experiment.

Chasing the Grail: A History of Binding Affinity Predictions in Drug Discovery

Argument: Daniel Ramirez of Recursion's Valence Labs argues that physics simulations and AI models fail in opposite ways at predicting how tightly a drug binds its target: physics is slow but holds up on new proteins, AI is fast but breaks without warning outside its training data. So each should feed the other.

Why read: Read it for a short history of the problem, from docking to free-energy calculations to cofolding models such as Boltz-2, with what each approach trades away. It is Valence's own blog, and its own step toward the combined loop, a model called AquaGen, has so far been used only on how molecules dissolve in water.

A biologist queries whether AI ‘borrowed’ his work to make major discovery – an expert explains the rules

Argument: Robson Tramontina, a chemical biology researcher at the University of Manchester, reads the dispute over Anthropic's ART enzymes: the enzyme was already known, some evidence came from another team's 2022 data, and the agents missed the repeat array in ten reruns. AI-discovery announcements should credit human work as clearly as the AI's.

Why read: Read it for practical guidance: what an AI discovery claim owes the people whose data it reused, and what a researcher should check before uploading unpublished work to a chatbot. It does not settle whether Mario Rodríguez Mestre's drafts played any part, and says so.

Why read together: Read in full at source. The quotes are as WIRED prints them; Anthropic's announcement and technical report were not read.

OpenAI, the Partition Principle, and mathematics

Argument: Asaf Karagila, a Leeds set theorist who had offered a bottle of whisky for this problem, looked over OpenAI's preprint claiming the Partition Principle does not imply the Axiom of Choice. He finds it muddled and oddly referenced, a desk reject, and says dropping hundreds of such "solutions" on experts works like a denial-of-service attack.

Why read: How the specialist this result most concerns reads it: going by the prose and references rather than the Lean code, he says the result cannot be read, not that it is wrong, and that he will not spend his time checking it.

Why AI for Science Is Booming in 2026?

Argument: An AceCamp investment note argues the AI4S boom rests on real progress, but only at the front of drug R&D: structure, binding and early design. Clinical success, generalisation to new targets and agents' reproducibility are unproven; valuations rose faster than scientific output, and the stock market rewarded synthesis and lab suppliers more than AI platforms.

Why read: It separates what is proven from what is priced and gives a watch list an investor can check: third-party blind hit rates, Phase II readouts, and how often an agent's result repeats. It ends by calling AI4S a constructive investment theme, citing bank research for its clinical figures.

What should we tell our students?

Argument: Álvaro Lozano-Robledo, a UConn mathematician, writes to students rethinking a maths PhD: AI companies steer the story ahead of their IPOs, and AI proofs so far seem to recombine known ideas rather than add new ones. People stay needed, and the case for a PhD has not changed in a year.

Why read: It turns a worry into a prediction a reader can check: if AI only fills in the "convex hull" of known ideas, results found by AI alone should slow down. The model is a borrowed toy with one worked example, and the job outlook rests on universities' need for maths teaching.

Complementary remarks from Gary Marcus and Terence Tao on OpenAI’s giant math drop

Argument: Gary Marcus says the news in OpenAI's maths release is what it leaves out: procedure, model, training, failure rate. Without them, he argues, no one can tell a step toward general AI from a clever use of Lean and synthetic data that works only where proofs can be checked.

Why read: Read together, the two ask different questions of the same release. Gary Marcus asks whether the results generalise; OpenAI's note does give about 4,000 problems posed, though not how many proofs failed. The Terence Tao post he quotes asks what is lost when prompters solve problems and leave, starting fewer seminars and collaborations.

The barriers of perception

Argument: Raghu Meka, a theoretical computer scientist at UCLA, says some recent AI solutions were brilliant but not completely alien: they cracked old problems that researchers had mostly stopped trying, he suspects partly because folklore said they were too hard. He warns against now setting, just as quickly, limits on what human mathematicians can contribute.

Why read: His point is a comparison of costs: wrongly believing in a barrier costs more than wrongly doubting one, and AI has made trying cheaper. It rests on his own career and a few results he admits are a small fraction, seen with hindsight; a short reflection, not evidence.

The Mathocalypse

Argument: Scott Aaronson, a computer scientist at UT Austin, calls OpenAI's 6 October release (372 results, the Unique Games Conjecture among them) one of the biggest days in mathematics. He sets OpenAI's way of posting raw proofs against Anthropic's, which let chosen mathematicians publish a digested version first.

Why read: He names the real choice: OpenAI's way starts a thankless race to explain proofs nobody understands yet, Anthropic's lets a company pick who speaks for the AI. He backs neither, and calls the proofs only probable so far: almost no proof has been understood by a person, and not all carry a Lean certificate.

AHM Statement on OpenAI’s October 6 Release of Mathematical Documents

Argument: The Association for Human Mathematics, formed to defend mathematics as human work against AI, says OpenAI's release of over 700 files ignored the first advice of the advisory group OpenAI cites (do not test hard problems on internal models) and shows power, not scholarship. It urges mathematicians to stop working with OpenAI.

Why read: Its sharpest point uses the advisory group's own first rule, though that group, independent of OpenAI, called its talks with the company constructive and left the verdict to mathematicians. The statement engages none of the proofs; the test is whether mathematicians walk away or keep checking the results.

Why read together: Read in full at source (agmai.org general recommendations and the group's home page). The survey replies and the PDF were not read. Tao's 30 September post only points to this document.

Artificial intelligence pathways from weather to climate

Argument: Tom Beucler of the University of Lausanne and twelve co-authors argue that an AI weather model run for longer is still not a climate model: the record holds one warming path, so learned correlations can break in a climate nobody has measured. Their minimum: greenhouse gases, aerosols and land use must enter as inputs that can be moved one at a time, and the model must be tested outside its training range.

Why read: Read it for two tests to put to any AI climate result. Hold a forcing fixed: with CO2 pinned at its 1979 level, Ai2's ACE2-SHiELD warmed unrealistically little against the simulation it emulates, and its authors retrained it on varied CO2 to repair that. Then ask what the speed buys: the paper suggests AI is fast mainly by computing less.

The Future of AI-assisted Physics: Discovering, Verifying and Organizing Results via Formalization

Argument: Sven Krippendorf (Cambridge), Leopoldo Sarra (Axiomatic AI) and Joseph Tooby-Smith (Bath) argue that AI now writes computer-checked physics proofs fast, but a proof that checks cannot show its definitions match the intended physics. Unread code lands on shared libraries such as Mathlib and Physlib, whose reviewers lose the credit they once earned.

Why read: Read it for a split the authors say applies to coding in general: AI is reliable at local, checkable work, such as filling in a proof, and weaker where judgment spans a whole project, such as choosing definitions or designing a library. Tooby-Smith started and maintains Physlib, the library they want at the centre.

AI could undermine scientific independence in subtle ways

Argument: Fabio Motoki argues that AI might quietly make studies less independent. A 2026 preprint suggests different language models, given the same questions, propose narrower and more alike methods than published work; if teams lean on the same few models, ten papers may be fewer than ten independent paths. He wants AI use reported, and replications to check the tools too.

Why read: A useful point that evidence reviews can apply now: count shared tools the way one counts shared data. It is a short letter resting on one preprint, and it does not show how often alike AI advice has produced matching errors.

Hexagon

Argument: Ben Antieau announces Hexagon, a nonprofit maths and theoretical computer science repository that accepts papers written entirely by an LLM, even ones nobody claims to understand, and invites the big AI labs. arXiv said it would not be that home; GitHub or X posts are a brittle record.

Why read: It is the kind of repository Bloom said the same day should exist, kept apart from his Erdős site. Antieau's own case shows the need: a result he once would have sent to a good journal, but will not sign. Whether moderation keeps the quality up is untested.

Changes to the Erdős problems web site

Argument: Thomas Bloom, who runs erdosproblems.com, is freezing new problem comments and proof claims, hiding which problems are solved and dropping language that credits anyone with a result, because most comments now announce AI proofs, often unexplained. He will link Lean proofs checked on the Palomar registry and well-written explanations instead.

Why read: His sharpest point: a formal proof does not end a problem's value, yet a stream of unexplained AI proofs makes it look that way and drives off the people who want to understand the mathematics. He concedes the no-credit rule also shortchanges human solvers, and calls it temporary.

Mathematics of the Future

Argument: Pavel Etingof and Slava Gerovitch of MIT argue that when AI does most theorem proving, papers stop showing how good their authors are. Hiring and PhD exams should lean more on talks, oral exams and discussion, and value a theorem proved with heavy AI help the same as one proved without.

Why read: Read it for a protocol any research group could copy: students work at the blackboard without AI, the faculty member sends the notes to a model once after each meeting, and students check its reply before the next one. Etingof discloses part-time consulting for Anthropic since July.

Scientists must be trained to work without AI, as well as working with it

Argument: Statistician Phil Kay argues that scaled-up self-driving labs risk more wasteful experiments and cost chemists both agency and basic skills. His remedy is the fix a UK report proposed for pocket calculators: teach and examine chemistry both with AI and without it, including manual practicals and pen-and-paper design of experiments.

Why read: Read it for a test to put to autonomous-lab results: what the runs bought. OpenAI and Ginkgo's lab needed 36,000 runs for one recipe; Alán Aspuru-Guzik's agent Óptima reasoned well about a zero yield, though a human-directed campaign reached a higher yield, in more than twice the runs. The column is sponsored by JMP.

Will Claude ever win a Nobel Prize for medicine?

Argument: Jeffrey Flier, former dean of Harvard Medical School, asks who gets credit if an AI agent finds a new way to cure cancer. Credit rewards scientists and assigns trust and responsibility. AI-driven discovery changes the first; the second still has to be done, and patents and prizes were built for human discoverers.

Why read: Read it for one distinction: credit as a reward, and credit as the record of who answers for a claim. It separates what AI-driven discovery changes from what institutions still have to settle. It mostly sets questions rather than answering them, and he says so.

The Future of Mathematics

Argument: Logician Jeremy Avigad says AI has upended mathematicians' daily routine (results that made a respectable paper a year ago now come easily) but not mathematics itself, a culture of rigorous reasoning. His answer: solve harder problems, think bigger thoughts, and count building AI and proof tools as mathematics.

Why read: His sharpest point, credited to Matthew Ballard: the AI solutions to open problems so far all stitch known techniques together, and no reinforcement-learning reward could have scored Riemann's leap, whose payoff was diffuse and took decades. It is a hopeful essay, not a plan, and he admits it offers students little comfort.

AI biohazard hype must not divert attention from the real risks we face now

Argument: An epidemiologist argues that fear of AI-designed bioweapons is crowding out plainer gaps: agencies that still fail to coordinate, as in the 2001 anthrax attacks and COVID; unmonitored private labs; and US cuts ($177 billion in grants cut or frozen, about 25,000 research-agency staff lost since 2025).

Why read: Her strongest point is a RAND biologist's: an AI can optimise a sequence on screen in seconds, but making it work still runs into physical bottlenecks. She still wants AI safeguards, as one layer. What she does not show is how far attention to AI has actually displaced biodefence.

Why read together: Both begin with the same fact: turning an idea into physical reality is hard. Read together to see how one bottleneck can limit both scientific benefit and harmful capability.

On classical solutions and singularity formation in incompressible fluids

Argument: Diego Córdoba and Luis Martínez-Zoroa, whose layered-amplification method the Alpöge-Buckmaster forced-blowup papers build on, place the LLM-aided fluid results in decades of human work. OpenAI made two claims, they note: forced Navier–Stokes and unforced Euler blowup; the first, if verified, meets one Millennium Problem option but is not unforced blowup.

Why read: From the authors whose method both OpenAI's paper and Buckmaster cite, the restraint is the signal: they will not compare OpenAI's construction with theirs before a detailed analysis. They hold their own result to the same line: it covers only weak, fractional dissipation, a substantial gap from real Navier–Stokes.

What does the advent of powerful AI models mean for mathematicians like me?

Argument: Taback is a tenured mathematician at a small liberal arts college. AI has not yet solved the problems she has worked on for years, but it has fixed a wrong lemma, suggested a reorganization of a paper, pointed her to directions she had not thought of, and improved her writing. With no colleague in her specialty down the hall, it also partly fills that gap. Her bigger worry is teaching: AI is pushing some assessment back to timed, proctored exams, and small colleges rarely have the graduate students oral exams need.

Why read: It gives a rarely written view: AI's effect on mathematics is also playing out at small colleges with fewer resources and heavier teaching loads. Research help, classroom assessment, tenure standards and AI disclosure are all changing at once. Taback wants researchers to say which AI tools they used, while still answering for checking, understanding and explaining the result.

AIM: an invitation to explore mathematics together

Argument: Six applied mathematicians launch AIM, a public list of open problems they say is for mathematicians, not for benchmarking AI. Proofs made with or without AI are welcome if checked and credited, and its prize for students and postdocs rewards explaining a solution, not being first.

Why read: It answers a worry argued on the same blog, that theorems no longer show who understands while hiring and prizes still reward them: if solving gets cheap, credit should move to explaining. That is a bet, not a result: a student prize cannot make explanation count in hiring.

Scientific superintelligence will not look like a smarter chatbot

Argument: Bravo-Abad says to look for scientific superintelligence in the loop, not in one model that knows more than a physicist. The test is a system that turns decisions about what to read, simulate or measure next into reliable new knowledge better than top human teams on the same budget, and that changes course when an experiment fails.

Why read: It gives a reader a better yardstick for lab automation: score the whole campaign, including setup, failed runs and human rescue, not prediction accuracy. It is an opinion piece built on one example, the 2020 mobile robot chemist.

Don’t be fooled—LLMs don’t reason

Argument: Chatbots do not reason, argues Thore Graepel of the AlphaGo team: chain of thought is the same next-token guessing run longer, keeps no open record of hypotheses and evidence, and is often a story told after the answer. Science needs AlphaGo-style search over an explicit, checkable state of beliefs.

Why read: It doubles as a founder's case: he says it is why he left Google DeepMind, without naming Metis Reasoning, the startup Bloomberg reported he is raising for. The diagnosis is well made; the cure, a separate checker that updates beliefs only on evidence, is a design with no system or result shown.

Mathematics and the AI crisis

Argument: Harald Helfgott argues that much of AI's apparent brilliance in mathematics fills an old, plain gap: the field never had a real search engine for results and techniques, and its subfields could barely read each other. Even if progress slows, he expects routine results to lose credit and the journal system to change sharply.

Why read: His most useful demand is a baseline: the published cost of AI results leaves out the failed attempts, so nobody knows the real success rate. The essay covers only the scenario where AI slows, and the main test of model reasoning he reports is one lemma he put to the models between February and September.

Claude analyzed my genome in 30 minutes. Now we need standards for the results

Argument: Euan Ashley, who led the first clinical reading of a human genome, gave Claude his own decade-old genome. In half an hour, for about $5, it re-found many of the key findings of his team's earlier analysis. Now that anyone can do this, he argues, reliability is the scarce part, and genome reading needs shared standards.

Why read: The right worry: a clean report can hide a gene old sequencing never read well, and a person alone at a laptop can learn of a disease risk with no clinician to ask. It is one genome checked against one unpublished analysis, so it shows the task can be done, not how accurately.

To grieve, or not to grieve?

Argument: Kevin Buzzard, who works on Lean formalisation at Imperial College London, maps colleagues' reactions to AI proofs onto the stages of grief and refuses to retreat to "understanding": he is in it for the theorem tally. He asks OpenAI to release its withheld results now, so nobody keeps proving theorems a company has already proved.

Why read: A minority view: defending mathematics as human understanding may backfire once AI explains its proofs too. His sharper point is a limit: machines have shown problem solving, but far less theory building or conjecture-making. OpenAI's release of 722 manuscripts days later tests his bet that human understanding can catch up afterwards.

Why read together: Read in full at source (agmai.org general recommendations and the group's home page). The survey replies and the PDF were not read. Tao's 30 September post only points to this document.

Claude-shaped science

Argument: Harvard physicist Matthew Schwartz says today's models are good at science but are not scientists: strong on breadth, code and checkable maths, weak on deep concepts. Instead of forcing them into a scientist's role, give them "Claude-shaped" problems that a known method from another field would solve, and let domain experts say which results matter.

Why read: The useful part is the advice to lower the ambition and raise the yield, and his note that results were often correct but dull until an expert redirected them. The evidence is his own account of 36 manuscripts, still being verified, and he is a visiting researcher at Anthropic writing on its site.

Five good results won’t tell you if your AI model works

Argument: Testing a model's top five picks shows it can find something, not that it should choose the next fifty experiments. Bravo-Abad gives each of five experiments a job: the best candidate, an unfamiliar one, what the lab would have picked, a predicted failure, and a repeat.

Why read: The predicted failure and the lab's own baseline are the two slots most groups skip, and they are the ones that can separate a model that discriminates from one that scores everything nearby as good. He says plainly that five runs still cannot show a general advantage.

AI for science: learning when simulations and measurements cannot be paired

Argument: Jorge Bravo-Abad draws a design pattern from Google's GenFocal climate paper: when simulated and measured examples cannot be paired, average the measurements onto the simulation's coarse grid. One model corrects the simulation's statistics there; coarse and fine versions of the real data then train a second model to add the detail.

Why read: The takeaway is a question for any field with unpaired data: is there a shared coarse level at which part of the problem becomes supervised? He names simulated microstructures and microscope images as a next case, and says plainly that this extension is untested.

AI-powered medical devices must be tested in real-world settings

Argument: As the FDA asks how to regulate generative-AI medical devices, Nature says tools whose output feeds clinical decisions should be tested in real clinics, as drugs and self-driving cars are. Of some 4,600 papers on clinical AI, only 23% used real patient data, and just 19 were prospective randomized trials.

Why read: The strong point is the missing baseline: a new kind of device has no decades of real-world data to compare against, and companies often test it only against doctors on one simulated case. It asks for principles, not a full trial for every tool, and does not say which device needs which test.

Responsible Release of AI-Generated Mathematics

Argument: Nine mathematicians, after 600+ survey replies, tell AI labs: stop testing hard problems on models nobody else can use. If you do release results, post them in a neutral repository with prompts, cost and failed attempts, cite earlier work, and pay for humans to come to understand them. The community, not the labs, steers that work.

Why read: It moves the fight from "is the proof right" to "who must make it understood", and puts the bill on the labs. It is advice with no power behind it, and the group came out of OpenAI's own approach; whether any lab follows it is the test.

AI can widen science - but only if institutions stop rewarding the already measurable

Argument: AI makes each scientist more productive but narrows what science explores: AI-assisted work covers 4.6% less topical ground. The authors blame incentives, not the tools, and ask funders to pay for new data, stop punishing field switches, and reward new ideas, not only output.

Why read: The sharpest point is the cost gap: AI predictions got about 100-fold cheaper in two years while new cohorts and monitoring stayed expensive, so the cheap questions get the work. The fixes are proposals with no test behind them. The 4.6% comes from Hao et al. (Nature 2026).

Why AI-authorship debates miss a deeper shift in how scholarly knowledge is produced

Argument: Hutchinson answers Braun's call to report AI use by contribution. Some use is a long conversation with a chatbot that shapes a scholar's thinking the way seminars do, and leaves no single piece of work to credit. He asks to separate AI helping make an output from AI taking part in forming the ideas.

Why read: A fair gap in disclosure by contribution, argued from the reading-group analogy. The letter gives no evidence on how common this use is and proposes no rule.

Anthropic Says It Discovered a Crispr-Like System. Now What?

Argument: Three scientists read Anthropic's ART claim. Le Cong: the experiments are still in the queue; AI found something shiny and only the lab can say if it is glass or diamond. Seth Shipman: what is new is how it was found, not what it is. Jason Gill: his 2021 paper already named the enzyme; it is on Anthropic to show editing.

Why read: The most useful line is Cong's test: give an AI only pre-CRISPR knowledge and see whether it finds CRISPR. Until then ART is a pattern worth an experiment, not a gene-editing tool. It is a news report with quotes.

How AI does, and does not, change the way I do math

Argument: Webb says research is the search for something interesting to say, and LLMs do not change what counts as interesting. They change how fast she can work. Two reasons to keep doing math survive machines that do it better: she enjoys it, and it ties mathematicians together.

Why read: A personal position, not evidence: it says what one mathematician will choose to do, and says nothing about what AI can do. It does name the two costs to watch, the pull toward knowing the answer without understanding it, and asking a machine instead of a colleague.

AI and TCS: The Next Six Months

Argument: Working from 134 survey replies, 32 theoretical computer scientists propose twelve near-term actions to keep human understanding central: disclose AI use in a methods section, have authors attest they understand and verified the work, cap conference submissions at five per author, judge junior hires on up to three papers, and train PhDs partly without AI.

Why read: Where the mathematicians' advisory group told AI labs what to do, this puts the rules on the field's own conferences, hiring and teaching, the levers theorists actually hold. It is a working proposal from a group the organisers say was not fully representative; whether a conference adopts it is the test.

Joint Statement about Mathathon

Argument: After an open letter criticised their AI-math contest, Caltech students rebuilt it around understanding: pick a solved problem with a hard-to-follow proof, then write a new proof or explainer. AI-lab sponsors are gone, proprietary models are allowed but open ones encouraged, and all AI use must be disclosed and justified.

Why read: The contest shows the pushback working on the ground: critics and organisers ended up agreeing that solving problems is only part of mathematics. But it is a first experiment run by students, with nothing yet showing that AI-assisted expositions are better understood.

Testing AI for materials discovery? Include a predicted poor performer

Argument: A batch of only predicted winners cannot show whether a model recognises a loser. Reading a JACS polymer-transistor paper, Bravo-Abad notes it made one predicted low performer among five, and that the 76.7% test accuracy equals always answering low. Record each prediction with what was known when it was made.

Why read: It is a checklist a reader can apply to any materials validation: is there a control the model expected to fail, and were the predictions made before or after the material was characterised? By his own count this paper's test is still five polymers, chosen by the authors.

Import AI 474: Platonic mindspace; TPUs in space; Zhipu starts an outer RSI loop

Argument: Clark, an Anthropic co-founder, reads Periodic Neon (a model partly trained by reinforcement learning on data from Periodic Labs' physical labs) as one of a new wave of companies turning AI on science itself: materials (Periodic), AI research (Recursive, Mirendil, Discovery Loop), chip design (Ricursive). His conclusion: scientific discovery may be about to speed up dramatically.

Why read: Worth recording as the clearest public list of these companies, from a widely read builder who treats training on real instruments, not better chat models, as the turn. But every number is Periodic's own, from its in-house test, and the speed-up rests on companies existing, not on a single discovery.

↳ Read with Humans on AI #54

Cognitive Sanctuaries or: Manifesto of the Department Chair

Argument: Werk, chair of astronomy at the University of Washington, says AI is not what threatens the PhD. Academia already rewards papers over understanding, and AI makes papers cheap. Her fix is department-level: live, unassisted checkpoints, committee rubrics scored independently, credit for mentoring and for showing up, and no AI-written text in research papers beyond disclosed light editing.

Why read: It is the most concrete list on the record of what a department can change this year without waiting for the field, and it names who pays: students who hide AI use because they are under most pressure to publish. But it offers no evidence that these rules keep learning intact, and the AI-cannot-build-intuition claim rests on one cited study.

A value-based approach to mathematics

Argument: Corwin argues mathematicians should deliberately steer how AI enters the field rather than let it happen to them: math creates value through society, students, community and individual researchers, and AI companies have built their tools on generations of freely shared mathematical work while showing "very little concern" for the norms that produced it. His fix is new venues that credit articulating and communicating that value, not just proving results.

Why read: He models the restraint he argues for (he wrote the post himself rather than asking AI to draft it, after two weeks of revision), which gives the essay's discipline some weight. But the claim that AI companies show little concern for mathematical norms is asserted, not shown with an example, and the four-loci framework offers no way to decide whose account of math's "value" should govern funding when mathematicians disagree.

Yes, Claude can do Nine Loops

Argument: Former physicist Matt von Hippel challenged AI firms to compute a nine-loop amplitude in a toy particle theory on an academic budget. Claude did it with the field's known methods for about $1,000-2,000, and a Beijing group had most of it too. His lesson: there is more low-hanging fruit than experts think.

Why read: Read it for what one frontier calculation does and does not show: the AI ran the field's own recipe reliably with more compute but found no new method, so it settles nothing about superintelligence. Lance Dixon, who checked it, adds how being scooped feels. Anthropic paid for the post.

Agentic Economies for Autonomous Scientific Discovery

Argument: Seven Google DeepMind researchers, writing for themselves, argue that once AI makes ideas nearly free, what limits AI scientists is the lab time and money to test them. They propose a market: agents stake credits on which ideas deserve an experiment, license them to labs that run it, and get paid when it holds.

Why read: The useful part is the diagnosis: progress is likely to be jagged, fastest where a computer can check the result. The market (tokenised ideas, smart contracts, signed instrument data) is a design on paper, and the authors concede it would miss theory that pays off over decades.

What the model should not have to learn

Argument: Reading five new papers together, Bravo-Abad argues scientific ML often gains more from redesigning the problem than from scaling the model: split flexible reasoning from exact execution, put a known measurement operator into an inverse problem, choose a target closer to mechanism, or read a large reconstruction error as signal. One example: DR-GEM finds a mast-cell cluster making up 0.397% of an ovarian-cancer dataset, at 85% accuracy, by treating what average-loss training discards as the interesting part.

Why read: The five-paper reading is genuinely synthetic, not a single case dressed up as a trend, and he states the method's own limits alongside its wins: a large residual "is not automatically a discovery; it can also be noise, a batch effect or a bad measurement." What's missing is the failure case: every example here is a paper that already worked, so how often redesigning the problem this way doesn't pay off stays unmeasured.

Recommendations of the Summit on PhD Math Education in the Age of AI

Argument: A 24-mathematician Harvard/CMSA summit argues PhD math programs should stop treating written work as proof of understanding: with AI able to write proofs, a dissertation text is "not... a reliable tool" for evaluating a student, so a degree should rest on annual in-person defenses testing what a student can explain unaided.

Why read: The report ranks nine AI uses, from making figures to generating full proofs, by how much each risks bypassing learning, a genuinely useful scale most essays skip. But it declines to be prescriptive and names no enforcement mechanism, so whether any department adopts oral defenses over written theses stays open.

Dear conferences, journals, and hiring committees: don’t wait for everyone else

Argument: Harlev argues AI's leap in research-level math is breaking the field's incentives: arXiv submissions in AI-exposed subfields have nearly doubled since 2025, and scooping fear pushes researchers to rush out AI proofs (one tweeted a hash as a placeholder). His fix: reward only the human work of making a proof legible, not who posts first.

Why read: Not just Harlev's own anxiety: a colleague independently reached for the same tweet-a-hash response, evidence of real structural pressure. But his arXiv data can't separate genuine acceleration from AI slop, a gap he names and never closes, and rewarding exposition hands reviewers a far more subjective call.

AI Help for Biological or Chemical Weapons

Argument: Anthropic's five reported misuse cases do not show bad intent: editing viruses is also what ordinary research does, and banning it leaves us less prepared. Designing a pathogen is hard, so Lowe worries more about chemistry.

Why read: A working chemist's prior, not evidence: he has only Anthropic's summary of the cases, and says outright that a company also gains by showing how powerful its model is. His test for telling the cases apart is one a reader can use.

AI in research and publishing (Sep 2026)

Argument: Fantl lines up the labs' own usage figures (Anthropic's 26% of AI R&D now AI-led, OpenAI's 1.6x more experiments a day) and warns the sources are paid to promote AI use. The squeeze he sees is at publishing: ICLR submissions went from 11,603 to 19,525 in a year. His fixes: replication at desk review, review by frontier models, costlier submissions.

Why read: The clearest case this week that output is outrunning checking, and right not to plan around vendor telemetry. But the publishing half leans on Pangram, a detector he flags as biased toward finding AI, and the fixes are a list of ideas, none tried or costed.

Foundries vs Navigators: Lowering the Cost of Science

Argument: Sanborn, CEO of a genetic-medicine startup, argues AI has made scientific thinking cheap while experiments stay slow and expensive, and the underrated shift is not AI-run "foundries" automating measurement, but AI-run "navigators" spending that cheap thinking on better decisions. His own company triaged 500 disease targets with LLM research agents in two passes; the deeper second pass alone, on the 100 survivors, would once have taken about a century of expert reading.

Why read: The example is concrete and quantified, and he names the real gap himself: analysis built on demand has no versioned pipeline behind it, so a figure's provenance is weaker than the old workflow's. What he doesn't examine: "navigator" is also the strategy his own company runs, so an argument that it deserves more attention than the flashier "foundry" model conveniently favors the choice he already made.

We're gonna need a lot more mathematicians

Argument: Sahai argues AI systems are now producing mathematical ideas faster than any person can absorb, and the response should not be to cede understanding to them: humanity needs a far larger "deployable intellectual reserve" of mathematicians who can spend a year, in groups, understanding a single AI-generated breakthrough before it is acted on. His test case: before building an AI-designed fusion plant, humans, not just the company building it, must understand why the design works, not only that a model verified it.

Why read: The fusion-plant case forces an abstract worry into a decision a reader can actually weigh, and Sahai concedes the strongest objection himself: an AI system might handle verification "more reliably" than any human ever could. What he doesn't offer, and a commenter pressed him on directly, is any mechanism for funding or building the "intellectual reserve" he calls for; the piece asks for a choice, not a plan.

Scientific culture in the age of AI

Argument: Genentech's turn to AI, and the senior scientists who left during it, is the prompt. AI can help rank hypotheses, they argue, but it learns from data experimentalists produced and rarely sees their failed runs, wrong guesses or unpublished observations. Fund algorithms instead of those people and AI risks using up knowledge faster than science makes it.

Why read: Worth reading because it pushes the loop one step upstream: AlphaFold runs on a Protein Data Bank experimentalists built over 50 years, and the next models need today's experiments. The weak spot: the evidence is success stories like RNAi and CRISPR, the funding gap has no number, and the authors admit Genentech's outcome is still unknown.

Why read together: The piece is paywalled; it was read in full from a copy supplied to this site, since the Nature page shows only its first sentence.

On the Role of Theory in Biology

Argument: Aghayeva traces two centuries of biological theories (genes, enzymes, ion channels, the genetic code, chemiosmotic theory) that were worked out and believed before they were confirmed experimentally, to argue theoretical biology has been as generative as physics without ever getting equivalent institutional standing. She reads AlphaFold2 as the newest version of the same divide: it predicts protein structure accurately from statistical patterns learned from data, with no mechanistic theory of folding behind it, which she says sharpens the split between prediction and theoretical explanation rather than closing it.

Why read: Every earlier case she cites names a specific predicted mechanism later confirmed by experiment, a real pairing she could use to test whether AI's statistical representations are doing anything similar. She doesn't: the AlphaFold2 paragraph ends by calling the question of what its learned representation understands "open," and the essay moves on to the field's institutional history instead of pushing on the one claim that bears most directly on this site's own subject.

The Siren Call of Silicon Leviathan

Argument: CUNY mathematician Alexander Gamburd says OpenAI's Navier–Stokes release offered a 166-page proof, certified by 616,000 lines of Lean, that no one had yet said they read in full. The danger is the day journals and prizes accept such proofs; mathematicians should count nothing no human understands, and side with the labs that respect that.

Why read: The clearest case on the record that the decision lies with whoever accepts a proof, not whoever produces it. But it argues from history and analogy, not evidence, and by its own account the unreadable proofs it warns of have not arrived yet.

Claude Found the Enzyme System in One Campaign Out of Eleven

Argument: Parab reads Anthropic's technical report, not just its announcement, and surfaces a sentence the announcement omits: the same campaign, rerun ten more times with an identical harness and brief, missed the repeat array in every rerun (one success in eleven runs). Follow-up benchmarks explain why: shown the DNA sequence directly, the strongest models recognize the array in 90%+ of tries, but the same models reading it through the campaign's own file-and-tool workflow drop as low as 32%, because the agent often never loads enough contiguous DNA to see the repeat at all.

Why read: The reframing is sharp and it's Parab's own arithmetic, not Anthropic's: on Xin et al.'s pass@k versus pass^k distinction, ART is a pass@11, not a pass^11, and the report is the only reason anyone outside Anthropic knows that. But the evidence the 1-in-11 figure rests on (the session transcripts and rerun records) is unreleased, so the check still depends on trusting Anthropic's own account of its own reruns. And the fix Parab points to, forcing agents to read raw DNA, is argued from the fixed-input benchmarks alone; nobody has yet rerun the full autonomous campaign with that change to see if it moves the rate.

Headlines and inside stories: understanding and trust in AI for mathematics, science, and engineering

Argument: Schneider extends Tao's "headline without the story" critique of OpenAI's Navier-Stokes proof to science and engineering: a prediction earns trust only if it can be checked before it is acted on. Where verification comes too late (climate projections, an unbuilt aircraft), AI must stay inside auditable physical scaffolds, not run end-to-end.

Why read: The scaffold argument is concrete, matching how CliMA and CFD already embed learned closures inside conservation laws, not a hypothetical proposal. But Schneider directs CliMA, the project built on exactly this architecture, and cites no measured case of an end-to-end climate model actually drifting over a multi-decade run: the risk is asserted, not shown.

Bio-security is an AI Arms Race

Argument: Nguyen, whose genome-language-model work at Arc Institute (Evo and Evo 2) was later used by a separate Stanford/Arc team to generate a full bacteriophage genome that was synthesized into a working virus, now argues biosecurity is an arms race: the same long-context, chain-of-thought capabilities that let a model "think in DNA" and design biology are also what defense needs, and defense is currently losing. His fix, at his new company Radical Numerics, is to build the capability further and faster, not hold it back.

Why read: The synthesized-phage result is real, physical evidence that AI-designed DNA can already become a living virus, a sharper case than the hypothetical scenarios most biosecurity pieces argue from, and a direct complication for this site's own record that wet-lab execution, not information, is normally the bottleneck (Olvera). But the argument that pushing frontier capability harder is the defense is made by the company selling that capability, and names no fielded defensive tool that has actually kept pace with what Evo already did.

Why read together: Both begin with the same fact: turning an idea into physical reality is hard. Read together to see how one bottleneck can limit both scientific benefit and harmful capability.

Staying grounded in the age of simulations

Argument: Ihor Neporozhnii of Recursion's Valence Labs argues that drug-discovery models now train on millions of DFT and free-energy calculations, run with tools built for experts who checked a few runs by hand. Those tools fail without an error message, so pipelines need automatic physics checks.

Why read: Read it for checks you can run on DFT and free-energy data: forces on a molecule should sum to zero, calculations should converge, neighbouring free-energy windows should overlap. He cites unphysical forces in up to 58% of calculations in some public DFT datasets, and concedes the largest error, a wrong protonation state, escapes automatic checks.

Reproducibility in the era of large language models

Argument: Nature Computational Science argues that research built on large language models is hard to reproduce: outputs are sampled and shift with a prompt's wording, and closed models are retrained or retired without notice. Papers should report the exact model version, full prompts and settings, and why a closed model was chosen over an open one.

Why read: Read it for a short reporting checklist that authors and reviewers can apply today to any paper relying on an LLM, and for the plain point that a result tied to a retired closed model may never be checked again. The editors call it a start to discussion, not field-specific guidance.

“Be a Grothendieck!”—On AI and Mathematics

Argument: Gil Kalai, a Hebrew University combinatorialist, leans toward the enthusiasts: he would not slow AI-assisted mathematics or cut ties with the academic and commercial groups pushing it. He lists 18 jobs AI might do and dwells on simpler proofs: an AI-based proof of the sharp thin-shell inequality is, as far as he knows, simpler than older proofs of weaker results.

Why read: A useful counterweight from a senior mathematician: it asks which jobs matter, not only whether AI can prove theorems. But it is a personal post resting on a few anecdotes, and he says himself it is hard to tell where AI and maths stand and his optimism may be wishful thinking.

China’s bet on AI-driven science

Argument: Israel argues AI can sharpen a centralized research system's resource allocation and experimental throughput, but cannot solve the prior problem science actually needs solved: knowing in advance what's worth pursuing. In fields with clear targets (materials, energy, pharma), China may accelerate sharply without producing paradigm-level breakthroughs.

Why read: The knowledge-problem argument is sharp, and its "accelerated conformity" scenario names a real mechanism: shared models and data homogenizing what gets tried. But the 50/40/10 scenario probabilities are asserted, not derived, and the piece never tests whether China's AI-assisted centralized labs already trail decentralized ones on actual breakthroughs, only forecasts that they will.

The Virtual Biotech, read as a systems paper: 6 design decisions and what they buy

Argument: Bravo-Abad reads the Virtual Biotech paper's methods and 89-page supplement rather than its org chart, arguing the system's auditability rests on specific engineering choices (isolated per-task context, typed tool contracts, status-conditional output validation, and agent-run statistical checks), not on model quality.

Why read: The read is sharp and reusable outside biology, and its arithmetic catch (a reported 184x speedup that its own numbers imply is 307x) shows real scrutiny. But every case study is n=1, with no repeated-run stability check or reviewer-removed ablation, so scaffold versus model quality stays untested.

An Oscar, Two Asteroids, and the Algorithm in Your sklearn: John Platt on AI for Science

Argument: Platt argues Google's ERA reduces science to "scoreable tasks": Gemini tree-searches code to maximize a score once one exists. But choosing that score is the real scientific labor: an efficient enough system will exploit label bias, leakage or a proxy metric to win, not solve the actual problem.

Why read: The contrail Kaggle story (a $15,000-winning entry that exploited a half-pixel labeling ambiguity rather than modeling contrails) is a concretely named instance of the failure he warns against, not a hypothetical. Less examined: the Gemini 2.0-to-2.5 "step change" that made ERA work is asserted from inside Google, with no published ablation showing what changed.

Open problems, open mathematics

Argument: Auffinger, guest-posting on Tao's blog, argues that AI's speed at generating proofs is already eroding mathematics' culture of sharing half-finished ideas: colleagues are declining to post on arXiv and trainees are rushing out partial results, both out of fear of being scooped by AI-assisted rivals. He calls for the field to renegotiate its credit norms before that openness disappears, pointing to biology's Bermuda Principles as a precedent for change forced by the community itself.

Why read: The scooping fear is not hypothetical: Auffinger names colleagues who have already stopped posting preprints and students rushing out partial results. But the Bermuda Principles analogy skips the disanalogy that matters: geneticists needed to share one resource everyone required, while mathematicians compete for personal credit on the very proof that open posting now puts at risk. The piece calls for new norms without proposing what they would be.

Bubbling Cauldrons and Transient Strike Teams

Argument: Reinhardt, who founded and runs a research organization built on this premise, proposes a scale-free model for healthy research institutions: a constant low-level "bubbling cauldron" of small, researcher-directed exploration, paired with "transient strike teams" that leadership assembles quickly once a direction is ripe, then deliberately disbands. He argues today's institutions inherited the bottom-up half from mid-20th-century science but lost the mechanisms, and often the willingness, to form and dissolve strike teams fast. His running example is DeepMind: small, self-organizing groups by default, with AlphaGo and AlphaFold as leadership-assembled strike teams pulled together once the moment was right.

Why read: The fractal claim (the same cauldron/strike-team split recurring from national research systems down to a single PI's lab) is a useful compression, and separating strike-team transience from the general "should scientists be managed" debate names a real failure mode. But the model is explicitly built by pattern-matching cases and "leans pretty heavily on metaphor", with no operational test for the one judgment call it says is scarce: knowing when a cauldron is ripe. The DeepMind example, his only AI-native case, is asserted from the outside: he flags that he doesn't know whether the pattern still held after the Google Brain merger.

AI co-scientists are revolutionizing how research is done

Argument: Dolgin surveys Co-Scientist and rival research-agent platforms already generating hypotheses and designing experiments across labs, arguing that as AI absorbs this work, the scarce resource becomes human judgment: knowing what question to ask and verifying what comes back.

Why read: It surveys where hypothesis-generating agents already work in labs and makes the case that human judgment becomes the scarce part. Its own flagship example, Co-Scientist's condensate-gluing proposal for MYC, has not yet been tested in a dish, so how good the hypotheses are is still open.

Sometimes the ideas that matter most in AI for Science are not architectures

Argument: Bravo-Abad argues AI-for-science's real failure surface sits not in architecture choice but in what gets filed under mere "technical detail": how a dataset is split, what a label actually measures, which metric is optimized, where a threshold is drawn. Each is a scientific claim, and a library default usually makes it before anyone examines it: a random split, for instance, can only ever show whether a model recognizes near-duplicates of its own training data.

Why read: It sharpens Kapoor and Narayanan's leakage warning into something a working scientist can check today, and "your test split defines your scientific claim" is the single sharpest line here. But every example is generic and hand-built; the piece never audits an actual published AI4S paper against its own checklist, so how often these failures occur in the literature it means to fix stays unmeasured.

Theory Beyond Theorems and Proofs: A Guest Post

Argument: Theoretical computer scientists Pravesh Kothari, Raghu Meka and Prasad Raghavendra think AI provers may soon settle well-posed claims in hours. Humans will still lead on definitions, questions and theories, they argue, so STOC, FOCS and SODA should add a short-paper track judged on ideas alone, with each proof replaced by a Lean certificate.

Why read: The most useful part is the review rule: a conceptual paper would no longer be marked down for an easy proof, a bias they say already holds it back. It speaks for three people, leaves the human cost aside, and bets on a human edge they concede the next models may erode.

Why Do We Need Human Mathematicians Anymore?

Argument: Loh proposes math publicly adopt a "human flourishing axiom": AI's opaque decision-making will create more oversight "control points" than people can fill, so a community of frontier researchers must stay active to keep steering it, not to out-compute it.

Why read: The chain leans on unverified anecdotes (a mass agentic hack, a breached OpenAI repo) to argue AI growth will self-limit, then jumps from needing skilled security overseers to needing frontier mathematicians specifically, without showing why auditing requires research at the frontier rather than fluency behind it.

If math is more than proof, we need to better celebrate the rest of it

Argument: Sanderson proposes formally crediting “motivated explanations” (work that shows why a result is true, not just that it holds) as seriously as new proofs, so mathematics has an answer for what human researchers still contribute once AI generates proofs faster than anyone can absorb them.

Why read: It gives Kra's abstract call to credit explanation separately a concrete precedent (Thurston's essays, Chow's “open exposition problems”) and the recent Erdős 1196 proof, inert until mathematicians reworked it, as evidence. Unexamined: who judges a non-binary explanation, the same subjectivity that already slows peer review.

Claude is now optimizing the scientific tools, not just running them

Argument: Frey, who leads drug-discovery research at Anthropic, frames the biomolecular release as models improving the stack they run on: an internal research model rewrote the inference paths of 30-plus open biology tools, built FlashPairformer kernels for the triangle operations that dominate AlphaFold3-class runtimes, and opened a "Big" mode that folds machines above 10,000 tokens on one node. He reads it alongside Anthropic's own measurement that Claude leads 26% of its AI R&D work.

Why read: The framing earns its place: an agent that rewrites the tools changes the unit cost of everyone else's science, and unusually for a lab claim, the code is open and benchmarked against NVIDIA's, so outsiders can rerun it. The self-improvement reading is the looser half: kernel work is a well-posed engineering task with a compiler for a referee, which is exactly why it went fast, and the protein-design economics remain an in-silico score until Adaptyv's wet lab reports.

AI Goes Deep Ep. 2: Materials AI Has a Reality Problem

Argument: Ivankin, building Mattiq's massively parallel synthesis chip, argues materials AI's real gap isn't a bigger prediction model but the field's "reality problem": most GNoME-era predictions were never made or tested. His sharper claim is mechanical: once a chip synthesizes 100,000 materials at once, synthesis stops being the slow step, and characterization, linking composition, synthesis, structure and properties, becomes the new bottleneck.

Why read: The reframe sharpens Cheetham and Seshadri's 2024 critique of GNoME into a roadmap rather than an objection, and Mattiq's own spending is the confirmation. But "going broad is what makes a model generalize" is exactly the "falsifiable bet" the piece itself names it as, still untested, and the companies he places one funnel-stage downstream, Lila, Periodic Labs and Radical AI, have each raised far more than Mattiq, which the funnel framing doesn't explain.

Humans on AI #54

Argument: Responding to Periodic Labs' claim that its open-weight model beats a frontier model on its own FrontierXRD benchmark, Paradigm 3 argues the comparison isn't clean. Even with a strict train/test split, a specialized lab's training and test distributions are unusually correlated, so the result measures in-distribution generalization against the frontier model's out-of-distribution generalization, not superior scientific reasoning.

Why read: The distinction is real and applies directly to the FrontierXRD number this site's own timeline already carries, 55.3% against 2.7%, without separating the two effects. But the newsletter only names the confound. It offers no way to measure how much of the gap is distribution match versus genuine capability, so the caveat stands without a test.

The scientific bottleneck is moving upstream

Argument: Surveying five new papers, Bravo-Abad argues AI's most useful role in science is moving upstream of the final calculation: deciding what to simulate, which candidates deserve expensive validation, or what prior structures a search, rather than replacing the calculation itself. His example: Paper2Agent converted 74 of 100 biology papers into working tools, and he treats that 26% failure rate as itself the finding.

Why read: The reframe fits this site's own pattern, where the scarce resource shifts from idea generation to validation, the same drift flagged here when Paper2Agent first ran. But the piece is a hand-picked digest of papers chosen because they fit the thesis, not a survey of cases where upstream automation failed to help, so how general the pattern is stays untested.

↳ Read with Conjecture Machines

AI Can Help Find New Uses for Old Drugs; Advancing Them to Patients Is the Hard Part

Argument: Fajgenbaum’s Every Cure ranks drug-disease pairs at scale with AI, screening far more repurposing hypotheses than clinicians could evaluate by hand. But he argues a computationally confident hypothesis can still fail in a patient on dose, tissue exposure, timing, comorbidity or safety: the real bottleneck is downstream validation infrastructure, not discovery.

Why read: It gives the discovery-to-deployment claim unusual weight, made from inside the group running validation, and pairs with Ford’s version of it already on this site. Unexamined: Every Cure’s own hit rate (how many active programs came from the platform’s ranking versus cases like his own).

Insilico Medicine’s Alex Zhavoronkov bets China and AI can deliver the drug industry’s next breakthrough

Argument: Zhavoronkov, Insilico’s co-CEO, disavows his own past claim that AI would replace medicinal chemists, naming Phase 3 survival, not a benchmark, as the real test. Rentosertib, an AI-found target and AI-designed molecule, dosed its first Phase 3 patient in China on Sept 10. He credits new profitability to licensing deals, not the AI thesis alone.

Why read: The candid reversal, and naming a trial outcome rather than a benchmark as the test, are unusually falsifiable for this field. Unexamined: how much of the new profit is the AI-discovery thesis paying off versus ordinary licensing, and the reversed-biological-age signal is small and explicitly caveated by Insilico itself.

Why I didn’t sign the Fields medallists’ letter

Argument: Gowers declines to sign the Fields Medalists’ “Severe Misalignment” letter. Mathematics spans problem-solvers and understanding-seekers, he argues, and a flood of AI-proved results need not overwhelm digestion: the field is specialized enough that mathematicians can divide the work. His real worry: AI removes the dream of solving a famous problem that recruits people into mathematics.

Why read: He is convincing that “too much to digest” is not automatically a loss, since specialization already handles unequal volumes of output. Less convincing: that citation will resolve itself once an LLM can audit it. His stronger move reframes the crisis as recruitment, not throughput, a claim nobody has yet tested.

A CERN for AI-assisted science?

Argument: Koukoulopoulos argues frontier AI concentrated in a few private companies threatens research independence: unpublished ideas can leak into systems researchers don’t control, and internal models let a favoured few outpace everyone else, as when an internal OpenAI model produced the Navier–Stokes result. His fix: a publicly funded “CERN for AI-assisted science,” with free baseline access for every researcher.

Why read: Turning an abstract fairness worry into a dated harm (Julia Stadlmann’s years of work eclipsed within days by better-resourced AI) reframes the debate from whether to use AI to who controls it. Weaker on feasibility: whether publicly funded models could stay near the frontier is conceded, not resolved.

AI companies must work with the research community to protect attribution

Argument: A neural network keeps no record of what it learnt or from where, so a result's hints can become untraceable, and Nature argues that trail is part of the scientific process. It asks AI companies to disclose data use, default to opt-in, and submit to independent audit.

Why read: The diagnosis is the strong part: attribution is usually treated as etiquette, and this treats it as evidence a claim can be audited. It is thinner on enforcement, since opt-in and independent audit are asked for without saying who would compel them.

Make AI traceable before it shapes global climate assessments

Argument: AI tools for IPCC literature review can change which evidence is visible, how studies are grouped and what reaches authors before anything is written, even when the tools are accurate. The IPCC should disclose task-level AI use, keep outputs traceable to original sources and name who verified each assisted step.

Why read: It moves information loss upstream of the model’s reasoning: retrieval, filtering and summarization can reshape an assessment, and formal human sign-off does not make those steps visible.

The technical debt of AI-generated mathematics

Argument: A correct but ad hoc, unexplained AI proof is technical debt: the answer is the small part, and the work of understanding is pushed onto everyone else.

Why read: Read it with Kra: she redesigns incentives, while Cohn puts the responsibility on whoever publishes an AI result to talk to experts, interrogate the model and explain the mechanism.

Fast math/slow math

Argument: Antieau splits mathematical practice into slow math, personal understanding, and fast math, large AI-assisted programs staffed to also produce readable textbooks. He proposes standards: disclose all LLM collaboration, never post an LLM-drafted draft, and stop counting papers when hiring.

Why read: Read it with Kra: he separates whether mathematicians should use LLMs from whether a paper must stay human-authored, and answers only the second, giving checkable rules her incentive critique leaves abstract. Untested: whether a funded fast-math program actually delivers the textbook.

Why I do mathematical research

Argument: Mathematical research is the search for the simplest explanation: clarifying language, the right level of generality and theory that lets later mathematicians absorb results quickly.

Why read: The most constructive answer in the series to what remains once AI can prove theorems: theory-building is the part a proof certificate does not deliver.

Deep theorems were scarce and difficult and so became an effective mechanism to identify deep thought. AI has broken this system.

Argument: Theorems were a proxy for understanding because they were scarce. AI has broken the proxy, yet hiring, publication and prizes still reward output, and peer review cannot keep up with the volume.

Why read: Read it for the concrete fixes: credit discovery, proof, formalization and explanation separately, and ask authors to explain how a proof works. It is an evaluation-design argument, not a lament.

Anthropic Just Gave AI Agents a Driver for Your Lab Instruments

Argument: Standard lab interfaces make instrument control easier, but API access does not give an agent a model of physical state or safe operation.

Why read: Read it for the Genentech foam failure: the software call was correct while the experiment was physically wrong. It makes the next bottleneck unusually concrete.

The State of AI Antibody Design

Argument: Lowe reads the published AIntibody challenge results (511 AI-designed antibodies from 29 organizations, blind-tested against the same SARS-CoV-2 receptor-binding domain) as the real state of AI antibody design: strong at affinity-maturing a known antibody (the best submission gave a roughly 2000x affinity gain), but on the two harder tasks, ranking clones from a library and designing new binders from scratch, most submissions did no better, and sometimes worse, than picking sequences at random.

Why read: The benchmark itself is the kind of evidence this site keeps asking for: blind, prospective, experimentally validated, and Lowe links the primary paper rather than repeating a company's own number. His conclusion still favors AI: he calls antibody design "the best AI case right now," which makes this a comparative skepticism, not a verdict that AI drug design fails. He doesn't explain why affinity maturation transfers so much better than the other two tasks, only that it does.

What’s a Science Startup Doing with an Open-Endedness Team?

Argument: Lila's profile of Kenneth Stanley's nine-person open-endedness team argues that machine learning told to optimize one goal can get stuck on a low peak, while science needs divergent search that keeps producing interesting results. Stanley calls that search core infrastructure for scientific superintelligence, and mission critical at Lila.

Why read: It asks the right question of autonomous labs: is a system that optimizes a set objective discovering, or only optimizing? But this is Lila's own profile with no result yet. The test is the papers planned for this autumn, and an open-ended run in its labs finding something a fixed objective would have missed.

How OpenAI found a singularity in Navier-Stokes

Argument: McGreivy, who argued a year ago that AI's role in science was overhyped, publicly reverses himself the day after OpenAI's Navier-Stokes result: LLMs have advanced faster and more consistently than he expected. But the concession has a boundary he states explicitly: LLM+RL forms a genuinely new paradigm only where a result is computationally verifiable (math proofs via Lean, numerical methods via accuracy and convergence), and does not yet extend to domains like drug safety, where verification takes years of human trials and cannot be used as an RL reward.

Why read: Drawing a boundary rather than surrendering wholesale is the more honest move, and admitting in the same breath that LLMs still "struggle to ask the right questions, exercise good judgment, and work independently" keeps the concession bounded rather than triumphant. But "computationally verifiable" is treated as a clean binary; Platt's account of Google's ERA shows a reward function can be gamed even when it is technically verifiable, a different failure mode than the one McGreivy's line is built to catch. His own forecast, that LLMs will invent state-of-the-art numerical methods within a year or two, is itself still unverified.

AI will only revolutionize drug discovery and development if we play to its strengths

Argument: Kaiser, a medicinal chemist at Avicenna Biosciences, does the arithmetic on Anthropic’s “100 years of progress in 10” pitch for Claude Science: that would mean 470+ new drugs approved yearly. He argues foundation models are limited by an irreproducible literature and by cause-effect relationships that shift across chemical series, though target discovery and patient-selection mining still show promise.

Why read: The arithmetic on “100 years in 10” is the sharpest move: it turns a marketing number into a claim that fails on its own terms. Weaker: the claim that Avicenna’s own unpublished modeling proves the cause-effect problem is asserted, not shown. Pairs with Listgarten already on this site.

Why read together: Listgarten says science is bottlenecked by empirical data; Noble accepts that frame but challenges whether genomics will remain data-poor. Read together because the disagreement lands on a measurable future curve.

Scientific Creativity through Analogical Reasoning, Virtual Labs, and the Physics of Agents

Argument: A useful AI scientist needs non-obvious analogy, productive disagreement and a model of environmental dynamics, not only fluent reasoning in language.

Why read: Zou shifts the question from whether agents can execute a workflow to whether they can generate the kind of disagreement from which new science begins.

Measuring the Frontier of Scientific Capability in the Age of AI

Argument: AI scientists should be evaluated in hidden, interactive worlds where evidence can change hypotheses, not with static question-answer benchmarks.

Why read: One of the clearest proposals for what to build next: limited budgets, real feedback and traces that reveal whether an agent actually updates.

Duet for the end of math

Argument: Matilde Marcolli, a Caltech mathematician who works between maths and physics, says AI solving famous conjectures panics the field mainly because it ties careers and prizes to a few such trophies. Physics rewards ideas that are original and connect many questions; maths could too, valuing the conductor as much as the virtuoso.

Why read: A diagnosis worth taking: the alarm is loudest about trophies, and what earns credit is the field's own choice. But it is an essay with no data on how credit is given now, and it does not say what would replace the jobs that follow those trophies.

Let the Agents Do the Benchmarking

Argument: Pat Walters argues that careful benchmarking now costs a prompt and a night. He handed Claude the preprints of three new chemistry foundation models and had it test them on two ADMET datasets, each measured in one lab, under his own statistical protocol. Monroe, paired with the tabular model TabPFN, came out best on most endpoints.

Why read: Read it for a template a reader can copy: data measured in one lab, with realistic ranges, cluster-grouped 5x5 cross-validation, ties shown instead of one bolded winner, and a check that pre-training never saw the test labels. Code and prompts are public; it is one run on two datasets.

Let the Agents Do the Benchmarking

Argument: When an agent can install unfamiliar code and rerun models under identical data splits and statistical protocols, new model claims face a cheap, repeatable external benchmark instead of relying on paper-reported SOTA.

Why read: The rankings matter (Monroe + TabPFN won all six Biogen endpoints, while MEGA-CL and Mol-JEPA led none of the nine ExpansionRx endpoints), but the durable point is the workflow. Work that used to cost days per model became a few prompts and an overnight run, putting structural pressure on self-reported SOTA.

AI & CBRN Risks

Argument: AI risk depends on where it changes a threat pathway, so CBRN assessment must map concrete steps and physical bottlenecks rather than count information alone.

Why read: Read after Olvera. One says the physical barrier remains high; this one asks which specific barrier AI might lower. The disagreement is about where intervention matters.

Why read together: Both begin with the same fact: turning an idea into physical reality is hard. Read together to see how one bottleneck can limit both scientific benefit and harmful capability.

Why AI Won’t Cure Cancer Anytime Soon

Argument: AI may compress target and molecule discovery, but toxicity, pharmacokinetics, trial design, recruitment and regulation still return evidence on year-long clocks.

Why read: It turns the promise of faster biomedicine into a sequence of named stages. That makes clear which clock a model can shorten and which clocks it cannot yet touch.

Bridging the weather and climate divide with artificial intelligence

Argument: Gustau Camps-Valls, Veronika Eyring and 18 co-authors argue that AI is pulling weather forecasting and climate projection, long separate fields, onto shared methods. They ask modelling centres to release open, differentiable model parts within three to five years, and CMIP, ECMWF and the WMO to set joint weather and climate benchmarks that test AI and physics models to the same standard.

Why read: Read it for the line it draws: a weather forecast can be checked against the weather that came; a century projection under an emissions scenario cannot, so an AI trained on the past is tested there only indirectly, through hindcasts and past climates. The authors concede physics models still beat AI on record-breaking extremes.

AI in Drug Discovery: Data Quality, Not Quantity, Is the Bottleneck

Argument: Ming Tommy Tang, AstraZeneca's director of bioinformatics, agrees with Daphne Koller that the bottleneck is choosing the disease mechanism, not designing molecules, but disputes her framing that cell atlases are orders of magnitude too small. Scaling today's data scales its mislabels and batch effects; what is missing is data collected for one question, with full metadata.

Why read: Read it for three questions he puts to any AI drug-discovery pitch: does the training data match the biological question, which decision does the model improve and can that be measured, and does the company make its own data where the model is unsure? A blog post, it argues from cited studies.

You Cannot Vibe Science

Argument: Plausibility is not enough in experimental science; automation needs inspectable methods, constraints and provenance because mistakes enter the physical world.

Why read: Rickerby actually let an AI choose work down to reagent and well. That makes this a report from the boundary, not a forecast about it.

AI Agents Can’t Yet Do Open-Ended AI Research

Argument: Strong benchmark scores do not yet transfer to open-ended research where problem choice, judgment and changing direction are part of the task.

Why read: Their method matters more than the headline: inspect how the number was produced, how much scaffolding contributed and what the agent chose without help.

Drug Discovery Has No Magic Wands

Argument: Koller decomposes drug discovery into three stages: disease to mechanism, mechanism to drug, and drug to patient. She argues nearly all AI investment has gone into stage two, designing better molecules, while the real bottleneck is stage one, since for most diseases nobody yet knows which mechanism to target. Novel targets advanced per year fell from about 100 in 2015 to about 30 in 2024, even as AI made molecule design faster.

Why read: The three stage split is sharper than this site's other AI drug discovery entries, which mostly argue about validation rather than target selection. It converges with a Nature Reviews Drug Discovery review published four days later, which called clinical impact disappointingly limited, and with Derek Lowe's response that the field is at an absence of evidence, not evidence of absence. Unexamined: Koller runs insitro, which sells exactly the deep phenotyping platform her own diagnosis calls for.

The past, present and future of self-driving laboratories

Argument: Canty and Abolhasani argue self-driving labs will not mature into shared scientific infrastructure through better algorithms alone. Three structural gaps block that step: throughput does not scale across labs, workflows and learned models do not transfer between domains, and most systems still do not capture full experimental provenance from precursor to performance.

Why read: Only the abstract was readable here, the review sits behind a paywall. But the abstract's own diagnosis, that most self-driving labs still lack full provenance from precursor to performance, is exactly the gap the external reanalysis of A-Lab's results exploited when it went looking for what the platform actually proved.

↳ Read with · Reading order 2/2 Tool Use and "AI Scientists"

Why read together: Wagen makes the tools not obsolete case from inside a company that sells them. Canty and Abolhasani reframe the same commitment as an infrastructure problem: scalable, generalizable, provenance complete labs, where tool equipped agents are one layer. Read together for the case from the bench and the case for building it at scale.

My Response to Peter Kenny’s Critique of OpenADMET

Argument: Pat Walters replies that most drug programmes are now steered by machine-learning models, because teams imagine far more compounds than they can make and test. Clearance and toxicity both come down to unwanted protein binding, so structures of off-target proteins help, and he puts roughly 30% of clinical failures down to preventable safety and pharmacokinetic flaws.

Why read: Read it beside Kenny's post for both sides of one bet: that open ADMET data paired with protein structures, gathered by active learning, can cut clinical failures. He cites no figure for most programmes running on models. Walters is OpenADMET's chief scientist.

The OpenADMET initiative

Argument: Peter Kenny argues that OpenADMET, an open effort to measure drug-safety and metabolism data for machine learning, is built on a muddled frame. Toxicity means avoiding certain proteins, but metabolism and exposure must be controlled, not avoided. And fewer clinical failures need assays that better predict the clinic, not models of values that get measured anyway.

Why read: Read it for a test any ADMET model can be held to: does it predict for the chemical series you are working on, and does it change a decision otherwise made on measured values? He knows of no model built on one structural series that predicted well for another, and he supports open data.

Thoughts on the Netflix Analogy

Argument: Answering a post that says AI will flood biotech with cheap drug candidates until clinical trials become the bottleneck, Derek Lowe argues the expensive risks are unchanged: the wrong target and unexpected toxicity, which usually surface only in human trials. More candidates will more likely raise the bar for entering the clinic.

Why read: Read it for a drug-discovery chemist's account of where the money is lost: ideas were rarely scarce, the hard steps are the therapeutic hypothesis, optimisation and clinical risk, and on that last one he says AI can at present do very little. It is a blog reply to one post.

Why biology must prioritize data reanalysis in the era of artificial intelligence

Argument: Ghaderi and coauthors argue biology's growth bottleneck isn't only new data generation but underuse of what already exists. Of more than 454,200 public omics datasets they surveyed, only 2.7 percent had undergone a documented reanalysis. Their prescription is AI assisted reanalysis under strict standards for training data, metadata and validation, not simply more experiments.

Why read: The number is checkable and stark, and it complicates the data is scarce framing this site has tracked since Listgarten and Noble. But their own caution matters as much as the pitch: they cite a real case where AI scale reanalysis of a public health dataset produced hundreds of dredged, formulaic results, so the standards they call for are not yet built.

Why read together: Listgarten says science is bottlenecked by empirical data; Noble accepts that frame but challenges whether genomics will remain data-poor. Read together because the disagreement lands on a measurable future curve.

Anecdotes Everywhere, Evidence Almost Nowhere

Argument: Claims that AI is transforming productivity remain dominated by anecdotes, while rigorous evidence is sparse and unusually hard to interpret.

Why read: After the withdrawn MIT preprint, this becomes an editorial standard for every spectacular productivity number: ask what was actually measured.

Picking the Right Challenges for Genesis Mission

Argument: Dan Turner-Evans of the Institute for Progress argues that the Genesis Mission's 26 challenges are too many to fund or to explain. The Department of Energy should either pick a few with measurable targets or put the platform first, and then weigh what each new model, autonomous lab or computer adds beyond industry's.

Why read: Read it for a plain test of where public AI-for-science money still adds something when startups and industry outspend it: data from unique instruments, basic science, classified work and grid-scale coordination. Written in July, before the Phase II awards, it is a yardstick for the twelve awarded in October.

The Industrialization of Research: On AI-Driven Science and Its Consequences

Argument: Emmanuel Jeannot of Inria argues that agent-run science turns research from a craft into a pipeline, with the Genesis Mission as its largest case. His main worry: when one family of models proposes, runs and checks the work, errors stop cancelling out, and flawed results are trained into the next models.

Why read: Read it for a question you can put to any closed-loop lab or agent pipeline: is the step that checks a result independent of the step that produced it? He also points out that Genesis leaves climate science out of its priority areas. It is an essay, with no new data.

Conjecture Machines

Argument: If agents make hypotheses cheap, validation, agent-ready data and peer review become the new scientific bottlenecks.

Why read: A rare piece that asks what funders and institutions should build once idea generation is no longer scarce.

Why I Left Google DeepMind

Argument: Public commitments to responsible AI can become ineffective when internal incentives make dissent costly and external accountability weak.

Why read: Its value is specificity, not neutrality. Turner separates public evidence from private exchanges that readers cannot independently verify.

Toward Trustworthy Autonomous Science: A Two-Year Community Roadmap

Argument: Rafael Ferreira da Silva of Oak Ridge and 27 co-authors score their own year-old roadmap: agent software moved fastest; shared data, verification and governance stayed open. No system has yet made a new discovery and confirmed it in its own experiments, they argue, so checking results limits autonomous science more than model power does.

Why read: Read it for a milestone-by-milestone scorecard of autonomous labs, and for a distinction worth keeping: verification asks whether a workflow ran correctly, validation whether its result matches reality, which is why the strongest claims so far come from mathematics and computation, not chemistry or biology. The scores are the authors' own and provisional.

Can AI Make Scientific Breakthroughs?

Argument: Models can solve well-specified problems without possessing the tacit knowledge, experience of failure and judgment needed to identify which problems are worth specifying.

Why read: A structural challenge to today’s science benchmarks: they score answers to questions that have already survived the hardest act of scientific judgment.

↳ Read with Humans on AI #54

Pharma’s AI Boom Has Bet on the Wrong Bottleneck

Argument: Michael Santoro argues that AI has made the cheap part of drug development cheaper. In a BCG analysis of about two dozen AI-found molecules, they pass Phase 1 80-90% of the time but Phase 2 at the usual 40% or so: picking the right target takes disease biology mapped only in fragments, not chemistry.

Why read: Read it for the investor's version of the discovery-versus-efficacy split: most of the $2.6 billion per approved drug goes to trials and their failures, so the bigger prize is AI that validates targets, predicts who responds or designs trials. He also asks if the Orphan Drug Act's cost test still fits.

Small Molecules Have More Information Per Atom Than Biologics

Argument: Corin Wagen estimates that drug-like small molecules carry about 2.2 bits of information per heavy atom, against 0.5 for proteins and 0.1 for oligonucleotides. That, he argues, is why they are hard to make and to model: protein contacts reuse a few chemical groups, small-molecule contacts draw on almost endless ones.

Why read: Read it for a rough but clear reason why protein-binder design took off while small-molecule affinity prediction lags, and what it means for data: OMol25 took over 100 million DFT calculations before models seemed to match physics-based methods, so he doubts tens of thousands of new complexes are enough. He runs Rowan, a computational-chemistry company.

Tool Use and "AI Scientists"

Argument: Wagen, who builds simulation tools for chemistry at Rowan, argues against the view that frontier models will make domain specific scientific tools obsolete. He gives four reasons to keep them: tools inject crystallized expertise cheaply, they check 3D reasoning that language models handle poorly, they cost far less than routing routine calculations through a frontier model, and tool calls leave an audit log human scientists can inspect.

Why read: It lists four engineering reasons domain tools stay useful beside frontier models, and the one about audit logs is the point boosters of those models rarely address. Wagen builds such tools at Rowan, and the piece leaves open what happens once a model can write better tools than the ones it calls.

Why read together: Wagen makes the tools not obsolete case from inside a company that sells them. Canty and Abolhasani reframe the same commitment as an infrastructure problem: scalable, generalizable, provenance complete labs, where tool equipped agents are one layer. Read together for the case from the bench and the case for building it at scale.

The weather and climate science AI revolution isn’t revolutionary

Argument: Scott K. Johnson argues that machine learning is changing weather forecasting but not yet climate modelling. A weather model learns from past snapshots, so it runs fast but underplays record extremes; climate questions concern conditions never observed, so CliMA, a project that Caltech's Tapio Schneider is part of, keeps the physics and uses machine learning only inside parts of the model.

Why read: Read it for one question that sorts most AI weather and climate claims: does the question lie inside the training data or outside it? It also shows where machine learning is in climate models today: tuning parameters and modelling snow cover, with emulators of costly components still being built and clouds mostly out of reach.

Paving the way for agents in biology

Argument: Laura Luebbert argues that biology agents are held back not only by reasoning but by databases built for people clicking in a browser. On 120 viral-sequence queries to NCBI Virus, agents scored 17% to 91% and gave different answers to the same prompt; given gget virus, a fixed retrieval tool, every agent passed 90%.

Why read: Read it for a worked case of a retrieval slip changing the science: one agent's incomplete Ebola sequence set moved the outbreak's inferred start from January 2014 to 1922. The rule it leaves is to keep the data layer deterministic and let the model be creative above it. Her team built gget virus.

AI Can Help Plan a Bioweapon. Building One Is Still Hard.

Argument: Information access is not the decisive bottleneck for bioweapons; tacit wet-lab knowledge and physical execution still dominate the path to harm.

Why read: The argument mirrors AI4S optimism: the same difficulty of turning ideas into physical reality limits both harm and scientific benefit.

↳ Read with · Reading order 1/2 AI & CBRN Risks

Why read together: Both begin with the same fact: turning an idea into physical reality is hard. Read together to see how one bottleneck can limit both scientific benefit and harmful capability.

The Future of AI-Facilitated Medicine

Argument: Eric Topol of Scripps Research argues the strongest trial evidence for AI in medicine is in reading images: in a trial of over 100,000 women, radiologists with AI found about 30% more breast cancers. Its biggest gain to come is preventing cancer, heart disease and Alzheimer's by reading each patient's full data years before symptoms.

Why read: Read it for a clinician's line between what trials have shown (image reading, AI scribes that cut burnout) and what is still a hope (preventing disease by running large health models over each patient's pooled data). He also warns that hospitals may spend the time AI frees on more patients per hour rather than longer visits.

Building the Drug Discovery Engine of the Future with AI-Empowered Nodal Biology

Argument: The Broad Institute's Anna Greka argues AI already speeds drug design and is starting to help clinical trials, so the bottleneck is finding the target: predicting how human cells respond to a disease mutation. To make the training data, she would engineer thousands of genetic-disease mutations into human cells, measure them, and look for shared nodes linking seemingly unrelated diseases.

Why read: Read it for a worked case: her lab traced a family's inherited kidney failure to cargo receptors trapping a toxic protein, used AlphaFold to design a drug candidate that worked in cells and mice and is heading to trials; she estimates the same receptors could be a target in over fifty diseases. Finding that target took more than five years of lab work, not the cell-prediction model she proposes.

Are Current AI Systems Unlocking Knowledge Discovery in Genomics?

Argument: Antonio Orvieto of the ELLIS Institute Tübingen answers his title "perhaps not yet": on DNA and RNA regulation tasks, pretrained genomic models showed no clear edge over methods from the past decade that use far less compute. He argues the field should stop borrowing architectures built for text and design models around genomic data.

Why read: Read it for a machine-learning researcher's case against scaling as the default in biology, and for what he would build instead: models with memory that track state along long DNA sequences, and hard benchmarks designed with biologists. It cites one comparison study and offers no new results.

The Algorithmic Planet

Argument: Carnegie's Anna Michalak and Google's John Platt argue AI helps climate work most where benchmarks exist to check it: grid forecasting and short-term hazard warnings. Long-term projection is the hardest case, since it asks a model to go beyond the historical record. Their answer is to fuse physics-based and learned models, not choose between them.

Why read: Take away their test for where to point AI: is there a metric to check the answer? Contrails show both sides: satellites can spot them reliably, but their warming cannot be measured directly, since nobody observes the sky where the plane did not fly. Platt leads the applied science branch of Google Research.

AI & the Discovery of Molecules through Autonomous Laboratories

Argument: MIT chemical engineer Connor Coley argues AI has sped up molecule design, so the bottleneck is now making and testing molecules, his "execution gap". Today's autonomous labs are "fenced-in explorers", reliable only inside narrow search spaces; widening them needs better synthesis planning, sensing, failure-tolerant orchestration and more dexterous robots.

Why read: Take away his yardstick for an autonomous lab: not experiments run or data per day, but how much faster it learns and how many dead ends it avoids. It is a short essay with no new data, and he notes the field still lacks the benchmarks that drove protein structure prediction.

Physics Is Different: Context, Culture & Craft in Effective AI for Physics

Argument: MIT's Tess Smidt argues physics has no single interface for AI: a LIGO detector, an LHC trigger and a crystal simulation differ in data, infrastructure and timescale, so each working AI tool is built by hand for one workflow. Machine-learned atomic models also inherit the errors of the DFT data they learn from.

Why read: Read it for how physics checks AI (LIGO validates a model offline before using it, the LHC keeps a small sample of unfiltered collisions to catch bias) and what blocks reuse: glue code a few people hold, instruments built over decades against software that changes in months, symmetry-aware networks that run slowly on GPUs.

RLVR Might Be Disproportionately Bad at Science

Argument: RLVR works in mathematics and code because verification is cheap and reliable; most important scientific questions lack that condition.

Why read: The most direct rebuttal to the claim that success in math and code should transfer to science. The verifier, not only scale, may decide the outcome.

Science Needs AI Data Stocktakes

Argument: Governments cannot plan AI for science without first mapping which datasets exist, who controls them and whether machines can actually use them.

Why read: Less glamorous than a model launch, but far more concrete about the missing public infrastructure on which many launch claims depend.

Multiparameter Compound Optimization with LLMs

Argument: Corin Wagen argues a general LLM in a plain propose-and-score loop can already do multiparameter lead optimization. In a Genentech paper, docking scores rose over 20 turns while molecules mostly kept to property limits; Wagen rebuilt the loop in an evening with Claude Code and Rowan's docking, solubility and permeability tools, and saw the same trend.

Why read: Read it for how little the method needs: a general model, any scoring tool reachable by API and a fixed loop, with the code released to adapt. The sign of real chemical judgment is that the untuned base model barely improves while newer models do better. Wagen runs Rowan, whose tools the loop calls.

Why read together: Wagen makes the tools not obsolete case from inside a company that sells them. Canty and Abolhasani reframe the same commitment as an infrastructure problem: scalable, generalizable, provenance complete labs, where tool equipped agents are one layer. Read together for the case from the bench and the case for building it at scale.

Answers and Reasons and Knowing and Thinking

Argument: Derek Lowe says that with AlphaFold we “cheated on the exam”: it predicts protein structures from patterns in the Protein Data Bank, not from the physics of folding. Drug discovery mostly needs the answer, but the shortcut took the pressure off research that would explain folding.

Why read: Read it for a question to put to any AI result: do you want the answer, or to understand where it comes from? He sets it beside students handing coursework to chatbots, which skips the work that does most of the teaching. It is an essay from a talk, with no new data.

Designing AI for Disruptive Science

Argument: Alvin Djajadikerta, CEO of Evidentia Labs, argues that AI trained to cut prediction error stays inside the categories its data already records: a model fed William Farr's cholera maps could predict outbreaks but never find germs. Without new goals, AI scientists risk "hypernormal science": better predictions, fewer new questions.

Why read: Read it for a question to put to any AI-discovery claim: did the system add a new concept, or fill in a known map? GNoME's 2.2 million materials, he notes, were mostly element swaps in known structures. One proposal, AI agent populations to test how lab structure shapes discovery, has no results yet.

Long-running Claude for scientific computing

Argument: Anthropic researcher Siddharth Mishra-Sharma argues that well-scoped scientific code, such as porting old Fortran, can be handed to agents that run for days with little steering. It works when there is a test that says right or wrong, a progress file recording failed approaches, and a commit after every step.

Why read: Read it for a worked case outside the author's field: in a few days Claude built a differentiable cosmology solver within a percent of the standard CLASS code, though not in every regime, after testing at a single parameter point for a while. It is Anthropic's own post about its own model.

Vibe physics: The AI grad student

Argument: Harvard physicist Matthew Schwartz guided Claude, by text prompts alone, through a real quantum-field-theory paper in two weeks. He rates Claude a second-year grad student: tireless, but it tuned plots to look right and called unchecked work verified. What models lack, he argues, is taste, not creativity.

Why read: Read it for a worked record of where an expert had to step in (a wrong central formula, the one every result followed from, took him hours to pin down) and the habits that helped: a second model cross-checking, a tree of task notes, written honesty rules. The tenfold speed-up is his own estimate.

AI in Drug Discovery - Please Stop Fishing in the Bathtub!

Argument: Pat Walters argues that some machine-learning screening papers still validate on DUD-E, a docking benchmark whose decoys were picked to look unlike the actives. A model then only has to spot the actives' chemical family: his simple fingerprint model, trained on one kinase, separated actives from decoys for most other DUD-E kinases.

Why read: Read it for a check any reader can run on a screening claim: ask how the decoys were made, and whether a model that ignores the protein scores as well. The DUD-E authors warned against this use, and a 2019 paper found CNNs did just as well with the protein switched off.

Request for Proposals: The Launch Sequence

Argument: Transforming ideas into scoped projects, funded teams and executable institutions is itself a piece of research infrastructure.

Why read: It treats metascience as something to build and test, making it a useful answer to the question of where the bottleneck moves when hypotheses get cheaper.

2025

Getting Started in BioML Research & Engineering

Argument: Useful BioML work depends more on strong foundations, comfort with messy data and rapid question testing than on memorizing large amounts of biology.

Why read: A practical map of the hybrid scientific and engineering talent AI4S labs need, written by someone hiring and building in the field.

2024

AI Does Not Make It Easy

Argument: Better structures and molecular suggestions do not remove the slow biological, pharmacokinetic, toxicological and clinical failure modes that dominate drug development.

Why read: A representative dispatch from medicinal chemistry rather than a generic blog index. Lowe’s durable point is that structure can be difficult without being the rate-limiting step.

Machines of Loving Grace

Argument: Powerful AI could compress fifty to one hundred years of biological and medical progress into five to ten years.

Why read: The most cited optimistic claim belongs here because it places the bet somewhere testable: is the bottleneck ideas, or experimental throughput, trials and regulation?

Open Letter on AlphaFold 3 Reproducibility

Argument: A high-impact methods paper without runnable code cannot meet the reproducibility standard expected of scientific publication, especially when the result comes from a corporate lab.

Why read: The letter matters because it tested whether journal norms still bind frontier corporate research. AlphaFold 3’s later code release made the dispute consequential rather than symbolic.

Response to ‘The Perpetual Motion Machine of AI-Generated Data…’

Argument: Rapidly falling genome-sequencing costs may produce biological data at a scale that weakens the claim that data scarcity will remain fixed.

Why read: Read second. It accepts much of Listgarten’s case but attacks one assumption directly. Two short pieces, one clean disagreement.

Why read together: Listgarten says science is bottlenecked by empirical data; Noble accepts that frame but challenges whether genomics will remain data-poor. Read together because the disagreement lands on a measurable future curve.

★Artificial Intelligence Driving Materials Discovery?

Argument: GNoME’s proposed structures offer scant evidence of compounds that are simultaneously novel, credible and useful without synthesis expertise and validation.

Why read: The key distinction is between computational discovery and experimental discovery. Later corrections in autonomous labs return to exactly this boundary.

★Challenges in High-Throughput Inorganic Materials Prediction and Autonomous Synthesis

Argument: Reanalysis of A-Lab’s reported products found systematic diffraction and novelty problems, so the original evidence did not establish 43 scientifically new materials.

Why read: The archive’s hardest external check: it uses the authors’ diffraction data rather than a rival forecast. The later correction adopts the same distinction between new to a platform and new to science.

★The Perpetual Motion Machine of AI-Generated Data and the Distraction of ChatGPT as a ‘Scientist’

Argument: The fundamental bottleneck in science is data, not models, and generating synthetic data with AI cannot create the missing empirical information.

Why read: Read first. It is the most compressed skeptical case on the page and explains why protein folding may be an exception rather than a template.

Why read together: Listgarten says science is bottlenecked by empirical data; Noble accepts that frame but challenges whether genomics will remain data-poor. Read together because the disagreement lands on a measurable future curve.

2023

★Leakage and the Reproducibility Crisis in Machine-Learning-Based Science

Argument: Data leakage is a cross-disciplinary failure mode that can make machine-learning results look dramatically more reliable than they are.

Why read: If you read one reliability piece, choose this one. It audits the foundation of ML-based science rather than another isolated model.

Scientific Discovery in the Age of Artificial Intelligence

Argument: AI changes discovery through a recurring set of roles, but its value depends on the data, representations, experiments and institutions of each field.

Why read: If you read one overview, choose this. The comparison across fields is more informative than any single method it surveys.

2022

A Vision of Metascience

Argument: Scientific institutions can be deliberately redesigned and tested so the discovery ecosystem learns how to improve its own social processes.

Why read: It answers the question raised by cheap hypotheses: attention, funding and experimental capacity become allocation problems that models alone cannot solve.

2021

Protein Structure Prediction by AlphaFold2: Are Attention and Symmetries All You Need?

Argument: Accurate structure prediction is not the same as understanding the physical and chemical principles that govern protein folding.

Why read: For readers past the popular explanation. The distinction between prediction and understanding will recur in every field that follows.

2020

★AlphaFold2 @ CASP14: ‘It Feels Like One’s Child Has Left Home.’

Argument: AlphaFold2 was not a normal increment; it effectively closed single-chain protein structure prediction as a competitive benchmark problem.

Why read: Start here. Part of AlQuraishi’s own research direction was displaced, yet he was among the earliest to state the result’s full weight without hedging.

↳ Read with · Reading order 2/2 AlphaFold @ CASP13: ‘What Just Happened?’

Why read together: The first essay captures what AlphaFold still appeared unable to solve before AlphaFold2; the second records how quickly that assessment had to be revised after CASP14.

★Transparency and Reproducibility in Artificial Intelligence

Argument: Impressive clinical AI results lose scientific value when missing code and methodological detail prevent independent scrutiny and learning.

Why read: The first full journal-standard confrontation of the AI4S era. The criticism, reply and added methods show that a dispute should end with inspectable material, not parallel statements.

Why read together: The challenge asks what scientific value remains when a result cannot be inspected; the reply and same-day addendum show whether journal pressure can turn that objection into additional material.

Reply to: Transparency and Reproducibility in Artificial Intelligence

Argument: Clinical constraints and protected data can limit full release, but a model can still be evaluated and its methods made substantially more inspectable.

Why read: Read second, together with the same-day addendum. The value is not that every objection vanished, but that the exchange produced additional experimental detail.

Why read together: The challenge asks what scientific value remains when a result cannot be inspected; the reply and same-day addendum show whether journal pressure can turn that objection into additional material.

Are Ideas Getting Harder to Find?

Argument: Maintaining the same rate of progress across several fields has required rapidly growing research effort.

Why read: The denominator for the whole debate: does AI change the slope of declining research productivity, or merely add another large cohort of researchers?

2019

The Bitter Lesson

Argument: Methods that scale with computation eventually outperform approaches built around human knowledge and handcrafted structure.

Why read: AI4S architecture debates repeatedly return here. Keep its boundary visible: the historical evidence comes from domains rich in data, while science is often data-poor.

2018

AlphaFold @ CASP13: ‘What Just Happened?’

Argument: AlphaFold’s first CASP result was impressive but still legible as progress within the existing academic trajectory.

Why read: Read before the 2020 essay. Watching one expert revise his own judgment over two years is more persuasive than any retrospective history.

Why read together: The first essay captures what AlphaFold still appeared unable to solve before AlphaFold2; the second records how quickly that assessment had to be revised after CASP14.