2608.07454-Strategy-first synthesis planning for complex natural products

Introduction to the show: ident: Paper Radio. Generated commentary on the latest Artificial Intelligence papers.

Tom: Next we'll be talking about the paper "Strategy-first synthesis planning for complex natural products".

Jane: The paper was written by Daniel Armstrong, Xuan-Vu Nguyen, Octavian Susanu, Gabriel Gibberd, Théo A. Neukomm et al. from École Polytechnique Fédérale de Lausanne and National Centre of Competence in Research Catalysis and Ghent University and University of Arizona and University of Pittsburgh.

Tom: Stay tuned as we take you through the paper and discuss its implications.

The Paper in Brief: Tom: We've spent the morning with this one, and I'll admit it's the kind of paper that makes you want to call a chemist friend and argue about it. Jane, where do we even start?

Jane: Maybe with the headline. SynthEx is a synthesis planner built from a team of language-model agents, and it completes routes for 63 point 9 percent of a benchmark of 1,098 natural products. A leading template-based planner, run near-exhaustively, only reaches 13 point 8 percent on that same set.

Lu: And that gap isn't about compute. The baseline expands tens of thousands of nodes per target and still fails. The authors argue the barrier is structural — the reaction library simply doesn't contain the disconnections these molecules need.

Tom: Right, that's the thesis. Traditional planners choose reactions from a catalogue mined out of patents, and complex natural products ask for chemistry that's too rare in patents to ever become a template. SynthEx writes each reaction directly as atom-level graph edits, in a format they call ReactionJSON, so it isn't choosing from a library at all.

Meng: The part I keep coming back to is the blinded expert study. Ten synthetic chemists rated key steps without knowing the source, and on feasibility, elegance, and overall quality, the machine steps were statistically indistinguishable from published human ones. The only detectable gap was strategic value, and even that gap was smaller than the disagreement among the raters themselves.

Jane: The chemists genuinely couldn't tell which steps were SynthEx's. The paper tells us that's a response algorithmic route prediction has never drawn before, and I'm inclined to believe it.

Lalam: And there's a public resource behind all of it — SynthAtlas, with 1,098 targets, 3,243 routes, and 33,145 atom-mapped reaction steps, released openly for chemists to browse, comment on, and argue with. That could outlive any single benchmark number in this paper.

Tom: It also frames an argument about where the field should measure itself. The old patent-derived benchmarks are saturated, and natural-product total synthesis is the frontier where capabilities actually separate. Let's go back to page one and see how they lay that out.

The First Page and Its Claims: Jane: So we've got the headline numbers and the core thesis in hand. Page one is where the paper sets up its stakes.

Tom: The author list spans EPFL, Ghent, Arizona, and Pittsburgh, and it's not decorative — the machine-learning labs and the total-synthesis groups are sitting together in the same project. That's a statement about how this kind of research has to be done.

Jane: And the abstract fires off a chain of claims. Catalogued-reaction tools report near-complete success on benchmarks drawn from those same catalogues, yet they falter on natural products, whose densely functionalized, polycyclic architectures demand the inventive chemistry the record contains least. Then comes the countermove: SynthEx proposes competing strategies, assembles a route, and critiques and repairs its own design.

Lu: The thing that sticks with me is the order of operations. The design commits to a high-level strategy before choosing any specific reactions, and then it revises reactions while keeping the strategy intact. That mirrors how expert chemists describe their own working process, which is rare for a machine system.

Meng: The abstract also previews the evidence, including that blinded assessment. Experts judged its key steps comparable to those of published human syntheses and engaged with them as genuine synthesis plans — treated them as chemistry to reason about rather than output to score.

Jane: I'd underline that sentence, because it's doing real work. Algorithmic route prediction hasn't drawn that response before, and the rest of the paper is essentially the attempt to back it up.

Tom: And it all rests on ReactionJSON — reactions as ordered atom-level edits, written by the model rather than retrieved from a library. That's the liberty that lets it leave patent space.

Lalam: The abstract also sets the evaluation stakes. They're advancing natural-product synthesis as the right test because its disconnections are, by construction, absent from reaction catalogues. Success then has to involve chemical reasoning rather than template recall, which is a much harder and more honest bar than the old benchmarks.

Jane: It sets up the architecture that follows. The next pages describe how that representation actually runs inside a multi-agent pipeline.

The Architecture: Tom: So the bet is that writing reactions as graph edits escapes the template library. Page four is where that bet becomes a machine.

Jane: The machinery is five agents, each doing one job. A Strategy Generator proposes several competing high-level strategies, each anchored on a key disconnection, three per target by default. A Route Builder then expands each strategy into a full pathway, expressing every disconnection in ReactionJSON.

Meng: And the Strategy Generator can be steered. You can hand it a required starting material or a free-text instruction from a chemist. For this paper they left it unsteered to measure the system unaided, but that input channel comes back later as a genuine strength.

Lu: ReactionJSON is the technical heart. Ten primitives — break bond, add bond, change bond order, add or remove groups, invert stereocenters, that whole family. A retro-Diels-Alder becomes two bond-order changes followed by two bond breaks. Applying those edits to the mapped product yields the precursors deterministically.

Tom: Which means the route becomes an editable object. Since every step is anchored on atom maps, the Critic and Editor can repair chemistry in place — reorder steps, insert protections, replace a disconnection — without re-running a tree search. That's something template-based planners fundamentally cannot do.

Jane: There's a nice lineage point, too. The architecture descends from Synthelite, which already used a language model as the search policy but grounded every proposal against a fixed template library. SynthEx removes that grounding step entirely, and that's the whole difference in kind.

Lalam: What impresses me is the division of labor. The Critic simulates each reaction in the forward direction and flags blocking steps. The Editor performs surgical fixes. The Analyst scores the finished route for feasibility and names its key steps and risks. It's structured like a research group, not like a scoring function.

Meng: The paper positions this against LARC and MMORF as well, which use language models as evaluators inside a traditional search. Those systems still select within a reaction space a conventional planner fixed in advance. SynthEx is the first in that lineage to write the expansions themselves.

Tom: And that, they argue, is the difference between a critic and a policy. Now the real question is whether that freedom produces chemistry that survives scrutiny — so the next pages go straight to three test cases.

Okaramine M: Jane: We've seen the machinery, but no chemistry yet. Page seven runs it headfirst at real molecules, ordered by how much external validation exists to check against.

Tom: First is Okaramine M, from the Amauromine class of alkaloids — compounds with vasodilating and anticancer activity. The setup is clever: the target is the TIPS-protected intermediate rather than the natural product itself, because the known syntheses of the Amauromines all run through it.

Lu: And here's the kicker. A route to that intermediate was published online in June 2025, after the model's documented training cutoff of January 2025. SynthEx reconstructs the expert route's strategic logic without having seen it. The key step is a tandem prenylation — a prenyl cation adds at the C3 position of an unprotected indole, and the resulting iminium is trapped by a nitrogen of the diketopiperazine.

Meng: The mechanistic detail is what impressed me. The model correctly identifies C3 as more nucleophilic than C2 on the indole, and it recognizes that TIPS protection on one indole nitrogen lowers that indole's C3 nucleophilicity — so the addition gets directed to the unprotected indole. That's genuine reasoning about reactivity, not pattern matching.

Jane: And the departure from the literature route is interesting. The published synthesis installs TIPS late, on pre-Okamauromine, which risks a mixture of mono- and bis-protected products. SynthEx protects from the very first step, which the authors argue might actually be an improvement — though they're explicit that it stands as a proposal, not a tested result.

Tom: The paper is also careful about what this case does and doesn't show. The target is the protected intermediate rather than Okaramine M itself, and recovery of the strategy was judged by inspection, not by running the reactions. Still, reconstructing the strategic logic of a route published after the cutoff is a hard test to argue with.

Lalam: And those caveats matter for how we read the whole paper. This is evidence of retrosynthetic reasoning, but nobody is claiming the route would perform exactly as written. The next case raises the stakes considerably, because there the expert route actually failed.

Melonine and the Aza-Cope Fix: Tom: Okaramine M showed recovery of an expert route. Page ten pushes the test further, to Melonine, where the published syntheses postdate the cutoff and SynthEx converges on a disconnection an expert group tried — and failed.

Jane: Melonine is a pentacyclic monoterpene indole alkaloid with a congested, bridged architecture. Two total syntheses exist, both after the cutoff: Yokoshima's, built on an oxidative aziridination, and Zhu's, built on a bis-cyclisative diamination. But crucially, Zhu's group also attempted the biosynthetic route centered on a Mannich cyclization — exactly the disconnection SynthEx selects.

Meng: And that attempt failed. The conformation required for cyclization suffers a severe steric clash between the piperidine ring and the C–H bonds of the CH2CH2 linker, so the iminium can't adopt a geometry where the indole can reach it. One of the paper's authors, Jieping Zhu, led those experiments, so the comparison is direct rather than inferred.

Lu: Here's where it gets elegant. SynthEx generates its iminium through an aza-Cope rearrangement instead of a direct condensation, which replaces that CH2–CH2 single bond with an HC=CH double bond. That removes the clash, and the intermediate should reach a reactive conformation far more easily. A related cyclization on a similar substrate has already been realized by the same group.

Jane: The paper carefully separates convergence from outcome. Agreement with an idea experts chose to test is a demanding standard on its own, independent of whether the idea worked. SynthEx then reaching the same disconnection by a route the original group judges more likely to succeed is a stronger result than convergence alone — and they say they intend to test it.

Tom: Then there's a third mode, which might be the most practically useful of all. Given only Chanoclavine and Lysergol — an advanced intermediate and a target — SynthEx proposes a Hofmann-Löffler-Freytag reaction to close the D ring of the ergoline skeleton, using a 1,6-hydrogen atom transfer to functionalize an allylic methyl group, then a double-bond migration to reach Lysergol.

Lalam: That's remote functionalization of an unactivated C–H bond, exactly the low-frequency chemistry the patent record lacks, proposed unprompted to bridge a specific two-compound gap. That's the mode of use they expect to matter most in practice — a campaign stalled a few steps from its target, asking how to cross the finish line. These three stories set up the quantitative question: does this hold across a thousand targets?

A Different Reaction Space: Jane: The case studies look strong on three molecules. Page thirteen asks whether that distinctiveness holds systematically across the full corpus of 33,145 steps.

Tom: And the answer is yes, in several measurable ways. First, the reactions aren't garbage — an expert-curated name dictionary called NameRXN, tied to no training corpus, recognizes them at parity with patent reactions. But a classifier trained on USPTO patents recognizes 15 to 25 percentage points fewer of SynthEx's steps. So this is nameable chemistry that's scarce in the patent record.

Lu: The strongest number for me is the single-step reachability test. They fed every SynthEx reaction to RetroChimera, a state-of-the-art model trained on Pistachio, and asked it to rediscover the disconnection. Top-1 recovery is 13 point 5 percent, top-5 is 31 point 4 percent. For ring-forming steps it collapses to 2 point 3 percent at top-1 and 10 point 9 percent at top-5, and even at top-50 it only reaches 25 point 8 percent.

Meng: Which matters because in a real multi-step search, a disconnection buried at position forty in a ranked list is never reached in practice. So this isn't a faster path to the same routes — it's a region of reaction space the other tools essentially cannot reproduce.

Jane: And the composition of that space tells a clear story. 16 percent of SynthEx's steps form a ring, against 9 point 9 percent for USPTO and just 2 point 8 percent for RetroChimera's own predictions. Carbon–carbon bond formation is the single largest named class at 22 point 5 percent, more than double RetroChimera's share, and 63 point 5 percent of those constructions unite two independent fragments — a convergent signature.

Tom: Meanwhile the corpus-trained model defaults to conservative functional-group editing, with protecting-group manipulations at 40 percent of its disconnections against 27 percent for SynthEx. The paper frames it as constructive chemistry against janitorial chemistry, which sounds harsh but the numbers back it up.

Lalam: I'd add the visualization point — a principal-component projection shows the two corpora occupying largely distinct territories rather than dispersing through each other. The authors are careful to call it a visualization, not independent evidence, since the classifier itself is patent-trained. But combined with the recovery rates, the separation is real.

Jane: So the chemistry is different, and the difference is ring construction and convergence. Which raises the obvious next question — how often does that different chemistry actually get you to a finished route?

Reach and the Expert Panel: Tom: We've established the chemistry is distinct. Page sixteen is where they count how often it succeeds, on 1,098 natural products drawn from NP-Atlas with no reported total synthesis.

Jane: The baseline is striking. AiZynthFinder, run near-exhaustively — no expansion cap, depth 25, thirty minutes per target, a median of roughly 29,000 nodes — solves only 13 point 8 percent of the benchmark, 151 targets. SynthEx's strategic layer alone, without any leaf completion, solves 25 percent. Stitch in a short template search to finish the simple leaves, and the solve rate jumps to 63 point 9 percent, or 702 targets.

Meng: And the control subsets make the argument airtight. On structurally simple targets, AiZynthFinder solves 80 percent, close to its performance on the patent-derived benchmarks it was built for, while SynthEx solves 95 percent. On the complexity-dense set the template planner drops to 12 percent, and on the large complex set to 4 percent. Same budget, same planner — the failure is specific to structural complexity.

Lu: The interpretation is that the strategic layer decomplexifies the target. It hands the template engine simple leaves it can finish within six steps, and the same engine that fails as a standalone planner succeeds as a completion engine. The advantage widens as the molecules get heavier and more complex.

Jane: But solve rate alone isn't quality, so they ran the blinded panel. Ten chemists from three total-synthesis groups, 148 unique key steps, 1,040 ratings across four axes. On feasibility the difference is essentially zero, with a confidence interval from minus 0 point 09 to plus 0 point 08. Elegance and overall quality are indistinguishable. Strategic value shows a small literature edge, but it's smaller than the disagreement among the raters themselves.

Tom: And the panel couldn't act on the difference — a classifier trained on their ratings couldn't identify a step's source, with an area under the curve of 0 point 48, right at chance. That's a remarkable result in its own right.

Lalam: The paper is also honest about route lengths. SynthEx routes are frequently longer than published human syntheses, but that's expected — a published synthesis is the endpoint of months of lab optimization, while SynthEx's is a first proposal. On targets both methods solve, SynthEx is shorter than AiZynthFinder on 105 of 134.

Jane: Which brings us to the part I find most fascinating — the routes get repaired before anyone ever sees them.

The Critic–Editor Loop: Tom: So the system proposes routes, and experts judge them on par with human ones. Page nineteen shows what happens between proposal and release — an iterative repair loop.

Jane: It's modeled on how coding agents work, with an important disanalogy the paper states plainly. A coding agent is corrected by a compiler and a test suite, which are ground truth. Synthesis planning has no such oracle short of the laboratory, so a language-model critic stands in — and the paper says that makes this an internal consistency check, not experimental validation.

Meng: Mechanically, each route becomes a RouteJSON document, a linear sequence of ReactionJSON entries. The Critic simulates each reaction forward and flags blocking steps — transformations that are chemically infeasible as written. The Editor then fixes them surgically, preserving the key disconnection and overall strategy, and the loop iterates.

Lu: The quantitative improvement is clear. The per-route blocking rate falls from about 0 point 27 before any repair to about 0 point 06 after six iterations, and the feasibility distribution shifts accordingly — fewer poor routes, more good and excellent ones. The worked example is Monascuspirolide A, and it's a great illustration of what surgical means.

Jane: Three problems, three fixes. The acid-labile spiroketal was installed mid-route, where a later Friedel-Crafts reaction under acidic conditions would destroy it — so the Editor moves spiroketalization to the very last step. The Claisen condensation substrate carried an alpha-keto ester more electrophilic than the external ester, risking polymerization — so the Horner-Wadsworth-Emmons olefination moves earlier, eliminating that ketone. And the acid introduced by the olefination gets protected as a tert-butyl ester, with alcohols shielded as TBDMS ethers.

Tom: The level of chemical judgment there — reading an electrophilicity ordering and its downstream consequences — is the kind of reasoning that's hard to imagine coming from a template. And because the route is a text object anchored on atom maps, each fix is a local edit rather than a full re-search.

Lalam: I also note the admitted blind spot. All the agents share the same language-model backbone, so blind spots can be shared across them. The loop demonstrates convergence against its own critic, and establishing true feasibility requires the lab. That honesty is what makes the release of all these routes feel responsible rather than reckless.

Jane: And that release is the subject of the discussion. Anyone can now go and look at these routes, which is where the paper starts making claims about the field's future.

The Discussion: Tom: We've watched routes get proposed, judged, and repaired. Page twenty-two steps back and makes the case for where synthesis planning should go next.

Jane: The opening argument is about benchmarks. The multistep benchmarks everyone uses are saturated — state-of-the-art planners report near-complete success, so score differences no longer separate capabilities. The paper's move is to propose complex natural-product synthesis as the setting where planners should be measured, because its difficulty scales continuously with structural complexity instead of saturating.

Lu: There's a deliberate parallel to early coding benchmarks, which stopped separating models before the field moved from isolated scripts to repository-scale software engineering tasks. The authors see the same pattern here, and they want the field to move before that happens — a benchmark is most useful while it still separates systems.

Meng: The discussion also restates the honest limits. Nothing in this work is experimental feasibility. Stereochemical outcomes aren't verified, expert review surfaced occasional selectivity errors, the improvement loop is scored by the same class of model that performs the repairs, and the language-model backbone is costly relative to a template search. A route that looks sound on paper is a hypothetical, not a result.

Tom: And yet the strategic value gap — the one axis where human chemistry kept an edge — points directly at where the collaboration should go. The Strategy Generator accepts chemist-supplied strategies in natural language, and the most productive arrangement might be a chemist supplying the strategy while the agent works out the details.

Jane: That's the part I find genuinely forward-looking. Neither full autonomy nor unaided human design, but a division of labor where judgment about what to build comes from the chemist, and the exhausting bookkeeping of how to build it comes from the machine. The longer-term goal is closed-loop validation in the laboratory.

Lalam: And the routes themselves become dated public predictions. Every target was chosen as having no reported total synthesis, so each released route is a falsifiable statement — and the paper commits to reporting concordance as syntheses of these targets appear. That's a built-in evaluation loop for the entire field.

Jane: It's a strong closing posture. Then the methods section arrives, and that's where we check every number they've cited.

The Methods: Tom: The discussion makes grand claims about benchmarks and the future. Page twenty-five is where we check whether the machinery supports them.

Jane: The benchmark construction is precise. Targets come from NP-Atlas, release 2024-09, filtered to molecules with no reported total synthesis, then further filtered by structural criteria — Bertz complexity between 900 and 2200, 24 to 65 heavy atoms, 4 to 12 stereocenters, 2 to 8 rings. Morgan fingerprint clustering with BitBirch keeps a representative medoid per cluster, spanning the chemical space.

Meng: And the three subsets are clever. The large complex set is the representative core, 852 molecules. The complexity-dense set, 123 targets, are ones where AiZynthFinder's route is surprisingly long for their complexity — hard to do concisely. The control set, another 123, are structurally simple molecules that a short template search failed on, which turn out to be budget failures rather than structural ones.

Lu: The search criteria are equally explicit. A building block counts as purchasable only if its full InChIKey appears in the combined ZINC and eMolecules stock — just under forty million compounds. A target counts as solved only when every leaf is purchasable, using the same logic AiZynthFinder inherits, so the comparison is apples to apples.

Tom: And the LLM configuration matters for the paper's central claim. The backbone is Gemini 3 point 1 Pro Preview, with a documented knowledge cutoff of January 2025. Search grounding was never enabled and the model had no web access, so at inference it could draw only on its training data. The authors are careful that a documented cutoff is reasonable evidence against retrieval, not proof — post-training data isn't disclosed.

Jane: The reaction recognition analysis gets spelled out, too. Three tools, four configurations. NameRXN, the expert-curated dictionary, at parity. Rxn-INSIGHT and their own ReactionClassifier, in ordered and hybrid modes, showing that 15-to-25-point deficit. And the RetroChimera recovery numbers come with exact matching rules — canonical SMILES, fragments sorted, stereochemistry retained.

Meng: There's a technical detail I really appreciate — atom mapping is produced by construction. Because each precursor is generated by applying graph edits to a mapped product, atoms keep their parent map numbers, and no external mapping model like RXNMapper is needed. That makes the released corpus internally consistent in a way post-hoc mapped datasets aren't.

Lalam: So the methods hold up to inspection. The criteria are checkable, the baselines are generous, and the caveats are written into the same pages as the claims. That's the right way to end a paper of this ambition.

Jane: It leaves the field with a clear agenda — use the routes, test the predictions, and build the next generation of planners against a resource that didn't exist before.

Conclusion: Tom: We've gone page by page through the architecture, the case studies, the numbers, and the methods. Time to pull it together. Jane, what's the one thing you'd want a listener to remember?

Jane: I'd say this: synthesis planning just moved from retrieving reactions to reasoning about molecules. SynthEx writes its own chemistry as graph edits, reaches 63 point 9 percent of a thousand-plus natural-product benchmark where a near-exhaustive template search manages 13 point 8 percent, and its key steps survived blinded comparison with published human syntheses.

Meng: And the ring-forming, convergent chemistry it favors is precisely what the patent corpora under-represent. That's a measurable, structural difference, not a marketing claim. More than two-thirds of its transformations are absent from the top-5 of a leading corpus-trained model.

Lu: The three case studies bind it together for me. Recovering a route published after the training cutoff, converging on a disconnection an expert group tried and failed, and proposing a remote C–H functionalization across a gap nobody had solved. Each one came with honest caveats — judged by inspection, not by the bench.

Jane: Exactly. The paper never lets us forget that wet-lab feasibility is the next frontier. The improvement loop is checked by the same class of model that does the repairs, and the expert comparison is conditional on a shared strategic frame. None of that is hidden.

Lalam: And the release of SynthAtlas turns the whole thing into an experiment the community can run. Over a thousand targets with no reported synthesis, each route a dated public prediction, with the authors committing to report concordance as syntheses appear. That's rare in this literature.

Tom: The strategic value gap also tells a story. Experts still hold an edge in higher-order planning, and the model is built to accept their strategy as input. The near-term future might be chemists steering, machines executing, and both sides learning.

Lalam: And if those predicted routes start getting validated in laboratories, the analogy the paper draws to AlphaFold — predicted protein structures transforming how biologists reason about molecules they may never crystallize — will start to look less like aspiration and more like a roadmap.

Jane: It's a good note to end on. We'll be watching the SynthAtlas routes as the syntheses roll in.

Tom: Thanks for listening, everyone. We'll see you at the next paper.