What Should a Large Language Model See? Physical Invariants as a Data Representation for PDE Discovery
cs.LG, cond-mat.soft
Submitted: 2026-08-25
Updated: 2026-08-25
Comments: 6 pages, 1 figure
License: http://creativecommons.org/licenses/by/4.0/
The gist: Understanding how molecular interactions govern macroscopic behaviour is a central challenge in molecular sciences.
Terminology
Abstract
Understanding how molecular interactions govern macroscopic behaviour is a central challenge in molecular sciences. However, conventional theory building cannot keep pace with the vast datasets modern experimentation routinely produces. Large language models offer a promising route to automating theory construction, but a spatiotemporal field cannot be directly placed in a prompt. Existing models generally learn about the data only through a score measuring how well each proposal fits it. Here we introduce data interpretation, a stage that measures the field into the quantities a theorist would consult and supplies them to the model as a direct input. On a benchmark of simulated fields, interpretation nearly triples the accuracy of recovered equations relative to showing the raw data, at negligible computational cost and without any training. By allowing a language model to read field data as a theorist does, data interpretation offers a practical route to automated field theory construction that can coevolve with experimentation.
Sources
- LLM-SR: Scientific Equation Discovery via Programming with Large Language Models
- Symbolic Regression with a Learned Concept Library
- DrSR: LLM based Scientific Equation Discovery with Dual Reasoning from Data and Experience
- Influence-Guided Symbolic Regression: Scientific Discovery via LLM-Driven Equation Search with Granular Feedback
- LLM-ACES: Closed-Loop Discovery of Dynamical Systems with LLM-Guided Adaptive Search
- From Residuals to Reasons: LLM-Guided Mechanism Inference from Tabular Data
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: Local-Consistency Optimisation for Bayesian Neural Networks
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks