Introductory Notes on Learning squared
math.NA, cs.LG, cs.NA
Submitted: 2026-09-06
Updated: 2026-09-06
Comments: 11 pages. Code and implementation: https://github.com/EuLaNet/EuLaNet
Code: https://github.com/EuLaNet/EuLaNet
License: http://creativecommons.org/licenses/by-sa/4.0/
The gist: Although machine learning can be used to predict the evolution of physical systems from data, a formulation that learns only the system state at each time leaves the temporal and dynamical structure
Terminology
Abstract
Although machine learning can be used to predict the evolution of physical systems from data, a formulation that learns only the system state at each time leaves the temporal and dynamical structure of the solution to be resolved within a broad hypothesis space. We introduce Learning squared, a representation-level framework that structures this space by coupling a primary representation to a second representation through a known physical transformation. The resulting cross-representation constraint restricts the effective hypothesis space and provides an ante-hoc, physically interpretable criterion for excluding solutions that satisfy the primary representation alone. We instantiate Learning squared through EuLaNet, an Eulerian--Lagrangian representation for fluid dynamics. Given the velocity state u(x,t), EuLaNet constructs its induced Lagrangian flow map X(a,t) through (a,t)=u(X(a,t),t), from which material transport and finite-time deformation are derived. The resulting representation couples the predicted state to the dynamical consequences it induces, providing a second consistency criterion beyond state-level agreement. We formalize this construction through an effective hypothesis space H L squared H and define the conditions under which a consequence representation provides discriminative constraints on candidate solutions. EuLaNet is implemented as a model-independent representation module, separating the physical constraint from the downstream learning architecture. This construction provides an ante-hoc mechanism for physically interpretable constraint in scientific learning and offers a basis for developing and evaluating broader classes of Learning squared architectures. The implementation is open-sourced to support the development and extension of the architecture across scientific domains.
Related papers
- Do physics-informed neural networks (PINNs) need to be deep? Shallow PINNs using the Levenberg-Marquardt algorithm
- A Neural-preconditioned Poisson Solver for Mixed Dirichlet and Neumann Boundary Conditions
- Second-order consistency for learning chaotic dynamics via randomized Jacobian matching
- Windowed thinning and query complexity for the bouncy particle and Zigzag samplers
- Data-efficient Kernel Methods for Learning Hamiltonian Systems
- Adjoint Method versus Physics-Informed Neural Networks in PDE-Constrained Inverse Problems