NORi: An ML-Augmented Ocean Boundary Layer Parameterization
Listen
Radio episode about this paper
Transcript
Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.
Tom: Next we'll be talking about the paper "NORi: An ML-Augmented Ocean Boundary Layer Parameterization".
Jane: The paper was written by L. Zanna, W. Gregory, P. Perezhogin, A. Sane, C. Zhang et al. from.
Tom: Stay tuned as we take you through the paper and discuss its implications.
Summary of the Paper: Tom: So, after introducing the problem with "NORi: An ML-Augmented Ocean Boundary Layer Parameterization," let's look at the summary. What’s the core idea of this approach that makes it so effective?
Jane: The paper says they are using neural networks to capture what’s called entrainment—which is basically when denser water from deeper down gets pulled up into the mixed surface layer. They can't model this with standard physics closures, and that's where the AI steps in.
Lu: It's truly elegant because of how they train it; they aren't just matching instantaneous measurements of flows, which is really noisy. Instead, they are training on a posteriori data—that is to say the entire time-integrated evolution of interest.
Meng: That sounds like a massive improvement for stability over long runs. If the network is trained to predict the correct trajectory rather than just one snapshot, it should behave much more predictably in a one hundred-year simulation.
Lalam: Predicting the movement over time is fundamentally different from predicting a single moment; that’s how we move from capturing fleeting chaos to achieving reliable long-term climate prediction.
Tom: And while the summary of "NORi: An ML-Augmented Ocean Boundary Layer Parameterization" explains this training method, what does it mean in practical terms for the model's performance?
Jane: The paper shows that this approach outperforms traditional models like k-epsilon, and they track real observations from a station called Papa quite well. It seems to be doing much better than previous methods.
Lu: I think the mention of "NORi: An ML-Augmented Ocean Boundary Layer Parameterization" is also significant because it suggests we are getting closer to a physically grounded AI solution, rather than just some black box.
Meng: The fact that they are achieving this with a relatively simple physics base closure, as opposed to using some massive complex network, is very efficient for us engineers who need to keep computational overhead low.
Lalam: This suggests that we don' not have to sacrifice speed for accuracy when we are building the future of climate models.
Tom: That’s a huge relief; moving on from the summary, let's talk about "NORi: An ML-Augmented Ocean Boundary Layer Parameterization" and what specific improvements it offers over existing techniques.
Improvements Suggested by the Paper: Tom: The paper highlights that "NORi: An ML-Augmented Ocean Boundary Layer Parameterization" is not just better, but it suggests some fundamental improvements in how we approach this entire parameterization problem. What are those improvements?
Jane: They are tackling the bias of mixed layer depth. Traditional models often underpredict how much the boundary layer should deepen due to entrainment, and this model seems to be filling that gap reliably.
Lu: It’s not just fixing one thing, though; they' have also made a big improvement in computational cost. Since you’re using a small network on top of simple physics, it' isn't as computationally demanding as the two-equation models that are often the gold standard for accuracy.
Meng: From an engineering standpoint, this is key because running long simulations with these kinds of complex models is a massive resource drain. A solution that provides high accuracy while remaining efficient at scale is a huge win for practical deployment.
Lalam: It’s about finding that sweet spot where we can achieve the detail of small-scale mixing without the computational cost of simulating those processes directly, which is exactly what this hybridization achieves in "NORi: An ML-Augmented Ocean Boundary Layer Parameterization."
Tom: That's a perfect summary; building on that idea, let's look at how the authors tested "NORi: An ML-Augmented Ocean Boundary Layer Parameterization."
Conclusion and Wrap Up: Tom: We’ve covered a lot of ground today, from the specific design choices in "NORi: An ML-Augmented Ocean Boundary Layer Parameterization" to its real-world performance. I think we can all agree on the core message here.
Jane: It’s really clear that while "NORi: An ML-Augmented Ocean Boundary Layer Parameterization" is a new tool, it’s also a testament to a whole new design philosophy for using AI in science.
Lu: The way they' have structured this—simple physics plus expressive AI—it opens up so many possibilities for future collaborations and feels like the beginning of a completely different era in atmospheric modeling.
Meng: I'm glad we saw the results of its one hundred-year double-gyre simulation, because that really demonstrates its ability to be numerically stable, which is a massive hurdle for other approaches.
Lalam: I hope that our discussion today highlights how much of a step forward this represents. The way you've all looked at the data and the implications of "NORi: An ML-Augmented Ocean Boundary Layer Parameterization" shows that it is indeed making progress.
Tom: It’s been a truly fascinating journey through this paper, and I think we'll be looking forward to seeing how this new approach evolves in global simulations.
Conclusion: Tom: So, after all the deep dives into "NORi: An ML-Augmented Ocean Boundary Layer Parameterization," we can really say that this research represents a major breakthrough in how we model ocean turbulence.
Jane: It’s a huge step forward because it successfully marries solid physics with intelligent machine learning to capture those tricky, non-local mixing processes that were previously too complex to simulate directly.
Lu: I think the potential for future is huge; imagine applying this framework to other complex systems where traditional models struggle with unpredictable emergent behavior.
Meng: For us, it means we can now deploy more accurate climate models on existing hardware without needing massive GPU clusters, which is a major win for scale.
Lalam: I see the cultural impact in this—it's allowing a global community to move towards climate solutions that are not only precise but also accessible and efficient.
Tom: And it’s also great that you all pointed out how robust it has been, especially with those long-term one hundred-year simulations.
Jane: It really shows that the paper's a posteriori training strategy is effective, making sure the model behaves reliably over time instead of just providing quick snapshots.
Lu: I’m just excited to see how this framework generalizes when people start adapting it to other environmental challenges besides ocean mixing.
Meng: We definitely have a lot of work ahead in optimizing that inference speed, but the path is much clearer now that the design is proven to be feasible and effective.
Lalam: I hope we can build upon this foundation to create even more robust and reliable tools for the global community.
Tom: It’s been great discussing "NORi: An ML-Augmented Ocean Boundary Layer Parameterization" with all of you, Jane, Lu, Meng, and Lalam.
physics.ao-ph, cs.AI, cs.LG, physics.comp-ph, physics.flu-dyn
Submitted: 2025-12-04
Updated: 2026-08-01
Comments: 59 pages, 20 figures, submitted to Journal of Advances in Modeling Earth Systems (JAMES). This is version 3, updated based on reviews from 3 anonymous reviewers after initial submission to JAMES
Journal ref: Journal of Advances in Modeling Earth Systems 18(9), e2025MS005667 (2026)
DOI: 10.1029/2025MS005667
License: http://creativecommons.org/licenses/by/4.0/
Importance score: 100/100
The gist: NORi is a novel parameterization designed to address fundamental limitations in current large-scale ocean models, which are constrained by computational cost and inherent biases in representing
Key concepts
- Entrainment
- This is when denser water from deeper parts of the ocean gets pulled up into the mixed surface layer. Traditional physics models struggle to capture this process accurately.
- A Posteriori Training
- Instead of training a model on noisy, instantaneous measurements, it trains on data that represents the entire time-integrated evolution of interest. This ensures better stability over long simulations.
- NORi
- This is the specific ML-augmented parameterization approach discussed. It uses a small neural network built upon simple physics to solve complex ocean mixing problems efficiently.
Terminology
Summary
NORi is a novel parameterization designed to address fundamental limitations in current large-scale ocean models, which are constrained by computational cost and inherent biases in representing small-scale turbulent mixing. This hybrid approach, combining established physical principles with modern machine learning techniques, offers a robust solution for modeling subgrid-scale processes that occur in the upper ocean boundary layer (BL).
The Hybrid Design Philosophy
The core of NORi is built on the principle of being simple but not any simpler.
The parameterization begins with a foundational physics-based closure, specifically a first-order diffusive closure similar to the Pacanowski–Philander model. This base closure handles local mixing driven by both convective and shear turbulence, where it accurately captures mixing that is purely local.
However, this local approach fails to account for complex dynamics such as entrainment—a process described as inherently anti-diffusive
that occurs at the base of the BL. To capture this missing physics, NORi augments the base closure with neural networks (NNs) trained to predict these nonlocal entrainment fluxes for temperature and salinity.
How it Works: The Role of Neural Networks
The neural network component is specifically designed to model non-local mixing that occurs at the BL base. Its function is not to replace the entire parameterization, but to augment the local diffusive closure by providing additional flux terms (J NNT and J NNS) for temperature and salinity, respectively.
-
The NNs are
convolved
along the vertical dimension, meaning their weights are shared across all grid points. -
The inputs to these networks include local gradients (e.g., d T/d z, d S/d z), the local Richardson number (Ri), and the surface buoyancy flux, which provides
nonlocal information
about the strength of convective plumes. -
The network activity is restricted to an
entrainment zone,
typically within five grid points below and ten grid points above the BL base, where it is deemed necessary to capture plume-driven mixing.
A Posteriori Training Paradigm
A significant technical challenge in applying ML to climate models is maintaining numerical stability over long integration times. To overcome this, NORi employs an a posteriori calibration strategy. Instead of training the networks to match instantaneous subgrid-scale fluxes (which are inherently noisy
), the model is trained using a loss function that explicitly depends on the actual time-integrated variables of interest.
This approach ensures that:
-
The training data distribution aligns with conditions expected during inference.
-
The model naturally accounts for numerical discretization errors, leading to improved stability.
-
The resulting parameterization is robustly stable, allowing it to be run for
at least 100 years
despite being trained on short, two-day horizons.
Performance and Validation
NORi demonstrates strong predictive skill across various physical regimes:
-
In idealized simulations, NORi
outperforms baselines.
-
The model successfully simulates the seasonal evolution of the boundary layer at Ocean Weather Station Papa (OWS Papa), showing performance
similar to the state-of-the-art two-equation k- epsilon closure.
-
The design allows for excellent generalization across different convective strengths, background stratifications, and wind forcings.
Key Features of NORi
The final framework integrates several key components:
-
A local gradient Richardson number (Ri)-based eddy-diffusivity closure.
-
Neural ODE (NODEs) augmentation to capture nonlocal entrainment fluxes.
-
A rigorous a posteriori training regimen that ensures
numerical stability.
-
The ability to operate with time steps up to one hour, making it a strong candidate for
coarse-resolution, long-time step simulations.
Improvements for AI systems
The following improvements are derived from the methodological innovations in the NORi paper and applied to general AI system architectures that require modeling dynamic physical or systemic processes (e.g, climate, fluid dynamics, complex logistical flows).
Improvement: Integrating a parsimonious base closure
(a simple, physically-grounded model) with a data-driven neural network component. Instead of replacing physical laws entirely with black-box ML, the system uses the physics to capture the majority of local behavior and only employs ML to learn the residual or nonlocal dynamics that are physically complex.
What it enables:
-
Physical Realizability: Guarantees that outputs adhere to fundamental conservation laws (e.g., mass, energy) by construction, eliminating physically impossible states.
-
Interpretability: Allows researchers to isolate which physical phenomena the system is handling via the base closure versus which are being learned by the neural network.
-
Increased Trust: Provides a robust baseline performance even in scenarios where ML-learned physics might fail, increasing confidence in long-term simulation results.
Improvement: Designing neural network components specifically to model effects that are spatially or temporally distant from the input state—the nonlocal flux.
The architecture uses localized features (e.g., local gradients, pressure/buoyancy flux at a specific point) combined with global system inputs (e.g., surface forcing) to predict a systemic effect far from the source.
What it enables:
-
Modeling Systemic Behavior: Allows the AI system to account for phenomena like deep entrainment, long-term resource depletion, or cascading failure modes that are not captured by local sensors or immediate inputs.
-
Capturing Feedback Loops: Enables accurate representation of feedback mechanisms where the consequence (e.g, a change in temperature at z) is driven by an event far away from the initial perturbation (e.g., surface evaporation).
Improvement: Shifting the loss function from matching instantaneous predictions (Loss = Prediction Instantaneous) to matching the time-integrated trajectory of a set of key system variables (Loss = integral (phi Sim - phi Target) dt).
What it enables:
-
Drastic Stability Improvement: Prevents the
finite-time blowup
and numerical divergence common in traditional autoregressive models, ensuring that the model remains physically consistent over extremely long integration periods (e.g., 100 years). -
Enhanced Generalization: The system is trained not to match a specific snapshot, but to learn how the system evolves. This allows it to extrapolate accurately into scenarios where conditions have never been seen before, as the training implicitly learns the dynamics of change rather than just the state.
Improvement: Utilizing gradient-free optimization techniques (like Ensemble Kalman Inversion, EKI) for parameter tuning in conjunction with a two-stage calibration
approach. This involves calibrating local parameters first and then freezing them to ensure that the system is not overcompensating for biases in one area when learning the next.
What it enables:
-
Robust Tuning: Enables effective calibration on noisy, real-world data where instantaneous flux measurements are unreliable, leading to more robust parameter sets.
-
Systematic Bias Reduction: Ensures that the model learns to capture physical processes in a structurally correct way, rather than merely
cheating
by compensating for errors in specific local regimes.
Abstract
NORi is a machine learning (ML) parameterization of ocean boundary layer turbulence that is physics-based and augmented with neural networks. NORi stands for neural ordinary differential equations (NODEs) Richardson number (Ri) closure. The physical parameterization is controlled by a Richardson number-dependent diffusivity and viscosity. The neural ODEs are trained to capture the entrainment through the base of the boundary layer, which cannot be represented with a local diffusive closure. The parameterization is trained using large-eddy simulations in an a posteriori fashion, where parameters are calibrated with a loss function that explicitly depends on the actual time-integrated variables of interest rather than the instantaneous subgrid fluxes, which are inherently noisy. NORi conserves tracers by design, uses realistic nonlinear thermodynamics, and demonstrates excellent prediction and generalization capabilities in capturing entrainment dynamics under different convective strengths, background stratifications, rotation, and wind forcings. NORi is shown to simulate the seasonal evolution of the boundary layer at Ocean Weather Station Papa with similar performance to the state-of-the-art two-equation k-epsilon closure. When implemented in a double-gyre simulation, it is numerically stable for at least 100 years, despite only being trained on two-day horizons, and can be run with time steps as long as one hour. Combining highly expressive neural networks with a physically grounded base closure proves to be a robust paradigm for designing parameterizations for climate models: data required and training cost are drastically reduced, inference performance can be directly optimized as a primary objective, and numerical stability is implicitly promoted through training.
Sources
- Challenges of learning multi-scale dynamics with AI weather models: Implications for stability and one solution
- Neural Ordinary Differential Equations
- The Ensemble Kalman Inversion Race
- Adam: A Method for Stochastic Optimization
- GraphCast: Learning skillful medium-range global weather forecasting
- FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operators
- Universal Differential Equations for Scientific Machine Learning
- Learned Coarse Models for Efficient Turbulence Simulation
- High-level, high-resolution ocean modeling at all scales with Oceananigans
- A Framework for Hybrid Physics-AI Coupled Ocean Models
Related papers
- A Checklist to assess the energy and carbon impacts of ML/AI applications in Earth System Modeling
- On the Predictive Skill of Artificial Intelligence-based Weather Models for Extreme Events using Uncertainty Quantification
- A Mechanism-Coupled Split Window Network for Medium- to High-Resolution Land Surface Temperature Retrieval
- Composable multi-satellite precipitation estimation for evolving observing systems
- Improving global precipitation forecasts with an AI weather model trained on satellite observations
- Atmospheric Predictability Beyond 30 Days with Machine Learning