High-Resolution Probabilistic Data-Driven Weather Modeling with a Stretched-Grid

Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.

Tom: Next we'll be talking about the paper "High-Resolution Probabilistic Data-Driven Weather Modeling with a Stretched-Grid".

Jane: The paper was written by Even Marius Nordhagen, Håvard Homleid Haugen, Magnus Sikora Ingstad, Aram Farhad Shafiq Salihi, Thomas Nils Nipen et al. from Norwegian Meteorological Institute and ECMWF.

Tom: Stay tuned as we take you through the paper and discuss its implications.

Title and Authors: Tom: Welcome back, everyone. Today we're diving into a paper that's got the whole weather forecasting community buzzing — it's called "High-Resolution Probabilistic Data-Driven Weather Modeling with a Stretched Grid." Jane, I have to say, just the title alone tells you this is something special.

Jane: It really does, Tom. And the author list reads like a who's who of European weather research — folks from the Norwegian Meteorological Institute and ECMWF, which is the European Centre for Medium-Range Weather Forecasts. You've got names like Even Marius Nordhagen, Simon Lang, Peter Dueben — these are serious players in the data-driven weather space.

Tom: So for our listeners who might not be deep in the meteorology world, what's the big deal here? What does "stretched grid" even mean?

Jane: Great question. Imagine you're looking at a map of the whole Earth, but you've got a magnifying glass held over Scandinavia. That's essentially what they've done — they dedicate super fine detail, about two point five kilometers, to the Nordic region, while the rest of the globe runs at a coarser thirty-one kilometers. It's like having a high-resolution camera focused on your backyard while still seeing the whole neighborhood.

Lu: And that's the clever part, Jane. Normally, to get that kind of detail everywhere, you'd need massive computing power. But by stretching the grid, they concentrate all that computational muscle where it matters most. The model still sees the global weather patterns — the jet streams, the big pressure systems — but it can also resolve local effects like mountain winds and sea breezes.

Tom: So it's not just a global model pretending to be regional — it's actually doing both at the same time.

Lu: Exactly. And that's a huge step forward. Most data-driven weather models operate at a uniform resolution of around twenty-five to thirty kilometers. That's fine for seeing a storm system, but it can't tell you whether it's going to rain on your specific street corner.

Jane: And that's where the "probabilistic" part comes in. This isn't just giving you one forecast — it generates a whole ensemble of possible futures. We're talking about a model that can produce as many different weather scenarios as you want, each one slightly different, to capture the uncertainty.

Meng: Right, and from an engineering standpoint, that's actually pretty remarkable. Generating an ensemble usually means running the model multiple times, which multiplies the cost. But because this model is stochastic — it injects random noise internally — each ensemble member comes at nearly the same cost as a single deterministic run.

Tom: So you're telling me we're getting more information for basically the same price?

Meng: That's the promise, Tom. And when you're running forecasts four times a day operationally, like they're doing at the Norwegian Met Institute, that cost efficiency matters a lot.

Jane: And I love that they're already running it operationally — since October two thousand twenty-five apparently. This isn't just a research curiosity; it's already being used to make real forecasts that people depend on.

Tom: That's fantastic. So we've got a model that's high-resolution where it counts, probabilistic in nature, and already in production. What's not to love?

Jane: Well, let's not get ahead of ourselves. There's a lot of technical detail in how they actually trained this thing — and some interesting challenges they had to overcome. That's where the real story is.

Lu: And I think the most interesting part is how they handled the loss function — how they taught the model to produce forecasts that look like real weather, not just smoothed-out averages.

Tom: Okay, I'm hooked. Let's get into the nitty-gritty after this short break.

Summary and Key Findings: Jane: Welcome back. We're continuing our discussion of "High-Resolution Probabilistic Data-Driven Weather Modeling with a Stretched Grid." Tom, we left off talking about how they trained this model — and I think that's where things get really interesting.

Tom: Absolutely. So Jane, what did they actually do differently in the training process?

Jane: Well, the big innovation here is in the loss function — that's the mathematical formula that tells the model how wrong it is during training. Most data-driven weather models use something called mean squared error, which basically penalizes the model for every mistake equally. But that has a problem they call the "double penalty" issue.

Lu: Right, and that's a classic problem in weather forecasting. If a model predicts a rainstorm slightly to the east of where it actually happens, it gets penalized twice — once for predicting rain where there wasn't any, and once for missing it where it actually fell. To minimize that error, the model learns to just smooth everything out, making the forecast blurry and unhelpful.

Tom: So it's like a student who figures out that the safest answer on a test is always the average — never too high, never too low.

Lu: Exactly. And that's terrible for weather forecasting, especially for extreme events. You want a model that can actually predict heavy rain or strong winds, not just a watered-down version of the average weather.

Jane: So instead, they used something called the Continuous Ranked Probability Score, or CRPS. That's a proper scoring rule that evaluates the whole probability distribution, not just a single value. And crucially, they made it stochastic — the model generates multiple ensemble members during training, and the loss function rewards the ensemble for being both accurate and appropriately spread out.

Meng: But here's the catch, and I think this is the part that really shows their engineering skill. When they just used CRPS point-by-point, the forecasts looked terrible spatially. The fields were noisy — like static on a TV screen. Each individual grid point had good statistics, but the overall pattern was incoherent.

Tom: So the model was technically right at each point, but the picture as a whole looked like garbage?

Meng: That's exactly it. And that's where the "FFT" part comes in — Fast Fourier Transform. They added a second term to the loss function that evaluates the forecast in spectral space, meaning it looks at the spatial scales of the features. Are the rain bands the right width? Is the energy distributed correctly across different wavelengths?

Jane: And that made all the difference. When they compared their model — which they call Bris CRPS-FFT — to a version trained without the spectral term, the difference was night and day. The spectral version produced rain fields that actually looked like real weather, with coherent structures and realistic sharpness.

Lu: And the verification results are genuinely impressive. Against two hundred fifty-four weather stations across Norway, their model matched or beat the operational MEPS system — that's the state-of-the-art numerical weather prediction system used in the region. For temperature, they were up to fifteen percent better in the fair CRPS score.

Tom: Fifteen percent better than an operational NWP system? That's not just a small improvement — that's a leap.

Jane: It is. And they also showed that their single ensemble members look more like real weather than the deterministic model's output. The power spectra — essentially the fingerprint of spatial scales in the forecast — matched MEPS much more closely, especially for wavelengths longer than ten kilometers.

Meng: There's still some excess noise at the very smallest scales, which they acknowledge. But compared to the alternatives, it's a massive improvement in spatial coherence.

Tom: So we've got a model that's probabilistic, high-resolution, and produces spatially realistic forecasts. What's the catch? What are the limitations?

Jane: Well, there are a few, and I think that's what we should dig into next.

Improvements and Future Directions: Tom: Welcome back. We're still talking about "High-Resolution Probabilistic Data-Driven Weather Modeling with a Stretched Grid." Jane, you mentioned there are some limitations. Let's hear them.

Jane: Right. So the first big one is temporal resolution. This model produces forecasts every six hours. That's fine for seeing the general evolution of weather, but it's too coarse for many practical applications. Think about aviation — pilots need updates much more frequently than every six hours. Or severe thunderstorm warnings — those can develop and dissipate within a couple of hours.

Lu: And that's a real gap. The spatial resolution is two point five kilometers, which is genuinely kilometer-scale. But the temporal resolution doesn't match that. The authors themselves say they want to move to hourly forecasts in future work. That would be a game-changer for nowcasting — predicting weather in the next few hours.

Tom: So we've got high-res in space but low-res in time. What else?

Meng: The other issue is the ensemble spread. When they compared their ensemble to MEPS, they found that Bris CRPS-FFT has too little spread for most variables — meaning the ensemble members are too similar to each other. The model is overconfident about what's going to happen.

Jane: And why is that? I mean, they trained it to be probabilistic.

Meng: The likely reason is that they trained it against the control analysis — the single best estimate of the true state of the atmosphere. But in reality, that analysis itself is uncertain. The model learns to predict that one specific analysis, so it doesn't capture the full range of possible initial conditions.

Lu: That's a classic issue in data-driven weather prediction. The numerical weather prediction systems like MEPS initialize with a whole ensemble of perturbed analyses — they nudge the initial conditions slightly to represent uncertainty. The data-driven model doesn't do that yet, so it's starting from a single point instead of a spread of points.

Tom: So the fix would be to initialize with an ensemble of analyses?

Jane: Exactly. And the authors suggest that as a potential improvement. If you feed the model perturbed initial states, the ensemble spread should naturally increase to better match the true uncertainty.

Meng: There's also the small-scale noise issue we mentioned. Even with the spectral loss, there's still excess energy at the finest scales — wavelengths below about ten kilometers. That means the model is generating some small-scale features that aren't physically realistic. They're not sure yet whether that needs a loss function tweak or an architectural change.

Lu: And I'd add one more thing — the verification is focused on surface variables over Norway. That makes sense given the stretched grid is centered there, but it means we don't know how well the model performs in other regions or for upper-atmosphere variables. The global part of the model is running at thirty-one kilometers, which is coarser than some other global models.

Tom: So there's room to grow, but the foundation is solid. What does this mean for the future of weather forecasting?

Jane: I think this paper is a proof point that data-driven models can operate at kilometer scale with genuine probabilistic skill. That's something a lot of people doubted was possible. And the fact that it's already running operationally at MET Norway — four times a day — shows that this isn't just a lab experiment.

Tom: Let's bring in Lalam to get a broader perspective on where this could go.

Conclusion: Tom: We're wrapping up our discussion of "High-Resolution Probabilistic Data-Driven Weather Modeling with a Stretched Grid." Lalam, what's your take on the bigger picture here?

Lalam: I think the most impactful aspect is what this means for extreme weather warnings. National meteorological services have a core responsibility to issue timely warnings for high-impact events — flash floods, severe wind, heat waves. These events are short-lived and localized, which is exactly what this model is designed to capture. The combination of kilometer-scale resolution and probabilistic ensembles gives forecasters the tools they need to say not just "it might rain" but "there's a seventy percent chance of thirty millimeters of rain in this specific valley in the next six hours."

Jane: That's a really important point. And it connects to something the paper mentions — that this model could be a pathway for next-generation extreme weather prediction. The speed of data-driven models means you can run many more scenarios, explore more possibilities, and get answers faster.

Lu: And I'd add that the stretched-grid approach itself is a template for how to make data-driven weather prediction accessible to smaller countries and regions. You don't need a supercomputer the size of a warehouse to run this — the computational cost is a fraction of traditional NWP. A national meteorological service with modest computing resources could fine-tune this approach for their own region.

Meng: From an engineering standpoint, the fact that they've already got it running operationally is the real proof. It's not just a research paper — it's a deployed system. That's the hardest step, and they've done it.

Tom: So let's summarize what we've learned today. This paper presents a data-driven weather model that combines a stretched grid for kilometer-scale regional detail with a probabilistic ensemble approach. It uses a clever loss function that evaluates forecasts both point-by-point and in spectral space, which is what gives it spatially coherent fields. And it's already performing competitively with — and in some cases better than — the operational MEPS system.

Jane: And the key innovations are the spectral CRPS loss to fix the spatial coherence problem, and the stretched-grid architecture that makes high resolution computationally feasible. The limitations — six-hour temporal resolution, insufficient ensemble spread, and some residual small-scale noise — are all addressable in future work.

Tom: This is one of those papers that feels like a turning point. We're seeing data-driven weather prediction move from proof-of-concept to operational reality, and the implications for public safety, agriculture, aviation, and renewable energy are enormous.

Jane: Absolutely. And with the system already running at MET Norway since October two thousand twenty-five this isn't hypothetical — it's happening right now. We'll be watching closely to see how they address the temporal resolution and ensemble spread in their next iterations.

Tom: Well said. That's our discussion of "High-Resolution Probabilistic Data-Driven Weather Modeling with a Stretched Grid." Thanks to everyone who joined us — Lu, Meng, and of course Lalam. We'll be back soon with another paper. Until then, keep your eyes on the sky.

Jane: And check your forecasts — they might just be generated by a graph neural network. Take care, everyone.