NeuralBES: A Differentiable, Control-Aware Emulator for Scalable Building Energy Modeling
summary
The gist
The gist: NeuralBES introduces a differentiable emulator that resolves the tradeoff between high-fidelity physics simulators and scalable data-driven models by parameterizing an RC thermal model with
In short
NeuralBES creates a differentiable emulator that balances accurate physics with scalable data-driven modeling for building energy forecasting. It parameterizes an RC thermal model using a shared neural encoder to map static building features to physical parameters, then solves the resulting linear recurrence in parallel. A predictor-corrector loop closes the thermostat-temperature nonlinearity, achieving high accuracy comparable to complex simulators while remaining much smaller.
Key concepts
- RC Thermal Model
- This is a simplified physical model representing how heat moves through a building's structure. It treats the building as having resistance (like insulation) and capacitance (like stored heat in materials). NeuralBES parameterizes this model using a neural network to learn the specific resistance and capacitance values for different buildings.
- Shared Neural Encoder
- This is a single neural network that takes static information about a building, such as its floor area or vintage, and converts it into two things: a general building embedding (zb) and specific thermal parameters. This allows the model to generalize knowledge from many buildings while still being tailored to individual characteristics.
- Log-Space Associative Scan
- This is a highly efficient method used to solve the time-varying thermal dynamics equation in parallel across time steps. It works by processing cumulative log-decays instead of raw numbers, which prevents numerical underflow and allows the calculation to proceed efficiently over long prediction horizons.
- Predictor–Corrector Loop
- This is a control mechanism used to fix a common problem in thermal modeling: the nonlinear relationship between the thermostat setting (desired temperature) and the actual resulting temperature. The loop estimates what load the thermostat would demand, clips it by equipment limits, and then re-integrates that clipped load to correct the temperature trajectory.
Terminology used across episodes
This episode discusses
- NeuralBES: A Differentiable, Control-Aware Emulator for Scalable Building Energy Modeling · Paper Radio
- Mamba: Linear-Time Sequence Modeling with Selective State Spaces
- Efficient Parallelization of a Ubiquitous Sequential Computation
- A Time Series is Worth 64 Words: Long-term Forecasting with Transformers
- Simplified State Space Layers for Sequence Modeling
The paper
NeuralBES: A Differentiable, Control-Aware Emulator for Scalable Building Energy Modeling · Read on arXiv
Ting-Yu Dai, Takuya Kurihana, Wing Yee Au, HON YUNG WONG
Fujitsu Research of America
Transcript
Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.
Tom: I'm Tom, and with me are Jane, Lu, senior AI researcher at Tsinghua, Meng, lead engineer at a mysterious AI startup and Lalam, the in-house Large Language Model.
Jane: Today's paper: "NeuralBES: A Differentiable, Control-Aware Emulator for Scalable Building Energy Modeling".
Tom: The gist:
Jane: First, who's behind it and why it matters.
Paper summary: Tom: So we talked about what NeuralBES is, and now let’s get into the specifics of how they built this system. The paper "NeuralBES: A Differentiable, Control-Aware Emulator for Scalable Building Energy Modeling" lays out how they parameterize that resistance–capacitance model.
Jane: They start by saying they use a shared neural encoder to read the static building metadata, which includes things like floor area, vintage, and HVAC type. This metadata is then mapped to physically bounded capacitances, conductances, and equipment coefficients.
Lu: The architecture involves a neural encoder that produces both a latent building embedding zb and those building-specific thermal parameters that populate the RC model.
Meng: So the static data isn't just fed into some standard neural network; it’s specifically designed to produce these physically constrained parameters, which is key for making it useful.
Lalam: Each head in their architecture is a two-layer SiLU MLP conditioned on that static embedding zb, and they make sure the final layer has a zero-initialized weight and a bounded activation so that all those capacitances, conductances, capacities, and COPs stay strictly positive and within physically plausible ranges.
Tom: That constraint enforcement sounds like it’s where the physics enforcement comes in for the machine learning part. So they aren't just letting the network learn anything; they are forcing it to respect physical boundaries from the start.
Jane: And then, this time-varying signal wb,t acts as the external forcing on this model, and that air-node balance equation reduces to a scalar linear ODE of a specific form.
Lu: That ODE is written as dTair b dt equals minus P air b,t Cair b Tair b Cair b Tair,eq b,t Pair b,t equals UAinfil b(t) plus h am m b(three).
Meng: So this linear ODE has an exact closed-form solution over a time interval of t to t plus Delta t, which is pretty neat because it means they don't have to rely on numerical integration for the core dynamics.
Lalam: Then they introduce the affine term bair b,t equals (one minus alphaair b,t) Tair,eq b,t puts the update into a familiar state-space form of Tair b,t equals alphaair b t TAir b t−one + bai airb t <ref:2610.10459#pg1>.
Tom: And that’s the setup for solving it in parallel across time using a log-space associative scan. The paper calls this Heinsen log-space reformulation because it avoids underflow by working with cumulative log-decays.
Jane: This parallel scan approach is what allows them to solve the recurrence efficiently, and they do it in adaptively sized chunks to keep things efficient at long horizons without overflowing.
Lu: The coupling between state and actuator is closed through a short fixed-point loop that alternates between estimating the load the thermostat would demand at the current trajectory, clipping that demand by equipment capacity, and then re-integrating the temperature trajectory under that clipped load.
Meng: So this predictor–corrector loop is what finally closes that thermostat–temperature nonlinearity they mentioned earlier, which is a critical piece for making sure their simulation matches real-world control behavior.
Lalam: That whole process, from parameterization to parallel solving to the control loop, shows how NeuralBES manages to keep both the physical structure and the data-driven flexibility together effectively.
Conclusion: Tom: So we’ve covered a lot about NeuralBES today. To wrap up, we looked at how this system works, from parameterizing a building model with a shared neural encoder to solving that linear recurrence in parallel and closing the thermostat nonlinearity with a predictor–corrector loop.
Jane: The authors of "NeuralBES: A Differentiable, Control-Aware Emulator for Scalable Building Energy Modeling" are aiming to show this model can be used widely by grid planners, utility analysts, MPC researchers, and policy modelers who need to simulate large populations of buildings under various conditions.
Lu: The main implication is that they’ve created a differentiable surrogate that scales to millions of buildings, trains once on metadata already available in tax-assessor records and utility rolls.
Meng: So for the practical world, this means you can get physics-valid predictions at scale without needing to perform a massive per-building calibration campaign.
Lalam: And they really highlight that NeuralBES occupies a specific point in the BEM / ML design space by contrasting it against classical methods, trading envelope fidelity for two orders of magnitude fewer required inputs.
Tom: It’s about showing that first principles thermodynamics and scalable neural sequence modeling can share the same forward pass, which is pretty powerful for building trust in these kinds of models.
Jane: And they show that when you combine physical inductive bias with data-driven flexibility, you get something that's accurate to within four MAPE points of the strongest raw-error baseline.
Lu: The future research target they set is about extending the data-driven component so it can absorb phenomena hard to express analytically while keeping the interpretability and generalization properties provided by the physical backbone.
Meng: So essentially, they are pushing toward a system that’s robust enough for complex, real-world scenarios without needing to fundamentally rewrite the governing ODE just to add new physics like multi-zone coupling.
Lalam: That sounds like they are focusing on making the data component smarter enough to handle the hard stuff while keeping that physical backbone intact for interpretability.
More episodes
- 2610.11866-Understanding Latent-Dimension Scaling in Dynamical-System Learning through Spectral Reliability
- 2610.11896-Automated Assembly Instruction Generation from CAD Models Using Grounded Large Language Models: A Human-in-the-Loop Framework
- 2610.11908-Cost-Aware Mixture-of-Experts Coordination for Model Markets
- 2610.05570-Poisson-GENERIC Neural Operators: Exact Metriplectic Structure in Function Space via Casimir Entropies
- 2610.11953-Interval-valued SHAP in Tree-Based Models
- 2610.11914-Puffin: Probabilistic Learning of Spatial Detail From Coarse Observations
- 2610.11984-Example-driven Parametrisations for Bayesian Shape Optimisation
- 2610.12005-Test-Time Compute for Tabular Foundation Models: Mechanisms, Gains, and Limits
- 2610.12009-Ghost tasking for parametrized Gaussian Processes solving linear differential equations
- 2610.07080-When Attention Does Not Explain the Peak: Temporal Reference vs. Forecast Output in Attention-Based Time-Series Forecasting