RheOFormer: A generative transformer model for simulation of complex fluids and flows
cs.LG, physics.flu-dyn
Submitted: 2025-10-01
Updated: 2026-09-21
Comments: 8 pages, 5 figures. Submitted to PNAS
License: http://creativecommons.org/licenses/by/4.0/
The gist: The ability to model mechanics of soft materials under flowing conditions is key in designing and engineering processes and materials with targeted properties.
Terminology
Abstract
The ability to model mechanics of soft materials under flowing conditions is key in designing and engineering processes and materials with targeted properties. This generally requires solution of internal stress tensor, related to the deformation tensor through nonlinear and history-dependent constitutive models. Traditional numerical methods for non-Newtonian fluid dynamics often suffer from prohibitive computational demands and poor scalability to new problem instances. Developments in data-driven methods have mitigated some limitations but still require retraining across varied physical conditions. In this work, we introduce Rheological Operator Transformer (RheOFormer), a generative operator learning method leveraging self-attention to efficiently learn different spatial interactions and features of complex fluid flows. We benchmark RheOFormer across a range of different viscometric and non-viscometric flows with different types of viscoelastic and elastoviscoplastic mechanics in complex domains against ground truth solutions. Our results demonstrate that RheOFormer can accurately learn both scalar and tensorial nonlinear mechanics of different complex fluids and predict the spatio-temporal evolution of their flows, even when trained on limited datasets. Its strong generalization capabilities and computational efficiency establish RheOFormer as a robust neural surrogate for accelerating predictive complex fluid simulations, advancing data-driven experimentation, and enabling real-time process optimization across a wide range of applications.
Sources
- Predicting Physics in Mesh-reduced Space with Temporal Attention
- Transformer for Partial Differential Equations' Operator Learning
- Neural Machine Translation by Jointly Learning to Align and Translate
- Neural Turing Machines
- Effective Approaches to Attention-based Neural Machine Translation
- Message Passing Neural PDE Solvers
- A detailed and comprehensive account of fractional Physics-Informed Neural Networks: From implementation to efficiency
- Fourier Neural Operator for Parametric Partial Differential Equations
- Neural Operator: Graph Kernel Network for Partial Differential Equations
- Masked Autoencoders are PDE Learners
- A physics-informed transformer neural operator for learning generalized solutions of initial boundary value problems
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: Local-Consistency Optimisation for Bayesian Neural Networks
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks