Gradient-free learning of a closed-loop wall controller for turbulent drag reduction

arXiv:2607.12626 · physics.flu-dyn, cs.LG · Submitted 2026-07-14 · Read on arXiv

physics.flu-dyn, cs.LG

Submitted: 2026-07-14

Updated: 2026-08-27

Terminology

• Reinforcement Learning — 16× in this paper · explained in 4 episodes
• Evolution Strategy — 15× in this paper
• Anisotropy — 6× in this paper · explained in 3 episodes
• Deep Reinforcement Learning — 6× in this paper · explained in 2 episodes
• Adam — 2× in this paper · explained in 2 episodes
• Benchmark — 2× in this paper · explained in 2 episodes
• Credit assignment — 2× in this paper · explained in 3 episodes
• Action Space — 1× in this paper · explained in 1 episode
• Actor — 1× in this paper · explained in 3 episodes
• Adaptation — 1× in this paper · explained in 1 episode
• Reinforcement Learning (RL) — 1× in this paper · explained in 25 episodes
• Reward Hacking — 1× in this paper · explained in 8 episodes

Sources

• Adam: A Method for Stochastic Optimization
• Evolution Strategies as a Scalable Alternative to Reinforcement Learning
• Flow control of three-dimensional cylinders transitioning to turbulence via multi-agent reinforcement learning

Related papers

• Reward hacking in physical reinforcement learning revealed by turbulent drag reduction
• Diffraction of walking drops by a standing Faraday wave
• Adjoint-based shape optimization of a ship hull using a Conditional Variational Autoencoder (CVAE) assisted propulsion surrogate model