An Energy-Based Mechanism for Compositional Behavior
math.OC, cs.AI, cs.SY, eess.SY, nlin.AO
Submitted: 2025-12-04
Updated: 2026-09-02
Code: https://github.com/francescarossi1/Neural-Policy-Composition-from-Free-Energy-Minimization
Project page: https://fbullo.github.io/ctds
License: http://creativecommons.org/licenses/by-nc-nd/4.0/
The gist: Flexible intelligence relies on the ability to reuse previously acquired behaviors and combine them differently as circumstances change.
Terminology
Abstract
Flexible intelligence relies on the ability to reuse previously acquired behaviors and combine them differently as circumstances change. In biological and artificial systems, this ability is often attributed to gating mechanisms that determine how much each available behavior should contribute at a given time. Yet these gating rules, the dynamics that compute them, and the neural circuits that may implement them are usually introduced separately, leaving unclear whether they reflect a common underlying principle. Here, we show that they can all be derived from a single variational principle for behavioral composition. The resulting mechanism naturally gives rise to softmax gating, evolves as an energy-based dynamical system with guaranteed convergence, and admits a recurrent neural network instantiation featuring context-dependent and local interactions. Across collective behavior, human decision-making, and layered control, the same mechanism reproduces characteristic behavioral patterns, provides interpretable accounts of how different behaviors are combined, and matches or outperforms established approaches. These results provide a unified account of how behavioral composition can emerge from a common principle, with implications for understanding flexible behavior in natural systems and for designing artificial agents that can adapt by recombining existing capabilities.
Sources
- A Comprehensive Survey of Mixture-of-Experts: Algorithms, Theory, and Applications
- On the Properties of the Softmax Function with Application in Game Theory and Reinforcement Learning
- What the flock knows that the birds do not: exploring the emergence of joint agency in multi-agent active inference
Related papers
- Lions and Muons: Optimization via Stochastic Frank-Wolfe under Heavy-Tailed Noise
- Adam-HNAG: A Convergent Reformulation of Adam with Accelerated Rate
- Incremental Learning in Mirror Flows
- Online Control via Counterfactual Tracking
- Asynchronous Replanning in Two Population Linear Quadratic Mean Field Games: Information Requirements and Stability
- Petrov-Galerkin operator inference with application to stability-encouraging identification