Benefits of Low-Cost Bio-Inspiration in the Age of Overparametrization
cs.RO, cs.AI
Submitted: 2026-04-22
Updated: 2026-08-28
Code: https://github.com/kgd-al/apets-ariel
License: http://creativecommons.org/licenses/by/4.0/
The gist: While Central Pattern Generators (CPGs) and Multi-Layer Perceptrons (MLP) are widely used paradigms in robot control, few systematic studies have been performed on the relative merits of large
Terminology
Abstract
While Central Pattern Generators (CPGs) and Multi-Layer Perceptrons (MLP) are widely used paradigms in robot control, few systematic studies have been performed on the relative merits of large parameter spaces in highly constrained settings. As opposed to traditional Machine Learning contexts, our input and output spaces are small and performance is bounded thus having more parameters may actively hinder the learning process instead of empowering it. To empirically measure this, we submit a given robot morphology, with limited proprioceptive capabilities, to controller optimisation under two bio-inspired paradigms (CPGs and MLPs) with evolutionary- and reinforcement- trainer protocols. By varying parameter spaces across multiple reward functions, we demonstrate that shallow MLPs and densely connected CPGs result in better performance when compared to deeper MLPs or Actor-Critic architectures. To account for the relationship between said performance and the number of parameters, we introduce a Parameter Impact metric which showcases diminishing returns for MLPs but not for CPGs. Taken together these results demonstrate, on a fixed quadrupedal morphology, the benefits of integrating prior bias when considering locomotion tasks with simple hinge actuators.
Sources
- CPG-RL: Learning Central Pattern Generators for Quadruped Locomotion
- Visual CPG-RL: Learning Central Pattern Generators for Visually-Guided Quadruped Locomotion
- Neural Circuit Architectural Priors for Quadruped Locomotion
- CPG-ACTOR: Reinforcement Learning for Central Pattern Generators
- Emergence of specialized Collective Behaviors in Evolving Heterogeneous Swarms
- A "missing" family of classical orthogonal polynomials
- Reinforcement Learning of CPG-regulated Locomotion Controller for a Soft Snake Robot
- The Effects of Learning in Morphologically Evolving Robot Systems
- A comparison of controller architectures and learning mechanisms for arbitrary robot morphologies
- Natural gradient descent for improving variational inference based classification of radio galaxies
- Dota 2 with Large Scale Deep Reinforcement Learning
- Optimizers Qualitatively Alter Solutions And We Should Leverage This
- High-Dimensional Continuous Control Using Generalized Advantage Estimation
- Proximal Policy Optimization Algorithms
- Gymnasium: A Standard Interface for Reinforcement Learning Environments
- DeepGait: Planning and Control of Quadrupedal Gaits using Deep Reinforcement Learning
- Solving Deep Reinforcement Learning Tasks with Evolution Strategies and Linear Policy Networks
- Understanding deep learning requires rethinking generalization
Related papers
- FMT x: An Efficient and Asymptotically Optimal Extension of the Fast Marching Tree for Dynamic Replanning
- MPCFormer: A physics-informed data-driven approach for explainable socially-aware autonomous driving
- RoboLab: A High-Fidelity Simulation Benchmark for Analysis of Task Generalist Policies
- HRDexDB: A 4D Dexterous Grasping Dataset Across Human and Multiple Robot Embodiments
- APT: Action Expert Pretraining Improves Instruction Generalization of Vision-Language-Action Policies
- Fine-tuning is Not Enough: A Parallel Framework for Collaborative Imitation and Reinforcement Learning in End-to-end Autonomous Driving