RAGNAROK: Radar-Aided Gravity-Normalized Alignment for Robust Open Keyframe-based Radar-Visual-Kinematic-Inertial SLAM
summary
The gist
The gist The RAGNAROK framework presents a novel radar-visual-kinematic-inertial SLAM system designed for robust operation in challenging environments by integrating slip- and rolling-contact-aware
In short
RAGNAROK is a novel radar-visual-kinematic-inertial SLAM system designed for challenging environments. It integrates slip/rolling contact awareness, kinematics-aware radar factors, and degradation-aware image enhancement to achieve robust performance. The system fuses proprioceptive and exteroceptive estimates using a continuous-time backbone to maintain accurate state estimation despite perceptual issues.
Key concepts
- Slip & Rolling-Contact-Aware Leg Velocity Factor
- This factor estimates leg velocity by accounting for two slip modes and rolling contact during locomotion on rough terrain. It computes the foot-center position based on forward kinematics, directly incorporating the contact velocity caused by rolling motion to yield a reliable body velocity estimate.
- Kinematics-Aware Radar Velocity Factor
- This factor addresses radar's asymmetric resolution by using an orthogonal dual-radar configuration and a kinematics-aware covariance. It adjusts the 1D radial Doppler measurement based on the robot's instantaneous motion to accurately estimate velocity, mitigating directional uncertainty.
- Proprioceptive-Based State Estimator
- This estimator fuses radar data with internal body measurements (proprioception). It extends previous gravity-aligned estimation by incorporating kinematics-aware multi-radar constraints and slip/rolling contact factors. This provides a refined estimate of ego-centric velocity, rotation, and local gravity.
- Factor Graph Optimization
- The system uses a factor graph optimization framework to jointly minimize errors across multiple sensor measurements. It optimizes the radar-aided proprioceptive spline by balancing constraints from various sources like image features, radar residuals, gravity estimates, and motion models.
Terminology used across episodes
This episode discusses
- RAGNAROK: Radar-Aided Gravity-Normalized Alignment for Robust Open Keyframe-based Radar-Visual-Kinematic-Inertial SLAM · Paper Radio
- Proprioceptive Invariant Robot State Estimation
The paper
RAGNAROK: Radar-Aided Gravity-Normalized Alignment for Robust Open Keyframe-based Radar-Visual-Kinematic-Inertial SLAM · Read on arXiv
Hanjun Kim, Chiyun Noh, Sangwoo Jung, Jaehyung Jung, Simon Boche, Cedric Le Gentil, Stefan Leutenegger and Ayoung Kim
Department of Mechanical Engineering, Seoul National University (SNU) · Mobile Robotics Lab, School of Computation, Information and Technology (CIT) at the Technical University of Munich (TUM) · Mobile Robotics Lab, ETH Zurich
Legged robots offer superior mobility in unstructured environments, but reliable operation in such conditions requires robust state estimation. To address the vulnerability of proprioceptive estimators in rough terrain, recent methods have incorporated radar to provide velocity measurements. However, their limited yaw observability still leads to drift, and failure-aware fusion for adverse environments remains underexplored. In this letter, we present RAGNAROK, the first radar-visual-kinematic-inertial SLAM designed for robust operation in challenging environments. It integrates slip- and rolling-contact-aware leg velocity estimation, a kinematics-aware radar factor, and degradation-aware image enhancement. We further incorporate a B-spline-based radar-aided proprioceptive backbone, adaptive weighting, and online extrinsic calibration. Extensive experiments on public and self-collected datasets demonstrate that RAGNAROK achieves robust performance under challenging conditions and outperforms state-of-the-art baselines. The source code and dataset are available at https://github.com/hanjun815/RAGNAROK.
Transcript
Introduction to the show: ident: Robotics Radio. Generated commentary on the latest robotics and control papers.
Rosa: Today's paper: "RAGNAROK: Radar-Aided Gravity-Normalized Alignment for Robust Open Keyframe-based Radar-Visual-Kinematic-Inertial SLAM".
Dev: The gist The RAGNAROK framework presents a novel radar-visual-kinematic-inertial SLAM system designed for robust operation in challenging environments by integrating slip- and rolling-contact-aware leg velocity estimation,
Rosa: First, who's behind it and why it matters.
Paper summary: Rosa: So, wrapping up the RAGNAROK paper by Hanjun Kim and colleagues. The title itself says Radar-Aided Gravity-Normalized Alignment for Robust Open Keyframe-based Radar-Visual-Kinematic-Inertial SLAM. It’s a very descriptive title showing exactly what this complex system is built to do.
Dev: It points to the core idea: taking that combination of radar, visual, kinematic, and inertial data and aligning it robustly even when you don't have perfect keyframes or the environment is rough. They’re not just looking for a single best sensor; they’re building a system that manages uncertainty across all those modalities at once.
Taro: From an autonomy perspective, this means we can expect to see more systems that use these kinds of multi-sensor constraints as a standard way to handle the complexity of real-world navigation, especially in unstructured settings. It formalizes how you should combine these different sensing streams.
Rosa: The implication is that for legged robots and mobile platforms operating outdoors, we can expect a significant step up in reliability when dealing with terrain that causes slips or uneven footing. This system tackles the problem of proprioceptive estimators being too fragile when things go wrong physically.
Dev: And I think the use of the B-spline backbone to interpolate motion is key here. It’s a way to bridge the gap between discrete sensor measurements and continuous physical reality, which is what you need for smooth, accurate state tracking in real-time applications.
Taro: So, if you listen to this show and want a high-level view of the research: RAGNAROK is about creating an integrated SLAM system where different physics—like how a foot rolls versus slips—are explicitly modeled as constraints within the estimation process.
Rosa: That’s right. It’s not just adding more sensors; it’s building a smarter way to fuse them, making the robot's understanding of its own motion much more grounded in physical reality, even when the environment is messy.
Dev: The work shows that by carefully designing those specific factors—the slip factor and the kinematics-aware radar factor—you can achieve robust performance across challenging conditions. It’s a concrete methodology for engineering reliable autonomy.
Taro: For future work, I think we need to see how this system scales up to even more diverse sensor inputs or how the adaptive weighting scheme performs when there are completely unexpected, extreme environmental events that weren't anticipated in testing.
Rosa: That’s a fair point for the next iteration of this research. The paper lays out a strong foundation, and now it’s about testing those limits against truly unpredictable scenarios outside of the controlled testbeds.
Conclusion: Rosa: So, RAGNAROK is essentially trying to build a SLAM system that doesn't break when things get rough outdoors by blending radar, vision, and motion data together in a way that respects how physics actually works on the ground.
Dev: Yeah, the title itself tells you they're focusing on aligning those different sensor types using gravity as a steady reference point so it stays grounded even if the robot is slipping.
Taro: It’s interesting how they tackle that open keyframe problem, which is usually where these systems fall apart when you lose track of where you are in space.
Rosa: They use this whole framework—radar, vision, kinematics—to create a super strong internal model of the robot's movement using a continuous-time fusion backbone that stitches frames together smoothly.
Dev: The math behind it is pretty dense, but the core idea is using this slip and rolling contact factor to figure out exactly how fast the wheels are actually moving based on what you see on the ground.
Taro: That slip factor seems crucial because most of these SLAM systems assume perfect wheels, but real terrain has those weird moments where you're sliding or rolling unevenly.
Rosa: And they also have this kinematics-aware radar factor that adjusts how much they trust the radar readings based on how fast the robot is actually moving right then.
Dev: It’s about making sure that when the robot is moving quickly, the way we interpret a radar return changes because of that motion, so you don't get noisy data back.
Taro: What this means for autonomy is that you can expect robots to stay much more stable and accurate on rough terrain without needing a perfectly clear path or perfect sensor readings.
Rosa: It’s about moving past the lab tests and seeing if this level of robustness holds up when the robot is actually navigating a field or some kind of uneven surface for extended periods.
Dev: We need to check how that loop rate holds up under sustained stress, because if the latency gets too high, all that careful fusion just turns into a slow, inaccurate guess.
Taro: And honestly, the real question is how this system handles situations where the sensors themselves are degraded—like when there’s heavy dust or poor lighting interfering with the vision part of the stack.
Rosa: That’s exactly what we need to test next; seeing if RAGNAROK can maintain that alignment even when one of its main inputs starts to fail.
More episodes
- 2610.10846-Cross-Embodiment Robot Foundation World Models with Latent Actions
- 2610.10601-Teaching a Robot Dog New Tricks: Diverse Quadruped Skills via Combined Reinforcement and Imitation Learning with Adversarial Task Selection
- 2610.10637-TacHair: Tactile Contact-Distribution Guided Online Correction for Robotic Hair Stroking and Perception
- 2610.10646-Masked Generative Motion Planning with Geometry-Guided Token Search
- 2610.10812-Skill-SLM: Agent Skill-driven Small Language Models for Reliable Robot Operation
- 2610.10801-Same Action, Different Outcome: Variability in Dynamic Cloth Manipulation
- 2610.10810-Diagnosing and Recovering from Observation-Space Shift at Long-Horizon Skill Seams
- 2610.10748-TAPNAV: Humanoid Navigation through Tactile Active Perception
- 2610.10855-OmniHOI: Dexterous Hand-Object Interaction from Monocular Human Video
- 2610.11003-ActiveReg: Information-Driven Active Regional Probing for Partial-to-Full Bone Registration