Learning tactile perception from high-bandwidth single-point sensing
cs.RO, cs.LG
Submitted: 2026-09-21
Updated: 2026-09-23
Code: https://github.com/huggingface/lerobot
Project page: https://tna001ai.github.io/LeFlexiTac/docs.html
License: http://creativecommons.org/licenses/by/4.0/
The gist: Tactile sensing is increasingly being incorporated into learning-based robotic manipulation, yet many existing approaches rely on spatially distributed sensors.
Terminology
Abstract
Tactile sensing is increasingly being incorporated into learning-based robotic manipulation, yet many existing approaches rely on spatially distributed sensors. Here we introduce SpectRobot, a framework that transforms single-point tactile signals into compact time-frequency spectrograms. These spectrograms encode high-bandwidth tactile histories as fixed-size image-like representations. They can be processed by standard vision encoders and integrated into learning pipelines originally developed for vision, while preserving temporal and frequency information unavailable to conventional cameras. Rather than increasing spatial density through arrays of tactile elements, SpectRobot exploits the rich dynamics contained in sparse, high-bandwidth single-point measurements. In our implementation, the sensors are mounted away from the contact surface while remaining mechanically coupled to it, reducing direct exposure to wear and potentially improving robustness in harsh environments and for long-term deployment on dexterous robots. Our experiments demonstrate that: (1) a robot can exploit single-point vibration signals to solve a visually occluded manipulation task; (2) temporal history strongly influences policy performance, while sensing bandwidth controls the spectral information available, with measurements extending to 100 kHz; and (3) the same representation can be used across different tactile sensing technologies mediated by acceleration, force, or strain. We further show that capabilities previously associated with research-grade instrumentation can be accessed using readily available, off-the-shelf hardware. We believe that broader access to high-bandwidth tactile sensing could facilitate the integration of contact dynamics into embodied learning systems and, for some tasks, offer an alternative or complement to increasing the spatial density of tactile sensing.
Sources
- FlexiTac: A Low-Cost, Open-Source, Scalable Tactile Sensing Solution for Robotic Systems
- Play it by Ear: Learning Skills amidst Occlusion through Audio-Visual Imitation Learning
- Learning Precise, Contact-Rich Manipulation through Uncalibrated Tactile Skins
- eFlesh: Highly customizable Magnetic Touch Sensing using Cut-Cell Microstructures
- Touch begins where vision ends: Generalizable policies for contact-rich manipulation
- Tactile Genesis: Exploring Tactile Sensors at Scale for Learning Dexterous Tasks
- TacO: Benchmarking Tactile Sensors for Object Manipulation
- TacVLA: Contact-Aware Tactile Fusion for Robust Vision-Language-Action Manipulation
- VibeAct: Vibration to Actions for Contact-Rich Reactive Robot Dexterity
- AnySkin: Plug-and-play Skin Sensing for Robotic Touch
Related papers
- FMT x: An Efficient and Asymptotically Optimal Extension of the Fast Marching Tree for Dynamic Replanning
- MPCFormer: A physics-informed data-driven approach for explainable socially-aware autonomous driving
- RoboLab: A High-Fidelity Simulation Benchmark for Analysis of Task Generalist Policies
- HRDexDB: A 4D Dexterous Grasping Dataset Across Human and Multiple Robot Embodiments
- APT: Action Expert Pretraining Improves Instruction Generalization of Vision-Language-Action Policies
- Fine-tuning is Not Enough: A Parallel Framework for Collaborative Imitation and Reinforcement Learning in End-to-end Autonomous Driving