An Open-Access Multi-modal Dataset for Cognitive, Motor, and Cognitive-Motor Tasks

summary

Video file (mp4)

The gist

The authors present an open-access, multi-modal dataset integrating neurophysiological (EEG, fNIRS), physiological (ECG), behavioral, and subjective measures collected from 30 healthy participants

In short

Researchers created a public, open-access dataset integrating EEG, fNIRS, ECG, and behavioral data from 30 healthy participants across seven hierarchical cognitive and motor tasks. This resource allows researchers to study complex interactions between thinking and moving in real-world scenarios.

Key concepts

Multimodal Dataset
A collection of different types of data—like brain activity (EEG/fNIRS), heart rate (ECG), and actions (behavioral)—collected simultaneously from the same participants. This allows scientists to see how different physical and mental processes relate to each other.
Hierarchical Tasks
Seven experimental conditions were designed in increasing difficulty, starting with simple cognitive tasks like arithmetic and progressing to complex combined tasks that require simultaneous thinking and movement. This structure helps test hypotheses about how these processes interact at different levels of challenge.
BIDS Format
Brain Imaging Data Structure is a standardized, open format for storing neurophysiological data. Using this standard ensures that the raw EEG, fNIRS, and other measurements are organized consistently so that different research tools can easily access and analyze the data.

Terminology used across episodes

This episode discusses

The paper

An Open-Access Multi-modal Dataset for Cognitive, Motor, and Cognitive-Motor Tasks · Read on arXiv

Zaineb Ajra, Gr´egoire Vergotte, St´ephane Perrey, Lilian Evra, Simon Pla, G´erard Dray

EuroMov Digital Health in Motion · IMT Mines Ales

The incorporation of neuroimaging techniques such as electroenchephalography (EEG) and functional near-infrared spectroscopy (fNIRS) has provided new opportunities for the analysis of dynamic brain processes involved in cognitive and motor functions. Despite the great contribution of the open-access neuroimaging datasets to neuroscience studies, they have mainly remained on a single modality and isolated task paradigms performed in a controlled environments. These limitations restrict the analysis of multi-task effects in real-world applications, thus creating a gap in the understanding of how cognitive and motor processes interact in daily life activities. To address these limitations, we present a multi-modal dataset containing neurophysiological (EEG, fNIRS), physiological (ECG), behavioral, and subjective measures collected from 30 healthy participants over three sessions. This dataset includes a hierarchical series of seven tasks ranging from single cognitive and motor activities, such as N-back, motor, passive motor, mental arithmetic and motor imagery, to combined cognitive-motor interactions simulating real life scenarios. This raw dataset provides a resource for developing advanced preprocessing methods and analysis pipelines, with potential applications in brain-computer interfaces, neurorehabilitation, and other fields requiring an understanding of multi-tasks brain dynamics. https://doi.org/10.18112/openneuro.ds007554.v1.0.0

DOI: 10.1038/s41597-026-08125-y

Transcript

Introduction to the show: ident: Genomics Radio. Generated commentary on the latest computational biology and genomics papers.

Ines: Today's paper: "An Open-Access Multi-modal Dataset for Cognitive, Motor, and Cognitive-Motor Tasks".

Marcus: The authors present an open-access, multi-modal dataset integrating neurophysiological (EEG, fNIRS), physiological (ECG), behavioral, and subjective measures collected from 30 healthy participants across seven hierarchical cognitive and motor tasks.

Ines: First, who's behind it and why it matters.

Paper summary: Ines: So we've covered a bit about the setup for this open-access resource by looking at its structure and how it addresses previous limitations in the field seventeen <ref:2603.22933#pg1>. The main thesis of "An Open-Access Multi-modal Dataset for Cognitive, Motor, and Cognitive-Motor Tasks" is that existing neuroimaging datasets are too siloed, focusing on single modalities or isolated tasks in controlled settings <ref:2603.22933#pg0>.

Marcus: That's right; they argue that this lack of multi-task datasets restricts our ability to study how cognitive and motor processes actually interact during daily life activities, which is the gap this dataset aims to fill seventeen <ref:2603.22933#pg1>. They propose a continuum from lab-based single-task designs up through multitask and more naturalistic experiments <ref:2603.22933#pg1>.

Yuki: It's interesting because that continuum approach suggests a way to test the robustness and transferability of neurophysiological methods as we move toward more complex, real-world experimental designs <ref:2603.22933#pg1>. This connects the lab work to broader behavioral contexts.

Ines: And what they claim is that by providing this comprehensive platform integrating EEG, fNIRS, ECG, behavior, and subjective measures from thirty participants across seven hierarchical tasks—ranging from simple mental arithmetic to the full cognitive-motor integration—they enable testing multiple hypotheses about these interactions <ref:2603.22933#pg0>.

Marcus: That comprehensive nature is what makes it valuable; it's not just one piece of data, but a synchronized set that allows researchers to test relationships between different brain-behavior functional organizations <ref:2603.22933#pg1>. It’s about seeing the whole system together, not just isolated parts.

Yuki: And from a population genetics standpoint, having this level of integrated data allows us to potentially map out how these complex behaviors and cognitive functions are organized across individuals in a more holistic way seventeen <ref:2603.22933#pg1>. It moves beyond simple correlation into understanding functional organization.

Ines: So, the core message is that we need datasets like this to move past studying specific processes in detail and start exploring the complex relationships between those processes when they happen together <ref:2603.22933#pg0>.

Marcus: Exactly; it provides the necessary data foundation for multivariate analytical methods to get a better interpretability of these complex signals, which is what researchers are hoping to achieve with this resource fifteen <ref:2603.22933#pg1>.

Yuki: It’s about providing the raw material to challenge existing models of how our species organizes its cognitive and motor capabilities in dynamic situations seventeen <ref:2603.22933#pg1>.

Conclusion: Ines: Looking at the paper "An Open-Access Multi-modal Dataset for Cognitive, Motor, and Cognitive-Motor Tasks," the authors highlight that by creating this integrated resource across seven hierarchical tasks, they are offering a new way to test hypotheses about how cognitive functions and motor skills work together in real life scenarios <ref:2603.22933#pg0>.

Marcus: I think the implication for the genomics data science community is that we now have a standardized way to feed complex interaction data into our statistical models, which should allow us to build more sophisticated predictive models than we could with single-modality studies seventeen <ref:2603.22933#pg1>.

Yuki: From a population view, this resource suggests that our understanding of cognitive and motor organization in the species might be better informed when we can anchor findings to these rich, multi-modal behavioral and physiological data points seventeen <ref:2603.22933#pg1>.

Ines: Essentially, the authors are saying that to truly understand how we operate in dynamic environments, we need data that captures those simultaneous interactions between our thinking and our doing <ref:2603.22933#pg0>.

Marcus: And they've provided a publicly available dataset in BIDS format on OpenNeuro, which is a huge step forward for accessibility and reproducibility in this area seventeen <ref:2603.22933#pg1>. It makes this kind of research much more accessible to the wider community.

Yuki: That availability is key because it means other researchers, perhaps even those outside our immediate field, can use this data to explore how these complex processes manifest across different cognitive and motor profiles within a population seventeen <ref:2603.22933#pg1>.

Ines: It really comes down to providing the raw material for testing hypotheses about the real-world coordination of our minds and bodies <ref:2603.22933#pg0>. That’s the big picture here.

Marcus: And it's a testament to how combining different data streams—neurophysiology, physiology, and behavior—can lead to a more robust understanding of complex biological systems seventeen <ref:2603.22933#pg1>.

More episodes

← Home