embodied-vr-feedback-3d-motor-imagery-bci

name	embodied-vr-feedback-3d-motor-imagery-bci
description	Embodied Virtual Reality feedback reshapes neural representations to support continuous 3D motor imagery decoding in brain-computer interfaces. First systematic investigation of embodied VR feedback during real-time 3D virtual limb control. Use when: (1) Designing VR-based BCI systems, (2) Studying motor imagery neural representations, (3) Comparing VR vs screen feedback modalities, (4) Investigating longitudinal BCI training effects. Activation: embodied VR feedback, motor imagery BCI, 3D virtual limb, VR vs screen, continuous BCI, neural representations reshaping, sensorimotor-parietal
license	Complete terms in LICENSE.txt
metadata	{"arxiv_id":"2605.29677","published":"2026-05-28","authors":"Niall McShane, Attila Korik, Karl McCreadie, Naomi Du Bois, Darryl Charles, Damien Coyle","journal":"Nature Biomedical Engineering (submitted)","zenodo_doi":"10.5281/zenodo.16047021","tags":["embodied-vr","bci","motor-imagery","neural-representations","continuous-decoding","vr-feedback","cnn-lstm","longitudinal-training"]}

Embodied VR Feedback Reshapes Neural Representations

arXiv:2605.29677 | Submitted: 2026-05-28 | Journal: Nature Biomedical Engineering (submitted)

Overview

首次系统性调查实时 3D 虚拟肢体控制中的具身 VR 反馈如何通过运动想象驱动，以及反馈模态和纵向训练如何塑造神经表征和解码性能。10 个受试者，10 个纵向 sessions。

Core Innovation

Embodied VR Feedback System

• First Systematic Investigation: 首次系统性调查具身 VR 反馈在实时 3D 虚拟肢体控制中的作用
• Longitudinal Training: 10 个受试者，10 个纵向训练 sessions
• Real-time 3D Control: 实时 3D 虚拟肢体控制，由运动想象驱动

Three Evaluation Strategies

1. Fixed Decoder Generalisation (FDG): 实际在线性能，固定解码器泛化
2. Sequential Adaptive Training (SAT): 定期重新训练，顺序适应训练
3. Within-Session Reconstruction (WSR): 会话内上限估计，会话内重建

CNN-LSTM Decoder

• VR 下 imagined movement correlations: r = 0.762
• Screen feedback baseline: r = 0.672
• VR 优势显著: 8.9-13.0% (p <= 0.002, d = 1.42-2.05)

Key Results

Performance Comparison

Feedback	Correlation	Improvement
VR	r = 0.762	8.9-13.0%
Screen	r = 0.672	baseline

• VR 在所有策略和运动维度上显著优于 screen
• VR 优势在固定解码器（无重新训练）下持续存在
• 具身 VR 反馈产生本质上更可解码和可泛化的神经表征

Statistical Analysis

• Linear Mixed-Effects Model: 反馈模态和运动轴主效应稳健
• 无交互效应
• 所有运动维度 VR 优势显著

Neurophysiological Findings

Enhanced Desynchronisation

• Sensorimotor-Parietal: VR 产生更强的 sensorimotor-parietal 去同步化
• Motor-Frontal Connectivity: 增强 motor-frontal 功能连接

Anterior Insula Engagement

• Pervasive Engagement: 所有频率波段的前部脑岛参与
• Real Movement Patterns: 与真实运动执行相关的模式

Superior Parietal Lobule Coupling

• Increased Coupling: 增加的上顶叶耦合
• Spatial Processing: 空间处理相关

Neural Representation Reshaping

VR vs Screen Feedback

• VR: 具身空间反馈
• Screen: 传统屏幕反馈
• Reshaping Effect: VR 重塑神经表征

Brain Network Changes

• Sensorimotor Network: 感觉运动网络激活增强
• Parietal Cortex: 顶叶皮层去同步化增强
• Frontal-Motor Connectivity: 额叶-运动连接增强

Applications

Continuous BCIs

• Next-generation BCI design principles
• Intuitive motor control
• Neurorehabilitation

VR-based Training

• Embodied feedback design
• Longitudinal training protocols
• Performance enhancement

Neural Rehabilitation

• Stroke rehabilitation
• Motor recovery
• Spatial feedback therapy

Key Design Principle

Embodied Spatial Feedback: 具身空间反馈作为下一代连续 BCI 的关键设计原则

Why VR Outperforms Screen?

1. Embodied Experience: 具身体验增强运动想象
2. Spatial Representation: 空间表征更接近真实运动
3. Neural Engagement: 神络参与更强
4. Functional Connectivity: 功能连接增强

Implementation

VR System Requirements

• Embodied Virtual Reality: 具身虚拟现实系统
• 3D Virtual Limb: 3D 虚拟肢体渲染
• Real-time Feedback: 实时反馈系统

Decoder Architecture

CNN-LSTM Decoder:
- CNN: Spatial feature extraction
- LSTM: Temporal sequence processing  
- Output: 3D movement trajectory

Training Protocol

• 10 Sessions: 10 个训练 sessions
• 10 Participants: 10 个受试者
• 3 Strategies: FDG, SAT, WSR

Clinical Relevance

Neurorehabilitation Applications

• Stroke rehabilitation
• Spinal cord injury recovery
• Motor function recovery

BCI Design Principles

• Embodied feedback as key design principle
• Spatial VR feedback enhances decoding
• Longitudinal training protocols

Data Availability

Zenodo DOI: https://doi.org/10.5281/zenodo.16047021

Citation

@article{mcshane2026embodiedvr,
  title={Embodied Virtual Reality Feedback Reshapes Neural Representations to Support Continuous Three-Dimensional Motor Imagery Decoding},
  author={McShane, Niall and Korik, Attila and McCreadie, Karl and Du Bois, Naomi and Charles, Darryl and Coyle, Damien},
  journal={arXiv preprint arXiv:2605.29677},
  year={2026},
  note={Submitted to Nature Biomedical Engineering}
}