kinematic-zero-shot-bci-decoding

name	kinematic-zero-shot-bci-decoding
description	Zero-shot handwriting BCI decoding via conserved kinematic representations. Aligns neural activity to imagined kinematics for open-vocabulary character decoding without per-character training data. Activation: zero-shot BCI, handwriting decoding, kinematic primitives, intracortical BCI, logographic language BCI, motor cortex representation, imagined handwriting.

Kinematic Zero-Shot BCI Decoding

Methodology from arXiv:2605.19048 (Ravishankar & de Sa, 2026) — a computational framework for zero-shot character decoding in handwriting Brain-Computer Interfaces by aligning neural activity to imagined kinematic primitives.

Problem Statement

Existing intracortical BCIs that decode imagined handwriting achieve high communication rates for Latin scripts but require observing every character during training. This is infeasible for logographic languages (Chinese, Japanese) with thousands of characters. The fundamental question: does motor cortex represent handwriting through composition of shared kinematic primitives that can be exploited for zero-shot decoding?

Core Insight

Neural representations of kinematic strokes are robustly conserved across different character contexts. A stroke (e.g., horizontal line) has similar neural representation whether it appears in "A", "B", or "C". This compositional structure enables decoding of unseen characters by predicting kinematics rather than directly classifying characters.

Methodology

Two-Stage Architecture

1. Kinematics Prediction: Map neural activity → continuous kinematic trajectory (x, y position over time)
2. Character Recognition: Use predicted kinematics for character identification via retrieval or classification

Key Components

Neural-to-Kinematics Model

• Input: Intracortical spike counts / neural features from motor cortex
• Output: Predicted (x, y) trajectory coordinates
• Trained on known characters, generalizes to unseen characters via shared kinematic primitives

Unsupervised Recalibration

• Addresses neural non-stationarity across sessions
• No supervised single-letter data collection needed for recalibration
• Builds on domain adaptation for handwriting decoding

Zero-Shot Evaluation Protocol

• Cut out all snippets of specific characters from training data
• Test on completely unseen characters
• Measure hits@K retrieval accuracy

Results

• 64% hits@3 retrieval on unseen letters (English alphabet)
• Demonstrates compositional basis of complex motor control
• Establishes paradigm for open-vocabulary iBCI communication

Applications

• Logographic language BCIs: Chinese (3000+ common characters), Japanese (2000+ jouyou kanji)
• Reduced calibration burden: Minimal recalibration needed across sessions
• Open-vocabulary communication: Decode any character without per-character training
• Motor neuroscience: Evidence for compositional motor cortex representations

Technical Details

• Dataset: Intracortical micro-electrode recordings during imagined handwriting
• Participant: Single participant from prior study (Willett et al.)
• Evaluation: Leave-out-character protocol simulating zero-shot setting
• Model: Kinematics-prediction based approach vs. direct character classification

Comparison with Existing Approaches

Approach	Training Data	Zero-Shot	Logographic Support
Direct character classification	Per-character required	No	Infeasible (thousands of chars)
This work: kinematics prediction	Shared strokes only	Yes	Feasible (shared stroke primitives)

Implementation Considerations

# Conceptual architecture
class KinematicBCI:
    def __init__(self):
        self.neural_encoder = ...  # Maps neural spikes → latent features
        self.kinematics_decoder = ...  # Maps latent → (x,y) trajectory
        self.character_retriever = ...  # Maps trajectory → character ID
    
    def train(self, neural_data, kinematics_data, known_chars):
        # Train neural → kinematics mapping
        # Does NOT require per-character labels, only trajectory data
    
    def decode_zero_shot(self, neural_data):
        # Predict kinematics from neural activity
        predicted_traj = self.kinematics_decoder(self.neural_encoder(neural_data))
        # Retrieve character from trajectory (no training on this character needed)
        return self.character_retriever(predicted_traj)

Pitfalls

• No public logographic dataset yet: Current work demonstrates proof-of-concept in English; logographic evaluation requires new data collection
• Single participant: Results from one participant; generalization across users needs validation
• Ballistic vs. slow writing: Prior Chinese zero-shot work used slow single-letter writing (4-9 sec/char); this work targets ballistic continuous handwriting
• Non-stationarity: Neural signal drift across sessions remains a challenge despite unsupervised recalibration

Related Work

• Willett et al. (Nature 2021): High-performance handwriting BCI
• FALCON benchmark: Few-shot/zero-shot generalization evaluation
• Prior Chinese zero-shot handwriting: Single-letter, slow writing paradigm
• Unsupervised recalibration for BCI: Domain adaptation approaches

Citation

@article{ravishankar2026kinematic,
  title={Conserved Kinematic Representations enable Zero-Shot Decoding in Handwriting BCIs},
  author={Ravishankar, Srinivas and de Sa, Virginia},
  journal={arXiv preprint arXiv:2605.19048},
  year={2026}
}