meta-learning-in-context-brain-decoding-v4

name	meta-learning-in-context-brain-decoding-v4
description	BrainCoDec v4 — Foundation framework for training-free cross-subject fMRI-based semantic visual decoding via meta-optimized in-context learning. Achieves zero-shot generalization across subjects and scanners without anatomical alignment or stimulus overlap. Use when: cross-subject brain decoding, fMRI visual reconstruction, training-free neural decoding, meta-learning for neuroscience, brain-computer interfaces. Trigger: brain decoding, fMRI decoding, cross-subject, meta-learning in-context, visual reconstruction, brain codec, BrainCoDec, zero-shot brain decoding, semantic fMRI.
version	1.0.0
author	Research Synthesis (arXiv:2604.08537)
license	MIT
metadata	{"hermes":{"tags":["brain-decoding","fMRI","meta-learning","cross-subject","visual-reconstruction","training-free"],"source_paper":"Meta-learning In-Context Enables Training-Free Cross Subject Brain Decoding (arXiv:2604.08537)","citations":"CVPR 2026 accepted","github":"https://github.com/ezacngm/brainCodec"}}

BrainCoDec v4: Training-Free Cross-Subject Brain Decoding

Overview

BrainCoDec uses meta-optimized in-context learning to perform fMRI-based semantic visual decoding WITHOUT any subject-specific training. It achieves zero-shot generalization across subjects and scanners by inverting a per-voxel visual response encoder through hierarchical inference.

Key breakthrough: No anatomical alignment needed, no stimulus overlap required between source and target subjects.

Core Architecture

┌─────────────────────────────────────────────────┐
│  Source Subject (Training)                       │
│  ┌─────────────┐    ┌──────────────────────┐    │
│  │ fMRI voxels │───→│ Per-voxel response   │    │
│  │  (N×V)      │    │ encoder f(·)         │    │
│  └─────────────┘    └──────────┬───────────┘    │
│                               ↓                 │
│                    ┌──────────────────────┐     │
│                    │ Meta-optimized       │     │
│                    │ context retriever    │     │
│                    └──────────────────────┘     │
└─────────────────────────────────────────────────┘
                       ↓
┌─────────────────────────────────────────────────┐
│  Target Subject (Zero-Shot, NO Training)         │
│  ┌─────────────┐    ┌──────────────────────┐    │
│  │ fMRI voxels │───→│ Hierarchical         │    │
│  │  (M×V)      │    │ inference via        │    │
│  └─────────────┘    │ context inversion    │    │
│                     └──────────┬───────────┘    │
│                                ↓                 │
│                     ┌──────────────────────┐    │
│                     │ Semantic decoding    │    │
│                     │ (text/image output)  │    │
│                     └──────────────────────┘    │
└─────────────────────────────────────────────────┘

Key Methodology

1. Per-Voxel Response Encoder

Each voxel's response is modeled as a function of visual features:

• Encode stimulus features → predicted voxel responses
• Learn mapping without subject-specific fine-tuning

2. Meta-Optimized In-Context Learning

• Meta-train on multiple source subjects
• Learn to retrieve relevant context for novel subjects
• No gradient updates needed at test time

3. Hierarchical Inference

• Invert the encoder to recover stimulus semantics from fMRI
• Multi-level inference from low-level visual to high-level semantic features

Implementation Pattern

# Core inference flow (pseudo-code based on paper)
class BrainCoDec:
    def __init__(self, meta_model):
        self.encoder = meta_model.voxel_encoder
        self.retriever = meta_model.context_retriever
    
    def decode(self, target_fmri):
        # Zero-shot: no subject-specific training needed
        context = self.retriever.retrieve(target_fmri)
        semantics = self.encoder.invert(target_fmri, context)
        return semantics

Key Results

• Training-free cross-subject generalization
• Cross-scanner generalization without anatomical alignment
• No stimulus overlap required between subjects
• Accepted to CVPR 2026

Applications

• Brain-computer interfaces (BCI)
• Cognitive neuroscience research
• Clinical fMRI analysis
• Multi-site neuroimaging studies

Activation Keywords

• brain decoding, fMRI decoding, cross-subject decoding
• meta-learning in-context, training-free decoding
• visual reconstruction from brain activity
• BrainCoDec, brain codec
• 脑解码, 跨被试解码, 元学习上下文

References

• Mu Nan, Muquan Yu, et al. "Meta-learning In-Context Enables Training-Free Cross Subject Brain Decoding." CVPR 2026. arXiv:2604.08537
• Code: https://github.com/ezacngm/brainCodec