flow-matching-in-context-priors-brain-dynamics

name	flow-matching-in-context-priors-brain-dynamics
description	Flow Matching with In-Context Priors for Out-of-Distribution Brain Dynamics — per-timestep conditioned diffusion transformer for generating realistic fMRI brain dynamics during unseen cognitive tasks. Activation: flow matching, fMRI generation, counterfactual neuroscience, brain dynamics, diffusion transformer, in-context prior.
category	neuroscience

Context

arXiv:2606.11833 - Flow matching and diffusion models enable conditional generation across domains, but generative models of neural time series have remained restricted to categorical conditioning, precluding compositional and zero-shot generalization. This paper proposes a per-timestep conditioned diffusion transformer for generating realistic fMRI brain dynamics during unseen cognitive tasks by injecting compositional language and optional spatial priors in-context.

Key Innovation: Zero-shot generation of whole-cortex fMRI dynamics for unseen cognitive tasks, enabling counterfactual neuroscience and in-silico experimental design before empirical validation.

Methodology Score: 10/10 (theoretical framework + practical implementation + compositional generalization)

Core Methodology

1. Per-Timestep Conditioned Diffusion Transformer

Architecture: Diffusion transformer that conditions on both compositional language descriptions and optional spatial priors at each timestep, enabling:

• Compositional task specification (e.g., "visual task with attention modulation")
• Zero-shot generalization to unseen task combinations
• Counterfactual brain dynamics generation

Key Components:

# Conceptual architecture (not actual code from paper)
class FlowMatchingBrainDynamics:
    def __init__(self):
        self.language_encoder = LanguageEncoder()  # encode task descriptions
        self.spatial_prior_module = SpatialPriorModule()  # optional spatial masks
        self.diffusion_transformer = DiffusionTransformer()  # fMRI generation
    
    def generate(self, task_description, spatial_prior=None):
        # Per-timestep conditioning
        language_embedding = self.language_encoder(task_description)
        if spatial_prior:
            spatial_embedding = self.spatial_prior_module(spatial_prior)
            conditioning = concatenate(language_embedding, spatial_embedding)
        else:
            conditioning = language_embedding
        
        # Flow matching generation
        fMRI_timeseries = self.diffusion_transformer.generate(conditioning)
        return fMRI_timeseries

2. In-Context Prior Injection

Language Pathway: Compositional task descriptions injected as in-context priors enable:

• Recovery of region-specific recruitment across tasks
• Generation of held-out spatial activation patterns
• Compositional structure retention for counterfactual specification

Spatial Prior Pathway (optional):

• Anchors generation in regions where language alone degrades
• Complements text pathway for improved accuracy
• Maintains compositional flexibility

3. Zero-Shot Evaluation Framework

Training Manifold Characterization:

• Evaluate across hundreds of held-out task conditions
• Characterize predictive performance relative to training manifold
• Measure region-specific recruitment accuracy

Counterfactual Neuroscience Applications:

• In-silico design of novel cognitive experiments
• Evaluation before empirical validation
• Hypothesis testing via generated brain dynamics

4. Flow Matching for fMRI

Advantages over Categorical Conditioning:

• Compositional generalization (combine task features)
• Zero-shot unseen task generation
• Flexible counterfactual specification

Technical Implementation:

• 4D fMRI signal modeling (whole-cortex dynamics)
• Conditional generation across task conditions
• Integration with existing fMRI preprocessing pipelines

Implementation Steps

1. Model Setup:

   • Initialize per-timestep conditioned diffusion transformer
   • Configure language encoder for task descriptions
   • Set up optional spatial prior module

2. Training:

   • Train on multi-task fMRI datasets (HCP, etc.)
   • Condition on task descriptions + optional spatial priors
   • Optimize flow matching objective

3. Zero-Shot Generation:

   • Specify compositional task descriptions
   • Generate fMRI dynamics for unseen task combinations
   • Evaluate region-specific activation patterns

4. Counterfactual Analysis:

   • Design novel cognitive experiments in-silico
   • Generate predicted brain dynamics
   • Validate against empirical data (if available)

Key Results

• Region-Specific Recruitment: Language alone recovers region-specific recruitment across tasks
• Spatial Activation Patterns: Held-out spatial patterns generated with high fidelity
• Compositional Generalization: Unseen task combinations generated zero-shot
• Spatial Prior Complementarity: Anchors generation where language degrades, retaining compositional structure

Pitfalls

1. Language Prior Limitations: Language alone may degrade in certain task regions; spatial priors needed for anchoring
2. Training Manifold Coverage: Zero-shot performance depends on training task diversity
3. Spatial Prior Availability: Optional spatial priors require additional data/processing
4. fMRI Preprocessing: Generated dynamics still require standard preprocessing for downstream tasks
5. Counterfactual Validation: In-silico predictions need empirical validation for reliability

Verification

1. Region Recruitment Accuracy: Compare generated region-specific recruitment against held-out empirical data
2. Spatial Pattern Correlation: Measure correlation between generated and actual spatial activation patterns
3. Compositional Consistency: Verify compositional task combinations produce coherent dynamics
4. Training Manifold Mapping: Characterize predictive performance relative to training manifold coverage

Activation Keywords

flow matching, fMRI generation, brain dynamics, counterfactual neuroscience, diffusion transformer, in-context prior, zero-shot generation, compositional task, spatial prior, whole-cortex dynamics, neural time series, cognitive task generation, in-silico experiment

Applications

• Counterfactual neuroscience (hypothesis testing before empirical validation)
• In-silico cognitive experiment design
• fMRI foundation model development
• Brain dynamics prediction for novel tasks
• Multi-task fMRI data augmentation
• Neuroscience hypothesis exploration

References

• arXiv:2606.11833 - Flow Matching with In-Context Priors for Out-of-Distribution Brain Dynamics
• Gijsen et al. (2026) - Code and pretrained models available at GitHub
• Flow matching theory (Lipman et al., 2022)
• Diffusion transformers for conditional generation
• HCP multi-task fMRI datasets