neurocogmap-llm-cognitive-organization

name	neurocogmap-llm-cognitive-organization
description	NeuroCogMap framework for mapping cognitive organization in LLMs using neuroscience-inspired methods, linking LLM internal representations to human cortical function
tags	["llm-interpretability","cognitive-neuroscience","brain-alignment","functional-parcels","cognitive-hierarchy"]
arxiv_id	2607.00397
date_created	2026-07-02T00:00:00.000Z

NeuroCogMap: Cognitive Organization of Large Language Models

Overview

NeuroCogMap is a cognitive neuroscience-inspired framework that organizes internal features of LLMs into functional parcels and links them to interpretable functions, cognitive capabilities, and a cognitive hierarchy. This approach bridges artificial and biological cognition by treating LLM internal representations analogously to brain functional organization.

Core Methodology

1. Functional Parcel Organization

Concept: Treat LLM internal features (activations, representations) as analogous to brain functional parcels (regions).

Process:

• Extract internal features from multiple layers of LLM
• Apply clustering/parcellation algorithms to identify functional units
• Map parcels to semantic functions and cognitive capabilities
• Validate stability across different models and tasks

Implementation:

# Pseudocode for functional parcellation
from sklearn.cluster import SpectralClustering
import torch

def extract_functional_parcels(model, dataset):
    """
    Extract and cluster internal representations into functional parcels
    """
    # Collect activations across layers
    activations = []
    for layer in model.layers:
        layer_acts = get_layer_activations(layer, dataset)
        activations.append(layer_acts)
    
    # Concatenate multi-layer features
    features = torch.cat(activations, dim=-1)
    
    # Apply spectral clustering (like brain parcellation)
    n_parcels = 50  # or determine via elbow method
    clustering = SpectralClustering(n_clusters=n_parcels)
    parcel_labels = clustering.fit_predict(features)
    
    return parcel_labels, features

2. Cognitive Hierarchy Construction

Concept: Organize parcels into a hierarchy reflecting cognitive complexity, from low-level features to high-level abstract reasoning.

Hierarchy Levels:

• Level 1 (Sensory): Basic token/word features, surface patterns
• Level 2 (Semantic): Word meanings, entity recognition
• Level 3 (Relational): Syntax, logical relationships
• Level 4 (Pragmatic): Context, intent, discourse
• Level 5 (Meta-cognitive): Reasoning, planning, self-monitoring

Validation:

• Compare hierarchy to established cognitive taxonomies
• Test hierarchical organization via perturbation experiments
• Verify progression through causal interventions

3. Failure Mode Mapping

Concept: Major LLM failures correspond to disruptions in specific cognitive systems.

Failure Types & Signatures:

Failure Mode	Cognitive System	Internal Signature
Hallucination	Representational grounding	Weak connectivity between semantic and factual parcels
Bias	Value/priority system	Overactivation of stereotypical association parcels
Refusal Failure	Behavioral control	Disrupted inhibition from control to generation parcels
Sycophancy	Social cognition	Overweighting user-agreement parcels vs. truth parcels

Detection Pipeline:

def detect_failure_mode(model, input_text):
    """
    Detect LLM failure mode via internal signature analysis
    """
    # Get parcel activations for input
    parcel_acts = get_parcel_activations(model, input_text)
    
    # Compute signature scores
    signatures = {
        'hallucination': compute_hallucination_signature(parcel_acts),
        'bias': compute_bias_signature(parcel_acts),
        'refusal_failure': compute_refusal_signature(parcel_acts),
        'sycophancy': compute_sycophancy_signature(parcel_acts)
    }
    
    # Return dominant failure mode
    return max(signatures, key=signatures.get)

4. Brain-LLM Alignment

Concept: Use NeuroCogMap to improve prediction of human brain responses during language comprehension.

Method:

• Collect fMRI data during naturalistic language comprehension
• Extract brain responses in higher-order association cortex
• Compare to LLM parcel activations for same stimuli
• Optimize alignment via linear mapping or CKA similarity

Key Finding: Strongest brain-LLM correspondence in:

• Default mode network (DMN)
• Frontoparietal control network
• Temporal language areas

Implementation:

from sklearn.cross_decomposition import CCA

def align_brain_llm(fmri_data, llm_parcels):
    """
    Align fMRI responses to LLM parcel activations
    """
    # Canonical Correlation Analysis
    cca = CCA(n_components=10)
    fmri_proj, llm_proj = cca.fit_transform(fmri_data, llm_parcels)
    
    # Compute correlation
    correlations = [np.corrcoef(fmri_proj[:, i], llm_proj[:, i])[0, 1] 
                    for i in range(10)]
    
    return np.mean(correlations)

Applications

1. Mechanism-Guided Intervention

Use Case: Target specific cognitive systems to fix failure modes.

Approach:

• Identify disrupted parcels via signature analysis
• Apply targeted fine-tuning or prompting to restore function
• Validate improvement via signature reduction

Example: Fix hallucination by strengthening factual grounding parcels through retrieval-augmented training.

2. Human Cognitive Model Refinement

Use Case: Use LLM internal signatures to refine classical cognitive models.

Approach:

• Extract LLM latent strategies from parcel dynamics
• Compare to human decision-making models (e.g., drift-diffusion, reinforcement learning)
• Identify gaps and propose model extensions

Example: LLM reveals hierarchical evidence accumulation strategy not captured by flat drift-diffusion models.

3. Cross-Model Comparison

Use Case: Compare cognitive organization across different LLM architectures and training regimes.

Metrics:

• Parcel stability (consistency across random seeds)
• Hierarchical organization (correlation with cognitive complexity)
• Brain alignment strength (CKA with fMRI data)

Finding: Larger models show more stable and hierarchically organized parcels, with stronger brain alignment.

Implementation Workflow

Step 1: Data Collection

# Collect diverse dataset covering multiple cognitive tasks
dataset = {
    'reasoning': load_math_reasoning_data(),
    'knowledge': load_factual_qa_data(),
    'language': load_natural_language_data(),
    'social': load_social_reasoning_data()
}

Step 2: Feature Extraction

# Extract multi-layer activations
all_features = {}
for task_name, task_data in dataset.items():
    features = extract_functional_parcels(model, task_data)
    all_features[task_name] = features

Step 3: Parcellation

# Cluster features into parcels
n_parcels = 50
parcel_labels = cluster_features(all_features, n_parcels)

Step 4: Cognitive Mapping

# Map parcels to cognitive functions
cognitive_map = {}
for parcel_id in range(n_parcels):
    function = identify_parcel_function(model, parcel_id, dataset)
    cognitive_map[parcel_id] = function

Step 5: Hierarchy Construction

# Organize parcels into cognitive hierarchy
hierarchy = build_cognitive_hierarchy(cognitive_map)

Step 6: Validation

# Validate against brain data
brain_alignment = validate_brain_alignment(model, fmri_data, parcel_activations)

# Validate failure detection
failure_accuracy = validate_failure_detection(model, failure_dataset)

Pitfalls & Limitations

1. Parcellation Granularity

• Issue: Too few parcels lose detail; too many create noise
• Solution: Use elbow method or silhouette score to determine optimal n
• Tip: Start with 30-70 parcels for GPT-scale models

2. Task Diversity

• Issue: Limited task coverage leads to incomplete cognitive map
• Solution: Include diverse tasks (reasoning, knowledge, social, language)
• Tip: Minimum 5-10 task categories

3. Model Architecture Dependence

• Issue: Parcels may not transfer across architectures (transformer vs. RNN)
• Solution: Validate within architecture family first
• Tip: Cross-architecture comparison requires careful alignment

4. Brain Data Quality

• Issue: Noisy fMRI data reduces alignment strength
• Solution: Use high-quality datasets (e.g., narrative fMRI)
• Tip: Focus on higher-order cortex where signal is strongest

5. Causal Interpretation

• Issue: Correlation ≠ causation in parcel-function mapping
• Solution: Use perturbation experiments (ablation, intervention)
• Tip: Validate with targeted fine-tuning or prompting

Related Work

Neuroscience Foundations

• Brain parcellation: Brodmann areas, Yeo networks, Schaefer atlas
• Cognitive hierarchy: Miller & Cohen (2001) prefrontal hierarchy
• Predictive coding: Friston (2010) free energy principle

LLM Interpretability

• Mechanistic interpretability: Olah et al. (2020) circuit analysis
• Probing classifiers: Belinkov & Glass (2019) linguistic probes
• Representation similarity: Khaligh-Razavi & Kriegeskorte (2014) RSA

Brain-LLM Alignment

• Schrimpf et al. (2021): Brain-score for language models
• Tuckute et al. (2024): fMRI alignment with GPT activations
• Ivanova et al. (2024): Language network selectivity in LLMs

Research Opportunities

1. Temporal Dynamics

• Question: How do parcel activations evolve during generation?
• Approach: Track parcel dynamics across token positions
• Hypothesis: Cognitive hierarchy reflects temporal processing stages

2. Developmental Trajectories

• Question: How does cognitive organization emerge during training?
• Approach: Analyze checkpoints across training
• Hypothesis: Hierarchical organization emerges progressively

3. Multilingual Cognition

• Question: Do different languages engage different parcels?
• Approach: Compare parcel activations across languages
• Hypothesis: Universal cognitive parcels with language-specific modulation

4. Embodied Cognition

• Question: Can sensorimotor grounding improve cognitive organization?
• Approach: Train LLMs with multimodal inputs (text + vision + action)
• Hypothesis: Embodied training leads to more human-like cognitive hierarchy

Key Findings Summary

1. Stable Parcels: LLM internal representations form stable, semantically coherent functional parcels
2. Cognitive Hierarchy: Parcels organize hierarchically from low-level features to high-level reasoning
3. Failure Signatures: Major LLM failures correspond to specific cognitive system disruptions
4. Brain Alignment: NeuroCogMap improves prediction of human cortical responses, especially in higher-order association cortex
5. Cross-Model Conservation: Functional organization is partly conserved across different LLM architectures
6. Intervention Targets: Specific parcels can be targeted to fix failure modes
7. Cognitive Insights: LLM internal signatures reveal latent strategies for refining human cognitive models

References

• arXiv: 2607.00397 (2026)
• Authors: Zhongxiang Sun, Haolang Lu, Qiang Ma, et al.
• Code: Not yet released (check paper for updates)
• Data: Uses standard LLM benchmarks and fMRI datasets

Citation

@article{sun2026neurocogmap,
  title={NeuroCogMap Reveals Cognitive Organization of Large Language Models},
  author={Sun, Zhongxiang and Lu, Haolang and Ma, Qiang and Li, Qi and Wang, Qipeng and Pang, Liang and Liu, Chenyu and Li, Qiankun and Sun, Hao and Wang, Kun and Zeng, Yi and Xu, Jun and Li, Guoqi and Wen, Ji-Rong},
  journal={arXiv preprint arXiv:2607.00397},
  year={2026}
}