group-intervention-causal-discovery-subsystems

name	group-intervention-causal-discovery-subsystems
description	Group intervention-based causal discovery for identifying causal structure in deep neural network subsystems — extending causal discovery from single neurons to functional subnetwork groups. Activation: causal discovery, deep network, subsystem, group intervention, causal structure, neural circuit, interpretability, interventional causality.

Group Intervention Causal Discovery in Deep Network Subsystems

Causal discovery framework that extends interventional causality analysis from individual neurons to functional subsystems within deep neural networks, revealing mesoscale computational circuits.

Metadata

• Source: arXiv:2510.23906
• Authors: Wasim Ahmad, Sreejith Sreekumar, Vijay S. Raju
• Published: 2025-10-16
• Categories: cs.LG, cs.AI

Core Methodology

Key Innovation

Proposes group-level causal discovery for deep networks. Instead of treating each neuron individually (exponential search space) or each layer as a unit (too coarse), the method identifies functional subsystems — groups of neurons that work together — and discovers causal relationships between these subsystems via targeted interventions.

Technical Framework

1. Subsystem Identification: Cluster neurons by activation correlation patterns across diverse inputs → functional groups
2. Group Intervention Design: Systematically perturb subsystem outputs (ablation, activation scaling, noise injection) while observing effects on other subsystems
3. Causal Graph Construction: Build a directed causal graph where nodes=subsystems, edges=causal influences
4. Discovery Algorithm: Use interventional data to orient causal edges (resolving ambiguity from observational correlations)
5. Validation: Verify discovered causal structure predicts effects of novel interventions

Implementation Guide

Prerequisites

• Causal inference and discovery (Pearl's do-calculus, DAGs)
• Deep network interpretability
• Statistical hypothesis testing
• Activation clustering methods

Step-by-Step

1. Extract activations from all layers for a diverse input dataset
2. Cluster neurons into functional subsystems using activation correlation
3. Design interventions: For each subsystem pair (A, B), perturb A and measure B's response
4. Test causality: Apply conditional independence tests on interventional data
5. Construct DAG: Orient edges based on intervention outcomes
6. Validate: Predict effects of unseen perturbations using discovered causal graph

Code Example

import numpy as np
from sklearn.cluster import AgglomerativeClustering

def identify_subsystems(activations, n_subsystems=20):
    """Cluster neurons into functional subsystems by activation correlation."""
    # activations: [n_samples, n_neurons]
    corr_matrix = np.corrcoef(activations.T)
    # Hierarchical clustering on correlation distance
    distance_matrix = 1 - np.abs(corr_matrix)
    clustering = AgglomerativeClustering(
        n_clusters=n_subsystems,
        metric='precomputed',
        linkage='average'
    )
    labels = clustering.fit_predict(distance_matrix)
    return labels  # subsystem assignment per neuron

def group_intervention(model, subsystem_labels, target_subsystem, 
                       intervention_fn, inputs):
    """Apply intervention to a subsystem and measure effects on others."""
    n_subsystems = len(set(subsystem_labels))
    effects = {}
    
    # Register hooks for all subsystems
    def make_hook(sub_id):
        def hook(module, input, output):
            if sub_id == target_subsystem:
                return intervention_fn(output)
            return output
        return hook
    
    # Measure baseline and intervened activations
    with torch.no_grad():
        baseline = model(inputs)
    
    # Apply intervention and measure changes in other subsystems
    
    
     effects  

Applications

• Network Interpretability: Understand computational pathways in deep networks at mesoscale
• Neural Circuit Discovery: Identify functional subnetworks analogous to brain circuits
• Model Debugging: Trace error propagation through causal subsystem chains
• Architecture Design: Inform better architectures based on causal subsystem analysis

Pitfalls

• Subsystem identification depends heavily on clustering method and granularity
• Intervention design is combinatorial — O(n²) for n subsystems
• Causal relationships may be context-dependent (vary across input distributions)
• Intervention effects can be nonlinear and non-additive

Related Skills

• causal-brain-network-inference
• computational-lesions-brain-alignment
• neural-population-decoding
• ultrastructure-to-dynamics-compiler