feedback-hebbian-continual-learning
Backpropagation-free continual learning using feedback-aligned Hebbian plasticity. Replaces backpropagation with local Hebbian updates guided by random feedback connections, enabling biologically plausible continual learning without catastrophic forgetting. Use for bio-inspired learning, continual/incremental learning, and backprop-free neural network training. Activation: backprop-free learning, feedback alignment, Hebbian continual learning, local learning rules, biologically plausible training, feedback Hebbian
Datos de origen
- Repositorio
- hiyenwong/ai_collection
- Última actividad en el origen
- 4 de junio de 2026 a las 13:32
- Idioma detectado de SKILL.md
- inglés
- Estrellas
- 2
- Forks
- 0
Opciones de instalación
De forma predeterminada está seleccionado el prompt que primero revisa el origen. Puedes cambiar a un comando directo o descargar una copia local.
Revisa los archivos de origen
Lee SKILL.md y los archivos complementarios que muestra SkillsMP antes de decidir si quieres instalarlo.
Mostrando SKILL.md
SKILL.md
Instrucciones de origen · Vista previa de solo lectura- name
- feedback-hebbian-continual-learning
- description
- Backpropagation-free continual learning using feedback-aligned Hebbian plasticity. Replaces backpropagation with local Hebbian updates guided by random feedback connections, enabling biologically plausible continual learning without catastrophic forgetting. Use for bio-inspired learning, continual/incremental learning, and backprop-free neural network training. Activation: backprop-free learning, feedback alignment, Hebbian continual learning, local learning rules, biologically plausible training, feedback Hebbian
# Backpropagation-Free Feedback-Hebbian Continual Learning
## Overview
Training framework that eliminates backpropagation by combining random feedback alignment with local Hebbian plasticity rules. Error signals are transmitted through fixed random feedback connections, while forward weights are updated using biologically plausible local learning rules.
## Core Architecture
### Forward Path
- Standard feedforward or recurrent network
- Forward weights updated via local Hebbian rules
- No gradient computation or backpropagation
### Feedback Path
- Fixed random feedback weights (initialized once, never updated)
- Transmit error signals from output to hidden layers
- Replace the need for weight transport (symmetric backprop)
### Local Learning Rule
- Hebbian plasticity modulated by feedback error signals
- Each synapse updates based only on local pre/post activity and global error
- No need to store gradients or compute Jacobians
## Implementation Pattern
```python
class FeedbackHebbianNetwork:
def __init__(self, layers, feedback_scale=0.1, hebbian_lr=0.001):
self.layers = layers
self.forward_weights = [torch.randn(l, n) * 0.1
for l, n in zip(layers[:-1], layers[1:])]
self.feedback_weights = [torch.randn(n, l) * feedback_scale
for l, n in zip(layers[:-1], layers[1:])]
self.lr = hebbian_lr
def forward(self, x):
activations = [x]
for w in self.forward_weights:
h = torch.relu(activations[-1] @ w)
activations.append(h)
return activations
def hebbian_update(self, activations, target):
output = activations[-1]
error = output - target
for i in range(len(self.forward_weights) - 1, -1, -1):
local_error = error if i == len(self.forward_weights) - 1 else local_error
local_error = local_error @ self.feedback_weights[i]
pre = activations[i]
delta_w = self.lr * (pre.T @ local_error)
self.forward_weights[i] += delta_w
```
## Continual Learning Properties
- **No catastrophic forgetting**: Local updates don't overwrite all weights simultaneously
- **No replay buffer needed**: Natural resilience to sequential task learning
- **Biological plausibility**: No weight transport, no global error gradient
- **Scalability**: No backpropagation memory overhead
## References
- Josh Li, Fow-sen Choa, "A Backpropagation-Free Feedback-Hebbian Network for Continual Learning Dynamics", arXiv:2601.06758v3, 2026-01-11
Ver en GitHub