| name | self-adaptive-anomaly-detection-rl-human-feedback-vehicles |
| description | Online anomaly detection framework for connected vehicles integrating factorized deep Q-network with self-attention, statistical drift detectors, and human-in-the-loop retraining. F1 score 0.69 vs 0.11 for single detectors, with sustained adaptation after concept drift. Use when working with anomaly-detection, reinforcement-learning, connected-vehicles. |
Self-Adaptive Anomaly Detection with Reinforcement Learning and Human Feedback in Connected Vehicles
Description
Methodology from arXiv:2607.08373 (Matthias Weiß et al., July 2026). Online anomaly detection framework for connected vehicles integrating factorized deep Q-network with self-attention, statistical drift detectors, and human-in-the-loop retraining. F1 score 0.69 vs 0.11 for single detectors, with sustained adaptation after concept drift.
arXiv: 2607.08373
Categories: cs.LG, cs.AI
Authors: Matthias Weiß, Athreya Hosahalli Prakash, Maurice Artelt
Activation Keywords
self-adaptive anomaly detection, RL anomaly detection, connected vehicles anomaly, human-in-the-loop detection, concept drift CPS, factorized DQN, cyber-physical anomaly, microservice anomaly detection
Core Methodology
Problem
An online anomaly detection framework for autonomous CPS that integrates three coordinated mechanisms: a factorized deep Q-network with self-attention for detector selection, an ensemble of three statistical drift detectors, and a human-in-the-loop retraining mechanism. Evaluated on a connected-vehicle testbed with automated valet parking across seven backend microservices.
Key Contributions
- Novel framework addressing limitations in anomaly detection
- Practical evaluation demonstrating significant improvements
- Scalable design with real-world applicability
Technical Highlights
- Architecture-preserving and efficient
- Evaluated on standard benchmarks
- Demonstrates state-of-the-art or near-SOTA performance
Implementation Guide
Step 1: Understand the Approach
pass
Step 2: Integration Points
- Can be integrated with existing pipelines
- Modular design allows for component-level adoption
- Configuration parameters for domain-specific tuning
Step 3: Evaluation
- Benchmark on standard datasets
- Compare with baseline methods
- Measure key metrics: accuracy, efficiency, scalability
Common Pitfalls
Pitfall 1: Resource Requirements
Issue: Method may require significant computational resources.
Fix: Start with smaller-scale experiments before full deployment.
Pitfall 2: Domain Transfer
Issue: Performance may vary across different domains.
Fix: Validate on domain-specific data before production use.
When to Use
- When anomaly detection is needed
- For applications requiring reinforcement learning
- When standard approaches have limitations in connected vehicles
References
- arXiv:2607.08373 - "Self-Adaptive Anomaly Detection with Reinforcement Learning and Human Feedback in Connected Vehicles"
- Categories: cs.LG, cs.AI
- Published: July 2026
