| name | domain-adaptation-papers-guide |
| description | Comprehensive collection of domain adaptation research papers |
| metadata | {"openclaw":{"emoji":"๐","category":"domains","subcategory":"ai-ml","keywords":["domain adaptation","transfer learning","distribution shift","domain gap","UDA","domain generalization"],"source":"https://github.com/zhaoxin94/awesome-domain-adaptation"}} |
Domain Adaptation Papers Guide
Overview
Domain adaptation addresses the problem of training models on one data distribution (source domain) and deploying them on a different distribution (target domain). This curated collection covers the full spectrum โ from unsupervised domain adaptation (UDA) and domain generalization to partial, open-set, and source-free adaptation. Organized by methodology and application area with regularly updated paper lists.
Taxonomy of Methods
Domain Adaptation
โโโ Unsupervised DA (UDA)
โ โโโ Discrepancy-based (MMD, CORAL, CDD)
โ โโโ Adversarial-based (DANN, ADDA, CDAN)
โ โโโ Reconstruction-based (DRCN, DSN)
โ โโโ Self-training (SHOT, CBST)
โโโ Semi-supervised DA
โโโ Source-free DA (no source data at adaptation time)
โโโ Partial DA (target has subset of source classes)
โโโ Open-set DA (target has unknown classes)
โโโ Universal DA (no prior on label set relationship)
โโโ Multi-source DA
โโโ Domain Generalization (no target data at all)
โโโ Test-time Adaptation (adapt at inference)
Key Methods by Era
Classical Methods
| Method | Year | Approach | Key Idea |
|---|
| TCA | 2011 | Kernel | Transfer Component Analysis |
| GFK | 2012 | Subspace | Geodesic Flow Kernel |
| SA | 2013 | Subspace | Subspace Alignment |
| DAN | 2015 | MMD | Deep Adaptation Networks |
| DANN | 2016 | Adversarial | Domain-Adversarial Neural Networks |
| ADDA | 2017 | Adversarial | Adversarial Discriminative DA |
| CORAL | 2016 | Statistics | Correlation Alignment |
Modern Methods
| Method | Year | Approach | Key Idea |
|---|
| CDAN | 2018 | Adversarial | Conditional adversarial + entropy |
| MCD | 2018 | Discrepancy | Maximum Classifier Discrepancy |
| SHOT | 2020 | Source-free | Self-supervised pseudo-labeling |
| TENT | 2021 | Test-time | Entropy minimization at test time |
| DAFormer | 2022 | Transformer | DA for semantic segmentation |
| PADCLIP | 2023 | Vision-language | CLIP-based domain adaptation |
Paper Tracking
import arxiv
def find_da_papers(subtopic="unsupervised", days=30):
"""Find recent domain adaptation papers on arXiv."""
queries = {
"unsupervised": "abs:unsupervised domain adaptation",
"source_free": "abs:source-free domain adaptation",
"generalization": "abs:domain generalization",
"test_time": "abs:test-time adaptation OR test-time training",
}
search = arxiv.Search(
query=queries.get(subtopic, queries["unsupervised"]),
max_results=30,
sort_by=arxiv.SortCriterion.SubmittedDate,
)
for result in search.results():
print(f"[{result.published.strftime('%Y-%m-%d')}] "
f"{result.title}")
print(f" {result.entry_id}")
find_da_papers("source_free")
Benchmark Datasets
benchmarks = {
"Office-31": {
"domains": ["Amazon", "DSLR", "Webcam"],
"classes": 31,
"task": "Object recognition",
},
"Office-Home": {
"domains": ["Art", "Clipart", "Product", "Real World"],
"classes": 65,
"task": "Object recognition",
},
"VisDA-2017": {
"domains": ["Synthetic", "Real"],
"classes": 12,
"task": "Large-scale sim-to-real",
},
"DomainNet": {
"domains": ["Clipart", "Infograph", "Painting",
"Quickdraw", "Real", "Sketch"],
"classes": 345,
"task": "Large-scale multi-domain",
},
"PACS": {
"domains": ["Photo", "Art", "Cartoon", "Sketch"],
"classes": 7,
"task": "Domain generalization",
},
}
name, info benchmarks.items():
(
)
()
Application Areas
| Application | Source โ Target Example |
|---|
| Medical imaging | Hospital A โ Hospital B scanners |
| Autonomous driving | Simulation โ Real world |
| Remote sensing | Region A โ Region B satellite |
| NLP | News text โ Social media |
| Speech | Studio โ Noisy environments |
| Robotics | Sim โ Real manipulation |
Reading Roadmap
### Beginner Path
1. "A Survey on Transfer Learning" (Pan & Yang, 2010)
2. "Domain Adaptation for Object Recognition" (Saenko et al., 2010)
3. "Deep Domain Confusion" (Tzeng et al., 2014)
4. DANN paper (Ganin et al., 2016)
### Intermediate Path
5. CDAN (Long et al., 2018)
6. MCD (Saito et al., 2018)
7. "Moment Matching for Multi-Source DA" (Peng et al., 2019)
### Advanced Path
8. SHOT (Liang et al., 2020) โ source-free
9. TENT (Wang et al., 2021) โ test-time
10. "Benchmarking DA on Language" (Ramponi & Plank, 2020)
Use Cases
- Literature survey: Map the DA research landscape
- Method selection: Choose appropriate DA technique for your task
- Benchmark comparison: Compare methods on standard datasets
- Research gaps: Identify under-explored DA settings
- Course material: Teach transfer learning and DA
References