qe-learning-optimization
Optimizes QE agent performance through transfer learning, hyperparameter tuning, and pattern distillation across test domains. Use when improving agent accuracy, applying learned patterns to new projects, tuning quality thresholds, or implementing continuous improvement loops for AI-powered testing.
소스 정보
- 저장소
- proffesor-for-testing/agentic-qe
- 최근 소스 활동
- 2026년 9월 27일 15:26
- 감지된 SKILL.md 언어
- 영어
- 스타
- 494
- 포크
- 98
설치 방법
기본적으로 소스를 먼저 확인하는 Prompt가 선택됩니다. 직접 명령으로 전환하거나 로컬 사본을 다운로드할 수도 있습니다.
소스 파일 검토
설치 여부를 결정하기 전에 SKILL.md와 SkillsMP에 표시된 보조 파일을 읽어 보세요.
파일 탐색기
4 개 파일SKILL.md 표시 중
SKILL.md
소스 지침 · 읽기 전용 미리보기- name
- qe-learning-optimization
- description
- Optimizes QE agent performance through transfer learning, hyperparameter tuning, and pattern distillation across test domains. Use when improving agent accuracy, applying learned patterns to new projects, tuning quality thresholds, or implementing continuous improvement loops for AI-powered testing.
- trust_tier
- 3
- validation
- {"schema_path":"schemas/output.json","validator_path":"scripts/validate-config.json","eval_path":"evals/qe-learning-optimization.yaml"}
# QE Learning Optimization
## Purpose
Guide the use of v3's learning optimization capabilities including transfer learning between agents, hyperparameter tuning, A/B testing, and continuous performance improvement.
## Activation
- When optimizing agent performance
- When transferring knowledge between agents
- When tuning learning parameters
- When running A/B tests
- When analyzing learning metrics
## Quick Start
```bash
# Transfer knowledge between agents
aqe learn transfer --from jest-generator --to vitest-generator
# Tune hyperparameters
aqe learn tune --agent defect-predictor --metric accuracy
# Run A/B test
aqe learn ab-test --hypothesis "new-algorithm" --duration 7d
# View learning metrics
aqe learn metrics --agent test-generator --period 30d
```
## Agent Workflow
```typescript
// Transfer learning
Task("Transfer test patterns", `
Transfer learned patterns from Jest test generator to Vitest:
- Map framework-specific syntax
- Adapt assertion styles
- Preserve test structure patterns
- Validate transfer accuracy
`, "qe-transfer-specialist")
// Metrics optimization
Task("Optimize prediction accuracy", `
Tune defect-predictor agent:
- Analyze current performance metrics
- Run Bayesian hyperparameter search
- Validate improvements on holdout set
- Deploy if accuracy improves >5%
`, "qe-metrics-optimizer")
```
## Learning Operations
### 1. Transfer Learning
```typescript
await transferSpecialist.transfer({
source: {
agent: 'qe-jest-generator',
knowledge: ['patterns', 'heuristics', 'optimizations']
},
target: {
agent: 'qe-vitest-generator',
adaptations: ['framework-syntax', 'api-differences']
},
strategy: 'fine-tuning',
validation: {
testSet: 'validation-samples',
minAccuracy: 0.9
}
});
```
### 2. Hyperparameter Tuning
```typescript
await metricsOptimizer.tune({
agent: 'defect-predictor',
parameters: {
learningRate: { min: 0.001, max: 0.1, type: 'log' },
batchSize: { values: [16, 32, 64, 128] },
patternThreshold: { min: 0.5, max: 0.95 }
},
optimization: {
method: 'bayesian',
objective: 'accuracy',
trials: 50,
parallelism: 4
}
});
```
### 3. A/B Testing
```typescript
await metricsOptimizer.abTest({
hypothesis: 'ML pattern matching improves test quality',
variants: {
control: { algorithm: 'rule-based' },
treatment: { algorithm: 'ml-enhanced' }
},
metrics: ['test-quality-score', 'generation-time'],
traffic: {
split: 50,
minSampleSize: 1000
},
duration: '7d',
significance: 0.05
});
```
### 4. Feedback Loop
```typescript
await metricsOptimizer.feedbackLoop({
agent: 'test-generator',
feedback: {
sources: ['user-corrections', 'test-results', 'code-reviews'],
aggregation: 'weighted',
frequency: 'real-time'
},
learning: {
strategy: 'incremental',
validationSplit: 0.2,
earlyStoppingPatience: 5
}
});
```
## Learning Metrics Dashboard
```typescript
interface LearningDashboard {
agent: string;
period: DateRange;
performance: {
current: MetricValues;
trend: 'improving' | 'stable' | 'declining';
percentile: number;
};
learning: {
samplesProcessed: number;
patternsLearned: number;
improvementRate: number;
};
experiments: {
active: Experiment[];
completed: ExperimentResult[];
};
recommendations: {
action: string;
expectedImpact: number;
confidence: number;
}[];
}
```
## Cross-Framework Transfer
```yaml
transfer_mappings:
jest_to_vitest:
syntax:
"describe": "describe"
"it": "it"
"expect": "expect"
"jest.mock": "vi.mock"
"jest.fn": "vi.fn"
patterns:
- mock-module
- async-testing
- snapshot-testing
mocha_to_jest:
syntax:
"describe": "describe"
"it": "it"
"chai.expect": "expect"
"sinon.stub": "jest.fn"
adaptations:
- assertion-style
- hook-naming
```
## Continuous Improvement
```typescript
await learningOptimizer.continuousImprovement({
agents: ['test-generator', 'coverage-analyzer', 'defect-predictor'],
schedule: {
metricCollection: 'hourly',
tuning: 'weekly',
majorUpdates: 'monthly'
},
thresholds: {
degradationAlert: 5, // percent
improvementTarget: 2, // percent per week
},
automation: {
autoTune: true,
autoRollback: true,
requireApproval: ['major-changes']
}
});
```
## Pattern Learning
```typescript
await patternLearner.learn({
sources: {
codeExamples: 'examples/**/*.ts',
testExamples: 'tests/**/*.test.ts',
userFeedback: 'feedback/*.json'
},
extraction: {
syntacticPatterns: true,
semanticPatterns: true,
contextualPatterns: true
},
storage: {
vectorDB: 'agentdb',
versioning: true
}
});
```
## Coordination
**Primary Agents**: qe-transfer-specialist, qe-metrics-optimizer, qe-pattern-learner
**Coordinator**: qe-learning-coordinator
**Related Skills**: qe-test-generation, qe-defect-intelligence
GitHub에서 보기