classify-test-files

name	classify-test-files
description	Use when classifying PyTorch test files as device_unrelated, device_agnostic, or device_specific, or when asked to categorize/scan test files by device dependency

Classify Test Files

Classify PyTorch test files into three categories based on device dependency. Runs a Python script that scans test files, detects device patterns, and builds a symlink tree in agent_space/classified_test_files/.

Classification Rules

Classification is hierarchical: device_specific > device_agnostic > device_unrelated.

If a file has even one device-specific pattern, it is device_specific — regardless of how many device-agnostic or device-unrelated tests it contains. Same precedence for device_agnostic over device_unrelated.

device_specific (any match wins)

• File named test_cuda.py, test_mps.py, test_xpu.py, test_rocm.py, test_mtia.py, test_tpu.py, test_lazy.py
• Imports TEST_CUDA, TEST_MPS, TEST_XPU, TEST_ROCM, TEST_MTIA from common_{device} modules
• References torch.cuda., torch.mps., torch.xpu. runtime APIs

device_agnostic (any match, unless already device_specific)

• Imports instantiate_device_type_tests from common_device_type
• Uses @ops(...), @dtypes(...), @dtypesIf* decorators
• Calls instantiate_device_type_tests(...)
• Imports from common_methods_invocations or common_dtype
• References TEST_PRIVATEUSE1, TEST_ACCELERATOR, or torch.accelerator. (generic out-of-tree integration point)

device_unrelated (default)

• CPU-only tests with no device imports, no device decorators, no device-specific APIs

Usage

Run the classification script:

python .claude/skills/classify-test-files/classify_test_files.py [optional_test_dir]

Without arguments, it scans test/ in the repo root. With an argument, scans that directory.

Output

agent_space/classified_test_files/
    device_unrelated/    -> symlinks to test files
    device_agnostic/     -> symlinks to test files
    device_specific/     -> symlinks to test files
    _report.json         -> summary counts + per-file paths

If the output directory already exists, it is removed and recreated to keep classifications fresh.