Menu
SkillsMP has collected 6 skills from amd/ZenDNN-pytorch-plugin. Open a skill to review its source and details.
Showing 6 of 6 collected skills.
Measures vLLM serving performance on the zentorch/ZenDNN CPU backend on AMD EPYC. Brings up a multi-instance stack -- N cpuset-pinned `vllm serve` containers, one core slice each, behind an NGINX round-robin load balancer -- and drives it with GuideLLM…
Install vLLM plus the zentorch plugin against the ZenDNN backend. vLLM is obtained either from a pre-built CPU wheel (pip) or built from source — always ask the user which. If the user provides vLLM PR(s), force a source build and cherry-pick them. Always…
Build or rebuild the zentorch wheel from source (cmake auto-fetches ZenDNN), install it, and verify the version and build config. Use when the user asks to build, rebuild, or compile zentorch from source.
Prepare the Python environment (install the pinned PyTorch CPU build) and/or do a fresh end-to-end zentorch setup: validate PyTorch, install dependencies, build, install, and verify zentorch. Use when the user asks to create or prepare an environment, install…
Lint zentorch Python (flake8), C++ (git clang-format), or shell (shellcheck) code. Use when the user asks to lint, format-check, or run style checks on zentorch code.
Run zentorch tests (unit, op, model, miscellaneous, export, vLLM, LLM, or pre-trained model tests) with the required ZenDNN cache env vars. Use when the user asks to run or discover zentorch tests.