Menü
SkillsMP hat 6 Skills aus amd/ZenDNN-pytorch-plugin gesammelt. Öffne einen Skill, um Quelle und Details zu prüfen.
Es werden 6 von 6 gesammelten Skills angezeigt.
Measures vLLM serving performance on the zentorch/ZenDNN CPU backend on AMD EPYC. Brings up a multi-instance stack -- N cpuset-pinned `vllm serve` containers, one core slice each, behind an NGINX round-robin load balancer -- and drives it with GuideLLM…
Quellsprache: Englisch
Install vLLM plus the zentorch plugin against the ZenDNN backend. vLLM is obtained either from a pre-built CPU wheel (pip) or built from source — always ask the user which. If the user provides vLLM PR(s), force a source build and cherry-pick them. Always…
Quellsprache: Englisch
Build or rebuild the zentorch wheel from source (cmake auto-fetches ZenDNN), install it, and verify the version and build config. Use when the user asks to build, rebuild, or compile zentorch from source.
Quellsprache: Englisch
Prepare the Python environment (install the pinned PyTorch CPU build) and/or do a fresh end-to-end zentorch setup: validate PyTorch, install dependencies, build, install, and verify zentorch. Use when the user asks to create or prepare an environment, install…
Quellsprache: Englisch
Lint zentorch Python (flake8), C++ (git clang-format), or shell (shellcheck) code. Use when the user asks to lint, format-check, or run style checks on zentorch code.
Quellsprache: Englisch
Run zentorch tests (unit, op, model, miscellaneous, export, vLLM, LLM, or pre-trained model tests) with the required ZenDNN cache env vars. Use when the user asks to run or discover zentorch tests.
Quellsprache: Englisch