amd/ZenDNN-pytorch-plugin

benchmark-vllm

Measures vLLM serving performance on the zentorch/ZenDNN CPU backend on AMD EPYC. Brings up a multi-instance stack -- N cpuset-pinned `vllm serve` containers, one core slice each, behind an NGINX round-robin load balancer -- and drives it with GuideLLM…

원문 언어: 영어

build-vllm-zentorch

Install vLLM plus the zentorch plugin against the ZenDNN backend. vLLM is obtained either from a pre-built CPU wheel (pip) or built from source — always ask the user which. If the user provides vLLM PR(s), force a source build and cherry-pick them. Always…

원문 언어: 영어

build-zentorch-from-source

Build or rebuild the zentorch wheel from source (cmake auto-fetches ZenDNN), install it, and verify the version and build config. Use when the user asks to build, rebuild, or compile zentorch from source.

원문 언어: 영어

build-zentorch-setup-env

Prepare the Python environment (install the pinned PyTorch CPU build) and/or do a fresh end-to-end zentorch setup: validate PyTorch, install dependencies, build, install, and verify zentorch. Use when the user asks to create or prepare an environment, install…

원문 언어: 영어

lint-zentorch-source

Lint zentorch Python (flake8), C++ (git clang-format), or shell (shellcheck) code. Use when the user asks to lint, format-check, or run style checks on zentorch code.

원문 언어: 영어

test-zentorch-unit

Run zentorch tests (unit, op, model, miscellaneous, export, vLLM, LLM, or pre-trained model tests) with the required ZenDNN cache env vars. Use when the user asks to run or discover zentorch tests.

원문 언어: 영어