职业分类
软件开发工程师
描述
Benchmarks a deployed llm-d well-lit path guide stack on GKE using llm-d-benchmark cli with inference-perf as the harness, the user a will select the appropriate workload profiles from llm-d-benchmark.
原文语言:英语
更新
菜单
SkillsMP 已收集 GoogleCloudPlatform/accelerated-platforms 中的 4 个 Skill。打开任一 Skill 可查看来源和详情。
已展示 4 / 4 个已收集 Skill。
Benchmarks a deployed llm-d well-lit path guide stack on GKE using llm-d-benchmark cli with inference-perf as the harness, the user a will select the appropriate workload profiles from llm-d-benchmark.
原文语言:英语
This is an experimental Skill. It automatically tunes GKE vLLM inference server parameters and resources based on workload profiles specified in the benchmark configs.
原文语言:英语
Deploys the GKE base platform and inference-specific terra-services (GPU/TPU) for accelerated workloads.
原文语言:英语
Deploys the llm-d stack on GKE using well-lit paths specification.
原文语言:英语