Skip to main content

aws-samples/sample-sagemaker-agentic-model-deployment

SkillsMP 已收集 aws-samples/sample-sagemaker-agentic-model-deployment 中的 3 个 Skill。打开任一 Skill 可查看来源和详情。

最近记录的来源活动
SkillsMP 收录数据更新
已收集 skills
3
GitHub 星标
5
GitHub Forks
1

这个仓库中的 skills

1 个职业分类 · 已分类 100%

已展示 3 / 3 个已收集 Skill。

职业分类
软件开发工程师
描述

Stage any supported open-weight Hugging Face model directly into Amazon S3 and deploy it to an Amazon SageMaker AI real-time endpoint with a compatible vLLM or SGLang Deep Learning Container. Use for model hosting, endpoint creation, direct-to-S3 transfer,…

原文语言:英语

更新
职业分类
软件开发工程师
描述

Run a managed performance benchmark against a deployed Amazon SageMaker AI endpoint using SageMaker AI inference benchmarking (part of optimized GenAI inference recommendations; NVIDIA AIPerf under the hood). Measures TTFT, ITL, request-latency percentiles,…

原文语言:英语

更新
职业分类
软件开发工程师
描述

Find an optimized serving configuration for a model with Amazon SageMaker AI inference recommendations, then deploy it and compare against a baseline benchmark. Covers both config search (best instance + serving knobs) and deep optimization (speculative…

原文语言:英语

更新
已展示 3 / 3 个已收集 Skill。