Skip to main content

openinfer-project/openinfer

SkillsMP has collected 2 skills from openinfer-project/openinfer. Open a skill to review its source and details.

Latest recorded source activity
SkillsMP catalog refreshed
skills collected
2
GitHub stars
621
GitHub forks
95

Skills in this repository

1 occupation categories · 100% classified

Showing 2 of 2 collected skills.

occupation
Software Developers
description

Use vllm-bench to benchmark OpenAI-compatible or vLLM serving endpoints, especially multi-turn chat load tests. Use when the user asks for vllm bench, vllm-bench, multi-turn benchmark, chat serving benchmark, TTFT/TPOT/throughput measurement, concurrency…

updated
occupation
Software Developers
description

Profile GPU workloads with NVIDIA Nsight Systems (nsys). Use this skill when the user says 'profile', 'nsys', 'capture a trace', 'GPU profiling', 'kernel breakdown', 'where is time spent', 'decode is slow', 'prefill is slow', 'TPOT regression', 'TTFT…

updated
Showing 2 of 2 collected skills.