VLM benchmark CLI — run, compare, and reproduce VLM inference benchmarks. Use when the user wants to: (1) benchmark a VLM model's throughput, latency, or VRAM usage, (2) compare results across models or configs, (3) choose or configure a backend (vLLM Docker, vLLM native, Ollama, SGLang, cloud API), (4) run text-only LLM benchmarks via HF dataset text columns, (5) look up model-specific --serve-args, or (6) debug server startup or GPU detection issues. Triggers on: vlmbench, VLM benchmarking, OCR model evaluation, inference throughput, tokens/sec, TTFT, TPOT, VRAM, text benchmark.
2026-03-13