zkkython

Use OpenAI-compatible API, integrate with clients

Contribution guide, model integration, debugging

Distributed inference, tensor/pipeline parallelism

Multi-hardware backend configuration (CUDA, ROCm, NPU, XPU, CPU)

Text model inference (Llama, Qwen, Mistral, GPT, etc.)

LoRA adapter serving, multi-LoRA deployment

Vision, audio, and video model inference

Offline inference, batch processing, script integration

Publish Markdown/HTML articles to WeChat Official Account (微信公众号) drafts via API with multiple visual styles