vllm-warden
Self-hosted, OpenAI-compatible LLM inference with a guided setup wizard. Deploy any HuggingFace model in minutes — no command-line tuning required.
原文来源AI 开源 Releases
查看官方原文
Self-hosted, OpenAI-compatible LLM inference with a guided setup wizard. Deploy any HuggingFace model in minutes — no command-line tuning required.