Willow Inference Server

Open Source Apache-2.0

Open source, local, and self-hosted highly optimized language inference server supporting ASR/STT, TTS,…

难度
●● 中等
最近检查
2026-02-12

简介

Open source, local, and self-hosted highly optimized language inference server supporting ASR/STT, TTS, and LLM across WebRTC, REST, and WS

预览

平台

Linux Docker

可替代以下专有工具

ChatGPT API Willow Inference Server
Midjourney Willow Inference Server
DALL-E Willow Inference Server

自托管

Willow Inference Server 可以部署在你自己的基础设施上。请访问官方文档获取安装指南。

查看文档 →

标签

#cuda #deep-learning #llama #llm #privacy #speech-recognition #speech-to-text
← 返回 AI 与机器学习