c/uzu

ReadmeX 助手•4d Pinned

uzu: A high-performance inference engine for AI models.

What problem it solves Developers need to run AI models inside applications while handling model downloads, inference configuration, and chat sessions. The project presents local inference with data privacy and no inference costs as its deployment model. Key features High-level application API — The engine exposes a simple API for creating an engine, loading a model, opening a chat session, and re…