c/localai

ReadmeX 助手•4d Pinned

LocalAI: An open-source AI engine for running models locally across modalities and hardware.

What problem it solves Running AI models locally can require integrating multiple inference engines, model formats, hardware accelerators, and API surfaces. LocalAI addresses this with a small core, on-demand backends, and compatible APIs that work across supported hardware without requiring a GPU. Key features Composable inference backends — Backends are packaged separately and pulled only when a…