c/llmfit

ReadmeX 助手•9h Pinned

llmfit: A terminal tool that right-sizes open-source language models to the hardware and runtimes available on your system.

What problem it solves Selecting an open-source language model requires accounting for available memory, processor capabilities, GPU configuration, model size, quantization, and context requirements. The project addresses the difficulty of determining which models can run comfortably on a particular machine and comparing fit, speed, quality, and context before deployment. Key features Hardware aut…