iQuantize开源大模型量化桌面工作区
AI 总结
开发者 Fazmin 发布 iQuantize,这是一款采用 Apache 2.0 许可证的大语言模型桌面量化工作区,支持转换为 GGUF、MLX 和 ONNX 格式。据 Reddit 帖子介绍,用户可加载本地 Safetensors 模型或从 Hugging Face 选择模型,按照引导流程完成量化、比较结果,并通过模型卡发布。
深度见解
iQuantize 将引导式本地模型转换、结果比较和 Hugging Face 发布整合到一款开源桌面工具中,但这些功能主要来自开发者自述。
| This is a full quantization desktop workspace for large language models that supports GGUF, MLX, and ONNX. You can pick your own Safetensors model or choose one from Hugging Face, quantize it step by step, and watch what changes. You can then compare the result with the original and publish it to Huggingface with a model card that records how it was made. It’s open source, Apache 2.0. I definitely think there more can be done to improve. I’ve only tested mostly on Apple Silicon so far. Windows and Linux builds exist, but haven't done much in-depth testing with them so I’d expect bugs there. Contributors are very welcome! Repo: https://github.com/Fazmin/iQuantize Thank u. submitted by /u/Zipidyzip [link] [comments] |