Comet 60B A12B
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- Community user ports Comet 60B A12B to GGUF for llama.cpp
Reddit user /u/Felladrin converted Multiverse Computing’s Comet 60B A12B BF16 model into GGUF formats that reportedly run on stock llama.cpp. The Q4_K_M and Q8_0 files are reported as 42.6 GB and 64.2 GB, respectively, and retain the MTP head for speculative decoding through llama-server with the --spec-type draft-mtp option. The conversions are text-only because the vision tower was not converted.
r/LocalLLaMA · 🔥 0
Experience and discussion from the community
Share my Comet 60B A12B experienceAsk about Comet 60B A12B
Nobody has shared their experience with Comet 60B A12B yet.