QLoRA
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- Reddit user seeks Qwen3.5-9B QLoRA fine-tuning advice
A Reddit user is seeking advice on fine-tuning Qwen3.5-9B with QLoRA using about 500 GB of mixed images, scanned documents, PDFs, Word files, and Excel files. They report running a Q5_K_XL build on an ASUS ESC4000 G3 with 128 GB of RAM and eight NVIDIA T4 GPUs, using separate llama.cpp instances behind a round-robin nginx load balancer. Their internal harness reportedly measured 35–40 tokens per second for an average single user and a 3–5 second time to first token, but the post does not provide a completed fine-tuning workflow or validated answer.
r/LocalLLaMA · 🔥 0
Experience and discussion from the community
Share my QLoRA experienceAsk about QLoRA
Nobody has shared their experience with QLoRA yet.