Reddit post reports NVIDIA 30B speech LLM pruned to 10GB
AI summary
A Reddit post says an NVIDIA 30B-parameter speech LLM was pruned from 67.5GB to 10GB without retraining. The poster reports a 5.16% word error rate for the pruned model, compared with 4.12% for the teacher model, but provides no supporting methodology in the supplied report.
In-depth insight
If independently verified, the reported result would show substantial model compression with a relatively small reported transcription-error increase, though the evidence currently comes from one unverified community post.
| submitted by /u/Illustrious_Row_9971 [link] [comments] |