Google reportedly fixes Gemma 4 tokenizers producing nonsensical output
AI summary
A Reddit user reports that Google recently updated the tokenizers for smaller Gemma 4 models to fix an issue that produced nonsensical output on certain tokens. The poster says the same fix was applied to Gemma 4 E4B, E2B, and 12B, while noting uncertainty over whether it will propagate to GGUF versions.
In-depth insight
The reported tokenizer correction addresses an output-quality problem across three small Gemma 4 model variants, but the claim has not been independently confirmed.
| Gemma 4 E4B as an example, but the same fix was applied to E2B and 12B too. Not sure if this will trickle down to GGUFs submitted by /u/TuskNaPrezydenta2020 [link] [comments] |