Gemma 4 31B拟人对话微调模型发布
AI 总结
开发者LessThanThreeAI发布Gemma-4-31B-Humanlike-Chat，这是基于Google Gemma 4 31B、使用SFT、在线策略蒸馏和自博弈训练的微调模型。作者称该模型能呈现更自然的对话风格，并提供GGUF、BF16、FP8和GPTQ-Int4权重，以及训练方法和自测基准结果。其行为优势尚无独立验证。
深度见解
该模型提供多种可下载的开放权重格式和详细训练信息，但其在对话风格、工具选择和指令遵循方面的改进目前仅来自开发者自评。
| The previous released Qwen3.8-27B-Humanlike-Chat 2.0, a fine-tune that texts humanly and does stuff, is now at 136k downloads for the GGUF repo between v1 and 2.0. Thank you. One of the top comments on the 2.0 post was "I wonder how Gemma 4 31B would do, trained with your method". So here it is: Gemma-4-31B-Humanlike-Chat. The voice of 2.0 on the official Gemma 4 31B from Google. What it does How I trained it Two steps. Same recipe as for 2.0. On 1 H200. The student doesn't see the hidden instruction. So it texts like that without a prompt. Some self-play in each step. Long chats with simulated friends. That fixed the habit of fading to one-word replies towards the end of long chats (after SFT, 28% of the late replies in long chats were only 1 or 2 words; after distillation, 12%). Numbers vs Google base Chart with all ten benchmarks in the images. Numbers vs 2.0 Same eval inputs. Thinking off. Does it text humanly? Same benchmark as last time. Google Gemma didn't manage to fool the judge a single time. Links Thank you for asking for a Gemma version, and thank you for the feedback on 2.0. Try it, hope you like it! submitted by /u/kvyb [link] [comments] |
#Gemma-4-31B-Humanlike-Chat#Gemma 4 31B#Google#LessThanThreeAI