GeneralPoints
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- GeneralPoints test favors RL over SFT under rule and suit changes
A report on the GeneralPoints experiment describes a game similar to “24 points,” using four cards with addition, subtraction, multiplication and division. In a rule-change test, J, Q and K counted as 10 during training but as 11, 12 and 13 during testing; RL accuracy rose 3.5%, while SFT accuracy fell 8.1%. In a separate suit-change test, training used black suits and testing used red suits; RL rose 17.6% and SFT fell 9.9%. The report presents these results as an example of how RL and SFT can behave differently when inputs change, while cautioning that they do not show RL always generalizes better or SFT only memorizes.
掘金 · 人工智能 · 🔥 0
Experience and discussion from the community
Share my GeneralPoints experienceAsk about GeneralPoints
Nobody has shared their experience with GeneralPoints yet.