Hugging Face 推出决策模型接口
Hugging Face 将决策模型介绍为分类类任务的非文本生成方案,通过类型化接口返回结构化决策和概率。文章使用 GEV-26B-Decide 演示 Transformers 决策管线,并解释 Choice、Score 和 Noul 三种原语,同时介绍自定义训练及尚未合并的 TRL 支持计划。
该接口把决策和概率作为软件的一等输出,为要求生成 JSON 答案的生成式语言模型应用提供了一种类型化替代方案。
Large Language Models (LLMs) are exceptionally good at generating text. We use them to answer questions, write code, reason about problems, and so much more. But not every problem requires generating text.
Consider a customer support system receiving the following message:
"I was charged twice for my subscription. I need a refund today."
The system needs to determine which team should handle the request, how urgent it is, and whether the customer is requesting a refund.
We could ask an LLM to return a JSON object containing these answers.
llama cli -hf ggml-org/gemma-4-e4b-it-GGUF:Q4_0
> We have the following customer support ticket, "I was charged twice for my subscription. I need a refund today.", which team should handle the request, how urgent it is, and whether the customer is requesting a refund. Give the answers in JSON.
[Start thinking]
...
[end thinking]
```json
{
"team_to_handle": "Billing",
"urgency": "High",
"request_refund": true
}
#Hugging Face#Transformers#GEV-26B-Decide#TRL#TypeSafe AI#Jev#Unsloth#Qwen