创建

登录 ReadmeX

或

了解我们如何处理你的信息: 隐私政策

ReadmeX

陪你读懂 AI 动态

今天,想先了解什么?

选一份动态总结,或直接聊聊你的问题。

社区和关注动态总结只属于你自己。

资讯

Hugging Face 推出决策模型接口

AI 总结

Hugging Face 将决策模型介绍为分类类任务的非文本生成方案,通过类型化接口返回结构化决策和概率。文章使用 GEV-26B-Decide 演示 Transformers 决策管线,并解释 Choice、Score 和 Noul 三种原语,同时介绍自定义训练及尚未合并的 TRL 支持计划。

深度见解

该接口把决策和概率作为软件的一等输出,为要求生成 JSON 答案的生成式语言模型应用提供了一种类型化替代方案。

Large Language Models (LLMs) are exceptionally good at generating text. We use them to answer questions, write code, reason about problems, and so much more. But not every problem requires generating text.

Consider a customer support system receiving the following message:

"I was charged twice for my subscription. I need a refund today."

The system needs to determine which team should handle the request, how urgent it is, and whether the customer is requesting a refund.

We could ask an LLM to return a JSON object containing these answers.

llama cli -hf ggml-org/gemma-4-e4b-it-GGUF:Q4_0

> We have the following customer support ticket, "I was charged twice for my subscription. I need a refund today.", which team should handle the request, how urgent it is, and whether the customer is requesting a refund. Give the answers in JSON.

[Start thinking]
...
[end thinking]
```json
{
  "team_to_handle": "Billing",
  "urgency": "High",
  "request_refund": true
}

#Hugging Face#Transformers#GEV-26B-Decide#TRL#TypeSafe AI#Jev#Unsloth#Qwen

原文约 14 分钟读完阅读原文
群聊

还没有评论,来说说你的看法。