创建

登录 ReadmeX

或

了解我们如何处理你的信息: 隐私政策

ReadmeX

陪你读懂 AI 动态

今天,想先了解什么?

选一份动态总结,或直接聊聊你的问题。

社区和关注动态总结只属于你自己。

资讯

SageMaker AI新增无服务器全量微调

AI 总结

Amazon SageMaker AI 无服务器模型定制现已支持全量微调(FFT),客户无需配置 GPU、集群或分布式训练即可更新全部模型参数。AWS Machine Learning Blog 称,在数据量大且质量较高时,FFT 在复杂任务上可优于 LoRA,但其测试显示 FFT 对超参数高度敏感,并非始终占优;LoRA 的 LLM-as-Judge 得分为 81.5%,高于 FFT 的 79.5%。

深度见解

此次更新为 AWS 客户提供了全参数微调的无服务器选项,但 AWS Machine Learning Blog 建议根据数据特征和训练设置,通过实验选择 FFT 或 LoRA。

Fine-tuning is the process of continuing to train a pretrained large language model (LLM) on a company’s own data so it adapts to a specific domain, task, or style rather than relying on general-purpose knowledge alone. For businesses, the value is twofold. A fine-tuned model delivers measurably better accuracy on domain-specific work while reducing costs: a smaller specialized model can match or exceed a frontier model on your task at a fraction of the per-token inference price. Those savings compound across millions of requests. Fine-tuning has therefore become an essential process for businesses looking to get more value from LLMs at lower costs.

Parameter-efficient fine-tuning (PEFT) methods like Low-Rank Adaptation (LoRA) have emerged as a practical solution for fine-tuning LLMs to downstream tasks, reducing GPU capacity requirements by updating only a small subset of LLM parameters. LoRA aims to strike a balance between efficiency and expressiveness, however, the low-rank nature of the weight update inherently limits the representation power of LoRA fine-tuned models, potentially compromising performance on complex tasks. This trade-off hampers the ability of LoRA methods to capture complex patterns needed for diverse tasks. To address these challenges, Full Fine-Tuning (FFT) updates model parameters simultaneously, overcoming the low-rank limitations so LLMs can fully absorb complex domain-specific knowledge.

#AWS#Amazon SageMaker AI Serverless Model Customization#Amazon Nova Pro

原文约 10 分钟读完阅读原文
群聊

还没有评论,来说说你的看法。