SageMaker AI新增无服务器全量微调
Amazon SageMaker AI 无服务器模型定制现已支持全量微调(FFT),客户无需配置 GPU、集群或分布式训练即可更新全部模型参数。AWS Machine Learning Blog 称,在数据量大且质量较高时,FFT 在复杂任务上可优于 LoRA,但其测试显示 FFT 对超参数高度敏感,并非始终占优;LoRA 的 LLM-as-Judge 得分为 81.5%,高于 FFT 的 79.5%。
此次更新为 AWS 客户提供了全参数微调的无服务器选项,但 AWS Machine Learning Blog 建议根据数据特征和训练设置,通过实验选择 FFT 或 LoRA。
Fine-tuning is the process of continuing to train a pretrained large language model (LLM) on a company’s own data so it adapts to a specific domain, task, or style rather than relying on general-purpose knowledge alone. For businesses, the value is twofold. A fine-tuned model delivers measurably better accuracy on domain-specific work while reducing costs: a smaller specialized model can match or exceed a frontier model on your task at a fraction of the per-token inference price. Those savings compound across millions of requests. Fine-tuning has therefore become an essential process for businesses looking to get more value from LLMs at lower costs.
Parameter-efficient fine-tuning (PEFT) methods like Low-Rank Adaptation (LoRA) have emerged as a practical solution for fine-tuning LLMs to downstream tasks, reducing GPU capacity requirements by updating only a small subset of LLM parameters. LoRA aims to strike a balance between efficiency and expressiveness, however, the low-rank nature of the weight update inherently limits the representation power of LoRA fine-tuned models, potentially compromising performance on complex tasks. This trade-off hampers the ability of LoRA methods to capture complex patterns needed for diverse tasks. To address these challenges, Full Fine-Tuning (FFT) updates model parameters simultaneously, overcoming the low-rank limitations so LLMs can fully absorb complex domain-specific knowledge.
#AWS#Amazon SageMaker AI Serverless Model Customization#Amazon Nova Pro