SageMaker AI adds serverless full fine-tuning
Amazon SageMaker AI Serverless Model Customization now supports Full Fine-Tuning (FFT), allowing customers to update all model parameters without provisioning GPUs, configuring clusters, or setting up distributed training. AWS Machine Learning Blog says FFT can outperform LoRA for complex tasks with sufficiently large, high-quality datasets, but its own tests found it was highly sensitive to hyperparameters and not universally superior. LoRA scored 81.5% on LLM-as-Judge versus 79.5% for FFT, while aggressive FFT learning rates sharply degraded MATH and MMLU results.
The update gives AWS customers a serverless option for full-parameter LLM customization, but AWS Machine Learning Blog recommends selecting FFT or LoRA through careful experiments based on dataset characteristics and training settings.
Fine-tuning is the process of continuing to train a pretrained large language model (LLM) on a company’s own data so it adapts to a specific domain, task, or style rather than relying on general-purpose knowledge alone. For businesses, the value is twofold. A fine-tuned model delivers measurably better accuracy on domain-specific work while reducing costs: a smaller specialized model can match or exceed a frontier model on your task at a fraction of the per-token inference price. Those savings compound across millions of requests. Fine-tuning has therefore become an essential process for businesses looking to get more value from LLMs at lower costs.
Parameter-efficient fine-tuning (PEFT) methods like Low-Rank Adaptation (LoRA) have emerged as a practical solution for fine-tuning LLMs to downstream tasks, reducing GPU capacity requirements by updating only a small subset of LLM parameters. LoRA aims to strike a balance between efficiency and expressiveness, however, the low-rank nature of the weight update inherently limits the representation power of LoRA fine-tuned models, potentially compromising performance on complex tasks. This trade-off hampers the ability of LoRA methods to capture complex patterns needed for diverse tasks. To address these challenges, Full Fine-Tuning (FFT) updates model parameters simultaneously, overcoming the low-rank limitations so LLMs can fully absorb complex domain-specific knowledge.
#AWS#Amazon SageMaker AI Serverless Model Customization#Amazon Nova Pro