# Amazon — Full Fine-Tuning (FFT) on SageMaker AI Serverless Model Customization

- Company: Amazon (amazon.com)
- Announced: 2026-11-19T00:15:58+00:00
- Category: not stated
- Coverage: 1 outlet
- Announcement: no
- Group: covered
- Source: https://aws.amazon.com/blogs/machine-learning/full-fine-tuning-fft-on-sagemaker-ai-serverless-model-customization/
- Record: https://forck.live/items/38378-full-fine-tuning-fft-on-sagemaker-ai-serverless-model-customization
- Subject: Bedrock / Nova
- Models affected: Qwen3-4B

Amazon says SageMaker AI Serverless Model Customization now supports Full Fine-Tuning, letting teams train a model on their own data without managing GPU clusters. The post contrasts FFT with parameter-efficient methods such as LoRA, which freeze the pretrained weights and inject small low-rank matrices into the model layers. Amazon says the low-rank structure limits the representation power of the fine-tuned model, and that as datasets scale beyond tens of thousands of examples, LoRA hits an accuracy plateau where raising rank fails to close the gap with standard fine-tuning. FFT instead updates the model's weight matrix uniformly, which Amazon says yields stronger convergence and better activation alignment across layers. In experiments on a Qwen3-4B base model fine-tuned on the Magicoder-Evol-Instruct-110K dataset of 110,000 coding instruction-response pairs, FFT reached 90.0 percent on LLM-as-Judge semantic correctness at 100K+ training examples. The dataset was split 90/5/5, with 99,000 records for training, 5,500 for validation and 5,500 held out for testing.

## Evidence

Verbatim from https://aws.amazon.com/blogs/machine-learning/full-fine-tuning-fft-on-sagemaker-ai-serverless-model-customization/:

> Fine-tuning is the process of continuing to train a pretrained large language model (LLM) on a company’s own data so it adapts to a specific domain, task, or style rather than relying on general-purpose knowledge alone. For businesses, the value is twofold. A fine-tuned model delivers measurably better accuracy on domain-specific work while reducing costs: a smaller specialized model can match or exceed a frontier model on your task at a fraction of the per-token inference price. Those savings compound across millions of requests. Fine-tuning has therefore become an essential process for businesses looking to get more value from LLMs at lower costs.
> 
> Parameter-efficient fine-tuning (PEFT) methods like Low-Rank Adaptation (LoRA) have emerged as a practical solution for fine-tuning LLMs to downstream tasks, reducing GPU capacity requirements by updating only a small subset of LLM parameters. LoRA aims to strike a balance between efficiency and expressiveness, however, the low-rank nature of the weight update inherently limits the representation power of LoRA fine-tuned models, potentially compromising performance on complex tasks.

## Around this story

Outlets this record can name and link:

- Neoteo — SageMaker serverless full fine-tuning: AWS results: https://neoteo.com/en/aws-announced-sagemaker-serverless-full-fine-tuning-in-august

---

Record: https://forck.live/items/38378-full-fine-tuning-fft-on-sagemaker-ai-serverless-model-customization
Catalogue: https://forck.live/llms.txt
Current issue: https://forck.live/feed.md
