# Amazon — Build a model improvement flywheel with Amazon SageMaker HyperPod Data Capture

- Company: Amazon (amazon.com)
- Announced: 2026-11-13T18:01:15+00:00
- Category: capability-change
- Coverage: not counted
- Announcement: no
- Group: routine
- Source: https://aws.amazon.com/blogs/machine-learning/build-a-model-improvement-flywheel-with-amazon-sagemaker-hyperpod-data-capture/
- Record: https://forck.live/items/36012-build-a-model-improvement-flywheel-with-amazon-sagemaker-hyperpod-data-capture
- Subject: Bedrock / Nova
- Models affected: Qwen2.5-3B-Instruct

Amazon SageMaker HyperPod now provides Data Capture, a built-in capability that records live inference inputs and outputs to Amazon S3 at three independent tiers, with minimal latency impact and zero impact on model availability. The feature addresses a gap for teams running foundation models in production: without a record of production inference data, they cannot detect drift, find failure patterns, or use real interactions to improve the model. The walkthrough runs on a single HyperPod cluster, where a home-appliance support router captures its traffic, Athena queries surface a new-product blind spot, a SQL policy labels the captured records, and a fine-tune on that data teaches the router the new product. Tiers 1 and 3 both store full payloads, so enabling both stores every record twice; Amazon suggests Tier 1 for compliance and Model Monitor, Tier 2 when only traffic metadata is needed, and Tier 3 when the payloads will be used. Because Tier 3 records complete payloads that can include names, addresses and order numbers, Amazon advises protecting that data with sampling, AWS KMS encryption, S3 lifecycle rules and PII redaction before it becomes training data. The example uses Qwen2.5-3B-Instruct, which Amazon says is small enough to fine-tune in about a minute and fits on a single L40S, with the inference operator serving on one node and the training operator fine-tuning on another.

## Evidence

Verbatim from https://aws.amazon.com/blogs/machine-learning/build-a-model-improvement-flywheel-with-amazon-sagemaker-hyperpod-data-capture/:

> Foundation models deployed on Amazon SageMaker HyperPod meet inputs that no pre-curated dataset covers: domain-specific jargon, unexpected formats, new products, and changing user behavior. Without a record of production inference data, teams can’t detect drift, find failure patterns, or use real interactions to improve the model.
> 
> Amazon SageMaker HyperPod now provides Data Capture, a built-in capability that records live inference inputs and outputs to Amazon Simple Storage Service (Amazon S3) at three independent tiers, with minimal latency impact and zero impact on model availability.
> 
> In this post, we walk through one complete example on a single SageMaker HyperPod cluster. A home-appliance support router captures its production traffic, Amazon Athena queries surface a new-product blind spot, a SQL policy labels the captured records, and a fine-tune on that data teaches the router the new product. We measure accuracy before and after, on data that could not have existed before the model was deployed. The inference operator serves the model on one node, and the training operator runs the fine-tuning on another.
> 
> We use synthetic data for the walkthrough.

---

Record: https://forck.live/items/36012-build-a-model-improvement-flywheel-with-amazon-sagemaker-hyperpod-data-capture
Catalogue: https://forck.live/llms.txt
Current issue: https://forck.live/feed.md
