From the source
Lead story
Top stories
Models & availability
Latest
Lead story
Top stories
Models & availability
Latest
From the source
Training across AWS Regions without data movement
Amazon published a solution architecture pairing SageMaker HyperPod with Qumulo's Cloud Data Fabric to enable cross-Region training without copying data.
Validation showed a spoke cluster in us-west-2 reading data from a hub in us-east-2 matched the hub's throughput of 115–117 samples/sec after a warmup period, achieving 98–100% GPU utilization.
The post describes the architecture, NeuralCache predictive caching, and validation results from a 1.02 billion-parameter LLaMA v3 training run.
From the source
A HyperPod cluster running in a different Region from its data reaches the same throughput as a cluster co-located with the data (115–117 samples/sec) with no additional data orchestration needed.
aws.amazon.com