From the source
Amazon announced benchmarking of small LLM inference on SageMaker AI, comparing G7 instances (
NVIDIA Blackwell GPUs) against G5 and G6 instances for two 30B MoE models: Qwen3-Coder-30B and NVIDIA Nemotron-3-Nano-30B-A3B-NVFP4.
- The benchmarks demonstrate that G7 instances deliver measurable gains in throughput, latency, and cost-per-token.





