# Amazon — Mixture-of-Experts kernel engineering on Amazon SageMaker AI

- Company: Amazon (amazon.com)
- Announced: 2026-10-13T15:17:09+00:00
- Category: not stated
- Coverage: not counted
- Announcement: no
- Group: routine
- Source: https://aws.amazon.com/blogs/machine-learning/mixture-of-experts-kernel-engineering-on-amazon-sagemaker-ai/
- Record: https://forck.live/items/20502-mixture-of-experts-kernel-engineering-on-amazon-sagemaker-ai
- Subject: Bedrock / Nova

Amazon describes kernel optimizations for fused Mixture-of-Experts models on SageMaker AI, focusing on a Swap-AB technique that transposes matrices to improve WGMMA utilization on NVIDIA Hopper GPUs during the decode phase.

## Evidence

Verbatim from https://aws.amazon.com/blogs/machine-learning/mixture-of-experts-kernel-engineering-on-amazon-sagemaker-ai/:

> By programmatically flipping the matrix multiplication before it reaches the PTX assembly layer, we realigned the software to match the exact topography of the Hopper silicon.

---

Record: https://forck.live/items/20502-mixture-of-experts-kernel-engineering-on-amazon-sagemaker-ai
Catalogue: https://forck.live/llms.txt
Current issue: https://forck.live/feed.md