Inside the Together AI kernels team

The blog post tells the story of Together AI's kernels team, highlighting their work on FlashAttention, the ThunderKittens library, and their rapid optimization of kernels for NVIDIA's Blackwell GPUs, achieving up to 2x speedups over cuBLAS on H100s within a week of hardware access.

From the source
Within one week of hardware access, we had some of the fastest FP4 and FP8 GEMM kernels available for Blackwell, with up to 2x speedups over cuBLAS on H100s.
together.ai

Visit source ↗together.ai

Announced: 01 Apr 2026 00:00 UTC
Detected: 03 Aug 2026 21:12 UTC (+124d after)

Other stories

Together AI · 28 AugGLM-5.3 vs. GLM-5.3 Flash on DeepSWE: Cost, Coding, and Routing

xAI · 29 AugGrok Bot now works with XCapability change

GitHub · 28 AugGitHub Copilot in Visual Studio — August update

GitHub · 28 AugGitHub Copilot weekly releases — August 24Capability change

Amazon · 28 AugBatch write and discover records in Amazon SageMaker Feature Store

API release

Perplexity · 28 AugGLM 5.3API release