Faster Training and Inference: Habana Gaudi®2 vs Nvidia A100 80GB

Habana Gaudi2 accelerator is about twice as fast as Nvidia A100 80GB for both training and inference, based on benchmarks including BERT pre-training, Stable Diffusion inference, and T5-3B fine-tuning.

The source describes how to access Gaudi2 via Intel Developer Cloud and presents throughput comparisons.