Fast Inference on Large Language Models: BLOOMZ on Habana Gaudi2 Accelerator

To deploy large language models like BLOOMZ on Habana Gaudi2 accelerators using Optimum Habana, and presents benchmarks showing that Gaudi2 achieves lower inference latency than Nvidia A100 80GB GPUs for BLOOMZ models.