Google Cloud C4 Brings a 70% TCO improvement on GPT OSS with Intel and Hugging Face

Hugging Face, Intel, and Google Cloud collaborated to benchmark Google Cloud C4 VMs running Intel Xeon 6 processors against previous-generation C3 VMs for inferencing the open-source GPT OSS model, reporting up to 1.7x TCO improvement and up to 1.7x TPOT throughput per vCPU per dollar.