Lead story
Models & availability
Latest
Lead story
Models & availability
Latest
Hugging Face, Intel, and Google Cloud collaborated to benchmark Google Cloud C4 VMs running Intel Xeon 6 processors against previous-generation C3 VMs for inferencing the open-source GPT OSS model, reporting up to 1.7x TCO improvement and up to 1.7x TPOT throughput per vCPU per dollar.
From the source
GPT OSS is a common name for an open-source Mixture of Experts (MoE) model released by OpenAI.
huggingface.co