From the source
NVIDIA is expanding its Confidential Computing platform with Confidential Bare Metal, a deployment option that lets frontier model builders run sensitive workloads on dedicated third-party infrastructure while keeping control of their models and data.
- The company says the new option adds platform security controls that protect data in transit, measure platform integrity and enforce hardware-level access restrictions, so builders can own and operate their own host and platform software on NVIDIA accelerated computing across third-party cloud, neocloud and enterprise infrastructure.
- Confidential Computing now covers three deployment modes: Confidential Bare Metal, Confidential Containers for Kubernetes and Confidential Virtual Machines for virtualized environments.
Cohere plans to integrate Confidential Bare Metal into Cohere Model Vault, using trusted execution environments to extend hardware-rooted security to the GPU and protect models and data in memory and across interconnects during execution.
Google Cloud is extending support to A4X Max instances powered by NVIDIA GB300 NVL72 systems, which it says combine non-virtualized accelerated computing with cryptographic protection for training data and model intellectual property.
