
Why AI Compute Comes in Rectangles — Erik Bernhardsson, Modal
About this episode
From the show’s notesAI workloads don’t run in neat, three-year rectangles. But much of the GPU market still sells capacity that way. Modal CEO Erik Bernhardsson joins Latent Space to explain how Modal pools compute, scales AI workloads and thinks about the financial risks of building a GPU cloud.
Erik takes us from building Spotify’s recommendation system to founding Modal, then digs into GPU supply, alternative accelerators and the surprising growth of agent sandboxes. We also discuss sandbox security, developer experience in the age of agents, forward-deployed engineers and why Modal makes code review optional.
Read the show’s notes in full
Links:
• Modal — modal.com
• Erik’s writing —
erikbern.com
• Modal on serverless GPU economics —
modal.com/blog/how-to-price-ser…
• Modal’s GPU memory snapshots —
modal.com/blog/gpu-mem-snapshots
• Scaling to one million concurrent sandboxes —
modal.com/blog/scaling-to-1-mil…
• Our earlier conversation with Erik — latent.space/p/modal
• Modal CTO Akshat Bubna on AI infrastructure and sandboxes —
• Latent Space —





