Jacob Coxon vs. Robin Hanson: Should We Slow Down AI? · Y Combinator Startup Podcast — forck
← Podcasts / Y Combinator Startup Podcast19 Nov · 66 min Jacob Coxon vs. Robin Hanson: Should We Slow Down AI?
About this episode From the show’s notes Should governments intervene to substantially slow the progress of frontier AI? In the inaugural YC debate, Jacob Coxon, an ex-Anthropic and OpenAI researcher, faces off against Robin Hanson, an economist at GMU, about AI takeoff and what government regulation should (or shouldn’t) do about it.
Chapters:
Read the show’s notes in full Apply to Y Combinator: ycombinator.com/apply↗
Work at a startup: ycombinator.com/jobs↗
Chapters 28 · press a time to start there 00:00 YC Debate Topic: Should We Slow Down AI? 02:42 Jacob's case: Superintelligence by 2028 07:02 Models already behaving in ways we don't understand 09:18 Robin's case: the danger of abstraction 11:22 Why new technologies take decades to diffuse 13:12 Liability instead of regulation 14:50 Why regulating AI is different from regulating drugs 16:00 Jacob's rebuttal: general intelligence is one number 17:36 Why normal liability won't cover extinction risk 19:52 Robin's rebuttal: regulating this means regulating all compute 21:44 AI as our descendants 23:38 Diminishing returns Show all 28 chapters 24:40 Direct exchange: is it just the rate of change? 26:48 How long until most cognitive work is automated? 29:21 The jobs we have no data for 32:45 How do you align the regulators?
35:03 Reward hacking, and what Hugging Face actually showed
36:11 Why not an equilibrium of AIs watching AIs
39:50 Q&A: what regulation would you actually want?
41:36 Q&A: what about China?
42:58 Q&A: an FAA for AI labs?
43:45 Q&A: the military is already deploying this
47:46 Q&A: does regulation just move the reward hacking up a layer?
51:27 Q&A: what unemployment rate can an economy withstand?
56:25 Q&A: what's the downside of a pause?
58:09 Q&A: what would change your mind?
1:02:01 Closing statements
1:04:24 The final audience vote
Anthropic IPO, GTA 6 Launch, Strauss Zelnick Joins | Hemant Taneja TBPN · 19 Nov · 97 min