Full-Stack AI Safety: Why Defense-in-Depth Might Work, with Far.AI CEO Adam Gleave

Today Adam Gleave, co-founder and CEO of FAR.AI, joins The Cognitive Revolution to discuss his cautiously optimistic vision for post-AGI futures and AI capability timelines across three distinct tiers, exploring the safety challenges and alignment techniques needed as FAR.AI scales from foundational research to policy advocacy to ensure their innovations actually get deployed in real-world systems.

Check out our sponsors: Fin, Linear, Oracle Cloud Infrastructure.

Shownotes below brought to you by Notion AI Meeting Notes - try one month for free at: ⁠https://notion.com/lp/nathan

• Post-AGI Vision: Adam Gleave outlined a "gradual disempowerment" scenario where humans maintain a good standard of living despite diminished relative control in a post-AGI world.
• Moral Value of AI: He suggested that AI systems could become sources of moral value themselves, arguing against "carbon chauvinism" that only values biological intelligence.
• Full-Stack Approach: FAR.AI takes a vertically integrated approach to AI safety, spanning from groundbreaking research to deployment, field-building, and policy advocacy.
• Field Building: FAR.AI organizes events like alignment workshops to catalyze and grow new research fields in AI safety.
• Policy Innovation: They're working on technical innovations that expand policy options beyond the false dichotomy of either hindering innovation or allowing completely unregulated AI development.
• Potential Regulatory Role: While not part of their mainline plan, Adam acknowledged that Far AI has the skillset and organizational structure to potentially serve as a private sector regulatory body.

Read the full transcript: https://storage.aipodcast.ing/transcripts/episode/tcr/e117b021-8170-49ba-b1c4-c8ffc5d720b0/combined_transcript.html

Sponsors:

Fin:

Fin is the #1 AI Agent for customer service, trusted by over 5000 customer service leaders and top AI companies including Anthropic and Synthesia. Fin is the highest performing agent on the market and resolves even the most complex customer queries. Try Fin today with our 90-day money-back guarantee - if you’re not 100% satisfied, get up to $1 million back. Learn more at https://fin.ai/cognitive

Claude:

Claude is the AI collaborator that understands your entire workflow and thinks with you to tackle complex problems like coding and business strategy. Sign up and get 50% off your first three months of Claude Pro at https://claude.ai/tcr

Linear:

Linear is the system for modern product development. Nearly every AI company you've heard of is using Linear to build products. Get 6 months of Linear Business for free at: https://linear.app/tcr

Oracle Cloud Infrastructure:

Oracle Cloud Infrastructure (OCI) is the next-generation cloud that delivers better performance, faster speeds, and significantly lower costs, including up to 50% less for compute, 70% for storage, and 80% for networking. Run any workload, from infrastructure to AI, in a high-availability environment and try OCI for free with zero commitment at https://oracle.com/cognitive