They sincerely believe the existential risk. It’s why the founders left OpenAI. The argument is very logical, and AI people have been talking about it for decades.
youtu.be/RIJJB5B2lHU?...
youtu.be
A realistic path from rogue AI agents to human extinction
YouTube video by 80,000 Hours