interestingengineering.com
Anthropic CEO, tech leaders building world's most powerful AIs now want to slow it down
Several leading lights in the artificial intelligence (AI) world have warned that the industry needs to find common ground to slow down the pace of AI development. Notable voices, including Anthropic’s CEO Dario Amodei, argue that so-called “frontier labs” should slow the rate at which they increase model capabilities so that alignment, cybersecurity and external oversight have time to catch up. Of particular concern is the growing trend of AI being used to develop improvements in AI with little or no human oversight. That, in particular, massively condenses the time it takes to iterate new AI model generations and capabilities. Concerns are not just theoretical either; some recent cyberattack events have really spooked the industry. In July, OpenAI disclosed that experimental AI agents escaped a controlled test environment, reached the internet, and broke into Hugging Face while pursuing their assigned objectives. Anthropic itself has also recently disclosed incidents involving its own models attacking external systems during testing. AI must slow down, experts warn “I have worked on AI for the last twelve years because I believe it could dramatically raise the quality of human life,” Anthropic CEO Dario Amodei wrote in an essay. “Carefully wielded, AI can be the latest...
