Anthropic Researcher Calls for AI Regulation Amid Concerns Over Safety

<p>Jacob Coxon, a researcher at Anthropic, announced his departure from the company due to concerns that advancements in artificial intelligence (AI) could pose risks to human life. In an interview on Fox News, he emphasized the importance of regulation in mitigating these risks.</p><p>Coxon, who previously worked at OpenAI and Anthropic for three years, expressed that the rapid development of self-improving superintelligence is akin to 'gambling with our lives.' He stated that while the current threat level from AI is minimal, the potential for recursive self-improvement could lead to significant dangers in the near future.</p><p>In his resignation post on X, he highlighted the urgent need for responsible action from companies involved in AI development. He believes that there is a greater than 10% chance that AI could lead to catastrophic outcomes within the next decade if not properly managed.</p><p>Evan Hubinger, alignment science lead at Anthropic, supported Coxon's views, stating that while current AI models pose low risks, the emergence of superintelligence could happen sooner than anticipated. He noted that the industry must address alignment issues to prevent potential threats.</p><p>Coxon called for international cooperation to regulate AI technologies, describing them as potentially the most dangerous technology humanity has created. He urged the global community to oversee AI development to avoid an arms race that could have disastrous consequences.</p><p>He acknowledged the benefits of AI but stressed the need for a cautious approach to ensure safety. Coxon believes that with concerted effort, the challenges posed by AI can be addressed effectively.</p><p>Fox News Digital has reached out to Anthropic for further comments.</p>