'We may not survive this': Another Anthropic employee quits with stark AI warning

Joe Benton calls for greater transparency from AI companies. Days after Anthropic researcher Jacob Coxon resigned, warning that AI companies were “gambling with our lives” in their race to build self-improving superintelligence, another employee from the company’s safety team has also stepped down, raising concerns over the risks posed by increasingly capable AI systems.Joe Benton, the former manager of Anthropic’s Scalable Oversight team, said he left the company’s safety team two weeks ago because he believes frontier AI companies are moving too quickly towards systems that could become far more capable than humans, without adequately addressing the risks.“I left Anthropic's safety team two weeks ago. Now feels like a good moment to explain why,” Benton wrote in a post on X.‘We may not survive this’Benton said AI companies were racing to build machines “much smarter than any human” and warned that humanity may not survive if the development of such systems continues without stronger safeguards.“AI companies are racing to build machines that are much smarter than any human, and we may not survive this,” he wrote. Benton said he wanted to work outside the company to better inform t...