AI has over 10% chance of killing all humans within decade – Anthropic researcher

Evan Hubinger says the company still has no clear plan to keep superintelligence under human control There is a more than 10% chance that artificial intelligence could wipe out humanity within the next ten years, a senior Anthropic researcher has warned amid mounting concerns over increasingly powerful systems slipping beyond human control.Evan Hubinger, who works on aligning advanced AI systems with human interests, made the assessment after fellow Anthropic researcher Jacob Coxon resigned over fears that leading tech companies are racing toward systems they may not be able to keep in check.“We really do earnestly believe AI could kill all humans,” Hubinger wrote on X on Wednesday. “I personally think it is >10% within the next decade.” He added that Anthropic is “trying its best” but still does not have a plan for safely controlling superintelligence and is “not clearly on track” to find one.Hubinger noted that while current AI models pose a low risk, there is concern that future systems could begin improving themselves recursively, rapidly becoming more capable than humans before adequate safeguards are developed.Coxon, who previously worked at OpenAI, announced his departure...