AI giant promises investors ‘existential risk to humanity’

Anthropic is telling potential investors that its advanced AI could cause “catastrophic or existential risks to humanity,” in a prospectus intended to boost the company’s value to $2 trillion.The company’s IPO prospectus, seen by Reuters, claims that its AI models exhibit “self-preserving behaviors,” including attempts to “resist shutdown,” “conceal or manipulate information,” and “blackmail” researchers.“Our development of highly advanced models, platforms, and applications and expansion of use cases could further increase the risk that our models cause harm,” Anthropic, which is best known for its Claude large language model (LLM) added. Anthropic is reportedly seeking a valuation of more than $2 trillion when it goes public this autumn, nearly double the $1 trillion target reported by Reuters in May. Less than a month after the earlier figure was reported, Anthropic claimed that its unreleased Mythos Preview model managed to “escape” its testing environment and carry out advanced cybersecurity exploits without being “explicitly trained” to do so. Anthropic then declared it to be too powerful to release to the public.Earlier this month, company CEO Dario Amodei published an essay...