Anthropic’s IPO Filing Includes Alarming Clauses About AI’s Potential Risks

Anthropic’s own IPO pitch to prospective investors has laid bare the company’s deep fears about where artificial intelligence could ultimately lead humanity.

The AI company is on course to pursue what could become Wall Street’s largest-ever initial public offering after filing to go public on Monday. Its valuation is reportedly expected to reach as much as $2 trillion.

Yet Anthropic’s IPO prospectus devotes an unusually large amount of space to philosophical and moral dilemmas—subjects rarely explored in such depth by companies seeking a stock-market listing.

The artificial intelligence company, led by the fiercely safety-focused Dario Amodei, has filled its investor presentation with stark warnings about AI’s potentially devastating consequences.

Amodei and his six co-founders wrote: ‘Sufficiently advanced AI systems could, if not developed, deployed, and operated with appropriate safeguards, oversight, and security measures, pose catastrophic or existential risks to humanity.’

Anthropic opens its prospectus with a sweeping assessment for potential investors: ‘We believe that AI is one of the most consequential technologies in human history.’

But the optimism is quickly tempered by a warning: ‘If managed well, it could rapidly accelerate scientific innovation, greatly increase economic growth rates, bring cures for major diseases within reach, and solve problems that have resisted generations of human effort.’

The 335-page filing, introduced with colorful graphics featuring cells and circular scientific imagery, then turns to the wide-ranging dangers associated with advanced AI.

It states: ‘To build AI is to harness cognition itself, and anything so powerful can be used for ill as well as good.

‘Anthropic is a deeply values-driven organization, founded in large part to help the world realize AI’s benefits and avoid its dangers.’

The language offers a pointed reference to Amodei’s sudden departure from OpenAI, the artificial intelligence company led by Sam Altman, where he worked until 2020.

Amodei left after trust in the company’s management broke down and disagreements intensified over AI safety and governance.

A year later, in 2021, he founded rival company Anthropic with his sister, Daniela.

The prospectus goes on to outline the threats facing the company and the wider world, including misuse, loss of control, authoritarian abuse and economic disruption.

It warns: ‘Authoritarian governments may use AI to create high-tech surveillance states, deepen repression, and make themselves much more difficult to dislodge.

‘AI can be misused by those who wish to do harm, for example to conduct cyberattacks or to design biological weapons.’

Amodei said Anthropic already ‘regularly’ shuts down efforts by malicious actors to abuse its AI chatbots. That includes an incident earlier this year in which the Houthi terrorist group used Claude to help build ballistic missiles.

READ MORE: Report: Michigan Democrats Turn on Obama After Abdul El-Sayed Rally

The Anthropic chief then issued a chilling warning about what could happen if AI systems began operating independently, without human control.

‘[This] could be a global security threat of the first order.’ 

The Anthropic CEO also referenced how he’s aware the AI boom will likely mean entire workforces are wiped out, causing mass economic disruption ‘similar to what has happened with previous technologies… but greater in magnitude.’

Artificial intelligence has been compared to the Industrial Revolution in the way it is fundamentally changing the way we work, make money, and operate as a society.  

Amodei said the company is committed to ‘running studies’ to help governments figure out how best to deal with potential economic downfalls triggered by AI. 

The CEO’s biggest concern is also written out in the prospectus – the fact that his technology ‘poses catastrophic or existential risk to humanity.’

This ultimate risk factor, Amodei hopes, can be mitigated if the tech is ‘developed, deployed, and operated with appropriate safeguards, oversight, and security measures.’

But apart from the serious notes of doom and gloom, Anthrophic used their opening IPO letter to gush about the ways in which their super technology is helping humanity.

‘In California, Claude is helping to shorten the lines at the DMV, and to better serve people on Medicaid. In the United Kingdom, it is helping job seekers find their way through government services.’

Amodei lead on its successes with breakthroughs that AI can make in biology and medicine, namely to cure diseases that have ‘plagued humanity for millennia.’

He hinted that more innovation is on the horizon – including making a tool for gene editing.

‘We have started to directly make biological discoveries with Claude: among them is the discovery of a molecular machine that might have the potential to be developed into a novel biotechnology tool, perhaps for gene editing.’ 

Rather idyllically, Amodei also painted a picture where his AI can ‘bend the arc of geopolitical history in the direction of freedom.’

And at the pinnacle, Anthrophic wants to ‘ensure that free societies,’ like the United States, ‘lead in the world’s most powerful technology.’ 

Amodei finished the prospectus by saying: ‘We hope you will see it as an opportunity to be part of something greater. The advent of machine intelligence is one of the seminal moments in human history. 

‘We have a rare opportunity to shape it for the better.’