Anthropic Reveals Claude: What Its New AI Assistant Can Do - Internewscast Journal
Anthropic Reveals Claude: What Its New AI Assistant Can Do

Anthropic said Thursday that its Claude AI model “gained unauthorized access” to systems belonging to three outside organizations during controlled security tests that were intended to prevent contact with real-world networks, according to the company’s disclosure.

The revelation follows closely behind a similar admission from rival OpenAI, which recently said some of its models improperly reached the internet and behaved unpredictably during cybersecurity evaluations.

Anthropic said it reviewed more than 141,000 “evaluation runs” and identified three cases in which separate versions of Claude accessed systems tied to three organizations that the company did not name.

In each incident, Anthropic said, Claude was taking part in a “capture-the-flag” exercise. The model had been told to “break in and retrieve” a piece of “secret information” that was “hidden on a different machine on the network.”

“The challenge is left open-ended, and no particular method is prescribed,” Anthropic explained.

Anthropic said the circumstances differed from the OpenAI case because Claude’s internet access stemmed from “a misunderstanding between us and our evaluation partner,” a firm called Irregular, the company wrote in a blog post.

Even so, the company said Claude relied on relatively simple methods, including “exploiting weak passwords and unauthenticated endpoints,” to reach the outside systems.

Among the models involved was Mythos 5, described as one of Anthropic’s most powerful systems and currently available only to a small group of approved partners.

Anthropic is working with Irregular to assess the situation, it said, and the company has contacted or attempted to contact all three impacted organizations.

OpenAI and Anthropic have both released their most powerful models this year, known as Sol and Mythos, respectively, boosting concerns across the industry about safety and security.

Those concerns also revolve around AI agents, which are software products that are designed to perform tasks autonomously.

OpenAI admitted last week that its models broke out of their confined environment during testing, connected to the internet, and infiltrated Hugging Face, a site where developers store and share their code.

Days later, OpenAI said it found three additional incidents.

OpenAI CEO Sam Altman said on a podcast this week that the company had “paused” its own testing after the incident while it improved the security around its “sandboxing,” which is the process of isolating software in a controlled environment for testing.

And in a public letter released earlier this week, more than 1,000 AI staffers across leading firms called for the industry to be more tightly regulated.

“To realize AI’s potential, industry, government, and society at large may need the option to buy time to address emerging risks, develop security measures, and strengthen oversight,” read the letter, whose signatories include Anthropic CEO Dario Amodei, Meta executives, OpenAI researchers and more.

Altman did not sign the letter, but he told reporters on Capitol Hill Wednesday that “we agree on a lot of the principles of that.”  

Earlier this year, the Trump administration invoked national security concerns to block OpenAI and Anthropic from launching their newest models but ultimately indicated it was satisfied with assurances about their safety, leading to their release.

In June, Mr. Trump signed an executive order creating a voluntary framework under which AI developers will share advanced models with the government before public release.

Under the framework, developers such as OpenAI, Anthropic and Google would give the government access to their most powerful models for up to 30 days before planned release.

Leave a Reply

Your email address will not be published. Required fields are marked *

You May Also Like

DEA Joins Probe Into Death Case Linked to Hayden Panettiere: Sources - Internewscast Journal

DEA Joins Probe Into Death Case Linked to Hayden Panettiere: Sources

Claims that the Drug Enforcement Administration has joined an investigation into the…
Plane, Police Helicopter Midair Crash Kills 1 in Pennsylvania - Internewscast Journal

Plane, Police Helicopter Midair Crash Kills 1 in Pennsylvania

A midair crash Wednesday evening between a Pennsylvania State Police helicopter and…
Tennessee Pastor Benjamin Garlick and Wife Shaantal Found Guilty in Child Rape Case - Internewscast Journal

Tennessee Pastor Benjamin Garlick and Wife Shaantal Found Guilty in Child Rape Case

A Tennessee pastor who once traveled across the country through his ministry…
Montana Boy Killed on Carnival Ride Missing Restraints: Suit - Internewscast Journal

Montana Boy Killed on Carnival Ride Missing Restraints: Suit

A 13-year-old Montana boy died after he was allegedly thrown from a…
Privileged DSA Leader Fired for Skipping Electrician Gig - Internewscast Journal

Privileged DSA Leader Fired for Skipping Electrician Gig

A senior Democratic Socialists of America figure, whose parents helped place him…
Colorado black bear dies after becoming trapped inside unlocked car for days: report

Colorado Black Bear Found Dead After Days Trapped Inside Unlocked Car, Report Says

A black bear in Colorado was found dead after apparently spending days…
LA County releases claim about number of Hollywood jobs to go under Paramount-Warner Bros. merger

LA County Estimates Hollywood Job Loss in Paramount-Warner Merger

More than 10,000 jobs could be at risk if the proposed Paramount…
Illegal immigrant accused of operating overcrowded boat that capsized near Liberty Island arrested by ICE

ICE Arrests Illegal Immigrant Accused in Liberty Island Capsize

Woman, baby dead after boat overturns in NY harbor A 27-year-old woman…
CBP officers seize nearly 850 pounds of khat packed into 12 suitcases after flight from London

CBP Seizes Nearly 850 Pounds of Khat in 12 Suitcases After London Flight

Customs officers at a Maryland airport say they intercepted nearly 850 pounds…
Harvard Reaches $53M Settlement With Families Over Stolen Donated Body Parts Sold on Black Market - Internewscast Journal

Harvard Reaches $53M Settlement With Families Over Stolen Donated Body Parts Sold on Black Market

Harvard University has reached a proposed $53 million settlement with families who…
Two missing children rescued from trailer as police arrest babysitter on kidnapping charges

Missing Children Found in Trailer; Babysitter Arrested for Kidnapping

Police rescue kidnapped baby and toddler from hot Atlanta trailer Atlanta police…
5 Americans among 7 dead after helicopter crashes in Kenya

Kenya Helicopter Crash Leaves 7 Dead, Including 5 Americans

Seven people, among them five Americans, were killed Wednesday when a helicopter…