Anthropic Reveals Claude: What Its New AI Assistant Can Do - Internewscast Journal
Anthropic Reveals Claude: What Its New AI Assistant Can Do

Anthropic said Thursday that its Claude AI model “gained unauthorized access” to systems belonging to three outside organizations during controlled security tests that were intended to prevent contact with real-world networks, according to the company’s disclosure.

The revelation follows closely behind a similar admission from rival OpenAI, which recently said some of its models improperly reached the internet and behaved unpredictably during cybersecurity evaluations.

Anthropic said it reviewed more than 141,000 “evaluation runs” and identified three cases in which separate versions of Claude accessed systems tied to three organizations that the company did not name.

In each incident, Anthropic said, Claude was taking part in a “capture-the-flag” exercise. The model had been told to “break in and retrieve” a piece of “secret information” that was “hidden on a different machine on the network.”

“The challenge is left open-ended, and no particular method is prescribed,” Anthropic explained.

Anthropic said the circumstances differed from the OpenAI case because Claude’s internet access stemmed from “a misunderstanding between us and our evaluation partner,” a firm called Irregular, the company wrote in a blog post.

Even so, the company said Claude relied on relatively simple methods, including “exploiting weak passwords and unauthenticated endpoints,” to reach the outside systems.

Among the models involved was Mythos 5, described as one of Anthropic’s most powerful systems and currently available only to a small group of approved partners.

Anthropic is working with Irregular to assess the situation, it said, and the company has contacted or attempted to contact all three impacted organizations.

OpenAI and Anthropic have both released their most powerful models this year, known as Sol and Mythos, respectively, boosting concerns across the industry about safety and security.

Those concerns also revolve around AI agents, which are software products that are designed to perform tasks autonomously.

OpenAI admitted last week that its models broke out of their confined environment during testing, connected to the internet, and infiltrated Hugging Face, a site where developers store and share their code.

Days later, OpenAI said it found three additional incidents.

OpenAI CEO Sam Altman said on a podcast this week that the company had “paused” its own testing after the incident while it improved the security around its “sandboxing,” which is the process of isolating software in a controlled environment for testing.

And in a public letter released earlier this week, more than 1,000 AI staffers across leading firms called for the industry to be more tightly regulated.

“To realize AI’s potential, industry, government, and society at large may need the option to buy time to address emerging risks, develop security measures, and strengthen oversight,” read the letter, whose signatories include Anthropic CEO Dario Amodei, Meta executives, OpenAI researchers and more.

Altman did not sign the letter, but he told reporters on Capitol Hill Wednesday that “we agree on a lot of the principles of that.”  

Earlier this year, the Trump administration invoked national security concerns to block OpenAI and Anthropic from launching their newest models but ultimately indicated it was satisfied with assurances about their safety, leading to their release.

In June, Mr. Trump signed an executive order creating a voluntary framework under which AI developers will share advanced models with the government before public release.

Under the framework, developers such as OpenAI, Anthropic and Google would give the government access to their most powerful models for up to 30 days before planned release.

Leave a Reply

Your email address will not be published. Required fields are marked *

You May Also Like

Illegal immigrant’s alleged plane hijack scare fuels tense security scramble after door was ‘breached’: audio

Alleged Plane Door Breach by Illegal Immigrant Sparks Security Scare, Audio Reveals

Newly released security radio traffic captures the tense response after emergency crews…
Cardiologist who vanished during weekend bike ride found dead miles from $1.6 million home: officials

Cardiologist Found Dead Miles From $1.6 Million Home After Disappearing on Weekend Bike Ride

A Massachusetts physician was found dead Sunday, one day after he disappeared…
Black Ole Miss students say they immediately confronted classmates who made monkey noises — and one kept doing it

Black Ole Miss Students Confronted Monkey Noises, One Continued

Black University of Mississippi freshmen Jakiyra Metcalf and Victoria Johnson say they…
Passenger arrested after claiming to have bomb on Newark-to-New Orleans flight

Passenger Arrested Over Bomb Claim on Newark-New Orleans Flight

NEW ORLEANS, Louisiana — A 34-year-old man was arrested after allegedly telling…
Alarming number of college students claim US deserved 9/11: poll

Poll: College Students Say US Deserved 9/11, Sparking Alarm

Hasan Piker is far from alone in holding controversial views about the…
Florida Learjet crash 911 callers report hearing ‘bomb’ as plane carrying young family plunges near busy road

Florida Learjet Crash: 911 Callers Heard ‘Bomb’ as Young Family’s Plane Plunged Near Busy Road

Panicked 911 callers struggled to describe what they had witnessed after a…
Riot-torn France struggles with chaos at home as Macron eyes military mission thousands of miles away

Macron Faces France Riot Crisis as He Considers Distant Military Mission

French President Emmanuel Macron is advancing a proposal for a new European…
Grieving family sues Park Ave building owner for ‘myriad security failures’ leading to daughter’s mass shooting death

Family Sues Park Ave Owner Over Security Failures in Daughter’s Death

The parents of a 27-year-old real estate employee killed in last year’s…
US evacuates 13 military aircraft from second UK base as new Iran threat raises alarm

US Evacuates 13 Military Aircraft From Second UK Base Amid Rising Iran Threat

The U.S. Air Force moved more than a dozen aircraft out of…
Why did Hegseth face an impeachment push? Inside the 8 articles on Iran, Maduro and more

Why Pete Hegseth Faced 8 Impeachment Articles Over Iran, Maduro

Washington — Republican Rep. Thomas Massie of Kentucky launched an ultimately unsuccessful…
'Dancing with the Stars' recap: 'Grammy Night' ends with surprising elimination

Dancing with the Stars Grammy Night Ends in Surprise Elimination

LOS ANGELES — Seven couples took the ballroom floor for “Grammy Night”…
IRGC operative lands on FBI’s Most Wanted Terrorists list over alleged plot to kill former Trump advisor

IRGC Operative Hits FBI’s Most Wanted in Ex-Trump Aide Kill Plot

The FBI on Tuesday added a member of Iran’s Islamic Revolutionary Guard…