Anthropic CEO AI super weapon
The CEO of Anthropic revealed that internal testers described the company's AI as a 'super weapon' that should require a gun license to operate. #Anthropic
Transcript (en)
Mythos was too powerful to release to the public. What surprised you most about it? I think the thing that surprised me most about it was the models had been climbing in their ability to find vulnerabilities and, importantly, turn those vulnerabilities into exploits, which people only talk about the vulnerabilities. They don't often talk about turning the vulnerabilities into exploits, which it was quite good at. So the things that surprised me are we saw this huge jump. It was a particularly large jump. And without us really prompting them at all, some of the early companies that we gave this to said things like, this is a super weapon. You should have to own a gun license to use it. Please don't release this. Like, the demand to do this was coming from the companies we gave it to who were finding so many critical vulnerabilities and exploitability around these critical vulnerabilities that, you know, they were basically asking us not to release it.
