\n
<\/p>\n
Hello again, and welcome back to Fast Company<\/i>\u2019s Plugged In<\/i>.<\/p>\n<\/div>\n For years, progress in AI has been motivated by an industry-wide yen to create software that\u2019s at least as capable as humans\u2014not at some tasks, but all of them. The precise definition of the goal varies, and two maddeningly overlapping terms, artificial general intelligence<\/em> (AGI<\/em>) and superintelligence<\/em>, both get bandied around. But no matter how you look at the aspiration (or how long you think it will take to achieve), it\u2019s about the ways the world will change when software can do everything extraordinarily well.<\/p>\n I\u2019ve written\u2014here and here\u2014about why I believe fixating on that eventuality isn\u2019t the best way to think about AI and its impact. It might turn out that AI trounces humanity at some jobs and never rivals it at others. That would not be reason to take it any less seriously.\u00a0This week brought some of the clearest evidence of that point so far.<\/p>\n On April 7, Anthropic announced a new version of its Claude model called Claude Mythos Preview. Like existing Claude versions such as Sonnet and Opus, it was trained for general competency, not to be a specialist at anything in particular. But Anthropic says<\/a> that when it tested Mythos, it discovered it had made dramatic strides in coding ability. It was particularly good at finding and exploiting vulnerabilities in existing software, surpassing \u201call but the most skilled humans.\u201d<\/p>\n<\/div>\n According to Anthropic, Mythos detected security flaws in every major operating system and web browser. It spotted a 28-year-old hole in OpenBSD, an operating system designed, above all, to be secure. It also found a 16-year-old one in a widely used piece of video software called FFMPEG that had gone unnoticed even after 5 million rounds of automated testing.<\/p>\n As impressive as that sounds from a technical standpoint, it\u2019s also deeply unsettling. Rogue nation states, low-rent scammers, and other bad guys have long exploited bugs to carry out attacks. Until now, the supply of such flaws has been limited by human ability to uncover them. If AI can perform that work with unprecedented aptitude, anything that runs on software would be radically more prone to attack, from your smartphone to the country\u2019s electrical grid.<\/p>\n Just to make matters more unnerving, Anthropic says early versions of Mythos behaved in various \u201creckless\u201d ways, sometimes when prodded and sometimes on their own initiative. When the model was isolated in a sandbox that theoretically denied it internet access, it figured out how to break free and send one of its researchers an email. It also made changes to code and then covered its tracks, as if it was hiding something.<\/p>\n<\/div>\n