埃森哲与Anthropic达成合作测试AI模型安全

Also on the docket for this week, talks around AI in his AI models grow more powerful. Companies are racing to make sure their cyber defenses can keep up. Citigroup CEO Jane Frazier says the threat is evolving quickly and businesses need to be ready. There is a race to defend and shore up all of the firm's perimeters, and there is a tsunami of patching going on in the world at the moment in all companies, as we make sure that we are trying to secure the defense around the perimeter of all our firms against the negative side of the models.

Let's bring in Bloomberg Tech host Ed Ludlow. Ed, it's a discussion that will be on everyone's minds as the UN and China in the U.S. meet. Sam Altman of OpenAI also set to address the U.N. Security Council. How is this conversation taking shape? We are at least far away from the panic that we started last week with. Yeah, we ended the week with people saying, actually, the idea that there's sort of an existential threat to human life from AI is not universally believed, and lots of people came out and said that we believe it's near to zero.

From leading academics to Jensen Wang himself speaking over the weekend. And what's interesting is like, you know, how is this being acted on? So the big news that broke Friday and is carried over into this Monday equity session is anthropic doing an agreement with Accenture where Accenture, people go into anthropic get employee level access and red team models before they're deployed. Red teaming in that context means they try and break them.

They try and identify failures deliberately. But that is an interesting development and an interesting story, because if you remember Dario Almodovar's essay from, uh, Saturday prior to last, he said, we want third party independent evaluation of the models. And the deal between anthropic and Accenture is not exclusive meaning. And very significantly, Accenture doesn't become the sole auditor of anthropic. Um, but these kind of arrangements, um, you know, expect to see them and it is, uh, substantive. so we knew a century already had somewhat of a relationship.

There is there up to for the other sort of consultancy firms are we expect this more to be siloed. And basically this is going to be a winner take all situation. Yeah, it's why I ask I flagged the exclusivity thing. There seems to be, uh, talks between anthropic and other third parties for people that could come in. The main point, uh, the, the industry's grappling with is how do they get to a place where there is not a cartel formed?

In other words, um, there is no regulatory capture by which the frontier labs are setting their own rules to their own benefit. And, you know, you have people like David Sachs saying pretty robustly, like, you guys, sort this out yourselves. This is an engineering problem. According to Jensen Long, if you're so good at I, you should be able to make sure the models are safe prior to release. The other side of the argument is that some oversight is needed, right?

And the labs themselves want somebody to come in and just check their work and like, that's a big body of work. It will take multiple parties.