| | By Benjamin Guggenheim | Not a subscriber? Sign up here to get this newsletter in your inbox. - Exclusive: A group of AI policy groups are calling on President Donald Trump to launch a formal investigation into OpenAI’s rogue agent attack on digital library Hugging Face.
- The Senate Commerce Committee punts consideration of a suite of AI bills and narrows its focus for next week’s markup. Senate Democrats on the committee feel like they keep getting jammed and want a more “collaborative” process with Republicans on AI.
- Our Lead Global Security Analyst Josh Rogin sits down with Retired Vice Admiral Frank “Trey” Whitworth III about his leadership of r4 Federal, which provides predictive AI for defense and intelligence services.
This is Benjamin Guggenheim. Welcome to WP Intelligence’s AI & Tech Brief, where we examine the transformative technology of artificial intelligence at the intersection of innovation, policy and power. Get in touch at Benjamin.Guggenheim@washpost.com or on Signal at ben_guggenheim.88. The Lead Brief A group of prominent AI policy groups is formally requesting President Donald Trump to open a government investigation into OpenAI’s recent rogue agent hack into digital library Hugging Face. “Given the severity of the incident and the broader vulnerabilities it revealed, we urge the Trump administration to open an investigation, with the support of independent auditors, into what occurred,” says the new letter, which is led by Brad Carson, president of Americans for Responsible Innovation, and Brendan Steinhauser, CEO of the Alliance for Secure AI. The letter, which I obtained exclusively, is co-signed by Public Citizen, the Future of Life Institute, and AI research and independent evaluator FAR.AI, among others. Independent AI research nonprofit METR also announced early Thursday morning that it had reached an agreement with OpenAI to conduct research into the security incident alongside Redwood Research. But Carson tells me in an interview that this kind of incident calls for a government investigation and public transparency about the findings. “This is kind of like an airplane crash,” Carson said. “It’s fine if Boeing wants to investigate itself for this. Even if they hire a very reputable outside person to help them on that project, [we] have a public interest in knowing what’s going on here.” “There’s still a lot of questions about [the METR investigation],” he added. “Is METR under an NDA? Is this actually going to be released to the public? What access does METR have in terms of… the models that are being run?” In response to a request for comment, an OpenAI spokesperson said that METR and Redwood Research plan to publish a joint blog detailing the terms of their agreement with OpenAI and the scope of their evaluations and conclusions. “This is an unprecedented incident, and we think it marks an important moment for AI safety,” the spokesperson said. “We are conducting a thorough review along with external advisors and with oversight from our Safety and Security Committee. Once the review is complete, we will publish a technical report of our learnings for everyone.” Altman making the rounds: The call for a government investigation comes as OpenAI CEO Sam Altman is set to meet Thursday with White House Chief of Staff Susie Wiles, Commerce Secretary Howard Lutnick, Treasury Secretary Scott Bessent, White House Office of Science and Technology Director Michael Kratsios and National Cyber Director Sean Cairncross, according to an OpenAI spokesperson. Altman made the rounds on Capitol Hill Wednesday to preview the company’s newest models. Federal agency heads, such as Bessent and Cairncross, are charged by a White House executive order issued in June to submit a framework outlining how a voluntary pre-deployment review regime would work for new AI models. The agency heads must submit the framework to the White House by Saturday. The big question: Some AI experts I spoke with have argued that the narrative of a “rogue” agent gives too much grace to the researchers at OpenAI. (You can read an analysis of the full timeline of the hack by The Post here.) It’s possible that an AI agent could escape a sandbox set up to contain it, but the researchers should have been monitoring what the agents were doing in real time, the argument goes. Instead, it appears that OpenAI didn’t know about the agent’s attacks on Hugging Face for several days. “They were doing bad engineering and blaming rogue agents for it. That’s what my view is on what happened.” said Suresh Venkatasubramanian, the director for the Center for Technological Responsibility, Reimagination and Redesign at Brown University and a subcommittee chair on AI for the Association for Computing Machinery. “They didn’t bother to monitor the system that was doing the hacking to make sure it didn’t actually breach the containment of the environment they put it in,” he said. OpenAI did not respond to a request for comment on the argument. Sam Jones, the CEO and co-founder of cybersecurity firm Method Security, told me that he was also surprised that OpenAI’s researchers weren’t monitoring their agent environment. However, the broad takeaway should be that the systems surrounding large language models to date are designed for developers, not for real-world production, where trust and rules of engagement are important, Jones said. “They might be running such a large at-scale set of experiments that it was maybe too loose in the sense that they were incapable of monitoring,” said Jones. “But I was frankly surprised that they were not monitoring some of those tool calls and agent sessions more closely to catch that in the act.” (Method Security has a partnership with OpenAI.) |