Bien que soutenue par des poids lourds comme Microsoft, Cisco et Amazon, l'alliance souffre de l'absence d'OpenAI, Anthropic et Google au sein de son comité exécutif.
Les acteurs de l'open source cherchent à auto-organiser la sécurité des agents autonomes pour devancer les projets d'interdiction réglementaire visant les modèles ouverts.
L'Open Secure AI Alliance (OSAA), qui réunit plus de 120 entreprises, a profité de la conférence Black Hat pour lancer le groupe de travail SAFE sous l'égide de la Linux Foundation. L'organisation publie ses premières propositions axées sur le signalement confidentiel des vulnérabilités d'agents IA, la notification des incidents et le partage d'analyses d'impact sans incrimination. En parallèle, des membres comme Nvidia, Amazon et Okta ont ouvert l'accès à plusieurs briques logicielles open source de sécurité.
Impact concret
Les RSSI et responsables sécurité doivent réviser leurs procédures d'audit d'agents IA en intégrant les mécanismes de reporting confidentiel et les scanners de vulnérabilités partagés par le groupe.
Applications concrètes
Signalement sécurisé des failles de modèles via la Linux Foundation, audit automatisé des invite avec le scanner Garak, et contrôle des autorisations d'agents via le langage Cedar.
The week-old Open Secure AI Alliance (OSAA), an industry group spearheaded by Nvidia that has already grown to over 120 companies, has developed a cutely named working group, the Shared AI Findings Exchange, or SAFE. The group is already presenting proposals for open comment, and the Linux Foundation, a member of the group, is managing the proposals. The group developed them while members gathered at the nexus of the cybersecurity world, the Black Hat conference, taking place this week in Las Vegas. The guidelines are nothing terribly earth-shattering for now. The proposals cover areas like how to confidentially report AI cybersecurity incidents, alert those affected, and then do blame-free analysis so all can learn from them. At the same time, members of the OSAA are also contributing and cataloging bits and pieces of their open source technology that might be useful. This may, as these types of industry organizations go, eventually coalesce into an open source means for an enterprise to secure their AI agents, or defend against rogue AI attackers, such as the OpenAI model that infiltrated Hugging Face . (Hugging Face is also a member of this group.) For instance, Nvidia has noted that it offers an entire family of open models, as well as an open source LLM vulnerability scanner called Garak ; Okta is working on agent identity tech; Red Hat is working on agent governance; and Amazon has contributed both an open agent building tool, Strands Agents , and an authorization language, Cedar . And there are many more examples. The group now includes a host of big names, including Adobe, BlackRock, Cisco, Intel, Microsoft, and Visa, but there are some notable absences, like Anthropic, OpenAI, and Google. Interestingly, both OpenAI and Google signed the original open letter that spawned this group. The letter, published last week , urged the White House to support open source AI efforts, not squash them. It was championed by Nvidia and signed by over 200 tech companies. While Anthropic’s cold shoulder to the letter and the industry group to date is not a surprise , both OpenAI and Google have released open weight models of their own. Google is generally known as a big supporter of open source, too. We’ll see if they join as this group builds momentum. Meanwhile, the group is operating at AI speeds. It’s only been a couple of weeks since news broke that the Trump administration was considering banning Chinese open weight models , causing the industry consternation that resulted in the open letter . Whatever ultimately happens with Chinese open weight models in the U.S., the fast action by this heavyweight group appears to be a good thing for the U.S. open AI ecosystem. Some in the ecosystem, like the co-founder and chief technology officer of U.S. open weight AI lab Arcee, say that’s ultimately the way to best any threat — real or imagined — that Chinese AI labs pose to the United States . “Openness may be one of the most important paths to AI safety and security,” this industry group wrote in their letter. Looks like they are ready to immediately put their effort — and their tech — where their mouths are. Topics AI , cybersecurity , Enterprise , nvidia , Security When you purchase through links in our articles, we may earn a small commission . This doesn’t affect our editorial independence. Julie Bort Venture Editor Julie Bort is the Startups/Venture Desk editor for TechCrunch. You can contact or verify outreach from Julie by emailing julie.bort@techcrunch.com or via @Julie188 on X. View Bio October 13 – 15 San Francisco Scale faster. Grow your portfolio. Gain practical expertise. No matter your goal, Disrupt can empower you. Save up to $330 toda y! REGISTER NOW Most Popular Bending Spoons to buy Airtable for $1.28B Ivan Mehta Influencers draw backlash for attending OpenAI’s first luxury trip Dominic-Madori Davis Sequoia’s Shaun Maguire leads $1B round for nuclear startup Valar Atomics Julie Bort YouTuber Hank Green says his AI usage is ‘not healthy’ Anthony Ha WhatsApp is testing a new folder for messages from large businesses Ivan Mehta Okta buys AI security startup Permiso — source says for about $200M Jagmeet Singh Claude Opus 5 became downright ruthless when tasked with running a vending machine Julie Bort