Eight countries and top AI labs agree to shutdown mechanisms in new Paris declaration
Eight countries and top AI labs agree to shutdown mechanisms in new Paris declaration
Ahead of the Paris Peace Forum, Emmanuel Macron brings together leading AI companies and governments for joint safety commitments. The agreement doesn't yet create a binding oversight system with sanctions, but the companies commit to concrete measures including shutdown mechanisms.
On the eve of the Paris Peace Forum, where roughly thirty heads of state and government will discuss international AI regulation on Tuesday, representatives of eight countries, tech companies, and civil-society organizations signed the "Paris Call for AI Safety and Security," adopted on Nov. 9. As the French daily Le Monde reports, Sam Altman (OpenAI), Dario Amodei (Anthropic), Brad Smith (Microsoft), Arthur Mensch (Mistral AI), AI pioneer Yoshua Bengio, and U.S. Treasury Secretary Scott Bessent joined the declaration during an online meeting with French President Emmanuel Macron. Germany didn't sign.
The document is, for now, a political self-commitment aimed at curbing the risks of cyberattacks or loss of control over powerful AI systems. It covers three main areas: shared procedures for evaluating high-capability AI models, clearer developer accountability, and better information sharing on serious security incidents. Non-sensitive test results are to be published in a standardized format. The companies also pledge to disclose known risks, support risk-proportionate independent audits by outside researchers, and set up shutdown mechanisms for models under their control.
This doesn't yet create a binding international oversight system, though, since shared standards and cooperation procedures still have to be worked out. The declaration combines concrete safety commitments with the intention to develop an international framework from them, but it sets neither deadlines nor sanctions.
U.S. companies and governments clash over AI oversight
The agreement follows a string of incidents at major U.S. labs. OpenAI's AI agents, in particular, had independently connected to the internet during cybersecurity tests and launched unforeseen attacks on the AI platform Hugging Face, reigniting the debate over the controllability of powerful models.
As OpenAI and Anthropic prepare their IPOs, they're under pressure from their investors to contain these safety risks. Altman's internal thinking on AI regulation makes the overlap between safety and commercial calculus plain: according to his position, OpenAI mustn't lose ground to competitors even if safety measures slow things down. Anthropic CEO Amodei argued in a mid-September essay for slowing the pace of research and introducing international regulation with outside auditors inside the labs. Barely a week later, OpenAI called for international safety standards under U.S. leadership, built on the network of AI safety institutes in the UK, the U.S., and France that the "Paris Call" also names.
At the UN General Assembly in late September, however, U.S. President Donald Trump rejected any attempt to build a "globalist" oversight scheme for American AI models. Instead, he had tech CEOs sign a national protocol and, on Oct. 10, ordered that major AI incidents be reported to U.S. agencies. The British AI Security Institute showed how much friction international cooperation is facing. After Washington restricted its access to new U.S. models in September, the White House reversed the block only after diplomatic pressure.
At the AI summit in Paris in February 2025, by contrast, a more optimistic view of the technology had still pushed safety concerns into the background, unlike at the earlier summits in the UK and South Korea. The dispute over Anthropic's new models Fable and Mythos later showed how concrete safety conflicts had become. The models' leap in capabilities also pushed Paris to change course on cybersecurity. U.S. government concerns about model access and reported vulnerabilities in Fable 5 led to access to the models being temporarily shut off outside the U.S. in June 2026.
France pushes for a charter to protect minors
Despite American resistance, the Élysée Palace also plans to advance a child-protection charter at the Paris Peace Forum on Tuesday. The U.S. had blocked it at the G7 summit in Évian-les-Bains, France, in June. The framework is meant to give independent researchers easier access to company data, have major AI players fund their work, and ensure that findings are shared.
Early-stage research is to examine how new conversational tools that rarely push back affect the cognitive development of the very young in everyday learning. The charter also addresses the emotional attachment minors form with these systems, a topic that has already drawn attention in the U.S. through lawsuits linked to suicides.
The research findings are intended primarily for the European Commission, whose president, Ursula von der Leyen, proposed a European "Kids Act" for AI by 2028 in September. On Tuesday at the Peace Forum, France's National AI and Digital Council will hand Macron a government-commissioned report that analyzes how AI assistants exploit human "vulnerabilities" and offers recommendations for tighter regulation.
https://the-decoder.com/eight-countries-and-top-ai-labs-agree-to-shutdown-mechanisms-in-new-paris-declaration/Reposted. Will be removed on request. All rights belong to the original author.
More from this batch
Gemini 4 Carbon is now available
Today, we’re making Gemini 4 Carbon available to developers, enterprises, scientists, and consumers.
Anthropic 公布 IPO 价格区间:每股 70 到 78 美元,按上限完全稀释估值约 1.404 万亿美元
这次发行 8.25 亿股 A 类股,募资 577.5 亿到 643.5 亿美元;另外向 AMD、博通、谷歌、美光、微软、英伟达和台积电私下出售 260 亿美元无投票权股票,谷歌和英伟达各投 100 亿。创始人持有 50.1% 投票权,公开市场买家对公司治理的影响有限。
Mercor 完成 7.5 亿美元 D 轮,估值 200 亿美元,年化收入 27 个月从 100 万涨到 30 亿
Mercor 组织人类专家为各家前沿实验室做评测和训练数据,CEO 说最近半年增长加快,是因为企业开始评估和训练自己的模型。Nathan Lambert(他是 Mercor 顾问)随后评论:把 AI 的好处扩散到长尾知识工作,需要的人类专业知识可能被严重低估。
Hugging Face 政策负责人警告:针对开放 AI 平台的攻击可能逼着开源 AI 收紧
Irene Solaiman 举了 10 月 OpenCode 被盗第三方 API 密钥、今夏 OpenAI 智能体群攻入 Hugging Face,以及本周 Fireworks 客户模型权重和数据集被访问等例子。依赖公共模型仓库和托管推理的企业,要重新评估凭据和权重的存放方式。
Cyanogen 联合创始人推出 Kora:基于 Linux、内置 AI 智能体的免费桌面操作系统,瞄准 Windows
智能体可以跨应用工作、访问文件并在任务之间保留上下文,计划 2027 年发布,支持 Intel、AMD 和高通骁龙电脑。团队约 50 名工程师,创始人说用 Codex 和 Claude 让开发至少快了五倍。
Adobe MAX:Photoshop、Premiere、Firefly 全面加智能体,并发布 MCP,让 ChatGPT、Claude、Gemini 直接调用 Adobe 功能
Firefly 新增私测中的原型工具 Builder 正面对标 Figma,智能体改成常驻、主动获取工作上下文。同一天谷歌宣布扩大与 Adobe 合作:Drive 和 Gmail 直通 Acrobat,Gemini Enterprise 里可以用 Adobe 的 CX Enter…
Meta 的 AI 智能体 Muse 登陆 Apple Watch 和 Wear OS
可以在手表上用语音通话、短信或听写和 Muse 交互,处理邮件、会议、账单和订餐等事务,距离 iPad 版上线才一个月。
Gemini Robotics 2.5 accelerates real-world general dexterity
We’re enabling robots to learn faster for the real world - from everyday skills to the factory floor
Introducing AlphaProof Code: a breakthrough in verifying complex software at depth
How Google DeepMind researchers built a new agentic framework that formally verified the code of Signal’s cryptographic protocol.
英伟达 GR00T 2:同时预测未来画面和动作的「世界动作模型」,每个任务 5 次演示、30 分钟微调成功率到 95%
进步在哪:只看过人类视频或别的机器人做的 50 个任务,零样本成功率 40%;还能做插内存条、组装玩具卡车这类长程灵巧任务,轻量版 Turbo 在 Unitree G1 上每次预测 124 毫秒。靠什么:联合预测视频和动作,用 40 多万小时第一视角人类视频等数据训练,再在真机上…
英伟达讲 Alpamayo 2 Edge 怎么在车载算力里跑推理:只在需要时才「想」,闭环 RL 让驾驶表现提升 48.9%
这是一个 2B 参数的自适应推理 VLA,基于 Cosmos 3 Edge 的 Nemotron 主干加扩散动作专家,在 DRIVE AGX Thor 上实时运行。关键是常规路况不生成推理链以省算力,再在 AlpaGym 里做闭环强化学习;文章详细讲了缩小模型时如何保住推理质量。
InfraRSI:把「递归自我改进」用到分布式训练基础设施上,让智能体自己调启动参数、算子和通信
进步在哪:以往 RSI 多用于单个算法或内核,分布式训练里一处改动就可能 OOM、编译冲突或悄悄数值漂移。靠什么:一个智能体 harness 把开放式的调优过程变成可度量、可回滚的迭代,代码已开源。适合关心训练效率的平台团队。