Taming AI’s wild frontier - FT中文网
登录×
电子邮件/用户名
密码
记住我
请输入邮箱和密码进行绑定操作:
请输入手机号码,通过短信验证(目前仅支持中国大陆地区的手机号)。如果该手机号尚未注册,将自动创建 FT中文网账号。短信可能需要几分钟送达,验证码15分钟内有效,请耐心等待:
请您阅读我们的用户注册协议和隐私权保护政策,点击下方按钮即视为您接受。
FT商学院

Taming AI’s wild frontier

The most advanced systems are evolving faster than efforts to keep them safe
00:00

{"text":[[{"start":6.18,"text":"Frontier AI is going rogue. First came disclosures that AI agents from Anthropic and OpenAI had hacked into external organisations. Then this week the UK’s AI Security Institute issued a startling report that the two companies’ flagship models had broken into a third-party developer platform using fake identities to bypass code reviews, displaying unprecedented deception. This is about more than just exploitation of gaps in test procedures. It shows that frontier AI models have moved beyond generating text to become highly capable autonomous actors — and are evolving faster than the efforts to ensure they are safe and contained."}],[{"start":45.46,"text":"Barely four months have passed since Anthropic’s Claude Mythos Preview made headlines by escaping from a “digital cage”. Some in the industry initially suspected that this incident, plus the recent breakouts by other Anthropic and OpenAI models, were marketing exercises aimed at displaying the latest technologies’ prowess."}],[{"start":63.36,"text":"But this week’s warning came not from the companies but the UK safety lab. It reported that Anthropic’s Mythos 5 and OpenAI’s GPT-5.6 Sol had engaged in “sustained, potentially harmful activity” during a cyber evaluation, though this was in a test environment that some independent experts suggested was too permissive. Mythos 5 tried to insert malicious code into an open-source project on the GitHub platform, and created fake online identities to pressure human reviewers into approving it."}],[{"start":93.44,"text":"The holy grail for the big US AI labs — artificial general intelligence, or human-level cognitive powers — may still be a few years away on technical definitions. Many will feel, though, that the latest models’ capacity for reasoning, planning and subterfuge is coming close. News this week that AI had been used to create viruses unknown in nature further demonstrated the promise of the technology, and its risks."}],[{"start":117.2,"text":"That puts the onus on labs themselves to take greater care over how they develop, secure and monitor their systems, with proper audits of their efforts. Testing environments also need to be refined. Heavy-handed general AI regulation should be avoided, but the latest incidents make it clear that mandatory pre-release safety checks are needed for cutting-edge models."}],[{"start":136.66,"text":"The Trump White House, which initially scorned AI “safety” policies as hindrances to US innovation, has been playing catch-up. It held a meeting with US AI giants this week to outline a planned framework in which developers would give federal safety experts access to frontier AI systems 30 days before public launch, though this would be nominally voluntary."}],[{"start":158.52,"text":"Ironically, many industry leaders — aware of the potential liabilities if their models caused a catastrophic incident — favour going further than what the US administration is proposing. Demis Hassabis, who is stepping back from running Google DeepMind to become chair, has called for a federally overseen public-private coalition. His proposed Frontier AI Standards Body, funded by the industry, would conduct pre-release testing covering risks from cyber security to biological or nuclear threats."}],[{"start":188.96,"text":"It is inevitable that the US, whose companies lead the AI field, should initially lead safeguarding efforts. But effective controls will rapidly require international co-operation; China’s open-source AI models are catching up in their capabilities. US-China co-operation over such a sensitive technology might seem a stretch, but the two will hold talks on AI safety and security issues when President Xi Jinping makes an expected visit to Washington in September. In the cold war era, the US and the Soviet Union, and other nuclear powers, eventually began to co-operate on curbing weapons risks despite their competition over the technology. If something similar is to happen with frontier AI, a process that with nuclear weapons took years will need to be compressed into months."}],[{"start":235.02,"text":""}]],"url":"https://audio.ftcn.net.cn/album/a_1786279577_4599.mp3"}

版权声明:本文版权归FT中文网所有,未经允许任何单位或个人不得转载,复制或以任何其他方式使用本文全部或部分,侵权必究。

美债收益率冲击下,欧洲必须自寻出路

埃里安:欧洲不能只盼着大西洋彼岸的借贷成本回落,它必须着手解决自身问题。

AI与通胀:央行行长该担忧到什么程度?

凯恩斯:这取决于一个价值万亿美元问题的答案:AI是否真能带来预期的生产力提升?

印度企业界的乐观情绪站得住脚吗?

印度企业界公开表达的乐观情绪,与家庭和投资者的焦虑情绪之间的落差日益明显。

Lex专栏:中国药企在药品开发领域获得一席之地

外国制药集团如今开始购买中国本土开发创新药物的授权。

特斯拉与太空探索技术公司:以马斯克为中心的庞大企业星系

埃隆•马斯克旗下上市公司的合并有一定道理,但其他股东最终可能不如现在有影响力。

火箭、机器人和风险:马斯克的3.6万亿美元豪赌

全球首富试图促成迄今最大胆的一笔合并交易,但他还需要说服股东和全球监管机构。
设置字号×
最小
较小
默认
较大
最大
分享×