欧洲非营利组织 AI Forensics 发布报告指出,开源人工智慧平台 Hugging Face 存在严重的非自愿性深伪问题。研究人员测试了该平台上九个热门图片编辑空间,其中七个能轻易将穿著衣物的女性图片转换为裸露图片,仅需使用简单的六个字提示词即可完成,无需绕过任何安全机制。
研究人员进一步在 Hugging Face 上建立了蜜罐式图片编辑空间,一周内收集超过一千条提示词与图片。结果显示,73% 的提示词具有色情性质,其中 83% 意图脱衣或性化照片中的对象,95% 的目标为女性,更有 6.7% 的色情请求针对疑似未成年人。这些数据表明,使用者确实正在利用该平台生成非自愿的亲密影像。
面对指控,Hugging Face 表示研究方法可能导致误判,并称所搜集的提示词不具平台代表性,且因技术限制无法对所有空间进行提示词过滤或输出扫描。然而研究人员反驳称,平台在明知缺乏审核能力的情况下部署这些空间,不应免除其对可预见后果的责任。与此同时,美国、欧盟和英国正加强打击有害性深伪内容,包括查封相关网站并计划禁止「裸化」应用程式。
A report by European nonprofit AI Forensics reveals that Hugging Face, a major open-source AI platform, has a pervasive problem with nonconsensual sexual deepfakes. Researchers tested nine popular image editing Spaces on the platform and found that seven could easily transform a clothed image of a woman into a topless one using a simple six-word prompt, with no safety guardrails in place at the platform level.
The researchers also deployed honeypot-style Spaces on Hugging Face and collected over 1,000 prompts in one week. Seventy-three percent of prompts were sexual in nature, with 83 percent seeking to undress or sexualize the submitted person—95 percent of whom were women. Alarmingly, 6.7 percent of sexual requests targeted apparent children. The prompts revealed abuse extending beyond simple digital undressing, including requests depicting sexual acts and the removal of hijabs from Muslim women.
Hugging Face questioned the research methodology, claimed the prompts were not representative of typical platform usage, and stated that platform-wide prompt filtering is technically infeasible. Researchers countered that the company should not be exempt from responsibility for deploying Spaces it cannot moderate. Meanwhile, US law enforcement has seized deepfake hosting sites, and the EU and UK are advancing plans to ban nudifying apps, signaling a broader regulatory crackdown on harmful sexual deepfake technologies.