DeepfakeImpact：一个具有现实世界影响力的两阶段深度伪造检测基准
DeepfakeImpact: A Two-Stage Benchmark with Real-World Impact in Deepfake Detection
提出社会误判影响（SMI）指标，将误分类视频的社会危害纳入评估，为视觉检测模型提供超越准确率的伦理感知评测框架，可复用于其他安全敏感检测任务。
原文依据 we propose a novel metric (Social Misjudgment Impact, SMI) that quantifies the potential social harm of misclassified videos
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论当前深度伪造检测基准的一个根本但被忽视的局限是缺乏将技术准确性与现实世界影响对齐的评估框架。我们认为，技术指标可能无法捕捉模型减轻现实危害的实际能力，因为它们将所有错误视为同等重要。为弥合这一差距，我们引入了 DeepfakeImpact，一个两阶段基准，超越纯技术评估，迈向具有社会意识的评估。在第一阶段，我们通过在 12 个广泛使用的数据集上评估 33 个最先进的检测基线，建立了标准化的技术基线。在第二阶段，我们提出了一种新的指标（社会误判影响，SMI），量化误分类视频的潜在社会危害，并构建了一个包含高风险样本的 SMI 关键数据集。通过整合 SMI 感知的性能指标，我们将评估重点从检测器“有多准确”转向“有多社会有益”。因此，DeepfakeImpact 为评估深度伪造检测器提供了更现实和伦理的基础，敦促社区重新思考该领域真正构成进步的是什么。所有资源将在 https://anonymous.4open.science/r/DeepfakeImpact-Stage1-F5EC 公开。
英文原文摘要 1251 字符
A fundamental yet overlooked limitation of current deepfake detection benchmark is the lack of evaluation frameworks that align technical accuracy with real-world impact. We argue that technical metrics may fail to capture models' actual capacity to mitigate real-world harm, as they treat all errors as equally significant. To bridge this gap, we introduce DeepfakeImpact, a two-stage benchmark that moves beyond pure technical evaluation toward societally-aware assessment. In Stage I, we establish standardized technical baselines by evaluating 33 SOTA detection baslines across 12 widely used datasets. In Stage II, we propose a novel metric (Social Misjudgment Impact, SMI) that quantifies the potential social harm of misclassified videos, and construct a SMI-critical dataset containing high-risk samples. By integrating SMI-aware performance metrics, we shift the evaluation focus from "how accurate" to "how socially beneficial" a detector is. DeepfakeImpact thus provides a more realistic and ethically-grounded foundation for assessing deepfake detectors, urging the community to rethink what truly constitutes progress in this field. All resources will be publicly released at: https://anonymous.4open.science/r/DeepfakeImpact-Stage1-F5EC.