CISPA
Browse
cispa_all_3432.pdf (4.51 MB)

Beyond the Spectrum: Detecting Deepfakes via Re-Synthesis

Download (4.51 MB)
conference contribution
posted on 2023-11-29, 18:16 authored by Yang He, Ning Yu, Margret Keuper, Mario FritzMario Fritz
The rapid advances in deep generative models over the past years have led to highly realistic media, known as deepfakes, that are commonly indistinguishable from real to human eyes. These advances make assessing the authenticity of visual data increasingly difficult and pose a misinformation threat to the trustworthiness of visual content in general. Although recent work has shown strong detection accuracy of such deepfakes, the success largely relies on identifying frequency artifacts in the generated images, which will not yield a sustainable detection approach as generative models continue evolving and closing the gap to real images. In order to overcome this issue, we propose a novel fake detection that is designed to re-synthesize testing images and extract visual cues for detection. The re-synthesis procedure is flexible, allowing us to incorporate a series of visual tasks - we adopt super-resolution, denoising and colorization as the re-synthesis. We demonstrate the improved effectiveness, cross-GAN generalization, and robustness against perturbations of our approach in a variety of detection scenarios involving multiple generators over CelebA-HQ, FFHQ, and LSUN datasets. Source code is available at https://github.com/SSAW14/BeyondtheSpectrum.

History

Preferred Citation

Yang He, Ning Yu, Margret Keuper and Mario Fritz. Beyond the Spectrum: Detecting Deepfakes via Re-Synthesis. In: International Joint Conference on Artificial Intelligence (IJCAI). 2021.

Primary Research Area

  • Trustworthy Information Processing

Name of Conference

International Joint Conference on Artificial Intelligence (IJCAI)

Legacy Posted Date

2021-06-09

Open Access Type

  • Gold

BibTeX

@inproceedings{cispa_all_3432, title = "Beyond the Spectrum: Detecting Deepfakes via Re-Synthesis", author = "He, Yang and Yu, Ning and Keuper, Margret and Fritz, Mario", booktitle="{International Joint Conference on Artificial Intelligence (IJCAI)}", year="2021", }

Usage metrics

    Categories

    No categories selected

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC