CISPA
Browse
sec23summer_136-li_zheng-prepub.pdf (17.93 MB)

UnGANable: Defending Against GAN-based Face Manipulation

Download (17.93 MB)
preprint
posted on 2024-03-19, 13:09 authored by Zheng LiZheng Li, Ning Yu, Ahmed Salem, Michael BackesMichael Backes, Mario FritzMario Fritz, Yang ZhangYang Zhang
Deepfakes pose severe threats of visual misinformation to our society. One representative deepfake application is face manipulation that modifies a victim's facial attributes in an image, e.g., changing her age or hair color. The state-of-the-art face manipulation techniques rely on Generative Adversarial Networks (GANs). In this paper, we propose the first defense system, namely UnGANable, against GAN-inversion-based face manipulation. In specific, UnGANable focuses on defending GAN inversion, an essential step for face manipulation. Its core technique is to search for alternative images (called cloaked images) around the original images (called target images) in image space. When posted online, these cloaked images can jeopardize the GAN inversion process. We consider two state-of-the-art inversion techniques including optimization-based inversion and hybrid inversion, and design five different defenses under five scenarios depending on the defender's background knowledge. Extensive experiments on four popular GAN models trained on two benchmark face datasets show that UnGANable achieves remarkable effectiveness and utility performance, and outperforms multiple baseline methods. We further investigate four adaptive adversaries to bypass UnGANable and show that some of them are slightly effective.

History

Primary Research Area

  • Trustworthy Information Processing

Open Access Type

  • Green

BibTeX

@misc{Li:Yu:Salem:Backes:Fritz:Zhang:2022, title = "UnGANable: Defending Against GAN-based Face Manipulation", author = "Li, Zheng" AND "Yu, Ning" AND "Salem, Ahmed" AND "Backes, Michael" AND "Fritz, Mario" AND "Zhang, Yang", year = 2022, month = 10, doi = "10.48550/arxiv.2210.00957" }

Usage metrics

    Categories

    No categories selected

    Licence

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC