CISPA
Browse
CCS23-DEFAKE.pdf (8.39 MB)

DE-FAKE: Detection and Attribution of Fake Images Generated by Text-to-Image Generation Models

Download (8.39 MB)
conference contribution
posted on 2024-03-19, 13:18 authored by Zeyang ShaZeyang Sha, Zheng LiZheng Li, Ning Yu, Yang ZhangYang Zhang
Text-to-image generation models that generate images based on prompt descriptions have attracted an increasing amount of attention during the past few months. Despite their encouraging performance, these models raise concerns about the misuse of their generated fake images. To tackle this problem, we pioneer a systematic study on the detection and attribution of fake images generated by text-to-image generation models. Concretely, we first build a machine learning classifier to detect the fake images generated by various text-to-image generation models. We then attribute these fake images to their source models, such that model owners can be held responsible for their models' misuse. We further investigate how prompts that generate fake images affect detection and attribution. We conduct extensive experiments on four popular text-to-image generation models, including DALL·E 2, Stable Diffusion, GLIDE, and Latent Diffusion, and two benchmark prompt-image datasets. Empirical results show that (1) fake images generated by various models can be distinguished from real ones, as there exists a common artifact shared by fake images from different models; (2) fake images can be effectively attributed to their source models, as different models leave unique fingerprints in their generated images; (3) prompts with the "person'' topic or a length between 25 and 75 enable models to generate fake images with higher authenticity. All findings contribute to the community's insight into the threats caused by text-to-image generation models. We appeal to the community's consideration of the counterpart solutions, like ours, against the rapidly-evolving fake image generation.

History

Editor

Meng W ; Jensen CD ; Cremers C ; Kirda E

Primary Research Area

  • Trustworthy Information Processing

Name of Conference

ACM Conference on Computer and Communications Security (CCS)

Journal

CCS

Page Range

3418-3432

Publisher

Association for Computing Machinery (ACM)

Open Access Type

  • Green

BibTeX

@conference{Sha:Li:Yu:Zhang:2023, title = "DE-FAKE: Detection and Attribution of Fake Images Generated by Text-to-Image Generation Models", author = "Sha, Zeyang" AND "Li, Zheng" AND "Yu, Ning" AND "Zhang, Yang", editor = "Meng, Weizhi" AND "Jensen, Christian Damsgaard" AND "Cremers, Cas" AND "Kirda, Engin", year = 2023, month = 11, journal = "CCS", pages = "3418--3432", publisher = "Association for Computing Machinery (ACM)", doi = "10.1145/3576915.3616588" }

Usage metrics

    Categories

    No categories selected

    Licence

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC