CISPA
Browse

FACE-AUDITOR: Data Auditing in Facial Recognition Systems.

Download (3.46 MB)
conference contribution
posted on 2024-03-19, 13:35 authored by Min Chen, Zhikun Zhang, Tianhao Wang, Michael BackesMichael Backes, Yang ZhangYang Zhang
Few-shot-based facial recognition systems have gained increasing attention due to their scalability and ability to work with a few face images during the model deployment phase. However, the power of facial recognition systems enables anyone with moderate resources to canvas the Internet and build well-performed facial recognition models without people's awareness and consent. To prevent the face images from being misused, one straightforward approach is to modify the raw face images before sharing them, which inevitably destroys the semantic information and is still prone to adaptive attacks. Therefore, an auditing method that does not interfere with the facial recognition model's utility and cannot be quickly bypassed is urgently needed. In this paper, we formulate the auditing process as a user-level membership inference problem, and propose a complete toolkit FACE-AUDITOR that can carefully choose the probing set to query the few-shot-based facial recognition model and determine whether any of a user's face images is used in training the model. We further propose to use the similarity scores between the original face images as reference information to improve the auditing performance. Extensive experiments on multiple real-world face image datasets show that FACE-AUDITOR can achieve auditing accuracy of up to 99%. Finally, we show that FACE-AUDITOR is robust in the presence of several perturbation mechanisms to the training images or the target models. The source code of our experiments can be found at https://anonymous.4open.science/r/FACE-AUDITOR.

History

Primary Research Area

  • Trustworthy Information Processing

Name of Conference

Usenix Security Symposium (USENIX-Security)

Journal

USENIX Security Symposium

Page Range

7195-7212

BibTeX

@conference{Chen:Zhang:Wang:Backes:Zhang:2023, title = "FACE-AUDITOR: Data Auditing in Facial Recognition Systems.", author = "Chen, Min" AND "Zhang, Zhikun" AND "Wang, Tianhao" AND "Backes, Michael" AND "Zhang, Yang", year = 2023, month = 8, journal = "USENIX Security Symposium", pages = "7195--7212" }

Usage metrics

    Categories

    No categories selected

    Licence

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC