CISPA
Browse
58_learning_to_walk_impartially_o.pdf (2.9 MB)

Learning to Walk Impartially on the Pareto Frontier of Fairness, Privacy, and Utility

Download (2.9 MB)
conference contribution
posted on 2024-02-26, 11:06 authored by Mohammad Yaghini, Patty Liu, Franziska BoenischFranziska Boenisch, Nicolas Papernot
Deploying machine learning (ML) models often requires both fairness and privacy guarantees. Both objectives often present notable trade-offs with the accuracy of the model—the primary focus of most applications. Thus, utility is prioritized while privacy and fairness constraints are treated as simple hyperparameters. In this work, we argue that by prioritizing one objective over others, we disregard more favorable solutions where at least certain objectives could have been improved without degrading any other. We adopt impartiality as a design principle: ML pipelines should not favor one objective over another. We theoretically show that a common ML pipeline design that features an unfairness mitigation step followed by private training is non-impartial. Then, parting from the two most common privacy frameworks for ML, we propose FairDP-SGD and FairPATE to train impartially specified private and fair models. Because impartially specified models recover the Pareto frontiers, i.e., the best trade-offs between different objectives, we show that they yield significantly better trade-offs than models optimized for one objective and hyperparameter-tuned for the others. Thus, our approach allows us to mitigate tensions between objectives previously found incompatible.

History

Primary Research Area

  • Trustworthy Information Processing

Name of Conference

Conference on Neural Information Processing Systems (NeurIPS)

Journal

NeurIPS 2023 Workshop on Regulatable ML

BibTeX

@conference{Yaghini:Liu:Boenisch:Papernot:2023, title = "Learning to Walk Impartially on the Pareto Frontier of Fairness, Privacy, and Utility", author = "Yaghini, Mohammad" AND "Liu, Patty" AND "Boenisch, Franziska" AND "Papernot, Nicolas", year = 2023, month = 10, journal = "NeurIPS 2023 Workshop on Regulatable ML" }

Usage metrics

    Categories

    No categories selected

    Licence

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC