CISPA
Browse

Improved Estimation of Concentration Under Lp-Norm Distance Metric Using Half Spaces

Download (742.76 kB)
conference contribution
posted on 2024-10-14, 13:58 authored by Xiao ZhangXiao Zhang, Jack Prescott, David Evans
Concentration of measure has been argued to be the fundamental cause of adversarial vulnerability. Mahloujifar et al. (2019) presented an empirical way to measure the concentration of a data distribution using samples, and employed it to find lower bounds on intrinsic robustness for several benchmark datasets. However, it remains unclear whether these lower bounds are tight enough to provide a useful approximation for the intrinsic robustness of a dataset. To gain a deeper understanding of the concentration of measure phenomenon, we first extend the Gaussian Isoperimetric Inequality to non-spherical Gaussian measures and arbitrary Lp-norms (p>=2). We leverage these theoretical insights to design a method that uses half-spaces to estimate the concentration of any empirical dataset under Lp-norm distance metrics. Our proposed algorithm is more efficient than Mahloujifar et al. (2019)’s, and experiments on synthetic datasets and image benchmarks demonstrate that it is able to find much tighter intrinsic robustness bounds. These tighter estimates provide further evidence that rules out intrinsic dataset concentration as a possible explanation for the adversarial vulnerability of state-of-the-art classifiers.

History

Primary Research Area

  • Trustworthy Information Processing

Name of Conference

International Conference on Learning Representations (ICLR)

CISPA Affiliation

  • No

BibTeX

@conference{Zhang:Prescott:Evans:2021, title = "Improved Estimation of Concentration Under Lp-Norm Distance Metric Using Half Spaces", author = "Zhang, Xiao" AND "Prescott, Jack" AND "Evans, David", year = 2021, month = 1 }

Usage metrics

    Categories

    No categories selected

    Licence

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC