CISPA
Browse
cispa_all_2795.pdf (4.73 MB)

Sequential Attacks on Agents for Long-Term Adversarial Goals

Download (4.73 MB)
conference contribution
posted on 2023-11-29, 18:09 authored by Edgar Tretschk, Seong Joon Oh, Mario FritzMario Fritz
Reinforcement learning (RL) has advanced greatly in the past few years with the employment of effective deep neural networks (DNNs) on the policy networks. With the great effectiveness came serious vulnerability issues with DNNs that small adversarial perturbations on the input can change the output of the network. Several works have pointed out that learned agents with a DNN policy network can be manipulated against achieving the original task through a sequence of small perturbations on the input states. In this paper, we demonstrate furthermore that it is also possible to impose an arbitrary adversarial reward on the victim policy network through a sequence of attacks. Our method involves the latest adversarial attack technique, Adversarial Transformer Network (ATN), that learns to generate the attack and is easy to integrate into the policy network. As a result of our attack, the victim agent is misguided to optimise for the adversarial reward over time. Our results expose serious security threats for RL applications in safety-critical systems including drones, medical analysis, and self-driving cars.

History

Preferred Citation

Edgar Tretschk, Seong Oh and Mario Fritz. Sequential Attacks on Agents for Long-Term Adversarial Goals. In: ACM Computer Science in Cars Symposium (CSCS). 2018.

Primary Research Area

  • Trustworthy Information Processing

Name of Conference

ACM Computer Science in Cars Symposium (CSCS)

Legacy Posted Date

2019-02-01

Open Access Type

  • Gold

BibTeX

@inproceedings{cispa_all_2795, title = "Sequential Attacks on Agents for Long-Term Adversarial Goals", author = "Tretschk, Edgar and Oh, Seong Joon and Fritz, Mario", booktitle="{ACM Computer Science in Cars Symposium (CSCS)}", year="2018", }

Usage metrics

    Categories

    No categories selected

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC