BAN

Detecting Backdoors Activated by Adversarial Neuron Noise

Conference Paper (2024)
Author(s)

Xiaoyun Xu (Radboud Universiteit Nijmegen)

Zhuoran Liu (Radboud Universiteit Nijmegen)

Stefanos Koffas (TU Delft - Electrical Engineering, Mathematics and Computer Science)

Shujian Yu (Vrije Universiteit Amsterdam)

Stjepan Picek (TU Delft - Electrical Engineering, Mathematics and Computer Science, Radboud Universiteit Nijmegen)

Research Group
Cyber Security
DOI related publication
https://doi.org/10.52202/079017-3632 Final published version
More Info
expand_more
Publication Year
2024
Language
English
Research Group
Cyber Security
Volume number
37
Pages (from-to)
14348-114373
Event
38th Conference on Neural Information Processing Systems, NeurIPS 2024 (2024-12-09 - 2024-12-15), Vancouver, Canada
Downloads counter
40
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

Backdoor attacks on deep learning represent a recent threat that has gained significant attention in the research community. Backdoor defenses are mainly based on backdoor inversion, which has been shown to be generic, model-agnostic, and applicable to practical threat scenarios. State-of-the-art backdoor inversion recovers a mask in the feature space to locate prominent backdoor features, where benign and backdoor features can be disentangled. However, it suffers from high computational overhead, and we also find that it overly relies on prominent backdoor features that are highly distinguishable from benign features. To tackle these shortcomings, this paper improves backdoor feature inversion for backdoor detection by incorporating extra neuron activation information. In particular, we adversarially increase the loss of backdoored models with respect to weights to activate the backdoor effect, based on which we can easily differentiate backdoored and clean models. Experimental results demonstrate our defense, BAN, is 1.37× (on CIFAR-10) and 5.11× (on ImageNet200) more efficient with an average 9.99% higher detect success rate than the state-of-the-art defense BTI-DBF. Our code and trained models are publicly available at https://github.com/xiaoyunxxy/ban.