Views

Harnessing dynamic heterogeneous redundancy to empower deep learning safety and security

¹ National Digital Switching System And Engineering Technological Research Center (NDSC), Zhengzhou, 450002, China
² PLA Information Engineering University, Zhengzhou, 450002, China
³ Purple Mountain Laboratories, Nanjing, 211111, China
⁴ Fudan University, Shanghai, 200433, China
⁵ Southeast University, Nanjing, 210096, China
⁶ Zhengzhou University, Zhengzhou, 450001, China

^* Corresponding authors (email: huangwei@pmlabs.com.cn)

Received: 7 June 2024
Revised: 9 September 2024
Accepted: 9 September 2024

Abstract

The rapid development of deep learning (DL) models has been accompanied by various safety and security challenges, such as adversarial attacks and backdoor attacks. By analyzing the current literature on attacks and defenses in DL, we find that the ongoing adaptation between attack and defense makes it impossible to completely resolve these issues. In this paper, we propose that this situation is caused by the inherent flaws of DL models, namely non-interpretability, non-recognizability, and non-identifiability. We refer to these issues as the Endogenous Safety and Security (ESS) problems. To mitigate the ESS problems in DL, we propose using the Dynamic Heterogeneous Redundant (DHR) architecture. We believe that introducing diversity is crucial for resolving the ESS problems. To validate the effectiveness of this approach, we conduct various case studies across multiple application domains of DL. Our experimental results confirm that constructing DL systems based on the DHR architecture is more effective than existing DL defense strategies.