TY - JOUR
T1 - The Threat of Offensive AI to Organizations
AU - Mirsky, Yisroel
AU - Demontis, Ambra
AU - Kotak, Jaidip
AU - Shankar, Ram
AU - Gelei, Deng
AU - Yang, Liu
AU - Zhang, Xiangyu
AU - Pintor, Maura
AU - Lee, Wenke
AU - Elovici, Yuval
AU - Biggio, Battista
N1 - Publisher Copyright: © 2022
PY - 2023/1/1
Y1 - 2023/1/1
N2 - AI has provided us with the ability to automate tasks, extract information from vast amounts of data, and synthesize media that is nearly indistinguishable from the real thing. However, positive tools can also be used for negative purposes. In particular, cyber adversaries can use AI to enhance their attacks and expand their campaigns. Although offensive AI has been discussed in the past, there is a need to analyze and understand the threat in the context of organizations. For example, how does an AI-capable adversary impact the cyber kill chain? Does AI benefit the attacker more than the defender? What are the most significant AI threats facing organizations today and what will be their impact on the future? In this study, we explore the threat of offensive AI on organizations. First, we present the background and discuss how AI changes the adversary's methods, strategies, goals, and overall attack model. Then, through a literature review, we identify 32 offensive AI capabilities which adversaries can use to enhance their attacks. Finally, through a panel survey spanning industry, government and academia, we rank the AI threats and provide insights on the adversaries.
AB - AI has provided us with the ability to automate tasks, extract information from vast amounts of data, and synthesize media that is nearly indistinguishable from the real thing. However, positive tools can also be used for negative purposes. In particular, cyber adversaries can use AI to enhance their attacks and expand their campaigns. Although offensive AI has been discussed in the past, there is a need to analyze and understand the threat in the context of organizations. For example, how does an AI-capable adversary impact the cyber kill chain? Does AI benefit the attacker more than the defender? What are the most significant AI threats facing organizations today and what will be their impact on the future? In this study, we explore the threat of offensive AI on organizations. First, we present the background and discuss how AI changes the adversary's methods, strategies, goals, and overall attack model. Then, through a literature review, we identify 32 offensive AI capabilities which adversaries can use to enhance their attacks. Finally, through a panel survey spanning industry, government and academia, we rank the AI threats and provide insights on the adversaries.
KW - AI-Capable adversary
KW - APT
KW - Adversarial machine learning
KW - Cyber security
KW - Deepfake
KW - Offensive AI
KW - Organization security
UR - http://www.scopus.com/inward/record.url?scp=85141923216&partnerID=8YFLogxK
U2 - 10.1016/j.cose.2022.103006
DO - 10.1016/j.cose.2022.103006
M3 - Article
SN - 0167-4048
VL - 124
JO - Computers and Security
JF - Computers and Security
M1 - 103006
ER -