Real-Time DDoS Attack Detection System Using Big Data Approach



Awan, Mazhar Javed, Farooq, Umar, Babar, Hafiz Muhammad Aqeel, Yasin, Awais, Nobanee, Haitham ORCID: 0000-0003-4424-5600, Hussain, Muzammil, Hakeem, Owais and Zain, Azlan Mohd
(2021) Real-Time DDoS Attack Detection System Using Big Data Approach. SUSTAINABILITY, 13 (19). p. 10743.

Access the full-text of this item by clicking on the Open Access link.

Abstract

<jats:p>Currently, the Distributed Denial of Service (DDoS) attack has become rampant, and shows up in various shapes and patterns, therefore it is not easy to detect and solve with previous solutions. Classification algorithms have been used in many studies and have aimed to detect and solve the DDoS attack. DDoS attacks are performed easily by using the weaknesses of networks and by generating requests for services for software. Real-time detection of DDoS attacks is difficult to detect and mitigate, but this solution holds significant value as these attacks can cause big issues. This paper addresses the prediction of application layer DDoS attacks in real-time with different machine learning models. We applied the two machine learning approaches Random Forest (RF) and Multi-Layer Perceptron (MLP) through the Scikit ML library and big data framework Spark ML library for the detection of Denial of Service (DoS) attacks. In addition to the detection of DoS attacks, we optimized the performance of the models by minimizing the prediction time as compared with other existing approaches using big data framework (Spark ML). We achieved a mean accuracy of 99.5% of the models both with and without big data approaches. However, in training and testing time, the big data approach outperforms the non-big data approach due to that the Spark computations in memory are in a distributed manner. The minimum average training and testing time in minutes was 14.08 and 0.04, respectively. Using a big data tool (Apache Spark), the maximum intermediate training and testing time in minutes was 34.11 and 0.46, respectively, using a non-big data approach. We also achieved these results using the big data approach. We can detect an attack in real-time in few milliseconds.</jats:p>

Item Type: Article
Uncontrolled Keywords: DoS attack, Apache Spark, big data, privacy, sustainability, machine learning, real-time, DDoS detection
Divisions: Faculty of Humanities and Social Sciences > School of Histories, Languages and Cultures
Depositing User: Symplectic Admin
Date Deposited: 21 Jan 2022 17:06
Last Modified: 15 Mar 2024 18:12
DOI: 10.3390/su131910743
Open Access URL: https://www.mdpi.com/2071-1050/13/19/10743
Related URLs:
URI: https://livrepository.liverpool.ac.uk/id/eprint/3147369