download0 view737
twitter facebook

공공누리This item is licensed Korea Open Government License

Title
Developing an Intrusion Detection Framework for High-Speed Big Data Networks: A Comprehensive Approach
Author(s)
Kamran SiddiqueYangwoo KimMuhammad Ashfaq KhanZahid Akhtar정용환
Publication Year
2018-08-31
Abstract
In network intrusion detection research, two characteristics are generally considered vital to building efficient intrusion detection systems (IDSs): an optimal feature selection technique and robust classification schemes. However, the emergence of sophisticated network attacks and the advent of big data concepts in intrusion detection domains require two more significant aspects to be addressed: employing an appropriate big data computing framework and utilizing a contemporary dataset to deal with ongoing advancements. As such, we present a comprehensive approach to building an efficient IDS with the aim of strengthening academic anomaly detection research in real-world operational environments. The proposed system has the following four characteristics: (i) it performs optimal feature selection using information gain and branch-and-bound algorithms; (ii) it employs machine learning techniques for classification, namely, Logistic Regression, Naïve Bayes, and Random Forest; (iii) it introduces bulk synchronous parallel processing to handle the computational requirements of large-scale networks; and (iv) it utilizes a real-time contemporary dataset generated by the Information Security Centre of Excellence at the University of Brunswick (ISCX-UNB) to validate its efficacy. Experimental analysis shows the effectiveness of the proposed framework, which is able to achieve high accuracy, low computational cost, and reduced false alarms.
Keyword
Network intrusion detection systems; Anomaly detection; bulk synchronous parallel; BSP; Big Data; machine learning; Darpa; KDD Cup 99; ISCX-UNB dataset
Journal Title
KSII Transactions on Internet and Information Systems
Citation Volume
12
ISSN
1976-7277
Files in This Item:
There are no files associated with this item.
Appears in Collections:
7. KISTI 연구성과 > 학술지 발표논문
URI
https://repository.kisti.re.kr/handle/10580/14772
Export
RIS (EndNote)
XLS (Excel)
XML

Browse