download0 view200
twitter facebook

공공누리This item is licensed Korea Open Government License

Title
CASS: A distributed network clustering algorithm based on structure similarity for large-scale network
Author(s)
김정림박상현서동민유석종
Publication Year
2018-10-10
Abstract
As the size of networks increases, it is becoming important to analyze large-scale network
data. A network clustering algorithm is useful for analysis of network data. Conventional network
clustering algorithms in a single machine environment rather than a parallel machine
environment are actively being researched. However, these algorithms cannot analyze
large-scale network data because of memory size issues. As a solution, we propose a network
clustering algorithm for large-scale network data analysis using Apache Spark by
changing the paradigm of the conventional clustering algorithm to improve its efficiency in
the Apache Spark environment. We also apply optimization approaches such as Bloom filter
and shuffle selection to reduce memory usage and execution time. By evaluating our proposed
algorithm based on an average normalized cut, we confirmed that the algorithm can
analyze diverse large-scale network datasets such as biological, co-authorship, internet
topology and social networks. Experimental results show that the proposed algorithm can
develop more accurate clusters than comparative algorithms with less memory usage. Furthermore,
we confirm the proposed optimization approaches and the scalability of the proposed
algorithm. In addition, we validate that clusters found from the proposed algorithm
can represent biologically meaningful functions.
Keyword
network alaysks; algorithm; clustering
Journal Title
PLOS one
Citation Volume
13
ISSN
1932-6203
Files in This Item:
There are no files associated with this item.
Appears in Collections:
7. KISTI 연구성과 > 학술지 발표논문
URI
https://repository.kisti.re.kr/handle/10580/14747
http://www.ndsl.kr/ndsl/search/detail/article/articleSearchResultDetail.do?cn=NART90641578
Export
RIS (EndNote)
XLS (Excel)
XML

Browse