download0 view32
twitter facebook

공공누리This item is licensed Korea Open Government License

Title
DistME: A Fast and Elastic Distributed Matrix Computation Engine using GPUs
Author(s)
한동형김민수남윤민김현우이지혜박경석
Publisher
ACM
Publication Year
2019-06-30
Abstract
Matrix computation, in particular, matrix multiplication is time-consuming, but essentially and widely used in a large number of applications in science and industry. The existing distributed matrix multiplication methods only focus on either low communication cost (i.e., high performance) with the risk of out of memory or large-scale processing with high communication overhead. We propose a distributed elastic matrix multiplication method called CuboidMM that achieves both high performance and large-scale processing. We also propose a GPU acceleration method that can be combined with CuboidMM. CuboidMM partitions matrices into cuboids for optimizing the network communication cost with considering memory usage per task, and the GPU acceleration method partitions a cuboid into subcuboids for optimizing the PCI-E communication cost with considering GPU memory usage. We implement a fast and elastic matrix computation engine called DistME by integrating CuboidMM with GPU acceleration on top of Apache Spark. Through extensive experiments, we have demonstrated that CuboidMM and DistME significantly outperform the state-of-the-art methods and systems, respectively, in terms of both performance and data size.
Keyword
Matrix multiplication; Distributed data-parallel system; GPU computation
Journal Title
Proceedings of the ACM SIGMOD International Conference on Management of Data;
ISSN
0730-8078
DOI
10.1145/3299869.3319865
Files in This Item:
There are no files associated with this item.
Appears in Collections:
7. KISTI 연구성과 > 학술지 발표논문
URI
https://repository.kisti.re.kr/handle/10580/16745
Export
RIS (EndNote)
XLS (Excel)
XML

Browse