download0 view148
twitter facebook

공공누리This item is licensed Korea Open Government License

Title
EMP: execution time measurement protocol for compute-bound programs
Author(s)
서영균Cheng YiJohn KececiogluPeter DowneyRichard T. SnodgrassRobert Maier
Publication Year
2017-04-30
Abstract
Measuring execution time is one of the most used performance evaluation techniques in computer science research. Inaccurate measurements cannot be used for a fair performance comparison between programs. Despite the prevalence of its use, the intrinsic variability in the time measurement makes it hard to obtain repeatable and accurate timing results of a program running on an operating system. We propose a novel execution time measurement protocol (termed EMP) for measuring the execution time of a compute-bound program on Linux, while minimizing that measurement’s variability. During the development of execution time measurement protocol, we identified several factors that disturb execution time measurement. We introduce successive refinements to the protocol by addressing each of these factors, in concert, reducing variability by more than an order of magnitude. We also introduce a new visualization technique, what we term 'dual-execution scatter plot' that highlights infrequent, long-running daemons, differentiating them from frequent and/or short-running daemons. Our empirical results show that the proposed protocol successfully achieves three major aspects—precision, accuracy, and scalability—in execution time measurement that can work for open-source and proprietary software. 
Keyword
execution time; measurement; protocol; compute-bound programs
Journal Title
SOFTWARE: PRACTICE AND EXPERIENCE
Citation Volume
47
ISSN
0038-0644
Files in This Item:
There are no files associated with this item.
Appears in Collections:
7. KISTI 연구성과 > 학술지 발표논문
URI
https://repository.kisti.re.kr/handle/10580/14651
http://www.ndsl.kr/ndsl/search/detail/article/articleSearchResultDetail.do?cn=NART77462561
Export
RIS (EndNote)
XLS (Excel)
XML

Browse