TY - GEN
T1 - A file assignment strategy for parallel I/O system with minimum I/O contention probability
AU - Dong, Bin
AU - Li, Xiuqiao
AU - Xiao, Limin
AU - Ruan, Li
PY - 2011
Y1 - 2011
N2 - Many solutions have been proposed to tackle the problem of assigning files in a parallel I/O system. The primary objective of the existing solutions is either to balance the load among disks or to minimize the service time variance at each disk, whereas the dynamic characteristics of the file requests which would access these files are ignored. The studies on the dynamic I/O behaviors of applications show that the file requests targeted on the different popular files situated in the same disk may temporally compete with each another for the same disk. Consequently, the performance gained from the parallelism of multiple disks is degraded because this type of I/O contention turns the parallel I/O into sequential one. Hence, how to minimize the I/O contention among the file requests should become one of the new objectives which the file assignment strategy should take into consideration. In order to address this issue, this study proposes a new static file assignment algorithm named MinCP for parallel I/O system. Through assigning files sorted in their access rates onto multiple disks in round-robin fashion, the MinCP aims to minimize the I/O contention probability among file requests, thereby optimizing the mean response time of these requests. The experiment results show that the MinCP achieves optimal performance on mean response time among the existing schemes for comparison.
AB - Many solutions have been proposed to tackle the problem of assigning files in a parallel I/O system. The primary objective of the existing solutions is either to balance the load among disks or to minimize the service time variance at each disk, whereas the dynamic characteristics of the file requests which would access these files are ignored. The studies on the dynamic I/O behaviors of applications show that the file requests targeted on the different popular files situated in the same disk may temporally compete with each another for the same disk. Consequently, the performance gained from the parallelism of multiple disks is degraded because this type of I/O contention turns the parallel I/O into sequential one. Hence, how to minimize the I/O contention among the file requests should become one of the new objectives which the file assignment strategy should take into consideration. In order to address this issue, this study proposes a new static file assignment algorithm named MinCP for parallel I/O system. Through assigning files sorted in their access rates onto multiple disks in round-robin fashion, the MinCP aims to minimize the I/O contention probability among file requests, thereby optimizing the mean response time of these requests. The experiment results show that the MinCP achieves optimal performance on mean response time among the existing schemes for comparison.
KW - I/O contention probability
KW - Parallel I/O system
KW - file assignment algorithm
KW - heuristic algorithms
UR - https://www.scopus.com/pages/publications/83755181454
U2 - 10.1007/978-3-642-27180-9_55
DO - 10.1007/978-3-642-27180-9_55
M3 - 会议稿件
AN - SCOPUS:83755181454
SN - 9783642271793
T3 - Communications in Computer and Information Science
SP - 445
EP - 454
BT - Grid and Distributed Computing - International Conference, GDC 2011, Held as Part of the Future Generation Information Technology Conference, FGIT 2011, Proceedings
T2 - International Conference on Grid and Distributed Computing, GDC 2011, Held as Part of the 3rd International Mega-Conference on Future-Generation Information Technology, FGIT 2011
Y2 - 8 December 2011 through 10 December 2011
ER -