TY - GEN
T1 - I/O Optimizations Based on Workload Characteristics for Parallel File Systems
AU - Wei, Bing
AU - Xiao, Limin
AU - Zhou, Bingyu
AU - Qin, Guangjun
AU - Yan, Baicheng
AU - Huo, Zhisheng
N1 - Publisher Copyright:
© 2019, IFIP International Federation for Information Processing.
PY - 2019
Y1 - 2019
N2 - Parallel file systems usually provide a unified storage solution, which fails to meet specific application needs. In this paper, we propose an extended file handle scheme to address this problem. It allows the file systems to specify optimizations for individual file or directory based on workload characteristics. One case study shows that our proposed approach improves the aggregate throughput of large files and small files by up to 5% and 30%, respectively. To further improve the access performance of small files in parallel file systems, we also propose a new metadata-based small file optimization method. The experimental results show that the aggregate throughput of small files can be effectively improved through our method.
AB - Parallel file systems usually provide a unified storage solution, which fails to meet specific application needs. In this paper, we propose an extended file handle scheme to address this problem. It allows the file systems to specify optimizations for individual file or directory based on workload characteristics. One case study shows that our proposed approach improves the aggregate throughput of large files and small files by up to 5% and 30%, respectively. To further improve the access performance of small files in parallel file systems, we also propose a new metadata-based small file optimization method. The experimental results show that the aggregate throughput of small files can be effectively improved through our method.
KW - Extended file handle
KW - Parallel file systems
KW - Small file optimizations
KW - Workload characteristics
UR - https://www.scopus.com/pages/publications/85076118550
U2 - 10.1007/978-3-030-30709-7_24
DO - 10.1007/978-3-030-30709-7_24
M3 - 会议稿件
AN - SCOPUS:85076118550
SN - 9783030307080
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 305
EP - 310
BT - Network and Parallel Computing - 16th IFIP WG 10.3 International Conference, NPC 2019, Proceedings
A2 - Tang, Xiaoxin
A2 - Chen, Quan
A2 - Bose, Pradip
A2 - Zheng, Weiming
A2 - Gaudiot, Jean-Luc
PB - Springer
T2 - 16th IFIP WG 10.3 International Conference on Network and Parallel Computing, NPC 2019
Y2 - 23 August 2019 through 24 August 2019
ER -