跳到主要导航 跳到搜索 跳到主要内容

A fine-grained performance bottleneck analysis method for HDFS

  • Beihang University

科研成果: 书/报告/会议事项章节会议稿件同行评审

摘要

The performance issue of HDFS has always been a great concern due to its widely adoption in both production and research environments. However, a fine-grained performance analysis tool is missing to effectively identify the bottlenecks as well as to provide useful guidance for performance optimization. In this paper, we propose a fine-grained performance bottleneck analysis tool, which extends HTrace with fine-grained instrumentation points that are missing in Hadoop official distribution. In addition, we propose an effective trace merging method that improves the understandability of our analysis. We analyze the performance of HDFS under different kinds of workloads and get undiscovered insights.

源语言英语
主期刊名Network and Parallel Computing - 15th IFIP WG 10.3 International Conference, NPC 2018, Proceedings
编辑Marc Snir, Mateo Valero, Feng Zhang, Hironori Kasahara, Jidong Zhai, Hai Jin
出版商Springer Verlag
159-163
页数5
ISBN(印刷版)9783030056766
DOI
出版状态已出版 - 2018
活动15th IFIP International Conference on Network and Parallel Computing, NPC 2018 - Muroran, 日本
期限: 29 11月 20181 12月 2018

出版系列

姓名Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
11276 LNCS
ISSN(印刷版)0302-9743
ISSN(电子版)1611-3349

会议

会议15th IFIP International Conference on Network and Parallel Computing, NPC 2018
国家/地区日本
Muroran
时期29/11/181/12/18

指纹

探究 'A fine-grained performance bottleneck analysis method for HDFS' 的科研主题。它们共同构成独一无二的指纹。

引用此