A two-phase log-based fault recovery mechanism in master/worker based computing environment

Ting Chen; Yongjian Wang; Yuanqiang Huang; Cheng Luo; Depei Qian; Zhongzhi Luan

doi:10.1109/ISPA.2009.53

A two-phase log-based fault recovery mechanism in master/worker based computing environment

Ting Chen^*
, Yongjian Wang
, Yuanqiang Huang
, Cheng Luo
, Depei Qian
, Zhongzhi Luan

^*Corresponding author for this work

School of Computer Science and Engineering

Beihang University

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

1 Scopus citations

Abstract

The Master/worker pattern is widely used to construct the cross-domain, large scale computing infrastructure. The applications supported by this kind of infrastructure usually features long-running, speculative execution etc. Fault recovery mechanism is significant to them especially in the wide area network environment, which consists of error prone components. Inter-node cooperation is urgent to make the recovery process more efficient. The traditional log-based rollback recovery mechanism which features independent recovery cannot fulfill the global cooperation requirement due to the waste of bandwidth and slow application data transfer which is caused by the exchange of a large amount of logs. In this paper, we propose a twophase log-based recovery mechanism which is of merits such as space saving and global optimization and can be used as a complement of the current log-based rollback recovery approach in some specific situations. We have demonstrated the use of this mechanism in the Drug Discovery Grid environment, which is supported by China National Grid. Experiment results have proved efficiency of this mechanism.

Original language	English
Title of host publication	Proceedings - 2009 IEEE International Symposium on Parallel and Distributed Processing with Applications, ISPA 2009
Pages	290-297
Number of pages	8
DOIs	https://doi.org/10.1109/ISPA.2009.53
State	Published - 2009
Event	2009 IEEE International Symposium on Parallel and Distributed Processing with Applications, ISPA 2009 - Chengdu, Sichuan, China Duration: 9 Aug 2009 → 12 Aug 2009

Publication series

Name	Proceedings - 2009 IEEE International Symposium on Parallel and Distributed Processing with Applications, ISPA 2009

Conference

Conference	2009 IEEE International Symposium on Parallel and Distributed Processing with Applications, ISPA 2009
Country/Territory	China
City	Chengdu, Sichuan
Period	9/08/09 → 12/08/09

Keywords

Drug discovery grid
Fault recovery
Log-based rollback recovery
Twophase recovery

Access to Document

10.1109/ISPA.2009.53

Cite this

Chen, T., Wang, Y., Huang, Y., Luo, C., Qian, D., & Luan, Z. (2009). A two-phase log-based fault recovery mechanism in master/worker based computing environment. In Proceedings - 2009 IEEE International Symposium on Parallel and Distributed Processing with Applications, ISPA 2009 (pp. 290-297). Article 5207921 (Proceedings - 2009 IEEE International Symposium on Parallel and Distributed Processing with Applications, ISPA 2009). https://doi.org/10.1109/ISPA.2009.53

Chen, Ting ; Wang, Yongjian ; Huang, Yuanqiang et al. / A two-phase log-based fault recovery mechanism in master/worker based computing environment. Proceedings - 2009 IEEE International Symposium on Parallel and Distributed Processing with Applications, ISPA 2009. 2009. pp. 290-297 (Proceedings - 2009 IEEE International Symposium on Parallel and Distributed Processing with Applications, ISPA 2009).

@inproceedings{2fbe02ee35a3433ba2d3f6587b566c8e,

title = "A two-phase log-based fault recovery mechanism in master/worker based computing environment",

abstract = "The Master/worker pattern is widely used to construct the cross-domain, large scale computing infrastructure. The applications supported by this kind of infrastructure usually features long-running, speculative execution etc. Fault recovery mechanism is significant to them especially in the wide area network environment, which consists of error prone components. Inter-node cooperation is urgent to make the recovery process more efficient. The traditional log-based rollback recovery mechanism which features independent recovery cannot fulfill the global cooperation requirement due to the waste of bandwidth and slow application data transfer which is caused by the exchange of a large amount of logs. In this paper, we propose a twophase log-based recovery mechanism which is of merits such as space saving and global optimization and can be used as a complement of the current log-based rollback recovery approach in some specific situations. We have demonstrated the use of this mechanism in the Drug Discovery Grid environment, which is supported by China National Grid. Experiment results have proved efficiency of this mechanism.",

keywords = "Drug discovery grid, Fault recovery, Log-based rollback recovery, Twophase recovery",

author = "Ting Chen and Yongjian Wang and Yuanqiang Huang and Cheng Luo and Depei Qian and Zhongzhi Luan",

year = "2009",

doi = "10.1109/ISPA.2009.53",

language = "英语",

isbn = "9780769537474",

series = "Proceedings - 2009 IEEE International Symposium on Parallel and Distributed Processing with Applications, ISPA 2009",

pages = "290--297",

booktitle = "Proceedings - 2009 IEEE International Symposium on Parallel and Distributed Processing with Applications, ISPA 2009",

note = "2009 IEEE International Symposium on Parallel and Distributed Processing with Applications, ISPA 2009 ; Conference date: 09-08-2009 Through 12-08-2009",

}

Chen, T, Wang, Y, Huang, Y, Luo, C, Qian, D & Luan, Z 2009, A two-phase log-based fault recovery mechanism in master/worker based computing environment. in Proceedings - 2009 IEEE International Symposium on Parallel and Distributed Processing with Applications, ISPA 2009., 5207921, Proceedings - 2009 IEEE International Symposium on Parallel and Distributed Processing with Applications, ISPA 2009, pp. 290-297, 2009 IEEE International Symposium on Parallel and Distributed Processing with Applications, ISPA 2009, Chengdu, Sichuan, China, 9/08/09. https://doi.org/10.1109/ISPA.2009.53

A two-phase log-based fault recovery mechanism in master/worker based computing environment. / Chen, Ting; Wang, Yongjian; Huang, Yuanqiang et al.
Proceedings - 2009 IEEE International Symposium on Parallel and Distributed Processing with Applications, ISPA 2009. 2009. p. 290-297 5207921 (Proceedings - 2009 IEEE International Symposium on Parallel and Distributed Processing with Applications, ISPA 2009).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - A two-phase log-based fault recovery mechanism in master/worker based computing environment

AU - Chen, Ting

AU - Wang, Yongjian

AU - Huang, Yuanqiang

AU - Luo, Cheng

AU - Qian, Depei

AU - Luan, Zhongzhi

PY - 2009

Y1 - 2009

N2 - The Master/worker pattern is widely used to construct the cross-domain, large scale computing infrastructure. The applications supported by this kind of infrastructure usually features long-running, speculative execution etc. Fault recovery mechanism is significant to them especially in the wide area network environment, which consists of error prone components. Inter-node cooperation is urgent to make the recovery process more efficient. The traditional log-based rollback recovery mechanism which features independent recovery cannot fulfill the global cooperation requirement due to the waste of bandwidth and slow application data transfer which is caused by the exchange of a large amount of logs. In this paper, we propose a twophase log-based recovery mechanism which is of merits such as space saving and global optimization and can be used as a complement of the current log-based rollback recovery approach in some specific situations. We have demonstrated the use of this mechanism in the Drug Discovery Grid environment, which is supported by China National Grid. Experiment results have proved efficiency of this mechanism.

AB - The Master/worker pattern is widely used to construct the cross-domain, large scale computing infrastructure. The applications supported by this kind of infrastructure usually features long-running, speculative execution etc. Fault recovery mechanism is significant to them especially in the wide area network environment, which consists of error prone components. Inter-node cooperation is urgent to make the recovery process more efficient. The traditional log-based rollback recovery mechanism which features independent recovery cannot fulfill the global cooperation requirement due to the waste of bandwidth and slow application data transfer which is caused by the exchange of a large amount of logs. In this paper, we propose a twophase log-based recovery mechanism which is of merits such as space saving and global optimization and can be used as a complement of the current log-based rollback recovery approach in some specific situations. We have demonstrated the use of this mechanism in the Drug Discovery Grid environment, which is supported by China National Grid. Experiment results have proved efficiency of this mechanism.

KW - Drug discovery grid

KW - Fault recovery

KW - Log-based rollback recovery

KW - Twophase recovery

UR - https://www.scopus.com/pages/publications/70449502954

U2 - 10.1109/ISPA.2009.53

DO - 10.1109/ISPA.2009.53

M3 - 会议稿件

AN - SCOPUS:70449502954

SN - 9780769537474

T3 - Proceedings - 2009 IEEE International Symposium on Parallel and Distributed Processing with Applications, ISPA 2009

SP - 290

EP - 297

BT - Proceedings - 2009 IEEE International Symposium on Parallel and Distributed Processing with Applications, ISPA 2009

T2 - 2009 IEEE International Symposium on Parallel and Distributed Processing with Applications, ISPA 2009

Y2 - 9 August 2009 through 12 August 2009

ER -

Chen T, Wang Y, Huang Y, Luo C, Qian D , Luan Z. A two-phase log-based fault recovery mechanism in master/worker based computing environment. In Proceedings - 2009 IEEE International Symposium on Parallel and Distributed Processing with Applications, ISPA 2009. 2009. p. 290-297. 5207921. (Proceedings - 2009 IEEE International Symposium on Parallel and Distributed Processing with Applications, ISPA 2009). doi: 10.1109/ISPA.2009.53

A two-phase log-based fault recovery mechanism in master/worker based computing environment

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this