UCDC: Unlimited Content-Defined Chunking, A File-Differing Method Apply to File-Synchronization among Multiple Hosts

Jihong Ma; Chongguang Bi; Yuebin Bai; Lijun Zhang

doi:10.1109/SKG.2016.019

UCDC: Unlimited Content-Defined Chunking, A File-Differing Method Apply to File-Synchronization among Multiple Hosts

Jihong Ma
, Chongguang Bi
, Yuebin Bai
, Lijun Zhang

School of Computer Science and Engineering

Handan Polytechnic College
Science and Technology on Information Transmission and Dissemination
Beihang University

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

5 Scopus citations

Abstract

Nowadays, the data centric system has been playing an increasingly important role in blogs sharing, content delivery and news broadcasting, file-synchronization, and so on. Due to generated amount of data within the system, data backup and archiving has become a main challenging task. A main methods to solve the problem is Chunking based deduplication by eliminating redundant data and reducing the total storage space. In this paper, we summarized several ways of file-differing, and then designs a new Unlimited Content-Defined Chunking (UCDC) algorithm, which contains file-chunking, file-comparing and file-merging. We evaluate the effectiveness of the UCDC by simulation example that produces the description of file.

Original language	English
Title of host publication	Proceedings - 2016 12th International Conference on Semantics, Knowledge and Grids, SKG 2016
Editors	Hai Zhuge, Xiaoping Sun
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	76-82
Number of pages	7
ISBN (Electronic)	9781509047956
DOIs	https://doi.org/10.1109/SKG.2016.019
State	Published - 11 Jan 2017
Event	12th International Conference on Semantics, Knowledge and Grids, SKG 2016 - Beijing, China Duration: 15 Aug 2016 → 17 Aug 2016

Publication series

Name	Proceedings - 2016 12th International Conference on Semantics, Knowledge and Grids, SKG 2016

Conference

Conference	12th International Conference on Semantics, Knowledge and Grids, SKG 2016
Country/Territory	China
City	Beijing
Period	15/08/16 → 17/08/16

Access to Document

10.1109/SKG.2016.019

Cite this

Ma, J., Bi, C., Bai, Y., & Zhang, L. (2017). UCDC: Unlimited Content-Defined Chunking, A File-Differing Method Apply to File-Synchronization among Multiple Hosts. In H. Zhuge, & X. Sun (Eds.), Proceedings - 2016 12th International Conference on Semantics, Knowledge and Grids, SKG 2016 (pp. 76-82). Article 7815080 (Proceedings - 2016 12th International Conference on Semantics, Knowledge and Grids, SKG 2016). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/SKG.2016.019

Ma, Jihong ; Bi, Chongguang ; Bai, Yuebin et al. / UCDC : Unlimited Content-Defined Chunking, A File-Differing Method Apply to File-Synchronization among Multiple Hosts. Proceedings - 2016 12th International Conference on Semantics, Knowledge and Grids, SKG 2016. editor / Hai Zhuge ; Xiaoping Sun. Institute of Electrical and Electronics Engineers Inc., 2017. pp. 76-82 (Proceedings - 2016 12th International Conference on Semantics, Knowledge and Grids, SKG 2016).

@inproceedings{5ea1762cc03c4f28b759e1431fced7a6,

title = "UCDC: Unlimited Content-Defined Chunking, A File-Differing Method Apply to File-Synchronization among Multiple Hosts",

abstract = "Nowadays, the data centric system has been playing an increasingly important role in blogs sharing, content delivery and news broadcasting, file-synchronization, and so on. Due to generated amount of data within the system, data backup and archiving has become a main challenging task. A main methods to solve the problem is Chunking based deduplication by eliminating redundant data and reducing the total storage space. In this paper, we summarized several ways of file-differing, and then designs a new Unlimited Content-Defined Chunking (UCDC) algorithm, which contains file-chunking, file-comparing and file-merging. We evaluate the effectiveness of the UCDC by simulation example that produces the description of file.",

author = "Jihong Ma and Chongguang Bi and Yuebin Bai and Lijun Zhang",

note = "Publisher Copyright: {\textcopyright} 2016 IEEE.; 12th International Conference on Semantics, Knowledge and Grids, SKG 2016 ; Conference date: 15-08-2016 Through 17-08-2016",

year = "2017",

month = jan,

day = "11",

doi = "10.1109/SKG.2016.019",

language = "英语",

series = "Proceedings - 2016 12th International Conference on Semantics, Knowledge and Grids, SKG 2016",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "76--82",

editor = "Hai Zhuge and Xiaoping Sun",

booktitle = "Proceedings - 2016 12th International Conference on Semantics, Knowledge and Grids, SKG 2016",

address = "美国",

}

Ma, J, Bi, C, Bai, Y & Zhang, L 2017, UCDC: Unlimited Content-Defined Chunking, A File-Differing Method Apply to File-Synchronization among Multiple Hosts. in H Zhuge & X Sun (eds), Proceedings - 2016 12th International Conference on Semantics, Knowledge and Grids, SKG 2016., 7815080, Proceedings - 2016 12th International Conference on Semantics, Knowledge and Grids, SKG 2016, Institute of Electrical and Electronics Engineers Inc., pp. 76-82, 12th International Conference on Semantics, Knowledge and Grids, SKG 2016, Beijing, China, 15/08/16. https://doi.org/10.1109/SKG.2016.019

UCDC: Unlimited Content-Defined Chunking, A File-Differing Method Apply to File-Synchronization among Multiple Hosts. / Ma, Jihong; Bi, Chongguang; Bai, Yuebin et al.
Proceedings - 2016 12th International Conference on Semantics, Knowledge and Grids, SKG 2016. ed. / Hai Zhuge; Xiaoping Sun. Institute of Electrical and Electronics Engineers Inc., 2017. p. 76-82 7815080 (Proceedings - 2016 12th International Conference on Semantics, Knowledge and Grids, SKG 2016).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - UCDC

T2 - 12th International Conference on Semantics, Knowledge and Grids, SKG 2016

AU - Ma, Jihong

AU - Bi, Chongguang

AU - Bai, Yuebin

AU - Zhang, Lijun

PY - 2017/1/11

Y1 - 2017/1/11

N2 - Nowadays, the data centric system has been playing an increasingly important role in blogs sharing, content delivery and news broadcasting, file-synchronization, and so on. Due to generated amount of data within the system, data backup and archiving has become a main challenging task. A main methods to solve the problem is Chunking based deduplication by eliminating redundant data and reducing the total storage space. In this paper, we summarized several ways of file-differing, and then designs a new Unlimited Content-Defined Chunking (UCDC) algorithm, which contains file-chunking, file-comparing and file-merging. We evaluate the effectiveness of the UCDC by simulation example that produces the description of file.

AB - Nowadays, the data centric system has been playing an increasingly important role in blogs sharing, content delivery and news broadcasting, file-synchronization, and so on. Due to generated amount of data within the system, data backup and archiving has become a main challenging task. A main methods to solve the problem is Chunking based deduplication by eliminating redundant data and reducing the total storage space. In this paper, we summarized several ways of file-differing, and then designs a new Unlimited Content-Defined Chunking (UCDC) algorithm, which contains file-chunking, file-comparing and file-merging. We evaluate the effectiveness of the UCDC by simulation example that produces the description of file.

UR - https://www.scopus.com/pages/publications/85013306203

U2 - 10.1109/SKG.2016.019

DO - 10.1109/SKG.2016.019

M3 - 会议稿件

AN - SCOPUS:85013306203

T3 - Proceedings - 2016 12th International Conference on Semantics, Knowledge and Grids, SKG 2016

SP - 76

EP - 82

BT - Proceedings - 2016 12th International Conference on Semantics, Knowledge and Grids, SKG 2016

A2 - Zhuge, Hai

A2 - Sun, Xiaoping

PB - Institute of Electrical and Electronics Engineers Inc.

Y2 - 15 August 2016 through 17 August 2016

ER -

Ma J, Bi C, Bai Y , Zhang L. UCDC: Unlimited Content-Defined Chunking, A File-Differing Method Apply to File-Synchronization among Multiple Hosts. In Zhuge H, Sun X, editors, Proceedings - 2016 12th International Conference on Semantics, Knowledge and Grids, SKG 2016. Institute of Electrical and Electronics Engineers Inc. 2017. p. 76-82. 7815080. (Proceedings - 2016 12th International Conference on Semantics, Knowledge and Grids, SKG 2016). doi: 10.1109/SKG.2016.019

UCDC: Unlimited Content-Defined Chunking, A File-Differing Method Apply to File-Synchronization among Multiple Hosts

Abstract

Publication series

Conference

Access to Document

Other files and links

Fingerprint

Cite this