UCDC: Unlimited Content-Defined Chunking, A File-Differing Method Apply to File-Synchronization among Multiple Hosts

Jihong Ma; Chongguang Bi; Yuebin Bai; Lijun Zhang

doi:10.1109/SKG.2016.019

UCDC: Unlimited Content-Defined Chunking, A File-Differing Method Apply to File-Synchronization among Multiple Hosts

Jihong Ma
, Chongguang Bi
, Yuebin Bai
, Lijun Zhang

计算机学院

Handan Polytechnic College
Science and Technology on Information Transmission and Dissemination
Beihang University

科研成果: 书/报告/会议事项章节 › 会议稿件 › 同行评审

5 引用（Scopus）

摘要

Nowadays, the data centric system has been playing an increasingly important role in blogs sharing, content delivery and news broadcasting, file-synchronization, and so on. Due to generated amount of data within the system, data backup and archiving has become a main challenging task. A main methods to solve the problem is Chunking based deduplication by eliminating redundant data and reducing the total storage space. In this paper, we summarized several ways of file-differing, and then designs a new Unlimited Content-Defined Chunking (UCDC) algorithm, which contains file-chunking, file-comparing and file-merging. We evaluate the effectiveness of the UCDC by simulation example that produces the description of file.

源语言	英语
主期刊名	Proceedings - 2016 12th International Conference on Semantics, Knowledge and Grids, SKG 2016
编辑	Hai Zhuge, Xiaoping Sun
出版商	Institute of Electrical and Electronics Engineers Inc.
页	76-82
页数	7
ISBN（电子版）	9781509047956
DOI	https://doi.org/10.1109/SKG.2016.019
出版状态	已出版 - 11 1月 2017
活动	12th International Conference on Semantics, Knowledge and Grids, SKG 2016 - Beijing, 中国期限: 15 8月 2016 → 17 8月 2016

出版系列

姓名	Proceedings - 2016 12th International Conference on Semantics, Knowledge and Grids, SKG 2016

会议

会议	12th International Conference on Semantics, Knowledge and Grids, SKG 2016
国家/地区	中国
市	Beijing
时期	15/08/16 → 17/08/16

访问文件

10.1109/SKG.2016.019

其它文件与链接

链接到 Scopus 的出版物

引用此

Ma, J., Bi, C., Bai, Y., & Zhang, L. (2017). UCDC: Unlimited Content-Defined Chunking, A File-Differing Method Apply to File-Synchronization among Multiple Hosts. 在 H. Zhuge, & X. Sun (编辑), Proceedings - 2016 12th International Conference on Semantics, Knowledge and Grids, SKG 2016 (页码 76-82). 文章 7815080 (Proceedings - 2016 12th International Conference on Semantics, Knowledge and Grids, SKG 2016). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/SKG.2016.019

Ma, Jihong ; Bi, Chongguang ; Bai, Yuebin 等. / UCDC : Unlimited Content-Defined Chunking, A File-Differing Method Apply to File-Synchronization among Multiple Hosts. Proceedings - 2016 12th International Conference on Semantics, Knowledge and Grids, SKG 2016. 编辑 / Hai Zhuge ; Xiaoping Sun. Institute of Electrical and Electronics Engineers Inc., 2017. 页码 76-82 (Proceedings - 2016 12th International Conference on Semantics, Knowledge and Grids, SKG 2016).

@inproceedings{5ea1762cc03c4f28b759e1431fced7a6,

title = "UCDC: Unlimited Content-Defined Chunking, A File-Differing Method Apply to File-Synchronization among Multiple Hosts",

abstract = "Nowadays, the data centric system has been playing an increasingly important role in blogs sharing, content delivery and news broadcasting, file-synchronization, and so on. Due to generated amount of data within the system, data backup and archiving has become a main challenging task. A main methods to solve the problem is Chunking based deduplication by eliminating redundant data and reducing the total storage space. In this paper, we summarized several ways of file-differing, and then designs a new Unlimited Content-Defined Chunking (UCDC) algorithm, which contains file-chunking, file-comparing and file-merging. We evaluate the effectiveness of the UCDC by simulation example that produces the description of file.",

author = "Jihong Ma and Chongguang Bi and Yuebin Bai and Lijun Zhang",

note = "Publisher Copyright: {\textcopyright} 2016 IEEE.; 12th International Conference on Semantics, Knowledge and Grids, SKG 2016 ; Conference date: 15-08-2016 Through 17-08-2016",

year = "2017",

month = jan,

day = "11",

doi = "10.1109/SKG.2016.019",

language = "英语",

series = "Proceedings - 2016 12th International Conference on Semantics, Knowledge and Grids, SKG 2016",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "76--82",

editor = "Hai Zhuge and Xiaoping Sun",

booktitle = "Proceedings - 2016 12th International Conference on Semantics, Knowledge and Grids, SKG 2016",

address = "美国",

}

Ma, J, Bi, C, Bai, Y & Zhang, L 2017, UCDC: Unlimited Content-Defined Chunking, A File-Differing Method Apply to File-Synchronization among Multiple Hosts. 在 H Zhuge & X Sun (编辑), Proceedings - 2016 12th International Conference on Semantics, Knowledge and Grids, SKG 2016., 7815080, Proceedings - 2016 12th International Conference on Semantics, Knowledge and Grids, SKG 2016, Institute of Electrical and Electronics Engineers Inc., 页码 76-82, 12th International Conference on Semantics, Knowledge and Grids, SKG 2016, Beijing, 中国, 15/08/16. https://doi.org/10.1109/SKG.2016.019

UCDC: Unlimited Content-Defined Chunking, A File-Differing Method Apply to File-Synchronization among Multiple Hosts. / Ma, Jihong; Bi, Chongguang; Bai, Yuebin 等.
Proceedings - 2016 12th International Conference on Semantics, Knowledge and Grids, SKG 2016. 编辑 / Hai Zhuge; Xiaoping Sun. Institute of Electrical and Electronics Engineers Inc., 2017. 页码 76-82 7815080 (Proceedings - 2016 12th International Conference on Semantics, Knowledge and Grids, SKG 2016).

科研成果: 书/报告/会议事项章节 › 会议稿件 › 同行评审

TY - GEN

T1 - UCDC

T2 - 12th International Conference on Semantics, Knowledge and Grids, SKG 2016

AU - Ma, Jihong

AU - Bi, Chongguang

AU - Bai, Yuebin

AU - Zhang, Lijun

PY - 2017/1/11

Y1 - 2017/1/11

N2 - Nowadays, the data centric system has been playing an increasingly important role in blogs sharing, content delivery and news broadcasting, file-synchronization, and so on. Due to generated amount of data within the system, data backup and archiving has become a main challenging task. A main methods to solve the problem is Chunking based deduplication by eliminating redundant data and reducing the total storage space. In this paper, we summarized several ways of file-differing, and then designs a new Unlimited Content-Defined Chunking (UCDC) algorithm, which contains file-chunking, file-comparing and file-merging. We evaluate the effectiveness of the UCDC by simulation example that produces the description of file.

AB - Nowadays, the data centric system has been playing an increasingly important role in blogs sharing, content delivery and news broadcasting, file-synchronization, and so on. Due to generated amount of data within the system, data backup and archiving has become a main challenging task. A main methods to solve the problem is Chunking based deduplication by eliminating redundant data and reducing the total storage space. In this paper, we summarized several ways of file-differing, and then designs a new Unlimited Content-Defined Chunking (UCDC) algorithm, which contains file-chunking, file-comparing and file-merging. We evaluate the effectiveness of the UCDC by simulation example that produces the description of file.

UR - https://www.scopus.com/pages/publications/85013306203

U2 - 10.1109/SKG.2016.019

DO - 10.1109/SKG.2016.019

M3 - 会议稿件

AN - SCOPUS:85013306203

T3 - Proceedings - 2016 12th International Conference on Semantics, Knowledge and Grids, SKG 2016

SP - 76

EP - 82

BT - Proceedings - 2016 12th International Conference on Semantics, Knowledge and Grids, SKG 2016

A2 - Zhuge, Hai

A2 - Sun, Xiaoping

PB - Institute of Electrical and Electronics Engineers Inc.

Y2 - 15 August 2016 through 17 August 2016

ER -

Ma J, Bi C, Bai Y , Zhang L. UCDC: Unlimited Content-Defined Chunking, A File-Differing Method Apply to File-Synchronization among Multiple Hosts. 在 Zhuge H, Sun X, 编辑, Proceedings - 2016 12th International Conference on Semantics, Knowledge and Grids, SKG 2016. Institute of Electrical and Electronics Engineers Inc. 2017. 页码 76-82. 7815080. (Proceedings - 2016 12th International Conference on Semantics, Knowledge and Grids, SKG 2016). doi: 10.1109/SKG.2016.019

UCDC: Unlimited Content-Defined Chunking, A File-Differing Method Apply to File-Synchronization among Multiple Hosts

摘要

出版系列

会议

访问文件

其它文件与链接

指纹

引用此