Skip to main navigation Skip to search Skip to main content

Scalable bootstrap clustering for massive data

  • Haocheng Wang*
  • , Fuzhen Zhuang
  • , Xiang Ao
  • , Qing He
  • , Zhongzhi Shi
  • *Corresponding author for this work
  • CAS - Institute of Computing Technology
  • University of Chinese Academy of Sciences

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

The bootstrap provides a simple and powerful means of improving the accuracy of clustering. However, for today's increasingly large datasets, the computation of bootstrap-based quantities can be prohibitively demanding. In this paper we introduce the Bag of Little Bootstraps Clustering (BLBC), a new procedure which utilizes the Bag of Little Bootstraps technique to obtain a robust, computationally efficient means of clustering for massive data. Moreover, BLBC is suited to implementation on modern parallel and distributed computing architectures which are often used to process large datasets. We investigate empirically the performance characteristics of BLBC and compare to the performances of existing methods via experiments on simulated data and real data. The results show that BLBC has a significantly more favorable computational profile than the bootstrap based clustering while maintaining good statistical correctness.

Original languageEnglish
Title of host publication2014 IEEE/ACIS 15th International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing, SNPD 2014 - Proceedings
EditorsSatoshi Takahashi, Ju Yeon Jo
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781479956043
DOIs
StatePublished - 2014
Externally publishedYes
Event15th IEEE/ACIS International Conference on Software Engineering, Artificial Intelligence, Networking, and Parallel/Distributed Computing, SNPD 2014 - Las Vegas, United States
Duration: 30 Jun 20142 Jul 2014

Publication series

Name2014 IEEE/ACIS 15th International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing, SNPD 2014 - Proceedings

Conference

Conference15th IEEE/ACIS International Conference on Software Engineering, Artificial Intelligence, Networking, and Parallel/Distributed Computing, SNPD 2014
Country/TerritoryUnited States
CityLas Vegas
Period30/06/142/07/14

Keywords

  • bag of little boot-straps
  • clustering
  • data mining
  • machine learning
  • parallel and distributed computing

Fingerprint

Dive into the research topics of 'Scalable bootstrap clustering for massive data'. Together they form a unique fingerprint.

Cite this