Skip to main navigation Skip to search Skip to main content

Data stream prediction in distributed stream processing environment

  • Beihang University

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

With the wide adoption of distributed stream processing, the requirement of guaranteeing QoS has been raised to a new standard. Since node load influences QoS directly, it is a hotspot of research. Through analyzing the relationship between input data stream and load of physical node this paper abstracted a local node model from traditional distributed stream processing network. Based on this model, a new data stream prediction algorithm grounded on a classic machine learning algorithm - Share Algorithm - is proposed. The new algorithm uses recent data stream as the prediction resource and efficiently accomplishes the prediction of single nodes in the future period. Our experiments show that 73% of predictions can achieve the accuracy more than 90% with some common data traces.

Original languageEnglish
Title of host publicationInternational Conference on Automatic Control and Artificial Intelligence, ACAI 2012
Pages747-750
Number of pages4
Edition598 CP
DOIs
StatePublished - 2012
EventInternational Conference on Automatic Control and Artificial Intelligence, ACAI 2012 - Xiamen, China
Duration: 3 Mar 20125 Mar 2012

Publication series

NameIET Conference Publications
Number598 CP
Volume2012

Conference

ConferenceInternational Conference on Automatic Control and Artificial Intelligence, ACAI 2012
Country/TerritoryChina
CityXiamen
Period3/03/125/03/12

Keywords

  • Data
  • Distributed stream processing
  • Prediction

Fingerprint

Dive into the research topics of 'Data stream prediction in distributed stream processing environment'. Together they form a unique fingerprint.

Cite this