Skip to main navigation Skip to search Skip to main content

Scheduling performance of real-time tasks on MapReduce cluster

  • Fei Teng*
  • , Lei Yu
  • , Frédéric Magoulès
  • *Corresponding author for this work
  • Ecole Centrale Paris-Supelec

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

This paper addresses the scheduling problem of real-time tasks on MapReduce cluster. Since MapReduce consists of two sequential stages, segmentation execution enables cluster scheduling to be more flexible. In this paper, we analyze how the segmentation between Map and Reduce influences cluster utilization. We find out the worst pattern for schedulable task set, based on which the upper bound of cluster utilization is deduced. This bound function, as a general expression of the classic Liu's result, can be used for on-line schedulability test in time complexity O(1). Theoretical results show proper segmentation between Map and Reduce is beneficial to MapReduce cluster with a higher utilization bound.

Original languageEnglish
Title of host publicationProceedings of the International Conference on Human-Centric Computing 2011 and Embedded and Multimedia Computing 2011, HumanCom and EMC 2011
Pages365-374
Number of pages10
DOIs
StatePublished - 2011
Event4th International Conference on Human-Centric Computing, HumanCom'11 and the 6th International Conference on Embedded and Multimedia Computing, EMC'11 - Enshi, China
Duration: 11 Aug 2011 → 13 Aug 2011

Publication series

NameLecture Notes in Electrical Engineering
Volume102 LNEE
ISSN (Print)1876-1100
ISSN (Electronic)1876-1119

Conference

Conference4th International Conference on Human-Centric Computing, HumanCom'11 and the 6th International Conference on Embedded and Multimedia Computing, EMC'11
Country/TerritoryChina
CityEnshi
Period11/08/11 → 13/08/11

Keywords

  • MapReduce
  • Periodic task
  • Real-time scheduling
  • Utilization bound

Fingerprint

Dive into the research topics of 'Scheduling performance of real-time tasks on MapReduce cluster'. Together they form a unique fingerprint.

Cite this