SimMapReduce: A simulator for modeling MapReduce framework

  • Fei Teng*
  • , Lei Yu
  • , Frédéric Magoulès
  • *Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

As a parallel programming framework, MapReduce has attracted more and more attention from both IT enterprises and research institutes that work for large dataset processing. SimMapReduce, a MapReduce simulator based on GridSim, is introduced to facilitate research on resource management and performance evaluation. With SimMapReduce simulator, researchers are free to implement scheduling algorithms and resource allocation policies by inheriting the provided java classes without concerns of implementation details. A FileManager is integrated to manage files transfers, so that the file transmission time is recorded and taken into account as a part of job completion time. Different simulation scenarios are modeled by predefining parameters in a configuration file. Experiment results illustrate that SimMapReduce can be easily executed in a personal computer and can provide qualitative analysis for MapReduce systems.

Original languageEnglish
Title of host publicationProceedings of the 2011 5th FTRA International Conference on Multimedia and Ubiquitous Engineering, MUE 2011
Pages277-282
Number of pages6
DOIs
StatePublished - 2011
Event2011 5th FTRA International Conference on Multimedia and Ubiquitous Engineering, MUE 2011 - Loutraki, Greece
Duration: 28 Jun 201130 Jun 2011

Publication series

NameProceedings of the 2011 5th FTRA International Conference on Multimedia and Ubiquitous Engineering, MUE 2011

Conference

Conference2011 5th FTRA International Conference on Multimedia and Ubiquitous Engineering, MUE 2011
Country/TerritoryGreece
CityLoutraki
Period28/06/1130/06/11

Keywords

  • Distributed computing
  • File transmission
  • MapReduce
  • Scheduling
  • Simulator

Fingerprint

Dive into the research topics of 'SimMapReduce: A simulator for modeling MapReduce framework'. Together they form a unique fingerprint.

Cite this