Skip to main navigation Skip to search Skip to main content

Evaluation of software quality in the TopCoder crowdsourcing environment

  • Beihang University

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Many practitioners use rules of thumb to take participate in tasks from online labor markets. TopCoder is such a crowdsourcing platform in which users select among and compete in a collection of contests offering various rewards. Most research efforts on crowdsourcing focus on competitive behaviors of programmers and performance of contests without discussion on the quality of a complete software project that often involves several phases in a group software production process. The main objective of our research is to capture the essential features of TopCoder projects and introduce a new approach to evaluate the quality for each TopCoder project. This paper makes two major contributions: First, we model the effort level using intrinsic properties of contest and validate the definition. We evaluate quality of each contest following the definition of effort level. Subsequently we extend the quality definition to each phase of a TopCoder project and finally obtain the whole project quality. We also perform necessary validation on our model using empirical data and show some important discovery.

Original languageEnglish
Title of host publication2017 IEEE 7th Annual Computing and Communication Workshop and Conference, CCWC 2017
EditorsHimadri Nath Saha, Satyajit Chakrabarti
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781509042289
DOIs
StatePublished - 1 Mar 2017
Event7th IEEE Annual Computing and Communication Workshop and Conference, CCWC 2017 - Las Vegas, United States
Duration: 9 Jan 201711 Jan 2017

Publication series

Name2017 IEEE 7th Annual Computing and Communication Workshop and Conference, CCWC 2017

Conference

Conference7th IEEE Annual Computing and Communication Workshop and Conference, CCWC 2017
Country/TerritoryUnited States
CityLas Vegas
Period9/01/1711/01/17

Keywords

  • Crowdsourcing based Software Development
  • Effort Level
  • Software Quality

Fingerprint

Dive into the research topics of 'Evaluation of software quality in the TopCoder crowdsourcing environment'. Together they form a unique fingerprint.

Cite this