Service composition in cloud manufacturing: A DQN-based approach

  • Haifeng Zhang
  • , Yongkui Liu
  • , Huagang Liang
  • , Lihui Wang*
  • , Lin Zhang
  • *Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingChapterpeer-review

Abstract

Cloud manufacturing is a new service-oriented manufacturing model that integrates distributed manufacturing resources to provide on-demand manufacturing services over the Internet. Service composition that builds larger-granularity, value-added services by combining a number of smaller-granularity services to satisfy consumers’ complex requirements is an important issue in cloud manufacturing. Meta-heuristic algorithms such as genetic algorithm, particle swarm optimization, and ant colony algorithm are frequently employed for addressing service composition issues in cloud manufacturing. However, these algorithms require complex design flows and lack adaptability to dynamic environment. Deep reinforcement learning provides an alternative approach for solving cloud manufacturing service composition issues. This chapter proposes a deep Q-network (DQN) based approach for service composition in cloud manufacturing, which is able to find optimal service composition solutions through repeated training and learning. Results of experiments that take into account changes of service scales and service unavailability reveal the scalability and robustness of the DQN algorithm-based service composition approach.

Original languageEnglish
Title of host publicationInternational Series in Operations Research and Management Science
PublisherSpringer
Pages239-254
Number of pages16
DOIs
StatePublished - 2020

Publication series

NameInternational Series in Operations Research and Management Science
Volume289
ISSN (Print)0884-8289
ISSN (Electronic)2214-7934

Keywords

  • Cloud manufacturing
  • Deep Q-network
  • Deep reinforcement learning
  • Service composition

Fingerprint

Dive into the research topics of 'Service composition in cloud manufacturing: A DQN-based approach'. Together they form a unique fingerprint.

Cite this