Skip to main navigation Skip to search Skip to main content

STNet: Low-Complexity Neural Network Decoder With Network Pruning

  • Zhiyuan Ren
  • , Ling Zhao*
  • , Chuanyang Wei
  • , Zhen Dai
  • *Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

In this letter, a novel and compact neural network called Sigmoid-Tanh Network (STNet) is proposed for channel decoding, which is only composed of sigmoid and tanh activation functions. To address the structural redundancy problem in long and short-term memory network (LSTM), the neurons in the STNet are redesigned with the most effective structure in the LSTM cell for decoding. To further reduce the computational complexity, we propose an automatic pruning method based on multiple layer sensitivity, which can effectively remove redundant weights in STNet decoder with slight performance loss. Simulation results show that the proposed STNet decoder achieves near-maximum likelihood (ML) performance with only 17.1% trainable parameters compared to LSTM. Moreover, our pruning method achieves comparable decoding performance when reducing 58.3% Floating-point operations (FLOPs) for STNet.

Original languageEnglish
Pages (from-to)350-354
Number of pages5
JournalIEEE Communications Letters
Volume26
Issue number2
DOIs
StatePublished - 1 Feb 2022

Keywords

  • Deep learning
  • LSTM
  • channel decoding
  • network pruning

Fingerprint

Dive into the research topics of 'STNet: Low-Complexity Neural Network Decoder With Network Pruning'. Together they form a unique fingerprint.

Cite this