跳到主要导航 跳到搜索 跳到主要内容

BARQ: Boundary-Aware Regularized Training for Accurate Inference on Computing-in-Memory Accelerators with Low-Precision A/D Conversion

  • Tingrui Ren*
  • , Bi Wang
  • , Liang Wang
  • , Yuanfu Zhao
  • *此作品的通讯作者
  • Beihang University
  • Beijing Microelectronics Technology Institute

科研成果: 书/报告/会议事项章节会议稿件同行评审

摘要

Computing-in-Memory (CIM) with ReRAM crossbar arrays accelerates Deep Neural Network (DNN) computations by executing operations directly within memory, which reduces both data movement and energy consumption. Recent studies show that lowering the precision of Analog-to-Digital Converters (ADC) in crossbar peripheral circuits can significantly reduce system area and power overheads at the risk of increasing quantization-induced numerical errors that degrade inference accuracy. This paper proposes a Boundary-Aware Regularized Quantization (BARQ) technique to maintain accuracy in CIM accelerators with low-precision ADCs. BARQ introduces ADC bit-width boundary constraints to regulate model weights during quantization-aware training (QAT), mitigating overflow-induced clipping errors and enhancing unstructured weight sparsity. Additionally, we introduce a novel weight initialization strategy based on Euclidean projection, which minimizes initial quantization error and facilitates faster and more stable convergence. Experiments on the CIFAR-10, CIFAR-100, and ImageNet datasets show that BARQ achieves minimal accuracy loss of only 0.59% even with 3-bit ADCs. Furthermore, by enhancing weight sparsity, BARQ further reduces energy consumption by up to 75% and improves hardware efficiency by 3.79× compared to conventional quantization methods.

源语言英语
主期刊名2025 IEEE/ACM International Conference on Computer-Aided Design, ICCAD 2025 - Conference Proceedings
出版商Institute of Electrical and Electronics Engineers Inc.
ISBN(电子版)9798331515607
DOI
出版状态已出版 - 2025
活动44th IEEE/ACM International Conference on Computer-Aided Design, ICCAD 2025 - Munich, 德国
期限: 26 10月 202530 10月 2025

出版系列

姓名IEEE/ACM International Conference on Computer-Aided Design, Digest of Technical Papers, ICCAD
ISSN(印刷版)1092-3152

会议

会议44th IEEE/ACM International Conference on Computer-Aided Design, ICCAD 2025
国家/地区德国
Munich
时期26/10/2530/10/25

联合国可持续发展目标

此成果有助于实现下列可持续发展目标:

  1. 可持续发展目标 7 - 经济适用的清洁能源
    可持续发展目标 7 经济适用的清洁能源

学术指纹

探究 'BARQ: Boundary-Aware Regularized Training for Accurate Inference on Computing-in-Memory Accelerators with Low-Precision A/D Conversion' 的科研主题。它们共同构成独一无二的学术指纹。

引用此