跳到主要导航 跳到搜索 跳到主要内容

A meta-learning-guided TD3 control algorithm with adaptive experience replay for active vibration isolator

  • Weipeng Li*
  • , Haohui Li
  • , Xiaoguang Ren
  • , Zeshu Liu
  • , Yi Cui
  • *此作品的通讯作者
  • Beihang University
  • Academy of Military Medical Science China

科研成果: 期刊稿件文章同行评审

摘要

Structural vibration control is essential in aerospace, civil engineering, and electromechanical systems, yet the performance of conventional methods often degrades in nonlinear or time-varying environments owing to their strong dependence on accurate system models. Deep reinforcement learning (DRL) offers high adaptability and can effectively address these issues, but it typically suffers from low sample efficiency and unstable convergence. To overcome these limitations, this study proposes Meta-Twin Delayed Deep Deterministic Policy Gradient (Meta-TD3), a meta-learning-enhanced DRL framework. A Meta-Adaptive Experience Evaluator (MAEE) is introduced to assess transition utility through a nonlinear feature-to-priority mapping. Building on TD-error information, MAEE down-weights high-uncertainty transitions and maximizes entropy to preserve sampling diversity, enabling more reliable prioritization than PER-based methods. In the Hopper benchmark, Meta-TD3 achieves substantially faster convergence, requiring 52.3% fewer steps than TD3 and 17.6% fewer than PER-TD3, while also exhibiting improved training stability. For an active vibration isolation task on a single-degree-of-freedom platform, Meta-TD3 reduces peak vibration by 65% in simulations and 60% in experiments, and reduces RMS acceleration by 25.58% in simulations and 24.86% in experiments. Moreover, compared with the conventional Skyhook controller, Meta-TD3 delivers approximately 30% better suppression in fixed-frequency tests and enhances RMS reduction in sweep-frequency tests, demonstrating superior vibration attenuation under both operating conditions. These results demonstrate that Meta-TD3 enhances sample efficiency, improves stability, and provides a flexible and effective reinforcement learning-based framework for active vibration suppression in complex structural systems.

源语言英语
期刊论文编号104672
期刊Advanced Engineering Informatics
74
DOI
出版状态已出版 - 9月 2026

学术指纹

探究 'A meta-learning-guided TD3 control algorithm with adaptive experience replay for active vibration isolator' 的科研主题。它们共同构成独一无二的学术指纹。

引用此