针对现阶段外骨骼机器人轨迹运动时出现效果不佳的问题,提出了基于优先经验回放与分区奖励(PERDA)融合的深度确定性策略梯度(DDPG)强化学习算法,即PERDA-DDPG。该方法利用时间差分误差(TD-errors)的大小对经验排序,改变了原始采样的策略。此外,相较于以往二值奖励函数,本文根据物理模型提出针对化的分区奖励。在Open AI Gym平台上实现仿真环境,实验结果表明:改进的算法收敛速度提升了约9.2%
学习过程更加稳定。
Abstract
关键词
Keywords
references
Adaptive integral terminal sliding mode control for upper-limb rehabilitation exoskeleton[J]. A. Riani;T. Madani;A. Benallegue;K. Djouani.Control Engineering Practice,2018
Design and Adaptive Control for an Upper Limb Robotic Exoskeleton in Presence of Input Saturation.[J]. He Wei;Li Zhijun;Dong Yiting;Zhao Ting.IEEE transactions on neural networks and learning systems,2018
Adaptive Impedance Control for an Upper Limb Robotic Exoskeleton Using Biological Signals[J]. Li Zhijun;Huang Zhicong;He Wei;Su Chun Yi.IEEE Transactions on Industrial Electronics,2017
Robotics-Assisted Mirror Rehabilitation Therapy: A Therapist-in-the-Loop Assist-as-Needed Architecture[J]. Shahbazi, Mahya;Atashzar, Seyed Farokh;Tavakoli, Mahdi;Patel, Rajni V..IEEE/ASME transactions on mechatronics: A joint publication of the IEEE Industrial Electronics Society and the ASME Dynamic Systems and Control Division,2016
Assist-as-needed robotic trainer based on reinforcement learning and its application to dart-throwing[J]. Chihiro Obayashi;Tomoya Tamei;Tomohiro Shibata.Neural Networks,2014
Experience Replay for Real-Time Reinforcement Learning Control.[J]. Sander Adam;Lucian Busoniu;Robert Babuska.IEEE Trans. Systems, Man, and Cybernetics, Part C,2012
Rewarded Outcomes Enhance Reactivation of Experience in the Hippocampus[J]. Annabelle C. Singer;Loren M. Frank.Neuron,2009
Non-Gaussian Ornstein-Uhlenbeck-Based Models and Some of Their Uses in Financial Economics[J]. Ole E. Barndorff-Nielsen;Neil Shephard.Journal of the Royal Statistical Society. Series B (Statistical Methodology),2001