1. 中国科学技术大学 精密与智能化学重点实验室 精密机械与精密仪器系,安徽,合肥,230026
2. 中国科学技术大学 先进技术研究院,安徽,合肥,230088
纸质出版:2025
移动端阅览
胡俊伟, 何海洋, 雷英佳, 等. 双臂协作机器人的增强现实人机交互遥操作系统[J]. 传感器与微系统, 2025,44(11):87-92.
HU Junwei, HE Haiyang, LEI Yingjia, et al. Augmented reality human-robot interaction teleoperation system for dual-manipulator cooperative robot[J]. 2025, 44(11): 87-92.
针对双臂协作机器人遥操作系统在复杂场景作业中感知较为薄弱的问题,提出了一种利用增强现实(AR)和数字孪生(DT)技术的人机交互(HRI)遥操作系统。引入力反馈数据手套以增强力触觉,实现对双臂协作机器人的精细遥操作控制;采用手眼相机和Instant-NGP算法对机器人作业目标进行三维重建,并基于标记定位的方法实现重建模型与机器人DT模型的AR三维注册,实现视觉上的增强。同时,根据人与机器人是否处于同一场景空间,开发了两种HRI模式,包括远程操作模式和近程操作模式,以实现虚拟机器人与真实机器人之间的闭环控制。实验结果表明:本系统能够安全、高效、稳定地处理双臂协作机器人的HRI遥操作任务。
In order to solve the problem that the perception of the dual-manipulator cooperative robot teleoperation system is weak in the complex scene operation
a human-robot interaction(HRI)teleoperation system using augmented reality(AR)and digital twin(DT) technology is proposed.The force feedback data glove is introduced to enhance kinesthetic feedback and realize the fine teleoperation control of the dual-manipulator cooperative robot.The hand-eye camera and Instant-NGP algorithm are used for three-dimensional reconstruction of the robot operation target
and the AR three-dimensional registration of the reconstructed model and DT model of robot is realized based on mark positioning method
so as to achieve visual enhancement.At the same time
according to whether the human and the robot are in the same scene space
two HRI modes are developed
including the remote operation mode and the short-distance operation mode
to realize the closed-loop control between the virtual robot and the real robot.The experimental results show that the system can handle the HRI teleoperation task of dual-manipulator cooperative robot safely
efficiently
and stably.
0
浏览量
0
下载量
0
CSCD
关联资源
相关文章
相关作者
相关机构
京公网安备11010802024621