HUANG Man, HUANG Bo, GAO Yongbin. 3D target detection incorporating with depth completion and instance segmentation[J]. 2021, 40(1): 129-132. DOI: 10.13873/J.1000-9787(2021)01-0129-04.
引入深度补全与实例分割的三维目标检测
摘要
三维目标检测是自动驾驶系统与机器人系统的关键技术
目前对该技术的研究大多基于深度相机获取的RGB-D图
但在室外自动驾驶场景中
输入雷达点云更符合三维目标检测系统的应用环境。以RGB图与雷达点云为输入
结合IP-Basic算法在消除噪声的同时将稀疏雷达点云补全成稠密深度图;采用降维原理
结合Mask R-CNN在RGB图上进行实例分割
进而提取目标在深度图上的对应区域;结合点云的自然不变性
将目标对应深度图转化为点云后输入到卷积神经网络进行特征学习。在公开数据集Kitti上进行实验
实验结果表明:该方法在公开三维目标检测数据集上达到了较好的检测精度。
Abstract
3 D target detection is the key technology of autopilot system and robot system.At present
most of the research on this technology is based on the RGB-D image obtained by camera.However
in practical application scenarios
the input radar point cloud is more suitable with the 3D object detection system application environment.RGB image and radar point cloud are used as input
and the IP-Basic algorithm is used to eliminate the noise and fill the sparse radar point cloud into a dense depth map.According to the principle of dimensionality reduction
the instance is segmented on the RGB image with Mask R-CNN
and the corresponding region of the target on the depth map is extracted according to the segmentation instance.Combined with the natural invariance of the point cloud
the depth map corresponding to the target is converted into the point cloud which will be inputted into the convolutional neural network for feature learning.Experimental result on public datasets Kitti show that the proposed method achieves good detection precision on the public 3D target detection datasets.