Archive | 2021
Pedestrian detection and positioning for component hoisting based on millimeter wave radar and monocular vision sensor
Abstract
Aiming at the problem that it is difficult to accurately detect and locate pedestrians due to high air dust concentration and low visibility at the construction site lifting equipment, a pedestrian detection and positioning method based on monocular vision combined with millimeter wave radar is proposed. This method inputs the RGB image obtained by the monocular camera into the YOLOv4 algorithm to achieve pedestrian target detection. The distance information of the obstacle obtained by the millimeter wave radar and the pixel coordinate information of the pedestrian obstacle target obtained by the monocular camera are used for information fusion, and then it based on the positioning principle of monocular vision realizes the spatial positioning of pedestrian targets. Experimental results show that the accuracy and recall rates of pedestrian detection reach 94.09% and 93.52%, respectively, which are higher than 90.79% and 89.13% of the YOLOv3 algorithm, and the detection speed reaches 65 FPS; the relative error of pedestrian positioning in the lateral distance is 3.52%. The method is accurate and rapid, and can better realize real-time pedestrian detection and positioning in the hoisting equipment site.