Feature-based motion detection and tracking on approximate 3D ground plane

Abstract

The success of movement detection based on the distance moved in a 2D image sequence depends highly on the angle between a camera's optical axis and the normal vector of the ground plane on which the moving object is traveling. When the same 3D displacement occurs at various positions in the scene, the higher the angle is, the greater the distance observed in the image at a position close to camera differs from (strictly speaking, is larger than) those happening at the far end. As a consequence, a detection failure and/or false alarm may occur if no such 3D geometry is utilized. This paper estimates a 3D ground plane, which is then used to measure the approximate 3D displacement of features being detected and tracked. The 3D distances are therefore available and utilized in deciding whether they are of moving objects or just blinking features caused by illumination changes. FAST points are used to enhance a real-time system. Experimental results show superior performance in tracking: a longer trace of continuous tracking, a higher number of detected moving features, earlier detection, better recall rate, no misses, and no false alarms. A SURF descriptor and FLANN matcher were utilized here, however the robustness was not much enhanced when compared to the expense of finding the best match.