Design and Exploration of a Computer Vision Based Unmanned Aerial Vehicle for Railroad Health Applications

Railroad tracks require consistent and periodic monitoring to ensure safety and reliability. Unmanned Aerial Vehicles (UAVs) have great potential because they are not constrained to the track, allowing trains to continue running while the UAV is inspecting. Also, they can be quickly deployed without human intervention. For these reasons, the first steps towards creating a track-monitoring UAV system have been completed.

This thesis focuses on the design of algorithms to be deployed on a UAV for the purpose of monitoring the health of railroad tracks. Before designing the algorithms, the first steps were to design a rough physical structure of the final product. A small multirotor or fixed-wing UAV will be used with a gimbaled camera mounted on the belly. The camera will take images of the tracks while the onboard computer processes the images. The computer will locate the tracks in the image as well as perform defect detection on those tracks.

Algorithms were implemented once a rough physical structure of the product was completed. These algorithms detect and follow rails through a video feed and detect defects in the rails. The rail following algorithm is based on a custom-designed masking technique that locates rails in images. A defect detection algorithm was also created. This algorithm detect defects by analyzing gradient data on the rail surface.