The objective of this project was to explore how an autonomous vehicle identifies and safely responds to emergency vehicles using visual and other onboard sensors. Emergency vehicles can include police, fire, hospital and other responders’ vehicles. An autonomous vehicle in the presence of an emergency vehicle must have the ability to accurately sense its surroundings in real-time and be able to safely yield to the emergency vehicle. This project used machine learning algorithms to identify the presence of emergency vehicles, mainly through onboard vision, and then maneuver an in-path non-emergency autonomous vehicle to a stop on the curbside. Two image processing frameworks were tested to identify the best combination of vision-based detection algorithms, and a novel lateral control algorithm was developed for maneuvering the autonomous vehicle.