Development and analysis of a small-scale controlled dataset with various weather conditions, lighting, and route types for autonomous driving

This study addresses the limitations of existing autonomous vehicle datasets, particularly the need for greater specificity of weather conditions and road types. We utilized X-CAR to highlight the challenges of extreme weather and non-urban road conditions on autonomous driving systems. Our dataset comprises recordings under seven distinct weather and lighting conditions across four road types. Notably, our research focuses on differentiating between various lighting and weather conditions and road types, which often need improvement in many existing datasets. We used the X-CAR platform to collect 360-degree image information and LiDAR point clouds at 10Hz. Due to the constraints of time and resources, we used algorithmic prediction to generate ground truth data via the Co-DETR 2D prediction algorithm. We validated the accuracy of the Co-DETR algorithm through partial manual annotation. However, it is undeniable that in some extreme conditions, the algorithm-generated ground truth can lead to results deviating from expectations and real-world situations. Therefore, we conducted a scaled manual annotation and controlled experiments, ensuring the highest level of accuracy. After the manual annotation, we validated our initial conclusions and trained a model based on YOLOv8x, focusing on weak environmental conditions. The final model underwent multiple iterations and achieved satisfactory accuracy. The enhanced model demonstrated a significant increase in detection accuracy compared to the original YOLOv8x model. At the same time, our analysis identifies weather conditions that markedly reduce detection accuracy, providing focal points for future dataset enhancements.