Purpose Autonomous driving depends on the collection, processing and analysis of environmental information and vehicle information. Environmental perception and processing are important prerequisite for the safety of self-driving of vehicles; it involves road boundary detection, vehicle detection, pedestrian detection using sensors such as laser rangefinder, video camera, vehicle borne radar, etc. Design/methodology/approach Subjected to various environmental factors, the data clock information is often out of sync because of different data acquisition frequency, which leads to the difficulty in data fusion. In this study, according to practical requirements, a multi-sensor environmental perception collaborative method was first proposed; then, based on the principle of target priority, large-scale priority, moving target priority and difference priority, a multi-sensor data fusion optimization algorithm based on convolutional neural network was proposed. Findings The average unload scheduling delay of the algorithm for test data before and after optimization under different network transmission rates. It can be seen that with the improvement of network transmission rate and processing capacity, the unload scheduling delay decreased after optimization and the performance of the test results is the closest to the optimal solution indicating the excellent performance of the optimization algorithm and its adaptivity to different environments. Originality/value In this paper, the results showed that the proposed method significantly improved the redundancy and fault tolerance of the system thus ensuring fast and correct decision-making during driving.