AC arc faults are one of the most important causes of residential electrical wiring fires, which may produce extremely high temperatures and easily ignite surrounding combustible materials. The global interest in machine learning-based methods for arc fault diagnosis applications is increasing due to continuous challenges in efficiency and accuracy. In this paper, a temporal domain visualization convolutional neural network (TDV-CNN) methodology is proposed. The current transformer and high-speed data acquisition system are used to collect the current of a series of arc faults, then the signal is filtered by a digital filter and converted into a gray image in time sequence before being fed into TDV-CNN. Five different electric loads were selected for experimental validation with various signal characteristics, including vacuum cleaner, fluorescent lamp, dimmer, heater, and desktop computer. The experimental results confirm that the classification accuracy of the five loads’ work states in the ten categories could reach 98.7% or even higher by adjusting parameters perfectly. The methodology is believed to be reliable for series arc detection with relatively high accuracy and also has important potential applications in other fault diagnosis fields.