The directional polarimetric camera is a polarization sensor that offers an ultrawide angle and low-distortion imaging. Stray light is one of the important factors affecting the accuracy of its polarization measurement. In this paper, the stray light of the directional polarimetric camera is first divided into local stray light and global stray light according to the characteristics of its optical system, and the causes and characteristics of the two kinds of stray light are analyzed. Second, a novel deconvolution method is proposed to correct the local stray light, and the matrix method is extended to a 2D form to correct the global stray light. Finally, image acquisition and stray light correction laboratory experiments of integrating a sphere light source were carried out. The experimental results show that the proposed correction methods can effectively suppress more than 94% of the stray light of the directional polarimetric camera.