The Retinex models the human visual system to perceive natural colors, which could improve the contrast and sharpness of the degraded image and also provide color constancy and dynamic range simultaneously. This endows the Retinex exceeding advantages for enhancing the underwater image. Based on the multi-scale Retinex, an efficient enhancement method for underwater image and video is presented in this paper. Firstly, the image is pre-corrected to equalize the pixel distribution and reduce the dominating color. Then, the classical multi-scale Retinex with intensity channel is applied to the pre-corrected images for further improving the contrast and the color. In addition, multi-down-sampling and infinite impulse response Gaussian filtering are adopted to increase processing speed. Subsequently, the image is restored from logarithmic domain and the illumination of the restored image is compensated based on statistical properties. Finally, the color is selectively preserved by the inverted gray world method depending on imaging conditions and application requirements. Five kinds of typical underwater images with green, blue, turbid, dark and colorful backgrounds and two underwater videos are enhanced and evaluated on Jetson TX2, respectively, to verify the effectiveness of the proposed method.