ViBe (Visual background extractor) algorithm is a motion target detection algorithm by background modeling, uses domain pixels for background modeling and updates the background model in real time. However, the traditional ViBe algorithm will produce disadvantages such as ghosting and shadow part false detection. This paper solves the problem of ghosting by image fusion mechanism, through the characteristics of the shadow itself, using the shadow part of the three-channel variance value for shadow detection and eliminate the shadow. The experiments show that our algorithm can quickly and effectively solve the ghost and shadow problems in the ViBe algorithm © COPYRIGHT SPIE. Downloading of the abstract is permitted for personal use only.