According to the characteristics of directional polarimetric camera optical system, the ghost distribution characteristics of the instrument was analyzed. The optical working surface that could produce severe ghost images was determined through the optical design software CodeV combined with ZEMAX, and the ghost image of the experimental measurement was marked. On this basis, using the relationship between ghost image system distortion and field of view, polynomial fitting method was used to obtain the full-field ghost image position and deformation of the instrument. The energy ratio between the original image and the ghost image was determined by the measured image, and the ghost correction model of the full field of view of the instrument was established. Finally, the unsaturated and supersaturated images were corrected. The results show that the proposed correction method can eliminate at least 90% of ghost.