In order to solve the problem of color anomalies in digital video images obtained by photoelectric tracking equipment, a design and research on the automatic color matching system for digital video images of photoelectric tracking equipment is proposed. Design a digital video image acquisition module for photoelectric tracking equipment, collect and store digital video images of photoelectric tracking equipment, apply filtering algorithms to remove image noise, use Mean Shift algorithm to segment and extract image color information, debug and process the color boards of corresponding color blocks, and achieve automatic color matching of digital video images. The experimental data shows that under different experimental conditions, the maximum completeness of color information extraction in the design system image is 100%, and the automatic matching results of image colors are closer to the color information in the template image, fully confirming that the design system has better application performance.