In order to realize the rapid measurement of composite surfaces with diffuse and mirror reflection, the composite surface measurement system based on fringe projection and fringe reflection can obtain the absolute phase rapidly through the multi-color channel of the camera. Aiming at the crosstalk and chromatic aberration between the color channels introduced by the camera, projector, and display in the composite surface topography measurement, this paper studies the crosstalk elimination method based on the matrix and the chromatic aberration elimination method of the absolute phase corresponding pixel deviation. Based on the crosstalk matrix, the crosstalk matrix of the projector and display screen is established. The crosstalk intensity from other channels in the desired color channel is eliminated to complete the crosstalk elimination between color channels. The absolute phase in the horizontal and vertical directions of each color channel is obtained by color orthogonal stripes. The relationship between phase difference and pixel deviation is established to realize the pixel deviation correction of each pixel point and eliminate the influence of color difference. The experimental results show that the proposed method reduces the average measurement error of the composite step from 0.479 mm to 0.030 mm, and improves the efficiency and accuracy of measurement.