Due to the image distortion of the infrared ultra-wide angle system is large, the diffraction is obvious and the precision of traditional calibration method is not high, this article puts forward a kind of infrared ultra-wide angle image distortion centre calibration method based on the high odd-order polynomial model. The calibration method is designed by analyzing the radial and the tangential magnification of the small circular target. The ellipse equation is used to fit the target image, then two dimensional Gauss surface fitting is based on the ratio of the elliptical long and short axis as the objective function. Finally, the center of Gauss surface is regarded as the centre of distortion. The experimental results show that the calibration accuracy of the proposed method are 0.77 pixels and 1.02 pixels respectively. The distorted image is corrected by this calibration result. In the corrected image, the maximum root-mean-square-error of the line is 1.56 pixels. The experiment verifies the accuracy of the proposed infrared ultra-wide angle image center calibration method, which meets the requirements of the infrared ultra-wide angle image distortion center calibration.