Because of the difference of the grey value and the distortion between the object image and the reference image, traditional matching method will be degraded, and more useful characters are needed. In this paper, a new image matching method based on a novel distance measurement is proposed. Firstly it defines a novel similarity measurement from the thought of the Hausdorff distance measurement. It counts not only the distance of the grey level of the two images, but also the number of the similar points in the two images. Then the measurement method is applied in the image matching. The experimental results show that this image matching method could bear much image distortion and it is very promising.