A new adaptive method of multi-spectral image and panchromatic image is presented. The experiment results show that the new method can not only reach minimized color distortion and maximized spatial detail, but also have adaption in all kinds of images.