A novel adaptive image enhancing fusion algorithm which is used to fuse visible and infrared image is presented. At first, the new algorithm performs adaptive enhancement of visible and infrared image. Then, the fused image is constructed based on spatial local energy and local normalized correlation measure. The fusion performance is estimated using entropy. Experimental results of visible and infrared image fusion are given, which show that the proposed method is effective and fused image can provide more complementary information for personnel and target recognition.