To reduce the polarization beat length wavelength sensitivity in birefringence holey fiber so as to produce a stable broadband fiber-optic polarizer, a holey fiber cladding structure design with a rectangular array distribution of air holes in cladding is presented. Asymmetric structures with different birefringence trends are introduced into the cladding. The influence of different structural parameters on the polarization beat length stability is calculated and analyzed by the full vector beam propagation method, including the material dispersion of fused silica. The results show that the fiber cladding structure reduces the sensitivity of the polarization beat length to the wavelength. In the wavelength of 1.26~1.60 [μm], the relative change in polarization beat length is less than ± 4% and the broadband stability requirements for producing optical wave plate are met. Moreover, the optimized geometrical cladding structure has a large error tolerance, further reducing the difficulty of fabrication.