A frequency stabilized laser used in optically pumped cesium beam clocks is designed. The concise saturated absorption frequency stabilization system, in which the polarization direction of pumping laser is perpendicular to the polarization direction of probing laser, is utilized to lock laser frequency. The transition probability of the cesium atom is improved by the adjustment of the polarization direction of pumping laser. The amplitude of reference signal produced by the proposed system is higher than the signal produced by the simplified saturated absorption frequency stabilization system. When laser is locked at the frequency of the cycling transition 6S1/2, F=4→6P3/2, F=5 of cesium, the frequency stability is measured as 1.88×10－11 at 100 s. The setup of the system is compact, which is beneficial to the miniaturization and engineering of the optically pumped cesium beam clocks.