Noise will be caused because of the disturbance to the transmission fiber. The Michelson fiber interferometer is used to simulate the optical fiber hydrophone, and a remote optical fiber hydrophone system is built. The reference interferometer demodulation is used to suppress the noise caused by the transmission fiber. The experimental results show that compared with the phase generated carrier (PGC) demodulation, the ability to detect acoustic signal is not reduced by using the reference interferometer demodulation. A broadband noise caused by disturbing the transmission fiber is suppressed by maximal 25 dB at 500 Hz, and the ground noise is suppressed by 17 dB at 100 Hz.