The reflection matrix optical coherence tomography (RM-OCT) method has made significant progress in extending imaging depth within scattering media. However, the current method of measuring the reflection matrix (RM) through uniform sampling results in relatively long data collection time. This study demonstrates that the RM in scattering media exhibits sparsity. Consequently, a compressed sensing (CS)-based technique for measuring the RM is proposed and applied to RM-OCT images. Experimental results show that this method requires less than 50% of the traditional sampling data to recover target information within scattering media, thereby significantly reducing data acquisition time. These findings not only expand the theory of the RM but also provide a more efficient measurement approach. This advancement opens up broader applications for CS techniques in RM-OCT and holds great potential for improving imaging efficiency in scattering media.