An approach to the location of the sun and meridian by means of the Rayleigh skylight polarization pattern was introduced, given that the polarized-light-aided navigation relys heavily on the position of some astronomical markers. Combining with the theoretical analysis based on the single Rayleigh scattering theory, the skylight polarization pattern was practically detected the using the polarization analyzer. Then, with respect to the distribution stability of the polarization pattern, the information collected was clustered to locate the position of the sun with the polarization degree data, and that of the solar meridian with the E-vector data respectively. In this way, the location problem was changed to figure out the clustering center. Finally, the approach was tested through experiments on the theoretical and practical detected polarization pattern. Compared with the way of obtaining the solar location by the least square method, this approach can effectively take use of the stable distribution of the polarization pattern, locate the accurate position of astronomical marker based on the polarization information detected on a large scale, and skillfully process the captured data.