In this paper, a temperature sensor based on the splicing of a core offset multi-mode fiber with two single mode fibers is proposed and demonstrated experimentally. The temperature sensing principle is analyzed and related experiment is performed. By controlling the core offset and splicing length of the specialty multi-mode fiber (SMMF), two sensors with different temperature sensing properties are obtained, and experimental results show that the temperature sensitivity can be up to 48.76 pm/°C in the range of 25—95 °C. Moreover, it has many advantages, including small size, high sensitivity, and simple structure. So it can be used in potential temperature sensing applications, such as industrial production, biomedical science, power electronics, and so on.