Roughly, visual tracking algorithms can be divided into two main classes: deterministic tracking and stochastic tracking. Mean shift and particle filter are their typical representatives, respectively. Recently, a hybrid tracker, seamlessly integrating the respective advantages of mean shift and particle filter (MSPF) has achieved impressive success in robust tracking. The pivot of MSPF is to sample fewer particles using particle filter and then those particles are shifted to their respective local maximum of target searching space by mean shift. MSPF not only can greatly reduce the number of particles that particle filter required, but can remedy the deficiency of mean shift. Unfortunately, due to its inherent principle, MSPF is restricted to those applications with little changes of the target model. To make MSPF more flexible and robust, an adaptive target model is extended to MSPF in this paper. Experimental results show that MSPF with target model updating can robustly track the target through the whole sequences regardless of the change of target model.