For the particle′s sampling and optimization of particle filter in video object tracking,an adaptive layered-sampling auxiliary particle filter is proposed to realize the tracking precision and robustness′s requirement.A function which adjusts the particle amount is designed based on the Baattacharyya coefficient.According to the tracking quantity,it can allocate the particles keeping precision and the particles keeping robustness adaptively in the particle set.A predicted point of object-moving based on the LSM (least square method) algorithm is used to be the origin to do the meanshift operation.By this operation,the new particle set is made,it will be better to describe the object′s likelihood distribution and improve the algorithm efficiency.The tracking experiments under different enviroments demonstrate that this algorithm can achieve better tracking performance in presence of occlusion and object-moving in slow and variable direction,the consuming time is up to the requiment of real-time performance.