To solve the problem that target tracking only based on color cue always fails under complex background,a multi-cue fusing tracking algorithm is presented based on particle filter. Histogram of color is global description to targets,while histogram of oriented gradients contains some construction information. So they can complement each other,and target is represented by both histogram of color and histogram of oriented gradients in our algorithm. Color and gradient information are fused and updated online under the frame of particle filter. Experiments show that the proposed method provides more reliable result and robustness.