In order to reduce the adverse effects of waste rubber landfill on the environment, in this paper, crushed rubber as fine aggregate was mixed into mortar and experiments were conducted on the effects of different substitution ratios of rubber particles (NR20) and rubber fibers (NRS) on the workability, mechanical properties, and impact resistance of manufactured sand mortar. The results show that as the rubber substitution ratio increases, the consistency of rubber particle mortar gradually increases, and the delamination degree gradually decreases, while the consistency of rubber fiber mortar decreases first and then remains basically unchanged, and the delamination degree gradually increases. In addition, the compressive and flexural strength of rubber mortar decrease with the increase of rubber substitution ratio, and the compressive and flexural strength of rubber fiber mortar is higher than that of rubber particle mortar. Rubber changes the impact failure mode of mortar from single crack to multiple crack. The more rubber is added to the mortar, the higher the impact energy consumption for impact failure required is, and the impact energy consumption of rubber fiber mortar is higher than that of rubber particle mortar.