The paper reported the comparison of recognition for tomato surface color and internal color by spatially resolved and conventional single point visible and near infrared (SP Vis/NIR) spectroscopy. Spatially resolved (SR) spectra and SP Vis/NIR spectra were acquired using the newly spatially resolved spectroscopy system (wavelength: 550~1 650 nm), the portable Vis/NIR spectrometer (wavelength: 400~1 100 nm) and the portable NIR spectrometer (wavelength: 900~1 700 nm), for 600 “Sun Bright” tomatoes with six color stages (green, breaker, turning, pink, light red and red), based on their surface and internal color distribution, respectively. Partial least squares discriminant analysis (PLSDA) models for SR spectra and SP Vis/NIR spectra were developed and compared. The results showed combination of the SR spectra could further improve the classification of tomato color based on optimal single SR spectra, with classification accuracy for surface and internal color of 98.8% and 84.6%, respectively. The SR spectra with short source-detector distance were useful for recognition of tomato surface color, while SR spectra with large source-detector distance could better assess tomato internal color. The NIR spectra were comparable with SR spectra for tomato surface recognition with classification accuracy of 95%, however, SP Vis/NIR spectra could not evaluate tomato internal color accurately, and the classification accuracy was much lower than that of SR spectra, which indicated that SR spectra have great potential for the recognition of tomato color.