Nanoparticles have attracted enormous attention for biomedical applications as optical labels, drug-delivery vehicles and contrast agents in vivo. In the quest for superior photostability and biocompatibility, nanodiamonds are considered one of the best choices due to their unique structural, chemical, mechanical and optical properties. So far, mainly fluorescent nanodiamonds have been utilized for cell imaging. However, their use is limited by the efficiency and costs in reliably producing fluorescent defect centres with stable optical properties. Here, we show that single non-fluorescing nanodiamonds exhibit strong coherent anti-Stokes Raman scattering (CARS) at the sp(3) vibrational resonance of diamond. Using correlative light and electron microscopy, the relationship between CARS signal strength and nanodiamond size is quantified. The calibrated CARS signal in turn enables the analysis of the number and size of nanodiamonds internalized in living cells in situ, which opens the exciting prospect of following complex cellular trafficking pathways quantitatively.