Manipulation of spectral dynamics of single molecules (SM) by a metallized scanning probe tip is demonstrated. The Stark effect of the zero-phonon lines of single pentacene molecules in a p-terphenyl host at 1.8 K is investigated by applying a voltage to the tip in contact with the sample. The measured Stark shifts exhibit a plateau and the line widths depend on the electric field. These anomalies are explained by a model based on two-level systems with field-dependent double-well potentials. The experimental data show that the two-level systems are induced by the tip.