The synthesis and self-assembly of a polymer featuring a self-complementary supramolecular binding motif guanidiniocarbonyl pyrrole carboxylate zwitterion (GCP-zwitterion) bearing lactose moieties are reported. The GCP-zwitterion acts as a cross-linker to facilitate self-assembly of the polymeric chain into nanoparticles (NPs) at neutral pH in an aqueous medium. The formation of polymeric NPs can be controlled by addition of external stimuli (acid or base), which disfavors self-assembly of the GCP-zwitterion because of protonation or deprotonation of the GCP units in the polymer chain. The small-sized (<40 nm) NPs have a hydrophobic cavity and accessible lactose units on the outer shell for multivalent lectin binding. The multivalent interaction between NPs and the lectin peanut agglutinin was confirmed by agglutination experiments. In addition, the stimuli-responsive property of NPs was exploited for the uptake and release of a hydrophobic guest Nile red. Furthermore, the selectivity toward different cell lines (HEK 296T, HeLa, and Hep2G) was tested, and a cellular uptake of cargo-loaded NPs was found for Hep2G cells bearing the lactose-specific asialogylcoprotein receptor, whereas all other cells showed no NP interaction.