Polymeric nanoparticles with glucose-responsiveness under physiological conditions are of great interests in developing drug delivery system for the treatment of diabetes. Herein, glucose-responsive complex micelles were prepared by self-assembly of a phenylboronic acid-contained block copolymer PEG-b-P(AA-co-APBA) and a glycopolymer P(AA-co-AGA) based on the covalent complexation between phenylboronic acid and glycosyl. The formation of the complex micelles with a P(AA-co-APBA)/P(AA-co-AGA) core and a PEG shell was confirmed by HNMR analysis. The glucose-responsiveness of the complex micelles was investigated by monitoring the light scattering intensity and the fluorescence (ARS) of the micelle solutions. The complex micelles displayed an enhanced glucose-responsiveness compared to the simple PEG-b-P(AA-co-APBA) micelles and the sensitivity of the complex micelles to glucose increased with the decrease of the amount of P(AA-co-AGA) in the compositions. The cytotoxicity of the polymers and the complex micelles was also evaluated by MTT assay. This kind of complex micelles may be an excellent candidate for insulin delivery and may find application in the treatment of diabetes.