Diabetes has been cited as the most challenging health problem in the twenty-first century. Accordingly, it is urgent to develop a new type of efficient and low-toxic antidiabetic medication. Since vanadium compounds have insulin-mimetic and potential hypoglycemic activities for type 1 and type 2 diabetes, a new trend has been developed using vanadium and organic ligands to form a new compound in order to increase the intestinal absorption and reduce the toxicity of vanadium compound. In the current investigation, a new organic vanadium compounds, vanadyl rosiglitazone, was synthesized and determined by infrared spectra. Vanadyl rosiglitazone and three other organic vanadium compounds were administered to the diabetic mice through oral administration for 5 weeks. The results of mouse model test indicated that vanadyl rosiglitazone could regulate the blood glucose level and relieve the symptoms of polydipsia, polyphagia, polyuria, and weight loss without side effects and was more effective than the other three organic vanadium compounds including vanadyl trehalose, vanadyl metformin, and vanadyl quercetin. The study indicated that vanadyl rosiglitazone presents insulin-mimetic activities, and it will be a good potential candidate for the development of a new type of oral drug for type 2 diabetes.