To obtain a good bonding strength of steel/CFRP adhesive joint, the steel surface was machined by grooving process. Short aramid fibers were mixed into the adhesive layer to achieve the further adhesion strength. In the pressing process of steel/CFRP specimen preparation, short aramid fibers with the diameter of several micrometers could be embedded in the grooved gap and the rough surface of CFRP. The higher strength aramid fibers had been not only improved interfacial strength of steel/epoxy and CFRP/epoxy, but also reinforced the adhesive layer due to the bridging activities of aramid fibers. In this study, Mode II fracture strength of grooved-steel/CFRP adhesive joints was investigated by end-notch bending test. The ultimate load and fracture energy of specimens have been improved by 15.7 and 6.8%, in comparison to specimens with smooth steel surface, respectively. The reinforcing mechanisms of CFRP/steel bonding joint as a result of short aramid fibers were discussed according to the failure modes of specimens, and scanning electron microscopy observation and experimental results were carried out.