Improvement of the mechanical properties of adhesives and adhesive joints has been a subject of great interest in recent years. Up to now, several methods have been presented such as modifying substrate shapes, adding microparticles (MPs) and nanoparticles (NPs), and embedding micro and macrofibers in the adhesive layer. This review aims to investigate how these reinforcements of different scales in the adhesive layer influence the mechanical properties of adhesive joints and adhesives. Characteristics and applications of reinforcements are introduced in the first part. In the second part, the effects of several parameters commonly investigated by researchers on the strength, stiffness and fracture toughness improvement of polymeric materials are reviewed for reinforcements of different scales. Finally, damage mechanisms involved in increasing or decreasing the mechanical properties are reviewed and discussed.