Molecular understanding of neutralizing antibody responses to severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) could accelerate vaccine design and drug discovery. We analyzed 294 anti-SARS-CoV-2 antibodies and found that immunoglobulin G heavy-chain variable region 3-53 (IGHV3-53) is the most frequently used IGHV gene for targeting the receptor-binding domain (RBD) of the spike protein. Co-crystal structures of two IGHV3-53-neutralizing antibodies with RBD, with or without Fab CR3022, at 233- to 3.20 -angstrom resolution revealed that the germline-encoded residues dominate recognition of the angiotensin I converting enzyme 2 (ACE2)-binding site. This binding mode limits the IGHV3-53 antibodies to short complementarity-determining region H3 loops but accommodates light-chain diversity. These IGHV3-53 antibodies show minimal affinity maturation and high potency, which is promising for vaccine design. Knowledge of these structural motifs and binding mode should facilitate the design of antigens that elicit this type of neutralizing response.