The gnathostome (jawed vertebrate) crown group comprises two extant clades with contrasting character complements. Notably, Chondrichthyes (cartilaginous fish) lack the large dermal bones that characterize Osteichthyes (bony fish and tetrapods). The polarities of these differences, and the morphology of the last common ancestor of crown gnathostomes, are the subject of continuing debate. Here we describe a three-dimensionally preserved 419-million-year-old placoderm fish from the Silurian of China that represents the first stem gnathostome with dermal marginal jaw bones (premaxilla, maxilla and dentary), features previously restricted to Osteichthyes. A phylogenetic analysis places the new form near the top of the gnathostome stem group but does not fully resolve its relationships to other placoderms. The analysis also assigns all acanthodians to the chondrichthyan stem group. These results suggest that the last common ancestor of Chondrichthyes and Osteichthyes had a macromeric dermal skeleton, and provide a new framework for studying crown gnathostome divergence.