Atomistic computer simulations can provide insights into silicate glass-environment interactions with the recent development of reactive potentials. However, the accuracy of generated glass structures with these potential was usually not fully examined. In this paper, the capability of the reactive force field (ReaxFF) to describe the short and medium range structure features of sodium silicate glasses in molecular dynamics simulations is investigated by comparing a widely used partial charge pairwise potential and available experimental data. Glass structure information such as pair distribution function (PDF), coordination number, Q(n) species, neutron broadened structure factor, and X-ray broadened structure factor of the glass structures from ReaxFF simulations were calculated and compared to evaluate the generated glass structure. Advantages and limitations of the potentials and glass forming procedures, as well as areas of further improvement, were discussed. The results show that the recently refined ReaxFF parameters through the proposed procedure enable the simulations of sodium silicate glass structures with minimal defects, which paves the way to investigate water-glass interaction mechanisms with the reactive enabled potentials.