The crystals of [C5NH6](+)[AuCl4](-), [C5NH6](+)[AuBr4](-), and [C5NH6](+)[AuI4](-) have been studied by singlecrystal X-ray diffraction and dielectric spectroscopy. The structures of the chloride and bromide are isosymmetric, with the monoclinic space group C2/m, and both are built of sheets of pyridinium cations and tetrahalogenoaurate anions alternately arranged in the direction [001]. The anomalous thermal expansion and dielectric response characteristic of dipolar glass formation observed in these compounds have been interpreted in terms of the development of the short-range dipolar order and the competition between the ferroelectric and antiferroelectric interactions. The frustration of dipolar interactions, leading to glassy behavior, results from the strongly anisotropic properties of the layered crystal structure. These features have not been observed for [C5NH6](+)[AuI4](-), which crystallizes in the space group P2(1)/c and exhibits a nonlayered structural packing because of the larger size of the anion.