At sufficiently high frequency and low temperature, the dielectric responses of glassy, crystalline, and molten ionic conductors all invariably exhibit nearly constant loss. This ubiquitous characteristic occurs in the short-time regime when the ions are still caged, indicating that it could be a determining factor of the mobility of the ions in conduction at longer times. An improved understanding of its origin should benefit the research of ion conducting materials for portable energy source as well as the resolution of the fundamental problem of the dynamics of ions. We perform molecular dynamics simulations of glassy lithium metasilicate (Li2SO3) and find that the length scales of the caged Li+ ions motions are distributed according to a Levy distribution that has a long tail. These results suggest that the nearly constant loss originates from "dynamic anharmonicity" experienced by the moving but caged Li+ ions and provided by the surrounding matrix atoms executing correlated movements. The results pave the way for rigorous treatments of caged ion dynamics by nonlinear Hamiltonian dynamics. (C) 2004 American Institute of Physics.