Interaction between water molecules and alkali metal ions in aqueous salt solutions has been studied by the oxygen K-edge soft X-ray absorption spectroscopy (XAS) in transmission mode. In the measurement of several alkali halide aqueous solutions with different alkali chlorides (Li, Na, and K) and different sodium halides (Cl, Br, and I), the pre-edge component arising from the hydration water molecules shows a blue shift in peak energy as strongly depending on cations but not on anions. In the temperature dependent measurement, the pre-edge component arising from water molecules beyond the first hydration shell shows the same behavior as that of pure liquid water. On the other hand, the pre-edge component arising from water molecules in the first hydration shell of Li+ ions is not evidently dependent on the temperature, indicating that the hydration water molecules are more strongly bound with Li+ ions than the other water molecules. These experimental results are supported by the results of radial distribution functions of the first hydration shell and their temperature dependence, evaluated by molecular dynamics simulations.