We report on the structures exhibited by two different diblock poly(styrene)-b-poly(acrylie acid) (PS-b-PAA) copolymers in water, a selective solvent. Using a combination of X-ray scattering and freeze fracture-transmission electron microscopy (FF-TEM), we show that these structures can be widely swollen while retaining their initial morphology and a high degree of long-range order. The analysis of the FF-TEM pictures also evidences the presence of water crystallites of regular size and shape within the confined water domains. We relate the growth of these crystallites to the high local ionic strength of the water swelling the PAA brushes. Moreover, the confinement of the crystallites growth shows that the swollen phases have a very robust structure, potentially useful for confining colloidal particles.