Several kinds of hydrogels were prepared as mimics for the collagen/acidic protein hydrogel employed as the polymer matrix for mineralization in natural bone formation. The hydrogels prepared as mineralization matrices were employed for synthesizing artificial bones. The artificial bone made from a network of poly(vinyl alcohol) (PVA) and poly(acrylic acid) (PAA) prepared by heating (PVA/PAA-h-network) exhibited mechanical properties comparable with those of fish scales. To elucidate the formation mechanism of the artificial bone, we synthesized four further kinds of matrix. Artificial bones were obtained from both a PVA/PAA network prepared by repeated freezing and thawing (PVA/PAA-ft-network) and a chitosan/PAA network, in which hydrogen bonding exists between the two constituent polymers, similar to that observed in a natural collagen/acidic protein network. The artificial bone made from the chitosan/PAA network was confirmed to be formed by the phase transformation of a cartilaginous precursor by a process similar to the transformation of cartilaginous tissue to natural bone. In addition, skeletal phase material, i.e., a homogeneous solid phase of hydroxyapatite/polymers, was formed in the cartilaginous phase, i.e., the hypercomplex gel. The skeletal phase grew thicker at the expense of the cartilaginous phase until it formed the entirety of the composite. Artificial bones were also obtained from a gelatin/PAA network and a poly[N-(2-hydroxyethyl)acrylamide]-co-(acrylic acid) network. These experimental results suggested that the coexistence of proton donor and proton acceptor functions in the hydrogel is a key factor for bone formation. The hydroxyapatite content of our artificial bones was almost conterminous with those of natural bones.