We have demonstrated a polymer mediated "bricks and mortar" method for the self-assembly of quantum dots (QDs). This strategy allows QDs to self-assemble into structured aggregates using complementary three-point hydrogen bonding. The resulting nanocomposites have distinct morphologies and inter-particle distances based on the ratio between QDs and polymer. Time resolved photoluminescence measurements showed that the optical properties of the QDs were retained after self-assembly.