Sulfate-reducing microbial communities remain a suitable option for the remediation of acid mine drainage using several types of carrier materials and appropriate reactor configurations. However, acetate prevails as a product derived from the incomplete oxidation of most organic substrates by sulfate reducers, limiting the efficiency of the whole process. An established sulfate-reducing consortium, able to degrade acetate at initial acidic pH (3.0), was used to develop biofilms over granular activated carbon (GAC), glass beads, and zeolite as carrier materials. In batch assays using glycerol, biofilms successfully formed on zeolite, glass beads, and GAC with sulfide production rates of 0.32, 0.26, and 0.14 mmol H2S/L.d, respectively, but only with glass beads and zeolite, acetate was degraded completely. The planktonic and biofilm communities were determined by the 16S rRNA gene analysis to evaluate the microbial selectivity of the carrier materials. In total, 46 OTUs (family level) composed the microbial communities. Ruminococcaceae and Clostridiaceae families were present in zeolite and glass beads, whereas Peptococcaceae was mostly enriched on zeolite and Desulfovibrionaceae on glass beads. The most abundant sulfate reducer in the biofilm of zeolite was Desulfotomaculum sp., while Desulfatirhabdium sp. abounded in the planktonic community. With glass beads, Desulfovibrio sp. dominated the biofilm and the planktonic communities. Our results indicate that both materials (glass beads and zeolite) selected different key sulfate-reducing microorganisms able to oxidize glycerol completely at initial acidic pH, which is relevant for a future application of the consortium in continuous bioreactors to treat acidic streams.