Temporal variation of general and rare bacterial taxa was investigated using pyrosequencing of 16S rRNA gene from activated sludge samples collected bimonthly for a two-year period. Most of operational taxonomic units (OTUs) were allocated to rare taxa (89.6%), but the rare taxa comprised a small portion of the community in terms of abundance of sequences analyzed (28.6%). Temporal variations in OTUs richness significantly differed between the two taxa groups in which the rare taxa showed a higher diversity and a more fluctuating pattern than the general taxa. Furthermore, the two taxa groups were constrained by different explanatory variables: influent BOD, effluent BOD, and DO were the significant (P < 0.05) parameters affecting the pattern of the general taxa, while temperature was the factor for the rare taxa. Over the test period, the general taxa persisted for a longer time (i.e., lower turnover rate) in the bioreactor than the rare taxa. In conclusion, this study demonstrated clear differences in temporal dynamic patterns for the general and rare bacterial taxa in an activated sludge bioreactor, which would be a foundation for better understanding the bacterial ecology of activated sludge.