This study evaluated the effects of high-grain diets on the rumen fermentation, epithelial bacterial community, morphology of rumen epithelium, and local inflammation of goats during high-grain feeding. Twelve 8-month-old goats were randomly assigned to two different diets, a hay diet or a high-grain diet (65% grain, HG). At the end of 7 weeks of treatment, samples of rumen content and rumen epithelium were collected. Rumen pH was lower (P < 0.05), but the levels of volatile fatty acids and lipopolysaccharides were higher (P < 0.05) in the HG group than those in the hay group. The principal coordinate analysis indicated that HG diets altered the rumen epithelial bacterial community, with an increase in the proportion of genus Prevotella and a decrease in the relative abundance of the genera Shuttleworthia and Fibrobacteres. PICRUSt analysis suggested that the HG-fed group had a higher (P < 0.05) relative abundance of gene families related to energy metabolism; folding, sorting, and degradation; translation; metabolic diseases; and immune system. Furthermore, HG feeding resulted in the rumen epithelial injury and upregulated (P < 0.05) the gene expressions of IL-1 beta and IL-6, and the upregulations were closely related to the rumen pH, LPS level, and rumen epithelial bacteria abundance. In conclusion, our results indicated that the alterations in the rumen environment and epithelial bacterial community which were induced by HG feeding may result in the damage and local inflammation in the rumen epithelium, warranting further study of rumen microbial-host interactions in the HG feeding model.