We have investigated the mechanical loss factor for bimodal magnetic elastomers containing magnetic and nonmagnetic particles. The bimodal magnetic elastomer exhibited amphoteric response of loss factor by magnetic fields depending on the strain amplitude; i.e. negative response at low strains and significant positive response at high strains. The mechanism of amphoteric response seen in bimodal magnetic elastomers is discussed.