A comprehensive investigation is performed on highly monodisperse silica-based inverse ferrofluids under small-amplitude oscillatory shear in the presence of external magnetic fields up to 1 T. The effect of particle volume fraction and continuous medium Newtonian viscosity is thoroughly investigated. Experimental results for storage modulus are used to validate existing micromechanical magnetorheological models assuming different particle-level field-induced structures.