In this study, we performed direct simulations of particle suspensions in a simple shear flow with a viscoplastic model (Bingham fluid) using a finite-element/fictitious-domain method, as a model system for cuttings transport with a drilling mud in the oil and gas exploration. Bulk rheology and particle interaction were investigated via several example problems including single-particle, two-interacting particle, and many-particle problems for various solid fractions in both Bingham and Newtonian fluids. We report that, at low shear rate, huge reductions occur in both the relative bulk viscosity and angular velocity of particle suspension in a Bingham fluid compared to that in a Newtonian fluid. This indicates that, although particle incorporation increases bulk viscosity in a Bingham fluid, the amount of increase appears much smaller than that with the Newtonian medium, and particle motions were restricted to some extend at a low shear rate with a yield stress fluid. Moreover, the suppression in viscosity increase with particles disappears at a high shear rate, just like Newtonian particle suspension. This phenomenon has been interpreted by the suppressed particle angular rotation in a Bingham fluid. In addition, flow fields with low shear regions, where the viscosity of a Bingham fluid is high and the fluid mobility decreased significantly, on the left and right sides of a particle also confirm this interpretation. The two-interacting particle problem reveals delayed particle interaction with increased time period in particle trajectories (drafting, kissing, tumbling and separation) in a Bingham fluid. Similar behaviors with the suppression in viscosity increase can be also observed in the many-particle problem.