A theoretical procedure to analyze the overall properties of the particle-dispersed composite material is proposed. The localized behavior of the debonded interface between the matrix and the interface is modeled based on the micromechanical method. The effects of interfacial delamination on the strain field inside the particles are represented by a modified Eshelby tensor. Furthermore, the interfacial delamination may cause an additional strain at the interface. This effect is taken into account by introducing damage effected tensors. With the use of these tensors, a constitutive model is obtained, which is on the bases of equivalent inclusion method, and of a self-consistent compliance scheme. If the particles are not randomly dispersed, when damage occurs at the interface under uniaxial tension, the composite will behave anisotropic properties. This effect is also taken into consideration in the meso- and macro level. The numerical calculations are carried out. The results in some typical conditions of interface are discussed. It is concluded that the interfacial delamination has a dramatically detrimental effect on the overall properties of the composite materials. It is also revealed that the composite material as a whole will be orthorhombic due to the interfacial damage, when the particles are regularly arranged.