Giant unilamellar vesicles (GUVs) made up of phospholipid bilayer membranes (liposomes) and elastic capsules with a cross-linked, polymerized membrane, have emerged as biomimetic alternatives to investigating biological cells such as leukocytes and erythrocytes. This feature article looks at the similarities and differences in the electrohydrodynamics (EHD) of vesicles and capsules under electric fields that determines their electromechanical response. The physics of EHD is illustrated through several examples such as the electrodeformation of single and compound, spherical and cylindrical, and charged and uncharged vesicles in uniform and nonuniform electric fields, and the relevance and challenges are discussed. Both small and large deformation results are discussed. The use of EHD in understanding complex interfacial kinetics in capsules and the synthesis of nonspherical capsules using electric fields are also presented. Finally, the review looks at the large electrodeformation of water-in-water capsules and the relevance of constitutive laws in their response.