This paper deals with robust observer-based output-feedback stabilization of systems whose actuator dynamics can be described in terms of partial differential equations (PDEs). More specifically, delay dynamics (first-order hyperbolic PDE) and diffusive dynamics (parabolic PDE) are considered. The proposed controllers have a PDE observer-based structure. The main novelty is that stabilization for an arbitrarily large delay or diffusion domain length is achieved, while distributed integral terms in the control law are avoided. The exponential stability of the closed loop in both cases is proved using Lyapunov functionals, even in the presence of small uncertainties in the time delay or the diffusion coefficient. The feasibility of this approach is illustrated in simulations using a second-order plant with an exponentially unstable mode.