The linear and quadratic response functions have been derived for an exact state, based on an exponential parametrization of the time evolution consisting of products of exponentials for orbital rotations and for higher-order excitations. Truncating the linear response function such that the response function itself and its pole structure is correct to second order in Moller-Plesset perturbation theory, we arrive at the second-order polarization propagator approximation (SOPPA). Previous derivations of SOPPA have used the superoperator formalism, making the extension of SOPPA to quadratic and higher order response functions difficult. The derivation of the quadratic response function is described in detail, allowing molecular properties such as hyperpolarizabilities, two-photon cross sections, and excited-state properties to be calculated using the SOPPA model.