Prediction and filtering of continuous-time stochastic processes often require a solver of a continuous-time differential Lyapunov equation (CDLE), for example the time update in the Kalman filter. Even though this can be recast into an ordinary differential equation (ODE), where standard solvers can be applied, the dominating approach in Kalman filter applications is to discretize the system and then apply the discrete-time difference Lyapunov equation (DDLE). To avoid problems with stability and poor accuracy, oversampling is often used. This contribution analyzes over-sampling strategies, and proposes a novel low-complexity analytical solution that does not involve oversampling. The results are illustrated on Kalman filtering problems in both linear and nonlinear systems.