A general family of tracking algorithms for linear regression models is studied, It includes the familiar least mean square gradient approach, recursive least squares, and Kalman filter based estimators, The exact expressions for the quality of the obtained estimates are complicated, Approximate, and easy-to-use, expressions for the covariance matrix of the parameter tracking error are developed, These are applicable over the whole time interval, including the transient, and the approximation error can be explicitly calculated.