Based on the idea of the set-membership identification, a modified recursive least squares algorithm with variable gain, variable forgetting factor and resetting is presented. The concept of the error tolerance level is proposed. The selection criteria of the error tolerance level are also given according to the min-max principle. The algorithm is particularly suitable for tracing time-varying systems and is similar in computational complexity to the standard recursive least squares algorithm. The superior performance of the algorithm is verified via simulation studies on a dynamic fermentation process.