To solve the noise subspace problem, we extend the generalized singular value decomposition to a new decomposition that can be updated at a low cost. In addition, we show how a forgetting factor can be incorporated in our new decomposition.