This contribution deals with the problems related to robust fault detection. An approach to time domain optimization of observer-based fault detection systems is proposed. The core of this approach is the integration of robust residual generation and evaluation which provides a time domain optimal solution for the robustness problem of fault detection. The discussion on the optimal solution reveals some potential possibilities and ideas for improving the performance of fault detection systems.