Network and load recovery (NLR) during power system restoration is a multi-step mixed-integer nonlinear programming (MINP) problem. The NLR is difficult to be solved as it is NP-hard. Thus, NLR is commonly solved step by step, which is short-sighted and will result in longer restoration time. To obtain a far-sighted NLR plan, this paper proposes an improved two-stage optimization method for NLR. The first stage adopts a mixed-integer linear programming (MILP) model to obtain optimal solutions of integer variables in NIB, namely the load pick-up schedules and transmission line charging schedules. Then in the second stage, a continuous non-linear optimization method based on AC power flow with frequency constraints and load model is established to minimize the restoration duration of the plan generated in the first stage step by step. Case studies are undertaken on a 10 machine 39-bus system and Southeast Hubei Provincial power system of China. Simulation results indicate that the restoration plan obtained from the improved two-stage optimization method is highly effective, while the computational efficient meets the intensive need for restoration scheduling after blackouts.