In this work, we consider the infinite-time optimal control of input affine nonlinear systems subject to point-wise in time inequality constraints on both the process inputs and outputs. Fundamental to solving this constrained infinite-time nonlinear optimal control (CITNOC) problem is the ability to calculate the value function of it's unconstrained counterpart, the infinite-time nonlinear optimal control (ITNOC) problem. Unfortunately, the traditional ITNOC solution procedure of specifying an objective function and then solving for the optimal control policy and corresponding value function is computationally intractable in all but the simplest of examples. However, in many cases one can easily identify a stabilizing feedback for near operating point regulation. Building from this local policy, the proposed method is to construct a meaningful optimal control objective function as well as its corresponding value function. These functions are then used to analyze the closed-loop stability of the proposed policy. Upon return to the constrained case the constructed objective and value functions are again used to develop a self-consistent constrained finite-time scheme that will, for the first time, provide an exact solution to the CITNOC problem. The mechanics of the proposed method are then illustrated by an example from chemical reactor control.