Analytical solutions are derived for various start-up Newtonian Poiseuille flows assuming that slip at the wall occurs when the wall shear stress exceeds a critical value, known as the slip yield stress. Two distinct regimes characterise the steady axisymmetric and planar flows, which are defined by a critical value of the pressure gradient. If the imposed pressure gradient is below this critical value, the classical no-slip, start-up solution holds. Otherwise, no-slip flow occurs only initially, for a finite time interval determined by a critical time, after which slip does occur. For the annular case, there is an additional intermediate (steady) flow regime where slip occurs only at the inner wall, and hence, there exist two critical values of the pressure gradient. If the applied pressure gradient exceeds both critical values, the velocity evolves initially with no-slip at both walls up to the first critical time, then with slip only along the inner wall up to the second critical time and finally with slip at both walls.