Viscosity solutions of fully nonlinear, local or nonlocal, Hamilton-Jacobi equations with a superquadratic growth in the gradient variable are proved to be Holder continuous, with a modulus depending only on the growth of the Hamiltonian. The proof involves some representation formula for nonlocal Hamilton-Jacobi equations in terms of controlled jump processes and a weak reverse Holder inequality.