In this article, we elucidate the protein activity from the perspective of protein softness and flexibility by studying the collective phonon-like excitations in a globular protein, human serum albumin (HSA), and taking advantage of the state-of-the-art inelastic X-ray scattering (IXS) technique. Such excitations demonstrate that the protein becomes softer upon thermal denaturation due to disruption of weak noncovalent bonds. On the other hand, no significant.change in the local excitations is detected in ligand (drugs) bound HSA compared to the ligand-free HSA. Our results clearly suggest that the protein conformational flexibility and rigidity are balanced by the native protein structure for biological activity.