Small clusters have a range of unique physical and chemical phenomena that are strongly size dependent. However, analysis of these phenomena often assumes that thermodynamic equilibrium conditions prevail. We compare experimentally measured and ab initio computed photoelectron spectra of bare and deuterated silicon cluster anions produced in a plasma environment. We find that the isomers detected experimentally are usually not the ground-state isomers, but metastable ones, which indicates that cluster relaxation is strongly limited kinetically by a dwell time that is much shorter than the relaxation time. We show that, under these conditions, the highest electron affinity replaces the traditional lowest total energy as the appropriate criterion for predicting isomer structures. These findings demonstrate that a stringent examination of non-equilibrium effects can be crucial for a correct analysis of cluster properties.