A kind of novel hybrid nanostructure of anodic aluminum oxide (AAO) template or Au sputtered AAO template covered by a single layer NaYF4: Yb3+, Er3+ @NaYF4 nanocrystals (NCs) was prepared by a facile strategy. Two kinds of available models that include with and without Au nanolayer were suggested for simulations. Significant downconversion luminescence (DCL) enhancement was observed when the supported template changed from single AAO to Au nanolayer covered AAO. A formula for luminescence enhancement factor based on the cavity quantum optics theory was constructed. With luminescence dynamics analyses, the DCL enhancement was ascribe to the main positive influence of excitation enhancement, besides the minor negative impact of the competition among the nonradiative loss of resonant cavity, the higher order mode loss of Purcell factor, and the increase of radiative transition rate. It proposed a new idea for surface plasmon (SP) induced luminescence regulation mechanism exploration.