The effect of temperature modulation on the onset of double diffusive convection in a sparsely packed porous medium is studied by making linear stability analysis, and using Brinkman-Forchheimer extended Darcy model. The temperature field between the walls of the porous layer consists of a steady part and a time dependent periodic part that oscillates with time. Only infinitesimal disturbances are considered. The effect of permeability and thermal modulation on the onset of double diffusive convection has been studied using Galerkin method and Floquet theory. The critical Rayleigh number is calculated as a function of frequency and amplitude of modulation, Vadasz number, Darcy number, diffusivity ratio, and solute Rayleigh number. Stabilizing and destabilizing effects of modulation on the onset of double diffusive convection have been obtained. The effects of other parameters are also discussed on the stability of the system. Some results as the particular cases of the present study have also been obtained. Also the results corresponding to the Brinkman model and Darcy model have been compared.