The technological challenges of adapting energy systems to the addition of more renewables are intricately interrelated with the ways in which markets incentivize their development and deployment. Households with own onsite distributed generation augmented by electrical and thermal storage capacities (prosumers), can adjust energy use based on the current needs of the electricity grid. Heat pumps, as an established technology for enhancing energy efficiency, are increasingly seen as having potential for shifting electricity use and contributing to Demand Response (DR). Using a model developed and validated with monitoring data of a household in a plus-energy neighborhood in southern Germany, the technical and financial viability of utilizing household heat pumps to provide power in the market for Frequency Restoration Reserve (FRR) are studied. The research aims to evaluate the flexible electrical load offered by a cluster of buildings whose heat pumps are activated depending on selected rule-based participation strategies. Given the prevailing prices for FRR in Germany, the modelled cluster was unable to reduce overall electricity costs and thus was unable to show that DR participation as a cluster with the heat pumps is financially viable. Five strategies that differed in the respective contractual requirements that would need to be agreed upon between the cluster manager and the aggregator were studied. The relatively high degree of flexibility necessary for the heat pumps to participate in FRR activations could be provided to varying extents in all strategies, but the minimum running time of the heat pumps turned out to be the primary limiting physical (and financial) factor. The frequency, price and duration of the activation calls from the FRR are also vital to compensate the increase of the heat pumps' energy use. With respect to thermal comfort and self-sufficiency constraints, the buildings were only able to accept up to 34% of the activation calls while remaining within set comfort parameters. This, however, also depends on the characteristics of the buildings. Finally, a sensitivity analysis showed that if the FRR market changed and the energy prices were more advantageous, the proposed approaches could become financially viable. This work suggests the need for further study of the role of heat pumps in flexibility markets and research questions concerning the aggregation of local clusters of such flexible technologies.