As with all forms of energy technology there is a temptation to discount the capital costs when blinded by potentially low (or even nominally zero) running costs. There is also a tendency to discount maintenance and decommissioning costs when looking at the viability of a source of energy.
Take nuclear power: the 'carrot' is that fissile materials produce enormous amounts of energy and although they are rare minerals and require very careful preparation and handling. This attraction was causing people to say 'electricity too cheap to meter' 50 years ago. The real costs are of course staggering - the plants are expensive to build, expensive to run (safely) and the waste is politically undisposable, and very very expensive to store.
Another factor affecting energy sources is the temperature. There are loads and loads of methods of generating low grade heat energy which is useful for space heating. There are fewer and more expensive ways of obtain high grade heat energy that can be used to raise steam and make electricity.
Geothermal is probably viable i.e. won't cost more to make than it makes! I suspect, it's currently too expensive to complete with simpler methods.