Surely this cant be gravity fed?
Does the hot water 'tank' look like a conventional copper cylinder, or is it a really sturdy looking affair?
If the latter, you may have an unvented hot cylinder with a direct feed from the cold mains, and running at near mains pressure. If so, it will have lots of pipes and other gubbins connected to it - which is why someone asked for a photo in order to be able to identify it.
If it *is* an unvented cylinder, the hot flow will stop very shortly after turning off the cold mains. Turn off the mains and open a hot tap. If the water flows unabated for a long time, it ain't an unvented cylinder. I would expect to get no more than a few litres of hot before it reduces to a dribble and then stops. If this happens, you can safely dismantle a tap to fix the leak - as long as you don't turn the mains on again until the tap's back together!