Can you not french drain the outside (trench, perf pipe, suitable gravel) or put some suitable sink holes in with float operated pumps? They are about =A339 from Screwfix. You do not want to pump out the area below original water table height of course or you will cause more problems rather than resolve them.
If the water company has agreed it is their water, it provides a useful short term protection.
Proper internal tanking is a plastic sheet with raised bobbles to stand its surface off the substrate. It is fixed with special pegs comprising o-ring. There is a low-level sink hole with float operated pump. Basically a plastic tank, do not even try to use bitumen coatings with any hydrostatic pressure - water is quite an insistent brute even at slight depth as you have probably found. Do a quick google at the solutions, someone here can probably recommend the proper ones (they are not hugely expensive, it is only stuff on a roll and diligence with installation workmanship).
I would dig outside and put a float operated pump at a suitable depth re water table (may need some trial, wait, adjust). If that is a public right of way, get the water company to sort something out if possible - it only needs 1-2 narrow trenches. What you do not want is persistent water saturation of foundations, nor a whacking great big trench to undermine the foundations.
Ebay does rubber ducks in various sizes BTW :-)