If you have sealed the slate you will need to strip it first. I guess you have not sealed it yet so mix 50% vinegar with 50% water. If the water is hard use distilled water. Let it sit, but not dry out for 5 minues or so and then scrub with a nylon brush or a stiff bristle brush. It may take a few applications but it worked well for a friend who had the same trouble with an interior slate floor - by the way, hazy patches on the mortar is common so it's nothing you did wrong.