It is possible that the pulley may be made of diecast metal (many were on Sears saws) and is wollerd (SP) out. Hence each time it is used it moves about and loosens the set screw. I believe I'd try to locate a cast iron or machined steel pulley and see if this doesn't correct the problem.
Don Dando