tablesaw fence

No, just typical of saw with a crappy fence. If the saw is worth investing a few bucks, get a Beisemeyer or good clone for it and you'll live happily ever after.

This is a good one

I got the Vega fence for my c. 1983 Crafstman and it's the best investment I ever made.

-Zz

Something is either loose or worse, cracked. Find it and fix it. Usually, it's at the joint where the lock assembly attaches to the fence. Adjustment can include wrenching, shimming, even filing.

If nothing is broken this type of fence can probably be adjusted back into a serviceable condition. Inspect for any damage and if everything is OK, figure out which nuts/bolts change which adjustment. The key to a front and rear locking fence is to adjust it so the front locks to the front rail before the rear. If nothing is bent or broken the front rail will square the fence, then the rear will lock and hold the fence in place. It also helps to get in the habit of pushing forward on the front while setting the lock lever, and always move the fence towards the blade as its final motion before locking. (Move it away then back again when necessary)

Sounds like the fence needs adjustment. There's usually adjustments at the handle end to square it up and to adjust the tension rod. I don't think that type of fence is as nice as a higher end fence for reliable, repeatable accuracy, but they certainly can perform to far better than the accuracy you're experiencing now. Take 15 minutes and have a hand at adjusting it.