I also use Andrew's slide hammer method. If the joint was made correctly in the first place and not over tightened, then the olive comes off fairly easily. If it does fit a new olive. If not then a few wraps of PTFE, or jointing compound.
If using jointing compound, for those who may not be aware, be sure it's fit for the purpose,especially if using compression joints on potable (drinking) water supplies. Boss White is not suitable for use on potable water.