Well, really you ought to remove the thing entirely, but a short term solution is one of those 4" rubber-plugs with metal plates on both sides, and a bolt through the middle. You slide the whole plug into the pipe, and crank the bolt tight, with pulls the plates together and squeezes the rubber against the sides of the pipe.
--goedjn