Fixing flaky paint

We have a 3 year old house where the builder's decorators have done a poor job on the first painting of the plasterboard walls. Now that I'm getting round to redecorating, several areas of paintwork show really bad adhesion and start to flake off when they are painted over. Is there any way to remedy this without resorting to removing the bad paint - I was thinking about applying a very dilute PVA wash over the bad bits, and hoping that this would penetrate the paint layer. (The paint does seem to be a bit soluble already, as wiping with a damp cloth does take some off.)
Add pictures here
<% if( /^image/.test(type) ){ %>
<% } %>
Add image file
Upload is a website for homeowners and building and maintenance pros. It is not affiliated with any of the manufacturers or service providers discussed here. All logos and trade names are the property of their respective owners.