The time when it is a real problem is when the insulation does not completly fill all of the wall - either due to obstructions in the cavity, or sometimes from the filling slumping over time if it is a loose fill. Then you end up with a well insualted wall that has a few very cold spots. This concentrates much of the condensation in those spots.