JB is right, if you vent air out of the house, it will have to be replaced by other air, warm air from outside the house. If you used the same air, sucked in air from outside just to cool the coils, it would not cool the coils as well, because it woudl be hotter than the air iln the rest of your house** So you'd need more air, that is a faster fan.
** (My house at least is much cooler than outside on the first floor. Tnat's not always true on the seocnd floor)You'd have to have the coils that are on the back of the fridge outside the house instead.
When I had AC, I only used it 20 or 30 days a year, in Baltimore, but even when I wasn't using it, I never noticed heat coming from the fridge. Now that my AC is broken for the last 2 years or so, I still don't noticed any heat. Admittedly, the coils are in the back and the heat from them gradually spreads into the rest of the kitchen, but I think what really makes the difference is that I don't open the fridge door very much. If the door isn't opened, like for 8 hours every night, I'll bet the thing hardly runs at all.
Again, there's only one of me, but otoh some people just open the door and stare at the food for a while.