Reading this thread, these are some things that have occured to me. I'm not an expert on soil conditions in Virginia, but my job is in road construction. So here goes:
- The principal trouble is that there's no barrier between the driveway and the sub-base. This allows mud to migrate into the driveway aggregate and vice versa. A layer of geotextile fabric is the best, most effective and least expensive way to provide that barrier. Were it me, I'd look at woven versus non-woven fabric, but that's entirely up to you. Expect to pay between 50 cents and a buck per square yard of driveway surface, and the fabric comes in rolls with widths of 12.5', 15' and 17.5'. You will have considerable waste.
- The aggregate for you driveway is, as another poster mentioned, not the best for a road base. Round rocks roll against one another-- hey, that was alliteration! Anyway, if you're stuck with what you've got, you need to amend the road base with some well-graded material, i.e., some stuff with lots of different particle sizes. Around here, #610 limestone with fines is the standard, but if you plan to reuse what you have, I'd maybe try some #411 or something similar. The idea is to have as few voids as possible between as widely varied particle sizes as possible. A much less expensive, but less stable alternative is to use sand/clay fill.
- Your driveway or the soil under or next to it is holding water. Take your pick on how to alleviate that problem.
Having said all that, here's what I think I would do, keeping budget as the primary constraint: Dig up the existing drive and save the rock. Pile it along side, whatever. Put down your fabric. Spread the rock back out over the fabric, then put a thin layer (just an inch or two) of sand atop the rock. Wash the sand into the rock with a sprinkler (or let it rain or let it work its way in naturally) and then do it again. And again, if needed. Since you only have 2 or 3 inches of gravel, probably twice is going to do it. This will provide a reasonably stable matrix that will not leave ponds in ruts that develop (which can be fixed easily by filling with gravel/sand mix) and the geotex will keep migration to a minimum.
More expensive alternatives are a sand layer under the fabric, and crushed limestone of varying grades in place of the sand washed into the gravel.
Holy crap, that was long-winded. If you have more, or more specific questions, I check in here a couple times a week, or you can email me directly. I hope this helps you out.
Phil