Lord Reliant, my video card does have 512MB of memory. I downloaded the latest driver and that helped. However, the game is still awfully sluggish, and edge scroll is unusable, even though I set the delay to zero. It takes about a second to scroll when I move to the edge and it overshoots. If I have to buy a new video card, I would be willing to do that, provided it's not too expensive. I don't play that many games, and I'm unwilling to pay a couple hundred dollars or more for the latest and greatest in video cards.
You'd get a much better gaming experience going to a more modern card. Thankfully you can get them for relatively cheap, too:
http://www.tomshardware.com/reviews/gaming-graphics-card-review,3107-2.html
Glad that updating the drivers helped a bit. It would be helpful if Stardock posted a minimum GPU config.
As a work around, you could change the zoom level to take you to the cloth map view more quickly, as well as disable some other graphic options (if they aren't disabled currently). Turning off outlines, shadows, lowering textures, etc. should help significantly.