It happened to me way too much when playing BF3 on Windows 7 even with 2GB cards. The fix is just using Windows 8, the desktop in windows 7 still runs at dx9.
Because you'd be most likely cpu bound in your other games therefore the gpu load would be drastically lower.