Next time it happens, run a speed test:
http://www.megapath.com/speedtestplus/
The "plus" test shows down/upload, but more importantly shows packet loss, latency and jitter. I've noticed from time to time when things get rough in the game, things like my jitter are higher than normal.