I don't know what to expect as a latency but here is a partial trace on your server.
5 99ms 100ms 99ms [64.210.21.134] Datapipe.ge-5-3-1.ar1.SJC2.gblx.net
6 101ms 100ms 101ms [66.70.123.244] vl61.dist1-2.sj2.datapipe.net
7 102ms 102ms 102ms [65.17.255.14]
8 103ms 102ms 103ms [65.17.255.14]
I am questioning that the latency has a direct impact on time outs or loading errors. The server is expecting information quicker than it is getting.