Yes... heavy latency will slow your streams down.

I would guess that the problem has to do with the network, rather than the
server(s). Can you explain things in a little more detail?

When did the latency begin to increase?
what is the average round-trip time for your pings?
From what location are you getting long ping times? Where is the client and
where is the server?

Pings increased when server was moved from onsite to a co-lo facility.

Pings were 10ms and are now 80ms or so.

All the clients are internal (training).