Interactive renders when local rendering in client-server mode feels slow

When connected to remote machine that is not on LAN, even local rendering feels slow - as if every interactive frame is sending/receiving something over network. Does anyone else notice it as well?