I have 2 servers Ubuntu 20.04 server, running a service to transfer large tar files via HTTP (5 parallel) between server A to server B. Transfer rates sometimes dropped from x GiB/s to x MiB/s and a reboot was necessary to restore normal operation.
The network bandwidth is 25 GiB/s.
Normal State after reboot :
root@syd-7h1208-036:~# iperf3 -c xxx.xxx.6.50
Connecting to host xxx.xxx.6.50, port 5201
[ 5] local xxx.xxx.6.91 port 39958 connected to xxx.xxx.6.50 port 5201
[ ID] Interval Transfer Bitrate Retr Cwnd
[ 5] 0.00-1.00 sec 1.98 GBytes 17.0 Gbits/sec 0 2.76 MBytes
[ 5] 1.00-2.00 sec 1.98 GBytes 17.0 Gbits/sec 0 2.76 MBytes
[ 5] 2.00-3.00 sec 1.97 GBytes 16.9 Gbits/sec 0 2.76 MBytes
[ 5] 3.00-4.00 sec 1.98 GBytes 17.0 Gbits/sec 0 2.76 MBytes
[ 5] 4.00-5.00 sec 1.98 GBytes 17.0 Gbits/sec 0 2.76 MBytes
Slow State before reboot :
root@syd-7h1208-036:~# iperf3 -c xxx.xxx.6.50
Connecting to host xxx.xxx.6.50, port 5201
[ 5] local xxx.xxx.6.91 port 39958 connected to xxx.xxx.6.50 port 5201
[ ID] Interval Transfer Bitrate Retr Cwnd
[ 5] 0.00-1.11 sec 20.2 MBytes 153 Mbits/sec 4 332 KBytes
[ 5] 1.11-2.02 sec 31.8 MBytes 291 Mbits/sec 0 516 KBytes
[ 5] 2.02-3.00 sec 11.8 MBytes 101 Mbits/sec 0 568 KBytes
[ 5] 3.00-4.14 sec 27.5 MBytes 203 Mbits/sec 0 717 KBytes