I have around 5 Ubuntu 18.04.5 LTS systems with same disk image running at different locations.
After running for one year one of the systems is disconnecting from internet randomly. after reboot the internet works fine.
When i check the syslog after reboot the following are the last few lines of the logs
Feb 1 03:02:49 labs-1804LTS-V2 systemd[1]: Started Run anacron jobs.
Feb 1 03:02:49 labs-1804LTS-V2 anacron[11434]: Anacron 2.3 started on 2022-02-01
Feb 1 03:02:49 labs-1804LTS-V2 anacron[11434]: Normal exit (0 jobs run)
Feb 1 03:04:56 labs-1804LTS-V2 NetworkManager[986]: <info> [1643684696.1037] connectivity: (eno1) timed out
Feb 1 03:04:56 labs-1804LTS-V2 NetworkManager[986]: <info> [1643684696.1038] manager: NetworkManager state is now CONNECTED_SITE
Feb 1 03:04:56 labs-1804LTS-V2 dbus-daemon[948]: [system] Activating via systemd: service name='org.freedesktop.nm_dispatcher' unit='dbus-org.freedesktop.nm-dispatcher.service' requested by ':1.15' (uid=0 pid=986 comm="/usr/sbin/NetworkManager --no-daemon " label="unconfined")
Feb 1 03:04:56 labs-1804LTS-V2 whoopsie[1953]: [03:04:56] offline
Feb 1 03:04:56 labs-1804LTS-V2 systemd[1]: NetworkManager-dispatcher.service: Found left-over process 1584 (autossh) in control group while starting unit. Ignoring.
Feb 1 03:04:56 labs-1804LTS-V2 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies.
Feb 1 03:04:56 labs-1804LTS-V2 systemd[1]: NetworkManager-dispatcher.service: Found left-over process 1585 (ssh) in control group while starting unit. Ignoring.
Feb 1 03:04:56 labs-1804LTS-V2 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies.
Feb 1 03:04:56 labs-1804LTS-V2 systemd[1]: Starting Network Manager Script Dispatcher Service...
Feb 1 03:04:56 labs-1804LTS-V2 dbus-daemon[948]: [system] Successfully activated service 'org.freedesktop.nm_dispatcher'
Feb 1 03:04:56 labs-1804LTS-V2 systemd[1]: Started Network Manager Script Dispatcher Service.
Feb 1 03:04:56 labs-1804LTS-V2 nm-dispatcher: req:1 'connectivity-change': new request (1 scripts)
Feb 1 03:04:56 labs-1804LTS-V2 nm-dispatcher: req:1 'connectivity-change': start running ordered scripts...
Feb 1 03:09:56 labs-1804LTS-V2 NetworkManager[986]: <info> [1643684996.1038] connectivity: (eno1) timed out
Feb 1 03:14:27 labs-1804LTS-V2 NetworkManager[986]: <info> [1643685267.3361] manager: NetworkManager state is now CONNECTED_GLOBAL
Feb 1 03:14:27 labs-1804LTS-V2 dbus-daemon[948]: [system] Activating via systemd: service name='org.freedesktop.nm_dispatcher' unit='dbus-org.freedesktop.nm-dispatcher.service' requested by ':1.15' (uid=0 pid=986 comm="/usr/sbin/NetworkManager --no-daemon " label="unconfined")
Feb 1 03:14:27 labs-1804LTS-V2 systemd[1]: NetworkManager-dispatcher.service: Found left-over process 1584 (autossh) in control group while starting unit. Ignoring.
Feb 1 03:14:27 labs-1804LTS-V2 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies.
Feb 1 03:14:27 labs-1804LTS-V2 systemd[1]: NetworkManager-dispatcher.service: Found left-over process 1585 (ssh) in control group while starting unit. Ignoring.
Feb 1 03:14:27 labs-1804LTS-V2 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies.
Feb 1 03:14:27 labs-1804LTS-V2 systemd[1]: Starting Network Manager Script Dispatcher Service...
Feb 1 03:14:27 labs-1804LTS-V2 whoopsie[1953]: [03:14:27] The default IPv4 route is: /org/freedesktop/NetworkManager/ActiveConnection/1
Feb 1 03:14:27 labs-1804LTS-V2 whoopsie[1953]: [03:14:27] Not a paid data plan: /org/freedesktop/NetworkManager/ActiveConnection/1
Feb 1 03:14:27 labs-1804LTS-V2 whoopsie[1953]: [03:14:27] Found usable connection: /org/freedesktop/NetworkManager/ActiveConnection/1
Feb 1 03:14:27 labs-1804LTS-V2 dbus-daemon[948]: [system] Successfully activated service 'org.freedesktop.nm_dispatcher'
Feb 1 03:14:27 labs-1804LTS-V2 systemd[1]: Started Network Manager Script Dispatcher Service.
Feb 1 03:14:27 labs-1804LTS-V2 nm-dispatcher: req:1 'connectivity-change': new request (1 scripts)
Feb 1 03:14:27 labs-1804LTS-V2 nm-dispatcher: req:1 'connectivity-change': start running ordered scripts...
Feb 1 03:14:29 labs-1804LTS-V2 whoopsie[1953]: [03:14:29] online
In the past one year nothing has changed on this system. I disabled automatic updates as well.
The following is lspci
00:00.0 Host bridge: Intel Corporation Device 3e30 (rev 0d)
00:01.0 PCI bridge: Intel Corporation Xeon E3-1200 v5/E3-1500 v5/6th Gen Core Processor PCIe Controller (x16) (rev 0d)
00:12.0 Signal processing controller: Intel Corporation Cannon Lake PCH Thermal Controller (rev 10)
00:14.0 USB controller: Intel Corporation Cannon Lake PCH USB 3.1 xHCI Host Controller (rev 10)
00:14.2 RAM memory: Intel Corporation Cannon Lake PCH Shared SRAM (rev 10)
00:16.0 Communication controller: Intel Corporation Cannon Lake PCH HECI Controller (rev 10)
00:17.0 SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)
00:1b.0 PCI bridge: Intel Corporation Device a340 (rev f0)
00:1b.4 PCI bridge: Intel Corporation Cannon Lake PCH PCI Express Root Port 21 (rev f0)
00:1c.0 PCI bridge: Intel Corporation Device a338 (rev f0)
00:1d.0 PCI bridge: Intel Corporation Cannon Lake PCH PCI Express Root Port 9 (rev f0)
00:1f.0 ISA bridge: Intel Corporation Device a305 (rev 10)
00:1f.3 Audio device: Intel Corporation Cannon Lake PCH cAVS (rev 10)
00:1f.4 SMBus: Intel Corporation Cannon Lake PCH SMBus Controller (rev 10)
00:1f.5 Serial bus controller [0c80]: Intel Corporation Cannon Lake PCH SPI Controller (rev 10)
00:1f.6 Ethernet controller: Intel Corporation Ethernet Connection (7) I219-V (rev 10)
01:00.0 VGA compatible controller: NVIDIA Corporation Device 1e84 (rev a1)
01:00.1 Audio device: NVIDIA Corporation Device 10f8 (rev a1)
01:00.2 USB controller: NVIDIA Corporation Device 1ad8 (rev a1)
01:00.3 Serial bus controller [0c80]: NVIDIA Corporation Device 1ad9 (rev a1)
03:00.0 Ethernet controller: Intel Corporation Ethernet Controller 10-Gigabit X540-AT2 (rev 01)
03:00.1 Ethernet controller: Intel Corporation Ethernet Controller 10-Gigabit X540-AT2 (rev 01)
05:00.0 Non-Volatile memory controller: Samsung Electronics Co Ltd NVMe SSD Controller SM981/PM981
The ip address of the NIC is configured via router which is fixed.
Your help will be appreciated, Please let me know if you need more details.
