Score:0

Ubuntu 22.10 server amd64: Network can not reach local addresses but CAN ping internet after boot. I have to run netplan apply to establish comm

tn flag

Ok... this is baffling to me.

I just performed a fresh install of ubuntu 22.10 server on a dell poweredge T430. After first boot, and subsequent reboots, the server is unable to contact devices on the local network. I can ping google(8.8.8.8) successfully but can not ping anything local. Local devices are also not able to ping this server. This is all fixed by running 'sudo netplan apply' after boot.

This all started happening after an apt upgrade and reboot a couple days ago that led me to reinstall the server over the old(reformatting and only saving my /home partition) as a last ditch trouble shooting step, hence the fresh install caveat above.

The only configuration I performed on the network was setting static IPs for both NICs and the dell iDRAC during the ubuntu install process. The network is managed by networkd(network manager isn't even installed). I CAN access the iDRAC on the local net, but that is it.

here are some pertinent items I have checked:

imediately post-boot from system console -systemctl: status systemd-networkd returns active/enabled -ip addr: returns the proper ip settings and all links register UP -ip route show: indicates the proper default route and local net routes -ip link show indicates all links UP -ufw is inactive -/run/systemd/network/01-netplan-.network files have the configured settings

every status command I know of and a few I found through google says things are configured and happy. The server still can not connect to local IPs post boot, UNTIL I run 'sudo netplan apply' from the system console.

Below I am attaching my /etc/netplan/00-installer-config.yaml and the 'journalctl -b |grep net' from my last boot to the netplan apply command.

I added 'renderer: networkd' as a troubleshooting step and commented out the extra default routes to remove the 'netplan apply' warnings about duplicate default routes. This is my current netplan config file and the problem persists.

I'm at a loss as what to even try next, hence why I am here. Any help is greatly appreciated.

# This is the network config written by 'subiquity'
network:
  renderer: networkd
  ethernets:
    eno1:
      addresses:
      - 192.168.1.8/24
      #dhcp4: true
      dhcp6: true
      nameservers:
        addresses:
        - 1.1.1.1
        - 8.8.8.8
        search:
        - example.net
      routes:
      - to: default
        via: 192.168.1.1
    eno2:
      addresses:
      - 192.168.1.9/24
      dhcp6: true
      nameservers:
        addresses:
        - 9.9.9.9
        - 8.8.8.8
        search:
        - example.net
      #routes:
      #- to: default
      #  via: 192.168.1.1
    idrac:
      addresses:
      - 192.168.1.19/24
      nameservers:
        addresses:
        - 1.1.1.1
        - 8.8.8.8
        search:
        - example.net
      #routes:
      #- to: default
      #  via: 192.168.1.1
  version: 2

here is the journalctl |grep net output:

Nov 03 07:25:35 <hostname> kernel: audit: initializing netlink subsys (disabled)
Nov 03 07:25:35 <hostname> kernel: drop_monitor: Initializing network drop monitor service
Nov 03 07:25:35 <hostname> kernel: tg3 0000:01:00.0 eth0: attached PHY is 5720C (10/100/1000Base-T Ethernet) (WireSpeed[1], EEE[1])
Nov 03 07:25:35 <hostname> kernel: tg3 0000:01:00.1 eth1: attached PHY is 5720C (10/100/1000Base-T Ethernet) (WireSpeed[1], EEE[1])
Nov 03 07:25:35 <hostname> kernel: cdc_ether 3-12.3:1.0 eth0: register 'cdc_ether' at usb-0000:00:14.0-12.3, CDC Ethernet Device, 00:00:00:00:00:02
Nov 03 07:25:37 <hostname> systemd-networkd[1867]: lo: Link UP
Nov 03 07:25:37 <hostname> systemd-networkd[1867]: lo: Gained carrier
Nov 03 07:25:37 <hostname> systemd-networkd[1867]: Enumeration completed
Nov 03 07:25:37 <hostname> systemd-networkd[1867]: idrac: Configuring with /run/systemd/network/10-netplan-idrac.network.
Nov 03 07:25:37 <hostname> systemd-networkd[1867]: eno2: Configuring with /run/systemd/network/10-netplan-eno2.network.
Nov 03 07:25:37 <hostname> systemd-networkd[1867]: eno1: Configuring with /run/systemd/network/10-netplan-eno1.network.
Nov 03 07:25:38 <hostname> systemd-resolved[1874]: Negative trust anchors: home.arpa 10.in-addr.arpa 16.172.in-addr.arpa 17.172.in-addr.arpa 18.172.in-addr.arpa 19.172.in-addr.arpa 20.172.in-addr.arpa 21.172.in-addr.arpa 22.172.in-addr.arpa 23.172.in-addr.arpa 24.172.in-addr.arpa 25.172.in-addr.arpa 26.172.in-addr.arpa 27.172.in-addr.arpa 28.172.in-addr.arpa 29.172.in-addr.arpa 30.172.in-addr.arpa 31.172.in-addr.arpa 168.192.in-addr.arpa d.f.ip6.arpa corp home internal intranet lan local private test
Nov 03 07:25:38 <hostname> systemd-networkd[1867]: idrac: Link UP
Nov 03 07:25:38 <hostname> systemd-networkd[1867]: idrac: Gained carrier
Nov 03 07:25:38 <hostname> systemd-networkd[1867]: eno2: Link UP
Nov 03 07:25:38 <hostname> systemd-networkd[1867]: eno1: Link UP
Nov 03 07:25:38 <hostname> systemd[1]: Starting Dispatcher daemon for systemd-networkd...
Nov 03 07:25:38 <hostname> networkd-dispatcher[1913]: No valid path found for iwconfig
Nov 03 07:25:38 <hostname> networkd-dispatcher[1913]: No valid path found for iw
Nov 03 07:25:38 <hostname> systemd[1]: Started Dispatcher daemon for systemd-networkd.
Nov 03 07:25:39 <hostname> systemd-networkd[1867]: idrac: Gained IPv6LL
Nov 03 07:25:41 <hostname> systemd-networkd[1867]: eno1: Gained carrier
Nov 03 07:25:41 <hostname> systemd-networkd[1867]: eno2: Gained carrier
Nov 03 07:25:43 <hostname> systemd-networkd[1867]: eno1: Gained IPv6LL
Nov 03 07:25:43 <hostname> systemd-networkd[1867]: eno2: Gained IPv6LL
Nov 03 07:25:51 <hostname> systemd-networkd-wait-online[1899]: managing: idrac
Nov 03 07:25:51 <hostname> systemd-networkd-wait-online[1899]: managing: eno2
Nov 03 07:25:51 <hostname> systemd-networkd-wait-online[1899]: managing: eno1
Nov 03 07:25:52 <hostname> kernel: bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this.
Nov 03 07:25:52 <hostname> kernel: Initializing XFRM netlink socket
Nov 03 07:25:52 <hostname> networkd-dispatcher[1913]: WARNING:Unknown index 5 seen, reloading interface list
Nov 03 07:25:52 <hostname> systemd-networkd[1867]: docker0: Link UP
Nov 03 07:29:42 <hostname> systemd[2884]: Listening on GnuPG network certificate management daemon.
Nov 03 07:29:58 <hostname> sudo[2965]:   <username> : TTY=tty1 ; PWD=/home/<username> ; USER=root ; COMMAND=/usr/sbin/netplan apply
Nov 03 07:29:59 <hostname> systemd-networkd[1867]: eno2: Reconfiguring with /run/systemd/network/10-netplan-eno2.network.
Nov 03 07:29:59 <hostname> systemd-networkd[1867]: eno2: DHCPv6 lease lost
Nov 03 07:29:59 <hostname> systemd-networkd[1867]: idrac: Reconfiguring with /run/systemd/network/10-netplan-idrac.network.
Nov 03 07:29:59 <hostname> systemd-networkd[1867]: idrac: DHCPv6 lease lost
Nov 03 07:29:59 <hostname> systemd-networkd[1867]: eno1: Reconfiguring with /run/systemd/network/10-netplan-eno1.network.
Nov 03 07:29:59 <hostname> systemd-networkd[1867]: eno1: DHCPv6 lease lost
Nov 03 07:29:59 <hostname> systemd-networkd[1867]: idrac: Configuring with /run/systemd/network/10-netplan-idrac.network.
Nov 03 07:29:59 <hostname> systemd-networkd[1867]: idrac: DHCPv6 lease lost
Nov 03 07:29:59 <hostname> systemd-networkd[1867]: eno2: Configuring with /run/systemd/network/10-netplan-eno2.network.
Nov 03 07:29:59 <hostname> systemd-networkd[1867]: eno2: DHCPv6 lease lost
Nov 03 07:29:59 <hostname> systemd-networkd[1867]: eno1: Configuring with /run/systemd/network/10-netplan-eno1.network.
Nov 03 07:29:59 <hostname> systemd-networkd[1867]: eno1: DHCPv6 lease lost
Nov 03 07:30:32 <hostname> sudo[3066]:   <username> : TTY=tty1 ; PWD=/home/<username> ; USER=root ; COMMAND=/usr/sbin/netplan apply
Nov 03 07:30:33 <hostname> systemd-networkd[1867]: eno2: Reconfiguring with /run/systemd/network/10-netplan-eno2.network.
Nov 03 07:30:33 <hostname> systemd-networkd[1867]: eno2: DHCPv6 lease lost
Nov 03 07:30:33 <hostname> systemd-networkd[1867]: idrac: Reconfiguring with /run/systemd/network/10-netplan-idrac.network.
Nov 03 07:30:33 <hostname> systemd-networkd[1867]: idrac: DHCPv6 lease lost
Nov 03 07:30:33 <hostname> systemd-networkd[1867]: eno1: Reconfiguring with /run/systemd/network/10-netplan-eno1.network.
Nov 03 07:30:33 <hostname> systemd-networkd[1867]: eno1: DHCPv6 lease lost
Nov 03 07:30:33 <hostname> systemd-networkd[1867]: idrac: Configuring with /run/systemd/network/10-netplan-idrac.network.
Nov 03 07:30:33 <hostname> systemd-networkd[1867]: idrac: DHCPv6 lease lost
Nov 03 07:30:33 <hostname> systemd-networkd[1867]: eno2: Configuring with /run/systemd/network/10-netplan-eno2.network.
Nov 03 07:30:33 <hostname> systemd-networkd[1867]: eno2: DHCPv6 lease lost
Nov 03 07:30:33 <hostname> systemd-networkd[1867]: eno1: Reconfiguring with /run/systemd/network/10-netplan-eno1.network.
Nov 03 07:30:33 <hostname> systemd-networkd[1867]: eno1: DHCPv6 lease lost
Nov 03 07:31:03 <hostname> sudo[4270]:   <username> : TTY=tty1 ; PWD=/home/<username> ; USER=root ; COMMAND=/usr/bin/nano /etc/netplan/00-installer-config.yaml
Nov 03 07:31:35 <hostname> sudo[4294]:   <username> : TTY=tty1 ; PWD=/home/<username> ; USER=root ; COMMAND=/usr/sbin/netplan apply
Nov 03 07:31:36 <hostname> systemd-networkd[1867]: eno2: Reconfiguring with /run/systemd/network/10-netplan-eno2.network.
Nov 03 07:31:36 <hostname> systemd-networkd[1867]: eno2: DHCPv6 lease lost
Nov 03 07:31:36 <hostname> systemd-networkd[1867]: idrac: Reconfiguring with /run/systemd/network/10-netplan-idrac.network.
Nov 03 07:31:36 <hostname> systemd-networkd[1867]: idrac: DHCPv6 lease lost
Nov 03 07:31:36 <hostname> systemd-networkd[1867]: eno1: Reconfiguring with /run/systemd/network/10-netplan-eno1.network.
Nov 03 07:31:36 <hostname> systemd-networkd[1867]: eno1: DHCPv6 lease lost
Nov 03 07:31:36 <hostname> systemd-networkd[1867]: eno1: Configuring with /run/systemd/network/10-netplan-eno1.network.
Nov 03 07:31:36 <hostname> systemd-networkd[1867]: eno1: DHCPv6 lease lost
Nov 03 07:31:36 <hostname> systemd-networkd[1867]: eno2: Configuring with /run/systemd/network/10-netplan-eno2.network.
Nov 03 07:31:36 <hostname> systemd-networkd[1867]: eno2: DHCPv6 lease lost
Nov 03 07:31:36 <hostname> systemd-networkd[1867]: idrac: Configuring with /run/systemd/network/10-netplan-idrac.network.
Nov 03 07:31:36 <hostname> systemd-networkd[1867]: idrac: DHCPv6 lease lost
Nov 03 07:34:19 <hostname> systemd[2884]: Started GnuPG network certificate management daemon.
Nov 03 07:34:48 <hostname> sudo[4553]:   <username> : TTY=pts/0 ; PWD=/home/<username> ; USER=root ; COMMAND=/usr/bin/gpg --keyserver pool.sks-keyservers.net --recv-key 1285491434D8786F
Nov 03 07:38:38 <hostname> networkd-dispatcher[1913]: WARNING:Unknown index 6 seen, reloading interface list
Nov 03 07:38:38 <hostname> systemd-networkd[1867]: veth9ee8570: Link UP
Nov 03 07:38:39 <hostname> systemd-networkd[1867]: veth9ee8570: Gained carrier
Nov 03 07:38:39 <hostname> systemd-networkd[1867]: docker0: Gained carrier
tigerkzr avatar
tn flag
I have fixed the problem but it's not very satisfying. Switching to DHCP4 and using reserved IPs results in a working network after boot. I'm not really happy with it but I guess it will work.
mangohost

Post an answer

Most people don’t grasp that asking a lot of questions unlocks learning and improves interpersonal bonding. In Alison’s studies, for example, though people could accurately recall how many questions had been asked in their conversations, they didn’t intuit the link between questions and liking. Across four studies, in which participants were engaged in conversations themselves or read transcripts of others’ conversations, people tended not to realize that question asking would influence—or had influenced—the level of amity between the conversationalists.