Score:1

One IP in subnet not reachable from outside, but others work fine

mp flag

We had virtual host crash the other day, which caused a few VMs to reset and come back online. One of them, after coming back up, is not reachable on the network from outside the subnet it lives on. However, it is reachable from things in the same subnet. Nothing was changed on the VM other than it rebooted and migrated to a different host; other VMs on the same host are not having any network issues. We have tried migrating it to other host in the cluster but no change.

Oddly, if I apply a different IP address in the same subnet to the VM, it becomes reachable on that IP. It's as if just the one IP address is somehow broken or blocked. There are no firewall rules on the VM, and since it's in the same subnet, the gateway and netmask remain the same.

Normal configuration, not working:

IP 10.20.30.40/26; Gateway 10.20.30.1 - only reachable from other VMs in 10.20.30.0/26; it can ping gateway but nothing past it

Test configuration, same VM, reachable from outside:

IP 10.20.30.41/26; Gateway 10.20.30.1 - Reachable from outside 10.20.30.0/26 with no issues, and can reach out as well

I'm struggling to understand what could be wrong with the "original" IP that could be causing this. If it's something outside the VM I can have the Network team check, but I have no idea what to even ask them. What should I be checking?

in flag
double check subnet masks, trace it, tcpdump on each router, remember routing in both directions, also remember firewalls and also things like fail2ban and other rate limiting rules.
Brandon Xavier avatar
us flag
Sounds like a bad entry in an ARP cache - try clearing the ARP cache on the gateway device.
cn flag
Is it using DHCP or static IP? Has it come up with a lease that has the wrong subnet mask? What routes does it say it has?
mangohost

Post an answer

Most people don’t grasp that asking a lot of questions unlocks learning and improves interpersonal bonding. In Alison’s studies, for example, though people could accurately recall how many questions had been asked in their conversations, they didn’t intuit the link between questions and liking. Across four studies, in which participants were engaged in conversations themselves or read transcripts of others’ conversations, people tended not to realize that question asking would influence—or had influenced—the level of amity between the conversationalists.