Score:0

openstack cannot ssh onto instance on the provider network

us flag

I have set up openstack yoga installation and configure the networks exactly as mentioned in tutorials as mentioend in here https://docs.openstack.org/install-guide/launch-instance-networks-provider.html

I have tried to follow cirros test launch instance following https://docs.openstack.org/install-guide/launch-instance-provider.html however i cannot seem to ping the instance ip or ssh to it.

on the controller this is my routing table

$ route -n
Kernel IP routing table
Destination     Gateway         Genmask         Flags Metric Ref    Use Iface
0.0.0.0         10.0.0.1        0.0.0.0         UG    0      0        0 enp1s0
0.0.0.0         203.0.113.1     0.0.0.0         UG    100    0        0 brq5425fcec-c8
10.0.0.0        0.0.0.0         255.255.255.0   U     0      0        0 enp1s0
192.168.122.0   0.0.0.0         255.255.255.0   U     0      0        0 virbr0
203.0.113.0     0.0.0.0         255.255.255.0   U     0      0        0 brq5425fcec-c8

these are the commands I ran to configure the networks in openstack

$ openstack network create  --share --external \
  --provider-physical-network provider \
  --provider-network-type flat provider
+---------------------------+--------------------------------------+
| Field                     | Value                                |
+---------------------------+--------------------------------------+
| admin_state_up            | UP                                   |
| availability_zone_hints   |                                      |
| availability_zones        |                                      |
| created_at                | 2023-01-06T00:27:53Z                 |
| description               |                                      |
| dns_domain                | None                                 |
| id                        | 5425fcec-c8e4-4fc2-b524-75f5003222c1 |
| ipv4_address_scope        | None                                 |
| ipv6_address_scope        | None                                 |
| is_default                | False                                |
| is_vlan_transparent       | None                                 |
| mtu                       | 1500                                 |
| name                      | provider                             |
| port_security_enabled     | True                                 |
| project_id                | 51c9dda8d07b4b388970e1373afb3f92     |
| provider:network_type     | flat                                 |
| provider:physical_network | provider                             |
| provider:segmentation_id  | None                                 |
| qos_policy_id             | None                                 |
| revision_number           | 1                                    |
| router:external           | External                             |
| segments                  | None                                 |
| shared                    | True                                 |
| status                    | ACTIVE                               |
| subnets                   |                                      |
| tags                      |                                      |
| updated_at                | 2023-01-06T00:27:53Z                 |
+---------------------------+--------------------------------------+

$ openstack subnet create --network provider \
  --allocation-pool start=203.0.113.50,end=203.0.113.100 \
  --dns-nameserver 8.8.4.4 --gateway 203.0.113.1 \
  --subnet-range 203.0.113.0/24 provider
+----------------------+--------------------------------------+
| Field                | Value                                |
+----------------------+--------------------------------------+
| allocation_pools     | 203.0.113.50-203.0.113.100           |
| cidr                 | 203.0.113.0/24                       |
| created_at           | 2023-01-06T00:29:48Z                 |
| description          |                                      |
| dns_nameservers      | 8.8.4.4                              |
| dns_publish_fixed_ip | None                                 |
| enable_dhcp          | True                                 |
| gateway_ip           | 203.0.113.1                          |
| host_routes          |                                      |
| id                   | 3bd17c5e-e103-435a-94a4-a8578361c9c6 |
| ip_version           | 4                                    |
| ipv6_address_mode    | None                                 |
| ipv6_ra_mode         | None                                 |
| name                 | provider                             |
| network_id           | 5425fcec-c8e4-4fc2-b524-75f5003222c1 |
| project_id           | 51c9dda8d07b4b388970e1373afb3f92     |
| revision_number      | 0                                    |
| segment_id           | None                                 |
| service_types        |                                      |
| subnetpool_id        | None                                 |
| tags                 |                                      |
| updated_at           | 2023-01-06T00:29:48Z                 |
+----------------------+--------------------------------------+

$ openstack network create selfservice
+---------------------------+--------------------------------------+
| Field                     | Value                                |
+---------------------------+--------------------------------------+
| admin_state_up            | UP                                   |
| availability_zone_hints   |                                      |
| availability_zones        |                                      |
| created_at                | 2023-01-06T00:30:03Z                 |
| description               |                                      |
| dns_domain                | None                                 |
| id                        | 068e429e-66dc-4212-a011-ae46a476dc6d |
| ipv4_address_scope        | None                                 |
| ipv6_address_scope        | None                                 |
| is_default                | False                                |
| is_vlan_transparent       | None                                 |
| mtu                       | 1450                                 |
| name                      | selfservice                          |
| port_security_enabled     | True                                 |
| project_id                | 51c9dda8d07b4b388970e1373afb3f92     |
| provider:network_type     | vxlan                                |
| provider:physical_network | None                                 |
| provider:segmentation_id  | 475                                  |
| qos_policy_id             | None                                 |
| revision_number           | 1                                    |
| router:external           | Internal                             |
| segments                  | None                                 |
| shared                    | False                                |
| status                    | ACTIVE                               |
| subnets                   |                                      |
| tags                      |                                      |
| updated_at                | 2023-01-06T00:30:03Z                 |
+---------------------------+--------------------------------------+

$ openstack subnet create --network selfservice \
  --dns-nameserver 8.8.4.4 --gateway 172.16.1.1 \
  --subnet-range 172.16.1.0/24 selfservice
+----------------------+--------------------------------------+
| Field                | Value                                |
+----------------------+--------------------------------------+
| allocation_pools     | 172.16.1.2-172.16.1.254              |
| cidr                 | 172.16.1.0/24                        |
| created_at           | 2023-01-06T00:30:27Z                 |
| description          |                                      |
| dns_nameservers      | 8.8.4.4                              |
| dns_publish_fixed_ip | None                                 |
| enable_dhcp          | True                                 |
| gateway_ip           | 172.16.1.1                           |
| host_routes          |                                      |
| id                   | 9aeae112-e856-4846-b853-93c9e5a355ea |
| ip_version           | 4                                    |
| ipv6_address_mode    | None                                 |
| ipv6_ra_mode         | None                                 |
| name                 | selfservice                          |
| network_id           | 068e429e-66dc-4212-a011-ae46a476dc6d |
| project_id           | 51c9dda8d07b4b388970e1373afb3f92     |
| revision_number      | 0                                    |
| segment_id           | None                                 |
| service_types        |                                      |
| subnetpool_id        | None                                 |
| tags                 |                                      |
| updated_at           | 2023-01-06T00:30:27Z                 |
+----------------------+--------------------------------------+

$ openstack router create router
+-------------------------+--------------------------------------+
| Field                   | Value                                |
+-------------------------+--------------------------------------+
| admin_state_up          | UP                                   |
| availability_zone_hints |                                      |
| availability_zones      |                                      |
| created_at              | 2023-01-06T00:32:37Z                 |
| description             |                                      |
| distributed             | False                                |
| external_gateway_info   | null                                 |
| flavor_id               | None                                 |
| ha                      | False                                |
| id                      | 6dc070cd-c63e-4261-9f10-356298fcc35b |
| name                    | router                               |
| project_id              | 51c9dda8d07b4b388970e1373afb3f92     |
| revision_number         | 1                                    |
| routes                  |                                      |
| status                  | ACTIVE                               |
| tags                    |                                      |
| updated_at              | 2023-01-06T00:32:37Z                 |
+-------------------------+--------------------------------------+

# replace with ids
# openstack router add subnet router selfservice

openstack router add subnet 6dc070cd-c63e-4261-9f10-356298fcc35b 9aeae112-e856-4846-b853-93c9e5a355ea

#replace router and provider with id's
#openstack router set router --external-gateway provider
openstack router set 6dc070cd-c63e-4261-9f10-356298fcc35b --external-gateway 5425fcec-c8e4-4fc2-b524-75f5003222c1

launch cirros

$ openstack server create --flavor m1.nano --image cirros \
  --nic net-id=5425fcec-c8e4-4fc2-b524-75f5003222c1 --security-group default \
  --key-name openstack provider-instance
+-------------------------------------+---------------------------------------------+
| Field                               | Value                                         |
+-------------------------------------+---------------------------------------------+
| OS-DCF:diskConfig                   | MANUAL                                        |
| OS-EXT-AZ:availability_zone         |                                               |
| OS-EXT-SRV-ATTR:host                | None                                          |
| OS-EXT-SRV-ATTR:hypervisor_hostname | None                                          |
| OS-EXT-SRV-ATTR:instance_name       |                                               |
| OS-EXT-STS:power_state              | NOSTATE                                       |
| OS-EXT-STS:task_state               | scheduling                                    |
| OS-EXT-STS:vm_state                 | building                                      |
| OS-SRV-USG:launched_at              | None                                          |
| OS-SRV-USG:terminated_at            | None                                          |
| accessIPv4                          |                                               |
| accessIPv6                          |                                               |
| addresses                           |                                               |
| adminPass                           | NU6D2Cdqt3jL                                  |
| config_drive                        |                                               |
| created                             | 2023-01-06T00:44:35Z                          |
| flavor                              | m1.nano (0)                                   |
| hostId                              |                                               |
| id                                  | 0a1c9d97-5bd6-4589-8e4d-03eaf55469cb          |
| image                               | cirros (2a976ae1-3f55-4c4e-afb1-53200856be4c) |
| key_name                            | openstack                                     |
| name                                | provider-instance                             |
| progress                            | 0                                             |
| project_id                          | 51c9dda8d07b4b388970e1373afb3f92              |
| properties                          |                                               |
| security_groups                     | name='dd87e8fe-4285-4f6a-8b49-2bbbc04692b6'   |
| status                              | BUILD                                         |
| updated                             | 2023-01-06T00:44:35Z                          |
| user_id                             | 14efbfa5416c4d7b9ac641775406f640              |
| volumes_attached                    |                                               |
+-------------------------------------+---------------------------------------------+

This is my routing table on my host

route -n
Kernel IP routing table
Destination     Gateway         Genmask         Flags Metric Ref    Use Iface
0.0.0.0         192.168.192.1   0.0.0.0         UG    0      0        0 eno1
10.0.0.0        0.0.0.0         255.255.255.0   U     0      0        0 virbr1
10.33.242.0     0.0.0.0         255.255.255.0   U     0      0        0 lxdbr0
172.17.0.0      0.0.0.0         255.255.0.0     U     0      0        0 docker0
192.168.122.0   0.0.0.0         255.255.255.0   U     0      0        0 virbr0
192.168.192.0   0.0.0.0         255.255.255.0   U     0      0        0 eno1
192.168.192.128 0.0.0.0         255.255.255.192 U     0      0        0 *
192.168.192.129 0.0.0.0         255.255.255.255 UH    0      0        0 calid7cea7d52cd
192.168.192.156 0.0.0.0         255.255.255.255 UH    0      0        0 caliec3968549ad
192.168.192.158 0.0.0.0         255.255.255.255 UH    0      0        0 cali8fa92343d15
192.168.192.160 0.0.0.0         255.255.255.255 UH    0      0        0 cali38eb436791d
192.168.192.161 0.0.0.0         255.255.255.255 UH    0      0        0 cali8e0aabdc931
192.168.192.163 0.0.0.0         255.255.255.255 UH    0      0        0 cali6e78422f6cc
192.168.192.164 0.0.0.0         255.255.255.255 UH    0      0        0 cali8ed7bfb058d
192.168.192.166 0.0.0.0         255.255.255.255 UH    0      0        0 cali7f3d9c9dd8f
192.168.192.168 0.0.0.0         255.255.255.255 UH    0      0        0 caliaed6a691aa5
192.168.192.170 0.0.0.0         255.255.255.255 UH    0      0        0 cali96887bb4547
192.168.192.179 0.0.0.0         255.255.255.255 UH    0      0        0 cali25446452552
192.168.192.180 0.0.0.0         255.255.255.255 UH    0      0        0 calie0859b9aa4e
192.168.192.181 0.0.0.0         255.255.255.255 UH    0      0        0 cali533dd1634a8
192.168.192.182 0.0.0.0         255.255.255.255 UH    0      0        0 cali8eda4279482
192.168.192.183 0.0.0.0         255.255.255.255 UH    0      0        0 cali8dde5c8764d
192.168.192.184 0.0.0.0         255.255.255.255 UH    0      0        0 cali5e0abd36619
192.168.192.185 0.0.0.0         255.255.255.255 UH    0      0        0 caliad9985c9985
192.168.192.186 0.0.0.0         255.255.255.255 UH    0      0        0 cali5148d3c4b2b
192.168.192.187 0.0.0.0         255.255.255.255 UH    0      0        0 cali863d578c925
192.168.192.188 0.0.0.0         255.255.255.255 UH    0      0        0 cali3b5cb83e94b
192.168.192.190 0.0.0.0         255.255.255.255 UH    0      0        0 cali37a22f17c60
203.0.113.0     0.0.0.0         255.255.255.0   U     0      0        0 virbr2

The provider network is 203.0.113.0/24 dev virbr2 The management network is 10.0.0.0/24 dev virbr1

However on the controller I only see virbr0, i thought i should see virbr1 as well?

I have set in netplan on controller

$ cat /etc/netplan/*
# This is the network config written by 'subiquity'
network:
  ethernets:
    enp1s0:
      addresses:
      - 10.0.0.11/24
      gateway4: 10.0.0.1
      nameservers:
        addresses:
        - 8.8.8.8
        - 8.8.4.4
        - 10.0.0.1
        search: []
  version: 2
network:
  ethernets:
    enp7s0:
      addresses:
      - 203.0.113.11/24
      gateway4: 203.0.113.1
      nameservers:
        addresses:
        - 8.8.8.8
        - 8.8.4.4
        - 203.0.113.1
        search: []
  version: 2


$ ifconfig
brq068e429e-66: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1450
        inet6 fe80::80ac:67ff:fe6f:2102  prefixlen 64  scopeid 0x20<link>
        ether 82:ac:67:6f:21:02  txqueuelen 1000  (Ethernet)
        RX packets 6  bytes 304 (304.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 17  bytes 1334 (1.3 KB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

brq5425fcec-c8: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet 203.0.113.11  netmask 255.255.255.0  broadcast 203.0.113.255
        inet6 fe80::f88b:dbff:fe54:ffc5  prefixlen 64  scopeid 0x20<link>
        ether fa:8b:db:54:ff:c5  txqueuelen 1000  (Ethernet)
        RX packets 1315  bytes 51990 (51.9 KB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 218  bytes 20116 (20.1 KB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

enp1s0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet 10.0.0.11  netmask 255.255.255.0  broadcast 10.0.0.255
        inet6 fe80::5054:ff:fee3:79a  prefixlen 64  scopeid 0x20<link>
        ether 52:54:00:e3:07:9a  txqueuelen 1000  (Ethernet)
        RX packets 48741  bytes 22647001 (22.6 MB)
        RX errors 0  dropped 17  overruns 0  frame 0
        TX packets 36288  bytes 21971096 (21.9 MB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

enp7s0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet6 fe80::5054:ff:feb4:91d4  prefixlen 64  scopeid 0x20<link>
        ether 52:54:00:b4:91:d4  txqueuelen 1000  (Ethernet)
        RX packets 4704  bytes 257069 (257.0 KB)
        RX errors 0  dropped 17  overruns 0  frame 0
        TX packets 691  bytes 61512 (61.5 KB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

lo: flags=73<UP,LOOPBACK,RUNNING>  mtu 65536
        inet 127.0.0.1  netmask 255.0.0.0
        inet6 ::1  prefixlen 128  scopeid 0x10<host>
        loop  txqueuelen 1000  (Local Loopback)
        RX packets 445098  bytes 143120042 (143.1 MB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 445098  bytes 143120042 (143.1 MB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

tap0321b9cc-5a: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1450
        ether a6:2f:e3:7f:e1:b7  txqueuelen 1000  (Ethernet)
        RX packets 13  bytes 998 (998.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 4  bytes 280 (280.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

tap75ec3072-1f: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        ether 92:5b:17:36:7b:cf  txqueuelen 1000  (Ethernet)
        RX packets 28  bytes 2104 (2.1 KB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 1088  bytes 57946 (57.9 KB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

tap9605a975-ea: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1450
        ether 62:28:91:9d:c6:92  txqueuelen 1000  (Ethernet)
        RX packets 7  bytes 702 (702.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 21  bytes 1502 (1.5 KB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

tape84937c2-96: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        ether a6:ec:4e:66:c3:9f  txqueuelen 1000  (Ethernet)
        RX packets 81  bytes 11861 (11.8 KB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 1426  bytes 79954 (79.9 KB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

virbr0: flags=4099<UP,BROADCAST,MULTICAST>  mtu 1500
        inet 192.168.122.1  netmask 255.255.255.0  broadcast 192.168.122.255
        ether 52:54:00:f9:e5:18  txqueuelen 1000  (Ethernet)
        RX packets 0  bytes 0 (0.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 0  bytes 0 (0.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

vxlan-475: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1450
        ether 7a:b4:67:47:f5:17  txqueuelen 1000  (Ethernet)
        RX packets 0  bytes 0 (0.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 0  bytes 0 (0.0 B)
        TX errors 0  dropped 23 overruns 0  carrier 0  collisions 0
I sit in a Tesla and translated this thread with Ai:

mangohost

Post an answer

Most people don’t grasp that asking a lot of questions unlocks learning and improves interpersonal bonding. In Alison’s studies, for example, though people could accurately recall how many questions had been asked in their conversations, they didn’t intuit the link between questions and liking. Across four studies, in which participants were engaged in conversations themselves or read transcripts of others’ conversations, people tended not to realize that question asking would influence—or had influenced—the level of amity between the conversationalists.