K3S can't pull public docker hub images

locose

2/12/23, 7:14 AM

K3S cluster is failling to pull public docker hub images. in this instance i will user linuxserver/webtop which presents the error

Failed to pull image "linuxserver/webtop": rpc error: code = Unknown desc = failed to pull and unpack image "docker.io/linuxserver/webtop:latest": failed to copy: httpReaderSeeker: failed open: failed to do request: Get "https://production.cloudflare.docker.com/registry-v2/docker/registry/v2/blobs/sha256/93/935ea2a17ae86691c14df443e21f3c69a6f75609894f8cfe9378b66e39c0d752/data?verify=1634025162-%2Bc4663u0w0ArAbfgBm4aFRfJUh4%3D": dial tcp: lookup production.cloudflare.docker.com: no such host

i have found lots of similar threads to this one but they are all specific to trying to pull private images which causes this problem. So although could be related i think it is something else.

I did think it may be related to rate limiting on the dockerhub site but i have tried pulling the image directly from all of the nodes individually using docker pull and it works fine so seems the problem is elsewhere.

i have tried adding my docker credentials to the deployment with imagePullSecrets: but it didn't resolve.

due to the error i feel as though it's worth mentioning that on the nodes i'm using 1.1.1.1 as the dns

If anyone has any idea what could be the problem would be appreciated.

also seems to be intermittent for example here.

Events:
  Type     Reason     Age                   From               Message
  ----     ------     ----                  ----               -------
  Normal   Scheduled  7m2s                  default-scheduler  Successfully assigned default/dnstest-l6dh2 to node-3
  Warning  Failed     7m1s                  kubelet            Failed to pull image "busybox:1.28": rpc error: code = Unknown desc = failed to pull and unpack image "docker.io/library/busybox:1.28": failed to resolve reference "docker.io/library/busybox:1.28": failed to do request: Head "https://registry-1.docker.io/v2/library/busybox/manifests/1.28": dial tcp: lookup registry-1.docker.io: no such host
  Warning  Failed     7m1s                  kubelet            Error: ErrImagePull
  Normal   BackOff    7m1s                  kubelet            Back-off pulling image "busybox:1.28"
  Warning  Failed     7m1s                  kubelet            Error: ImagePullBackOff
  Normal   Pulling    6m49s (x2 over 7m2s)  kubelet            Pulling image "busybox:1.28"
  Normal   Pulled     6m47s                 kubelet            Successfully pulled image "busybox:1.28" in 1.3937859s
  Normal   Created    6m47s                 kubelet            Created container alpine
  Normal   Started    6m47s                 kubelet            Started container alpine

526

0 + 0

kubernetes

docker-registry

k3s

Gerald Schneider

2/12/23, 7:17 AM

Your node can't resolve `production.cloudflare.docker.com`. You have a DNS issue.

locose

2/12/23, 7:29 AM

yes but on the node it resolves it fine as i can pull the image so where do i need to change the dns?

Evan Carroll

6/14/23, 4:41 PM

Did you ever find the problem?

locose

6/24/23, 9:32 AM

No unfortunately not.

Elon Musk

I sit in a Tesla and translated this thread with Ai:

EN: K3S can't pull public docker hub images

TH: K3S ไม่สามารถดึงอิมเมจฮับนักเทียบท่าสาธารณะ

RO: K3S nu poate extrage imagini publice de hub docker

RU: K3S не может извлекать образы общедоступного докер-хаба

VI: K3S không thể kéo hình ảnh trung tâm docker công cộng

Post an answer

Most people don’t grasp that asking a lot of questions unlocks learning and improves interpersonal bonding. In Alison’s studies, for example, though people could accurately recall how many questions had been asked in their conversations, they didn’t intuit the link between questions and liking. Across four studies, in which participants were engaged in conversations themselves or read transcripts of others’ conversations, people tended not to realize that question asking would influence—or had influenced—the level of amity between the conversationalists.