Score:0

K3S master does not start due to v1.Event to any object conversion error

mt flag

I'm running k3s 1.26.4 on a small 4 nodes home lab cluster (1 master/worker + 3 workers). Today, the master node crashed, and a forced reboot was the only solution. Since then, the master node refuses to start correctly.

In the logs, I can see a lot of v1.Event to conversion errors. Here is an extract:

May 21 18:37:31 oc-1 k3s[6275]: W0521 18:37:31.123758    6275 reflector.go:424] storage/cacher.go:/leases: failed to list *coordination.Lease: converting (v1.Event) to (coordination.Lease): unknown conversion
May 21 18:37:31 oc-1 k3s[6275]: E0521 18:37:31.123782    6275 cacher.go:450] cacher (leases.coordination.k8s.io): unexpected ListAndWatch error: failed to list *coordination.Lease: converting (v1.Event) to (coordination.Lease): unknown conversion; reinitiali>
May 21 18:37:31 oc-1 k3s[6275]: W0521 18:37:31.130061    6275 reflector.go:424] storage/cacher.go:/endpointslices: failed to list *discovery.EndpointSlice: converting (v1.Event) to (discovery.EndpointSlice): unknown conversion
May 21 18:37:31 oc-1 k3s[6275]: E0521 18:37:31.130084    6275 cacher.go:450] cacher (endpointslices.discovery.k8s.io): unexpected ListAndWatch error: failed to list *discovery.EndpointSlice: converting (v1.Event) to (discovery.EndpointSlice): unknown convers>
May 21 18:37:31 oc-1 k3s[6275]: W0521 18:37:31.346605    6275 reflector.go:424] storage/cacher.go:/replicasets: failed to list *apps.ReplicaSet: converting (v1.Event) to (apps.ReplicaSet): unknown conversion
May 21 18:37:31 oc-1 k3s[6275]: E0521 18:37:31.346634    6275 cacher.go:450] cacher (replicasets.apps): unexpected ListAndWatch error: failed to list *apps.ReplicaSet: converting (v1.Event) to (apps.ReplicaSet): unknown conversion; reinitializing...
May 21 18:37:31 oc-1 k3s[6275]: W0521 18:37:31.899668    6275 reflector.go:424] storage/cacher.go:/services/endpoints: failed to list *core.Endpoints: converting (v1.Event) to (core.Endpoints): unknown conversion
May 21 18:37:31 oc-1 k3s[6275]: E0521 18:37:31.899694    6275 cacher.go:450] cacher (endpoints): unexpected ListAndWatch error: failed to list *core.Endpoints: converting (v1.Event) to (core.Endpoints): unknown conversion; reinitializing...
May 21 18:37:31 oc-1 k3s[6275]: W0521 18:37:31.969332    6275 reflector.go:424] storage/cacher.go:/pods: failed to list *core.Pod: converting (v1.Event) to (core.Pod): unknown conversion
May 21 18:37:31 oc-1 k3s[6275]: E0521 18:37:31.969396    6275 cacher.go:450] cacher (pods): unexpected ListAndWatch error: failed to list *core.Pod: converting (v1.Event) to (core.Pod): unknown conversion; reinitializing...
May 21 18:37:32 oc-1 k3s[6275]: W0521 18:37:32.130119    6275 reflector.go:424] storage/cacher.go:/leases: failed to list *coordination.Lease: converting (v1.Event) to (coordination.Lease): unknown conversion
May 21 18:37:32 oc-1 k3s[6275]: E0521 18:37:32.130154    6275 cacher.go:450] cacher (leases.coordination.k8s.io): unexpected ListAndWatch error: failed to list *coordination.Lease: converting (v1.Event) to (coordination.Lease): unknown conversion; reinitiali>
May 21 18:37:32 oc-1 k3s[6275]: W0521 18:37:32.136954    6275 reflector.go:424] storage/cacher.go:/endpointslices: failed to list *discovery.EndpointSlice: converting (v1.Event) to (discovery.EndpointSlice): unknown conversion
May 21 18:37:32 oc-1 k3s[6275]: E0521 18:37:32.136977    6275 cacher.go:450] cacher (endpointslices.discovery.k8s.io): unexpected ListAndWatch error: failed to list *discovery.EndpointSlice: converting (v1.Event) to (discovery.EndpointSlice): unknown convers>
May 21 18:37:32 oc-1 k3s[6275]: W0521 18:37:32.357950    6275 reflector.go:424] storage/cacher.go:/replicasets: failed to list *apps.ReplicaSet: converting (v1.Event) to (apps.ReplicaSet): unknown conversion
May 21 18:37:32 oc-1 k3s[6275]: E0521 18:37:32.358095    6275 cacher.go:450] cacher (replicasets.apps): unexpected ListAndWatch error: failed to list *apps.ReplicaSet: converting (v1.Event) to (apps.ReplicaSet): unknown conversion; reinitializing...
May 21 18:37:32 oc-1 k3s[6275]: E0521 18:37:32.514666    6275 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"converting (v1.Event) to (core.Pod): unknown conversion"}: converting (v1.Event) to (core.Pod): unkno>
May 21 18:37:32 oc-1 k3s[6275]: W0521 18:37:32.514991    6275 reflector.go:424] k8s.io/[email protected]/tools/cache/reflector.go:169: failed to list *v1.Pod: converting (v1.Event) to (core.Pod): unknown conversion
May 21 18:37:32 oc-1 k3s[6275]: E0521 18:37:32.515016    6275 reflector.go:140] k8s.io/[email protected]/tools/cache/reflector.go:169: Failed to watch *v1.Pod: failed to list *v1.Pod: converting (v1.Event) to (core.Pod): unknown conversion

Has anyone already had a similar issue, and how you solved it ? I have to admit, I'm a bit lost on what is happening here...

I sit in a Tesla and translated this thread with Ai:

mangohost

Post an answer

Most people don’t grasp that asking a lot of questions unlocks learning and improves interpersonal bonding. In Alison’s studies, for example, though people could accurately recall how many questions had been asked in their conversations, they didn’t intuit the link between questions and liking. Across four studies, in which participants were engaged in conversations themselves or read transcripts of others’ conversations, people tended not to realize that question asking would influence—or had influenced—the level of amity between the conversationalists.