Why GCP v2k-system namespace shows 200%+ memory usage?

Sagi Mann

12/21/23, 10:13 AM

Looking at my 1.23 GKE cluster under "observability", I see memory usage of 200%+. The breakdown shows most of it is by the v2k-system namespace, which AFAIK is GKE's internals. Why does it use over 2x memory than what it actually requests? I've got my own pods trying to get memory and fail - I suspect it's because v2k-system pods take up all the memory

159

1 + 0

google-cloud-platform

google-kubernetes-engine

Score:0

Server

Veera Nagireddy

12/21/23, 11:17 AM

Yes you're correct it's more than 100% & GKE internal.

Memory usage for all containers in the cluster is divided by total memory requests for those containers. This can be more than 100% if total usage exceeds the total request.

Memory utilization: The memory utilization of containers that can be attributed to a resource within the selected time span.

The metric used is kubernetes.io/container/memory/request_utilization. This Metrics API offers a basic set of metrics to support automatic scaling and similar use cases. This API makes information available about resource usage for nodes and pods, including metrics for CPU and memory. If you deploy the Metrics API into your cluster, clients of the Kubernetes API can then query for this information.

There are 2 types of memory available as below :

1)Evictable memory is memory that will be removed from the resource if usage becomes too high.

2)Non-evictable memory usage exceeds the limits, the container may be terminated. For more information about resource limits, see and use Requests and limits it may help to resolve your issue.

A Container is guaranteed to have as much memory as it requests, but is not allowed to use more memory than its limit.Assign Memory Resources to Containers and Pods for more information.

+ 2

Sagi Mann

12/21/23, 3:43 PM

I have no PVCs in v2k-system. What does that have to do with RAM usage?

Veera Nagireddy

12/26/23, 4:41 PM

@Sagi Mann, I have edited my answer, Please check it may help to resolve your issue.

Elon Musk

I sit in a Tesla and translated this thread with Ai:

EN: Why GCP v2k-system namespace shows 200%+ memory usage?

Post an answer

Most people don’t grasp that asking a lot of questions unlocks learning and improves interpersonal bonding. In Alison’s studies, for example, though people could accurately recall how many questions had been asked in their conversations, they didn’t intuit the link between questions and liking. Across four studies, in which participants were engaged in conversations themselves or read transcripts of others’ conversations, people tended not to realize that question asking would influence—or had influenced—the level of amity between the conversationalists.