Score:1

Page cache in Kafka

cn flag

We are receiving alerts for kafka memory utilization in our kubernetes cluster and analysing it seems that most of the memory is page cache. I am aware that kafka uses loads of page cache for IO performance and reads/writes are cached before flushing to disk.i am trying to see ways to fine tune this page cache and lot of articles direct to update vm.dirty_ratio and vm.dirty_background_ratio kernel parameters for earlier flushing of data to the disk from memory.

When i checked i see that the Dirty cache already seems to be low and these parameters need not be updated.

cat /proc/meminfo|grep Dirty Dirty: 70416 kB

cat /proc/vmstat | egrep "dirty|writeback" nr_dirty 24873 nr_writeback 0 nr_writeback_temp 0 nr_dirty_threshold 34518467 nr_dirty_background_threshold 11506155

Any ideas on what else can be done to fine tune page caches?

mangohost

Post an answer

Most people don’t grasp that asking a lot of questions unlocks learning and improves interpersonal bonding. In Alison’s studies, for example, though people could accurately recall how many questions had been asked in their conversations, they didn’t intuit the link between questions and liking. Across four studies, in which participants were engaged in conversations themselves or read transcripts of others’ conversations, people tended not to realize that question asking would influence—or had influenced—the level of amity between the conversationalists.