Score:0

Is there any way in aws to find if my ec2 instances is fully utlized for type which i am using?

in flag

I have may aws ec2 instances running in dev account and most of the instances i see cpu utlization doesn't go most of the time more than 5% . For example even in one of the kubernetes cluster where kafka is running it is not exceeding 5 or max 6% of cpu utlization when we used t3.xlarge (16gb ram and 4vcpu) machine for kafka cluster setup.

So my question is there an way to find out if i am really fully utlizing the instances for which we have opted for so that i can downgrade my instances type to low cost one if it is not fully utlized. I saw aws compute optimizer but that is saying most of the instances are optimized only 1 or 2 it shows as not optimized with under utlized.

Also most of the application like may be kafka are by default requesting 8gb ram and good cpu for better usage but the cloud watch chart doesn't actually show as if its fully utlized.

Hence is there any way to tacle this and reduce the ec2 costing in aws?

Score:1
gp flag
Tim

You can try:

  • Computer optimizer
  • Trusted advisor
  • Install the Cloudwatch Agent to ensure you have RAM metrics - by default CW can't see internal metrics, just external like network / CPU. Watch the CPU / RAM metrics and decide for yourself if they're overprovisioned.
  • Reduce the instance size and see what happens

It sounds to me like they're overprovisioned for CPU, but you should check the RAM use. The OS is likely using all the RAM for cache, the key metric I use in the Linux "free" is memory "used". The "free" metric takes into account the memory used for buffer / cache.

You can also use reserved instances or savings plans to save money, but right size your instances first. You should consider auto-scaling so AWS adds instances as required.

My experience is most enterprise servers are overprovisioned. I can run a low load t3a.nano with 512MB RAM and 512MB swap serving six low volume websites running Nginx / PHP / MySQL / other utilities like an open source version of Dropbox and it works very well.

in flag
Hi @Tim thanks for the response i will check, Just one more dout on cloud watch lets say if i install agent and start monitoring just memory metric in 100 instances is this the cost caculation? $0.30 for each metric per instances , so $0.30 * 100 = $30 and on top of it if i send metric every 5 min it might use very less api. So just confused with metric cost is that $0.30 for each instances or for any number of instances ?
Tim avatar
gp flag
Tim
I think it's $0.30 per metric per instance. In your case you could do something like a time limited test, or install it on only one or two representative instances. btw I'm not sure about t series behind a load balancer, with their CPU credit system they don't always balance well and it can be cheaper to use M series than t3 unlimited. You should check your CPU credits don't run out - I tend to alert on that metric.
mangohost

Post an answer

Most people don’t grasp that asking a lot of questions unlocks learning and improves interpersonal bonding. In Alison’s studies, for example, though people could accurately recall how many questions had been asked in their conversations, they didn’t intuit the link between questions and liking. Across four studies, in which participants were engaged in conversations themselves or read transcripts of others’ conversations, people tended not to realize that question asking would influence—or had influenced—the level of amity between the conversationalists.