Score:0

Poor disk throughput on Google App Engine

tc flag

Is there any way to manually provision IOPS for the disk used by the instances on Google App Engine?

The default throughput I get with a 256GB disk is terrible (60MiB/s burst, after which is settles to 30MiB/s combined for reads and writes).

Is there an option in App Engine to:

  • Provision IOPS manually
  • Use an SSD
  • Use a VM instance template so I can configure the hardware template in Compute Engine and ask App Engine to use the same
Score:1
de flag

App Engine is a fully managed, serverless platform for developing and hosting web applications at scale. It means that you simply deploy your code, and the platform does everything else for you.

There are two types of App Engine, first is the Standard and the other is Flexible. Based on your concerns, you may need to use App Engine Flex since you can only write files to /tmp in Standard. One key advantage of a Flex environment is that you can set resource settings for it. However, you may not be able to manually provision IOPS manually and add SSD but you can set your preferred resource settings in the app.yaml. Remember that bandwidth will depend on the disk size. The higher the disk size you choose the greater the bandwidth you will have available. See this documentation for performance by disk size reference.

After setting resources in app.yaml in App Engine Flex and you still think it is not enough for your application, you may want to consider switching to Compute Engine. In Compute Engine, you can deploy instance with a high number of cores and/or increase disk size to maximize the bandwidth and there won’t be any limitation. Also, you can add an SSD in your instance to get additional boost. Additionally, I would recommend SSD persistent disk over local SSD as the data stored in local SSD persists only until the instance is stopped or deleted. For adding persistent SSD in Compute Engine, see this documentation for reference.

mangohost

Post an answer

Most people don’t grasp that asking a lot of questions unlocks learning and improves interpersonal bonding. In Alison’s studies, for example, though people could accurately recall how many questions had been asked in their conversations, they didn’t intuit the link between questions and liking. Across four studies, in which participants were engaged in conversations themselves or read transcripts of others’ conversations, people tended not to realize that question asking would influence—or had influenced—the level of amity between the conversationalists.