Join Log in
Score:0
avatar Server

Cloud setup for occasional high to extreme CPU-intensive tasks (instant vertical scaling?)

in flag
Albeit

I have a business workload that has very low CPU-usage most of the time, and occasionally needs to burst to very high CPU-usage. It currently runs on a dedicated server with 32 cores, but was hoping to transition to a cloud hosting solution. The demands are roughly:

  • 1 core most of the time
  • 32 cores approximately every 20 minutes on average for about 30 seconds (not pre-determined intervals, and needs to run within seconds of being triggered)
  • 100s of cores (as many as possible) every few weeks, for a few hours (depending on how many cores available, with 32 cores about 8 hours)

Is there any setup I could arrange to deal with such a workload? The basic solution is to just setup at 32 core instance, but it doesn’t seem like the most efficient. I looked into burstable instances, but they don’t offer the high number of cores I would need. Ideally there would be some service that allows instant vertical scaling, but that doesn’t seem to exist.

Any ideas? Thank you!

56
0 + 2
vidarlo avatar
ar flag
vidarlo
There's many alternatives. What kind of workload is it? For a simple eventdriven workload, a function app may work. For other workloads, a docker image may work. Furthermore, is the scaling predictive? Can you spin up more instances *before* you need them, or is it induced demand that you can't exactly predict?
0
Reply
in flag
Albeit
@vidarlo: Thanks for the help! The work that occurs about every 20 minutes is a multi-threaded search program written in C++, that requires a minimal amount of memory but close to full core usage. It runs well on about 16 or 32 cores. The work that occurs every few weeks is many instances of the search, on different inputs. From what I've seen the function services don't allow lower-level code (like C++) and wouldn't be performant enough. The every 20 minute work is not very predictive - in an hour period it will run about three times, but I don't know ahead of time when it will be triggered.
0
Reply
ธงชาติไทย
Elon Musk
I sit in a Tesla and translated this thread with Ai:

mangohost

Post an answer

Most people don’t grasp that asking a lot of questions unlocks learning and improves interpersonal bonding. In Alison’s studies, for example, though people could accurately recall how many questions had been asked in their conversations, they didn’t intuit the link between questions and liking. Across four studies, in which participants were engaged in conversations themselves or read transcripts of others’ conversations, people tended not to realize that question asking would influence—or had influenced—the level of amity between the conversationalists.