Which Cloud Technology/Service?

manpreet Best Answer 2 years ago

I am a long time desktop developer who is struggling a little to choose a cloud technology. What I need to do: Periodically spin up a number of machines to run a task that runs until completion. The number of machines and length of task both vary, but 20-100 machines and a run time of 2-30 minutes are good estimates. So I might need a 5 minute task on 60 machines and then 10 minutes later I'll need a 15 minute task on 40 machines, for example.

I've tried researching this but I don't have the background to understand a lot of the websites I've been reading.

It seems like AWS could do this but when I start reading there's "containers" and "event driven compute" and "auto scaling" and "elastic beanstalk" and "lambda". Lambda actually sounds like what I want, but after about two hours of reading it turns out lambda is limited to 60 seconds of run time.

Can someone get me started by pointing me at a cloud technology that would be appropriate for my service?

Thanks.