You can get up to $100k in startup credits on AWS just by asking. They certainly cut a deal for Stable Diffusion on top of that.

The trouble isn't renting those GPUs but it was finding that number of GPUs closely connected to each other for the duration of the training process.

The founder said that this is not quite as possible with most public clouds and that it is easier to buy the GPUs.