r/MachineLearningJobs 7d ago

Where and who uses Cloud GPU?

From my previous post I came to know about CLOUD GPUs. But two question, who uses these Cloud GPUs? Like if a individual use, it gonna cost him a lot. For what purposes do they use? Like cloud gaming? Model running?

2 Upvotes

5 comments sorted by

1

u/danielsalehnia 7d ago

It depends with services such as modal you only pay for what you use and I mean a lot of use cases don't need that long and at 1-6usd per hour depending on the hardware it's worth it. And there's other services like shadow pc like I pay 70€ a month for a beefy computer with a lot of ram and a rtx6000 and vast ai you can rent a100s for 1 usd per hour one mcdonald menu is 13 hours you can do a lot of forward passes in that time lol

1

u/Sad-Net-4568 7d ago

They are generally used for training or inference purpose, you use them on-demand

1

u/Artistic-Lifeguard71 7d ago

There are few free available option like colab , modal

1

u/Divyanshailani 4d ago

Kaggle kinda better than Collab, dk why Collab kicks me out frequently

1

u/Artistic-Lifeguard71 4d ago

If u are not active it will definitely kick u out thinking of that u left and saves power consumption of servers