r/MachineLearningJobs • u/Top_Power_424 • 7d ago
Where and who uses Cloud GPU?
From my previous post I came to know about CLOUD GPUs. But two question, who uses these Cloud GPUs? Like if a individual use, it gonna cost him a lot. For what purposes do they use? Like cloud gaming? Model running?
2
Upvotes
1
u/Sad-Net-4568 7d ago
They are generally used for training or inference purpose, you use them on-demand
1
u/Artistic-Lifeguard71 7d ago
There are few free available option like colab , modal
1
u/Divyanshailani 4d ago
Kaggle kinda better than Collab, dk why Collab kicks me out frequently
1
u/Artistic-Lifeguard71 4d ago
If u are not active it will definitely kick u out thinking of that u left and saves power consumption of servers
1
u/danielsalehnia 7d ago
It depends with services such as modal you only pay for what you use and I mean a lot of use cases don't need that long and at 1-6usd per hour depending on the hardware it's worth it. And there's other services like shadow pc like I pay 70€ a month for a beefy computer with a lot of ram and a rtx6000 and vast ai you can rent a100s for 1 usd per hour one mcdonald menu is 13 hours you can do a lot of forward passes in that time lol