New on LowEndTalk? Please Register and read our Community Rules.
All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.
All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.
Comments
@PureGPU
Do you specifically need 8x 4090s on one machine, or would 4x / 2x instances work?
Weekly is pretty rare. Most of the time you'll either need to pay a premium for hourly, or pay monthly.
8x Preferable. 4x also work. We need to run LLM so need more GPU in a single class
does it have to be bare metal? (in this day and age?! really?!!)
if you're ok with not using bare metal, there are plenty of cheap options, available by the hour (or even by the second!)
runpod, vast.ai, paperspace, and many others immediately jump to mind.
(shout-out to @puregpu mentioned above too!)
vast.ai even has a fancy pricing tool that lets you choose gpu, disk space, I/O bandwidth, and even internet bandwidth. on many of those you have most, if not all, of the entire machine!! so, it's not bare metal (most of those providers give you a docker image with passthrough gpu, or similar) but it's pretty close.
they all provide ssh access, in my experience.
and for the specs you're looking for, (8x4090, 1gbps+) machines can be had for less than $3/hr. (though $4-$5 is more common...)
Hope this helps.
Will GeForce GTX 1080 Ti OR GeForce RTX 3080 suit you?
Check our dedicated servers with GPU
I can make a good discount for you!
He is using it for AI so it must be 4090's.
I would say it's possible for us to do something like this but we would have to order the cards in and not really something we would want to do without a longer term.
Hello,
I can offer you these servers but with monthly payment
You could consider making monthly payments you can contact me
Price:
AMD Ryzen 9 7950X3D
NVIDIA GeForce RTX 4060 Ti
128GB DDR5
2x 1TB NVMe M.2 Datacenter SSD
10 Gbit/s
250€ per month
Additional price for RTX 4070: +38€
Additional price for RTX 4070 Ti: +57€
Additional price for RTX 4080: +85€
Additional price for RTX 4090: +155€