Looking for 8x 4090 Servers

yuklet

I'm in search of a GPU server for AI inference with the following specifications:

8x RTX 4090 GPUs (Need more clusters)
Bare metal SSH access
1Gbps network connection preferred
Flexible billing: week-to-week payments, cryptocurrency also accepted

Advin

@PureGPU

PureGPU

Do you specifically need 8x 4090s on one machine, or would 4x / 2x instances work?

Weekly is pretty rare. Most of the time you'll either need to pay a premium for hourly, or pay monthly.

yuklet

@PureGPU said:
Do you specifically need 8x 4090s on one machine, or would 4x / 2x instances work?

Weekly is pretty rare. Most of the time you'll either need to pay a premium for hourly, or pay monthly.

8x Preferable. 4x also work. We need to run LLM so need more GPU in a single class

grooveuser

does it have to be bare metal? (in this day and age?! really?!!)

if you're ok with not using bare metal, there are plenty of cheap options, available by the hour (or even by the second!)

runpod, vast.ai, paperspace, and many others immediately jump to mind.
(shout-out to @puregpu mentioned above too!)
vast.ai even has a fancy pricing tool that lets you choose gpu, disk space, I/O bandwidth, and even internet bandwidth. on many of those you have most, if not all, of the entire machine!! so, it's not bare metal (most of those providers give you a docker image with passthrough gpu, or similar) but it's pretty close.
they all provide ssh access, in my experience.

and for the specs you're looking for, (8x4090, 1gbps+) machines can be had for less than $3/hr. (though $4-$5 is more common...)

Hope this helps.

vsys_host

@yuklet said:
I'm in search of a GPU server for AI inference with the following specifications:

8x RTX 4090 GPUs (Need more clusters)
Bare metal SSH access
1Gbps network connection preferred
Flexible billing: week-to-week payments, cryptocurrency also accepted

Will GeForce GTX 1080 Ti OR GeForce RTX 3080 suit you?
Check our dedicated servers with GPU

I can make a good discount for you!

PureVoltage

@vsys_host said:

@yuklet said:
I'm in search of a GPU server for AI inference with the following specifications:

8x RTX 4090 GPUs (Need more clusters)
Bare metal SSH access
1Gbps network connection preferred
Flexible billing: week-to-week payments, cryptocurrency also accepted

Will GeForce GTX 1080 Ti OR GeForce RTX 3080 suit you?
Check our dedicated servers with GPU

I can make a good discount for you!

He is using it for AI so it must be 4090's.

I would say it's possible for us to do something like this but we would have to order the cards in and not really something we would want to do without a longer term.

EvosHosting

Hello,
I can offer you these servers but with monthly payment
You could consider making monthly payments you can contact me

Price:

AMD Ryzen 9 7950X3D
NVIDIA GeForce RTX 4060 Ti
128GB DDR5
2x 1TB NVMe M.2 Datacenter SSD
10 Gbit/s

250€ per month

Additional price for RTX 4070: +38€
Additional price for RTX 4070 Ti: +57€
Additional price for RTX 4080: +85€
Additional price for RTX 4090: +155€