All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.
Hetzner Brings Back GPU Servers
Jasonhyperhost
Member, Patron Provider
Hetzner brings back GPU servers at last,
they used to have the 1080 in the i7-8700
With the new Dedicated Server GEX44, you'll experience the epic performance and computing power of a GPU; its processing architecture enables it to process many tasks in parallel, making it ideal for processing large and complex amounts of data especially quickly and efficiently.
The new GPU Server GEX44 houses a heavy-duty NVIDIA RTX™ 4000 SFF Ada generation graphics card with 20 GB of GDDR6 ECC GPU memory, making it ideal for the use of trained AI models. You can use the GEX44, for example, to run the open source large language model Mixtral via API. And of course, it cuts through other graphic-heavy workloads, such as 3D modelling and CAD.
The GEX44 wouldn't be complete without its Intel® Core™ i5-13500 processor from the 13th "Raptor Lake" generation with Hyper-Threading Technology Virtualization (Intel-VT), which houses an impressive 6 performance cores and 8 efficiency cores. Two speedy 1.92 TB Gen3 Datacenter Edition NVMe SSDs plus 64 GB of DDR4 RAM complete this powerhouse of a GPU server.
The GEX44, which includes an IPv4 address, can be yours for the impressively small price of just € 184.00 a month and a one-time setup fee of € 79.00.
The GEX44 will initially be reserved exclusively for existing customers and can be ordered directly via the robot.
only available for existing clients
Comments
got one after an hour. looks like its being built by order
@nanankcornering can you do a yabs?
Currently testing some production stuffs for encoding - so might affect the result
Too expensive, if only it was $20/year....
We spend a lot of money with GPU instances on Google Cloud (for AI stuff) as the ones with A100 80GB of RAM cost a fortune. How can Hetzner sell this server for less than 200 bucks per month? Unbelievable.
Nah not really, just wait till 3109.
EX44 is in desperate need of ECC in my experience (fast DDR4 is absolute dog tier for memory errors)… I guess this is a good way to get rid of these dud machines, where most processing can be done away from the dodgy main memory
Sh#t. The RTX4000 is limited to 70w of power only. 2.5x less than their GTX1080 server lineup (max power of 180w)
I'm currently running stuff with power usage of 63W already.
Does YABS need a section to benchmark GPU?
Not to steal Hetzner's spotlight here, but if you need any of these GPUs, come try us out, happy to give a few dollars of starting credit!
https://marketplace.tensordock.com/deploy
If you amortize costs over a period of 3 years, the numbers aren't too ugly. The problem with the big clouds is that they will charge prices such that they can earn back the cost of the hardware in 6-12 months, which is objectively crazy.
I would like to try your service but with Google I can have Kubeflow installed in GKE and provision nodes with GPUs in the cluster on demand, automatically with autoscaling etc. So it's not something I can easily replace with some third party service
The new RTX4000 SFF Ada is designed to be max 70w. It's a 4nm chip with increased efficiency so result in low power consumption.
Then why not build your own device locally?
The Google/Amazon Clouds are always black-hearted robber.