Searching for GPU server 96gb vram or more

Vaclav

HI, help to find a server for llm tests
gpu 96gb or 96gb*2, 6000rtx or similar. EU

Vaclav

i found few on hetzner and gigahost - any feedback?

averagedatahoarder

for LLM tests

Tbh going on-demand/community cloud/spot will be a lot cheaper for you unless you need it 24/7

Vaclav

thinking about per hour options and if somehow make an instance up withing few minutes with all data, that may be a best deal for me, but still 2$ per hour for 4-5hrs its rough ~300usd per month.

duonghowuaaxtnw763

@Vaclav said:
thinking about per hour options and if somehow make an instance up withing few minutes with all data, that may be a best deal for me, but still 2$ per hour for 4-5hrs its rough ~300usd per month.

Based on your requirement for a pay-as-you-go model, this service is likely the best fit for you: https://vast.ai/