Looking for affordable GPU server for Deepseek R1

Xytronix

Dear fellow community members,

I am looking into self hosting deepseek for our company.
How was your experience so far and which specs would you recommend?
Looking forward to recommendations.

Server location preferred Europe.

cainyxues

@sh97 can give you gpu vds with dedicated cores ram and vram too 😁 [Crunchbits]

sh97

@cainyxues said:
@sh97 can give you gpu vds with dedicated cores ram and vram too 😁

Thank you for the mention!
Unfortunately we don't have GPU VDS in EU.

@Xytronix if Spokane, US West works for you
https://crunchbits.com/gpu/cloud

cainyxues

@sh97 said:

@cainyxues said:
@sh97 can give you gpu vds with dedicated cores ram and vram too 😁

Thank you for the mention!
Unfortunately we don't have GPU VDS in EU.

@Xytronix if Spokane, US West works for you
https://crunchbits.com/gpu/cloud

Ok I didn't see the location requirements 😅

arnoldz

@Xytronix said:
Dear fellow community members,

I am looking into self hosting deepseek for our company.
How was your experience so far and which specs would you recommend?
Looking forward to recommendations.

Server location preferred Europe.

With GPU A100?

c1vhosting

@arnoldz said:

@Xytronix said:
Dear fellow community members,

I am looking into self hosting deepseek for our company.
How was your experience so far and which specs would you recommend?
Looking forward to recommendations.

Server location preferred Europe.

With GPU A100?

I’ve tried (the largest model) on our server with 8x A100 and it can’t run

cainyxues

@arnoldz said:

@Xytronix said:
Dear fellow community members,

I am looking into self hosting deepseek for our company.
How was your experience so far and which specs would you recommend?
Looking forward to recommendations.

Server location preferred Europe.

With GPU A100?

I mean one can also run distilled models right? which are of smaller size or maybe quantized versions too?

arnoldz

@c1vhosting said:

@arnoldz said:

@Xytronix said:
Dear fellow community members,

I am looking into self hosting deepseek for our company.
How was your experience so far and which specs would you recommend?
Looking forward to recommendations.

Server location preferred Europe.

With GPU A100?

I’ve tried (the largest model) on our server with 8x A100 and it can’t run

CPU, RAM - ?

hyperblast

@Xytronix said:
Dear fellow community members,

I am looking into self hosting deepseek for our company.
How was your experience so far and which specs would you recommend?
Looking forward to recommendations.

Server location preferred Europe.

budget?

dav848

Buying hardware is much more convenient, setup locally or colo

arnoldz

@Xytronix said:
Dear fellow community members,

I am looking into self hosting deepseek for our company.
How was your experience so far and which specs would you recommend?
Looking forward to recommendations.

Server location preferred Europe.

Are you sure you need it on a monthly or yearly basis?
Maybe a per-minute or hourly ($1.35) payment works better for you?
Here we go:
https://app.primeintellect.ai/dashboard/create-cluster/search?gpu_type=A100_80GB&image=ubuntu_22_cuda_12&location=Cheapest&quantity=1&security=Cheapest&show_spot=false

Xytronix

@arnoldz said:

@Xytronix said:
Dear fellow community members,

I am looking into self hosting deepseek for our company.
How was your experience so far and which specs would you recommend?
Looking forward to recommendations.

Server location preferred Europe.

Are you sure you need it on a monthly or yearly basis?
Maybe a per-minute or hourly ($1.35) payment works better for you?
Here we go:
https://app.primeintellect.ai/dashboard/create-cluster/search?gpu_type=A100_80GB&image=ubuntu_22_cuda_12&location=Cheapest&quantity=1&security=Cheapest&show_spot=false

Thank you.

This would be the actual hardware for hosting Deepseek R1 with no distillations:
Estimated cost is about $6000 for hardware
https://x.com/carrigmat/status/1884244369907278106

inthecloudblog

@lentro maybe has some?