New on LowEndTalk? Please Register and read our Community Rules.
All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.
All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.
Comments
First check forum name, because this is LOW END forum, not HIGH END.
I also don't think that it is possible to get more then 8 cards with one server. This server will use nearly 6000W of power ...
How many millions is your budget for this project? Are you able to put in a significant 7-figure security deposit, make annual prepayments, and commit to a 3 to 5-year term contract?
We would be happy to do this for you. Annual payments up front and a 3 year term.
same
Glad to hear your opinion every dc should consider this point and ask 5 year upfront contract from their customers. With this approach big dc can save billions which they are taking as loans from banks to expand their infra.your customers can become a free financer for you
an h100 cost as much as a really nice 100G router
now consider 100 of them. how can any business deploy such capital without a contract to ensure they can amortise the capital spent without risking the customer running off after month 10?
Yes. $2.30/card/hour at Vultr. $165K a month and your problem is solved.
When you're asking them to buy specialized gear on your behalf and there's every possibility you're going to rent this for a week and vanish, then yes.
I am not asking a summer host or basement hoster to invest such big amount. I have Specifically mentioned dc, so if anyone has infra ready or can arrange it with a genuine contract comfortable for both sides it ok otherwise no need to spend this much if it’s hurting anyone’s small pockets
so you come to LowEndTalk.com to ask this?
go ask your procurement officer to use their supplier network to get these then, why are fuck are you coming here to ask and then complain about summerhost
LOL...yes, the OP should definitely talk with this procurement officer. Perhaps during their next capital allocations budget meeting before the monthly board meeting.
I'm wondering if OP actually knows how much an H100 costs or what they rent for.
Heck, I looked at TensorDock which is usually one of the cheaper, and they're $2.70/hour there, more than Vultr.
Unless OP has a six-figure monthly budget, he's not getting a hundred H100s short of armed robbery. If he does have that budget...as you say...why LET.
I wish I could have a couple of them to warm my house during the winter.
i wonder why 100 of nvidia h100's ?
can you elaborate?
tensordock is cheaper because the stuff at vultr isn't actually an hourly rate. it's a longer commitment term that they break out into hourly so they look better price wise.
Well, llama-3 405B is out...
Even a non summer host won't just let you deploy one hundred of these instances. Try it and find out.
You'd save a lot of money if you considered ownership and colocation. I think you're trolling though, 🙂.
Isn't an H100 delivered directly from the Nvidia factory to the DC by armoured vehicles?
Hey manos, tensordock here. we can provide this on demand or in reserved contracts as little as a month
😁
Nah, we get them in cardboard boxes with really good packaging, at least to MSFT datacenters.
DM'd you.