Looking for new volume infra partner ($20k monthly spend)

mw

Hi LET

Our current infra partner is fantastic but ordering new hardware takes ages and is too large an operational risk for me to ignore so if anyone wants to discuss taking our business:

• Monthly spend: $20k growing @ 10-15% MoM
• All servers need 40Gbit at a minimum @ 5PB egress pooled (high estimate)
• Majority of egress is to AS13335 so peering is essential
• Ingress/local traffic must be unmetered
• We bring our own IPs on our ASN you must announce for us
• EU + US location, Asia is beneficial at reduced networking
• We are VAT registered, incorporated in South Africa and can pay via wire or crypto
• We are not interested in hardware ownership but are open to quarterly prepayments

We primarily use two configs, below is minimum viable to give you a rough estimate but we are flexible on details:

Config A:

• 96TB pure NVME per box
• 256GB RAM per box
• Xeon Gold/Plat @ 2.1Ghz
• 10 boxes to start

Config B:

• NVME-backed HDD dense storage
• Currently we use boxes of 16x 20TB but open to higher density
• 512GB RAM per box
• 10 boxes to start

We also require the following:

Dedi:
AMD 7950X or equivalent
192GB RAM
8-16TB NVME
With this config, our only requirement is high single core performance, we need less than a handful at the moment and alternative configs to consolidate are welcome with second order priority being the NVME density

VPS:
4 vCores @ 25% commit
32GB RAM
100GB NVME
Our only requirement with this VPS is high uptime - 1Gbit networking is fine, it will only communicate internally

SilverCreek

Hi @mw,

Please reach out to us on our portal (here, and we can assist you with your needs. For transparency, we would likely require a 3mo upfront to make it worthwhile, and we'd only be able to service your request in Amsterdam, Kansas and LA.

HostSlick

So Main reason you move off your Host is because long Delivery time?
Why not Spread your stuff amongst multiple Providers?

I guess looking at this Specs most would take a bit of time to deliver so.
Its not usual configurations that most customers Order.

Also Seems you grow alot since we talked Last time. Very nice to see

servarica_hani

Few questions about BW usage
you say each server need 40gbps but the 5BP is it total egress per server per month or for multiple servers ?

For config A : how big each NVMe disk is
as golds up to second gen have 48 lanes for PCI
so if each disk is 4 lanes that means you have max 10 disks
this makes each disk 9.6TB or 10TB

this is very expensive setup
it is much easier to go with AMD solution for the pure NVMe server

blorged

wow, porn distribution has really become a high scalability problem!

itsTomHarper

20k reminds me of someone here

mw

@HostSlick said:
Why not Spread your stuff amongst multiple Providers?

We do

mw

@servarica_hani said:
Few questions about BW usage
you say each server need 40gbps but the 5BP is it total egress per server per month or for multiple servers ?

5PB is the total estimated egress across all the servers pooled together (right now).

For config A : how big each NVMe disk is
as golds up to second gen have 48 lanes for PCI
so if each disk is 4 lanes that means you have max 10 disks
this makes each disk 9.6TB or 10TB

We aren't married to our current hardware spec, I provided it as guidance of what we -aim- to match elsewhere. Our current SSDs are Samsung 16TB x6 but better configs are welcome.

this is very expensive setup
it is much easier to go with AMD solution for the pure NVMe server

Feel free to DM me what you have

Levi

Wait, 20k? That’s cursed number. Increase it up to 20.1k to avoid fart master scam. And of course buy only from reputable providers.

mw

@SilverCreek said:
Hi @mw,

Please reach out to us on our portal (here, and we can assist you with your needs. For transparency, we would likely require a 3mo upfront to make it worthwhile, and we'd only be able to service your request in Amsterdam, Kansas and LA.

Will do

mw

@Levi said:
Wait, 20k? That’s cursed number. Increase it up to 20.1k to avoid fart master scam. And of course buy only from reputable providers.

@Calin have any offers for me? Can pay in crypto

BruhGamer12

stay away from any cheap romanians with 20k

MrRadic

$20k across 21 servers?

emgh

@internetport

mw

@MrRadic said:
$20k across 21 servers?

Our cost driver is price per TB of NVME and HDD. If you want to think of it as 960TB NVME and 3.2PB HDD for $20k you can slice it into whatever config you want as long as we can scale it easily.

On top of this, we pay $15/TB for Cloudflare R2 as we replicate in Asia, which is a massive cost I'm happy to shift away from CF if someone can offer me a competitive solution.

emgh

Also please contact https://inleed.com/ if Sweden is fine for the EU location

If they can accommodate, they go above and beyond for their clients

MrRadic

@mw said:

@MrRadic said:
$20k across 21 servers?

Our cost driver is price per TB of NVME and HDD. If you want to think of it as 960TB NVME and 3.2PB HDD for $20k you can slice it into whatever config you want as long as we can scale it easily.

On top of this, we pay $15/TB for Cloudflare R2 as we replicate in Asia, which is a massive cost I'm happy to shift away from CF if someone can offer me a competitive solution.

To confirm, there are no CPU/RAM requirements on the NVMe/HDD configurations, just storage? They can be split between as many (or as few) servers as needed? You only care about the total storage?

yoursunny

@itsTomHarper said:
20k reminds me of someone here

"Patron Provider Tag Suspended" is changed to "🚩 Patron Provider Tag Suspended".
After several months, the latter half will be dropped.
After several more months, the red flag will vanish.

mw

@MrRadic said:

@mw said:

@MrRadic said:
$20k across 21 servers?

Our cost driver is price per TB of NVME and HDD. If you want to think of it as 960TB NVME and 3.2PB HDD for $20k you can slice it into whatever config you want as long as we can scale it easily.

On top of this, we pay $15/TB for Cloudflare R2 as we replicate in Asia, which is a massive cost I'm happy to shift away from CF if someone can offer me a competitive solution.

To confirm, there are no CPU/RAM requirements on the NVMe/HDD configurations, just storage? They can be split between as many (or as few) servers as needed? You only care about the total storage?

We're very flexible but within reason. The only hard requirement we have would be RAM:

• at least 1.5GB/TB on the HDD servers as we use ZFS, and require 2-4TB NVME per box for L2ARC, more is obviously welcome
• at least 256GB on the NVME servers but we wouldn't necessarily need to scale this up linearly if you offered higher density, but I would not realistically consider scaling down because RAM is cheap enough to not be a limiting factor so lets call this a hard floor at 256

As for CPU, I'm open to exploring different platforms if its more effective from a cost perspective or provides a tangible performance benefit, particularly on the NVME servers if the storage density increases and we end up with fewer servers. Nothing lower than the equivalent of dual Xeon Gold 6138 per NVME server though, which is a pretty low bar already.

On the HDD boxes, anything that can comfortably handle our ZFS arrays works. We don't run deduplication or anything exotic at all.

1gservers

@mw said:
Hi

@mw if you are open to some servers in Phoenix, AZ, USA, we can definitely help you out of our data center. While that is our only location, we do have AS13335 4x100g PNI being turned up this month. Please send direct message and I can get you what you need.

Petey_Long

@crunchbits @advinservers @fiberstate @PureVoltage @jfreak53 @oplink @DataIdeas-Josh @AlexBarakov @Atomic_Networks @royalehosting

allthemtings

Torbox big growth 📈

Congrats @mw @wamy

dosai

Torbox expansion, good luck!

BharatB

@mw said:
Hi LET

Our current infra partner is fantastic but ordering new hardware takes ages and is too large an operational risk for me to ignore so if anyone wants to discuss taking our business:

• Monthly spend: $20k growing @ 10-15% MoM
• All servers need 40Gbit at a minimum @ 5PB egress pooled (high estimate)
• Majority of egress is to AS13335 so peering is essential
• Ingress/local traffic must be unmetered
• We bring our own IPs on our ASN you must announce for us
• EU + US location, Asia is beneficial at reduced networking
• We are VAT registered, incorporated in South Africa and can pay via wire or crypto
• We are not interested in hardware ownership but are open to quarterly prepayments

We primarily use two configs, below is minimum viable to give you a rough estimate but we are flexible on details:

Config A:

• 96TB pure NVME per box
• 256GB RAM per box
• Xeon Gold/Plat @ 2.1Ghz
• 10 boxes to start

Config B:

• NVME-backed HDD dense storage
• Currently we use boxes of 16x 20TB but open to higher density
• 512GB RAM per box
• 10 boxes to start

We also require the following:

Dedi:
AMD 7950X or equivalent
192GB RAM
8-16TB NVME
With this config, our only requirement is high single core performance, we need less than a handful at the moment and alternative configs to consolidate are welcome with second order priority being the NVME density

VPS:
4 vCores @ 25% commit
32GB RAM
100GB NVME
Our only requirement with this VPS is high uptime - 1Gbit networking is fine, it will only communicate internally

What about comittment?

PureVoltage

@mw said:
Hi LET

Our current infra partner is fantastic but ordering new hardware takes ages and is too large an operational risk for me to ignore so if anyone wants to discuss taking our business:

• Monthly spend: $20k growing @ 10-15% MoM
• All servers need 40Gbit at a minimum @ 5PB egress pooled (high estimate)
• Majority of egress is to AS13335 so peering is essential
• Ingress/local traffic must be unmetered
• We bring our own IPs on our ASN you must announce for us
• EU + US location, Asia is beneficial at reduced networking
• We are VAT registered, incorporated in South Africa and can pay via wire or crypto
• We are not interested in hardware ownership but are open to quarterly prepayments

We primarily use two configs, below is minimum viable to give you a rough estimate but we are flexible on details:

Config A:

• 96TB pure NVME per box
• 256GB RAM per box
• Xeon Gold/Plat @ 2.1Ghz
• 10 boxes to start

Config B:

• NVME-backed HDD dense storage
• Currently we use boxes of 16x 20TB but open to higher density
• 512GB RAM per box
• 10 boxes to start

We also require the following:

Dedi:
AMD 7950X or equivalent
192GB RAM
8-16TB NVME
With this config, our only requirement is high single core performance, we need less than a handful at the moment and alternative configs to consolidate are welcome with second order priority being the NVME density

VPS:
4 vCores @ 25% commit
32GB RAM
100GB NVME
Our only requirement with this VPS is high uptime - 1Gbit networking is fine, it will only communicate internally

We should be able to help you with this.
Shoot us a sales email and we can get on a call as well if needed.

[email protected]

iKeyZ

@emgh said:
Also please contact https://inleed.com/ if Sweden is fine for the EU location

If they can accommodate, they go above and beyond for their clients

Inleed are great, would highly recommend them if they're able.

kait

@emgh said:
Also please contact https://inleed.com/ if Sweden is fine for the EU location

If they can accommodate, they go above and beyond for their clients

Doubt they have enough network capacity, they list 20Gbps in IXP capacity and <50Gbps on peeringdb

sliix

Wait this is Torbox? Amazing! I love the service. All the best with the expansion.

vr10

@emgh said:
Also please contact https://inleed.com/ if Sweden is fine for the EU location

If they can accommodate, they go above and beyond for their clients

What an excellent website!

AlexBarakov

We could also help out, we're getting some PNI towards CloudFlare this month. Feel free to reach me over at alex[at]dagroup.bg

Saragoldfarb

@emgh said:
Also please contact https://inleed.com/ if Sweden is fine for the EU location

If they can accommodate, they go above and beyond for their clients

The do inleed.