New on LowEndTalk? Please Register and read our Community Rules.
All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.
All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.
Comments
Hi,
how much space do you need?
pay per usage would be ideal
Hi,
sorry, we have no automation for this to handle dynamic billing.
What i could do for you is offering either HDD speed or NVMe speed s3 compatible space with connectivity up to 10G with a specific traffic volume per month.
So i would need to know:
Then i can make an offer.
Cloudflare R2 maybe?
I had great experiences with it, didn't test the bandwidth speed however, but It's Cloudflare so I expect it's at least okay.
same here. haven't tested the top speeds but works great for videos for my usage.
i have this setup in my mind,
CPU: 2x Intel Xeon E5 2698 v3 (16c,32t,3.6GHz)
RAM: 64 GB DDR4 ECC
Storage: 2x120gb ssd for OS/Minio config and 4x 4TB SSD/nvme or 4x 8TB HDD r 4x 16TB HDD , no need software raid, as minio erasure feature make it adopt.
Uplink: 10G / Bandwidth: 100TB (Outgoing) Unmeterd (Incomming)
to setup minio with erasure coding enable,
https://min.io/product/erasure-code-calculator
Cloudflare R2 is fast and has unlimited free egress. Backblaze B2 is cheaper, also fast, and also has unlimited free egress when proxied through Cloudflare but B2 has an account-wide rate limit on requests.
I've used both to push up to 70 Gbps but if you're going to have a high uncached request rate I recommend avoiding B2.
Cloudflare R2 is great, but if you aren't made of money, storing at $15/tb is going to get pricey quick. It is super fast though world-wide.
To be fair, scalable storage that can comfortably push 10Gbit is never going to be cheap regardless. $15/TB is a great deal when you consider the negligible operation overhead and the bandwidth.
Especially when you compare it to the big 3 cloud providers.
What location you looking for?
We can help you out on this. Free inbound/outbound.
How!?
Can you please explain
How!?
Bandwidth is calculated into the cost of the product. (as it should be)
how you'll help in Free inbound/outbound bandwidth !?
how do you calculating ?
Cost per TB
whats your budget?
how many TB space needed?
expected traffic?
how many TB space needed?
expected traffic?
not sure yet, will be incremental (I just need to store things), most likely I will be adding 3-400 GB per month
Linode might be a good choice, expecially if you already have compute there with excess pooled bandwidth.
I think their S3 nodes are networked at 40G the same as their compute, I don't think its published but it feels fast and I've certainly seen some fast transfers on larger files.
IDrive e2 can provide that, and its only $4 per month per TB
And again: I find it interesting that you recommend IDrive e2 in every single one of your posts.
Edit: and the OP even said it's not suited.
considering also what I wrote in the thread
https://coststorage.com/
B2 is usually the cheapest there is, only 1 region though, helps to put it behind a CDN for downloads. Otherwise scan in #offers for storage VPS which can come with large arrays or block storage on discount.
StorJ has $4/TB https://www.storj.io/pricing
While R2 is a great service, that is misleading wording.
Not only does it have limits (both reads and writes) in requests per second per bucket, but also achieving speeds like 70Gbps is very optimistic unless your bucket contains a small number of large-ish files being used for the test, and you fire 70 clients all pulling at 1Gbps when it's in CF's edge caches (and thus not actually using R2 at all)...
Additionally, writes are far from great reliability-wise. Over 5000 uploads of 10MB files, we see about 0.5% of requests receiving an HTTP 502, with an error message inviting us to retry the request. Causing random spikes in processing time due to the retries (which you must also transparently support on the application side as a result)...
Not a deal-breaker given the price, as all solutions have caveats, but this kind of misleading discourse about SaaS is really not helping anyone make decisions. We can read the marketing spiel, and it's better to read what was not in the marketing here.
Similarly, I'd warn against planning around MinIO without some real testing of your workload against it. S3 is already a very inefficient (resources-wise) protocol in the first place, and MinIO was never the fastest implementation of it either... Maybe they improved since I last gave it a try though.
This was my experience with S3 as well (in a multi PB account SaaS), even confronted the AWS devs about it and they shrugged it off and advised to just have aggressive retry policies.
It's a truism. That statement is true with all public SaaS providers - speed is dependant on peering and consumer's capabilities and transfer sizes and concurrency and myriad other things.
All things considered, none of that has been stated as OP's requirements or considerations. For that reason B2, S3, StorJ and R2 are all viable solutions.
This is true with read requests as well. In the zone analytics I could see 500, 502, and 503 errors appearing at random times. There was also an issue with requests being closed randomly on stable network connections and the issue was so difficult to reproduce that Cloudflare's support staff were unable to resolve it (it still persists to this day).
With only one way to expose an R2 bucket via a custom domain, you also have to deal with the quirks of caching on Cloudflare such as not properly loading 206 responses, causing issues with seeking in video files unless the cache is bypassed.
B2 and R2 aren't perfect in every way but they do meet OP's bandwidth requirement.
Yeah you can also deploy Cloudflare R2 or S3 in a sharded cluster and local mount via JuiceFS with Redis caching backed metadata caching https://github.com/centminmod/centminmod-juicefs
Here's my Cloudflare R2 benchmarks using JuiceFS for sharded clustered scalability benchmarks https://github.com/centminmod/centminmod-juicefs?tab=readme-ov-file#juicefs-benchmarks-100x-r2-sharded-mount--redis-metadata-caching
100x Cloudflare R2 sharded JuiceFS mount with Redis metadata caching with location hint North American East
for 1MB file sizes
really?
is there any article told that?
All my files on one bucket, if it's true, that's terrible.