New on LowEndTalk? Please Register and read our Community Rules.
All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.
All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.
Comments
why does it have to be S3 compatible? What happened to just making a website?
r2 is good for storing it, but when it has to be served and streamed often id rather use something like bunny.net and then archive them somewhere else later.
thinking a video on the frontpage would be something youd not want to have loading forever.
If you can afford a managed solution then don't self host. R2 for unlimited egress and included CDN for free.
News site with almost 200k photos and a 2.3 GB database. Content from 2007. Even if my server is powerful enough, the right way is use external storage for media to have better backup options either way.
Cliudflare cdn on the free tier works fine for me till now, with some tuned powerful caching inside the server, also. That's why I am thinking to use R2 from Cloudflare, for better compatibility with their CDN.
This is for photos, not video. I use either youtube (for better distribution outside the website) or a self hosted media server specially configured for video.
Personally I love R2. Just works great, always fast no matter the region. I use it to distribute some large files mostly.
Depends on how much traffic your site gets, if it's a lot, then R2 is the better value with its free and unlimited egress. If it's not a lot, then get a server instead, as R2 at $15/TB isn't good value if you aren't doing high traffic and a server has cheaper storage.
Which solution you want to use as S3 compatible backend? Minio or seaweedfs?
I will migrate from idrive e2 to vps and now looking for a S3 compatible backend software.
I heard a lot about garage here on let. May try as well.
Seaweedfs works well, minio on the other hand will require a specific version because the latest one doesn't have an admin/management panel.
Thanks, for the Garage. Looks pretty good.
Why are you moving away from IDrive E2?
I think Backblaze B2 with Cloudflare CDN can get you the unlimited egress of R2 but with a much lower storage price ($6/TB)? You still have to pay for API transaction costs for both B2 and R2 afaik, though
Cost. 1tb is $50, 2tb is $99, here on let you can find 2tb for $20-30. E2 is really cool product, but i tired register every year new account and migrate. And a few month ago, I saw new prises, where 1tb was $75, but then they revert prices back. Anyway I already bought 2tb vps and plan migrate all my services from e2 to my own s3 compatible.
Backblaze speed was super slow beyond help even under CF CDN, they never fix it since 2021
Also have bad experience with R2 with somehow it fail when stream using http range and their support ticket was kinda slow (around 1 + ½ days) unless you okay having many small files and using single-thread stream it would be best choice.
For hassle-free, I recommended bunny.net, even price was steeping their support was very comfy and solved my problem quickly (as long I question about techincal stuff with possible dats required to check on their side) and http range support on their CDN standard network.
i can vouch for garage. I have it setup on a host-c VPS as cold storage s3 bucket for ente and it was easy to setup and get connected.
Cloudflare will cut you off if you use their CDN for delivering large amounts of files hosted outside of their R2/Stream service. Only exception is Enterprise customers.
R2 gives you 10m uncached reads free, then like $0.36/million. It's definitely the best deal, especially for larger files (max size they'll cache is 512mb).
I use Bunny as a CDN for now, but their support is useless. I've been trying to get them to add the standard "accept-range: bytes" header to 206 responses for month. Each ticket they say they'll prioritize the issue with their team, and then they close the ticket without resolution. What kind of CDN doesn't add standard response headers? Its costed me a lot of bandwidth.
Object storage makes it much easier to do access control and to prevent people from hot linking your shit. You can sign URLs for a limited amount of time, and it’s much easier to integrate with CMS.
Oh no, was considering using that pair for a new project, so that's not a good sign
I presume they don't publish the limits, yeah?
It was fast when I used them to store 250+ TB. They have technical issues from time to time and their support is abysmal though.
I've pushed more than 20 PB per month with B2 and Cloudflare on the free plan, Cloudflare didn't care.
Hmm, seems like your mileage may vary. Just out of curiosity, the technical issues imply this setup shouldn't be used for production?
The issues were mostly 500 or 503 error spikes that happened intermittently a few times per week. They also have a rate limit on API requests per account. For their native API the limit is very low but for the S3 compatible API it's higher.
Let me guess, it's going to be "AI powered" and "scalable" and all of those buzzwords...
Well, since you mentioned "News" I am automatically thinking it's just going to be AI written crap scraped from reddit. Not blaming you, it's just the current perception of new/upcoming "News sites" in general.
Got it, thank you for sharing your experience!
if you're looking for speed/throughput, please self-host and make it close to enduser.
if you're looking for cheap $/gb, r2 is way to go.
r2 is very slow in some regions, very fast in some regions. inconsistent performance
Why not Hetzner Object Storage?
There are also Storj, Telenyx, S4 and others.
Yes, performance with r2 can be hit or miss sometimes. In each r2 region, cloudflare has a cache in front of the storage that isn't visible to users, so maybe files requested less often or their internal routing from r2 cache to the cdn proxy has issues. If all of your files are below 512mb, you can cache it all with the cdn to mitigate the problem, but if it's larger then there's not much that can be done.
You have to pay for egress, I don't recommend it.
If some one interesting based on this comparition https://www.repoflow.io/blog/benchmarking-self-hosted-s3-compatible-storage-a-practical-performance-comparison SeaweedsFS looks more solid than Garage on download score