Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!


Shells Virtual Desktop
BMail.ag - Secure Email Service
Server.net
CPLicense.net
VPS Server
Buy VPN
Vultr
VMs for AI
HostDare
ReliableSite White-Label Dedicated Hosting for Resellers
InterServer VPS
BMail.ag - Secure Email Service
Best VPN
High-Performance Bare Metal Server Solutions
Karvl.com
Server Mania Cloud Hosting
DataWagon Hosting
AlphaVPS Hosting
Evoxt.com
Clouvider
VPS Hosting with NVMe
Residential IPs in the US & 4G Mobile Proxies in EU & US with Unlimited Bandwidth
ReliableSite White-Label Dedicated Hosting for Resellers
Rabisu - Hosting Solutions
Shells Virtual Desktop
New on LowEndTalk? Please Register and read our Community Rules.

All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.

Selfhosted S3

I'm playing around with the idea of setting up some selfhosted S3 storage. The idea is to use it for backups, nextcloud and whatever else I might see fit. Mostly just personal playground.

So far I've looked at SeaweedFS, MinIO and Garage. Any quick thoughts or recommendations? I'm sure each solution has it's pros and cons and is suitable in different scenarios, anyone with some experience that can shed some light?

«1

Comments

  • I personally only use (self hosted)S3 occasionally. Since I'm already using AList,I just use the S3 feature inbuilt.

  • I know Minio is pretty good

    Thanked by 1fayaz90
  • I installed and use minio at work, and personally using garage at my own lowend vps. Both are fine.

    Usability-wise for personal use, I would recommend minio because of the web interface. But too resource intensive for my low end taste.

    Garage was OK to install and use, uses very little resources. Doc is very good, I configured it to listen on localhost and a caddy reverse proxy doing SSL for it. Doing my rclone and restic backups to its buckets with no issues yet (3 months) -- restic restore check finds it all good.

  • @eliphas said:
    I installed and use minio at work, and personally using garage at my own lowend But too resource intensive for my low end taste.

    show me the numbers?

  • @ehab said:

    @eliphas said:
    I installed and use minio at work, and personally using garage at my own lowend vps. MINIO too resource intensive for my low end taste.

    show me the numbers?

    Just current htop output. This is as idle as they get, nobody is using either one of them in this instant:

    2-core 2GB personal vps (other 4 threads not showing):
        PID USER       PRI  NI  VIRT   RES   SHR S  CPU% MEM%▽  TIME+  Command
       7105 root        20   0 1024G  4728  4096 S   0.0  0.2  0:00.21 /garage server
    
    8-core-16GB office vm (other 27 threads not showing):
      PID USER      PRI  NI  VIRT   RES   SHR S CPU% MEM%   TIME+  Command
    22298 root       20   0 2354M  491M 21772 S  4.6  3.1 34h30:07 minio server
    

    I evaluated and measured both when choosing our restic backend, and both performed well in the single-node simple configuration with huge zfs disks backend that was our goal.

    In the small 2GB VPS trying minio, I found my VM sluggish at backup times, what I did not see with garage. I can tell that my restic backups are a tad bit slow with garage in that small VPS, but at least it does not gob down the entire server.

    Thanked by 5ehab 0xC7 vicaya gks OhJohn
  • With minio community, you don't get disk monitoring, which is fucking lame.

    Thanked by 1MannDude
  • @eliphas said:
    I installed and use minio at work, and personally using garage at my own lowend vps. Both are fine.

    Usability-wise for personal use, I would recommend minio because of the web interface. But too resource intensive for my low end taste.

    Garage was OK to install and use, uses very little resources. Doc is very good, I configured it to listen on localhost and a caddy reverse proxy doing SSL for it. Doing my rclone and restic backups to its buckets with no issues yet (3 months) -- restic restore check finds it all good.

    This fits the picture I've got from only reading the docs.
    Thank you.

  • I've only ever used minio and seaweedfs on hetzner.

    When installed on a single node both work great. When used in a distributed way (multiple nodes) you should also set up a private network (an actual switch and LAN, not vswitch) and have the servers communicate over that rather than over the public network (internet), otherwise the performance will be very poor.

  • gksgks Member

    Minio has 1 TB limit? I remember this number, not sure recently still limit applicable. Or it may be for cluster?

  • @gremeyer said:
    I've only ever used minio and seaweedfs on hetzner.

    When installed on a single node both work great. When used in a distributed way (multiple nodes) you should also set up a private network (an actual switch and LAN, not vswitch) and have the servers communicate over that rather than over the public network (internet), otherwise the performance will be very poor.

    That should be the strength of garage, his cluster code is oriented for coping well with nodes that may have high latencies in a geo distributed deployment.

    @gks said:
    Minio has 1 TB limit? I remember this number, not sure recently still limit applicable. Or it may be for cluster?

    If that limit is written in their docs anywhere, I definitely missed it.

    Thanked by 1OhJohn
  • For anyone else coming across this - garage looks a really good solution

    Compared to Minio you're fine with 3 x garage nodes instead of the recommended 4 of minio.

    & 1gb RAM is fine.

  • I use zipline https://zipline.diced.sh/ also good

  • Is there any S3 software like MinIO that can be deployed using Docker? I really hate configuring everything manually, which is very tough for migrations.

  • @NaughtyWombat said:
    Is there any S3 software like MinIO that can be deployed using Docker? I really hate configuring everything manually, which is very tough for migrations.

    Anilist.......

  • @NaughtyWombat said: S3 software like MinIO that can be deployed using Docker

    Garage can be deployed in docker, really great self-hosted S3 app.

  • I wouldn't recommend Minio if using the community version. They have the habit of enshitifying by stripping away features from their free version to the paid one

  • @fzorb said:
    I know Minio is pretty good

    Oh no , they removed admin panel

  • Minio used to be the preferred solution but since they stripped all the features out of the free edition, its looks like SeaweedFS is the way to go....

  • @barbarza said:
    Minio used to be the preferred solution but since they stripped all the features out of the free edition, its looks like SeaweedFS is the way to go....

    Oh they removed almost everything from admin panel

  • HushedManHushedMan Member, Host Rep

    MinIO has always been my favorite, but unfortunately, as of April 2025, most administrative features were removed from the web UI in the free, open-source version. This change drastically limited what you can do through the graphical interface, leaving only a basic object browser.

    For reference: LowEndBox article

    Because of this, I continue to use version RELEASE.2025-04-22T22-12-26Z.

  • Garage + Garage WebUI is brilliant for self-hosting S3.

    Thanked by 1OhJohn
  • But it lacks versioning if I read that correctly?

    Thanked by 1JC_Dev
  • @OhJohn said:

    But it lacks versioning if I read that correctly?

    To my knowledge, yes you are correct, for V1 at least. V2 has just been released so maybe it can/will be added? I’m not sure.

    I like garage because of how simple it is to deploy and setup, but yes lacking more advance features that you might find with say, MinIO or others.

    Thanked by 2OhJohn NaughtyWombat
  • @eliphas said:

    @gremeyer said:
    I've only ever used minio and seaweedfs on hetzner.

    When installed on a single node both work great. When used in a distributed way (multiple nodes) you should also set up a private network (an actual switch and LAN, not vswitch) and have the servers communicate over that rather than over the public network (internet), otherwise the performance will be very poor.

    That should be the strength of garage, his cluster code is oriented for coping well with nodes that may have high latencies in a geo distributed deployment.

    The problem isn't latency, it's Hetzner's unmetered 1 Gbps uplink. It will work much better with 10 Gbps, but you only get 20 TB of traffic on 10 Gbps with Hetzner, and their overage pricing isn't worth it.

  • Always Minio, best long-term stable, and enterprise grade solution, must use nvme drive,

  • @HushedMan said:
    MinIO has always been my favorite, but unfortunately, as of April 2025, most administrative features were removed from the web UI in the free, open-source version. This change drastically limited what you can do through the graphical interface, leaving only a basic object browser.

    For reference: LowEndBox article

    Because of this, I continue to use version RELEASE.2025-04-22T22-12-26Z.

    its removed from GUI, but you can use mc, or use old version below 2025

  • HushedManHushedMan Member, Host Rep

    @fayaz90 said:

    @HushedMan said:
    MinIO has always been my favorite, but unfortunately, as of April 2025, most administrative features were removed from the web UI in the free, open-source version. This change drastically limited what you can do through the graphical interface, leaving only a basic object browser.

    For reference: LowEndBox article

    Because of this, I continue to use version RELEASE.2025-04-22T22-12-26Z.

    its removed from GUI, but you can use mc, or use old version below 2025

    RELEASE.2025-04-22T22-12-26Z is the last version that has GUI integration.

    Thanked by 2fayaz90 JohnnySac
  • @HushedMan said:

    @fayaz90 said:

    @HushedMan said:
    MinIO has always been my favorite, but unfortunately, as of April 2025, most administrative features were removed from the web UI in the free, open-source version. This change drastically limited what you can do through the graphical interface, leaving only a basic object browser.

    For reference: LowEndBox article

    Because of this, I continue to use version RELEASE.2025-04-22T22-12-26Z.

    its removed from GUI, but you can use mc, or use old version below 2025

    RELEASE.2025-04-22T22-12-26Z is the last version that has GUI integration.

    yepp,

    i loved replication feature, but Erasure coding need more powerful cpu and data center nvme drive, it mostly slow down the write and delete speed, like 4x lower than read redundancy.

  • itsTomHarperitsTomHarper Member, Megathread Squad

    I recently started tinkering with Seaweedfs. Now I've a 4 node k3s cluster with swfs running on em all. Entirely a multi master cluster one leader is automatically elected through rafter quorum with a default replication set to 100 at least a copy on all dcs. It's been pretty solid so far, especially the write and read speeds. They offer a s3 interface as well

    Thanked by 2rcy026 OhJohn
  • Which one is "better"?
    SeaweedFS (with their S3 interface) or Garage?

Sign In or Register to comment.