Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!


Shells Virtual Desktop
BMail.ag - Secure Email Service
Server.net
CPLicense.net
VPS Server
Buy VPN
Vultr
VMs for AI
HostDare
ReliableSite White-Label Dedicated Hosting for Resellers
InterServer VPS
BMail.ag - Secure Email Service
Best VPN
High-Performance Bare Metal Server Solutions
Karvl.com
Server Mania Cloud Hosting
DataWagon Hosting
AlphaVPS Hosting
Evoxt.com
Clouvider
VPS Hosting with NVMe
Residential IPs in the US & 4G Mobile Proxies in EU & US with Unlimited Bandwidth
ReliableSite White-Label Dedicated Hosting for Resellers
Rabisu - Hosting Solutions
Shells Virtual Desktop
New on LowEndTalk? Please Register and read our Community Rules.

All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.

Mount iDrive e2 take up VPS disk space?

ok i s3fs mount a idrive e2 (20GB) to my debian VPS of 50GB
mount as in, if copy a file to $ /home/user/e2 , the same file will appear in iDrive cloud
vice versa, if i delete a file from iDrive cloud via browser, the file will disappear from my VPS.

Question, i notice my VPS $ df -h, the mounted 20GB is part of the 50GB allocated to my VPS plan.

How is that possible since I am mounting remote to local disk???

Comments

  • Temporary(?) Cache(?) I think ita needed so we can "read" the s3 files on local

  • /etc/fstab perm mount

    s3fs#backup-linux /home/user/e2 fuse _netdev,allow_other,passwd_file=/etc/passwd-s3fs,uid=user,gid=user,url=https://ixgx.sg.idrivee2-xx.com/ 0 1

  • Use Rclone to mount, just minimize the cache

    Thanked by 1darkimmortal
  • but does rclone also take up same diskspace on my vps as per s3fs?

  • @bustersg said:
    but does rclone also take up same diskspace on my vps as per s3fs?

    You can actually limit the space used by an s3fs mount for caching.

    s3fs <bucket-name> <mount-point> -o use_cache=<cache-directory> -o ensure_diskfree=<size>

  • bustersgbustersg Member
    edited October 2024

    @loay said:

    @bustersg said:
    but does rclone also take up same diskspace on my vps as per s3fs?

    You can actually limit the space used by an s3fs mount for caching.

    s3fs <bucket-name> <mount-point> -o use_cache=<cache-directory> -o ensure_diskfree=<size>

    but i want to see 1:1 on my vps.
    i dont login idrive s3 anymore.
    i monitor and check files existence from vps.
    so if i use cache, does that mean, i only see latest file(s) modified or some sort?

  • @bustersg said: so if i use cache, does that mean, i only see latest file(s) modified or some sort?

    Caching is used for files you want to read/write to, helping to improve performance depending on your setup. The files will remain in idrive and will only be cached when you access them.

  • @bustersg said:
    but does rclone also take up same diskspace on my vps as per s3fs?

    The size of the cache is completely customizable, I think you could just configure a very small cache for data caching, say 5GB, and that would be perfectly fine.

    You can even disable it, but disabling it completely will affect the performance of the access at some point, so it's best to leave it on a little bit to make sure to offset the high latency from unstable network transfers.

  • @bustersg said:
    ok i s3fs mount a idrive e2 (20GB) to my debian VPS of 50GB
    mount as in, if copy a file to $ /home/user/e2 , the same file will appear in iDrive cloud
    vice versa, if i delete a file from iDrive cloud via browser, the file will disappear from my VPS.

    Question, i notice my VPS $ df -h, the mounted 20GB is part of the 50GB allocated to my VPS plan.

    How is that possible since I am mounting remote to local disk???

    Paste your df -h output.

  • bustersgbustersg Member
    edited October 2024

    my vps 33G
    my DIR "backup-e2" takes (27-14)G = 13G
    am i right to say that "s3fs mount a remote cloud drive will take up my local VPS disk space" ?
    if answer is "yes", i am puzzled as on why? is it a cache thing that previous posts mention?

    Filesystem      Size  Used Avail Use% Mounted on
    /dev/vda1        33G   27G  3.9G  88% /
    tmpfs           3.9G     0  3.9G   0% /dev/shm
    tmpfs           5.0M     0  5.0M   0% /run/lock
    s3fs            256T     0  256T   0% /home/user/backup-e2
    
    $ du -sh /home/ --exclude=/home/user/backup-e2
    14G /home
    
    $ du -sh /home/ --exclude=/home/
    27G /home
    
  • $ du -sh /home/
    27G /home

    correction to previous post code

  • Really interesting discussion—and definitely a common point of confusion when working with cloud mounts like s3fs. What you're seeing is indeed expected behavior: while the data lives remotely, the system still uses local space for metadata and caching operations. s3fs in particular can be cache-hungry depending on how it's configured, especially if use_cache or ensure_diskfree options aren’t tuned. If you're aiming for near-zero local footprint, switching to rclone with minimal caching or even exploring union mounts with stricter sync policies might help. But even then, expect some overhead if you want real-time visibility of your cloud files from the VPS.

  • Not sure why JuiceFS seems to be quite unpopular? Don't notice it being mentioned very much in this forum, but it works great for me -- metadata operations are basically instant and caching amount is minimal (and controllable, I guess similar to the other mount strategy).

Sign In or Register to comment.