New on LowEndTalk? Please Register and read our Community Rules.
All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.
All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.
Expand VPS storage
Hello,
I'm looking for affordable ways to expand the storage on my VPS, which currently has limited capacity. I understand that services like S3 can be mounted to the VPS using rclone, but I've noticed that when I download and upload files with a torrent client, it still consumes storage on the VPS likely due to caching. Are there any other solutions to increase my VPS storage without running into these issues? Thanks!
Edit: The server has 2gb of ram, so i'd rather not use ram for cache
Comments
Fnd a storage server as geographically close to your existing VPS as you can and then mount its disk as an SSHFS mount
https://www.digitalocean.com/community/tutorials/how-to-use-sshfs-to-mount-remote-file-systems-over-ssh
so with this i wont have the issue of cache filling up my main vps storage drive?
No, you'll just have an extra drive that you can write data on. It won't be as fast as the local disk because the data is being written across a network but it's fine for most purposes. You'll probably want to go with a Provider that offers a 14 day money back guarantee to test, but you shouldn't have issues with it
never used SSHFS but rclone works well for this
dear valued customar
have you tired downloading more storage ok
reguards
I'm not too familiar with rclone but I'm not sure it serves the same purpose as SSHFS, as in I don't think it can be used to create a network disk like SSHFS*
*But I might be wrong about that
Rclone with SFTP backend is equivalent to SSHFS.
Another option is Network File System (NFS), as described in @Daniel15 blog:
https://d.sb/2020/12/nfs-howto
It's kernel based and could be faster than SFTP.
rclone still uses cache and i cant directly download files onto it without it taking storage on the local disk
I checked, im pretty sure this also requires cache?
rclone don't support direct r/w to remote target,a local cache is required for normal function.
You could try NFS or iSCSI. But the latency should not high.
SSHFS is dead years ago.
SSHFS does not need a cache.
But random r/w have terrible performance due to protocol limitation.
I have made good experiences with JuiceFS. It mounts remote s3 storage locally. What it does better than rclone is that it chunks the files (I think 64MB or so), so if you want to read from a large file it loads and caches only the needed chunks and not the whole file. Rclone I believe has to download the whole file.
But you will need caching one way or another, he more cache you have, the less painful.
I would Say No to this, You can use Memory as the on device storage (Cache) so local disk would not be used
i mentioned on the post that memory on the server is low therefore i don't want to use memory as cache
So what's the most performant protocol in this scenario? NFS/iSCSI>SSHFS/Rclone>?SMB?/
Most comparisons online are NAS related like: https://blog.ja-ke.tech/2019/08/27/nas-performance-sshfs-nfs-smb.html
How would a hetzner storage box perform if one were to mount it via sshfs/smb? (Assuming low latency)
So related to this thread, I have a NAT VPS with like 5GB storage. Are there any free cloud storages I can mount on? If I create a new google account, I found a post where I can use that to add like 15gb. I wonder if theres a better storage option elsewhere to consider.
So basically this should work not only with SFTP, but also with FTPS?
Also don't you happen to know how resource-intensive (CPU / RAM) this operation is for the "receiving side" (storage)?
I have vps
I have hosting StorageBox 2T from hostbrr @labze
And i add it the ftp as a partition on the vps
In this mode you don't get to mount it as root (because Hostbrr ftp doesn't allow root anyway) hence some docker containers might not run properly on the mounted drive.