New on LowEndTalk? Please Register and read our Community Rules.
All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.
All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.
Comments
Told ya
Are you using SSHFS to provide an SFTP connection with an SSH key, or just the default access key and secret key? This wouldn’t be secure, right? Because it uses SSH with a password.
You can add keys just like with any other machine
I'm not seeing any mention of how to use ssh-key in these docs, though.
https://juicefs.com/docs/community/reference/how_to_set_up_object_storage#sftp
Ie. standard Linux procedure
Got my 3TB Threadripper working.
YABS:
HDD:
GOOOOOOOOO
At this point I'm afraid Labze dozed off in a rack, haven't seen him in 36 hours.
I mean, I didn't look, but still.
Mind sharing how to set it up? I use this command; it seems JuiceFS does not recognize an alias in .ssh/config.
juicefs format \
--storage=sftp \
--bucket=somealias:/mnt/storage/ \
redis://localhost:6379/1 myjfs
Yeah. Just wait and see
I've got no idea how JuiceFS works, that was another poster.
I can't wait harder than I am already waiting, I promise
JuiceFS keep your metadata locally, that's why you get impressive speed for lots of smal operations unlike of rclone which request meta everytime from the server, juice takes it from local redis/sqlite/etc. i don't know what happens if you will use your storage in two places, probably, juce will go to storage if didn't get meta locally and performance will the same as for rclone.
It wasn't a question from me, it was from the other guy hahaha
Love this quoting system
If he was in thread, he will get a notification. Don't worry.
does it comes with jetbacup?
The deal I wanted the most is no longer available.
Which one?
Is JuiceFS faster than rclone mount ftp? As I am getting almost the desired results with it.
What are you using rclone mount ftp for?
Heard he died
Happens to the best of us after 2+ allnighters
Testing for immich, I know it's not secure, but perf is great!
Try rclone encryption wraper, that's will be secure.
Yes, this. My transfer speeds above were for rclone with crypt over sftp. All my data stored on Hostbrr is fully encrypted. Note that it does leak some details, like the size and approx path length since each file is mapped 1:1 from source to target.
Turn on encryption for dir names
Yes, but the approx length of the path and size of each file is still exposed.
I think you might be looking at the wrong solution if your data is so sensitive that you're afraid of even showing the approximate amount of characters in the file names, yet go for the cheapest service possible.
Just sayin.
Howdy yall! I did some extensive testing on JuiceFS vs rclone some time ago. The TLDR is the difference is negligible, I think any performance differences between them may arise if you get into multi-gigabit network speeds. The performance of the Storagebox is so far below the limits of either rclone mount or JuiceFS that I saw no difference. The most important difference in performance is the size of your cache, which needs to be enabled for rclone manually (i.e. through command line switches).
I think the main difference between rclone mount sftp and JuiceFS over sftp is that juicefs chunks all files at IIRC 64MB. So if you open a huge multi-GB file, rclone will (I think) download the entire file into the cache, whereas JuiceFS will only fetch the chinks that you are interested in. Also, I think JuiceFS has a bit more aggressive readahead. The downside of JuiceFS is that without the metadata DB your data is worthless, whereas rclone just stores your files as is and is as such a bit more resilient (or synergizes more with other programs accessing the data)