Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!

Sign In Register

Quick Links


Shells Virtual Desktop
BMail.ag - Secure Email Service
Server.net
CPLicense.net
VPS Server
Buy VPN
Vultr
VMs for AI
HostDare
ReliableSite White-Label Dedicated Hosting for Resellers
InterServer VPS
BMail.ag - Secure Email Service
Best VPN
High-Performance Bare Metal Server Solutions
Karvl.com
Server Mania Cloud Hosting
DataWagon Hosting
AlphaVPS Hosting
Evoxt.com
Clouvider
VPS Hosting with NVMe
Residential IPs in the US & 4G Mobile Proxies in EU & US with Unlimited Bandwidth
ReliableSite White-Label Dedicated Hosting for Resellers
Rabisu - Hosting Solutions
Shells Virtual Desktop

Categories

In this Discussion

Home › Announcements
New on LowEndTalk? Please Register and read our Community Rules.

All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.

[2024 EXTENDED] Black Friday / Cyber Monday: FLASH SALE & MEGATHREAD

1…865866868870871…1337

Comments

  • FAT32FAT32 Administrator, Deal Compiler Extraordinaire

    @Theezenuts said:
    More

    LOUDER

    Thanked by 2admax r3k
  • FAT32FAT32 Administrator, Deal Compiler Extraordinaire

    @emgh said:
    Can we repeat cyber monday on monday

    Why is @onidel not in your signature

    Thanked by 4onidel emgh admax r3k
  • lukast__lukast__ Member, Megathread Squad

    @FAT32 said: LOUDER

    MOARRRRRRRRRRRRRRRRRRRRRRRRRRRRRRRR

    Thanked by 5FAT32 amj admax satorik r3k
  • maverickmaverick Member

    @FAT32 said:
    What is the best way to utilize storage across many different VPS? Thinking if there's some sort of ZFS over internet :joy:

    @FAT32 said:

    @cybertech said:
    SSHFS cluster

    Ah... I was thinking is it possible to have some sort of auto redundancy, say if I have total storage of 2TB across 10 VPS. Then if I set the max size I need is only 500GB, then it will try its best to replicate the file content to 4 different VPS (2TB / 500GB = 4) creating redundancy.

    moosefs can do that https://github.com/moosefs/moosefs

    Thanked by 5FAT32 ariq01 admax dribbler r3k
  • onidelonidel Member, Patron Provider, Top Host, Megathread Squad

    @FAT32 said:

    @emgh said:
    Can we repeat cyber monday on monday

    Why is @onidel not in your signature

    why @emgh ?

    Thanked by 6FAT32 emgh admax trickeryjoker borkedascii r3k
  • NeoonNeoon Community Contributor, Veteran

    @maverick said:

    @FAT32 said:
    What is the best way to utilize storage across many different VPS? Thinking if there's some sort of ZFS over internet :joy:

    @FAT32 said:

    @cybertech said:
    SSHFS cluster

    Ah... I was thinking is it possible to have some sort of auto redundancy, say if I have total storage of 2TB across 10 VPS. Then if I set the max size I need is only 500GB, then it will try its best to replicate the file content to 4 different VPS (2TB / 500GB = 4) creating redundancy.

    moosefs can do that https://github.com/moosefs/moosefs

    How simple it is to setup? I thought about doing the same, got like 30 VPS's.
    Latency gonna be big sucky sucky but I don't care.

    I also thought about seaweedfs but pain to setup and uses a shiton of memory.
    GlusterFS is an option too.

    Thanked by 3FAT32 ariq01 r3k
  • emghemgh Member, Megathread Squad

    @onidel said:

    @FAT32 said:

    @emgh said:
    Can we repeat cyber monday on monday

    Why is @onidel not in your signature

    why @emgh ?

    Sorry sorry I’ll fix it

    Thanked by 5FAT32 lukast__ onidel admax r3k
  • NeoonNeoon Community Contributor, Veteran

    @Neoon said:

    @maverick said:

    @FAT32 said:
    What is the best way to utilize storage across many different VPS? Thinking if there's some sort of ZFS over internet :joy:

    @FAT32 said:

    @cybertech said:
    SSHFS cluster

    Ah... I was thinking is it possible to have some sort of auto redundancy, say if I have total storage of 2TB across 10 VPS. Then if I set the max size I need is only 500GB, then it will try its best to replicate the file content to 4 different VPS (2TB / 500GB = 4) creating redundancy.

    moosefs can do that https://github.com/moosefs/moosefs

    How simple it is to setup? I thought about doing the same, got like 30 VPS's.
    Latency gonna be big sucky sucky but I don't care.

    I also thought about seaweedfs but pain to setup and uses a shiton of memory.
    GlusterFS is an option too.

    Maybe worth doing like US cluster, EU cluster and APAC cluster.
    Should not suck so much then.

    Thanked by 4FAT32 ariq01 admax r3k
  • maverickmaverick Member
    edited December 2024

    @Neoon said: How simple it is to setup? I thought about doing the same, got like 30 VPS's.
    Latency gonna be big sucky sucky but I don't care.

    I'm afraid it's pretty complex, lots of moving parts... Though, once you get it to work, it's pretty solid. And it does work over WAN, at least it did several years ago when I last ran it. But take good care of the security, because it wasn't meant to be run that way. Also, I don't think that anything below 2 GB RAM is suitable, and depending on the number of files you have, your master server (which keeps all the metadata) might need much more.

    Thanked by 3FAT32 ariq01 r3k
  • let_hstslet_hsts Member

    @FAT32 said:

    @let_hsts said:
    I had exactly the same idea some time ago, some sort of RAID5 over IP :p

    I had thought about something like Snapraid could be used. Some (in very old posts) have said that it could work over network storage, but it is not recommanded at all.

    Turns out the best solution I found was to use something like Syncthing for a sort of RAID1 over IP. Did not implemented it, as I would have preferred a more storage efficient solution (read cheap ;) )

    All the "good" solutions (like CEPH) need block storage access (iSCSI) and a low latency network (LAN 10G at least).
    If you can do iSCSI for your storage, there is also GlusterFS, but... yeah.

    Ya... I have also looked up most of the technologies you mentioned here but sadly there's just no one good solution :/

    I am thinking a simple rclone union as suggested by @MMMMMM could work and we can set multiple union to mimic the "cluster"

    One of them will be master cluster and later on we can use a server to synchronise from master cluster to slave cluster periodically.

    Something like this would work:

    image

    BUT

    • you would have to read and write from/to 2 different locations
    • if a node deadpools, you would have to find another one with about the same spec to replace it
    • it doesn't scale at all

    You are effectively managing a RAID system by hand.
    It would quickly become a nightmare to manage.

    When I did some research about that, there was a lot work done by projects and start-ups about 10-15 years ago.
    We know now that none of them succeeded.

    But maybe with 10G becoming more available, IPv6 to reduce latency and whatnot, it will be worth to give another shot.

    Thanked by 7maverick FAT32 abtdw ariq01 admax dribbler r3k
  • NeoonNeoon Community Contributor, Veteran

    @maverick said:

    @Neoon said: How simple it is to setup? I thought about doing the same, got like 30 VPS's.
    Latency gonna be big sucky sucky but I don't care.

    I'm afraid it's pretty complex, lots of moving parts... Though, once you get it to work, it's pretty solid. And it does work over WAN, at least it did several years ago when I last ran it. But take good care of the security, because it wasn't meant to be run that way. Also, I don't think that anything below 2 GB RAM is suitable, and depending on number of files you have, your master server (which keeps all the metadata) might need much more.

    It looks as complex as glusterfs and seaweedfs.
    Well, so what is the best option?

    Yea I am aware that you need to run a VPN of some sort.

    Thanked by 1r3k
  • amaeva080amaeva080 Member

    @kuroit said:

    @DeviousDev said:
    @kuroit good mornig :)

    https://lowendtalk.com/discussion/comment/4157333#Comment_4157333

    @ypkin said:
    @kuroit
    Recently, I heard that your company's VPS stability is very good. Unfortunately, we couldn't catch up with the previous flash purchases. Can you consider another wave of flash purchases in Singapore for 7 pounds per year?

    @truemagic said:

    @kuroit said:

    @kuroit said:
    Good Morni…..qtujcdeipnvskkurdx 😴

    Finally! Good Morning everyone!

    Not enough Paypal notifications - We need to do something! :#

    I want to be your customer!

    Promocode still works: FAT32 for 50% off.

    Works on any VPS plan on any location including Singapore.

    UK: https://my.kuroit.com/store/west-midlands-uk-vps-servers
    US: https://my.kuroit.com/store/ashburn-usa-vps-servers
    NL: https://my.kuroit.com/store/netherlands-nl-vps-servers
    SG: https://my.kuroit.com/store/singapore-sg-vps-servers

    Awesome @kuroit
    Picked one.

    I see people posting invoice numbers, is there something else attached to these offers?

    Thanked by 1r3k
  • maverickmaverick Member

    @Neoon said:

    @maverick said:

    @Neoon said: How simple it is to setup? I thought about doing the same, got like 30 VPS's.
    Latency gonna be big sucky sucky but I don't care.

    I'm afraid it's pretty complex, lots of moving parts... Though, once you get it to work, it's pretty solid. And it does work over WAN, at least it did several years ago when I last ran it. But take good care of the security, because it wasn't meant to be run that way. Also, I don't think that anything below 2 GB RAM is suitable, and depending on number of files you have, your master server (which keeps all the metadata) might need much more.

    It looks as complex as glusterfs and seaweedfs.
    Well, so what is the best option?

    Good that you mention seaweedfs, I've also tested it briefly. It is good for what it has been made for, millions of small files. MooseFS would not work well in such an environment. It prefers (and was built for) much bigger files, which it chunks in IIRC 64MB files and then takes care of redundancy.

    I've also heard about https://github.com/cubefs/cubefs but have never had time to try it, would appreciate if anybody can share any experience about that one.

    Thanked by 3let_hsts dribbler r3k
  • let_hstslet_hsts Member

    @Neoon said:

    @maverick said:

    @Neoon said: How simple it is to setup? I thought about doing the same, got like 30 VPS's.
    Latency gonna be big sucky sucky but I don't care.

    I'm afraid it's pretty complex, lots of moving parts... Though, once you get it to work, it's pretty solid. And it does work over WAN, at least it did several years ago when I last ran it. But take good care of the security, because it wasn't meant to be run that way. Also, I don't think that anything below 2 GB RAM is suitable, and depending on number of files you have, your master server (which keeps all the metadata) might need much more.

    It looks as complex as glusterfs and seaweedfs.
    Well, so what is the best option?

    Yea I am aware that you need to run a VPN of some sort.

    Yeah, all those network FS are designed for entreprise grade infrastructure, so pretty complex to deploy.
    You will also often need jumbo frames, metadata servers, ...

    I remember looking at MooseFS but I dismissed it, Do not remeber why, but I quickly found this recent Reddit thread. And if you look at the comments, well...

    Thanked by 1r3k
  • NeoonNeoon Community Contributor, Veteran
    edited December 2024

    @maverick said:

    @Neoon said:

    @maverick said:

    @Neoon said: How simple it is to setup? I thought about doing the same, got like 30 VPS's.
    Latency gonna be big sucky sucky but I don't care.

    I'm afraid it's pretty complex, lots of moving parts... Though, once you get it to work, it's pretty solid. And it does work over WAN, at least it did several years ago when I last ran it. But take good care of the security, because it wasn't meant to be run that way. Also, I don't think that anything below 2 GB RAM is suitable, and depending on number of files you have, your master server (which keeps all the metadata) might need much more.

    It looks as complex as glusterfs and seaweedfs.
    Well, so what is the best option?

    Good that you mention seaweedfs, I've also tested it briefly. It is good for what it has been made for, millions of small files. MooseFS would not work well in such an environment. It prefers (and was built for) much bigger files, which it chunks in IIRC 64MB files and then takes care of redundancy.

    I've also heard about https://github.com/cubefs/cubefs but have never had time to try it, would appreciate if anybody can share any experience about that one.

    Considering seaweedfs is probably the easiest to setup.
    However as you said, only usable for smol files.

    I already managed to make it crash a few times since upload large files cost you about equal memory usage.
    So either seaweedfs for cluster optimized for small files or glusterfs/moosefs for bigger ones.

    Thanked by 1r3k
  • RamsterdamRamsterdam Member

    @FAT32 said:
    Did anyone promised anything on page 888 yet? We are still short of ~200k views to be the most viewed thread 🚀

    Dedicated server ... $8.88/yr

    Thanked by 6FAT32 zGato lukast__ admax Porlam r3k
  • FAT32FAT32 Administrator, Deal Compiler Extraordinaire

    @Ramsterdam said:
    Dedicated server ... $8.88/yr

    I think only @DataIdeas-Josh can do it with their Rpi Zero...

    Thanked by 5admax rahid Ramsterdam JoshR r3k
  • NeoonNeoon Community Contributor, Veteran

    @FAT32 said:

    @Ramsterdam said:
    Dedicated server ... $8.88/yr

    I think only @DataIdeas-Josh can do it with their Rpi Zero...

    cmon drop it like its hot.

    Thanked by 3FAT32 JoshR r3k
  • sammsamm Member

    where is @host_c today?

    Thanked by 4FAT32 admax WTF r3k
  • maverickmaverick Member

    @samm said:
    where is @host_c today?

    Spent all IPv4, gone fishin'...

    Thanked by 5samm FAT32 ariq01 admax r3k
  • FAT32FAT32 Administrator, Deal Compiler Extraordinaire

    @samm said:
    where is @host_c today?

    Trying to look at which minion underperformed and need to be removed

    Thanked by 4samm maverick admax r3k
  • _MS__MS_ Member
    edited December 2024

    @samm said:
    where is @host_c today?

    Setting up more storage for LET/LES.

    Thanked by 7maverick samm ariq01 admax rahid FAT32 r3k
  • Cryptominer937Cryptominer937 Member

    I'm up to 3 Dedicated, 7 VPS from this thread. FYI scrolling back through flash deals and.............. Some of them have been back in stock. (Guessing from unpaid invoice removal)

    Thanked by 4FAT32 ariq01 admax r3k
  • NeoonNeoon Community Contributor, Veteran

    I forgor about this one.
    https://github.com/Ne00n/seaweed-spawner-3000

    However its not really decentralized, should be able to grow a cluster at least though.

    Thanked by 2FAT32 r3k
  • rahidrahid Member

    @wewehello said:
    I'm up to 3 Dedicated, 7 VPS from this thread. FYI scrolling back through flash deals and.............. Some of them have been back in stock. (Guessing from unpaid invoice removal)

    Can you point me to a storage one? 😁

    Thanked by 1r3k
  • Cryptominer937Cryptominer937 Member

    @rahid said:

    @wewehello said:
    I'm up to 3 Dedicated, 7 VPS from this thread. FYI scrolling back through flash deals and.............. Some of them have been back in stock. (Guessing from unpaid invoice removal)

    Can you point me to a storage one? 😁

    I think I got the last VPS Hornet Revision 2.0 - Storage 1TB - I125 from Host-c
    but I know i clicked others that were in stock, just don't want to go back pages LOL

    Thanked by 3admax rahid r3k
  • Cryptominer937Cryptominer937 Member

    @rahid said:

    @wewehello said:
    I'm up to 3 Dedicated, 7 VPS from this thread. FYI scrolling back through flash deals and.............. Some of them have been back in stock. (Guessing from unpaid invoice removal)

    Can you point me to a storage one? 😁

    Servarica, and LevelOneServers have some good yearly prices for storage vps's over in their threads.

    Thanked by 4FAT32 admax rahid r3k
  • bitbit Member
    edited December 2024

    ...

    Thanked by 1r3k
  • admaxadmax Member, Megathread Squad

    @wewehello said:

    @rahid said:

    @wewehello said:
    I'm up to 3 Dedicated, 7 VPS from this thread. FYI scrolling back through flash deals and.............. Some of them have been back in stock. (Guessing from unpaid invoice removal)

    Can you point me to a storage one? 😁

    I think I got the last VPS Hornet Revision 2.0 - Storage 1TB - I125 from Host-c
    but I know i clicked others that were in stock, just don't want to go back pages LOL

    Oh no! I found that when my browser refreshed to another page, it was also at the moment when the "invoice removed" notification was sent. I saw that it was Host_C's IPv6 1TB box. Then I went to look for a discount code, but by the time I entered it, it was out of stock.

    Thanked by 1r3k
  • NeoonNeoon Community Contributor, Veteran

    @Neoon said:
    I forgor about this one.
    https://github.com/Ne00n/seaweed-spawner-3000

    However its not really decentralized, should be able to grow a cluster at least though.

    hmmm yea dc and rack options, lit.
    So you can just set the default to put your files in 2 different datacenters.

    Thanked by 1r3k
This discussion has been closed.