Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!


Shells Virtual Desktop
BMail.ag - Secure Email Service
Server.net
CPLicense.net
VPS Server
Buy VPN
Vultr
VMs for AI
HostDare
HostDare
ReliableSite White-Label Dedicated Hosting for Resellers
InterServer VPS
BMail.ag - Secure Email Service
Best VPN
High-Performance Bare Metal Server Solutions
Karvl.com
Server Mania Cloud Hosting
DataWagon Hosting
AlphaVPS Hosting
Evoxt.com
Clouvider
VPS Hosting with NVMe
Residential IPs in the US & 4G Mobile Proxies in EU & US with Unlimited Bandwidth
ReliableSite White-Label Dedicated Hosting for Resellers
Rabisu - Hosting Solutions
Shells Virtual Desktop
New on LowEndTalk? Please Register and read our Community Rules.

All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.

Sorting 10TB of mess (10+ years)

2»

Comments

  • @raindog308 said:
    Although my progress has been slow, what I did was setup some NAS space as the Perfectly Organized Future and then I move things to it. For example, although I might have a copy of...oh call it Debian 11.iso...under random folders titled "misc", "debian isos", "linux isos", "linux isos to save", "linux isos backup", etc. I have only one destination so duplicates get sieved out.

    How do you store your lookup index so you know "debian ISOs" = Asians and "Linux ISOs" = amateurs, etc? :D

    Thanked by 1raindog308
  • sort update i guess:
    im down to <5TB already
    my estimate of 10TB and 4TB was off (which is good !) it's been about 8TB and should be probably 2TB (i had a lot of duplicates)

    the naming convention i went with? this:
    name (comment) # {photographer, optional} (location) [date or date range]

    here are few examples (actual ones):
    Utrecht Trip # (Utrecht) [04.10.2019 - 07.10.2019]
    Dresden Klassenfahrt # (Dresden) [13.06.2016 - 17.06.2016]
    Exkursion nach Rostock (my class name...) # (Rostock) [11.07.2017]

    i went with german, because 80% of content is taken in Germany (even tho everything else is in english... oh well)

    i got around 60 fully sorted folders. some are 50gb and some have only 2 pictures...

    friends told me to remove similar looking pictures or advised me to remove things i didn't like anymore, i told them to fuck off :)

    let's hope im done in few months, my "half-sorted" folder has 30k pics to go all a mess and i don't even recognize some, but surely there are few trips here and there that can be assigned

  • bought a 6tb USB hard drive (WB book) from amazon

    Ran all checks, was all fine

    copied about 1tb over

    harddrive started doing some shit so i was like, truenas is running dogshit on 2gigs of ram

    okay, was like, screw truenas

    created a VM on my pc and started copying over all the files...
    getting to the rest, and guess what, errors... errors.... was like whatever, i got backup of that zip

    formatted the drive

    before dumping 1tb on it again, i was like, let's run SMART, i got errors.... ran wb whatever crap utility
    got errors again...

    messaged amazon, will return the drive (they wont give me replacement), once i wipe it like 5x cuz personal data (i copied the really really personal data first ofc)

    TL;DR; im left with no hard drive and all files on 1 drive, no backups (i'll try pushing some backups somehow)
    send hard drives and ram

  • anyways, been few weeks...
    amazon finally gave me money back...
    bought 2x https://www.amazon.de/gp/product/B00DUGDVFM
    will set them as raid here, or zfs or whatever
    then in a year or so I'll buy a 6 or 8tb HDD and put it remote, followed by sync with trash can

    pain in the ass, sorted most of stuff... some are left never to be sorted

    will keep updated

  • I had a loot at picture managers and taggers....
    I found PhotoPrism
    Looks promissing, even if i dont fancy paying (6€/month if you want multiple users)

    Hosted it

    Uploaded 300 pics as a test
    Holy shit is the autotagging bad

    Broken tree? Memorial
    Cat? Dog
    My suitcase? Portrait

    Yeah will probably use it, but not sure if to spend hours tagging by hand...

    Thanked by 1sillycat
  • pretty pissed. the hard drives i ordered were a scam...(oof)
    anyways, getting my money back (again)
    now instead of 2 drives i blew my budget and ordered
    1x Seagate Exos 7E10 ST8000NM017B 8TB (server)
    and
    1x 2tb nvme ssd (pc)
    somehow i'll clear my 6tb good old WB blue drive from me, ship it to remote location and use that as remote backup

    my current pc drive has simply too little storage and too many hours on it

    i spent way too much money and way, way way too many nerves (fuck you scamazon) and money to simply keep 3tb of data safe for the next 3 years

    i hope the next step is deploying the VMs and remote backups and probably PhotoPrism.... pretty pissed tbh but oh well

    Thanked by 1sillycat
  • @DeadlyChemist said: the hard drives i ordered were a scam...(oof)

    How were they a scam? Did they simply fail to send it, or did they fake the capacity?

  • @sillycat said:

    @DeadlyChemist said: the hard drives i ordered were a scam...(oof)

    How were they a scam? Did they simply fail to send it, or did they fake the capacity?

    bought 2 brand new drives

    zero padding when shipping...
    one drive was basically baking oven temp, didnt do anything in windows

    kay

    2nd drive? works perfectly, if you ignore the 60k hours on it

    both with visible PCB heat marks

  • @DeadlyChemist said:

    @sillycat said:

    @DeadlyChemist said: the hard drives i ordered were a scam...(oof)

    How were they a scam? Did they simply fail to send it, or did they fake the capacity?

    bought 2 brand new drives

    zero padding when shipping...
    one drive was basically baking oven temp, didnt do anything in windows

    kay

    2nd drive? works perfectly, if you ignore the 60k hours on it

    both with visible PCB heat marks

    Even receiving brand new drives in the mail is sketchy. I hate best buy with a passion but I'll always buy hard drives in store vs online unless they're SSD/NVME. Corporations tend to take more care of their pallets vs some random airplane baggage guy/some delivery guy. Always think of Ace Ventura...

  • @Don_Keedic said:

    @DeadlyChemist said:

    @sillycat said:

    @DeadlyChemist said: the hard drives i ordered were a scam...(oof)

    How were they a scam? Did they simply fail to send it, or did they fake the capacity?

    bought 2 brand new drives

    zero padding when shipping...
    one drive was basically baking oven temp, didnt do anything in windows

    kay

    2nd drive? works perfectly, if you ignore the 60k hours on it

    both with visible PCB heat marks

    Even receiving brand new drives in the mail is sketchy. I hate best buy with a passion but I'll always buy hard drives in store vs online unless they're SSD/NVME. Corporations tend to take more care of their pallets vs some random airplane baggage guy/some delivery guy. Always think of Ace Ventura...

    i'll always get money back, buyer protection
    but it's frustrating
    the drive i bought is this:
    https://www.computeruniverse.net/de/p/90852431

    i really really hope it comes in 1 piece...

  • @DeadlyChemist said:

    i'll always get money back, buyer protection
    but it's frustrating
    the drive i bought is this:
    https://www.computeruniverse.net/de/p/90852431

    i really really hope it comes in 1 piece...

    Sometimes it's worth paying a small premium up front to be able to walk into a physical location and buy and item (with the ability to walk in and exchange if things aren't proper) vs saving a few bucks online. Non-SSD and NVME hard drives are fairly sensitive pieces of hardware and it doesn't take a whole lot to mess them up Just might want to keep that in mind in case the third time isn't a charm :)

    Fingers crossed for you dude.

  • @Don_Keedic said:

    @DeadlyChemist said:

    i'll always get money back, buyer protection
    but it's frustrating
    the drive i bought is this:
    https://www.computeruniverse.net/de/p/90852431

    i really really hope it comes in 1 piece...

    Sometimes it's worth paying a small premium up front to be able to walk into a physical location and buy and item (with the ability to walk in and exchange if things aren't proper) vs saving a few bucks online. Non-SSD and NVME hard drives are fairly sensitive pieces of hardware and it doesn't take a whole lot to mess them up Just might want to keep that in mind in case the third time isn't a charm :)

    Fingers crossed for you dude.

    well, i dont really have 200€ saved in my pocket (my hourly pay is pretty much scam...) so i generally get stuff like that on long finance and just pay them off as i get money from random saving. not really a choice in stuff like HDD or laptop or stuff for home

    i definitely sleep better knowing i have full copy of my data more than few meters away from my home (across germany)

    i pulled a copy of my data last night, the old old stuff is copied over, spent like a day compressing and copying over to free 320gb hdds i got some time ago...
    got 2 sets of 2 for around 600gb of files

    still all in the same house... the copies will probably get shipped to a random sketchy friend once the actual setup is deployed

  • @DeadlyChemist said:
    well, i dont really have 200€ saved in my pocket (my hourly pay is pretty much scam...) so i generally get stuff like that on long finance and just pay them off as i get money from random saving. not really a choice in stuff like HDD or laptop or stuff for home

    i definitely sleep better knowing i have full copy of my data more than few meters away from my home (across germany)

    i pulled a copy of my data last night, the old old stuff is copied over, spent like a day compressing and copying over to free 320gb hdds i got some time ago...
    got 2 sets of 2 for around 600gb of files

    still all in the same house... the copies will probably get shipped to a random sketchy friend once the actual setup is deployed

    Totally understand! Gotta use what you can to make it work. Have you tried something like Affirm (affirm.com) to finance something, buy it online and pick it up in store? You'd have all the same protections and it'd be financed. Just maybe something to think about if this next hard drive is a dud.

    Why would you be shipping your stuff to a sketchy friend? lol

  • @Don_Keedic said:

    @DeadlyChemist said:
    well, i dont really have 200€ saved in my pocket (my hourly pay is pretty much scam...) so i generally get stuff like that on long finance and just pay them off as i get money from random saving. not really a choice in stuff like HDD or laptop or stuff for home

    i definitely sleep better knowing i have full copy of my data more than few meters away from my home (across germany)

    i pulled a copy of my data last night, the old old stuff is copied over, spent like a day compressing and copying over to free 320gb hdds i got some time ago...
    got 2 sets of 2 for around 600gb of files

    still all in the same house... the copies will probably get shipped to a random sketchy friend once the actual setup is deployed

    Totally understand! Gotta use what you can to make it work. Have you tried something like Affirm (affirm.com) to finance something, buy it online and pick it up in store? You'd have all the same protections and it'd be financed. Just maybe something to think about if this next hard drive is a dud.

    Why would you be shipping your stuff to a sketchy friend? lol

    not sure we have that in germany... also im not officially valiable to be financed so most people deny it to the point i dont try... paypal keeps giving me them (i love paypal regardless of hate)
    my income is 635€/month from work, so yeah.... rough

    well, anyone really, if sketchy friend takes the drives, it's fine, if legit then even better
    guess anyone with a basement and some space
    might knock in 5 or 15 years for a copy werid shit happens in life

Sign In or Register to comment.