Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!


Shells Virtual Desktop
BMail.ag - Secure Email Service
Server.net
CPLicense.net
VPS Server
Buy VPN
Vultr
VMs for AI
HostDare
HostDare
ReliableSite White-Label Dedicated Hosting for Resellers
InterServer VPS
BMail.ag - Secure Email Service
Best VPN
High-Performance Bare Metal Server Solutions
Karvl.com
Server Mania Cloud Hosting
DataWagon Hosting
AlphaVPS Hosting
Evoxt.com
Clouvider
VPS Hosting with NVMe
Residential IPs in the US & 4G Mobile Proxies in EU & US with Unlimited Bandwidth
ReliableSite White-Label Dedicated Hosting for Resellers
Rabisu - Hosting Solutions
Shells Virtual Desktop
New on LowEndTalk? Please Register and read our Community Rules.

All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.

300TB of online storage on a budget

24

Comments

  • plumbergplumberg Veteran, Megathread Squad

    @vjunkie
    Do you need all 300TB of data hit (accessible immediately)? how often you want to look at really old vhs digitized?

    If not start looking into S3 glacier for majority of your data. It is highly recommended for cheap and infrequently retrieved data.

    Thanked by 1quicksilver03
  • NetDynamics24NetDynamics24 Member, Host Rep
    edited February 2024

    @NetDynamics24 said:

    Better price can be done for quarter billing cycle.

    The server of our offer has 336 TB raw storage and we can offer it for $345/mo billed quarterly. That is a ratio of only $1.02 per TB!

    https://www.netdynamics24.com/client/order.php?step=1&productGroup=18

    Thanked by 1dedicados
  • https://quotaless.cloud/
    300TB = $600 one-time + $60 monthly

  • @jaimedelano said:
    https://quotaless.cloud/
    300TB = $600 one-time + $60 monthly

    This type of pricing doesn't make sense, you'll get rugpulled.

  • @ddorian43 said:

    @jaimedelano said:
    https://quotaless.cloud/
    300TB = $600 one-time + $60 monthly

    This type of pricing doesn't make sense, you'll get rugpulled.

    I agree, that business model doesn't look very sustainable long term unless is comes with heavy limitations (bandwidth, retention, I/O). I wonder if this is one of those services that resell unlimited Telegram or Discord storage.

  • gdrive still provide some weird boxes
    each Enterprise standard sub cost 2160 try(70$) yearly
    each sub can give you 5TB storage and can contact support to get 5TB more each 3months
    That means you can stack some subs,but i doubt will google delete your sub?...

  • @vjunkie said:
    I can probably trim it down to 200TB. The vast majority of my files are pictures of family albums that have been digitized, and lots and lots of family vhs recordings transferred to digital going back to my grandfather getting his first old school portable vhs recorder and filming his family going everywhere. ( He filmed his family through the years visiting every state in the US. That was his goal for his kids, to take them to each state )

    For pictures/VHS videos, the best route would be to get an OG Pixel with unlimited space / original quality and upload those videos to google photos.

    Thanked by 1darkimmortal
  • You can fit 300TB on a single tape, but retrieval time will be ... not optimal.

  • @yoursunny said:

    @vjunkie said:
    I can probably trim it down to 200TB. The vast majority of my files are pictures of family albums that have been digitized, and lots and lots of family vhs recordings transferred to digital going back to my grandfather getting his first old school portable vhs recorder and filming his family going everywhere. ( He filmed his family through the years visiting every state in the US. That was his goal for his kids, to take them to each state )

    Upload all the videos to YouTube or XTube (depending on content type), delete locally.
    Downscale all the photos to 2048x1536 at JPEG quality 80.
    You'll have much less content to store.

    But is there a private video function on XTube? Asking for a friend

  • @Calin said: 17x 18 TB HDD SAS Enterprise (4Kn) [306 TB Storage] (raid 5)

    who gave you that raid-5 idea? that's the perfect recipe for a disaster.
    what's your plan to do with it if one disk fails? replace and run a rebuild? ever heard of UREs?

    even JBOD would be much safer for your data, as the data loss would be a lot smaller.
    but good luck though.

    Thanked by 3raindog308 eris bench
  • Hello @Falzo customer it's free to choice , raid 5 , 6 , 60 or 10

    Regards

  • yoursunnyyoursunny Member, IPv6 Advocate
    edited February 2024

    @artxs said:
    For pictures/VHS videos, the best route would be to get an OG Pixel with unlimited space / original quality and upload those videos to google photos.

    … until Google shuts it down.

    @shruub said:

    @yoursunny said:
    Upload all the videos to YouTube or XTube (depending on content type), delete locally.
    Downscale all the photos to 2048x1536 at JPEG quality 80.
    You'll have much less content to store.

    But is there a private video function on XTube? Asking for a friend

    We set all the videos pubic.
    There's nothing to hide.
    https://youtube.com/@yoursunnyPower

  • @yoursunny said:
    … until Google shuts it down.

    until the provider deadpools
    until the hard drives die

    without a redundant copy, the chances of data loss are all the same, but google is the cheapest ($0).

  • @yoursunny said:
    We set all the videos pubic.
    There's nothing to hide.
    https://youtube.com/@yoursunnyPower

    top tier content.

    Thanked by 1yoursunny
  • @vjunkie said:
    I can probably trim it down to 200TB. The vast majority of my files are pictures of family albums that have been digitized, and lots and lots of family vhs recordings transferred to digital going back to my grandfather getting his first old school portable vhs recorder and filming his family going everywhere. ( He filmed his family through the years visiting every state in the US. That was his goal for his kids, to take them to each state )

    Perhaps changing the codecs, the compression is an option ...

  • darkimmortaldarkimmortal Member
    edited February 2024

    @Falzo said:

    @Calin said: 17x 18 TB HDD SAS Enterprise (4Kn) [306 TB Storage] (raid 5)

    who gave you that raid-5 idea? that's the perfect recipe for a disaster.
    what's your plan to do with it if one disk fails? replace and run a rebuild? ever heard of UREs?

    even JBOD would be much safer for your data, as the data loss would be a lot smaller.
    but good luck though.

    A single URE bringing down an entire raid 5 during rebuild is an outdated myth. You just lose that chunk

  • edited February 2024

    @vjunkie said:

    @kevinds said:

    @vjunkie said:
    If you can recommend anyone that won't break the bank monthly, let me know. I have searched and the quotes I get for 300TB are wayyyyyyyyy more then I want to pay.

    What do you want to pay (as a number)?

    300-500 for 200TB

    Dollar? Euro? Month? Year?

  • jlet88jlet88 Member
    edited February 2024

    I would NEVER EVER trust 200-300TB of my most precious family memories in the cloud, anywhere, by anyone, unless I also had TWO robust local copies in my physical possession. The 3-2-1 backup strategy is the only way to go for something so important.

    I mean, seriously.... this is awesome that you have this special content, congrats to you for collecting it! This content is priceless to your family for generations. "Pictures of family albums that have been digitized, and lots and lots of family vhs recordings transferred to digital going back to my grandfather getting his first old school portable vhs recorder and filming his family going everywhere."

    Way too precious content to be screwing around with. I'd personally break them down into more manageable chunks (50-100TB per chunk), and set up a few UNRAID servers or Synology servers with proper redundancy for your local copies.

    This will cost you money, of course, so it's worth talking with your family to share costs. It is worth it!

    Additionally, I'd look into transcoding ALL the videos into a more compact codec, if possible, to save space!

    Once you have your own LOCAL, REDUNDANT (TWO COPIES) set of data IN YOUR PHYSICAL POSSESSION, then I would really figure out with your family (among other like-minded smart family members), so you can establish a long-term sane plan for the family to help cover costs and retain a minimum 3-2-1 standard of data protection (3 copies of data, 2 copies local, 1 copy off-site). The off-site copy can be a cloud service (expensive) OR it can be another bunch of hard drives (or UNRAID/Synology servers) over at a trusted family member's house.

    Good luck! You have a treasure! Take good care of it!

  • hyperhostsolutionshyperhostsolutions Member, Patron Provider

    is backblaze still not unlimited or have they pulled it do ? pretty sure there personal device backups are unlimited

  • @jlet88 said:
    I would NEVER EVER trust 200-300TB of my most precious family memories in the cloud, anywhere, by anyone, unless I also had TWO robust local copies in my physical possession. The 3-2-1 backup strategy is the only way to go for something so important.

    I mean, seriously.... this is awesome that you have this special content, congrats to you for collecting it! This content is priceless to your family for generations. "Pictures of family albums that have been digitized, and lots and lots of family vhs recordings transferred to digital going back to my grandfather getting his first old school portable vhs recorder and filming his family going everywhere."

    Way too precious content to be screwing around with. I'd personally break them down into more manageable chunks (50-100TB per chunk), and set up a few UNRAID servers or Synology servers with proper redundancy for your local copies.

    This will cost you money, of course, so it's worth talking with your family to share costs. It is worth it!

    Additionally, I'd look into transcoding ALL the videos into a more compact codec, if possible, to save space!

    Once you have your own LOCAL, REDUNDANT (TWO COPIES) set of data IN YOUR PHYSICAL POSSESSION, then I would really figure out with your family (among other like-minded smart family members), so you can establish a long-term sane plan for the family to help cover costs and retain a minimum 3-2-1 standard of data protection (3 copies of data, 2 copies local, 1 copy off-site). The off-site copy can be a cloud service (expensive) OR it can be another bunch of hard drives (or UNRAID/Synology servers) over at a trusted family member's house.

    Good luck! You have a treasure! Take good care of it!

    Exactly. Keep one good array at home + Backup/Archive + a copy at another family members place + one cloud backup. At least.

    Only 1x local + 1x Cloud is definitely not enough.

    Thanked by 1jlet88
  • @vjunkie said:
    I can probably trim it down to 200TB. The vast majority of my files are pictures of family albums that have been digitized, and lots and lots of family vhs recordings transferred to digital going back to my grandfather getting his first old school portable vhs recorder and filming his family going everywhere. ( He filmed his family through the years visiting every state in the US. That was his goal for his kids, to take them to each state )

    VHS is low quality, more than 1 GB per hour is wasting data. Compress it. Unless you have 200,000 hours already, that takes 25 years to watch.

  • kevindskevinds Member, LIR

    @commercial said: Perhaps changing the codecs, the compression is an option ...

    VHS to digital, likely MPEG.. Changing to H.265 will save a LOT of space with no loss in quality.

    @KnightHider said: VHS is low quality, more than 1 GB per hour is wasting data.

    Even 0.5 GB/hour is wasting space...

  • bgerardbgerard Member
    edited February 2024

    @kevinds said:

    @commercial said: Perhaps changing the codecs, the compression is an option ...

    VHS to digital, likely MPEG.. Changing to H.265 will save a LOT of space with no loss in quality.

    @KnightHider said: VHS is low quality, more than 1 GB per hour is wasting data.

    Even 0.5 GB/hour is wasting space...

    +1 for encoding to H265. Surely nobody can have 200-300TB of family data when stored with appropriate compression / encoding.

    OP, setup Tdarr to convert your data appropriately. Rent a dedi (maybe a pulsedmedia MD could work well for encoding), pull files from the cloud, run through tdarr, push to S3 storage, B2 for stuff you think you'll access relatively frequently, S3 Glacier for stuff you want to keep but realistically won't use.

    I'd probably also pull out stuff that's ultra valuable and replicate that in multi places including locally

  • @kevinds said:

    @commercial said: Perhaps changing the codecs, the compression is an option ...

    VHS to digital, likely MPEG.. Changing to H.265 will save a LOT of space with no loss in quality.

    @KnightHider said: VHS is low quality, more than 1 GB per hour is wasting data.

    Even 0.5 GB/hour is wasting space...

    For sure he needs better encoding but h265 is a dubious choice for VHS - doesn’t maintain detail in grain as well as h264 (even with grain tune) and doesn’t support interlaced so you are forced into the deep rabbit hole of quality deinterlacing

  • kevindskevinds Member, LIR

    @darkimmortal said:
    For sure he needs better encoding but h265 is a dubious choice for VHS - doesn’t maintain detail in grain as well as h264 (even with grain tune) and doesn’t support interlaced so you are forced into the deep rabbit hole of quality deinterlacing

    I will defer to the more experienced then. :)

  • I would likely stick with h.264 as well, but frankly with that much footage, I would first select about 5-10 clips from the whole library that are truly representative of the content, current codec(s) used, and capture device(s) used, and then run a bunch of tests on them with different codec settings, to find the optimal settings.

    Once you've determined the optimal new codec settings, then you can calculate a better idea of the estimated total storage size savings and make more realistic plans than "300TB" or "maybe 200TB"...

    Then it's a matter of deciding if you are going to set up a local or cloud pipeline to batch process all the video.

    This is a big, fun, wonderful family project. Time to bring in some family members to be part of it... lots of family bonding time if you want it!

    Once you're done and have everything properly protected (as per various suggestions above, whatever you decide, my own suggestion is the 3-2-1 backup approach a few posts back), then you will eventually become a legend in your family. 25 years from now they will thank you. 50 years from now they will admire you. 100 years from now your family will think you were a genius.

    Have fun!

  • AthorioAthorio Member
    edited February 2024

    We could offer you 300TB+ of storage, s3, rclone, even a direct blockstorage "disk" should be no problem.

    either 3x replicated, scalable up/down anytime.
    bare metal machine
    or managed by us as "raid" disks

    price depends on the option you choose.

    If youre interested, let us know.

  • AthorioAthorio Member
    edited February 2024

    Oh and we could offer you, (as a service) to review your data once and shrink them by using modern compression, to reduce your data footprint* if you want :)

    Thanked by 1hcea520
  • @Athorio said:
    Oh and we could offer you, (as a service) to review your data once and shrink them by using modern compression, to reduce your data foodprint if you want :)

    "data foodprint"? Sounds delicious

    Thanked by 1Athorio
Sign In or Register to comment.