Which is good for file storage?

alfirous

Check Storj, I think it's the cheapest S3 compatible. But I don't know how the performance for offloading image and video.

vitobotta

@KeqingWangy said:
Hello...
I have a website and application that displays images and videos. I am quite in a dilemma to choose a cheap data storage server with good performance. I am currently using Bunny Storage SSD, but I might want to switch as it is quite expensive, 1TB costs $20 per month for SSD and $10 per month for HDD. But they have free API calls and free bandwidth (But it's paid if use CDN).

Wasabi and IDrive have cheap prices, but the bandwidth offered in my opinion is quite small, which is according to the total size of the files stored. Backblaze has quite a lot of bandwidth, which is 3x the size of the files stored, but unfortunately they charge for the API. Cloudflare? The price is quite expensive and charges for the API.

I have thought about taking an offer like Storage VPS, but honestly I don't know how the VPS will perform. Especially since image and video files will be accessed continuously by users, so I'm worried that the upload speed offered by the server is not fast enough.

If you have any suggestions, which one do you think I should take?

Have you thought about using Storj? It's cheap for storage, but you do pay for egress, which means you don't have any limits. You could also use Cloudflare to cut down on bandwidth costs.

COLBYLICIOUS

@vitobotta said:

@KeqingWangy said:
Hello...
I have a website and application that displays images and videos. I am quite in a dilemma to choose a cheap data storage server with good performance. I am currently using Bunny Storage SSD, but I might want to switch as it is quite expensive, 1TB costs $20 per month for SSD and $10 per month for HDD. But they have free API calls and free bandwidth (But it's paid if use CDN).

Wasabi and IDrive have cheap prices, but the bandwidth offered in my opinion is quite small, which is according to the total size of the files stored. Backblaze has quite a lot of bandwidth, which is 3x the size of the files stored, but unfortunately they charge for the API. Cloudflare? The price is quite expensive and charges for the API.

I have thought about taking an offer like Storage VPS, but honestly I don't know how the VPS will perform. Especially since image and video files will be accessed continuously by users, so I'm worried that the upload speed offered by the server is not fast enough.

If you have any suggestions, which one do you think I should take?

Have you thought about using Storj? It's cheap for storage, but you do pay for egress, which means you don't have any limits. You could also use Cloudflare to cut down on bandwidth costs.

Is there anything else cheaper than Storj? I got an Unraid server at home and I want to backup things outside my house.

CharityHost_org

@KeqingWangy said: I am currently using Bunny Storage SSD, but I might want to switch as it is quite expensive,

What do you consider good performance, for what price and what amount of storage? @oplink has great VPS btw If you need IO speed.

Otherwise look at offers VPS HDD Storage or VPS NVMe with attached HDD Storage which should be plenty of IO in my opinion if you are not disk IO bound for processing other than serving files:

https://lowendtalk.com/discussion/200838/75-discount-new-year-sale-1-mo-or-11-yr-vps-nvme-gold-or-ssd-2-core-1-2-gb-ram-50-gb-ssd/p1

Getting some yabs as an example.

CharityHost_org

Example here:

$4 with current Promotion in the link shared above:

VPS HDD 2TB in HW RAID 5.

4x Intel Xeon E5-2690 v3
4 GB DDR4 memory
2000 GB HDD
1 GbE Public
10 GbE Private
7.5 TB Bandwidth
IPv4 and IPv6

VPS HDD 2000 yabs.sh:

root@testio:~# free -m
               total        used        free      shared  buff/cache   available
Mem:            3915         316        2671           1        1154        3598
Swap:           1023           0        1023
root@testio:~# curl -sL https://yabs.sh | bash -s -- -r
# ## ## ## ## ## ## ## ## ## ## ## ## ## ## ## ## ## #
#              Yet-Another-Bench-Script              #
#                     v2024-06-09                    #
# https://github.com/masonr/yet-another-bench-script #
# ## ## ## ## ## ## ## ## ## ## ## ## ## ## ## ## ## #

Sat Dec 14 06:39:45 PM EST 2024

Basic System Information:
---------------------------------
Uptime     : 0 days, 0 hours, 2 minutes
Processor  : Intel(R) Xeon(R) CPU E5-2690 v3 @ 2.60GHz
CPU cores  : 4 @ 2599.982 MHz
AES-NI     : ✔ Enabled
VM-x/AMD-V : ✔ Enabled
RAM        : 3.8 GiB
Swap       : 1024.0 MiB
Disk       : 1.9 TiB
Distro     : Debian GNU/Linux 12 (bookworm)
Kernel     : 6.1.0-9-amd64
VM Type    : KVM
IPv4/IPv6  : ✔ Online / ✔ Online

IPv6 Network Information:
---------------------------------
ISP        : The Optimal Link Corp / Oplink.net
ASN        : AS40156 The Optimal Link Corporation
Host       : NeoTechAdmin LLC
Location   : Spring, Texas (TX)
Country    : United States

fio Disk Speed Tests (Mixed R/W 50/50) (Partition /dev/vda1):
---------------------------------
Block Size | 4k            (IOPS) | 64k           (IOPS)
  ------   | ---            ----  | ----           ----
Read       | 7.87 MB/s     (1.9k) | 83.69 MB/s    (1.3k)
Write      | 7.91 MB/s     (1.9k) | 84.13 MB/s    (1.3k)
Total      | 15.78 MB/s    (3.9k) | 167.83 MB/s   (2.6k)
           |                      |
Block Size | 512k          (IOPS) | 1m            (IOPS)
  ------   | ---            ----  | ----           ----
Read       | 377.61 MB/s    (737) | 532.69 MB/s    (520)
Write      | 397.67 MB/s    (776) | 568.17 MB/s    (554)
Total      | 775.28 MB/s   (1.5k) | 1.10 GB/s     (1.0k)

iperf3 Network Speed Tests (IPv4):
---------------------------------
Provider        | Location (Link)           | Send Speed      | Recv Speed      | Ping
-----           | -----                     | ----            | ----            | ----
Clouvider       | London, UK (10G)          | busy            | busy            | 101 ms
Leaseweb        | Singapore, SG (10G)       | 276 Mbits/sec   | 585 Mbits/sec   | 215 ms
Leaseweb        | NYC, NY, US (10G)         | 840 Mbits/sec   | 846 Mbits/sec   | 35.6 ms

iperf3 Network Speed Tests (IPv6):
---------------------------------
Provider        | Location (Link)           | Send Speed      | Recv Speed      | Ping
-----           | -----                     | ----            | ----            | ----
Clouvider       | London, UK (10G)          | 496 Mbits/sec   | 382 Mbits/sec   | 103 ms
Leaseweb        | Singapore, SG (10G)       | 300 Mbits/sec   | 509 Mbits/sec   | 213 ms
Leaseweb        | NYC, NY, US (10G)         | 841 Mbits/sec   | 837 Mbits/sec   | 35.8 ms

Geekbench 6 Benchmark Test:
---------------------------------
Test            | Value
                |
Single Core     | 874
Multi Core      | 2800
Full Test       | https://browser.geekbench.com/v6/cpu/9430317

vitobotta

@COLBYLICIOUS said:

@vitobotta said:

@KeqingWangy said:
Hello...
I have a website and application that displays images and videos. I am quite in a dilemma to choose a cheap data storage server with good performance. I am currently using Bunny Storage SSD, but I might want to switch as it is quite expensive, 1TB costs $20 per month for SSD and $10 per month for HDD. But they have free API calls and free bandwidth (But it's paid if use CDN).

Wasabi and IDrive have cheap prices, but the bandwidth offered in my opinion is quite small, which is according to the total size of the files stored. Backblaze has quite a lot of bandwidth, which is 3x the size of the files stored, but unfortunately they charge for the API. Cloudflare? The price is quite expensive and charges for the API.

I have thought about taking an offer like Storage VPS, but honestly I don't know how the VPS will perform. Especially since image and video files will be accessed continuously by users, so I'm worried that the upload speed offered by the server is not fast enough.

If you have any suggestions, which one do you think I should take?

Have you thought about using Storj? It's cheap for storage, but you do pay for egress, which means you don't have any limits. You could also use Cloudflare to cut down on bandwidth costs.

Is there anything else cheaper than Storj? I got an Unraid server at home and I want to backup things outside my house.

iDrive with the discounted offers is cheaper.

COLBYLICIOUS

@vitobotta said:

@COLBYLICIOUS said:

@vitobotta said:

@KeqingWangy said:
Hello...
I have a website and application that displays images and videos. I am quite in a dilemma to choose a cheap data storage server with good performance. I am currently using Bunny Storage SSD, but I might want to switch as it is quite expensive, 1TB costs $20 per month for SSD and $10 per month for HDD. But they have free API calls and free bandwidth (But it's paid if use CDN).

Wasabi and IDrive have cheap prices, but the bandwidth offered in my opinion is quite small, which is according to the total size of the files stored. Backblaze has quite a lot of bandwidth, which is 3x the size of the files stored, but unfortunately they charge for the API. Cloudflare? The price is quite expensive and charges for the API.

I have thought about taking an offer like Storage VPS, but honestly I don't know how the VPS will perform. Especially since image and video files will be accessed continuously by users, so I'm worried that the upload speed offered by the server is not fast enough.

If you have any suggestions, which one do you think I should take?

Have you thought about using Storj? It's cheap for storage, but you do pay for egress, which means you don't have any limits. You could also use Cloudflare to cut down on bandwidth costs.

Is there anything else cheaper than Storj? I got an Unraid server at home and I want to backup things outside my house.

iDrive with the discounted offers is cheaper.

Is there any offer ongoing?

KeqingWangy

@alfirous @vitobotta @COLBYLICIOUS
For backups, it may be okay to use Storj, but if the files are accessed continuously by users, the egress costs will increase.

KeqingWangy

@CharityHost_org said:
What do you consider good performance, for what price and what amount of storage? @oplink has great VPS btw If you need IO speed.

Otherwise look at offers VPS HDD Storage or VPS NVMe with attached HDD Storage which should be plenty of IO in my opinion if you are not disk IO bound for processing other than serving files:

https://lowendtalk.com/discussion/200838/75-discount-new-year-sale-1-mo-or-11-yr-vps-nvme-gold-or-ssd-2-core-1-2-gb-ram-50-gb-ssd/p1

Getting some yabs as an example.

I'll take note first. I think the performance is good enough.

tommmy

@KeqingWangy said:

@tommmy said:
what about hetzner object storage?

https://www.hetzner.com/storage/object-storage/

Hetzner only provides 1TB of bandwidth

I thought you said you only want 340-470GB?
Also 1TB is what included. You can use more with the cost of €1/TB.

Anyway I am using Cloudflare R2. It is quite cheap in my opinion.
These are given for free:
Class A Operations 1 million requests / month (then $4.50 / million requests)
Class B Operations 10 million requests / month (then $0.36 / million requests)

I had >100GiB in my bucket for a few months because I was too lazy to delete and they charged me like $0.50 each month. The storage is really cheap ($0.015 / GB-month).

You can use their calculator.

KeqingWangy

@tommmy said:

@KeqingWangy said:

@tommmy said:
what about hetzner object storage?

https://www.hetzner.com/storage/object-storage/

Hetzner only provides 1TB of bandwidth

I thought you said you only want 340-470GB?
Also 1TB is what included. You can use more with the cost of €1/TB.

Anyway I am using Cloudflare R2. It is quite cheap in my opinion.
These are given for free:
Class A Operations 1 million requests / month (then $4.50 / million requests)
Class B Operations 10 million requests / month (then $0.36 / million requests)

I had >100GiB in my bucket for a few months because I was too lazy to delete and they charged me like $0.50 each month. The storage is really cheap ($0.015 / GB-month).

You can use their calculator.

For now, yes. For the future I need more than that. Because there are more than 100k images and videos that I haven't uploaded because if I upload them now the cost I pay will increase.

EthanZou

@KeqingWangy said: idrive only provides bandwidth equivalent to the total files stored.

Not 3x anymore?
It's time to stay away from iDrive e2.

KeqingWangy

@EthanZou said:
Not 3x anymore?
It's time to stay away from iDrive e2.

Rizkyaa

@KeqingWangy said:

@EthanZou said:
Not 3x anymore?
It's time to stay away from iDrive e2.

Look at this VPS offer, you don't need to worry about storage and bandwidth

https://lowendtalk.com/discussion/200169/tnahosting-black-friday-deals-ovz-kvm-da-from-4-yr/p1

webontop

@KeqingWangy said:

@webontop said:
you should search more!

Give me 1TB for free!

@tommmy said:
what about hetzner object storage?

https://www.hetzner.com/storage/object-storage/

Hetzner only provides 1TB of bandwidth

@sreekanth850 said:
Did you thought about image optimizing and video transcoding? You can definitely use object storage, but bunny and other similar tool exist for a reason. Whe you stream with bunny they transcode it for different resolution and deliver based on bandwidth and device type. Same for image.

I'm just looking for file storage, because my image and video files are already compressed, so I don't need it.

Inbox me

niranjan

https://r2-calculator.cloudflare.com/