New on LowEndTalk? Please Register and read our Community Rules.
All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.
All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.
need advice for my streaming server
Hello everyone
i am running a NSFW video site, i host the video content myself, currently i use a 4X10 TB HDD 1Gbps server for the video content, from the server manage panel, i can see i use 200-400Mbps bandwidth, and the disk io (read) is 100-170 MB/s
i am getting a few thousands visitors everyday for a very long time, and someone told me, if i want more visitor, i need upgrade my server, he says my server can not handle more traffic.
i am not tech guy, and i build this site for a hobby, so i don't know how to judge my server has enough resource or not. if anyone has experience on big streaming server, i'll appreciate your advice
Comments
Upgrade to a 10Gbps if you can, these sort of sites eat bandwidth like crazy
It seems like your server is handling daily traffic well, but upgrading your server's bandwidth and storage might be a good idea.
The trick would be to cache the most frequently read content into SSD. Linux has a module for this. And maybe upgrade the port speed to 5 Gbps.
@yoursunny give this man your documentation and all source code under apache license for ndtn protocol. An ultimate sacrifice for adult video empire!
can i ask your software you use to host the files? you transcord them or is raw
thanks for reply, what do you mean upgrade storage? use NVME? that is too expensive, i don't have much revenue, if i use NVME for my 30TB content, it will cost me like $500-700 per month
not raw, all HLS
Use ssd/nvme drive. Or setup hdd cache boost. Which may require 1 ssd/nvme drive for
Can I see your nsfw site.
Thanks, NVME is expensive, i can't afford it
Didn't your read his first post?
Help him, help you.
I heard Someone using cloudflare to host video files freely by saving it as image formats
you use nginx ffmpeg or you use a software to automate all this? i dont want to take your job just asking just dont tell me if you dont want
i use a server to download and encode videos, not all auto, it's half auto, because you need do some manual check for your videos, don't use streaming server to encode video, that cause buffering
Hi,
if pure NVMe is not affordable, then already raising the number of disks will help you ( a lot ).
Instead of 4x 10 TB you could use 8x 6 TB or 12x 4 TB and this way increase your IO capacity.
This configs are available more or less cheap, because this kind of hardware is usually not used anymore. Maybe you just try your luck and open in the request section of this forum a new topic and ask for a hardware config with 8-12x disk.
If you want to know what resources you actually run short of, then simply check via top or atop what your disk, cpu and ram is doing. You will see fastly where an upgrade might be a good idea.
Thank you very much, and Yes, maybe i need upgrade on disk, i did a YABS
`
Block Size 4k (IOPS) 64k (IOPS)
Read 2.49 MB/s (624) 31.34 MB/s (489)
Write 2.51 MB/s (628) 31.73 MB/s (495)
Total 5.01 MB/s (1.2k) 63.08 MB/s (984)
Block Size 512k (IOPS) 1m (IOPS)
------ --- ---- ---- ----
Read 119.54 MB/s (233) 108.19 MB/s (105)
Write 125.89 MB/s (245) 115.40 MB/s (112)
Total 245.43 MB/s (478) 223.60 MB/s (217)
`
all my files are 400-600kb, so with 4 HDD raid0, how much read speed i can expect in real world?
Hi,
its technically impossible that this yabs belongs to a 4 disk raid 0 server, except this server is already tooo much under pressure.
But the most important info is, that you are using super small files and have 30 TB of it.
Anything but SSD / NVMe wont help here.
understand, SSD/NVME is my only option
thank you
Hi,
yes, sorry, sad news. But small files means automatically that you need high IOPS and thats something spinning disks can simply not provide.
Even if you put 10 disks inside, will just help you for a short time...