Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!


Hosting downloads for an open-source project
New on LowEndTalk? Please Register and read our Community Rules.

All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.

Hosting downloads for an open-source project

I'm the maintainer of a moderately popular open-source project which was hosted on gna! (free/libre software hosting), which will be shutting down soon. It has around 500k requests and 200k downloads (~2.7TiB) per month -- it gets used a lot in CI testing, so lots of HTTP 304 requests. The project is multi-platform and has versions going back 6-7 years, which unfortunately are still in use. As I see it, I have a few options:

  1. use a shared hosting plan with unlimited bandwidth (no server management)
  2. use a VPS with sufficient/unlimited bandwidth (have to manage VPS)
  3. use VPS and front it with CDN (have to manage VPS and CDN)
  4. look at other free software hosting sites

I don't really think (4) would work out, as I moved off SourceForge to gna! a few years ago (GitHub releases don't provide stats, and BitBucket implements rate-limiting for downloads). I don't think (1) would be fair to the host, so mostly I'm left with (2) and (3).

I tried to implement (2) with a cheap OpenVZ VPS (I know, my mistake) but not sure if I got compromised or the service had issues; now currently running on a $2.5 Vultr instance. So if I do go down this route I'd like to go KVM with a stable provider who has no issues with the bandwidth usage. OTOH I'm inclined to go with (3) but don't know if I'll get the CDN for free (although some do claim free for open-source, yet to get response). Also, how much bandwidth is it to likely to use from the upstream VPS?

Do you have any feedback if I'm doing the right thing, or is there another option I should be looking at?

Thanks.

«1

Comments

  • how much space do you need?

    can you send me the direct link to your open-source project

    Thanked by 1Falzo
  • joepie91joepie91 Member, Patron Provider

    Perhaps Afterburst would be an option? My experience with their network (and their services in general) is extremely good, even if they're not the cheapest provider around.

    They used to have some 'soft limits' on their "unmetered bandwidth" offering, but those seem to have gone away now. If you want to be absolutely sure, it's probably best to contact their support.

    Thanked by 1jackb
  • Hello,

    Do you have any idea on your projected bandwidth usage? 1,2,3 TB? Saying "Unlimited" does not really help.

  • @dedicados said:
    how much space do you need?

    It's wkhtmltopdf and it currently requires 2.5GiB of disk space ... so 5 GiB at the maximum considering new releases.

    @DigitalFyre said:
    Do you have any idea on your projected bandwidth usage? 1,2,3 TB? Saying "Unlimited" does not really help.

    Probably got lost in the wall of text, but I mentioned it there ... around 500k requests and 200k downloads (~2.7TiB) per month. See the stats per month at gna!, this month is lower due to the partial switchover. Plus it's growing, so would assume upto 4-5 TiB for the next year to be on the safer side.

  • jhjh Member
    edited March 2017

    I regularly use wkhtmltopdf. I would be happy to provide the server and maintenance in exchange for a link on your website. PM me if you're interested.

    Thanked by 3ashkulz WSS klikli
  • Thanks, but I don't mind paying for the server. No offense meant, but priorities do change and I'd prefer to not depend on someone who's not a regular contributor to the project.

  • stefemanstefeman Member
    edited March 2017

    I think Scaleway baremetal servers from online.net would be the best choice for this.

    They come with rather good hardware and unmetered traffic with guaranteed 200Mbps at all times.

    Cheapest plan is 2,99€/m and many members here use it.

    https://www.scaleway.com/

    https://www.scaleway.com/pricing/

    https://www.scaleway.com/features/network/

    Personally I like their Server/Network statistics and API myself.

    Or technically any reputable provider with unmetered traffic.. But it's pretty hard to beat the french giants in price/features/performance ratio lol.

    Thanked by 2WSS ashkulz
  • Get vps from scaleway. The CPU is the weak point, but if you used for static file and download only that more than enough to handle your download.

    Btw try asking linode or digitalocean for sponsoring server, I know they offer some opensource project server for free ex gitlab, gitea

    Thanked by 1ashkulz
  • vpsGODvpsGOD Member, Host Rep

    You can have a stable service on Vultr as my point

    Use multiple mirrors for your project download (you can get some sponsors here in LET also)

    Thanks for your contribution for the Opensource community

  • WSSWSS Member

    I still have a 2TB plan from CDN.net that has not been claimed by any OS project it has been offered to. You're welcome to it if you want it.

    Thanked by 1ashkulz
  • We can support your project with our cPanel powered SSD web hosting packages. All of our packages come with guaranteed resources (RAM, CPU, HDD, etc.) and our larger packages come with plenty of resources to handle 500K requests & ~3TB of bandwidth usage a month.

    You wouldn't need to worry about managing the server/vps, all you would need to do is upload your site & software.

    Ping me if you are interested.

    Thanked by 1ashkulz
  • FranciscoFrancisco Top Host, Host Rep, Veteran

    How much storage do you need?

    Short and skinny is get a slice ;) https://buyvm.net/kvm-dedicated-server-slices

    Fair share 1Gbit unmetered.

    Francisco

  • ashkulzashkulz Member
    edited March 2017

    @stefeman said:
    I think Scaleway baremetal servers from online.net would be the best choice for this. They come with rather good hardware and unmetered traffic with guaranteed 200Mbps at all times. Cheapest plan is 2,99€/m and many members here use it.

    @sibaper said:
    Get vps from scaleway. The CPU is the weak point, but if you used for static file and download only that more than enough to handle your download.

    Do you mean the Scaleway C1? Considering that the most-downloaded files would get cached in 2G RAM, the NBD storage and slow cores don't matter so much. Not sure whether the ARM cores will be able to handle the HTTPS load, if not I'll consider a VPS (both Scaleway or cheapest BuyVM slice have unlimited bandwidth and have similar cost, OVH VPS seems to have mixed reviews here).

    @vpsGOD said:
    You can have a stable service on Vultr as my point. Use multiple mirrors for your project download (you can get some sponsors here in LET also)

    Vultr would run out of bandwidth in just a week (500GB for the $2.5 plan). I'd prefer not to manage multiple servers, either have a single VPS or a CDN in front of VPS.

    @WSS said:
    I still have a 2TB plan from CDN.net that has not been claimed by any OS project it has been offered to. You're welcome to it if you want it.

    That's why I pinged you last week, but you said the second had already been given. 2 TB won't be enough and I don't want to stitch together a solution (also, sometimes the fates really go against a person ... look at me mouthing off, and now I have to search for hosting...).

    @Francisco said:
    How much storage do you need? Short and skinny is get a slice ;) https://buyvm.net/kvm-dedicated-server-slices Fair share 1Gbit unmetered.

    I know. You posted while I was typing the message :-)

  • WSSWSS Member

    @advarisk said:

    @WSS said:
    I still have a 2TB plan from CDN.net that has not been claimed by any OS project it has been offered to. You're welcome to it if you want it.

    That's why I pinged you last week, but you said the second had already been given. 2 TB won't be enough and I don't want to stitch together a solution.

    It had tentatively been taken, but there have been no followups since that time despite gentle prodding. Good luck with your search!

    Thanked by 1ashkulz
  • @WSS said:
    It had tentatively been taken, but there have been no followups since that time despite gentle prodding. Good luck with your search!

    Thanks! I'll probably go with the C1 to start with, as I only care about the bandwidth ... a low-end dedi means I wouldn't be the noisy neighbor ruining things for others :-)

  • WSSWSS Member

    @Falzo has some pretty awesome prices on NetCup too, if you haven't checked them recently.

  • Try 1fichier unlimited file hosting + 100GB/mo CDN. It is a file hosting site and although it is used frequently for warez their servers are very fast and stable + they are in buisiness since 2009. You also get to upload files via FTP or pw protect them.

    Check the download speeds: https://1fichier.com/network.html

    Works quite nice for me so far :)

  • @advarisk said:

    @WSS said:
    It had tentatively been taken, but there have been no followups since that time despite gentle prodding. Good luck with your search!

    Thanks! I'll probably go with the C1 to start with, as I only care about the bandwidth ... a low-end dedi means I wouldn't be the noisy neighbor ruining things for others :-)

    Would go with the cheapest vps one if i were you. Dont worry about noisy neighbours, you have like 1 core to yourself. With the arm dedi you're basically trying to hack some hardware encryption stuff on top of it from what i recall in order to get any decent https performance.

    That, or a slice. Wouldn't bother with ovh, as those are limited to 100mbit. Scaleway (vps line) can burst to 2.5gbit, and @Francisco's offer can do 1gbit burst.

    Thanked by 1ashkulz
  • FalzoFalzo Member

    @WSS said:
    @Falzo has some pretty awesome prices on NetCup too, if you haven't checked them recently.

    agreed ;-)

    but netcups smaller vserver range is limited to 100 mbit... while that of course should be enough for the mentioned bandwidth I do think a slice of @francisco can't be the wrong choice here either ^^

  • @teamacc said:
    Would go with the cheapest vps one if i were you. Dont worry about noisy neighbours, you have like 1 core to yourself. With the arm dedi you're basically trying to hack some hardware encryption stuff on top of it from what i recall in order to get any decent https performance.

    Do you have any links to that (https performance on ARM)? I'm already setting it up right now.

    That, or a slice. Wouldn't bother with ovh, as those are limited to 100mbit. Scaleway (vps line) can burst to 2.5gbit, and @Francisco's offer can do 1gbit burst.

    They only claim 200Mbps, google says that the SoC network card supports 2.5Gbps.

  • @advarisk said:

    @teamacc said:
    Would go with the cheapest vps one if i were you. Dont worry about noisy neighbours, you have like 1 core to yourself. With the arm dedi you're basically trying to hack some hardware encryption stuff on top of it from what i recall in order to get any decent https performance.

    Do you have any links to that (https performance on ARM)? I'm already setting it up right now.

    That, or a slice. Wouldn't bother with ovh, as those are limited to 100mbit. Scaleway (vps line) can burst to 2.5gbit, and @Francisco's offer can do 1gbit burst.

    They only claim 200Mbps, google says that the SoC network card supports 2.5Gbps.

    They have 200mbit guaranteed bandwidth, so your monthly average needs to stay below that. It's pretty speedy though, back when I was still using them I was able to burst pretty high.

    Would advise against arm though, but if you're really interested in it, this seems to be the thread: https://www.lowendtalk.com/discussion/39257/enable-hardware-crypto-acceleration-on-your-via-nano-dedi

  • teamacc said:

    Would advise against arm though, but if you're really interested in it, this seems to be the thread: https://www.lowendtalk.com/discussion/39257/enable-hardware-crypto-acceleration-on-your-via-nano-dedi

    That is for the VIA Nano, a x86 processor?

  • @jgillich said:

    teamacc said:

    Would advise against arm though, but if you're really interested in it, this seems to be the thread: https://www.lowendtalk.com/discussion/39257/enable-hardware-crypto-acceleration-on-your-via-nano-dedi

    That is for the VIA Nano, a x86 processor?

    Damn you memory.

  • WSSWSS Member

    @teamacc said:

    @jgillich said:

    teamacc said:

    Would advise against arm though, but if you're really interested in it, this seems to be the thread: https://www.lowendtalk.com/discussion/39257/enable-hardware-crypto-acceleration-on-your-via-nano-dedi

    That is for the VIA Nano, a x86 processor?

    Damn you memory.

    Memory? You didn't even nail the right platform.

  • @WSS said:

    @teamacc said:

    @jgillich said:

    teamacc said:

    Would advise against arm though, but if you're really interested in it, this seems to be the thread: https://www.lowendtalk.com/discussion/39257/enable-hardware-crypto-acceleration-on-your-via-nano-dedi

    That is for the VIA Nano, a x86 processor?

    Damn you memory.

    Memory? You didn't even nail the right platform.

    Just blaming my own brain by saying that, nothing to do with the "hardware memory" stuff.

  • WSSWSS Member

    @teamacc said:

    @WSS said:

    @teamacc said:

    @jgillich said:

    teamacc said:

    Would advise against arm though, but if you're really interested in it, this seems to be the thread: https://www.lowendtalk.com/discussion/39257/enable-hardware-crypto-acceleration-on-your-via-nano-dedi

    That is for the VIA Nano, a x86 processor?

    Damn you memory.

    Memory? You didn't even nail the right platform.

    Just blaming my own brain by saying that, nothing to do with the "hardware memory" stuff.

    You sure about that? :D

  • @teamacc said:
    They have 200mbit guaranteed bandwidth, so your monthly average needs to stay below that. It's pretty speedy though, back when I was still using them I was able to burst pretty high.

    Would advise against arm though, but if you're really interested in it, this seems to be the thread: https://www.lowendtalk.com/discussion/39257/enable-hardware-crypto-acceleration-on-your-via-nano-dedi

    Well, I started with an C1, speed was good but CPU load seemed high so migrated to a VPS and now download speed seems slow (was getting 1MB/sec on dedi vs 300KB/sec on VPS from India).

  • teamaccteamacc Member
    edited March 2017

    @advarisk said:

    @teamacc said:
    They have 200mbit guaranteed bandwidth, so your monthly average needs to stay below that. It's pretty speedy though, back when I was still using them I was able to burst pretty high.

    Would advise against arm though, but if you're really interested in it, this seems to be the thread: https://www.lowendtalk.com/discussion/39257/enable-hardware-crypto-acceleration-on-your-via-nano-dedi

    Well, I started with an C1, speed was good but CPU load seemed high so migrated to a VPS and now download speed seems slow (was getting 1MB/sec on dedi vs 300KB/sec on VPS from India).

    Ye, online.net's international network can be summarized as "quite shit". Try a slice @Francisco.

    Thanked by 2Francisco ashkulz
  • Why don't you use github? They provide free file hosting for everything that is open source

Sign In or Register to comment.