Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!


Recreating Gatsby.im
New on LowEndTalk? Please Register and read our Community Rules.

All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.

Recreating Gatsby.im

raindog308raindog308 Administrator, Veteran

When I first saw Gatsby (@ElliotJ), I had two impressions:

(1) That's a really nice site design, and
(2) That's a great idea - wish I'd thought of it.

Now that it's gone, last night I was thinking about what it would take to create something similar.

So What Do you Need?

Realistically, you'd need

  • a server
  • DDOS protection - it'd be very easy to have some user's drama result in many gbps you don't want.

Could this be run on a VPS? Maybe. Let's use BuyVM as an example because I'm familiar with them and they provide DDOS protection. Let's say you start with:

  • the largest BuyVM KVM (with DDOS Protection)
  • another large KVM for MySQL

The problem is that you've only got 70GB of disk, which may not be sufficient for many user accounts. There's the storage KVMs, but in my experience they are excellent for backup/storage but are often overtaxed for something like hosting. And they top out at 1GB RAM.

The math is the same for other well-known providers - you could scale by adding more VPSes but I suspect ultimately you'd need to look at a dedicated server. Prior to shutdown, Gatsby ran on a dual quad-core box (according to its status page). I think you'd need RAID-redundant hard drives and maybe a local backup drive as well.

Looking at QuickPacket (just because I'm familiar with them), a dual quad-core 2.5Ghz server, 24GB RAM, with 2x2TB SATA for primary storage + a 2TB backup drive is $115/month. Of course, one could start with something smaller - an Atom!?

And that doesn't include DDOS protection (which ain't cheap) or GRE from BuyVM/whoever.

It's unfortunate all of the major cloud providers (AWS, Azure, etc.) charge per GB of bandwidth, because that make it infeasible.

Business Model?

The vast majority of your clients would want simple free hosting. I don't think Gatsby had any limitations on size but I could be wrong. You'd probably have to put some in - I mean, I have 50GB of pictures on my self-hosted photo-sharing blog - wanna host it for free? :-)

You could charge for premium features, a la wordpress.com, such as custom domain names, CDN, etc. It would not be hard to undersell wordpress.com - the prices they want are outrageous. I think that was Gatsby's long-term plan (via cake.io) though I don't know if that ever got spun up.

But ultimately I think this would be a labor of love. You could offset some of the costs but I'm not sure one should go into it with the idea of making money.

It'd be possible to take donations also.

Heck, considering some of the crap I see on Kickstarter, crowdfunding should be an option, though I think KS is "build something, not fund a business/organization".

WordPress Choices

For wordpress itself, you have to make some decisions:

  • Do you allow people to install any plugin they want?

If no, can you disable that? How do you take requests for new plugins? Do you install every allowed plugin for every user, which could be overwhelming. For example, someone may want Disqus, many people won't care.

If yes, how do you handle bad plugins?

  • How do you handle anti-spam? Akismet for enterprise is waaaaaay too expensive. Prior to shutdown, Gatsby used Cloudflare (not sure exactly that) + reCaptcha + an in-house "obvious comment spam" system.

  • How do you handle wordpress updates? realistically you have auto-update for people otherwise you'll have zombie blogs that compromise your server. You'd need to update plugins, too.

  • Speaking of zombie blogs - probably need to require people login to their admin panel once every X days or their blog gets nuked.

  • And you have to pick out some nice themes, etc. Do you allow people to install any theme they want? What's to stop a user from uploading 2GB of themes, picking one, and letting the rest sit there soaking up disk space?

  • You could potentially reduce your processing by requiring use of SuperCache. But when I played with it several years ago, it was not 100% reliable and I had to periodically manually refresh the cache, etc. Maybe it's better now. But of course you're trading disk space for CPU.

  • Gatsby used Google Authenticator, which was a nice touch.

Other Software

What else do you need software-wise...

  • Probably nginx for better scalability than apache.

  • Presumably php-fpm and some kind of opcode cache (apc, etc.)

  • MySQL or MariaDB or Percona or whatever. Does WP prefer MyISAM or InnoDB?

  • A nameserver for subdomains and perhaps custom domains - maybe NSD would be sufficient.

  • Monitoring

  • Backup - which could potentially be a real pain. You'd need to backup all user's home directories + MySQL on a regular basis. Realistically, for free users, you could only promise perhaps weekly backups and divide them so you're only backing up 1/7 of your customer base on a nightly basis. But that then either goes to another local drive, another server/VPS on the same LAN, or you're burning bandwidth/time to upload somewhere. Daily backups could be a premium feature.

  • also, what about HTTPS? Presumably you'd want HTTPS for logins but HTTPS for everything would be another option. Then again, if they're public blogs, HTTPS is kind of silly since it's all public info.

  • what about private blogs? e.g., not available to the general public, only to invited people? I don't remember if WP supports that or not out of the box. In that case HTTPS is not so silly, though now you have the headache of unwittingly hosting someone's child porn ring.

Custom Software

Now for software, you have to write some signup code, which isn't rocket science. When a new user signs up, you have to:

  • email verify

  • Create a home directory for him/her and untar your standard WP config into it. Note this means that every time WP is updated you have to update your config and test it.

  • Create a subdomain (myblog.example.com) in your NS

  • Update your web server config

  • Put your defaults into the WP config. This could probably be a DB operation or better to do it through WP itself. This is setting SuperCache to true (perhaps), setting the user's signup blog name, turning on the plugins you want, etc. Maybe you have a new blog template DB you put in place.

  • It would be interesting to see to what extent some of the redundant disk files could be replaced with links to a central copy. For example, all the .php that Wordpress uses, all the themes, etc. - rather than create a copy for each user, perhaps you could just create links.

  • and of course once you start to charge (if you do) for premium features, some kind of merchant setup.

You'd also need some custom reports. I think you'd want to have some data to tell you info on typical blog size, how often people typicaly login/access, capacity planning, etc.

Thanked by 1vRozenSch00n
«1

Comments

  • what is gatsby.im?

    Thanked by 1Mark_R
  • Never heard of gatsby.im too.

  • VPNshVPNsh Member, Host Rep

    Recreating it would be pretty cool, and if somebody was willing to step up and take the plunge, I'm fairly confident there would be plenty of support from both providers and individuals in the community - both financially and in terms of resources.

  • raindog308raindog308 Administrator, Veteran

    Gatsby.im was free hosted Wordpress blogs:

    http://lowendtalk.com/discussion/comment/469749

  • raindog308raindog308 Administrator, Veteran

    I PM'd @ElliotJ - if he'd share his code/experiences/advice that would be a big headstart. Haven't heard back yet.

  • VPNshVPNsh Member, Host Rep

    @raindog308 said:
    I PM'd ElliotJ - if he'd share his code/experiences/advice that would be a big headstart. Haven't heard back yet.

    It certainly would.

  • What made it better than wordpress.com?

  • agoldenbergagoldenberg Member, Host Rep

    I would be willing to help code any of the custom stuff needed.

  • I'd be willing to donate a custom VPS to get you started, just pm me :).

  • Aren't the delimiter dedicated servers available in The Netherlands?

  • Gatsby was powered by WordPress multisites, which I've dealt with before.

    I don't know how active the Gatsby service was, I'd personally started to use it, and had referred others to it; but given the financial reasoning, I presume it got well used.

    The way Gatsby worked on the security of plugins/etc front was to (a) Not let users install plugins, and (b) Only supply a list of themes, users can't install their own. As it was running multisite, there was only ever one installation of WP and plugins to patch with updates (assuming he only used one installation).

    If people are looking for an alternative, and anyone is willing to help with supporting it, I'll more than happily put the time in to put an alternative online.

  • tuguhosttuguhost Member
    edited February 2014

    im not sure if a vps is good choice to host many website. i would recommend some cheap dedi like datashack n dacentec have.but if u need a openvz vps for this project i could donate one

    bytheway i just thinking to offering free cpanel hosting but without mail enabled

  • I would like to participate in this. In a few weeks i have semester holidays and a probably a lot of time.

    So if some of you would like to team up on that...
    I am a student with a lot of time to spend (as long as i am not taking finals)

  • I've just got a VPS setup with some domain mapping plugins I just brought, using WP Multisite, all seems to be working. Just waiting for some DNS to update to see if it actually works.

  • It works!!! You can test it by going to http://seeder.pw creating an account then going to tools and domain mapping. All the details are in there.

  • Mark_RMark_R Member
    edited February 2014

    @rmlhhd said:
    It works!!! You can test it by going to http://seeder.pw creating an account then going to tools and domain mapping. All the details are in there.

    offline for me (cannot find server error.)

    what was the purpose of that site?

  • @Mark_R said:

    Just for testing, I did just update DNS. Might be the issue.

  • @Mark_R said:

    Seems to be working for me now, sorry about that. DNS was updating.

  • @rmlhhd said:

    Yes it works now, nice template.

  • @Mark_R said:
    Yes it works now, nice template.

    didnt it was default wordpress template?

  • jarjar Patron Provider, Top Host, Veteran

    Lol

    Person 1:

    "Hey guys I wonder if anyone would like to help me start this project"

    Person 2:

    "Hey guys I just started this new project"

    LET is such a great place for ideas! Just don't share them ;)

  • You've got a login loop on newly created accounts - keeps trying to reauth after entering generated credentials

  • jarjar Patron Provider, Top Host, Veteran

    @prae5 said:
    You've got a login loop on newly created accounts - keeps trying to reauth after entering generated credentials

    Failure is a built in feature of multisite ;)

    Thanked by 1imagine
  • jarland said: Failure is a built in feature of multisite ;)

    +1 - I avoid multisite wherever possible - it causes nothing buy pain in my experience

    Thanked by 1jar
  • @prae5 said:

    Just reset your account. Should have fixed it. If not try a different browser. Also seeder.pw is testing so bugs are very likely.

  • prae5prae5 Member
    edited February 2014

    Still doesn't work completely.

    Chrome lets me in if i keep putting details in, but not always.
    Safari always fails.

  • @prae5 said:
    Still doesn't work - safari and chrome.

    What is happening exactly?

  • What about to stay with @raindog308 topic?

    Thanked by 1jcaleb
Sign In or Register to comment.