Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!


Atom SSD as MySQL Server?
New on LowEndTalk? Please Register and read our Community Rules.

All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.

Atom SSD as MySQL Server?

hi there guys, just got an email from one of the DC's i use about some Atom Servers..
im in the Process of downsizing one of my servers.
what is thoughts of using a Atom server (D2550) with an SSD Drive as a SQL Server.
i would think it would be better as a sql server then an atom server with a normal SATA drive.
but the fact of the matter is, all my server is doing at the moment is just Crawling the web and putting results into SQL.

So was going to get 2 of them, one for web one for sql.
Ideas?..

and before you say it.. that atoms are crap.. i know this, but it's better then paying €120 for a server that is maybe getting used 10% capacity.

Comments

  • Depends on the CPU usage I suppose obviously I/O won't be much of a problem when using SSDs but the CPU can bottle neck that sometimes.

  • How large is your DB? How hard are you hitting it?

    You'll probably be better off with a decently beefy VPS, if you're just crawling and storing and not actually really hitting the DB SSD isn't going to help that much, although it always helps. If you're using the DB often, put it in memory and take IO out of the equation.

    I've got a 128MB RamNode SSD running a very active Observium install, so an Atom + SSD may work fine for you.

  • You can also give a try and see if this works, also you can ask your datacenter for 24-48 hours test and move the application sql to runn on the atom till period of test ends and see if is better to take it or not take it.

  • @nunim - My DB is Currently 42GB (yes it's pretty damn huge) on my current server i have 16 of my crawlers going at any one time.

    and if my maths is correct..
    my current SQL Uptime is: 5 Days 3 Hours, with 10,840,696 queries sent.
    so...
    5*24+3=123 Hours Uptime
    10,840,696/123 = 88135 Queries Per Hour
    88135/60 = 1468.93 Queries Per Second

    if i don't say so that's a lot of queries...

    considering cybermarkt's sql says
    542,467 queries in 7 Days

  • rds100rds100 Member
    edited February 2014

    Make some stats on your current server - see how much CPU it is using and how much IO. You can then decide.

    I mean run top and iostat for some time.

  • Just curious, what are you crawling?

  • @taronyu - try and guess.. and no it's not porn lol

    @rds100 - sure will do that for a while and see what happens :)
    but i know running all 16 crawlers would murder a atom, that's why i would probably only run 8, but i've got plenty of time.. just i like to see my numbers increase lol

  • AutoSnipeAutoSnipe Member
    edited February 2014

    oh god.. (haven't iopinged for a fair while now.. but the results are scary)

    Check it: http://cybermarkt.eu/ioping-nl.txt
    

    Load is fluctuating from 5.20 to 8.00
    Cores are all over the place, 40-80%

  • So what are the specs of your current server?

  • AutoSnipeAutoSnipe Member
    edited February 2014

    E3-1275v2 /32gb / 2x1tb (swraid0) / 100tb @ 1gbit
    i got the feeling the atom will be murdered... unless i run 1-2 crawlers only
    @rds100

  • lol, or i could be an ass like so many others and put it on a Waveride vps :P (or GVH) lol

  • How much of the CPU of this E3-1275v2 is used?

  • image
    ^^^ After Dropping Caches

    image
    ^^ about 10mins after

  • have you tried to optimize your table and query? bad queries really take a big toll in the performance

  • @AutoSnipe said:
    nunim - My DB is Currently 42GB (yes it's pretty damn huge) on my current server i have 16 of my crawlers going at any one time.

    and if my maths is correct..
    my current SQL Uptime is: 5 Days 3 Hours, with 10,840,696 queries sent.
    so...
    5*24+3=123 Hours Uptime
    10,840,696/123 = 88135 Queries Per Hour
    88135/60 = 1468.93 Queries Per Second

    if i don't say so that's a lot of queries...

    considering cybermarkt's sql says
    542,467 queries in 7 Days

    Is it just inserts? I wrote a script to insert 1 million rows into a DB and it took < 1 minute with 512mb RAM on a VPS. about 1 minute 45 with just 128mb RAM and server load hardly went up.

  • @wcypierre - Last time i optimized it was when the mysql server got reset.

    @hostnoob - Inserts (up to about 120 per crawled page), Updates (up to about 20 per crawled page) and 1 sum of the updates
    image

    ^^ After 1.5 months of crawling and including 7 days of downtime of mysql server when i was in hospital

  • how are you inserting it? mind posting a pseudo query?

  • AutoSnipeAutoSnipe Member
    edited February 2014

    @wcypierre well, im self taught.. and i haven't got the hang of anything except php and straight mysql soooo...

    if (isset($upfile["files"]))
         {
                 $size=0;
             foreach ($upfile["files"] as $file)
                     {
                     $filenm = mysql_real_escape_string($file["path"][0]);
                     $filesz =$file["length"];
                     $size+=$file["length"];
                     $filestat = 'multi';
              $query5 = "INSERT INTO `file_db` (id, filename, size, list) VALUES (\"$id\", \"$filenm\", \"$filesz\", \"$filestat\")";
              $success4 = db_query($query5) or die(mysql_error());
             //echo $query4;  ##Debug
    
         }
    

    and db_query function is just

    
        if (!function_exists('db_query')) {
          function db_query($query, $debug=false, $die_on_debug=true, $silent=false) {
        global $DB_DIE_ON_FAIL, $DB_DEBUG;
    
        if ($debug) {
            echo "" . htmlspecialchars($query) . "
    "; if ($die_on_debug) die; } $qid = mysql_query($query); if (! $qid && ! $silent) { if ($DB_DEBUG) { echo "

    Can't execute query

    "; echo "
    " . htmlspecialchars($query) . "
    "; echo "

    MySQL Error: ", mysql_error(); } else { echo "

    Database error encountered

    "; } if ($DB_DIE_ON_FAIL) { echo "

    This script cannot continue, terminating."; die(); } } return $qid; } } }

  • NeoonNeoon Community Contributor, Veteran
    edited February 2014

    Depends on which atom, you can get Intel Atom dedis with 8 Cores or 4 Cores.

  • if you don't mind, please paste it at pastebin and post the link, can't really stand it.

  • I'm afraid this Atom will not cope with your CPU load, even if you improve the IO with a SSD.

  • hmm.. @rds100 ..
    http://www.cpubenchmark.net/cpu.php?cpu=AMD+FX-4100+Quad-Core maybe?
    16gb ram and 2x120gb ssd? might be better? only cost me an extra 10 euro?

    since its just a small project i wanted to stay with low costs :\

  • @AutoSnipe yes, this should work well. Rent it on a monthly basis just in case.

  • Thanks @rds100
    i dare say with the power usage from my server people would think im Mining :P

  • If you were mining it would be 100% on all cores all the time, not like 60% max :)

  • hahah true.. i might be limiting a core off though :P

  • @AutoSnipe said:
    taronyu - try and guess.. and no it's not porn lol

    How should I know? :P

  • If your doing a write only workload and you have no indexes the atom "should" be able to handle the workload. This is assuming the atom Mobo supports sata3. Now depending on the number of indexes you have the atom will chocke on having to move and grow indexes. The same goes for reads but this depends if you have some complex queries. If your reading from index only then it will be fine but you may get overwhelmed by inserting into that index

  • D2550 has no SATA3 support and the cpu/chipset combo is too slow to handle reasonable speeds anyway. Better stick to a cheap haswell (Intel Celeron G1820 for example) along with a cheap mobo (e.g. ASRock H81M-VG4 if 2 ram slots are enough, ASRock B85M Pro4 otherwise) which should offer much more performance for nearly the same bucks.

Sign In or Register to comment.