NEWS

Master your own destiny! Command a nation!

How we manage more and more servers

Today I will tell you a bit about the system we use to manage the server setup for Heroes & Generals.

servergraph A sample graph of the CPU load of one of the servers. You can see that the server load is higher from noon till midnight, but there is still load other hours as well as players from all over the world are playing H&G 24/7.

We use an open source tool called Nagios to monitor the game servers. It’s widely used by server managers all over the world and is free and can do a whole lot of things that are very useful when running a bunch of servers like we do. It can send warnings and text messages to administrators, show service load, system IO, network info and other stuff… even monitor the water temperature in some of the fisk tanks (aquarium) we have at the office. :o)

I love tools that is works like that. It gives me the freedom to choose freely what kind of services we will monitor; hardware and/or services like web-services, memory load on a box, the server temperature in a rack in US, etc.

In this setup it is possible to control how important a server is to monitor and give the alarms as needed. Do I need to fix problems right now in the day or night time, or can it wait to the next day. For instance low disk space might not be an urgent problem on some of the servers, so that might not be prioritized as high as a total crash of another server and so on.

We create graphs that shows the history of servers and services. By looking at these graphs, I can change the setup to handle more game-sessions per server over time. Or if some of the servers are having problems with handling certain requests, then we are ready to take action right away, before it is a problem to you.

At least this is our goal – while we’re in closed beta, occasional bugs also sneak into the setup of the Nagios system, but we’re getting better and better at handling it. :)

/Reto.hansg

  1. avatarTheMatrix09-06-2012

    And let me guess. one of the reasons you do love nagios is because its free ;-) (i love free tools my self)
    // Matrix

  2. avataruserssuck09-06-2012

    icinga is the better nagios….specialy for large scale operations…..just saying…..oh and yes graphviz still works.

  3. avatarreto.hansg09-06-2012

    Nagios can scale big time. You can create slave server in the datacenters and report back to master. Works great.

    /hansg

  4. avataruserssuck09-06-2012

    of course it can, just take a look a icinga….it can everything nagios does (because its based on nagios, you can still use nconf and your existing nagios config) it just has the little edge, specialy regarding collector and monitor servers because the databases and webmgmt are also completely independend and scalable.

    and yes the webmanagemnt is a whole lot better…..but nobody cares cause thats basicly useless eyecandy…..unless you want to make it pblic and give us a look too whats oging on at the time :P

  5. avatarLokkoPAKO09-06-2012

    my name is LokkoPAKO e have the key but i try to do the confirmation and the is : evilsamur (plx help me)

  6. avatarBizti15109-06-2012

    im Bizti151 and want my beta key to play

    email :lvlagic@live.com

  7. avatarGaurav25109-07-2012

    if you want to discuss keys go to the forums, this is just the news board.

  8. avatarbill w09-08-2012

    by the way what has happend to war 67 cause it keeps on saying the servers down ever since it said servers off for matinence on wednesday

  9. avatarkralj200009-08-2012

    send beta keys kralj2000

What are you waiting for soldier? We need heroes on the battlefield and generals to lead them!