Webfarms II: Balancing The Load.

Brad Kingsley

Okay, so you understand webfarms now. What's the magic that actually distributes the load, and how does it determine how the distribution is handled?

At ORCS Web we use the Foundry Server Iron products to perform our webfarm load-balancing. If one of them fails, the other instantly takes over (In our testing, it had sub-second fail-over!)

So what is this "Server Iron" thing? In simplest terms, it's a layer 4-7 switch. It has multiple network ports on it and can be used literally like other types of switches. But, it can also load-balancing and traffic distribution. A VIP (virtual IP) can be assigned to the SI (Server Iron) and it then handles all traffic sent to that address/VIP. Further configuration is done to tell the SI what to actually do with the traffic sent to the VIP address.

The traffic that hits the VIP on the Server Iron is of course redistributed to a number of server nodes so the client request can be satisfied - that's the whole point of a webfarm. If one or more server nodes are not responding, the switches are able to detect this and send all new requests to servers that are still online - making the failure of a server node almost transparent to the client.

The traffic can be distributed based on a couple different logic algorithms. The most common are:

* Round Robin: The switches send requests to each server in rotation, regardless of how many connections each server has or how fast it may reply.

* Fastest response: The switches select the server node with the fastest response time and sends new connection requests to that server.

* Least connections: The switches send traffic to whichever server node shows as having the fewest active connections.

* Active-passive: This is called Local/Remote on a Foundry switch, but is still basically active/passive. This allows one or more servers to be designated as "local" which marks them as primary for all traffic. This is combined with another method above to determine what order the "local" server nodes have requests sent to them. If a situation were to arise that all the "local" (active) server nodes were down, then traffic would be sent to the "remote" server nodes. Note that "remote" in this case doesn't really have to mean remote - the "remote" server could be sitting right next to the "local" servers but it is marked as remote in the configuration to let it operate as a hot-standby server. This setting can also be used in a true remote situation where there are servers in a different physical data center - perhaps for extreme disaster recovery situations.

What method is best? It really depends on your application and some other surrounding factors. Each method is good though and would probably satisfy requirements regardless of the configuration. Especially if you are closely monitoring each server node with an external tool (other than directly from the load-balancing switch). So, with the external monitoring you can confirm that all server nodes are operating without error and within reasonable speed thresholds that have been set.

Also, remember that, regardless which traffic algorithm is chosen, if a node goes down, traffic is sent to the other nodes. And when a node comes back online, it can automatically be placed back into the webfarm and start getting client requests again.

Clustered hosting does require some consideration of how state is managed within applications, which will be covered in a future article.

Happy hosting!

~Brad

Brad Kingsley is President and Founder of ORCS Web, Inc. - a company that provides managed hosting services for clients who develop and deploy their applications on Microsoft Windows platforms.

Brad Kingsley is President and Founder of ORCS Web, Inc. - a company that provides managed hosting services for clients who develop and deploy their applications on Microsoft Windows platforms.

Browse Hosting Plans

Home Private/Dedicated Co-Located Shared/Virtual Unix/Linux Windows Budget (<$10) Free Search Articles Contact Privacy Policy Add to Favorites

Did You Know?

Are You a Hosting Hostage? © 2004, John Calder http://www.TheEzine.net In recent years, the hosting business has become extremely competitive. Not so long ago, the monthly price for an average hosting account for one domain was in the $35 and up range, at a minimum. Now, you can get a hosting account where you can host unlimited domains (up to the disk space and network usage limits of your account), for $25 and under. To try to win more customers in this crowded field, most hosting companies offer bundles of features, included at no extra charge in your hosting plan. On the surface, all of those features look great, and they are. From single autoresponders to shopping carts, from private name servers to the amazing Fantastico package that lets you install any of numerous software packages, like blogs, content management systems, forums, help desks, and so on, with near one-click ease. But there's a hidden, more self-serving reason the hosting companies offer this convenience to their customers. They hope you'll become dependent enough on the software features they offer that it will discourage you from changing hosting companies. Their service may suffer at some point, perhaps due to sale of the company, support staff cutbacks, problems within their network, and a variety of other reasons. You may want to change hosting companies for good reason. But if you've set up your entire site using the software your hosting company offers, you won't necessarily be able to take those software packages with you. You can probably find another hosting company that offers the same software, but you'll still have to transfer all of your databases and configuration settings yourself. More...