Load balancing with node.js using http-proxy

Question

I'm trying to code a load balancing with node.js and http-proxy. I want a loadBalancer that shares incoming request treatment between 2 servers.

var http = require('http'),
httpProxy = require('http-proxy');

var servers =  [{host :'127.0.0.1', port :3000}, {host : 'remote_adr',port :3000}];

httpProxy.createServer(function (req, res, proxy) {
    var target = servers.shift();
    proxy.proxyRequest(req, res, target);
    servers.push(target);
}).listen(8000);

I thought that doing this would have made a loadBalancer which sends requests alternately to serv1 and to serv2.

However, when I try it out, it seems to request the 2 servers in no particular order. In addition, most of the requests are sent to my localhost node server ( 127.0.0.1:3000 )

Is somebody able to explain that behavior?

Timothy Strimple · Accepted Answer · 2012-11-29 00:05:36Z

7

That should be doing a round robin as you requested, however it's a very naive round robin. What you may be seeing is that your favicon.ico requests are putting a higher than normal share of requests on a single server. For instance.

Server 1: Actual Requests
Server 2: favicon.ico
Server 1: Another Request
Server 2: favicon.ico
Server 1: Final Request
Server 2: favicon.ico

So depending on how you're logging, it will appear that server 1 is getting all of the requests, when technically each server is getting the same number of requests. Also keep in mind that your assets will be included in the round robin as well if you're serving them from node. So each image or file request will also be handed off to a different node instance.

edited Nov 29, 2012 at 0:05

answered Nov 29, 2012 at 0:00

Timothy Strimple

23.1k6 gold badges73 silver badges76 bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

Amareswar Over a year ago

awesome explanation. favicon.ico is not hit be node.js? if yes, how come the request handled is not shown?

Timothy Strimple Over a year ago

@Amareswar Not sure what you mean by 'favicon.ico is not hit by node.js'. Node.js can certainly handle favicon requests, but if you're just logging explicit routes in express for instance, you may not see a favicon.ico request show up in your logs.

Amareswar Over a year ago

got it. That was my doubt.

Collectives™ on Stack Overflow

Load balancing with node.js using http-proxy

1 Answer 1

3 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

3 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related