NodeJS batching async.parallel

Question

I have

async.parallel(tasksGetContentFromGitHub, function(err, res) {
    // all request over, do something
}

the problem is that I might have a large number of tasks, and each of them is sending a request to GitHub.

Since I am a nice citizen, I don't want to send 1000+ queries at once at GitHub, therefore I would like to batch those requests 10 at the time, and then execute my inner code.

Is there an easy way to do that?

see parallelLimit: github.com/caolan/async/blob/master/lib/parallelLimit.js#L5 — rjz
– rjz, Commented Aug 22, 2016 at 4:07

haotang · Accepted Answer · 2016-08-22 04:09:47Z

1

You can try async.parallelLimit:

async.parallelLimit(tasksGetContentFromGitHub, 10, function(err, res) {
    // all request over, do something
}

Hope that it can help!

answered Aug 22, 2016 at 4:09

haotang

5,73637 silver badges50 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

HLP Over a year ago

I went through the doc, but it seems like I had miss that one. Works like a charm. Thanks a lot guys!

haotang Over a year ago

Nice. It's great to know that! :D

Collectives™ on Stack Overflow

NodeJS batching async.parallel

1 Answer 1

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related