Run multiple R scripts in parallel using foreach and controlling number of cores

Question

I have five R scripts in a folder, and I would like to run all these R scripts in parallel, controlling the number of cores available.

What do you suggest to do? I tried to use "foreach" package in this way but it didn't work.

files<-list.files(pattern=".R")

foreach(x=files) %dopar% {
        source(x)
      }

Varun Rajan · Accepted Answer · 2017-04-21 16:53:54Z

1

Did you register a parallel backend? If it is a single system then use doParallel package to register the backend first. Try this;

cl = makeCluster(detectCores() - 1)
registerDoParallel(cl)

files<-list.files(pattern=".R")

foreach (i in 1:length(files), .export = c("files")) %dopar%
 {
 source(files[i])
 }

stopCluster(cl)

answered Apr 21, 2017 at 16:53

Varun Rajan

2762 silver badges11 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Varun Rajan Over a year ago

What was the error or issue? you Had installed doparallel package right?

Collectives™ on Stack Overflow

Run multiple R scripts in parallel using foreach and controlling number of cores

1 Answer 1

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related