Java out of memory using fileoutstream

Question

I,m trying to export some files from a system and save it in my drive, the problem is that some files are pretty big and I get the java out of memory error.

FileOutputStream fileoutstream = new FileOutputStream(filenameExtension);
fileoutstream.write(dataManagement.getContent(0).getData());
fileoutstream.flush();
fileoutstream.close();

Any recomendation that I can try, I add the flush but now diference, this will call the export method, generate the file and saved. I,m using a cursos to run over the data that I,m exporting not an array, I try to add more memory but the files are too big.

Read and write the file in chunks.Try periodically flushing the output stream after some XXX amount of data is written . — AllTooSir
– AllTooSir, Commented May 1, 2013 at 16:23

Pino · Accepted Answer · 2013-05-01 16:31:25Z

2

You are loading the whole file in memory before writing it. On the contrary you should:

load only a chunk of data
write it
repeat the steps above until you have processed all data.

edited May 1, 2013 at 16:31

answered May 1, 2013 at 16:24

Pino

9,5737 gold badges61 silver badges79 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Devolus · Accepted Answer · 2013-05-01 18:17:29Z

1

If the files are really big, you may need to read/write them in chunks. If the files are big enough to fit in memory, then you can increase the size of the virtual machine memory.

i.e:

java -Xmx512M ...


FileInputStream fi = infile;
FileOutputStream fo = outfile
byte[] buffer = new byte[5000];
int n;
while((n = fi.read(buffer)) > 0)
    fo.write(b, 0, n);

Hope this helps to get the idea.

edited May 1, 2013 at 18:17

answered May 1, 2013 at 16:23

Devolus

22.2k15 gold badges70 silver badges122 bronze badges

1 Comment

user1725253 Over a year ago

I try to add 1500m of memory but it faild, the file is like 300m, any example on how to read and write it in chunks

user2340045 · Accepted Answer · 2013-05-01 16:36:46Z

0

you can use the spring batch framework to do the reading and writing the file in chunk size. http://static.springsource.org/spring-batch/

answered May 1, 2013 at 16:36

user2340045

1

Collectives™ on Stack Overflow

Java out of memory using fileoutstream

3 Answers 3

Comments

1 Comment

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

Comments

1 Comment

Comments

Your Answer

Sign up or log in

Post as a guest

Related