OutOfMemoryError when parsing large xml file using xstream

Question

I'm facing a problem while reading large XML files "100 MB" and parsing it using xstream always the below error occurs

java.lang.OutOfMemoryError: Java heap space error occurs,

here is the code that parses the XML

XStream xstream = new XStream();
xstream.processAnnotations(Class.forName((String)ClassName));

ClassName is a normal class that have the fields with xml annotations.

then use

Object resultDto = xstream.fromXML((String)fileString);

fileString: is the xml file after reading it as inputstream and put it in string buffer.

the above code works fine with small files but didn't work with the big one, any ideas please?

The XStream constructor can have a parameter with the type of xml parser to use specified, i think, maybe this helps you (not load the whole xml in memory at once): xstream.codehaus.org/tutorial.html — HectorLector
– HectorLector, Commented Apr 10, 2014 at 10:44

Shailendra · Accepted Answer · 2014-04-10 10:50:54Z

2

Do not convert your file into a String and then use Xstream, instead use the input stream or file reader directly. XStream.fromXML takes various input like File, InputStream, FileReader that operate directly without the need to first loading the text representation of File in memory as String.

edited Apr 10, 2014 at 10:50

answered Apr 10, 2014 at 10:42

Shailendra

9,1022 gold badges30 silver badges38 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Mikkel Løkke · Accepted Answer · 2014-04-10 10:44:38Z

1

Well there are 2 solutions as far as I can see:

Increase the heap space.
Use a SAX parser instead of a DOM parser (not sure if you can do this with xstream).

Lastly the data might simply be too large to fit.

answered Apr 10, 2014 at 10:44

Mikkel Løkke

3,76926 silver badges39 bronze badges

Comments

CsBalazsHungary · Accepted Answer · 2014-04-10 10:39:41Z

0

Can you run your parsing program with runtime parameters? In that case adding arguments -xmx512M -xms512M should do the trick, since it increases the heap size.

answered Apr 10, 2014 at 10:39

CsBalazsHungary

81114 silver badges31 bronze badges

Comments

Mitul Maheshwari · Accepted Answer · 2014-04-10 10:43:05Z

0

Try to incrise your java head memory. if you are using eclipse. then there is eclipse,ini file is there,

in that incrise the head size.

-XX:MaxPermSize=1024m
-Xms512m
-Xmx1024m

answered Apr 10, 2014 at 10:43

Mitul Maheshwari

2,6474 gold badges26 silver badges40 bronze badges

Comments

Jay · Accepted Answer · 2014-04-10 10:48:45Z

0

How much is the RAM size ? If you have more RAM allocate more to your JVM using -

Xms512m -Xmx2g -XX:PermSize=512m  -XX:MaxPermSize=2g

If you have 8GB of RAM, you could allocate as in the above example it allocate 2GB max Heap memory and 2GB Maximum PermGen space, so in total its 4GB. Or accordingly as per your RAM

answered Apr 10, 2014 at 10:48

Jay

9,55915 gold badges63 silver badges101 bronze badges

Collectives™ on Stack Overflow

OutOfMemoryError when parsing large xml file using xstream

5 Answers 5

Comments

Comments

Comments

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

5 Answers 5

Comments

Comments

Comments

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related