OutOfMemoryException while using string.replace()

Question

I am working on C#. I am getting OutOfMemoryException while using string.replace(dt,"") and even for stringbuilder.replace(dt,""). May I please know how to overcome this problem? Or any other way to do the same?

thanks for reply...my problem is that i am using got huge data ....so getting problem in replacing.... — MGK
– MGK, Commented Nov 19, 2009 at 6:29

tster · Accepted Answer · 2009-11-19 06:50:57Z

1

Since your data is so big, you should not try to operate on it all at once. Instead read in chucks, process it, then write it to disk and move on to the next chunk.

Here is some code (untested):

string current = getChunk();
while (current.Length > 0)
{
    current = current.Replace(oldValue, newValue);
    string toSave = current.Substring(0, current.Length - oldValue.Length);
    saveToFile(toSave);
    current = current.Substring(current.Length - oldValue.Length) + getChunk();
}

I don't save the last oldValue.Length because there is a chance that a replacement might be halfway in one chunk and halfway in another. NOTE: there might be a bug in that code, but it is pretty close.

answered Nov 19, 2009 at 6:50

tster

18.3k6 gold badges57 silver badges72 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

arul · Accepted Answer · 2009-11-19 06:25:22Z

1

Your string is probably way too large and the memory manager fails to find a contiguous block of memory for the new string.

You'll need to optimize your program for more efficient memory management.

answered Nov 19, 2009 at 6:25

arul

14.1k1 gold badge60 silver badges78 bronze badges

4 Comments

MGK Over a year ago

thanks for reply ....yes the string that i am using for replace got huge data .....Can u plz suggest me any other way to do the same

Rashmi Pandit Over a year ago

Contiguous block of memory shouldn't be reallocated for the StringBuilder as the replace is not increasing the length of the original string. Check the link stackoverflow.com/questions/287842/… for more info

arul Over a year ago

Process the string inside a loop in smaller chunks.

arul Over a year ago

Rashmi Pandit: Had the stringbuilder grown over it's capacity, it'd need to reallocate it's internal buffer.

Collectives™ on Stack Overflow

OutOfMemoryException while using string.replace()

2 Answers 2

Comments

4 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

4 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related