C# Threading Memory Exception

Question

I'm doing some college work and I'm supposed to simulate 10, 100, 1,000 and 10,000 threads doing 1,000,000 locks and unlocks in a mutex (static Mutex m_mutex = new Mutex();) and in a semaphore as mutex (static SemaphoreSlim m_semaphore = new SemaphoreSlim(1);, correct?).

I'm having no trouble in the first three cases, but I got a Memory Exception in the 10,000 threads case. My code:

        resultados.WriteLine("=== 10 threads ===");
        ts = new TimeSpan();
        media = 0;
        parcial = 0;
        resultados.WriteLine("Parciais:");
        for (int i = 0; i < 10; i++)
        {
            parcial = LockAndUnlock_Semaphore_ComDisputa(10);
            media += parcial;
            ts = TimeSpan.FromTicks(parcial);
            resultados.WriteLine(ts.ToString());
        }
        ts = TimeSpan.FromTicks(media / 10);
        resultados.WriteLine("Média: " + ts.ToString());

I'm supposed to take 10 tests and measure the average.

private static long LockAndUnlock_Semaphore_ComDisputa(int numeroDeThreads)
    {
        Thread[] threads10 = new Thread[10];
        Thread[] threads100 = new Thread[100];
        Thread[] threads1000 = new Thread[1000];
        Thread[] threads10000 = new Thread[10000];
//switch in the numeroDeThreads var
//[...]
 case 10000:
 sw.Start();
 for (int i = 0; i < numeroDeThreads; i++)
 {
      threads10000[i] = new Thread(LockUnlockSemaphore);
      threads10000[i].Priority = ThreadPriority.Highest;
      threads10000[i].Start();
 }
 for (int i = 0; i < numeroDeThreads; i++)
 {
      threads10000[i].Join();
 }
 sw.Stop();
 break;
//[...]
return sw.ElapsedTicks;


 static void LockUnlockSemaphore()
    {
        for (int i = 0; i < 1000000; i++)
        {
            m_semaphore.Wait();
            //thread dentro do semaforo
            m_semaphore.Release();
        }
    }

While I post this question, I'm trying again but this this I create the thread vector like this:

Thread[] threads = new Thread[numeroDeThreads];

I'm supposed to test in mutex and in semaphore as mutex, but the error happen in the just mutex.

EDIT

Even with the Thread[] threads = new Thread[numeroDeThreads]; I got outofmemoryexception =( ...

Thanks in advance,

Pedro Dusso

check this stackoverflow.com/questions/145312/…

Andrey
– Andrey

2010-12-07 16:33:20 +00:00
Commented Dec 7, 2010 at 16:33 — Andrey
– Andrey, Commented Dec 7, 2010 at 16:33
Can you post the exact text of the exception?

Scott Chamberlain
– Scott Chamberlain

2010-12-07 16:35:37 +00:00
Commented Dec 7, 2010 at 16:35 — Scott Chamberlain
– Scott Chamberlain, Commented Dec 7, 2010 at 16:35

sisve · Accepted Answer · 2010-12-07 17:38:20Z

6

10000 threads will cause a lot of allocated stack space, per default 1 megabyte per thread. The CLR will commit this memory requiring it to be available, requiring your process to be able to use 10000 mb of memory. 32 bit applications are unable to have more than 2 gb mapped process memory, causing this behavior.

See the blog entry Managed threads in "whole stack committed" shocker which may provide you with more information.

edited Dec 7, 2010 at 17:38

answered Dec 7, 2010 at 16:39

sisve

19.8k3 gold badges55 silver badges96 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Conrad Frix · Accepted Answer · 2010-12-07 17:23:36Z

1

Since this is only test you might want to lower the default stack size as Joe Duffy explains to something more reasonable. The two ways to do this is to use the thread constructor to limit the size or you can use Editbin.

The below reduces it from 1MB to 256KB which will roughly quadruples the amount of threads you can create before you run out of memory.

EDITBIN.EXE FOO.EXE /STACK:262144

The advantage that editbin has, is that it works for all threads including pooled threads.

Note this will work correctly if you use the VS command prompt. If you use the normal command prompt you will need to resolve the dll links manually

edited Dec 7, 2010 at 17:23

answered Dec 7, 2010 at 16:47

Conrad Frix

52.8k13 gold badges99 silver badges158 bronze badges

6 Comments

Pedro Dusso Over a year ago

this command will increase the stack, am I understand it right?

Conrad Frix Over a year ago

This command is supposed to lower the amount of stack consumed per thread to ~256k instead of 1MB

Pedro Dusso Over a year ago

Perfect, should work. But I get the error "EDITBIN :error : cannot execute LINK.EXE". My application is C#, maybe because this?

Conrad Frix Over a year ago

It works fine for C# for me, but only when I run it from the Visual Studio command prompt

Pedro Dusso Over a year ago

I think this will work for me in C# msdn.microsoft.com/en-us/library/5cykbwz4.aspx

|

GvS · Accepted Answer · 2010-12-07 16:40:11Z

0

In Windows the default stack size is 1MB.

1MB * 10.000 threads = 10GB of stack size alone.

Maybe, you should rethink your architecture.

answered Dec 7, 2010 at 16:40

GvS

52.5k16 gold badges104 silver badges139 bronze badges

1 Comment

sisve Over a year ago

Clarification: Windows wont require that 10 gb stack space to be available up front, but will commit it when necessary. 10 gb is only needed if all threads are using their stack space. Managed threads, however, commit their stack space when created causing the need for 10 gb memory up front.

Collectives™ on Stack Overflow

C# Threading Memory Exception

3 Answers 3

Comments

6 Comments

1 Comment

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

Comments

6 Comments

1 Comment

Your Answer

Sign up or log in

Post as a guest

Linked

Related