Redis - StackExchange.Redis - Missing Keys on Mass Insertion using C# Driver

Question

My current Environment - .NET Core 2.1, Redis-Server/cli 3.2 on Windows Server

I am currently trying to insert a large number keys into redis using the StackExchange.Redis Driver in my .NET core console application like this:

foreach (var item in collection)
{
    var key = item.SomeKey;
    var value = item.SomeValue;
    //Tried Both Async and Sync
    redisDatabase.StringSetAsync(key, value);
    redisDatabase.StringSet(key, value);
}

Records are passed to the for-each in batches of 1000

My collection has close to 285000 records and therefore is inserting these many into the redis-server, but upon completion i can see only 250000 odd records in the database (after running the INFO redis-cli command).

Why is this happening?

I do know that for mass insertions it is better to go with the redis protocol but this is a temporary solution i need for now

Are there any duplicate keys in your collections? These duplicate keys will be overwritten. — for_stack
– for_stack, Commented Aug 28, 2018 at 11:10

Rakshith Murukannappa · Accepted Answer · 2018-08-31 02:53:27Z

0

Turns out that redis only accepts so many set requests and processes them at once. What turned out to be the solution in my case was limiting the number of set commands fired from my application.

Initially it was set to 1000 requests per iteration and when it was changed to 500 it inserted all without missing any insertions.

answered Aug 31, 2018 at 2:53

Rakshith Murukannappa

5898 silver badges19 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Redis - StackExchange.Redis - Missing Keys on Mass Insertion using C# Driver

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related