Implement Consistent Hash Algorithm in Java

Question

I am trying to implement a consistent hash based algorithm in java using the following reference for sharding keys to redis -

Stanford Theory on CH

I am trying to understand the best way to generate the hascode for a node and a key. Currently I am using the DigestUtils to generate the hash as follows & adding the returned value to the ring/circle -

private BigInteger hash(String key) {
    return new BigInteger(DigestUtils.md5Hex(key.getBytes()), 16);
}

I wanted to know if this approach sounds correct.

Tague Griffith · Accepted Answer · 2017-07-17 22:14:23Z

1

If you look at the source code spymemcached client for Memcache, you can see how that client implemented the Ketama consistent hashing algorithm. Focus on the following files:

While not for Redis specifically, the principles are the same.

answered Jul 17, 2017 at 22:14

Tague Griffith

4,2432 gold badges22 silver badges24 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Nikita Koksharov · Accepted Answer · 2018-12-02 11:30:31Z

1

Redisson uses highwayhash algorithm for sharded Map and Set objects. This algorithm has better distribution characteristic.

Here is a usage example with reference implementation:

long[] KEY = {0x9e3779b97f4a7c15L, 0xf39cc0605cedc834L, 0x1082276bf3a27251L, 0xf86c6a11d0c18e95L};

byte[] data = new byte[] {1, 2, 3, 4, 5};

// getting 128 bits hashing
long[] hash128 = HighwayHash.hash128(data, 0, data.length, key);
// getting 256 bits hashing
long[] hash256 = HighwayHash.hash256(data, 0, data.length, key);

edited Dec 2, 2018 at 11:30

answered Jul 19, 2017 at 11:59

Nikita Koksharov

10.8k1 gold badge68 silver badges76 bronze badges

Collectives™ on Stack Overflow

Implement Consistent Hash Algorithm in Java

2 Answers 2

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related