Documentation
¶
Overview ¶
Package shard is the hashing WaveHouse places keys with: Jump maps a key to one of n buckets so that changing n moves as few keys as possible, and Mix derives a second, independent hash from one already taken. The external broker's partitions and shards, the ingest processes' shard assignment and the DynamoDB dedupe table's buckets are all placed with them, so a tool outside this module can compute where any of them lives. What they return is routed on and stored, so it never changes: tests pin it.
Index ¶
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
func Jump ¶
Jump is the jump consistent hash (Lamping and Veach, 2014): key's bucket among n, for n ≥ 1. Growing n to n+1 moves a key only into bucket n, and each key with probability 1/(n+1), where a modulus would move nearly all.
Types ¶
This section is empty.