Empirical follow-up split from #32 (closed by ADR-0002/0004/0005). #32 concluded on paper that under shared-nothing (ADR-0002) the owned per-shard store needs no concurrent reclamation machinery (ADR-0004/0005), and that hot-shard load skew is mitigated by detection plus routing/migration rather than shared state. The remaining question is empirical and cannot be settled on paper.
Question
At what Zipfian skew (theta) and key-cardinality does per-shard eviction's hit-rate loss exceed the cost of remapping/splitting a hot shard? Does cross-shard hot-key detection need a shared frequency sketch, and if so can it be shared without contention?
Done when
Empirical follow-up split from #32 (closed by ADR-0002/0004/0005). #32 concluded on paper that under shared-nothing (ADR-0002) the owned per-shard store needs no concurrent reclamation machinery (ADR-0004/0005), and that hot-shard load skew is mitigated by detection plus routing/migration rather than shared state. The remaining question is empirical and cannot be settled on paper.
Question
At what Zipfian skew (theta) and key-cardinality does per-shard eviction's hit-rate loss exceed the cost of remapping/splitting a hot shard? Does cross-shard hot-key detection need a shared frequency sketch, and if so can it be shared without contention?
Done when