as-cache · phase-shift

How a multi-armed bandit picks the eviction policy

The cache holds seven policies at once: one serves the traffic, the rest run as shadows and measure what would have happened had they been serving. Every epoch the bandit looks at their hit rates and decides which one to make active. Scrub along the timeline — below it you can see what the bandit knew at that moment and why it chose what it chose.

240,000 requests cache 500 entries 12 phases, zipf ⇄ loop final hit rate 73.5%

Active policy over time

What the bandit knew at this moment

Show as a table
PolicyHit rateHitsMissesRole