The thundering herd problem can overwhelm backends during cache expiration.
Techniques:
- Use request coalescing (single-flight)
- Stagger cache TTLs
- Introduce jitter into TTLs
Never let many clients hammer the backend for the same data at once.
Mitigating Thundering Herd Problems
Author
Shiv Bade
Tags
caching
thundering herd
Published
August 22, 2016
Featured
Slug
Tweet