Caching
7 topics in caching.
Caching 101
Caching reduces latency (memory access: ~100ns vs disk: ~10ms), reduces database load (cache absorbs 80-95% of reads), and reduces costs (fewer database.
Caching Strategies
Choosing the wrong caching strategy leads to stale data, cache misses, or unnecessary database load.
Cache Eviction Policies
The eviction policy directly affects cache hit rate. A poor policy evicts useful data, causing more cache misses and higher latency.
Distributed Caching
A single Redis server can only hold as much data as its RAM allows. Distributed caching (Redis Cluster, Memcached with consistent hashing) scales.
Content Delivery Network (CDN)
CDNs are essential for any user-facing application. They reduce latency, reduce origin server load, protect against DDoS attacks, and handle traffic.
Cache Warming
Pre-populating caches before traffic hits to avoid cold-start latency spikes, covering warming strategies, real-world implementations, and when warming is.
Cache Stampede
A cache stampede (thundering herd) occurs when many requests simultaneously miss the cache and hit the database, causing a load spike that can bring down.