Request Coalescing

Problem: Thundering Herd Problem

• When client tries to access Cache what happens if many of the same request come at once

Solution: Request Coalescing

Queue same request in a list

Sends only a single request to origin

Satisfy entire waiting list in parallel, no head of line blocking

Only works for cacheable content