Zach Tellman — the need for backpressure in queues, and the limits

(written by lawrence krubner, however indented passages are often quotes). You can contact lawrence at: lawrence@krubner.com

This is very good. A lot of this interesting, but perhaps the biggest surprise is when he adds 16 consumers of tasks, but also 16 producers of tasks, the crisis point comes suddenly, compared to when there was only 1 consumer and 1 producer. With multiple consumers the consumption is averaged out, so each machine works fine right up to the moment of crisis.

His main theme is “Unbounded queues are fundamentally broken because it puts the stability of our system in someone else’s hand.”

Source