#domain/software 6

Notes filed under this topic. All tags

Budding 11 months ago

CPU-bound vs IO-bound

Whether your program spends its time computing or waiting decides your concurrency model - and quietly picks the language that will feel effortless.
Evergreen last year

Rate limiting as an invariant

A rate limit reads like a restriction from outside and like a promise from inside - the invariant that keeps a system in a regime where it still works.
Evergreen last year

Queues Are Everywhere

A queue decouples a producer from a consumer so they need not move at the same speed. Most of the queues in a system are the ones nobody drew on the diagram.
Evergreen last year

Caching Isn't Cheating

Caching gets dismissed as a hack, but it is one of the oldest principled moves in computing - spending space, and a little staleness, to buy time.
Evergreen 2 years ago

Tail latency: the number the average hides

The average request looks fine while the slowest one percent decides your reputation. Why tails happen, and how to defend them.
Evergreen 2 years ago

Latency vs Throughput vs IOPS: why your fast API still fails at scale

Three performance numbers people blur together - and how the workload decides which one you should be optimizing.