Variability: exploit it, don't kill it
Manufacturing taught a generation of managers that variability is waste. In product development that instinct is wrong. We are paid to create information, and a result you could predict in advance carries none. The real questions are economic: when does variability create value (asymmetric payoffs), when is reducing it cheap (pooling, short horizons, repetition, reuse, buffers), and how can we cut the cost of variability without cutting the variability itself (fast feedback, operating in the linear range, moving it to where it is cheap)?
Information per test = entropy of its outcome
Locating 1 bad candidate among 64
Each test checks a subset holding 50% of the remaining candidates (like a bisect step that is lopsided). Finding the culprit requires log₂64 = 6 bits; the number of tests needed is roughly 6 ÷ bits-per-test.
Try: drag to 2% (a “sure thing”) and watch the tests-needed count explode. Then try 98%: a test that almost always fails is equally uninformative.
Payoff function × distribution of outcomes
Expected payoff as variability grows
Try: with the option payoff, widen σ and watch expected value rise even though the average outcome never moves. Switch to “symmetric”: the curve goes flat. Switch to “concave”: variability now destroys value, which is why factories fight it. Raise the cost of variability to see a finite optimum (V3).
Short planning horizons
V614 possible futures vs. the plan made today
Forecast error (1σ) at the commitment horizon
Error grows like horizon1.5: the trend you extrapolate is itself wrong, and that error compounds. Doubling the horizon nearly triples the error (21.5 ≈ 2.8×).
Try: slide the horizon from 24 down to 3 months. A 8× shorter commitment cuts forecast error by ~19×. That is the case for short release cycles and rolling-wave plans.
Time to do the same job, by repetition (e.g. a release)
Repetition turns an event into a routine: checklists, scripts and muscle memory remove the causes of variation. A team that deploys daily has a predictable deploy; a team that deploys twice a year does not. Small batches (next chapter) give you the repetitions.
Buffers trade money for certainty
V11Completion time (expected 20 days) vs the date you promise
Expected cost vs buffer size
A buffer is paid for in full every time; it converts uncertain lateness into certain lateness. Try: raise the cost of being late and the optimal buffer grows; reduce task CV and the same reliability needs far less buffer (reducing variability and buffering are substitutes).
Reduce the consequence, not the variability
V12Three projects hit by identical disturbances · tick 0
Press play. All three projects suffer exactly the same random drift: nobody reduced variability. Fast feedback cuts the loss by truncating each excursion before it grows. Try a 1-tick check interval: past a point, the cost of checking itself dominates.
Stay in the linear range
V13Queue time multiplier 1/(1−ρ) under fluctuating load
On a curved response, symmetric swings do asymmetric damage: the busy weeks cost far more than the quiet weeks save (Jensen's inequality). The fix is not only to reduce the swing but to move the operating point to where the curve is nearly straight, e.g. plan a development team at 70% load, not 95%.
Try: keep the swing at ±12 points and slide utilization from 50% to 90%. Same variability, very different consequence.
Iteration speed beats defect rate
V15Time to reach the quality target = iterations × cycle time
Each iteration (build → test → fix) removes a fraction of the remaining problems, so iterations needed = log(target) ÷ log(survival). Halving cycle time always halves total time; halving an already-low defect rate saves only part of one iteration, and is usually far harder to achieve than a faster build or test loop.
Try: start at 20% surviving and compare the two levers. Then push survival to 60%: only for a really sloppy process does halving defects compete with halving the loop time.
V14 · Which variable absorbs the slip?
The variability does not disappear; you choose where it shows up. If a week of delay costs $60k and a week of contractors costs $20k, let the budget vary to keep the date fixed.
V16 · Where in the flow is the wait absorbed?
Same delay to market in every case; what differs is what sits idle while you wait. Air traffic control holds planes at the departure gate instead of letting them circle the destination. Hold variable work in the backlog (gate the start) rather than as half-done work.
- takeawayVariability is an economic quantity, not a defect. With asymmetric payoffs, more of it raises expected value; at a 50% failure rate, a test produces the most information.
- takeawayWhen you do want less of it, use the cheap structural levers first: pool independent risks, commit over short horizons, run many small experiments, repeat, reuse, and size buffers economically.
- takeawayUsually the best lever is the consequence: fast feedback truncates losses, a linear operating range keeps swings cheap, and remaining variability belongs in the cheapest variable and the cheapest stage.
All 16 principles of variability
book chapter 4- V1The Principle of Beneficial Variability
Variability can create economic value, so it should not be eliminated by reflex.
A design project whose outcome is certain teaches you nothing; the value of development comes from uncertain experiments that might succeed. Manufacturing-style variance reduction (Six Sigma on every task) suppresses the very innovation you are paying for.
↑ see it in the visualization - V2The Principle of Asymmetric Payoffs
When upside gains are larger than downside losses, more variability raises expected value.
A product bet usually loses at most its investment but can win many times that, like a call option. Under such a convex payoff, widening the spread of outcomes adds more to the upside tail than it costs on the downside.
↑ see it in the visualization - V3The Principle of Optimum Variability
The right amount of variability is an economic optimum, neither the minimum nor the maximum.
Generating variability (radical designs, more risky experiments) has costs that grow faster than its benefits eventually. Find the point where the marginal value of extra spread equals its marginal cost instead of minimizing or maximizing it.
↑ see it in the visualization - V4The Principle of Optimum Failure Rate
Tests generate the most information when their chance of failure is about 50%.
Information per test is the entropy of its outcome, which peaks at a 50/50 pass/fail probability. A test suite that always passes, or an experiment you are sure will work, produces almost no information; design experiments that genuinely might fail.
↑ see it in the visualization - V5The Principle of Variability Pooling
Combining many uncorrelated sources of variation reduces relative variation.
The standard deviation of a sum of N independent tasks grows only with √N while the mean grows with N, so the coefficient of variation shrinks by √N. Hold one schedule reserve for the whole project instead of padding every task.
↑ see it in the visualization - V6The Principle of Short-Term Forecasting
Forecasts become dramatically more accurate as the time horizon shrinks.
Errors compound: market needs and technology drift, and forecast error grows faster than linearly with horizon. Shorter release cycles and rolling plans let you commit only over horizons you can actually predict.
↑ see it in the visualization - V7The Principle of Small Experiments
Many small experiments produce less total variation than one big experiment of the same size.
Splitting one large bet into many independent smaller ones lets their outcomes pool, so the total result is far more predictable. Ten two-week experiments are less risky than one twenty-week program, even at the same total spend.
↑ see it in the visualization - V8The Repetition Principle
Doing something repeatedly reduces its variation.
Repetition builds routine, tooling and learning, so the spread of task times narrows. Frequent small releases make deployment a well-practiced, predictable operation instead of a twice-a-year adventure.
↑ see it in the visualization - V9The Reuse Principle
Reusing proven designs reduces variability.
A reused component has known behavior, cost and schedule; only the new parts contribute large uncertainty. Reuse where novelty adds no value, and spend your variability budget where it creates differentiation.
↑ see it in the visualization - V10The Principle of Negative Covariance
You can reduce variance by introducing a counterbalancing effect that moves opposite to the disturbance.
Variance of a sum includes twice the covariance, so a negatively correlated term cancels swings. Cross-trained engineers who move to whichever stream is behind, or scope that shrinks when the schedule slips, create negative covariance.
↑ see it in the visualization - V11The Buffer Principle
Buffers buy reduced variability of outcome, at the price of time or money.
A schedule buffer turns an uncertain finish into a later but more certain one; you pay its cost every time, even when it is not needed. Size it economically: add buffer until the cost of one more day equals the expected lateness cost it avoids.
↑ see it in the visualization - V12The Principle of Variability Consequence
Reducing the consequences of variability is usually a better lever than reducing variability itself.
The cost of variability is the product of how often deviations happen and how much they cost. Fast feedback that catches a drifting design early truncates the loss tail at a fraction of the cost of preventing every deviation.
↑ see it in the visualization - V13The Nonlinearity Principle
Operate in the linear range of system performance, where variation has small consequences.
In a nonlinear region (a queue near 100% utilization, a structure near its limit) symmetric swings produce asymmetric damage, so average performance is worse than performance at the average. Back away from the knee of the curve.
↑ see it in the visualization - V14The Principle of Variability Substitution
Accept variability in something cheap to protect something expensive.
When schedule slips are costly, let budget or low-value scope flex instead: paying for overtime or dropping a minor feature is cheaper than missing a market window with a high cost of delay.
↑ see it in the visualization - V15The Principle of Iteration Speed
Improving iteration speed usually pays more than improving the defect rate.
Time to reach quality = iterations × cycle time. Halving cycle time always halves the total, while halving an already-low defect rate removes only a fraction of an iteration. Invest in fast builds and fast tests before perfect first passes.
↑ see it in the visualization - V16The Principle of Variability Displacement
Move variability to the stage of the process where it costs the least.
Air traffic control holds flights on the ground, not in the air, because waiting at the gate is far cheaper than circling. In development, absorb variation in the unstarted backlog rather than as half-finished work or a slipped launch.
↑ see it in the visualization