Preferences complete the model
Probability tells what may occur; utility determines how the organisation ranks the consequences.
A handbook for converting uncertain outcomes into rational choices using preference models, expected utility, decision networks and value-of-information analysis.
Probability tells what may occur; utility determines how the organisation ranks the consequences.
Non-linear preferences, constraints and severe downside can make equal expected-dollar alternatives strategically different.
A test, pilot or research activity is valuable only to the extent that it can improve a later decision enough to justify its cost and delay.
A forecast does not choose an action until outcomes are connected to preferences.
Suppose two projects have different probability distributions of cost and benefit. A probability model can describe those distributions, but the organisation still needs a rule for comparing them. If dollars are the only consequence and risk neutrality is appropriate, expected monetary value may be enough. If liquidity, safety, reputation or nonlinear strategic effects matter, a utility function or multi-attribute value model is more appropriate.
The source’s rational-preference framework formalises consistency conditions under which preferences can be represented by expected utility. In practice, the value is less about philosophical perfection and more about making trade-offs explicit and auditable.
Expected value averages outcomes using their probabilities.
Expected monetary value is appropriate when repeated exposure, financial scale and risk tolerance make dollars approximately linear in preference. For a one-off decision that could threaten solvency, linear monetary value may be inappropriate. A loss that forces closure has a consequence greater than its nominal dollar amount in a spreadsheet.
A concave utility over wealth represents aversion to variability in classical models; convex regions can represent risk-seeking behaviour. Rather than assuming a shape, elicit meaningful trade-offs and test sensitivity.
Business outcomes often contain more than one consequence.
A sourcing decision can affect cost, quality, lead time, resilience and intellectual-property exposure. Combining all consequences into one arbitrary weighted score can conceal interactions and double counting. Define attributes carefully, ensure scales have clear meaning and examine whether trade-offs are independent enough for an additive model.
Where strategic or regulatory constraints are non-negotiable, treat them as constraints rather than compensable attributes. A severe safety requirement should not be traded away simply because another score is high. Preference modelling should reflect the actual governance rules of the organisation.
A decision network extends a probabilistic network with decision and utility nodes.
Chance nodes represent uncertain states, decision nodes represent choices and utility nodes represent value. Information arcs specify what will be known when a decision is made. This timing is crucial. A test result has no value if it arrives after an irreversible commitment, and a forecast should not be used in a decision node if it would not actually be available at that time.
Perfect information is a useful upper bound on what any real information source can be worth.
If perfect information about an uncertainty would not change the chosen action, then no test about that uncertainty has decision value. This is a powerful screening rule: it can stop teams collecting data simply because it is available. If perfect information would materially change the choice, then real tests may be worth investigating.
Perfect information is hypothetical and rarely obtainable. Its value is an upper bound before considering the cost, delay and imperfection of an actual measurement.
Real tests produce noisy signals rather than certainty.
Model the possible test results and how each result changes posterior beliefs. For each result, calculate the best subsequent action and its expected value. Average across possible results, then subtract the value of the best decision without the test. Finally subtract the cost of obtaining the information and include the strategic cost of delay where relevant.
Identify what knowledge could change the decision.
List possible signals and their reliability.
Calculate posterior probabilities for each signal.
Identify the best action after each possible signal.
Weight those conditional values by the probability of each signal.
The difference is gross value of sample information.
Proceed only when the net value and practical timing justify the test.
A generic organisation considers a full rollout with uncertain customer adoption.
Without further data, the expected value of full rollout is slightly higher than not proceeding, but the downside under low adoption is material. A small trial can produce a high or low adoption signal. If a high signal would justify rollout and a low signal would justify stopping, the trial changes behaviour and therefore may have positive value.
If management would roll out regardless of the trial result, the trial has essentially no decision value even if it produces interesting information. Conversely, if the trial is so slow that competitors erase the opportunity, its delay cost may exceed its informational value. The calculation forces those trade-offs into the same decision frame.
The source also recognises that real decision-makers do not always behave like ideal expected-utility agents.
Framing, loss aversion, overconfidence, anchoring and inconsistent probability perception can affect choices. The remedy is not to assume people can become perfectly rational; it is to design process controls. Use pre-defined criteria, independent review, explicit probability ranges and decision records. Compare forecasts with outcomes to improve calibration.
No. A forecast may give the most likely outcome, while expected value averages across all modelled outcomes. The most likely outcome does not necessarily have the highest probability mass in a continuous distribution and does not capture tail consequences.
Gross information value cannot be negative when it can be ignored, but a real information-gathering activity can have negative net value after cost, delay or operational disruption.