Unit 7

Decision Making under Uncertainty and Simulation

Decision Making under Uncertainty and Simulation · Data, Models, and AI-Empowered Decision Making
7.1 Four Decision Criteria 7.2 Decision Trees and EMV/EVPI 7.3 Bayesian Updating and EVSI 7.4 Utility and Risk Preferences 7.5 Monte Carlo Simulation 7.6 Summary and Assignment 5 interactive demonstrations · 5 classroom exercises
How to use this e-textbook. Orange panels are interactive demonstrations where changing payoffs, probabilities or parameters recalculates the four decision criteria, Bayesian posteriors, expected values and simulation results immediately. Green panels are classroom exercises; complete them and select “Check” for feedback and reference values. The Monte Carlo demonstration actually runs random sampling with a fixed random seed, so results are identical and reproducible on every run.

7.1 Foundations of Decision Analysis: The Goferbroke Company Problem

Managers often decide in uncertain environments. This section establishes a shared language: alternatives, states of nature, prior probabilities and payoff tables.

Four Typical Decision Problems

SituationWhat is uncertain?
A manufacturer launches a new productHow will consumers respond? What production scale is appropriate? Should a test launch be run?
A financial institution invests in securitiesWhich sectors and assets have the best prospects? How will macro conditions and interest rates evolve?
A government contractor bids for a new projectWhat will actual cost be? Who will compete, and what will they bid?
An oil company decides whether to drillDoes the field contain oil? How much? Should geological testing be done first?

Case: The Goferbroke Company

  • A company is considering oil-well development in an unexplored area. Geological consultants report that the site has a probability of 1/4 of containing oil.
  • Drilling and exploration would cost about USD 100,000; if oil is found, estimated net proceeds are about USD 800,000.
  • Another oil company offers USD 90,000 to acquire the site.

The Payoff Table and Five Key Terms

AlternativeOilDry
Drill for oil700−100
Sell the land9090
Prior probability0.250.75

Units: USD thousands.

  • Decision maker the person or team responsible for the decision.
  • Alternative the available choices (here, drill or sell).
  • State of nature a condition determined by uncontrolled random factors (oil or dry).
  • Prior probability an initial estimate of how likely each state is.
  • Payoff the outcome from combining one alternative with one state, quantified in money.
Interactive Demonstration 1

Four Decision-Criteria Workbench

Drag the sliders to change payoffs and prior probabilities and observe which alternative each criterion recommends.With the same payoff table, different criteria may give opposite recommendations—which shows that the decision maker’s attitude is also an input.

Maximax criterion
Maximin criterion
Maximum-likelihood criterion
Bayes criterion (EMV)
EMV of drilling
EMV of selling
Expected Value of Perfect Information (EVPI)

Classroom Exercise 1

Which Alternative Does Each Criterion Recommend?

Using the original data (drilling: 700 if oil / −100 if dry; selling: 90 / 90; prior probability of oil 0.25), determine the recommendation from each criterion.

7.2 Decision Criteria and Decision Trees

How the Four Criteria Work

CriterionWhat it focuses onMethod
Maximax criterionThe best outcome onlyTake each row maximum, then choose the largest
Maximin criterionThe worst outcome onlyTake each row minimum, then choose the largest
Maximum-likelihood criterionThe most probable stateIdentify the most likely state, then choose the alternative with the highest payoff in that state
Bayes criterion (EMV)Weight by prior probabilitiesCompute EMV = Σ payoff × probability for each alternative and choose the maximum

No criterion is inherently “right”—each represents a different risk attitude. Management often uses EMV because it incorporates probabilities, but EMV assumes risk neutrality, an assumption challenged in Section 7.4.

Decision Trees

A decision tree shows the sequence of decisions and random events graphically and applies the Bayes criterion:Square nodes are decision nodes, with branches for alternatives;circular nodes are event nodes, with branches for possible states.

Interactive Demonstration 2

Decision Tree and EMV: A Change in the Prior Changes the Conclusion

Drag the probability of oil and observe how the drilling branch’s EMV changes. Below a threshold, the recommended action flips from drilling to selling.

EMV of drilling
EMV of selling
Alternative with maximum EMV
Probability threshold for reversal

Expected Value of Perfect Information (EVPI)

Suppose the true state could be known before deciding: drill if oil (700), sell if dry (90), giving expected payoff 0.25×700 + 0.75×90 = 242.5. This exceeds the no-information EMV of 100 by 142.5. The difference is the expected value of perfect information—an upper bound on the value of any information.

EVPI = expected payoff with perfect information − EMV without information = 242.5 − 100 = 142.5 Units: USD thousands

7.3 Bayesian Updating: Seismic Testing and Posterior Probabilities

Prior probabilities are often subjective and approximate. A company can pay for tests or research to update them more accurately; the updated probabilities are posterior probabilities.

Case: Seismic Testing at Goferbroke

The company can pay USD 30,000 for detailed seismic testing to improve its estimate of the probability of oil. The test has two results:FSS(favourable, indicating a higher chance of oil) and USS(unfavourable, indicating a low chance).

State of natureP(result | state): FSSUSS
OilP(FSS|Oil) = 0.6P(USS|Oil) = 0.4
DryP(FSS|Dry) = 0.2P(USS|Dry) = 0.8
Joint probability: P(state and result) = P(state) × P(result | state)
Posterior probability: P(state | result) = P(state and result) ÷ P(result)
CombinationPrior × conditional probabilityJoint probabilityMarginal probabilityPosterior probability
Oil + FSS0.25 × 0.60.15P(FSS) = 0.15 + 0.15 = 0.30.15 ÷ 0.3 = 0.5
Dry + FSS0.75 × 0.20.150.15 ÷ 0.3 = 0.5
Oil + USS0.25 × 0.40.10P(USS) = 0.10 + 0.60 = 0.70.10 ÷ 0.7 ≈ 0.143
Dry + USS0.75 × 0.80.600.60 ÷ 0.7 ≈ 0.857
Interactive Demonstration 3

Bayesian-Updating Calculator: Is the Test Worth Buying?

Drag the prior, the two conditional probabilities and the testing cost to see posterior probabilities, the best action under each result, expected payoff including testing and EVSI. The information is worth buying only when net value is positive.

P(FSS) / P(USS)
If testing is favourable
If testing is unfavourable
Expected payoff including testing
EVSI
Net payoff after cost

Accounting reminder: the test fee is paid before the result is known, so it must be deducted in both FSS and USS branches. This case gives expected payoff including testing of 153,EVSI = 53, and net value of 23 after the cost of 30. Deducting the cost from only one branch overstates the value of information.
Classroom Exercise 2

Calculate the Posterior Probabilities

Using the original data (prior 0.25, P(FSS | Oil) = 0.6 and P(FSS | Dry) = 0.2), complete three values (three decimals).

Classroom Exercise 3

Is the Test Worth Buying?

The test costs USD 30,000. Enter expected payoff including the test, EVSI and net value after cost (USD thousands).

7.4 Utility and Risk: Why People Reject Higher-Expected-Value Gambles

So far we have assumed that expected monetary value is the correct decision criterion. This assumption fails in many settings. Choose between:

A: Take a gamble

A 50% chance of winning USD 100,000 and a 50% chance of receiving nothing. Expected value: USD 50,000.

B: Guaranteed receipt

Receive USD 40,000 for certain.

Most people choose B even though A has a higher expected value. The reason is risk aversion a utility function translates monetary amounts into a scale that reflects subjective preference.

  • If two alternatives have equal expected utility the decision maker is indifferent between them.
  • When decisions use utility, the Bayes criterion substitutes utility for monetary payoffs.
  • The decision that maximises expected utility is optimal.

The Equivalent-Lottery Method

  1. Set U(maximum payoff) = 1 and U(minimum payoff) = 0.
  2. To determine the utility of an intermediate payoff M, offer two alternatives: A₁ gives the maximum with probability p and the minimum with probability 1−p; A₂ gives M for certain.
  3. Ask: for what p are you indifferent? Then U(M) = p.

For the Goferbroke problem, Max’s indifference probabilities correspond to the following table (USD thousands):

M−130−1006090670700
U(M)0.000.050.300.330.971.00

Notice the curve: utility rises quickly from −130 to 90 and barely changes from 670 to 700.This is what risk aversion looks like.

Interactive Demonstration 4

Utility Curves and Certainty Equivalents

Use exponential utility U(x) = 1 − e^(−x/r), where r is risk tolerance: smaller r means stronger risk aversion. Drag r to see the gamble’s expected utility, certainty equivalent and whether it exceeds the certainty of USD 40,000.

Gamble’s expected monetary value
Utility of guaranteed USD 40,000
Gamble’s expected utility
Gamble’s certainty equivalent

Classroom Exercise 4

Risk and Utility

Evaluate the following four statements.

7.5 Monte Carlo Simulation: Turning Uncertainty into Distributions

Decision trees handle only a few discrete states. Real uncertainty is often continuous—sales, price and cost are all examples. Use simulation: represent every uncertain quantity with a distribution and sample thousands of times to see the distribution of outcomes.

Case: Annual Profit from a New Product Launch

Core Simulation Ideas: Why Repeated Sampling Produces an Answer

Monte Carlo simulation does not solve a closed-form equation. It assigns a probability distribution to each uncertainty, repeatedly samples a set of values and calculates one outcome, and approximates the outcome distribution through thousands of repetitions. It is named after the casinos of Monaco because it relies on random sampling.

It works because of the law of large numbers: with enough repetitions, the sample average converges toward the true average. This is the same idea from earlier units—one draw is random, but the average of many draws is stable.

  1. Define the distributions: each uncertain quantity needs a distribution and parameters supported by historical data, industry experience or expert judgement.
  2. Draw one sample: sample one value for each uncertainty, substitute them into the model and calculate one outcome—a single “trial.”
  3. Repeat thousands of times: repeat step 2 N times to obtain N outcomes.
  4. Summarise the distribution: characterise the N outcomes with means, standard deviations, percentiles and probabilities.
1 Define distributions sales, price, cost 2 Draw one value for each calculate one outcome 3 Repeat N times usually at least 1,000 4 Summarise the distribution mean, volatility, loss probability, percentiles Each repetition is an independent trial; more repetitions produce more stable results
The four-step simulation loop: distribution → sample → repeat → summarise.

How to read the results. A single average is insufficient; examine at least four things together:

  • Mean: the expected profit—but it hides volatility.
  • Standard deviation: the size of fluctuations. If it exceeds the mean, outcomes are highly unstable.
  • Loss probability(or probability of missing any target): the share of outcomes below zero, directly corresponding to the managerial question “could we lose money?”
  • Percentiles: worst 5% and best 5% outcomes, describing tail risk and upside.

Inspect the histogram shape as well: two peaks often indicate two distinct situations (for example, “demand takes off” and “demand fails”), making a single average less meaningful.

ComparisonDecision TreesMonte Carlo simulation
Uncertainty handledA few discrete statesContinuous variables, potentially many at once
MethodWeight by probability and calculate expected value exactlyRepeatedly sample to approximate the distribution
Questions answeredExpected payoff and value of information (EVPI/EVSI)Outcome distribution, loss probability and worst cases
Main riskMisestimated states and probabilitiesUnsupported distributions and parameters, or too few trials

How many runs are needed? Around 1,000 runs are usually enough to reveal the distribution’s general shape; use several thousand when tail conclusions such as the worst 5% matter. More runs stabilise results, but improvement diminishes beyond a point.

Four common simulation mistakes:① using unsupported parameter guesses—wrong distributions or undocumented parameters make conclusions unreliable;② stopping after a few dozen runs—sampling error is too large;③ treating uncertainties as independent—in reality sales and price are often linked;④ looking only at the mean—a project with an attractive average may have a loss probability near 50%.

Case: Annual Profit from a New Product Launch

Uncertain quantityDistributionMeanStandard deviation
Annual sales (units)Normal distribution10,0002,000
Unit price (CNY)Normal distribution505
Unit cost (CNY)Normal distribution303
Fixed cost (CNY)Fixed value180,000—
Annual profit = sales × (price − unit cost) − fixed cost
Interactive Demonstration 5

Run a 1,000-Trial Simulation

Select “Resample” and the page generates thousands of random combinations of sales, price and cost, calculates each profit and plots a histogram. A fixed random seed makes results reproducible on every opening.

Simulation trials:
Mean profit
Profit standard deviation
Loss probability
Worst 5% outcome
Best 5% outcome

Accounting note: with fixed cost at CNY 180,000, mean profit is about CNY 20,000, standard deviation is about CNY 72,000 and loss probability is about 40%. At CNY 185,000 fixed cost, mean profit falls to about CNY 15,000—simulation conclusions depend on parameters, and parameter sources must be documented.

How to Do It in Excel

StepHow to Do It in ExcelHow AI can help
Define uncertain quantitiesSpecify each distribution and its parametersList uncertainties and reasonable ranges
Sample=NORM.INV(RAND(), mean, standard_deviation)Write formulas; you verify parameters
Repeat calculationsFill the formula down 1,000 rowsSuggest trial count and random seed
Summarise resultsUse AVERAGE, STDEV, PERCENTILE and COUNTIFExplain percentiles and probabilities
Interpret conclusionsExamine loss probability and worst casesRemind you not to rely only on the mean
Classroom Exercise 5

Interpret the Simulation Results

Evaluate the following four statements.

7.6 The Value of AI Information: Using EVSI to Decide Whether to Buy

Treat an AI forecast as additional information: it can improve accuracy, but is usually imperfect and costly. EVSI determines the maximum value of that information.

  1. Estimate AI accuracy and error patterns: how often is it correct, and how does it fail (false dry or false oil)?
  2. Use EVSI to calculate the upper bound on information value: EVSI = expected payoff with information − expected payoff without information.
  3. Compare with cost: if cost exceeds EVSI, the information is not worth relying on; if cost is below EVSI, it is worth buying.
Value of additional information = expected payoff with information − expected payoff without information EVSI is always non-negative and no greater than EVPI

This is one of the unit’s most practical management conclusions:calculate the value of information before deciding whether to buy it. For the seismic test above, EVSI is 53 (USD thousands), cost is 30 and net value is 23—worth doing.

7.7 Summary and Assignment

  • Three tools for decisions under uncertainty:decision criteria, decision trees and expected value.
  • New information can update probabilities through Bayes’ theorem, but it has a price: compare EVSI with cost.
  • Monte Carlo simulation turns distributions into observable outcomes.
  • Means can mislead: loss probability and worst-case outcomes matter too.
  • Utility functions explain why people reject gambles with higher expected value.
Post-class assignment. Exercise 1: complete the four decision criteria and EVPI for Goferbroke. Exercise 2: calculate joint probabilities, posterior probabilities and EVSI for the seismic test. Exercise 3: run 1,000 Monte Carlo trials with the page parameters and report the mean, standard deviation, loss probability and worst 5% outcome. Assignment: estimate AI forecast accuracy for a decision you care about, and use EVSI to determine whether that AI information is worth buying.

Appendix: Interactive Demonstrations and Classroom Exercises

LocationTypeContent
7.1DemonstrationFour Decision-Criteria Workbench
7.2DemonstrationDecision tree and EMV (adjustable prior)
7.3DemonstrationBayesian-updating calculator and EVSI
7.4DemonstrationUtility Curves and Certainty Equivalents
7.5Demonstration1,000-trial Monte Carlo simulation
7.1ExerciseWhich Alternative Does Each Criterion Recommend?
7.3ExerciseCalculate the Posterior Probabilities
7.3ExerciseIs the Test Worth Buying?
7.4ExerciseRisk and Utility
7.5ExerciseInterpret the Simulation Results

Data source: payoff table, test conditional probabilities and simulation parameters from 单元7_决策与仿真练习.xlsx; every expected value, posterior, EVSI and simulation result is calculated on the page.

Unit Glossary (English–Chinese)

English中文
State of nature自然状态
Prior probability先验概率
Payoff收益
Expected monetary value (EMV)期望货币值
Expected value of perfect information (EVPI)完全信息期望价值
Posterior probability后验概率
Bayesian updating贝叶斯更新
Utility效用
Certainty equivalent确定等价额
Monte Carlo simulation蒙特卡洛仿真