Decision Making under Uncertainty and Simulation
7.1 Foundations of Decision Analysis: The Goferbroke Company Problem
Managers often decide in uncertain environments. This section establishes a shared language: alternatives, states of nature, prior probabilities and payoff tables.
Four Typical Decision Problems
| Situation | What is uncertain? |
|---|---|
| A manufacturer launches a new product | How will consumers respond? What production scale is appropriate? Should a test launch be run? |
| A financial institution invests in securities | Which sectors and assets have the best prospects? How will macro conditions and interest rates evolve? |
| A government contractor bids for a new project | What will actual cost be? Who will compete, and what will they bid? |
| An oil company decides whether to drill | Does the field contain oil? How much? Should geological testing be done first? |
Case: The Goferbroke Company
- A company is considering oil-well development in an unexplored area. Geological consultants report that the site has a probability of 1/4 of containing oil.
- Drilling and exploration would cost about USD 100,000; if oil is found, estimated net proceeds are about USD 800,000.
- Another oil company offers USD 90,000 to acquire the site.
The Payoff Table and Five Key Terms
| Alternative | Oil | Dry |
|---|---|---|
| Drill for oil | 700 | −100 |
| Sell the land | 90 | 90 |
| Prior probability | 0.25 | 0.75 |
Units: USD thousands.
- Decision maker the person or team responsible for the decision.
- Alternative the available choices (here, drill or sell).
- State of nature a condition determined by uncontrolled random factors (oil or dry).
- Prior probability an initial estimate of how likely each state is.
- Payoff the outcome from combining one alternative with one state, quantified in money.
Which Alternative Does Each Criterion Recommend?
Using the original data (drilling: 700 if oil / −100 if dry; selling: 90 / 90; prior probability of oil 0.25), determine the recommendation from each criterion.
7.2 Decision Criteria and Decision Trees
How the Four Criteria Work
| Criterion | What it focuses on | Method |
|---|---|---|
| Maximax criterion | The best outcome only | Take each row maximum, then choose the largest |
| Maximin criterion | The worst outcome only | Take each row minimum, then choose the largest |
| Maximum-likelihood criterion | The most probable state | Identify the most likely state, then choose the alternative with the highest payoff in that state |
| Bayes criterion (EMV) | Weight by prior probabilities | Compute EMV = Σ payoff × probability for each alternative and choose the maximum |
No criterion is inherently “right”—each represents a different risk attitude. Management often uses EMV because it incorporates probabilities, but EMV assumes risk neutrality, an assumption challenged in Section 7.4.
Decision Trees
A decision tree shows the sequence of decisions and random events graphically and applies the Bayes criterion:Square nodes are decision nodes, with branches for alternatives;circular nodes are event nodes, with branches for possible states.
Expected Value of Perfect Information (EVPI)
Suppose the true state could be known before deciding: drill if oil (700), sell if dry (90), giving expected payoff 0.25×700 + 0.75×90 = 242.5. This exceeds the no-information EMV of 100 by 142.5. The difference is the expected value of perfect information—an upper bound on the value of any information.
7.3 Bayesian Updating: Seismic Testing and Posterior Probabilities
Prior probabilities are often subjective and approximate. A company can pay for tests or research to update them more accurately; the updated probabilities are posterior probabilities.
Case: Seismic Testing at Goferbroke
The company can pay USD 30,000 for detailed seismic testing to improve its estimate of the probability of oil. The test has two results:FSS(favourable, indicating a higher chance of oil) and USS(unfavourable, indicating a low chance).
| State of nature | P(result | state): FSS | USS |
|---|---|---|
| Oil | P(FSS|Oil) = 0.6 | P(USS|Oil) = 0.4 |
| Dry | P(FSS|Dry) = 0.2 | P(USS|Dry) = 0.8 |
Posterior probability: P(state | result) = P(state and result) ÷ P(result)
| Combination | Prior × conditional probability | Joint probability | Marginal probability | Posterior probability |
|---|---|---|---|---|
| Oil + FSS | 0.25 × 0.6 | 0.15 | P(FSS) = 0.15 + 0.15 = 0.3 | 0.15 ÷ 0.3 = 0.5 |
| Dry + FSS | 0.75 × 0.2 | 0.15 | 0.15 ÷ 0.3 = 0.5 | |
| Oil + USS | 0.25 × 0.4 | 0.10 | P(USS) = 0.10 + 0.60 = 0.7 | 0.10 ÷ 0.7 ≈ 0.143 |
| Dry + USS | 0.75 × 0.8 | 0.60 | 0.60 ÷ 0.7 ≈ 0.857 |
Calculate the Posterior Probabilities
Using the original data (prior 0.25, P(FSS | Oil) = 0.6 and P(FSS | Dry) = 0.2), complete three values (three decimals).
Is the Test Worth Buying?
The test costs USD 30,000. Enter expected payoff including the test, EVSI and net value after cost (USD thousands).
7.4 Utility and Risk: Why People Reject Higher-Expected-Value Gambles
So far we have assumed that expected monetary value is the correct decision criterion. This assumption fails in many settings. Choose between:
A: Take a gamble
A 50% chance of winning USD 100,000 and a 50% chance of receiving nothing. Expected value: USD 50,000.
B: Guaranteed receipt
Receive USD 40,000 for certain.
Most people choose B even though A has a higher expected value. The reason is risk aversion a utility function translates monetary amounts into a scale that reflects subjective preference.
- If two alternatives have equal expected utility the decision maker is indifferent between them.
- When decisions use utility, the Bayes criterion substitutes utility for monetary payoffs.
- The decision that maximises expected utility is optimal.
The Equivalent-Lottery Method
- Set U(maximum payoff) = 1 and U(minimum payoff) = 0.
- To determine the utility of an intermediate payoff M, offer two alternatives: A₁ gives the maximum with probability p and the minimum with probability 1−p; A₂ gives M for certain.
- Ask: for what p are you indifferent? Then U(M) = p.
For the Goferbroke problem, Max’s indifference probabilities correspond to the following table (USD thousands):
| M | −130 | −100 | 60 | 90 | 670 | 700 |
|---|---|---|---|---|---|---|
| U(M) | 0.00 | 0.05 | 0.30 | 0.33 | 0.97 | 1.00 |
Notice the curve: utility rises quickly from −130 to 90 and barely changes from 670 to 700.This is what risk aversion looks like.
Risk and Utility
Evaluate the following four statements.
7.5 Monte Carlo Simulation: Turning Uncertainty into Distributions
Decision trees handle only a few discrete states. Real uncertainty is often continuous—sales, price and cost are all examples. Use simulation: represent every uncertain quantity with a distribution and sample thousands of times to see the distribution of outcomes.
Case: Annual Profit from a New Product Launch
Core Simulation Ideas: Why Repeated Sampling Produces an Answer
Monte Carlo simulation does not solve a closed-form equation. It assigns a probability distribution to each uncertainty, repeatedly samples a set of values and calculates one outcome, and approximates the outcome distribution through thousands of repetitions. It is named after the casinos of Monaco because it relies on random sampling.
It works because of the law of large numbers: with enough repetitions, the sample average converges toward the true average. This is the same idea from earlier units—one draw is random, but the average of many draws is stable.
- Define the distributions: each uncertain quantity needs a distribution and parameters supported by historical data, industry experience or expert judgement.
- Draw one sample: sample one value for each uncertainty, substitute them into the model and calculate one outcome—a single “trial.”
- Repeat thousands of times: repeat step 2 N times to obtain N outcomes.
- Summarise the distribution: characterise the N outcomes with means, standard deviations, percentiles and probabilities.
How to read the results. A single average is insufficient; examine at least four things together:
- Mean: the expected profit—but it hides volatility.
- Standard deviation: the size of fluctuations. If it exceeds the mean, outcomes are highly unstable.
- Loss probability(or probability of missing any target): the share of outcomes below zero, directly corresponding to the managerial question “could we lose money?”
- Percentiles: worst 5% and best 5% outcomes, describing tail risk and upside.
Inspect the histogram shape as well: two peaks often indicate two distinct situations (for example, “demand takes off” and “demand fails”), making a single average less meaningful.
| Comparison | Decision Trees | Monte Carlo simulation |
|---|---|---|
| Uncertainty handled | A few discrete states | Continuous variables, potentially many at once |
| Method | Weight by probability and calculate expected value exactly | Repeatedly sample to approximate the distribution |
| Questions answered | Expected payoff and value of information (EVPI/EVSI) | Outcome distribution, loss probability and worst cases |
| Main risk | Misestimated states and probabilities | Unsupported distributions and parameters, or too few trials |
How many runs are needed? Around 1,000 runs are usually enough to reveal the distribution’s general shape; use several thousand when tail conclusions such as the worst 5% matter. More runs stabilise results, but improvement diminishes beyond a point.
Case: Annual Profit from a New Product Launch
| Uncertain quantity | Distribution | Mean | Standard deviation |
|---|---|---|---|
| Annual sales (units) | Normal distribution | 10,000 | 2,000 |
| Unit price (CNY) | Normal distribution | 50 | 5 |
| Unit cost (CNY) | Normal distribution | 30 | 3 |
| Fixed cost (CNY) | Fixed value | 180,000 | — |
How to Do It in Excel
| Step | How to Do It in Excel | How AI can help |
|---|---|---|
| Define uncertain quantities | Specify each distribution and its parameters | List uncertainties and reasonable ranges |
| Sample | =NORM.INV(RAND(), mean, standard_deviation) | Write formulas; you verify parameters |
| Repeat calculations | Fill the formula down 1,000 rows | Suggest trial count and random seed |
| Summarise results | Use AVERAGE, STDEV, PERCENTILE and COUNTIF | Explain percentiles and probabilities |
| Interpret conclusions | Examine loss probability and worst cases | Remind you not to rely only on the mean |
Interpret the Simulation Results
Evaluate the following four statements.
7.6 The Value of AI Information: Using EVSI to Decide Whether to Buy
Treat an AI forecast as additional information: it can improve accuracy, but is usually imperfect and costly. EVSI determines the maximum value of that information.
- Estimate AI accuracy and error patterns: how often is it correct, and how does it fail (false dry or false oil)?
- Use EVSI to calculate the upper bound on information value: EVSI = expected payoff with information − expected payoff without information.
- Compare with cost: if cost exceeds EVSI, the information is not worth relying on; if cost is below EVSI, it is worth buying.
This is one of the unit’s most practical management conclusions:calculate the value of information before deciding whether to buy it. For the seismic test above, EVSI is 53 (USD thousands), cost is 30 and net value is 23—worth doing.
7.7 Summary and Assignment
- Three tools for decisions under uncertainty:decision criteria, decision trees and expected value.
- New information can update probabilities through Bayes’ theorem, but it has a price: compare EVSI with cost.
- Monte Carlo simulation turns distributions into observable outcomes.
- Means can mislead: loss probability and worst-case outcomes matter too.
- Utility functions explain why people reject gambles with higher expected value.
Appendix: Interactive Demonstrations and Classroom Exercises
| Location | Type | Content |
|---|---|---|
| 7.1 | Demonstration | Four Decision-Criteria Workbench |
| 7.2 | Demonstration | Decision tree and EMV (adjustable prior) |
| 7.3 | Demonstration | Bayesian-updating calculator and EVSI |
| 7.4 | Demonstration | Utility Curves and Certainty Equivalents |
| 7.5 | Demonstration | 1,000-trial Monte Carlo simulation |
| 7.1 | Exercise | Which Alternative Does Each Criterion Recommend? |
| 7.3 | Exercise | Calculate the Posterior Probabilities |
| 7.3 | Exercise | Is the Test Worth Buying? |
| 7.4 | Exercise | Risk and Utility |
| 7.5 | Exercise | Interpret the Simulation Results |
Data source: payoff table, test conditional probabilities and simulation parameters from 单元7_决策与仿真练习.xlsx; every expected value, posterior, EVSI and simulation result is calculated on the page.
Unit Glossary (English–Chinese)
| English | 中文 |
|---|---|
| State of nature | 自然状态 |
| Prior probability | 先验概率 |
| Payoff | 收益 |
| Expected monetary value (EMV) | 期望货币值 |
| Expected value of perfect information (EVPI) | 完全信息期望价值 |
| Posterior probability | 后验概率 |
| Bayesian updating | 贝叶斯更新 |
| Utility | 效用 |
| Certainty equivalent | 确定等价额 |
| Monte Carlo simulation | 蒙特卡洛仿真 |