AI for Data Analysis & Decision MakingCommunicating uncertainty and making decisions · Lesson 16 of 16

Making decisions with AI support

Article · 11 min · 8 min lecture

Video lecture

Making decisions with AI support

15 chapters · about 8 min · full transcript

Coming soon

Chapter 1 of 15

Decision making with AI

  • AI augments; people decide
  • A decision workflow
  • Biases countered and amplified
  • Five frameworks
  • Decision records

The narrated lecture is in production

Every chapter is scripted and ready. Browse the chapters and read the full transcript now — the video will appear here when it’s published.

Chapters

AI supports decisions; people make them

AI can widen your options, stress-test your reasoning, and speed up analysis. It cannot own accountability, fully understand your organization's context and values, or bear the consequences. The goal is augmented judgment: better decisions because AI helped you think, not decisions delegated to a model.

A decision workflow with AI

  1. Frame: the decision, options, criteria and constraints (as in module 2).
  2. Gather evidence: analyzes from earlier modules, with verified numbers.
  3. Generate options: ask AI for alternatives you may not have considered.
  4. Stress-test: premortem, devil's advocate and assumption checks.
  5. Decide: weigh evidence and values; record the reasoning.
  6. Review: after the outcome, compare with expectations and learn.

Useful prompts

Option generation:

We're deciding how to respond to a competitor's 15% price cut in the UAE.
Current options: match, partial match, hold price and add value.
Suggest 4 other options, with the main risk of each.

Premortem:

Imagine it's six months from now and our decision to hold price
failed badly. Write the most plausible story of why it failed,
then list early warning signs we should monitor.

Criteria scoring (with caution):

Score each option 1-5 on: margin impact, customer retention risk,
brand fit, execution effort. Explain every score and flag which
scores rely on assumptions rather than data.

Scoring matrices are useful for structure, but the weights and scores are judgments. Don't let a numeric total disguise subjective inputs.

Biases AI can help counter (and ones it can amplify)

AI can help counter:

  • Confirmation bias: by arguing the other side.
  • Narrow framing: by generating more options.
  • Overconfidence: by listing failure modes.

AI can amplify:

  • Automation bias: trusting outputs because they look authoritative.
  • Anchoring: the first AI suggestion becomes the default.
  • Sycophancy: models may lean toward agreeing with the framing you give them. Ask neutrally, or ask it to argue against your preferred option explicitly.

Match rigor to stakes

Decision typeSuggested rigor
Reversible, low impact (subject line test)Quick analysis, decide, measure
Reversible, higher impact (budget shift)Verified analysis, stress-test, pilot
Hard to reverse, high impact (pricing, market entry)Full verification, multiple perspectives, experiments where possible, documented reasoning

Documenting decisions

A short decision record improves future learning:

Decision: Hold price, add free delivery for orders over 200 AED
Date / owner: 2026-09-25 / Head of E-commerce
Evidence: [links to analysis]; key numbers verified
Alternatives considered: match, partial match, bundle
Key assumptions: competitor cut is temporary; delivery cost per order stays under X
Review date and success metric: 2026-12-15; retention of top-tier customers

AI can draft this from your notes. When you review later, you can see whether the decision failed because of bad reasoning, bad information or bad luck, which are very different lessons.

Accountability and transparency

  • Be transparent with stakeholders about how AI was used in the analysis.
  • For decisions affecting people (hiring, credit, pricing for individuals, performance reviews), be especially careful: fairness, explainability and regulatory requirements apply, and data protection laws in many jurisdictions restrict purely automated decisions with significant effects on individuals. Our Responsible AI course covers this in depth.

Worked example

A regional e-commerce company uses the workflow for the competitor price cut. AI analysis of verified data shows most revenue comes from customers who rarely compare prices; the premortem flags risk among price-sensitive new customers. The team holds price, adds a delivery perk targeted at new customers, sets warning metrics, and documents the decision. Three months later, the review shows retention held; the record also shows that one assumption (delivery cost) was wrong, a lesson for next time.

Decision frameworks worth knowing

FrameworkUse it whenHow AI helps
Reversible vs irreversible ("two-way vs one-way doors")Deciding how much rigor a decision needsClassify options and list what would be hard to undo
Expected valueOptions with estimable outcomes and probabilitiesBuild the table, run sensitivity on the assumptions
Weighted criteria matrixSeveral options, several criteriaDraft criteria and scores with justifications; you set the weights
PremortemBefore committing to a planWrite plausible failure stories and early-warning signals
Decision record + reviewEvery important decisionDraft the record; later compare outcome with expectations

Hands-on: expected value with sensitivity

import pandas as pd

# Illustrative: respond to a competitor price cut
options = pd.DataFrame({
    "option": ["match price", "hold + free delivery", "hold price"],
    "p_keep_share": [0.90, 0.80, 0.55],               # probability we keep target share (judgment)
    "profit_if_keep": [120, 170, 200],                 # AED thousands per quarter
    "profit_if_lose": [60, 50, 40],
})
options["expected_profit"] = (options.p_keep_share * options.profit_if_keep
                              + (1 - options.p_keep_share) * options.profit_if_lose)
print(options.sort_values("expected_profit", ascending=False))

# Sensitivity: how low can p_keep_share fall before "hold + free delivery" stops beating "match price"?
for p in [0.8, 0.7, 0.6, 0.5]:
    ev = p * 170 + (1 - p) * 50
    print(p, round(ev, 1), "beats match" if ev > options.loc[0, "expected_profit"] else "loses to match")

The numbers are judgments, so the value of the exercise is the sensitivity: it shows which assumption the decision hinges on, and therefore what to monitor or test.

Second worked example: a Pakistani SaaS entering the Gulf

A Lahore SaaS company considers opening a Dubai office (hard to reverse) versus hiring a remote Gulf sales lead (easy to reverse). The team classifies the decisions, uses AI to draft a premortem for each, and builds a simple expected-value table with explicit assumptions about win rates. The sensitivity shows the office only pays off if win rates double, which nobody can support with evidence yet. They choose the reversible option, set a six-month review with success metrics, and record the decision.

Next steps

To apply these methods to website and campaign data, take Web Analytics with GA4 (including its BigQuery and AI-assisted analysis module). To measure marketing with consent-aware tracking and conversion APIs, take Privacy-First Measurement. If your decisions involve customer conversations at scale, Voice AI Agents shows how to design and evaluate them.

Going further

Build a lightweight decision log across your team. Over time, reviewing it shows where your forecasts and assumptions tend to be wrong, which is the most valuable dataset for improving judgment.

Key takeaways

  • AI augments judgment; accountability stays with people.
  • Workflow: frame, gather verified evidence, generate options, stress-test, decide, review.
  • Use premortems and devil's advocacy; beware automation bias, anchoring and sycophancy.
  • Match rigor to stakes, document decisions, and take extra care with decisions affecting individuals.

Check your understanding

Quick questions to lock in the lesson. They don’t count towards your certificate.

  1. What is a premortem?
  2. How can you reduce the risk of an AI simply agreeing with your preferred option?
  3. Which decision warrants the most rigor?

Put it into practice

Use the premortem and option-generation prompts on a decision your team faces, then write a decision record with assumptions and a review date.

Enrol for free to save your progress

Reading is always free. Enrol to keep your place, take the final assessment and earn a verifiable certificate.