Building AI Products & WorkflowsPrototyping and build vs buy · Lesson 5 of 18

Build vs buy (and blend)

Article · 12 min · 9 min lecture

Video lecture

Build vs buy (and blend)

15 chapters · about 9 min · full transcript

Coming soon

Chapter 1 of 15

Build, buy or blend

  • Four paths
  • Decision criteria
  • Hidden costs
  • Vendor bake-off

The narrated lecture is in production

Every chapter is scripted and ready. Browse the chapters and read the full transcript now — the video will appear here when it’s published.

Chapters

The options

For most AI features, there are four broad paths:

  1. Use AI features inside tools you already have. Many office suites, CRMs, help desks and analytics platforms now include AI features.
  2. Buy a specialised AI product. Vertical tools for specific jobs (contract review, support automation, meeting notes, sales intelligence).
  3. Build on model APIs or platforms. Your team combines model APIs, retrieval, tools and your own interface or workflow.
  4. Blend. Buy the commodity parts, build the differentiating parts, connect them with integrations (including open standards such as MCP).

Decision criteria

QuestionLeans buyLeans build
Is this capability a differentiator for us?No, it's table stakesYes, it's core to our value
Does a good product exist for our exact need?YesNo, or poorly fitting
How specific are our data and workflows?StandardHighly specific
Do we have engineering and ML/AI ops capacity?LimitedStrong
Time to value neededWeeksCan invest months
Control over data, models and roadmapVendor terms acceptableNeed full control
Scale and unit economicsLow-medium volumeHigh volume where per-seat pricing is costly

No single row decides; weigh them together.

Hidden costs of building

  • Evaluation, monitoring and maintenance, which continue after launch.
  • Keeping up with model changes and deprecations.
  • Security reviews, access control and compliance work.
  • UX work to make AI outputs usable and trustworthy.
  • On-call ownership when things break.

A useful rule of thumb: the initial prototype is a small fraction of the total cost of ownership.

Hidden costs of buying

  • Integration and data plumbing.
  • Per-seat or per-usage pricing that grows with adoption.
  • Limited customisation; workflows bend to the tool.
  • Vendor risk: roadmap changes, acquisition, shutdown, price increases.
  • Data terms: where data is processed and stored, retention, whether it is used for training.
  • Lock-in: exporting your data, prompts and configurations may be hard.

Evaluating vendors

Treat vendor selection like a benchmark (see evaluation lessons):

  • Test on your data: run your evaluation set through a trial, rather than relying on demos.
  • Security and privacy: certifications, data residency options, retention and training policies, sub-processors, incident history.
  • Controls: admin settings, permissions, audit logs, SSO.
  • Transparency: which underlying models are used, how changes are communicated, evaluation evidence.
  • Commercials: pricing model, caps, exit terms, data export.
  • Fit: integrations with your systems; support in your regions and languages.

Worked example: support automation

A regional e-commerce company compares:

  • Buy: a help desk's built-in AI agent. Fast to launch, good for common intents, limited control over tone and integrations with their custom order system.
  • Build: an assistant on model APIs with retrieval over their help centre and tools for their order system. Full control, requires two engineers plus ongoing ownership.

Evaluation on 200 real tickets shows the built-in agent handles common intents well but struggles with Arabic tone and custom order data. Decision: blend. Use the help desk AI for triage and English FAQs, and build a small service that exposes order data as tools, which the help desk's AI can call (the vendor supports external tool integrations). Differentiating logic stays in-house; commodity parts are bought.

Revisit regularly

The market changes fast. What required building a year ago may now be a feature in your existing tools, and vice versa. Revisit build/buy decisions at contract renewals and major model shifts.

Hands-on: a weighted decision matrix and a vendor bake-off

1. Score the options. Agree weights with stakeholders before scoring, so the matrix is not reverse-engineered to a favourite.

# 1-5 scores per option; weights sum to 1.0
WEIGHTS = {"differentiation_fit": 0.20, "quality_on_our_eval": 0.25, "time_to_value": 0.10,
           "data_control_and_terms": 0.15, "integration_effort": 0.10, "3yr_total_cost": 0.10,
           "vendor_or_team_risk": 0.10}
OPTIONS = {
    "Built-in help-desk AI": {"differentiation_fit": 2, "quality_on_our_eval": 3, "time_to_value": 5,
                               "data_control_and_terms": 3, "integration_effort": 4, "3yr_total_cost": 4, "vendor_or_team_risk": 3},
    "Build on model API":    {"differentiation_fit": 5, "quality_on_our_eval": 4, "time_to_value": 2,
                               "data_control_and_terms": 5, "integration_effort": 2, "3yr_total_cost": 3, "vendor_or_team_risk": 3},
    "Blend (buy + own tools)": {"differentiation_fit": 4, "quality_on_our_eval": 4, "time_to_value": 4,
                               "data_control_and_terms": 4, "integration_effort": 3, "3yr_total_cost": 4, "vendor_or_team_risk": 4},
}
for name, s in sorted(OPTIONS.items(), key=lambda kv: -sum(WEIGHTS[k] * v for k, v in kv[1].items())):
    print(f"{sum(WEIGHTS[k] * v for k, v in s.items()):.2f}  {name}")

The quality row must come from running your own evaluation set, not from demos.

2. Run a vendor bake-off. Ask each shortlisted vendor for a trial or sandbox and run the same 100 to 200 real (appropriately anonymised) cases through each. Record: pass rate on your rubric, failure categories, latency, cost per case at your expected volume, and how easy it was to get outputs into your systems.

3. Send a focused due-diligence questionnaire (copy and adapt):

1. Which underlying models do you use, and how do you notify customers of model changes? Can we pin versions?
2. Is our data used to train or improve any model? Default and contractual position?
3. Retention of inputs, outputs and logs; can we set shorter retention or zero retention?
4. Data residency options (e.g. UK, EU, UAE, KSA) and full sub-processor list.
5. Security certifications and latest independent audit reports; incident history and notification SLA.
6. Admin controls: SSO, roles, audit logs, data export, API access.
7. Integration: APIs, webhooks, MCP support or other open standards for tools and data.
8. Commercials: pricing model, usage caps, overage handling, price-change notice, exit and data export terms.
9. Evidence: evaluation results on tasks like ours; customer references in our sector and region.

Keep the answers with the decision record; you will need them at renewal.

Going further

Design for replaceability: keep prompts, evaluation sets, retrieval indexes and business logic in assets you own, and connect vendors through standard interfaces. This preserves negotiating power and lets you switch components as better options emerge.

Key takeaways

  • Four paths: AI in existing tools, specialised products, building on APIs, or blending.
  • Weigh differentiation, fit, data specificity, team capacity, time to value, control and unit economics.
  • Account for hidden costs on both sides: maintenance and ownership for builds; pricing, lock-in and data terms for buys.
  • Evaluate vendors on your own data and design for replaceability.

Check your understanding

Quick questions to lock in the lesson. They don’t count towards your certificate.

  1. Which factor most strongly favours building?
  2. Which is a hidden cost of building AI features in-house?
  3. What is the most reliable way to evaluate an AI vendor's quality?

Put it into practice

For one use case, fill in the build-vs-buy table with your organisation's answers and recommend build, buy or blend with three reasons.

Enrol for free to save your progress

Reading is always free. Enrol to keep your place, take the final assessment and earn a verifiable certificate.