Skip to content

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

8 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

The FDE Guide

Value engineering and production architecture for FDEs, applied AI engineers, product teams, and operations leaders

The FDE Guide: Discover value, design the system, govern decisions, release safely, operate outcomes

An independent, open-source guide for FDEs and internal applied-AI teams moving a customer or internal workflow from discovery to a measurable, operated outcome.

Repository validation License

Use this repository to:

  • Find operational work where a software system can create measurable value—and reject weak use cases early.
  • Choose the smallest adequate mix of rules, optimization, ML, foundation models, agents, and human review.
  • Turn field observations into a clear workflow, architecture, delivery plan, and controlled production service.
  • Give operating and engineering teams the evidence, skills, ownership, and operating routines to maintain the result.

Leading an engagement? Begin with the FDE playbooks. Designing one system? Use Start Here. Building with a coding agent? Give it AGENTS.md as its working map.

The promise

From a real workflow to a measurable, operated outcome.

A useful demo can call a model and a few tools. A production AI-enabled system must also know who is allowed to act, which information is current, how to handle failure, how to prove that work finished, how much it costs, and how operators can stop or recover it.

In this guide, a production agent is a bounded workflow in which a foundation model makes some decisions, software controls tools and state, and people remain accountable for the outcome. An agent is one component option—not the default answer for every decision.

This repository provides the design sequence, reusable contracts, tests, and operating checks around that system. It does not require a specific model, cloud, or agent framework. It is not a drop-in runtime, a certification, or a substitute for your organization's security and risk review.

Value engineering is the spine

Work in this order: outcome → workflow → decision → system → controlled action → accepted result → measured value. Start with the user's operational decision and the economics of an accepted result. Only then choose the software architecture and the smallest adequate intelligence mechanism. The value-engineering guide and intelligence-selection guide are the two starting points for that work.

Find your path

If you need to… Start with You should leave with…
Lead an FDE or internal delivery engagement FDE playbooks A path from field discovery and value to business-owned production operation
Build shared applied-AI capability FDE and applied AI engineering synthesis A clear boundary between workflow-specific delivery, reusable product/platform capability, and safe field learning
Decide what to build Discovery and Value and Start Here An observed workflow, owner, baseline, measurable outcome, verifier, and go/no-go decision
Make the value and cost case Value Engineering and Frugal Architecture A full-cost, outcome-level case with guardrails, cost ceiling, and stop conditions
Choose rules, ML, models, or agents Software Architecture and Intelligence Selection The smallest sufficient decision mechanism, fallback, and measurable selection rationale
Map a complex system or assess a material change Evidence Graphs and Change Intelligence A provenance-aware dependency view and impact review that cannot become a shadow control plane
Design a production system Production Implementation Playbook A domain model, architecture, behavior bundle, tool and capability contracts, evaluation cases, and threat model
Choose an architecture Blueprint selector The smallest system shape that fits the workflow and its risks
Deliver and transfer a solution Solution Design and Delivery A tested vertical slice, adoption evidence, release plan, and business-owned handoff
Review an existing AI system Production, Evaluation, and Governance and release gates A list of control gaps, required tests, and a release decision
Build or repair evaluations Evaluation Corpus and Review Loops Repeatable success, failure, and adversarial scenarios
Operate or improve a system Operate and Scale A service cadence covering outcomes, adoption, reliability, safety, cost, change, and retirement
Debug a production failure Telemetry contract and incident runbook Evidence for diagnosis, containment, recovery, and a regression case
Learn from controlled-write code Invoice-exception reference A tested example of approval, authorization, retry safety, and result verification
Follow one FDE journey Shipment-risk triage walkthrough An illustrative path from discovery and value case through hybrid design, adoption, and service review
Understand why guidance exists Source index and dated research ledger The evidence, caveats, and review date behind a recommendation

From idea to production

The repository follows one delivery path. Each stage produces an artifact that the next stage can inspect or test.

flowchart LR
    A["Observe the work"] --> B["Charter value and scope"]
    B --> C["Select the decision mechanism"]
    C --> D["Build one controlled slice"]
    D --> E["Prove it with cases and users"]
    E --> F["Launch with owners and rollback"]
    F --> G["Operate, improve, or retire"]
Loading
Stage Plain-language question Main artifact
Observe How does the work actually happen, including exceptions and workarounds? Field-observation log and FDE discovery pack
Charter What narrow decision is worth improving, how will value be measured, and who owns the result? Workflow charter and value case
Plan adoption How will users test, adopt, support, change, and eventually own the workflow? Delivery and adoption plan and draft customer handoff
Select intelligence Which decision steps belong in rules, optimization, ML, retrieval, a foundation model, an agent, or human review? Intelligence-selection record and architecture guide
Model the domain What objects, actions, rules, and sources of truth matter? Domain model template
Map dependencies Which software and operational relationships need active navigation or material-change review? System-map manifest and change-impact assessment, only where their maintenance cost is justified
Design Where do deterministic software, optimization, ML, foundation models, tools, and people make decisions? Agent-system template and architecture decision record
Bind behavior Which exact model route, prompt, harness, context policy, guardrails, and runtime work together? Behavior-bundle template
Bind capabilities What may each exact capability build read or change, for whom, and under what policy? Tool contract, capability manifest, and capability supply-chain guide
Threat model How could data, tools, identity, or evaluation be abused? Threat-model template
Prove Does it succeed, fail safely, and help users on representative work? Evaluation cases and evaluation report
Launch What compatible release and bounded autonomy are justified, who supports them, and what reverses them? Solution-release manifest, release gates, and customer handoff
Operate Is it valuable, adopted, reliable, safe, affordable, and supportable? Production service review, SLO scorecard, and incident runbook
Improve or retire Which field evidence justifies a change, expansion, constraint, or verified shutdown? Field-learning register, change management, and controlled improvement

Draft the threat model before the evaluation suite, then refine both together as failure paths become concrete. If the workflow has no measurable outcome or trustworthy verifier, stay in discovery. A more capable model does not repair an undefined task.

Learn from the reference systems

The invoice-exception example shows the controlled-write method on a small financial workflow:

  1. Read an invoice and the current policy.
  2. Propose a resolution without giving the model authority to commit it.
  3. Validate the proposal and stage it for approval.
  4. Bind approval to the exact proposal.
  5. Recheck permission and the current policy at commit time.
  6. Make duplicate retries safe.
  7. Verify the result in the ledger before reporting completion.

It includes machine-readable design files, a behavior bundle, tool and capability contracts, a threat model, executable policy, behavioral tests, adversarial evaluation cases, and a review-only release manifest. It is an in-memory teaching reference, not a deployable production service. Use the checkout validation to run it.

The shipment-risk triage walkthrough is the complementary end-to-end FDE reference. It follows an illustrative customer workflow through discovery, value measurement, intelligence selection, system design, adoption, handoff, and operation. Its compact executable core combines an ML risk score, deterministic routing, optional foundation-model explanation, and human dispatch review—without autonomous shipment intervention.

Choose the smallest system shape

Blueprint Use it when Typical result
Bounded retrieval The path to evidence varies, but the agent only reads and cites information An evidence-backed answer or escalation
Transactional write The workflow may change a real system and needs policy, approval, duplicate safety, and result verification A verified write receipt or safe rollback/escalation
Event-driven investigation Work begins from an event, may pause, and must survive restarts A durable case record with evidence and a terminal state
Multi-agent coordinator Specialists genuinely require different tools, permissions, context, or parallel execution Scoped worker results merged and verified by a parent workflow
Enterprise agent platform Several governed workflows need shared domain, capability, identity, evaluation, release, and operating services A reusable control plane with customer-specific solution layers
Governed data analysis Iterative analysis depends on metric semantics, query/code execution, source revisions, and claim-level review An evidence-linked notebook, report, or decision artifact
Controlled improvement Production signals should become isolated change candidates without giving the agent merge or deployment authority A replay-tested candidate, independent decision, canary, or rollback
Hybrid intelligence system One workflow needs deliberate rules, optimization, ML, retrieval, foundation-model, and human-review routing A bounded decision system with route-specific evidence, fallback, and cost controls

Start with a deterministic workflow when the steps and branches are already known. Use optimization for constrained allocation, classical ML for measured predictions, retrieval for governed evidence, and human review for weakly verifiable or high-stakes judgment. Add an agent only where bounded multi-step judgment is useful. Add multiple agents only when a real permission, context, ownership, or latency boundary justifies the coordination cost.

Production rules in plain language

  • A model may propose an action; trusted software must authorize and execute it.
  • Keep the acting principal unambiguous: bind interactive work to the current user with agent attribution, and give unattended work its own narrow workload identity.
  • Keep credentials behind a trusted tool boundary and restrict where runtime traffic can go.
  • Admit tools, MCP servers, skills, CLIs, and code packages by verified publisher, pinned build, digest, authority, assurance, and lifecycle—not by name alone.
  • Treat retrieved documents, user input, tool results, and memory as data—not instructions with higher authority.
  • A retry of the same business operation must not create a second real-world change.
  • After a consequential change, check the system of record before claiming success.
  • Limit steps, time, retries, parallel work, and cost; every run needs an explicit stop reason.
  • Treat cost as a non-functional requirement: measure full cost per accepted outcome and prefer the smallest mechanism that satisfies the outcome and risk ceiling.
  • Keep evaluation data and pass signals outside the agent's control.
  • Capture enough evidence to explain, pause, recover, and improve the workflow.
  • Pass work between agents or context windows through a typed, expiring, authority-reducing handoff—not a free-form summary.

The machine-readable control catalog contains the repository's engineering baseline, with each requirement mapped to release gates. The evaluation-report and solution-release contracts make the tested claim and compatible release bundle explicit. This is project guidance, not an external compliance standard.

Repository map

Path What it answers
playbooks/ How an FDE or internal delivery team moves from workflow discovery and value to delivery, adoption, handoff, and post-production improvement
library/ Why the design choices matter, what tends to fail, and how to work through a design
blueprints/ Which reference architecture fits the workflow
templates/ Which starter artifacts to adapt and complete for a new system
controls/ Which production requirements and release gates apply
schemas/ What valid machine-readable artifacts look like
patterns/ Which implementation patterns and anti-patterns are cataloged
examples/ How the artifacts and controls work together in executable code
operations/ How to release, observe, recover, change, and measure the system
research/ Which dated sources support changing implementation guidance
docs/maintainers/ How maintainers keep controls, evidence, contracts, navigation, and releases coherent
catalog.json Which governed artifacts have stable IDs, types, paths, and tags
scripts/ and tests/ How repository structure, contracts, and examples are verified

The production AI-systems mind map shows how customer value, architecture, intelligence selection, context, control, evidence, adoption, and operations depend on one another. The FDE and applied AI engineering synthesis explains how field delivery and internal product/platform engineering share one lifecycle without transferring customer-specific context.

Evidence and scope

The guide combines practice-informed patterns with technical sources. The foundational source index distinguishes supplied summaries, supplied full text, and directly reviewed references. The dated research ledger covers implementation sources reviewed from 2026-02-07 through 2026-08-07, plus explicitly revalidated foundations, and records caveats alongside portable findings. A separate practitioner-video index records exact talks, chapters, corroboration, and claim limits.

Vendor scale and performance figures remain attributed. Experimental findings remain labeled. Platform behavior changes, so apply the same controls to your own environment and verify claims against current primary documentation before deployment.

Validate a checkout

Requires Node.js 22 or later.

Review repository code before running it. For an untrusted contribution, use CI or a disposable environment with no credentials or sensitive data; npm test executes repository-controlled code.

npm ci --ignore-scripts
npm test
git diff --check

The suite checks repository links and anchors, JSON contracts, policy denials, authorization boundaries, duplicate-safe writes, adversarial scenarios, traces, and postcondition verification in the reference environment.

Use this repository with a coding agent

AGENTS.md tells coding agents what is authoritative, how the folders relate, which files to read for each task, and what must pass before a change is complete. catalog.json is the governed-artifact registry; llms.txt is the compact navigation index.

A useful starting prompt is:

Follow AGENTS.md. Help me design a production AI-enabled system for [workflow].
Start by observing and chartering the current work: actor, decision,
inputs, action, owner, baseline, accepted outcome, verifier, adoption path,
and risk ceiling. Compare deterministic, optimization, ML, retrieval,
foundation-model, agent, and human options. Recommend the smallest matching blueprint. Then produce
the required design artifacts, threat model, evaluation cases, release
plan, and operating handoff, citing repository control IDs. Do not begin
implementation while a consequential discovery question is unresolved.

For an implementation or review task, state the target workflow, allowed autonomy, systems in scope, and expected deliverable. The agent can then route itself through the repository instead of loading every document.

Contribute

Start with CONTRIBUTING.md. Use GitHub Discussions for design questions, Issues for reproducible defects or evidence corrections, and the private vulnerability channel in SECURITY.md for security reports.

Maintained by David Ahmann (LinkedIn), a cloud, data, and AI platform leader with Field CTO experience. This is an independent project; no current or former employer endorsement is implied.

Licensed under Apache-2.0. Citation metadata is in CITATION.cff.

Releases

Packages

Used by

Contributors

Languages