Value engineering and production architecture for FDEs, applied AI engineers, product teams, and operations leaders
An independent, open-source guide for FDEs and internal applied-AI teams moving a customer or internal workflow from discovery to a measurable, operated outcome.
Use this repository to:
- Find operational work where a software system can create measurable value—and reject weak use cases early.
- Choose the smallest adequate mix of rules, optimization, ML, foundation models, agents, and human review.
- Turn field observations into a clear workflow, architecture, delivery plan, and controlled production service.
- Give operating and engineering teams the evidence, skills, ownership, and operating routines to maintain the result.
Leading an engagement? Begin with the FDE playbooks. Designing one system? Use Start Here. Building with a coding agent? Give it AGENTS.md as its working map.
From a real workflow to a measurable, operated outcome.
A useful demo can call a model and a few tools. A production AI-enabled system must also know who is allowed to act, which information is current, how to handle failure, how to prove that work finished, how much it costs, and how operators can stop or recover it.
In this guide, a production agent is a bounded workflow in which a foundation model makes some decisions, software controls tools and state, and people remain accountable for the outcome. An agent is one component option—not the default answer for every decision.
This repository provides the design sequence, reusable contracts, tests, and operating checks around that system. It does not require a specific model, cloud, or agent framework. It is not a drop-in runtime, a certification, or a substitute for your organization's security and risk review.
Work in this order: outcome → workflow → decision → system → controlled action → accepted result → measured value. Start with the user's operational decision and the economics of an accepted result. Only then choose the software architecture and the smallest adequate intelligence mechanism. The value-engineering guide and intelligence-selection guide are the two starting points for that work.
| If you need to… | Start with | You should leave with… |
|---|---|---|
| Lead an FDE or internal delivery engagement | FDE playbooks | A path from field discovery and value to business-owned production operation |
| Build shared applied-AI capability | FDE and applied AI engineering synthesis | A clear boundary between workflow-specific delivery, reusable product/platform capability, and safe field learning |
| Decide what to build | Discovery and Value and Start Here | An observed workflow, owner, baseline, measurable outcome, verifier, and go/no-go decision |
| Make the value and cost case | Value Engineering and Frugal Architecture | A full-cost, outcome-level case with guardrails, cost ceiling, and stop conditions |
| Choose rules, ML, models, or agents | Software Architecture and Intelligence Selection | The smallest sufficient decision mechanism, fallback, and measurable selection rationale |
| Map a complex system or assess a material change | Evidence Graphs and Change Intelligence | A provenance-aware dependency view and impact review that cannot become a shadow control plane |
| Design a production system | Production Implementation Playbook | A domain model, architecture, behavior bundle, tool and capability contracts, evaluation cases, and threat model |
| Choose an architecture | Blueprint selector | The smallest system shape that fits the workflow and its risks |
| Deliver and transfer a solution | Solution Design and Delivery | A tested vertical slice, adoption evidence, release plan, and business-owned handoff |
| Review an existing AI system | Production, Evaluation, and Governance and release gates | A list of control gaps, required tests, and a release decision |
| Build or repair evaluations | Evaluation Corpus and Review Loops | Repeatable success, failure, and adversarial scenarios |
| Operate or improve a system | Operate and Scale | A service cadence covering outcomes, adoption, reliability, safety, cost, change, and retirement |
| Debug a production failure | Telemetry contract and incident runbook | Evidence for diagnosis, containment, recovery, and a regression case |
| Learn from controlled-write code | Invoice-exception reference | A tested example of approval, authorization, retry safety, and result verification |
| Follow one FDE journey | Shipment-risk triage walkthrough | An illustrative path from discovery and value case through hybrid design, adoption, and service review |
| Understand why guidance exists | Source index and dated research ledger | The evidence, caveats, and review date behind a recommendation |
The repository follows one delivery path. Each stage produces an artifact that the next stage can inspect or test.
flowchart LR
A["Observe the work"] --> B["Charter value and scope"]
B --> C["Select the decision mechanism"]
C --> D["Build one controlled slice"]
D --> E["Prove it with cases and users"]
E --> F["Launch with owners and rollback"]
F --> G["Operate, improve, or retire"]
| Stage | Plain-language question | Main artifact |
|---|---|---|
| Observe | How does the work actually happen, including exceptions and workarounds? | Field-observation log and FDE discovery pack |
| Charter | What narrow decision is worth improving, how will value be measured, and who owns the result? | Workflow charter and value case |
| Plan adoption | How will users test, adopt, support, change, and eventually own the workflow? | Delivery and adoption plan and draft customer handoff |
| Select intelligence | Which decision steps belong in rules, optimization, ML, retrieval, a foundation model, an agent, or human review? | Intelligence-selection record and architecture guide |
| Model the domain | What objects, actions, rules, and sources of truth matter? | Domain model template |
| Map dependencies | Which software and operational relationships need active navigation or material-change review? | System-map manifest and change-impact assessment, only where their maintenance cost is justified |
| Design | Where do deterministic software, optimization, ML, foundation models, tools, and people make decisions? | Agent-system template and architecture decision record |
| Bind behavior | Which exact model route, prompt, harness, context policy, guardrails, and runtime work together? | Behavior-bundle template |
| Bind capabilities | What may each exact capability build read or change, for whom, and under what policy? | Tool contract, capability manifest, and capability supply-chain guide |
| Threat model | How could data, tools, identity, or evaluation be abused? | Threat-model template |
| Prove | Does it succeed, fail safely, and help users on representative work? | Evaluation cases and evaluation report |
| Launch | What compatible release and bounded autonomy are justified, who supports them, and what reverses them? | Solution-release manifest, release gates, and customer handoff |
| Operate | Is it valuable, adopted, reliable, safe, affordable, and supportable? | Production service review, SLO scorecard, and incident runbook |
| Improve or retire | Which field evidence justifies a change, expansion, constraint, or verified shutdown? | Field-learning register, change management, and controlled improvement |
Draft the threat model before the evaluation suite, then refine both together as failure paths become concrete. If the workflow has no measurable outcome or trustworthy verifier, stay in discovery. A more capable model does not repair an undefined task.
The invoice-exception example shows the controlled-write method on a small financial workflow:
- Read an invoice and the current policy.
- Propose a resolution without giving the model authority to commit it.
- Validate the proposal and stage it for approval.
- Bind approval to the exact proposal.
- Recheck permission and the current policy at commit time.
- Make duplicate retries safe.
- Verify the result in the ledger before reporting completion.
It includes machine-readable design files, a behavior bundle, tool and capability contracts, a threat model, executable policy, behavioral tests, adversarial evaluation cases, and a review-only release manifest. It is an in-memory teaching reference, not a deployable production service. Use the checkout validation to run it.
The shipment-risk triage walkthrough is the complementary end-to-end FDE reference. It follows an illustrative customer workflow through discovery, value measurement, intelligence selection, system design, adoption, handoff, and operation. Its compact executable core combines an ML risk score, deterministic routing, optional foundation-model explanation, and human dispatch review—without autonomous shipment intervention.
| Blueprint | Use it when | Typical result |
|---|---|---|
| Bounded retrieval | The path to evidence varies, but the agent only reads and cites information | An evidence-backed answer or escalation |
| Transactional write | The workflow may change a real system and needs policy, approval, duplicate safety, and result verification | A verified write receipt or safe rollback/escalation |
| Event-driven investigation | Work begins from an event, may pause, and must survive restarts | A durable case record with evidence and a terminal state |
| Multi-agent coordinator | Specialists genuinely require different tools, permissions, context, or parallel execution | Scoped worker results merged and verified by a parent workflow |
| Enterprise agent platform | Several governed workflows need shared domain, capability, identity, evaluation, release, and operating services | A reusable control plane with customer-specific solution layers |
| Governed data analysis | Iterative analysis depends on metric semantics, query/code execution, source revisions, and claim-level review | An evidence-linked notebook, report, or decision artifact |
| Controlled improvement | Production signals should become isolated change candidates without giving the agent merge or deployment authority | A replay-tested candidate, independent decision, canary, or rollback |
| Hybrid intelligence system | One workflow needs deliberate rules, optimization, ML, retrieval, foundation-model, and human-review routing | A bounded decision system with route-specific evidence, fallback, and cost controls |
Start with a deterministic workflow when the steps and branches are already known. Use optimization for constrained allocation, classical ML for measured predictions, retrieval for governed evidence, and human review for weakly verifiable or high-stakes judgment. Add an agent only where bounded multi-step judgment is useful. Add multiple agents only when a real permission, context, ownership, or latency boundary justifies the coordination cost.
- A model may propose an action; trusted software must authorize and execute it.
- Keep the acting principal unambiguous: bind interactive work to the current user with agent attribution, and give unattended work its own narrow workload identity.
- Keep credentials behind a trusted tool boundary and restrict where runtime traffic can go.
- Admit tools, MCP servers, skills, CLIs, and code packages by verified publisher, pinned build, digest, authority, assurance, and lifecycle—not by name alone.
- Treat retrieved documents, user input, tool results, and memory as data—not instructions with higher authority.
- A retry of the same business operation must not create a second real-world change.
- After a consequential change, check the system of record before claiming success.
- Limit steps, time, retries, parallel work, and cost; every run needs an explicit stop reason.
- Treat cost as a non-functional requirement: measure full cost per accepted outcome and prefer the smallest mechanism that satisfies the outcome and risk ceiling.
- Keep evaluation data and pass signals outside the agent's control.
- Capture enough evidence to explain, pause, recover, and improve the workflow.
- Pass work between agents or context windows through a typed, expiring, authority-reducing handoff—not a free-form summary.
The machine-readable control catalog contains the repository's engineering baseline, with each requirement mapped to release gates. The evaluation-report and solution-release contracts make the tested claim and compatible release bundle explicit. This is project guidance, not an external compliance standard.
| Path | What it answers |
|---|---|
playbooks/ |
How an FDE or internal delivery team moves from workflow discovery and value to delivery, adoption, handoff, and post-production improvement |
library/ |
Why the design choices matter, what tends to fail, and how to work through a design |
blueprints/ |
Which reference architecture fits the workflow |
templates/ |
Which starter artifacts to adapt and complete for a new system |
controls/ |
Which production requirements and release gates apply |
schemas/ |
What valid machine-readable artifacts look like |
patterns/ |
Which implementation patterns and anti-patterns are cataloged |
examples/ |
How the artifacts and controls work together in executable code |
operations/ |
How to release, observe, recover, change, and measure the system |
research/ |
Which dated sources support changing implementation guidance |
docs/maintainers/ |
How maintainers keep controls, evidence, contracts, navigation, and releases coherent |
catalog.json |
Which governed artifacts have stable IDs, types, paths, and tags |
scripts/ and tests/ |
How repository structure, contracts, and examples are verified |
The production AI-systems mind map shows how customer value, architecture, intelligence selection, context, control, evidence, adoption, and operations depend on one another. The FDE and applied AI engineering synthesis explains how field delivery and internal product/platform engineering share one lifecycle without transferring customer-specific context.
The guide combines practice-informed patterns with technical sources. The foundational source index distinguishes supplied summaries, supplied full text, and directly reviewed references. The dated research ledger covers implementation sources reviewed from 2026-02-07 through 2026-08-07, plus explicitly revalidated foundations, and records caveats alongside portable findings. A separate practitioner-video index records exact talks, chapters, corroboration, and claim limits.
Vendor scale and performance figures remain attributed. Experimental findings remain labeled. Platform behavior changes, so apply the same controls to your own environment and verify claims against current primary documentation before deployment.
Requires Node.js 22 or later.
Review repository code before running it. For an untrusted contribution, use CI or a disposable environment with no credentials or sensitive data; npm test executes repository-controlled code.
npm ci --ignore-scripts
npm test
git diff --checkThe suite checks repository links and anchors, JSON contracts, policy denials, authorization boundaries, duplicate-safe writes, adversarial scenarios, traces, and postcondition verification in the reference environment.
AGENTS.md tells coding agents what is authoritative, how the folders relate, which files to read for each task, and what must pass before a change is complete. catalog.json is the governed-artifact registry; llms.txt is the compact navigation index.
A useful starting prompt is:
Follow AGENTS.md. Help me design a production AI-enabled system for [workflow].
Start by observing and chartering the current work: actor, decision,
inputs, action, owner, baseline, accepted outcome, verifier, adoption path,
and risk ceiling. Compare deterministic, optimization, ML, retrieval,
foundation-model, agent, and human options. Recommend the smallest matching blueprint. Then produce
the required design artifacts, threat model, evaluation cases, release
plan, and operating handoff, citing repository control IDs. Do not begin
implementation while a consequential discovery question is unresolved.
For an implementation or review task, state the target workflow, allowed autonomy, systems in scope, and expected deliverable. The agent can then route itself through the repository instead of loading every document.
Start with CONTRIBUTING.md. Use GitHub Discussions for design questions, Issues for reproducible defects or evidence corrections, and the private vulnerability channel in SECURITY.md for security reports.
Maintained by David Ahmann (LinkedIn), a cloud, data, and AI platform leader with Field CTO experience. This is an independent project; no current or former employer endorsement is implied.
Licensed under Apache-2.0. Citation metadata is in CITATION.cff.