The CRAFT Framework: Orchestrating Agentic Flow
-
- The one idea: Traditional teams optimise the output (features). CRAFT teams optimise the system that produces the output: the agent harness. Humans define the boundaries; AI accelerates the execution.
- 4 roles: Forward Deployed Engineer (owns Blueprints; gathers field signal & builds with agents, tests included) · Harness Engineer (optimises & independently verifies the system) · Product Strategist (prioritises, sequences, owns pace & Release Waves) · Flow Orchestrator (adoption, platform, cost, communication). Strategist & Orchestrator are usually shared across teams.
- 3 artifacts: Blueprint (one unit of work) · Core Craft (shared agent rules, ≤200 lines) · Local Craft (personal agent rules). Validated learnings are promoted upward.
- The cadence: Continuous flow in Micro-Cycles (3–7 days) → one CRAFT Evolution per cycle (harden the system) → monthly CRAFT Calibration (people & sustainability). No standups, no sprints.
- 2 gates: Gate 1: automated tests/scans + independent human review. Gate 2: async business verification by the Strategist. Nothing ships without both.
- Ship in waves: Features release in curated Release Waves with an observation window; users absorb change without being flooded.
Generative AI changes how software creates value. Traditional agile frameworks rely on heavy, synchronous human alignment to push work through a pipeline; CRAFT is built for the era of AI. It is a lightweight, asynchronous method for managing context, setting firm risk boundaries, and orchestrating AI agents to build high-quality software fast.
The Core Philosophy
Generative AI has enormous execution speed but no built-in direction or business context. CRAFT rests on one premise: humans define the boundaries; AI accelerates the execution. Rather than timeboxed sprints that cap velocity, CRAFT teams work in continuous flow. Asynchronous communication, automated state tracking, and disciplined instruction management remove the bottlenecks of legacy development.
This flow rests on three foundational pillars. Note: Security and Sustainability are not separate pillars; they are constraints embedded in all three.
- People: Human intent cannot be automated. People move from writing boilerplate to defining business value, setting risk boundaries, and orchestrating AI behaviour. Adoption and team health are actively managed to prevent burnout at speed.
- Processes: Continuous, asynchronous workflows replace synchronous ceremonies. The process feeds the AI exact context just in time and verifies output without stalling developer momentum.
- Technology: The execution engine: the AI models, MCP servers, CI/CD pipelines, Platform Engineering paved roads, observability, and the live cockpit that make the framework’s speed possible.
The Always-On Principle. Traditional teams create value only while humans are at their desks. CRAFT rejects that limit: AI agents have no working hours, and run around the clock when properly instructed. Treat every off-hours window (evenings, weekends, holidays) as execution capacity. The human role shifts from constant supervision to asynchronous orchestration: prepare the work, dispatch the agent, step away, then return to review results and clear HITL checkpoints. (More in the Always-On Execution note below.)
System Over Output. Traditional teams are measured on output: features shipped, tickets closed, pull requests merged. CRAFT changes what the team is accountable for. Its real job is to build and continuously harden the system that produces the output, not to produce it by hand. That system is the harness: the instructions, context, tools, guardrails, tests, and observability that turn a raw model into a reliable engineer. Build the harness well and quality and speed improve on their own, without adding people. Let it drift, through context rot, schema misalignment, or instruction bloat, and the output drifts with it, however hard anyone works. For anyone arriving from a traditional engineering background, this is the mental shift: you are no longer judged mainly on what you shipped this week, but on whether the system you steward is smarter, faster, and more reliable than it was last Micro-Cycle.
The Leadership Contract
CRAFT teams move fast because they have autonomy, and that autonomy has to be granted and protected by leadership. The research is blunt: 70–88% of digital transformations fail on leadership misalignment, not technology (BCG; Bain 2024). Gartner projects that organisations prioritising executive AI literacy will see 20% higher financial performance by 2027. CRAFT handles this with a short, two-way contract.
What leadership must provide:
- Trust asynchronous execution. The State of the Craft cockpit is your status report, and it is always live. All requests flow through the Flow Orchestrator, never directly to engineers.
- Protect the team from organisational antibodies. SAFe ceremonies, cross-department steering committees, and “quick check-in” meetings will try to re-impose synchronous overhead. The executive sponsor shields the team from them.
- Shift the budget model. CRAFT teams need fewer people but more infrastructure: model API budget, MCP access, premium tooling. Approve these as operating spend, not project-by-project procurement.
- Resist the headcount reflex. When you need more velocity, invest in better tooling and Core Craft quality, not more people. Adding headcount to a CRAFT team rarely helps and often hurts.
What leadership receives in return:
- Six numbers that matter (detailed in the Measuring Success section): Blueprint Cycle Time, Gate 1 First-Pass Rate, Effort Weight Accuracy, HITL Frequency Rate, API Cost per Blueprint, and Calibration Health Score. They answer three questions: How fast are we shipping? Can we trust our forecasts? Is this sustainable?
- A Monthly Business Review (30 min) replacing steering committees: metrics, outcomes delivered, and strategic redirect. No slide decks, no demos of half-finished work.
- A Quarterly Strategy Alignment (90 min) replacing PI Planning: leadership sets direction (“what business problems to solve”), the team decides how.
- A Quarterly Business Value Report connecting CRAFT metrics to business outcomes: value delivered, efficiency gains, risk posture, sustainability health, and forward forecast.
Leadership sets direction and removes barriers; the team decides how to execute and delivers measurable outcomes. Anything outside these channels (ad-hoc status requests, direct messages to FDEs, surprise steering committees) is an anti-pattern that degrades the system it means to help.
The CRAFT Ecosystem: Core Roles & Boundaries
In an agentic workflow, people are not managed as resources; they are empowered as the “expert in the lead.” By handing repetitive execution to the AI, team members step fully into their domain expertise. A CRAFT team is a small, cross-functional unit of specialized focus areas.
Team shape and size. Because Generative AI is a force multiplier, CRAFT teams stay exceptionally lean, typically 2 to 4 people and often fewer. The building is done by one or more Forward Deployed Engineers, paired with a Harness Engineer who owns independent verification and the health of the system. A typical shape is one Harness Engineer to one to three FDEs, a ratio that works because verification is automated: one person can be the independent verifier and harness owner for several builders when Gate 1 does the heavy lifting. As agents take on more of the execution and verification load, expect this number to shrink, not grow; adding people when you need velocity is an anti-pattern (see the Leadership Contract).
Staffing for stand-by duty is the one legitimate reason to add people. CRAFT’s always-on model means agents, and the incidents they can trigger, run off-hours, so any team with an on-call rotation needs enough people to cover it without burning anyone out. A two-person team on a 24/7 rotation is a sustainability failure the Calibration exists to catch. Note the reason this is allowed: it is coverage-driven, not velocity-driven. Adding people to ship faster is still an anti-pattern; adding people, or pooling the rotation across several teams, so the stand-by load stays humane is fine. If a Harness Engineer becomes a review bottleneck as throughput grows, the first fix is more automation in the harness, not another Harness Engineer.
Which roles are shared, which are embedded. Not every role maps one-to-one to a single team. The Product Strategist and Flow Orchestrator are genuinely multi-team: one Strategist can sequence and prioritize across several teams, and one Orchestrator serves one to several teams as the connective tissue between them, the organisation, and the wider platform ecosystem. The Harness Engineer leans embedded instead, because independent verification and daily harness tuning depend on proximity to the team’s Blueprints; only the deepest specialist layers (enterprise AppSec, shared eval and platform infrastructure) sit above the team as a shared capability. In large enterprises those deep experts, such as AppSec engineers and central Platform Engineering teams, act as a Shared Service across many CRAFT teams, because with AI they can build rules, components, and infrastructure fast enough to support the whole portfolio. This is a structural principle, not cost-cutting: teams stay lean because shared expertise scales across the portfolio rather than being duplicated in every team.
Small-team role flexibility. In small or early-stage teams, one person may hold more than one role, most often combining the FDE and Harness Engineer. This is allowed. What is never allowed, at any size, is reducing the harness and QA accountability itself. A two-person team applies the same adversarial verification, the same Gate 1 automation, and the same HITL checkpoints as a twenty-person team. The team is smaller; the bar is identical. This works because verification is mostly automated (Gate 1 runs the same pipeline whether one person or ten triggered it), so team size does not set verification rigor; harness configuration does. What does take discipline is the human judgment layer: when one person builds and reviews, they must force a context switch. Finish the build. Close the builder mindset. Reopen the work as the Harness Engineer with one question: “How would I break this, and what did the agent get wrong?” Blending both into one unchecked pass defeats the boundary. In regulated enterprises, separation of duties may be legally required regardless of team size; check your compliance requirements before combining roles.
Looking ahead: role boundaries in a more agentic world. Today CRAFT enforces role separation through human discipline: the Strategist decides what, the FDE builds how, the Harness Engineer verifies whether it is safe and optimal. As agents get more capable, this discipline-based model will be tested. Agents already draft Blueprints from call transcripts (see Agent-Initiated Blueprints), run their own risk analyses, and execute code, blurring who initiates what. Before long, a single agent system may cover work that today spans the Strategist, FDE, and Harness Engineer at once. CRAFT answers this with one principle: the origin of work may be automated, but the verification of work must stay structurally separated. Concretely: (1) Core Craft permissions must enforce which agents can propose versus approve; the agent that drafts a Blueprint must never be the instance that approves its risk analysis or signs off Gate 2. (2) As autonomous workflows grow, the Flow Orchestrator keeps an Agent Capability Registry, a living inventory of which agents do what, with boundaries that stop any single agent from spanning the full propose–build–verify chain without a human or independent-agent checkpoint. (3) HITL thresholds become more important, not less, as agents improve. The temptation to raise them (“it’s right 95% of the time, skip the review”) must be resisted until governance agents can provide equivalent adversarial verification. The gates and checkpoints are not overhead to optimise away; they are the structural guarantee that speed does not outrun accountability.
-
Goal: Maximise business value across one or more CRAFT teams by deciding what to build, in what order, at what pace, and what not to build. The Strategist usually does not originate Blueprints; they build on the FDE’s work. The FDE owns the Blueprint: they gather feedback and requests from the field (customers, users, internal teams) and craft the Blueprint from that signal. The Strategist then optimises it, sharpening the business Why, deciding priority and pace, and sequencing it into Release Waves, so raw field signal becomes a prioritized, unambiguous specification that points the AI engine in the right direction. The Blueprint stays with the FDE; the Strategist owns the decision of what to do with it. Because the Strategist works at portfolio level rather than inside one team’s daily execution, a single Strategist can serve several CRAFT teams at once, giving consistent ROI sequencing and cross-team prioritization that individual teams cannot maintain alone.
Why this role exists separately from the FDE: FDEs are the team’s eyes and ears in the field. They embed with users, surface missing features, validate outcomes, and can draft the initial spec. So why a separate Strategist? Four structural reasons:
- Helicopter view vs. field view: An FDE embedded with users naturally grows attached to their domain’s problems. If the person who builds also decides what comes next, they will unconsciously favour what is in front of them over what delivers the most value across the whole product. The Strategist holds the cross-product, cross-segment view an embedded engineer cannot.
- Pace and sequencing ownership: With AI agents an FDE can ship a feature in a day. Without someone curating which features ship when (bundling Release Waves, allocating Hardening Blueprints, managing how much change users can absorb), the product drowns its users. Enterprises are already asking AI-accelerated teams to slow down because the UI changes every week. The Strategist owns the rhythm of delivery, not just the features.
- Forecasting as a dedicated function: Constantly weighing “Feature A or Feature B next, given AI-calculated effort against business value?” needs sustained attention. An FDE deep in execution and user work has no bandwidth to run Agentic Forecasting across the full backlog. That is the Strategist’s core loop.
- Verification independence: The Strategist owns Gate 2 (business verification in staging). If the FDE both builds and verifies business value, the independent check disappears. The Strategist asks “did we solve the right problem?”; the FDE stays accountable for “did we solve it correctly?”
In short: the FDE surfaces the signal and owns the Blueprint (the business What and the technical How); the Strategist refines the business Why and owns prioritization, sequencing, and pace.
Role Includes (In Scope):
- Steering product vision, defining business logic, and advocating for user needs.
- Refining, prioritizing, and sequencing Blueprints, which the FDE typically drafts from field signal (see Blueprint CRAFTing, Step 1). The Strategist sharpens the business Why, sets priority and pace, and places each Blueprint in the right Release Wave. When an initiative comes from product vision rather than the field, the Strategist writes the business What and Why and hands the draft to the FDE for the technical layer. Blueprints are never created in isolation from field reality.
- Using Agentic Forecasting to prioritize Blueprints by business value against AI-calculated effort.
- Allocating roughly 10–15% of Blueprint throughput each Micro-Cycle to Hardening Blueprints: work with no new user-facing functionality, dedicated to refactoring, test coverage, observability gaps, or architectural cleanup. AI-generated code accrues technical debt faster than human-written code and compounds into fragility if ignored. This allocation is a non-negotiable product investment the Strategist owns like any other capacity decision.
- Synthesising the user feedback and field signal the FDE surfaces into prioritization decisions: what to act on, what to defer, what to deliberately ignore.
- Curating Release Wave composition and timing so users can absorb changes without being overwhelmed.
- Verifying finished, agent-built features in staging on their own schedule (Gate 2: independent business verification).
Role Excludes (Out of Scope):
- Acting as the sole owner or dictator of the product; success is a shared team accountability.
- Writing technical AI prompts or managing the AI’s coding execution.
- Gathering user requirements in isolation. The FDE is the primary interface with users and the field; the Strategist synthesises and prioritizes that signal rather than replacing it.
Preferred Strategist stances: A strong Strategist works from several modes. As a Visionary, they set a clear direction that aligns the team around what could be. As a Customer Representative, they work alongside the FDE (the team’s field-facing interface) to stay close to real user pain and gain, combining the FDE’s ground-level insight with their own stakeholder work and turning it into Blueprint priorities. As a Decision Maker, they keep decisions fast, delegating where they can and making the call themselves when speed demands it; every day a decision sits unmade, the AI engine idles. As an Experimenter, they treat each Blueprint as a hypothesis, with the desired outcome as the prediction and staging as the test, which keeps the product in intentional, evidence-driven evolution rather than treating shipped features as permanent. As an Influencer, they build stakeholder alignment around the product vision and the AI-first model so the business never surprises the team with shifting priorities mid-execution.
Strategist anti-patterns to avoid: The Clerk adds everything requested to the backlog without prioritizing or defending the vision, flooding the AI engine with low-value work. The Story Writer buries themselves in ticket templates and acceptance-criteria grooming instead of engaging stakeholders and reading real-world signal, producing Blueprints that pass the template check but lack business context, so the AI builds the wrong thing precisely. The Gatekeeper becomes an execution bottleneck, demanding sign-off at every stage or going missing during staging verification, which contradicts CRAFT’s asynchronous-first principle and recreates the coordination overhead the framework exists to remove.
-
Goal: Build, tune, and continuously improve the agent harness: the runtime infrastructure that determines how well AI agents execute, how efficiently they use resources, and how reliably they produce good output. The Harness Engineer is a system builder, not primarily a gatekeeper. Their core accountability is to make the team’s agentic environment progressively smarter, faster, and cheaper to run. QA and security governance are not separate functions here; they are applied through the lens of harness optimization: every security guardrail is a harness constraint, every QA gate a harness checkpoint, every test a harness signal that feeds back into improvement. Note: in enterprises this role is often shared across several CRAFT teams. An embedded Harness Engineer handles daily Blueprint-level tuning, while shared AppSec and Platform Engineering experts enforce enterprise-wide standards across the portfolio.
Why it is important: Research puts about 65% of enterprise AI failures down to harness defects, mainly context drift, schema misalignment, and state degradation. Generative AI takes the path of least resistance within whatever harness it runs in: a poorly configured harness produces consistently poor output; a well-tuned one produces consistently excellent output at lower token cost and with fewer HITL interruptions. The Harness Engineer is the team’s main lever for compounding output quality over time without adding headcount. They turn FDE field feedback into harness improvements: when an FDE surfaces a recurring hallucination or an inefficient pattern, the Harness Engineer adjusts the harness (Core Craft rules, context loading, agent permissions, or token budgets) so it does not recur. The agentic risk surface is broader than traditional development: agents access enterprise systems under service identities, pull potentially sensitive data into context, and make autonomous tool calls that can change infrastructure. The Harness Engineer governs all of it, not just the code output but the agent behaviour, execution efficiency, and governance boundaries that produce it.
The harness has two halves, guides and sensors. Guides (feedforward controls) steer the agent before it acts: Core Craft rules, context loading instructions, permission scopes, and HITL thresholds that raise the odds of a correct first attempt. Sensors (feedback controls) observe after it acts: automated tests, linters, type checkers, SAST/DAST scans, golden-trajectory comparisons, and observability signals that catch what the guides missed and feed the correction back in. The Harness Engineer builds, tunes, and owns both. Every escaped defect is treated as a missing or weak sensor: the job is to ask “what in our harness should have caught this?” and strengthen the guide or sensor so that class of defect cannot escape again.
Why this role exists separately from the FDE: Both are engineers, and both touch the harness, so why separate them? Three structural reasons:
- The builder must not be the sole verifier. When the person who builds a feature is also the only one who verifies it, intent errors and blind spots survive, because they verify against the same mental model that produced the mistake. CRAFT already applies this to business value (the Strategist, not the FDE, owns Gate 2). The Harness Engineer applies it to technical and system correctness: they own the independent verification harness (acceptance criteria, golden trajectories, adversarial tests, the human side of Gate 1) that the FDE’s build must pass. The FDE builds the tests into the software; the Harness Engineer defines and owns the independent bar those tests, and the agent that wrote them, must clear.
- System focus vs. output focus. An FDE deep in field work and execution optimises for shipping the right feature fast. Improving the system that produces every feature (token efficiency, context hygiene, eval coverage, permission scoping, governance) is a separate discipline that needs sustained, cross-Blueprint attention the FDE cannot give while heads-down building. That is the Harness Engineer’s core loop.
- Learning is centralised, not siloed. FDEs each discover failures in their own Local Craft. Someone has to sit above the individual Blueprints, spot the patterns across all of them, and decide what becomes a permanent harness rule. The Harness Engineer is that convergence point, turning scattered field failures into systemic hardening.
In small teams the FDE and Harness Engineer may be one person (see Small Team Note), but even then the two mindsets stay separate: build, then switch hats and verify as an adversary. What is never collapsed is the accountability.
“If FDEs harden the system too, what is left for the Harness Engineer?” A fair question, and the answer is not “writing harness rules,” because that is deliberately distributed to every FDE through the Local → Core Craft Promotion Loop. Three things remain that a builder cannot do well while shipping. (1) Independent verification. The builder cannot be the sole verifier, and with AI this matters more, not less: AI-written code and AI-written tests share the same blind spots, AI mistakes look intentional (well-formatted, plausibly named) so human review misses them, and teams shipping with AI merge far more pull requests carrying materially more defects. Someone independent must be the “requirement guardian” who checks intent, not just output. (2) Curative, whole-system ownership. FDEs improve the harness reactively, in the direction of their current Blueprint; someone must keep the sum of all those promotions coherent: pruning and deduplicating rules, holding the Core Craft under its line budget, owning the eval suite and cost optimization across every Blueprint. Without it you get the “Core Craft becomes a dumping ground” failure. (3) Specialist depth in security, evals, and agent governance that most FDEs neither have nor should context-switch into mid-build. In short: FDEs harden locally and reactively; the Harness Engineer verifies independently and hardens systemically. The overlap is real and healthy; the boundary is accountability, not a wall.
Role Includes (In Scope):
- Independent Verification & Eval Ownership: Owning the verification harness every Blueprint must clear: the binary acceptance criteria, the golden-trajectory library (recorded known-good execution traces), the failure-mode trajectory library (recorded known-good rejections), and the adversarial/negative-path coverage. The Harness Engineer is the independent technical verifier: FDEs build tests into the software, while the Harness Engineer defines what “verified” means, maintains the evals that detect agent regression, and does the human side of Gate 1 review for work they did not build. When a defect escapes to staging or production, they run the root-cause analysis and turn the finding into a new guide or sensor (the “learn what went wrong, harden the system” loop). These live as the eval suite, a durable, version-controlled artifact rather than ad-hoc checks. Evals run offline in CI on full agent trajectories: was the right tool chosen, were the arguments valid, was the step count and cost reasonable, did it comply with policy, not merely “did the final output look right.” CRAFT applies an eval-to-guardrail lifecycle: once an offline eval reliably catches a failure class, it is promoted into a runtime guardrail (a Core Craft rule or a guardrail agent) so the harness blocks that failure in flight, not just in review, the same bottom-up hardening as the Promotion Loop applied to verification.
- Harness Configuration & Token Optimization: Designing, configuring, and continuously tuning the execution harness (Core Craft rules, context loading constraints, token budgets, tool permissions, HITL thresholds) to maximise output quality while minimising token cost and execution time. The Harness Engineer tracks cost-per-Blueprint and drives it down Micro-Cycle over Micro-Cycle. Progressive disclosure of context (exposing only what the agent needs for the current sub-task) is the main lever, with disclosure patterns defined per Blueprint type in the Core Craft.
- FDE Feedback Loop: Being the primary receiver of FDE field observations. When an FDE surfaces a hallucination, an inefficient pattern, or an execution failure during the Micro-Cycle, the Harness Engineer turns it into a concrete harness change (a new Core Craft rule, a refined context loading instruction, a tightened HITL threshold) before the next Micro-Cycle. This loop is how the CRAFT system compounds quality over time.
- Blueprint Risk Analysis: Running rapid Product Risk Analyses (PRA) and threat modeling on new Blueprints before development starts. Rate each risk by likelihood and impact, and flag which need a HITL checkpoint.
- Harness Guardrail Definition: Defining and maintaining the security rules, coding standards, and quality constraints in the Core Craft, treated as absolute law by all agents. As new vulnerabilities or anti-patterns surface (pipeline scans, external CVEs, agent hallucinations), the Harness Engineer updates the Core Craft immediately.
- Automated Test & Acceptance Criteria: Turning acceptance scenarios into binary pass/fail criteria and setting the exact coverage thresholds the pipeline must enforce before any deployment.
- AI-Specific Security: Identifying and mitigating risks unique to GenAI workflows: prompt injection, sensitive-data leakage through context windows, model-output manipulation, insecure MCP tool permissions, and unauthorized code execution via agents.
- Agent Identity & Access Management (IAM): Every agent that touches enterprise systems runs under a dedicated service identity with the minimum permissions its task needs, never a human developer’s credentials. This is non-negotiable in regulated enterprises and required for SOC2 and ISO 27001 audit trails. Scope service accounts to the Blueprint’s actual needs: a Blueprint spanning frontend, API, and database legitimately needs all three. The principle is least privilege for the task at hand, not blanket restrictions that make the FDE fight the tooling. In local development (local database, local services, sandboxed infrastructure) broad access is expected and practical; restricting it artificially slows work for no real security gain. Scoping discipline becomes critical for shared, staging, and production environments, where over-permissioning is real risk. All agent actions (file reads, API calls, database queries, shell commands) are logged to an immutable audit trail. The Harness Engineer defines the permission model in the Core Craft security rules and reviews it at every CRAFT Evolution so permissions still match real Blueprint patterns and have not drifted toward over-permissioning.
- Data Classification & Context Privacy: Agents routinely touch codebases, config, API responses, and database records that may hold PII, trade secrets, credentials, or other sensitive data. Before any data enters an agent’s context, the Harness Engineer checks that the classification is compatible with the AI provider’s data-handling terms (for example, whether the API retains training data), that sensitive fields are masked or excluded when not needed, and that data-residency requirements are met (some regulated industries require data to stay in specific regions, which can rule out certain cloud AI APIs entirely). The Blueprint’s Context Loading Instructions are the main control point, reviewed for classification compliance during the PRA, not after deployment.
- Agentic Chain Verification (Skill → MCP Server → Tool): In agentic workflows the visible UI is no longer the primary surface; the AI environment is. A user gives an intent, a Skill turns it into a specific tool call, an MCP Server connects to the external tool and executes, and the result flows back. Each layer has its own behaviour and failure modes, so testing must cover all three independently and their integration: (1) Skill behaviour, does the Workflow or Skill translate intent into the right tool calls with the right parameters, and pick the right tool when several exist? (2) MCP Server contract, does it handle errors, timeouts, and unexpected responses gracefully, and validate inputs and sanitise outputs before they re-enter context? (3) Chain integration, does the full end-to-end run produce correct, verifiable results, and when one layer fails silently, does the agent detect it or hallucinate success? Traditional tests built for screens and predictable flows do not cover this. The Harness Engineer defines automated chain-level tests, including fault injection at each layer boundary, as part of acceptance criteria whenever a Blueprint involves MCP servers or Skill-based automation.
- Continuous Pipeline Monitoring: Reviewing SAST/DAST results, dependency alerts, and security test failures on the cockpit each Micro-Cycle. On a critical finding, they update the Core Craft guardrail immediately and trigger a Flow Sync if it blocks active work.
- Post-Deployment Validation: Periodically checking production observability (logs, traces, anomaly alerts) to confirm shipped features behave as expected on security and quality. Any regression becomes a new Blueprint or Core Craft update.
- Agentic Governance, Agents Monitoring Agents: As workflows scale, humans cannot inspect every agent action in real time. The Harness Engineer defines and deploys governance agents whose only job is to monitor, audit, and constrain other agents. Three patterns: Critic agents review agent outputs (code, config, data transformations) against Core Craft rules before they reach Gate 1, catching policy violations, architectural drift, or security anti-patterns faster than humans. Guardrail agents enforce hard boundaries in real time during execution, blocking forbidden operations (writing to production databases, hitting restricted APIs, exceeding token budgets) before they complete. Compliance agents watch behaviour logs against regulatory and organisational policy, flagging anomalies and producing audit-ready reports without manual log review. These are defined in the Core Craft, versioned like any infrastructure, and reviewed at every CRAFT Evolution. The Harness Engineer owns their configuration and effectiveness. One hard constraint: governance agents advise and block; they never override human HITL decisions or approve deployments. Human accountability stays absolute.
- Compliance & Audit Readiness: In regulated environments, keeping security controls, test evidence, and risk assessments in a form that satisfies audit, including a traceable link between Blueprint risk decisions and deployed code. Regulatory context is regional: CRAFT is globally applicable and prescribes no specific regulatory mappings. Obligations vary by country, region, industry, and product type. Common considerations include documentation of AI usage and human oversight (EU AI Act, ISO/IEC 42001, and national equivalents), audit trails for AI-generated code in production (SOC2, ISO 27001), data minimisation when feeding context (GDPR, CCPA, PDPA, and equivalents), and industry controls for healthcare (HIPAA, MDR), financial services (PCI-DSS, SOX, MiFID II), and government. The Harness Engineer maps CRAFT’s structural controls (gate documentation, HITL checkpoints, Blueprint audit trail) to the team’s regulatory environment, validated with legal and compliance before the first production deployment. Audit Bundle (regulated teams): where formal audit applies, the Harness Engineer compiles a structured Audit Evidence Bundle per Blueprint after Gate 1 passes. The raw material already exists: the PRA and threat model, the acceptance criteria, Gate 1 results (pass/fail with timestamps), SAST/DAST output, HITL decision-log entries, and any FDE decision-log entries. An AI agent assembles these into a named, version-controlled document (for example
audit-evidence.md) linked fromplanning.md, generated once per Blueprint and stored with the code. This turns existing artifacts into audit-ready documentation without a separate workflow. - Agent Context Supply Chain Security: In agentic workflows, file presence equals execution: the moment an instruction file, skill, or agent config exists in the repo, agents ingest and act on it. There is no separate “install” step a human reviews first, which collapses install → review → execute into one event and makes the context supply chain a different security surface from code dependencies. The Harness Engineer ensures that all external context artifacts (shared skills, community agent configs, MCP definitions from registries) are reviewed before entering the repo, that no instruction file arrives by direct push (everything goes through the same PR review as the Core Craft), that the pipeline scans for hidden Unicode (tag characters, bidirectional overrides, variation selectors) that is invisible in editors but can alter behaviour, and that transitive MCP access from third-party context packages is audited and allow-listed. Treat the prompt supply chain with the rigour of the code supply chain: compromised context is harder to spot than compromised code, because it produces plausible, confident, subtly wrong output rather than crashes.
Role Excludes (Out of Scope):
- Writing line-by-line manual test cases or forcing rigid Test-Driven Development (TDD) loops that throttle AI speed; automation handles this.
- Standing in as the release gatekeeper who personally approves every deploy. The automated pipeline is the gate, and the Harness Engineer’s job is to build and improve it, not stand in it.
- Owning the product backlog or Blueprint prioritization; that stays with the Product Strategist.
-
Goal: Work at the intersection of the field and the agentic build environment: gather real-world intelligence from users, then use it to build better applications through the AI execution engine. The FDE has two equally important accountabilities. (1) Field intelligence: embedding with users, surfacing what is broken, missing, or misunderstood, and feeding that signal back into the Blueprint pipeline. (2) Agentic execution: turning Blueprints into fully working, secure, observable features by orchestrating AI agents rather than writing boilerplate by hand. Neither is optional. An FDE who only builds is a traditional developer with AI tools; an FDE who only gathers insight is a consultant. The CRAFT FDE does both, and that combination is what makes the role valuable on an agentic team. “Users” means whoever the product serves: external customers, internal business teams, partner integrations, or platform consumers. Proximity can range from daily on-site embedding to asynchronous feedback loops, depending on the product and organisation.
Why it is important: The FDE is the bridge between the real world and the agentic build environment. AI agents execute at extraordinary speed, but only in the direction they are pointed. Without constant ground-level intelligence about what users actually need, that speed goes the wrong way. The FDE makes sure the team builds the right thing at speed, not just a working thing. Those field insights also feed the Harness Engineer: recurring user pain points reveal where the harness is producing weak output, and the Harness Engineer uses that signal to improve the system. How teams organise the experience-design layer, whether inside the FDE role or as a shared capability, is left to their discretion.
Role Includes (In Scope):
- Defining the technical How during Blueprinting (architecture, database schema, required MCP servers).
- Owning the full build: backend logic, API integrations, data pipelines, and the UI/experience layer, assembling from coded design systems or building them when none exist.
- Building tests into the software: Every Blueprint ships with its automated tests. Unit, integration, and end-to-end coverage is generated and maintained by the agent as part of the build, not bolted on afterward: the code and the tests that prove it works are committed together. The FDE writes the tests into the codebase; the Harness Engineer defines the independent bar those tests (and the agent that wrote them) must clear, and verifies work the FDE did not build. A harness can only catch regressions in software that is testable by design.
- Embedding with users or customer teams to understand real workflows, constraints, and requirements, as a field-level technical expert.
- Surfacing missing features, usability gaps, and adoption blockers found through direct user interaction, and feeding them to the Product Strategist for prioritization.
- Setting the technical HITL thresholds for the AI (for example, requiring permission before running terminal commands or modifying databases). HITL ownership is shared: the Harness Engineer sets the risk-driven mandatory checkpoints during the Product Risk Analysis (any Critical-rated risk forces a stop), while the FDE adds the operational, execution-level checkpoints their agent needs to run safely. Where they overlap, the stricter one wins.
- Workflow Creation: Building and testing local GenAI workflows or prompt chains in their tooling to automate repetitive tasks.
- Observability & GreenOps: Making sure the AI bakes in deep observability (logs, metrics, traces) and writing token-efficient prompts to avoid compute waste.
- Continuously updating their Local Craft (
dev-instructions.md) to record and correct recurring agent hallucinations. - Rule File & Memory Management: Knowing how their AI tool’s rule-file system works: directory structures, activation modes (always-on, file-pattern, model-decided, manual), precedence, and auto-generated memory. The FDE maps Core Craft rules to the tool’s native format, sets the right activation mode for each file, and makes sure no critical project knowledge stays trapped in ephemeral, machine-local memory instead of version-controlled rule files.
- Off-Hours Agent Orchestration: Before ending a session, the FDE dispatches agent tasks that can run autonomously overnight: Blueprints with low HITL needs, or batch work like test generation, documentation, refactoring, and dependency updates, with the cockpit set to capture progress and flag issues for review. Off-hours execution is a core FDE discipline, not an afterthought.
Role Excludes (Out of Scope):
- Manually typing extensive boilerplate.
- Deciding feature priority or owning the product backlog; that stays with the Product Strategist.
- Managing overall API budgets or acting as the primary infrastructure builder.
The FDE Execution Loop (what a day actually looks like): Once a Blueprint is fully formed (Strategist, Harness Engineer, and FDE sections complete), the loop is the same across Blueprints:
- Load context: Open the Blueprint’s
planning.md, the Core Craft, and relevant Local Craft rules, and start the agent session. If the Blueprint specifies Context Loading Instructions, apply them: load only the listed files and exclude the rest. - Delegate and monitor: Prompt the agent with the Blueprint and let it run. The FDE does not watch every line; they watch the cockpit for HITL halts, unexpected-behaviour flags, and loop-detection alerts, and work on other tasks or the next Blueprint’s FDE section meanwhile.
- Handle HITL checkpoints: When the agent asks for approval, the FDE reviews the action, approves or rejects it with a short reason, and the agent continues. Most Blueprints need 1–3 HITL interactions. If a checkpoint exposes an ambiguity, the FDE edits
planning.mdin place and tells the agent to re-read it. - Update Local Craft: After the agent finishes, the FDE reviews any hallucinations, odd decisions, or weak patterns and logs each one briefly in
dev-instructions.mdbefore doing anything else. This step is not optional; the system depends on it. - Push and open PR: The FDE or agent pushes the branch and opens a Pull Request, triggering Gate 1 (automated checks and AI-assisted review, then human approval). The FDE does not wait; failures and review notes arrive asynchronously.
- End-of-session dispatch: Before closing the session, the FDE queues work that needs zero or minimal HITL: test generation, refactoring, documentation, dependency audits, or well-scoped feature Blueprints. They load the context, start the agent, and step away while the cockpit captures activity and any halts.
- Morning review: On returning, the FDE first reviews the cockpit for overnight activity: completed tasks, pending HITL approvals, failed runs, and new PRs. Pending checkpoints are cleared immediately, completed work enters Gate 1, and failed runs are diagnosed and logged in the Local Craft before any new work starts. This review-first habit turns off-hours execution into shipped value rather than a queue of unreviewed artifacts.
-
Goal: Ensure CRAFT adoption expands correctly within the organisation’s norms, the platform grows in the right direction, and the team stays in flow. The Flow Orchestrator owns five linked mandates: correct adoption of CRAFT within the organisation’s boundaries and culture (Adoption); securing the technical “paved road” and growing the platform sustainably within governance standards (Platform); acting as the team’s single voice to leadership and stakeholders (External Communication); governing the team’s AI model usage, cost, and sustainability footprint (Model & Cost Governance); and scouting better tools and practices from other teams and the wider ecosystem, then bringing them back to accelerate the team (Intelligence). A Flow Orchestrator typically serves one to several CRAFT teams at once, acting as the connective tissue between teams, the organisation, and the broader agentic ecosystem.
Why it is important: AI development moves faster than corporate bureaucracy. Without active guidance, teams adopt AI in ways that clash with governance, blow past infrastructure budgets, duplicate what other teams have already solved, or drift from CRAFT under delivery pressure. The Flow Orchestrator is the platform advocate, adoption guardian, resource governor, external communicator, modern CRAFT Coach, and the organisation’s intelligence relay. Remove the role and five things break at once: the team slides back into legacy Agile habits with no one coaching it forward (Adoption); it loses access to infrastructure it needs (Platform); FDEs get pulled into status meetings and stakeholder requests that wreck deep-work focus (Communication); model costs drift up with no one tracking which Blueprints are expensive and why (Governance); and breakthroughs from other teams never reach the teams that need them (Intelligence). When every CRAFT team is generating new Skills and workflows, no team should reinvent what another has already solved, and getting good ideas across team boundaries fast is the Orchestrator’s job.
The multi-stance model: The Flow Orchestrator shifts between six stances depending on what the team needs: Teacher (explaining CRAFT through directed discovery, teaching the purpose of the framework, not just its mechanics); Impediment Remover (clearing friction, which evolves over time from early adoption confusion, to tooling issues, to deep structural blockers as the team matures); Coach (asking the right question at the right moment so the team develops its own solutions, rather than becoming the answer machine); Mentor (drawing on direct CRAFT and AI experience to guide individuals through challenges coaching alone cannot resolve); Facilitator (making work transparent and turning observations into concrete adaptations within the team, across teams, and across the organisation); and Change Agent (moving the wider organisation toward an environment where AI-accelerated teams can thrive, knowing when to disrupt and when to be careful).
Under all six stances sits one constant attitude: servant leadership. The Orchestrator leads by removing obstacles, raising others’ effectiveness, and protecting the conditions that let humans and agents work in continuous flow, not by authority or task assignment. They help others be effective rather than drawing attention to themselves. Servant leadership is not one of the stances; it is the operating system they all run on.
Role Includes (In Scope):
- People & Adoption Coaching: Championing CRAFT internally, coaching the team away from legacy Agile habits, and spotting when individuals are struggling with the pace or the tooling.
- Platform Engineering Alignment: Ensuring the team has smooth access to the infrastructure it needs (MCP servers, AI toolsets, CI/CD, shared GenAI workflows). Rather than building the platform, they orchestrate these needs with central Platform Engineering teams, or help the FDEs implement them.
- Cross-Team Skills & Process Scouting: Watching what other CRAFT teams build, especially new AI Skills, MCP servers, GenAI workflows, and prompt patterns. When another team has solved a relevant problem, the Orchestrator brings it back immediately, preventing duplicate effort and speeding the team’s growth. Across multiple teams this is formalized as the Orchestrator Sync (see CRAFT at Scale).
- Compute & Carbon Governance (Sustainability): Monitoring API usage, setting hard stops on looping agents to prevent budget burn, and tracking the team’s compute footprint.
- Resolving ad-hoc blockers on the spot during Flow Syncs to keep developers moving.
- Communicating to the organisation: The Orchestrator is the primary interface between the team and the wider organisation. Progress updates, timeline estimates, and capacity views go through them, not to individual FDEs. They translate the cockpit and Blueprint status into business language non-technical audiences can act on, protecting the team’s focus while giving the organisation a reliable view of output and direction.
Sustainability note: The Orchestrator’s own workload is reviewed at every CRAFT Calibration. If they are consistently overloaded, the team redistributes platform or technical-governance tasks to FDEs. The coaching and communication mandates cannot be delegated; infrastructure and model-governance tasks can.
Role Excludes (Out of Scope):
- Manually scripting or building the enterprise platform infrastructure.
- Acting as a traditional people manager or assigning daily tasks.
Roles within CRAFT
The CRAFT Engine: Executing Agentic Flow
CRAFT drops traditional sprint ceremonies. The workflow runs as continuous, asynchronous phases called Micro-Cycles (typically 3 to 7 days), built to keep the pipeline fed and the AI executing. Each phase has a clear owner, a concrete output, and an explicit handoff, so everyone knows what to do and when.
What is a Micro-Cycle? A Micro-Cycle is a team-level cadence period, not a per-Blueprint sprint. Blueprints start and finish continuously within and across Micro-Cycles; no sprint boundary freezes the backlog or batches work artificially. The boundary exists for one thing only: to trigger the CRAFT Evolution meeting, the team’s heartbeat for system hardening. The team sets the duration in its Team Agreement and shows it on the cockpit. It should track the rhythm at which meaningful agent learnings accumulate, not a fixed calendar slot. This is a team process decision, not an AI agent instruction, so it does not belong in the Core Craft.
Note: this section covers the workflow phases and how the team operates. The artifacts that power them, the Blueprint, Core Craft, and Local Craft, are defined in the Knowledge Threads section below. Read both together for the full picture.
Note: all meeting timeboxes here are baselines. Because CRAFT runs fast and evolves continuously, teams should adjust these durations when different constraints serve them better.
Blueprint CRAFTing (asynchronous, no meeting): the FDE (drafts and owns), the Product Strategist (prioritizes and sequences), and the Harness Engineer (sets risk and verification boundaries) each contribute directly in the artifact.
Flow Sync (ad-hoc, ≤15 min): only the people whose input the blocker needs, never the whole team by default. The Flow Orchestrator is usually involved, since they own the closing call-to-action.
CRAFT Evolution (per Micro-Cycle, system hardening): core attendees are all FDEs and the Harness Engineer; the Flow Orchestrator facilitates; the Product Strategist joins only for the forecasting and prioritization part.
CRAFT Calibration (monthly, people and sustainability): the delivery team (FDEs and Harness Engineer) with the Flow Orchestrator facilitating. The Product Strategist is optional, since this event is about team health, not product.
Monthly Business Review / Quarterly Strategy Alignment (Leadership Contract): the Product Strategist and Flow Orchestrator with leadership; FDEs and the Harness Engineer are not pulled in.
A shared Strategist or Orchestrator attends the events of the teams they serve, not one merged session across all of them.
1. Blueprint CRAFTing & Agentic Forecasting (Async & Ongoing)
A Blueprint is the single source of truth for a unit of work. It is not a traditional requirements document; it is a machine-readable, AI-executable specification that holds everything the agent needs to act and everything the team needs to verify the outcome. Blueprints are created continuously; there is no “sprint planning” gate. As soon as a Blueprint is fully formed and forecasted, an FDE can start executing it.
Scope. A Blueprint covers the complete scope of a unit of work, from UI changes and API logic down to database schema updates. Its boundary is a coherent business outcome, not a technical layer. For very large features that genuinely need multiple sequential Blueprints (for example, the data model must ship before the API can be built), group them under a Blueprint Epic: a lightweight parent record that links dependent Blueprints in order and makes the sequence explicit in the backlog. An Epic is not a planning ceremony, just a named sequence.
Backlog vs. the cockpit. How the team manages its Blueprint backlog is its own choice. Some teams keep Blueprints as markdown files in the repo (managed via a backlog.md); others use a board tool. The framework mandates no tool; pick whatever the team will actually use and maintain. What matters is one source of truth for the Blueprint queue. The State of the Craft cockpit is not the backlog; it shows only real-time operational state (what is executing, blocked, or staged for verification). Backlog management and prioritization happen outside the cockpit.
Agent-initiated Blueprints. The steps below describe the human-led flow, but Blueprints need not start with a human. As agents mature, they can initiate Blueprints by observing real-world signals. During a user call, a transcription agent can listen live, extract pain points, feature requests, and usage patterns, and draft a structured Blueprint proposal before the call ends. Observability agents can turn recurring error patterns into Hotfix Blueprint drafts; support-ticket agents can cluster complaints into one feature Blueprint; telemetry agents can spot performance bottlenecks and propose Hardening Blueprints. The originating role stops mattering; what matters is that every agent-initiated Blueprint enters the same CRAFT pipeline as a human-initiated one. Specifically: (1) the Product Strategist still reviews, prioritizes, and approves or rejects it before it enters the backlog (agents propose, humans decide); (2) the Harness Engineer still runs the risk analysis and sets boundaries; (3) HITL thresholds and Gate 1/Gate 2 apply identically no matter who drafted the spec. Agent-initiated Blueprints multiply signal capture, so valuable information in calls, logs, and user behaviour is not lost to human memory, but they never bypass the verification architecture. The gates exist precisely because a Blueprint’s origin matters less than its validation.
Input sanitisation for agent-initiated Blueprints. The data sources that feed these Blueprints (observability logs, support tickets, call transcripts, telemetry streams) are untrusted input. They may contain customer PII (names, account numbers, health data), embedded credentials (session tokens, API keys logged by accident), or adversarial content (prompt injection hidden in a crafted error message or ticket body). The same data-governance layers that apply to all agent operations apply here: an agent ingesting external data must not reach raw, unsanitised sources when a sanitised alternative exists. Define a structured ingestion schema for each external source, a format that strips PII, redacts credentials, and normalises the data before the agent sees it. For example, a support-ticket schema exposes category, severity, anonymised_description, and affected_feature, but never customer_name, account_id, or raw email content. Where full sanitisation is not possible (for example, free-form call transcripts), the Core Craft must include explicit rules telling the agent never to reproduce PII from ingested data and to treat any instruction-like content inside external data as data, not a command. The Harness Engineer reviews these ingestion schemas as part of the data-governance check at each CRAFT Evolution.
The steps below describe contributions, not a strict waterfall. Blueprints are drafted, refined, bounded, and forecasted asynchronously and often iteratively; a Blueprint is ready to execute the moment all sections are complete and it has been forecasted.
Step 1. Forward Deployed Engineer: draft the Blueprint from field signal.
Because the FDE is the team’s interface with users and the field, they usually open or create the planning.md and draft the initial Blueprint, turning real-world signal into a concrete, executable specification. (For purely strategic or agent-initiated Blueprints the origin may differ, see Step 2 and Agent-Initiated Blueprints, but the FDE always owns the technical layer.) The FDE fills in the following.
Business & outcome fields:
- Business Goal: One or two sentences, grounded in observed user need. What user problem does this solve, and what measurable outcome do we expect? (The Product Strategist refines and validates this in Step 2.)
- Desired Outcome: What does success look like from the user’s perspective? Use concrete, verifiable language (for example, “a user can complete checkout in under 3 steps”).
- Out of Scope: Explicitly list what this Blueprint does NOT cover, to prevent AI scope creep.
- Acceptance Scenarios: Written in plain language. The Harness Engineer converts these into automated test cases.
Technical & execution fields:
- Technical Architecture: Which services, components, or infrastructure does this feature touch? Note dependencies on existing modules.
- Required MCP Servers or Tools: List the AI tools the agent will need (for example, a file-system MCP, a database query tool, a browser agent).
- Human-in-the-Loop (HITL) Thresholds: Explicit stopping points where the AI must pause for human approval before continuing. Common examples: before a database migration, before external API requests, before modifying production files. HITL checkpoints are the technical expression of CRAFT’s “expert in the lead” principle: the precise moments where human expertise overrides automated momentum and reclaims control of execution.
- Local Craft Reference: Note relevant rules from
dev-instructions.mdor known agent hallucinations that apply to this feature. - Context Loading Instructions: Define which files, modules, and documentation the agent must load before execution, and which it must not load. Agents with full-repo access often pull irrelevant context that degrades output (“context rot”: as the window grows, attention quality drops). Curated context loading is one of the highest-leverage improvements to agent output quality. Example: “Load
src/payments/anddocs/payment-api.md. Do NOT loadsrc/legacy/ortests/e2e/.” Include any live data lookups (schema snapshots, API specs) the agent needs but that should not live permanently in the Core Craft. - Agent Execution Constraints (Loop Detection): Hard guardrails for this Blueprint’s execution: maximum tool calls before an automatic HITL halt (25–50 for typical feature Blueprints), maximum wall-clock time before auto-halt (30–60 minutes), and a maximum token-spend threshold that triggers an automatic pause and a cost-overrun alert to the Flow Orchestrator. These override the global Core Craft limits for this Blueprint only; with no Blueprint-specific values, the agent runs on the global defaults. Runaway agents are both a budget risk and a trust risk: teams that have watched an agent silently spend 10× the expected cost on one Blueprint rarely trust agentic execution again without discipline here.
- Depends On (Optional): If this Blueprint cannot run until another is deployed, list its ID or title. The Blueprint is marked blocked until its dependency completes, which stops FDEs building on infrastructure that does not yet exist in production.
Off-hours execution readiness. Evaluate every Blueprint for off-hours executability during Blueprinting. The FDE tags one of three levels: (a) fully autonomous, the agent can finish with no HITL interaction, fit for overnight or weekend dispatch; (b) low-touch, 1–2 HITL checkpoints that can be batched and cleared in one review the next morning; (c) high-touch, needs continuous human steering during working hours. Levels (a) and (b) are prime end-of-session dispatch candidates. Teams that only ever produce (c) Blueprints should revisit their Blueprinting discipline; vague specs and missing context are the main reasons an agent cannot run autonomously. Blueprints designated as (a) or (b) can be automatically queued and picked up by agents in a pipeline that aligns with the Product Strategist's needs (and release strategy).
Step 2. Product Strategist: prioritize, sequence, and optimize.
The Strategist does not usually author the draft; their accountability is to decide whether, when, and in what order the Blueprint is built, and to sharpen its business value. Working with the FDE, the Strategist:
- Refines the Business Goal and Why, making sure the Blueprint targets a genuine, high-value user problem, not just the pain most visible to one embedded FDE.
- Assigns priority using business value against the AI-calculated Effort Weight (from Step 4), and finalises the Blueprint’s place in the backlog.
- Owns sequencing and pace: places the Blueprint in the right Release Wave and manages user absorption so the product is not flooded with changes.
- Works with the FDE to tighten ambiguous specs before execution; a vague Desired Outcome or fuzzy scope is fixed here, not discovered at Gate 2.
For strategic Blueprints that come from product vision rather than the field, the Strategist writes the business What and Why and hands the draft to the FDE for the technical layer.
Step 3. Harness Engineer: set risk and verification boundaries.
Asynchronously, the Harness Engineer reviews the Blueprint and adds the following into planning.md:
- Product Risk Analysis (PRA): A rapid assessment of what could go wrong. Rate each risk by likelihood and impact on this baseline matrix: Critical (high likelihood × high impact), mandatory HITL checkpoint and Harness Engineer sign-off before execution; High (high impact or high likelihood), HITL checkpoint strongly recommended plus a targeted automated scan; Medium, automated scan only; Low, log and monitor. Risk scores are recorded in the Blueprint and shown on the cockpit.
- Threat Model: Identify attack surfaces the feature introduces (new API endpoint, file upload, user-data access) and define the mitigation that must be implemented.
- Automated Test Constraints: Define the exact test coverage the pipeline must pass before deployment. These are non-negotiable gates, not suggestions.
- Acceptance Criteria & Verification Harness: Translate the acceptance scenarios into binary pass/fail criteria that the pipeline and the Strategist can verify independently, and specify any golden-trajectory or adversarial coverage the Blueprint needs.
The FDE builds the tests into the software during execution (Step 1’s architecture made it testable); the Harness Engineer defines the independent bar those tests must clear.
Technical revision note: the FDE’s technical contributions (architecture, MCP servers, HITL thresholds, context loading, execution constraints) live in Step 1. If the Harness Engineer’s risk boundaries require a change to the technical approach, for example adding a HITL checkpoint the PRA flagged as mandatory, the FDE updates the relevant fields before execution.
Step 4. AI Agent: Agentic Forecasting.
Once the Blueprint is complete (the FDE’s draft and technical layer, the Strategist’s prioritization, and the Harness Engineer’s risk and verification boundaries all in place), an AI agent runs an automated analysis:
- It reads the Blueprint against the global Core Craft (architecture constraints, coding standards, security rules).
- It cross-references historical team throughput and codebase complexity metrics.
- It outputs an Effort Weight, a normalized score (not story points) for relative execution complexity.
- The Product Strategist uses the Effort Weight alongside business value to calculate ROI and place the Blueprint in the prioritized backlog. The highest-value, lowest-effort Blueprints execute first.
Why this matters for CRAFT: Traditional requirements gathering loses fidelity at every handoff: user words become notes, notes become tickets, tickets become specs, specs become code. Each translation step introduces drift. Live user verification collapses this chain: the user sees a working representation of their request within minutes and can correct misunderstandings instantly. The FDE validates what to build with the user in real time, and the Product Strategist gets a Blueprint proposal that has already been visually confirmed by the person who requested it.
Critical caveat: The prototype generated during the call is a validation artifact, not a production deliverable. It proves that the team understood the requirement correctly, nothing more. The output still enters the full CRAFT pipeline: the Product Strategist reviews and prioritizes it, the Harness Engineer conducts the risk analysis and sets boundaries, the FDE adds the technical layer with proper HITL thresholds, and Gate 1 and Gate 2 verification apply in full. Security, quality, and architectural standards are never bypassed because a user saw a demo during a call. The prototype accelerates understanding; CRAFT governs the implementation.
Blueprint Definition of Done
A Blueprint is only considered done when all of the following are true. This checklist can be embedded in planning.md so the AI agent can self-verify before marking the Blueprint complete:
- Gate 1 passed: All automated acceptance criteria tests, SAST/DAST scans, and dependency checks passed without manual override.
- Gate 2 passed: The Product Strategist has verified the feature against the business goal and desired outcome in staging.
- Observation window closed cleanly: No regressions, error rate spikes, or security alerts surfaced during the post-deployment observation period.
- Local Craft updated: Any AI hallucinations, HITL halts, or prompt failures encountered during execution are logged in the FDE’s
dev-instructions.md. - Promotable learnings flagged: Any reusable architectural pattern, workflow, or technique worth sharing has been marked for the next Evolution’s Promotion Loop.
- Off-hours execution tag assigned: The Blueprint’s FDE section explicitly tags the work as fully autonomous, low-touch, or high-touch for off-hours execution. This tag is set during Blueprinting and validated after completion; if the actual HITL interaction count deviated significantly from the tag, the FDE logs why in their Local Craft to improve future tagging accuracy.
- Monitoring confirmed: Observability signals (logs, metrics, traces) for the shipped feature are active in the production environment.
- Execution context snapshot logged: The model version, Core Craft version (commit hash), active MCP servers, active skills, and Blueprint version at execution start are recorded alongside the Blueprint’s completion record. This lightweight provenance trail enables the team to answer “what instructions and tooling were active when this Blueprint was built?” without manual Git archaeology. When debugging unexpected agent behaviour or evaluating the impact of a Core Craft change, the snapshot makes it possible to compare execution conditions across Blueprints. The Flow Orchestrator owns the tooling setup that captures this automatically; where there is no automated capture, the FDE logs it manually at execution start. This snapshot is also the basis for attribution (answering “which model, instructions, and tools produced this code?”), a governance capability increasingly expected as AI-generated code reaches production.
- Execution trace posted to the issue: A structured comment is posted to the originating issue or ticket (see Execution Traceability below) so the Harness Engineer and FDE can reconstruct exactly what happened without opening the agent session or digging through Git history.
Execution Traceability: The Issue as the Audit Log
Every CRAFT Blueprint originates from an issue or ticket. That issue is already the natural place to record what happened during execution — not just that it was done, but how it was done. The prompt that drove the agent, the key decisions it made, the output it produced, and a link to the resulting PR all belong in the issue, posted as a structured comment when the agent completes its run.
This matters most for (A) Agentic Blueprints, where no human is present during execution. Without a trace in the issue, the Harness Engineer has no reliable way to review what the agent did, the FDE has no starting point when something goes wrong, and the team cannot answer the most basic governance question: what exactly produced this code? But it is equally valuable for (B) Balanced runs — HITL approval decisions should be recorded in the issue too, so there is a clear log of what the human saw and chose to approve at each checkpoint.
What the trace comment must contain:
- Execution mode and label: Which label triggered this run (A / B / C) and the dispatch mode.
- Model and harness version: The model name and version, Core Craft commit hash, active MCP servers, and active skills at the time of execution. MCPs define what external tools the agent could reach; skills define what domain-specific instructions and capabilities it carried. Both directly affect what the agent did and how — if either changes between runs, the output may differ. This is the same data as the execution context snapshot in the DoD, surfaced here in the issue so it is immediately visible without opening a separate record.
- Key prompt(s) used: The primary instruction or Blueprint excerpt that drove the agent. Not the full conversation transcript, but enough to understand what the agent was told to do and what constraints it was given. For (A) Agentic runs this is especially critical — it is the only human-readable record of what drove the autonomous execution.
- Execution summary: A brief, structured summary of what the agent did: steps taken, tools called, decisions made at branch points, and any self-corrections. Most agents can generate this as a closing summary if instructed to do so in the Core Craft.
- Output reference: A direct link to the PR or merge request, the specific commit hash, and (if applicable) the Gate 1 run result. This closes the loop between the issue and the code it produced.
- Deviations and anomalies: Anything unexpected: a prompt that had to be adjusted mid-session, a tool call that failed and was retried, an output that diverged from the acceptance criteria in a minor way. These are exactly what the Harness Engineer needs to spot patterns and tighten the harness.
- HITL decisions (B only): For each checkpoint where a human approved continuation: who approved, at what step, and what they saw before approving. This makes the human judgment part of the audit log, not just the agent’s actions.
Who posts it and when: For (A) Agentic runs, the agent posts this comment automatically at the end of its session, before it opens the PR — this should be a Core Craft instruction so every agent does it consistently. For (B) Balanced runs, the agent posts the execution summary and the FDE appends HITL decisions. For (C) Crafted runs, the FDE posts a brief note of the approach taken if the implementation involved a non-obvious prompt or technique — this builds institutional knowledge even for human-led work.
Why the issue, not just the PR: Pull and merge requests are excellent for reviewing the diff, but they are poor audit logs for agent behaviour. Comments disappear into review threads; the PR is closed and archived once merged. The issue stays open as a permanent record linked to the code change, searchable by the Harness Engineer when a pattern surfaces months later. The issue is also where the Execution Mode label lives — keeping the trace there means all the information about a Blueprint (what was asked, what ran, what was produced) lives in one place.
A minimal Core Craft traceability rule looks like this: “When a Blueprint execution session ends, post a structured closing comment to the originating issue before opening the PR. The comment must include: (1) the execution mode label, (2) model name and version, Core Craft commit hash, active MCP servers, and active skills, (3) a one-paragraph summary of what you did and any key decisions made, (4) a list of all tools and MCP calls made and the reason for each, (5) any deviations from the Blueprint spec and why, (6) the PR link.”
Once this rule is in the Core Craft, every (A) Agentic run produces a traceable record with zero additional human effort. The Harness Engineer can then review these traces across Blueprints to identify patterns — a tool being called unnecessarily 80% of the time, a spec ambiguity that always causes the same deviation, a model that handles a certain file type poorly. The trace comment is not documentation overhead; it is the raw signal the Promotion Loop feeds on.
CRAFT Pipeline Labels: Automating the Workflow
Labels are the connective tissue between human intent and automated pipeline execution in CRAFT. When applied consistently in your issue tracker — GitHub Issues, Jira, Azure DevOps, Linear, or any equivalent — they tell the pipeline exactly what to do, how much human oversight is required, and whether the work can run unattended overnight. Without a shared label vocabulary, every team member makes different assumptions about who should act next and whether the agent can proceed autonomously. With it, a single label on an issue triggers the right branch, the right agent, and the right review flow automatically.
CRAFT labels fall into five categories. Every issue should carry at minimum one label from each of the first two categories (Execution Mode and Blueprint Type) before it enters the backlog. Risk, State, and Dispatch labels are added during Blueprint CRAFTing and evolve as the work progresses through the pipeline.
(A) Agentic: When an issue carries this label, the pipeline automatically creates a branch, dispatches the agent, opens a pull or merge request when complete, and routes it through Gate 1 with no human required during execution. The agent runs to completion (or a defined HITL checkpoint) and notifies the Harness Engineer for the Gate 1 human review only after the automated checks pass. This label is appropriate for well-specified, low-risk Blueprints with clear acceptance criteria and no ambiguous system interactions.
(B) Balanced: The agent executes, but at least one HITL checkpoint is mandatory before the work can merge. The pipeline creates the branch and starts execution, but explicitly halts at defined checkpoints for human approval. This is the correct default for most feature work: you get AI execution speed with the right human oversight at the points that matter.
(C) Crafted: The engineer leads; the AI is a copilot, not the driver. No autonomous pipeline execution is triggered. This label is correct for work involving architectural decisions, novel security boundaries, regulatory compliance, or any context where the risk of autonomous execution outweighs its speed benefit. The issue enters the standard human-driven engineering flow.
Category 1 - Execution Mode (required on every issue)
Determines how much autonomous pipeline execution is triggered. Assign exactly one per issue. This is the label the automation pipeline reads first.
| Label Name | Human / AI | Description |
|---|---|---|
| (A) — Agentic | AI only | Fully autonomous pipeline execution. The agent creates a branch, implements the work, opens a pull or merge request, and runs Gate 1 checks without any human involvement during execution. A human reviews the output only at the Gate 1 PR stage. Use for well-specified, low-risk Blueprints with clear acceptance criteria. |
| (B) — Balanced | AI + Human | Agent-driven execution with mandatory HITL checkpoint(s). The pipeline starts the agent automatically, but halts at defined checkpoints for human approval before continuing. The correct default for most feature work: agent speed with human oversight at the moments that matter. Use when the Blueprint has medium risk, external API calls, database changes, or any step that requires judgment before proceeding. |
| (C) — Crafted | Human only | Engineer-led; AI is a copilot, not the driver. No autonomous pipeline execution is triggered. The engineer owns design decisions and implementation direction. Use for architectural work, novel security boundaries, regulatory compliance requirements, or any context where autonomous execution risk outweighs its speed benefit. |
Category 2 - Blueprint Type (required on every issue)
Describes the nature of the work. Used to route issues to the correct pipeline variant and to calculate meaningful throughput metrics across issue types.
| Label Name | Human / AI | Description |
|---|---|---|
| type: feature | A or B | A new user-facing capability or business outcome. Should always have a Blueprint with a defined business goal, desired outcome, and acceptance scenarios. |
| type: bug | A or B | A defect in existing functionality. Include repro steps and expected vs. actual behaviour in the issue body. Well-described bugs in bounded areas are good candidates for (A) Agentic execution. |
| type: hotfix | B or C | An urgent production defect requiring immediate resolution. Hotfixes almost always warrant at least (B) Balanced due to time pressure and production risk. The Harness Engineer must be looped in immediately; standard Gate 1 automation still applies but may run in parallel with human triage. |
| type: hardening | A or B | A Hardening Blueprint: zero new user-facing functionality, dedicated to refactoring, test-coverage improvement, observability gaps, or technical debt reduction identified at the CRAFT Evolution. Count toward team throughput like any other Blueprint. |
| type: epic | Human (C) | A Blueprint Epic: a parent issue that groups multiple dependent Blueprints in sequence. Not directly executed; serves as a tracker. Child Blueprints carry their own Execution Mode and Type labels. |
| type: craft-evolution | Human (C) | A Core Craft or harness improvement identified at the CRAFT Evolution: a new rule, guardrail update, or system-level change that has no direct user-facing output but strengthens the agent harness. |
Category 3 - Risk Level (from the Harness Engineer’s PRA)
Set by the Harness Engineer during Blueprint CRAFTing based on the Product Risk Analysis. Determines the number of mandatory HITL checkpoints and whether additional sign-off is required before Gate 1.
| Label Name | Human / AI | Description |
|---|---|---|
| risk: low | AI primary | No significant security, data, or system-stability risk identified in the PRA. No special HITL checkpoints beyond the standard Gate 1 human review. Compatible with (A) Agentic execution and off-hours dispatch. |
| risk: medium | AI + Human | One or more HITL checkpoints required (e.g., before external API calls, before schema changes). Agent can execute between checkpoints autonomously, but must halt for approval at defined steps. Compatible with (B) Balanced; may still be dispatched off-hours if HITL notifications reach the responsible human promptly. |
| risk: high | Human gate | Multiple HITL checkpoints; Harness Engineer sign-off required before the PR can be merged. Typically involves production infrastructure changes, security boundary modifications, data migrations, or regulatory compliance scope. Requires (B) Balanced or (C) Crafted. Do not dispatch off-hours without explicit team agreement. |
Category 4 - Dispatch Mode (set during Blueprint CRAFTing, validated at Definition of Done)
Controls whether the agent can run unattended (e.g., overnight, over a weekend). Directly feeds the Always-On Execution principle. Set in the Blueprint alongside the Execution Mode label; validate accuracy after completion and log any deviation in the Local Craft.
| Label Name | Human / AI | Description |
|---|---|---|
| dispatch: off-hours | AI primary | Safe to dispatch at end-of-session for overnight or weekend execution. The Blueprint is sufficiently specified and the risk level is low enough that the agent can run to completion (or a known checkpoint) without active FDE supervision. Combine with (A) Agentic + risk: low for maximum unattended throughput. |
| dispatch: supervised | AI + Human | Can run off-hours only if the responsible FDE or Harness Engineer has HITL notifications configured and can respond promptly to checkpoint halts. The agent will pause at HITL points and wait; if no response comes within a defined timeout (set in the Team Agreement), it should stop safely and log the halt. |
| dispatch: active-only | Human gate | Must only be executed while an FDE is actively present and monitoring. Do not dispatch off-hours. Typically paired with risk: high, (B) Balanced, or (C) Crafted. Used for production infrastructure changes, data migrations, security boundary work, or any execution where an immediate human response to an unexpected agent action is required. |
Category 5 - Pipeline State (managed automatically by the CI/CD pipeline)
State labels are applied and removed automatically by the pipeline as a Blueprint moves through the CRAFT Engine. They reflect real-time status on the cockpit without anyone manually updating a board column. Teams should not set these manually; they are owned by automation.
| Label Name | Human / AI | Description |
|---|---|---|
| state: blueprint-ready | Auto (pipeline) | The Blueprint is fully specified (all required fields complete, Execution Mode and Risk labels set, Effort Weight calculated) and ready for an FDE to pick up and begin execution. Applied automatically once Blueprint CRAFTing is complete. |
| state: in-execution | Auto (pipeline) | The agent is actively working on this Blueprint. Applied automatically when a branch is created and the agent session starts. Visible on the cockpit to the whole team. |
| state: hitl-waiting | Human action | The agent has reached a HITL checkpoint and is paused, waiting for human approval to continue. Applied automatically when the agent halts at a defined checkpoint. The FDE or Harness Engineer must respond; a lack of response within the Team Agreement timeout should trigger a notification escalation. |
| state: gate-1-blocked | FDE fixes | Gate 1 automated checks failed (tests, SAST/DAST scans, or dependency alerts). The FDE is responsible for fixing the failures and re-pushing. The Harness Engineer monitors Gate 1 block rates; a rising trend is a Core Craft signal, not a people problem. |
| state: gate-2-pending | Strategist | Gate 1 passed; the Blueprint is staged and awaiting the Product Strategist’s asynchronous business verification (Gate 2). The FDE moves on to the next Blueprint; they do not wait for Gate 2 completion. |
| state: blocked | Flow Sync | Execution cannot proceed due to an external dependency, missing context, or unresolved decision. Triggers a Flow Sync within 30 minutes. The Flow Orchestrator is responsible for resolving or escalating. A Blueprint should never stay in this state for more than one working day without a documented escalation. |
How the Labels Work Together: A Practical Example
A well-labelled CRAFT issue gives the pipeline, the team, and any automated triage agent a complete picture at a glance. For example, an issue labelled (A) — Agentic type: bug risk: low dispatch: off-hours tells the pipeline: create a branch immediately, dispatch the agent tonight, let it run to completion and open a PR — no human needed until the Harness Engineer reviews Gate 1 tomorrow morning. Contrast that with (B) — Balanced type: feature risk: medium dispatch: supervised, which tells the pipeline: start the agent, but stop at the schema migration step, notify the FDE, wait for approval, then continue.
The label combination is the Blueprint’s execution fingerprint. Standardising it across the team is what makes CRAFT consistent: any team member, at any time, can look at an open issue and know exactly how it will be handled — and any automation agent can read the same labels and act accordingly without ambiguity.
2. State of the Craft (Continuous Hybrid Cockpit)
The State of the Craft cockpit is the team's single, always-live source of truth. It replaces the daily standup entirely. No one asks “what are you working on?”; the cockpit already knows. Every team member is responsible for keeping their assigned work accurate on the cockpit in real time.
Tooling note: CRAFT does not prescribe a specific cockpit tool. Choose whatever your team will genuinely maintain: a GitHub Projects board with CI/CD webhook automation, Linear, Jira, or any equivalent. The only requirement is that the tool supports automated state transitions (triggered by pipeline events), real-time filtering by Blueprint status, and visibility of agent activity and pipeline health signals. The cockpit is a live operational view, not a project management archive.
What the Cockpit Tracks (Automated):
- Blueprint Status: Each Blueprint moves through active states on the cockpit: In Progress → Verification → Staged → Done. A Blueprint only appears on the cockpit when an FDE picks it up from the backlog and marks it active; the backlog itself lives outside the cockpit. AI agents update these states automatically based on CI/CD pipeline events and repository activity.
- Agent Activity Logs: What is each AI agent currently doing? Any loops, failures, or HITL halt points are surfaced immediately.
- Pipeline Health: Build status, test pass rates, SAST/DAST scan results, and dependency vulnerability alerts.
- Observability Signals: Key metrics, error rates, and traces from the staging environment so the team can spot regressions before they reach production.
- Sustainability Metrics: Real-time API token burn rate, estimated compute cost, and carbon footprint for all active agents. Managed by the Flow Orchestrator, who sets hard budget thresholds and alerts.
What Each Role Does With the Cockpit:
- Product Strategist: Monitors Blueprint progress and Agentic Forecast queue. Reprioritizes the backlog as new user signal arrives from the FDE. Flags Blueprints that are ready for their async verification review.
- Harness Engineer: Monitors failed test gates and security scan alerts. If a critical vulnerability surfaces, they immediately update the Core Craft with a corrective guardrail and trigger a Flow Sync if it is blocking.
- Forward Deployed Engineer: Updates their active Blueprint state. Logs any agent hallucinations or HITL halts they encounter in their Local Craft. If a blocker cannot be resolved within 15 minutes independently, they post it to the cockpit and initiate a Flow Sync.
- Flow Orchestrator: Monitors the full team's API usage and compute footprint. Sets automated hard stops on any agent that exceeds defined token budgets. Identifies cross-team impediments and ensures the cockpit is always clean and actionable.
3. Flow Sync (Ad-Hoc Resolution - Max 15 mins)
A Flow Sync is not a meeting; it is a precision intervention. Its only purpose is to unblock the system as fast as possible. While humans resolve the blocker, AI agents keep executing everything else in the background. Calling a Flow Sync for anything that is not immediately blocking is an anti-pattern.
How to Initiate:
- Any team member who hits a blocker they cannot resolve within 15 minutes posts it to the State of the Craft cockpit, tags it as a Flow Sync trigger, and pings only the team members whose input is required, not the whole team.
- The Flow Sync must start within 30 minutes of being posted. If the required people are unavailable, the Flow Orchestrator unblocks the situation by escalating or making the decision.
Structure of a Flow Sync (15 minutes maximum):
- Minutes 0–2, Context (FDE or blocker owner): State the problem in one sentence. What is blocked, and what has been tried? No background story, only the specific blocker.
- Minutes 2–10, Resolution (relevant team members): Discuss only what is needed to decide. If it needs more than 10 minutes, the issue is too complex for a Flow Sync and should be re-Blueprinted.
- Minutes 10–15, Call to Action (Flow Orchestrator): The Orchestrator closes the Sync with a concrete, named CTA: who does what, by when, written into the cockpit immediately. No action item left unowned.
What Happens After:
- If the blocker is resolved, the cockpit is updated and execution resumes immediately.
- If the issue turns out to be non-blocking, it moves to the backlog. The board stays clean; only active blockers remain visible.
- If the Flow Sync reveals a systemic problem (for example, a repeated agent failure pattern), the Harness Engineer or FDE logs it in their Local Craft for the next CRAFT Evolution.
4. CRAFT Verification (Async)
The verification triad: who verifies what. CRAFT separates building from verifying, because the builder cannot be the sole judge of their own work. Three accountabilities divide the surface: the FDE builds the feature and its in-code tests (proving “does it work as I intended?”); the Harness Engineer independently verifies technical and system correctness through the automated harness and the human side of Gate 1 (proving “is it correct and safe, and does it clear the bar, whoever built it?”); and the Product Strategist verifies business value at Gate 2 (proving “did we solve the right problem?”). No one person owns all three. That separation keeps quality independent of individual optimism.
Verification is a two-gate process: an automated technical gate and an asynchronous human business gate. They run in sequence, never at the same time as active development, so the pipeline never becomes a bottleneck. The gates matter because an agent can convince itself its work is correct in its own local session while missing cross-service contract violations or environment-specific failures; CI verification (Gate 1), not the agent’s local confidence, is the real proof. The 2026 default loop is therefore orchestrate locally, verify asynchronously in CI. The FDE’s active build on a Blueprint is complete when the code is pushed to Gate 1; they do not take part in the Gate 2 business decision, which belongs solely to the Product Strategist. This is the asynchronous-first principle in practice: the FDE should not wait around for approval. They stay engaged, though: they fix Gate 1 failures promptly, watch the feature in staging, and remain accountable for its real-world outcomes through the production observation window. The build phase ends at the push; team accountability does not.
Gate 1: Automated Technical Verification (CI/CD Pipeline).
- Triggered by (FDE or Agent): The FDE or their AI agent pushes the completed feature branch and opens a Pull Request. That is the only action needed to start Gate 1; every subsequent check runs on the PR automatically.
- PR Review (AI-Assisted + Human Approval): The PR triggers two layers of review. First, an AI review agent runs automatically on the diff, checking Core Craft compliance, security anti-patterns, coding-standard violations, missing test coverage, and architectural drift. This review is advisory: it comments, flags, and may request changes, but cannot approve. FDEs are encouraged to run an agent review on their own work before opening the PR, asking it to critique the change as an adversarial reviewer and catch obvious issues early. The PR reviewer is itself part of the harness, and must be harnessed too. When the FDE or Harness Engineer sees the review agent miss a real issue, raise false positives, or apply the wrong standard, that is a signal to improve the review harness, not a one-off to fix by hand: the correction goes back into the Core Craft review rules (or the review agent’s configuration) so it catches that class of issue automatically next time. Over successive Micro-Cycles the automated review sharpens, shifting more of the burden off humans without lowering the bar. It is the same guide-and-sensor discipline the Harness Engineer applies to execution agents, applied to the reviewer. Second, a human reviews and approves. When team size allows, the reviewer should not be the FDE who built the feature; the natural independent reviewer is the Harness Engineer, whose job is to verify work they did not build. A second pair of eyes catches intent errors, business-logic gaps, and architectural drift that neither pipelines nor AI reviewers reliably detect. Any recurring class of issue the reviewer finds is fed back into the harness (a new Core Craft rule, a new sensor, or a tightened acceptance criterion) so the pipeline catches it next time without a human. In small teams where builder and reviewer are the same person, the same context-switch discipline applies: finish building, then reopen the PR as a reviewer asking “what did the agent get wrong, and what would I challenge if someone else wrote this?” No PR merges without human approval. This is non-negotiable. The AI accelerates the review; the human authorises the merge.
- SAST (Static Application Security Testing): Automated scan of the source for known vulnerability patterns. If any critical or high-severity finding matches the Blueprint’s threat model, the pipeline fails immediately and the FDE is notified.
- DAST (Dynamic Application Security Testing): Automated scan of the running application in a sandbox for runtime vulnerabilities (SQL injection, XSS, broken access control).
- Automated Test Suite: Every acceptance-criteria test the Harness Engineer defined during Blueprinting must pass. No exceptions. A failing test means the feature does not proceed; it goes back to the FDE.
- Dependency Check: Automated scan for known vulnerabilities in third-party libraries the feature introduces.
- If Gate 1 passes: The PR merges and the pipeline promotes the build to staging automatically. The cockpit updates to “Staged” and notifies the Product Strategist.
- If Gate 1 fails: The PR is blocked. The FDE gets a detailed failure report (automated check failures, AI review comments, or human reviewer feedback), fixes the issues, pushes to the same PR branch, and Gate 1 restarts: automated checks rerun and the reviewer is re-notified. No new PR or meeting needed; the cycle is self-service within the existing PR.
LLM-Specific Testing (Agentic Regression Layer): Traditional SAST/DAST and unit tests catch deterministic bugs, not AI-specific regressions. Gate 1 must also include these behavioral checks, especially when the Core Craft or agent prompts have changed since the last deployment:
- Behavioral regression against golden trajectories: A golden trajectory is a recorded, validated execution trace for a representative task, the sequence of tool calls, decisions, and final output, captured when the agent was known to behave correctly. When the Core Craft or prompts change, the agent’s run is compared against it. Significant deviation (a different tool-call sequence, unexpected file modifications, new external API calls) automatically fails the pipeline and routes to the Harness Engineer. Keep at least 3–5 golden trajectories per major workflow area.
- Prompt drift detection: Any change to
project-instructions.md(the Core Craft) triggers a diff review in the pipeline before merging. It checks for rules that contradict existing ones, removal of security guardrails, and scope changes that expand agent permissions. Prompt drift is the leading cause of production AI regression across enterprise deployments. A change that passes review proceeds to merge; one that fails is escalated as a Flow Sync trigger. - Context window pollution check: Verify the Blueprint’s Context Loading Instructions load only what was specified, not the whole repository. If the agent’s actual context token count significantly exceeds the Blueprint’s expected load, it is flagged before execution continues.
- Adversarial and negative-path testing: Golden trajectories prove the agent succeeds on known-good paths; they do not prove it fails gracefully on unexpected, malformed, or adversarial input. For any Blueprint that processes external data (user input, API responses, ingested logs, support tickets, transcripts), the Harness Engineer sets the adversarial coverage by the Blueprint’s risk profile, the same risk-based approach used for every other verification decision, ranging from a single edge-case check for low-risk Blueprints to a full adversarial suite for Blueprints that ingest uncontrolled external data. Common categories: prompt injection embedded in user-provided data (instructions hidden in a support ticket trying to override behaviour); malformed or schema-violating input that should trigger validation errors rather than silent wrong output; and edge cases where the agent should halt and ask for guidance rather than guess. Keep a small portfolio of failure-mode trajectories alongside the golden ones: recorded traces where the agent is expected to reject input, halt, or surface an error. These negative-path trajectories matter most for Agent-Initiated Blueprint pipelines, where the agent ingests external sources the team does not fully control.
Gate 2: Async Business Verification (Product Strategist).
- Triggered by (Cockpit): The Product Strategist is notified that the feature is staged and reviews it on their own schedule; no synchronous meeting required.
- What the Strategist verifies: They review the feature in staging against the Blueprint’s Desired Outcome and Acceptance Scenarios, walking each scenario to confirm it behaves as specified. They are NOT checking code quality; that is Gate 1’s job. They mark the Blueprint “Gate 2 Passed” or “Gate 2 Rejected” on the cockpit with a one-line rationale, within 24 hours of Gate 1 passing to prevent staging queue buildup.
- User Signal Check: Where relevant, the Strategist may share the staged feature with the FDE’s embedded users or customer contacts for quick informal validation before promoting to production.
- If Gate 2 passes: The Strategist marks the Blueprint approved on the cockpit and the pipeline promotes the build to production automatically.
- If Gate 2 fails: The Strategist documents the gap in the Blueprint itself (in
planning.md, not a meeting or chat). The Blueprint re-enters the active queue, and the FDE picks it up next Micro-Cycle with a clear written spec of what must change.
4.5 CRAFT Incident Response (Team-Owned, Flow Sync-Driven)
Production incidents are a team responsibility, not an individual one. CRAFT does not introduce a separate incident war-room process; instead, it extends the existing Flow Sync mechanism with an Incident classification and a mandatory post-incident loop. Any team member who detects a production failure, critical regression, or security breach triggers an Incident Flow Sync immediately. No approval is required to call one.
The harness detects incidents too, not just humans. A mature CRAFT system does not wait for a human to notice something is wrong. The Harness Engineer configures monitoring and anomaly-detection agents as part of the observability layer, governance agents whose job is to watch production signals (error-rate spikes, latency regressions, anomalous traces, security alerts, SLO breaches) continuously and around the clock. When such an agent detects a likely incident, it acts automatically: (1) it opens an Incident entry on the State of the Craft cockpit with the detected signal, affected component, and an initial severity estimate; (2) it begins autonomous first-line investigation, correlating logs and traces, identifying the probable failing Blueprint or recent deployment, checking whether a tested rollback path exists in the Wave Manifest, and drafting a preliminary root-cause hypothesis, so that when humans arrive, triage is already underway rather than starting from zero; and (3) it triggers an Incident Flow Sync at the appropriate severity, paging the required humans exactly as a human trigger would. The detection agent investigates and reports; it does not remediate autonomously; containment decisions (rollback vs. hotfix) and any Gate 2 bypass remain documented human calls. This closes the detection gap that pure human monitoring leaves open during off-hours, when the always-on execution model means agents may be shipping and running work while no human is watching. Detection-agent accuracy (true positives vs. false alarms) is reviewed at the CRAFT Evolution and tuned like any other part of the harness.
Incident Classification (set in the cockpit when triggering):
- P1 (Critical): Service is down or a critical user-facing workflow is fully broken. Trigger the Incident Flow Sync immediately.
- P2 (High): Core functionality is degraded but the service is operational. Trigger within 30 minutes.
- P3 (Medium): Non-critical feature impacted. Handle as a fast-tracked Hotfix Blueprint. “Fast-tracked” means it jumps to the top of the next Micro-Cycle’s execution queue ahead of all regular feature Blueprints, but below any active P1 or P2 Hotfix Blueprint. No emergency Flow Sync required, but the Product Strategist must acknowledge the P3 classification on the cockpit before execution begins.
Incident Flow Sync (P1 / P2 only):
- The triggering team member posts to the cockpit immediately: what is broken, what the impact is, and what has already been tried. They then start the Incident Flow Sync tagging only the required team members.
- Unlike a standard Flow Sync, the Incident Flow Sync has no fixed time cap; it stays active until the incident is contained. However, every decision must result in an immediate action; discussion without action is not permitted.
- The Flow Orchestrator leads containment coordination. The FDE who owns the affected Blueprint is the technical authority. The Orchestrator prevents decision paralysis and keeps the team moving with urgency.
- First decision: rollback or hotfix? If a tested rollback path exists in the Wave Manifest, use it. Rollback is faster and lower-risk. A Hotfix Blueprint is only chosen when rollback would cause greater damage (e.g., rolling back a live schema migration that data already depends on).
Hotfix Blueprint (when rollback is not viable):
- Follows the same structure as a standard Blueprint but streamlined: replace the Business Goal and Desired Outcome fields with a single Incident Description & Reproduction Steps field. The Harness Engineer’s risk analysis focuses exclusively on the specific failure mode, not a full PRA.
- Gate 1 still applies, no exception. Under P1 pressure, the automated pipeline runs with a compressed SLA: all acceptance criteria tests must pass. There is no manual override for test failures.
- Gate 2 is bypassed for P1 incidents. The Flow Orchestrator documents the bypass decision in the Hotfix Blueprint. The Product Strategist reviews the fix asynchronously once the service is restored and confirms it in the cockpit.
Post-Incident Review (blameless, within 24 hours of resolution):
- 15–20 minutes, facilitated by the Flow Orchestrator. Blameless: the question is never “who caused this?” but always “what in our system allowed this to happen?”
- Every P1 or P2 incident must produce: a root cause entry in the Local Craft (was this an AI hallucination, a missing HITL checkpoint, an insufficient acceptance criterion, or a process failure?); at least one Core Craft update within 24 hours (the guardrail or rule that would have prevented or caught this); and a follow-up Hardening Blueprint if technical debt contributed to the failure.
- The incident and its resolution are logged permanently in the State of the Craft cockpit. At the next CRAFT Evolution (Part 1), the team reviews all incidents from the Micro-Cycle to identify systemic patterns, not just isolated fixes.
5. CRAFT Evolution (Sync - Max 50 mins, End of Each Micro-Cycle)
This is the only mandatory synchronous meeting per Micro-Cycle, held at the end of each cycle. (The CRAFT Calibration is also mandatory but runs monthly, see step 6.) It is not a retrospective; it is an active engineering session where the team hardens the system. The Flow Orchestrator facilitates. Attendance is mandatory for the people who build and harden, all FDEs and the Harness Engineer. The Product Strategist joins only for Part 3 (Forecasting & prioritization) and otherwise contributes asynchronously; a shared Strategist or Orchestrator attends the Evolutions of the teams they serve, not one global session.
Agenda (strictly timeboxed):
-
- Before any technical review begins, the Flow Orchestrator runs a deliberate altitude shift: each team member answers one question in under 60 seconds that forces them to view the product from the outside rather than from inside their last Blueprint. The question rotates each cycle. Examples: “If you were a user who interacted with this product today, what one thing would frustrate or delight you?” or “What happened this cycle that the rest of the team probably doesn’t know about yet?”
- No actions, no discussion, no rebuttals. The sole goal is to surface shared context and reset everyone from their individual Blueprint tunnel vision into a collective, product-level perspective before the technical work begins.
- This is also the team’s lightweight team-building moment. In high-speed, asynchronous AI-accelerated environments, the risk of individual isolation is real, and people can spend an entire Micro-Cycle operating nearly independently. The Context Reset reconnects the humans before the system review begins, making it easier for everyone to inspect the cycle’s outputs with a shared, helicopter-level view rather than through the narrow lens of their own work.
-
- Each FDE presents the agent hallucinations, HITL halts, and prompt failures logged in their Local Craft during the Micro-Cycle. The goal is to find patterns, not to assign blame.
- The Harness Engineer presents any security scan findings that surfaced during the cycle and any gaps in automated test coverage they identified.
- The team votes on which failures are systemic risks (go to Core Craft) versus isolated incidents (stay in Local Craft).
- Incident review: Any P1 or P2 incidents that occurred during the Micro-Cycle are reviewed here. Were the post-incident Core Craft updates made? Did the root cause reveal a systemic pattern the whole team should know about? The Flow Orchestrator marks incidents as “closed” in the cockpit only after this review confirms the learnings are captured.
- Technical debt check: Is the AI consistently generating code with identifiable debt patterns such as duplicated logic, missing error handling, insufficient test coverage, or observability gaps? If yes, the team flags it and the Product Strategist creates a Hardening Blueprint for the next Micro-Cycle. Hardening Blueprints have zero new user-facing functionality and are dedicated entirely to cleanup, refactoring, or coverage improvement. They execute in exactly the same way as feature Blueprints and count toward team throughput. Skipping this check is how AI-accelerated teams silently accumulate fragility.
-
- FDEs share validated rules and GenAI workflows from their Local Craft files that are ready to be promoted to the team level.
- For each candidate: the team decides: promote to Core Craft, promote to the shared tool workspace, or keep local. No grey areas.
- The Flow Orchestrator or a nominated FDE immediately makes the change in the Core Craft during the meeting. The rule is then physically deleted from the Local Craft. If it is not deleted, it creates conflicting instructions for AI agents.
- Any new shared GenAI workflows are configured in the team's tooling workspace before the end of the meeting.
-
- Compare the AI-generated Effort Weights from completed Blueprints against actual execution time. Were estimates accurate? Adjust the forecasting model or the prompts used to generate them.
- The Flow Orchestrator presents the Micro-Cycle's API token usage and compute footprint. If the team exceeded budget, they identify which agent jobs caused it. Budget thresholds and cost targets are recorded in the Team Agreement and tracked on the cockpit. If the root cause is an agent behavior problem (e.g., excessive context loading, unnecessary tool calls, or looping), the team adds a corrective rule to the Core Craft to constrain that specific behavior.
-
- Each FDE flags any manual tasks they performed during the Micro-Cycle that could be automated with a new AI Skill, MCP server, or GenAI workflow.
- The team decides: build it now, add it to the backlog, or deprioritize. Any approved automation is assigned to a named FDE with a delivery Micro-Cycle.
The Evolution meeting ends with a clean, updated Core Craft and a clear set of actions for the next Micro-Cycle. There are no open discussion points or follow-ups; every decision is committed before anyone leaves.
CRAFT Evolution
6. CRAFT Calibration (Sync - Monthly, Max 2 Hours)
While every other CRAFT event focuses on Technology and Processes, the Calibration is entirely about People. It is held once per month, facilitated by the Flow Orchestrator, and is the only space where team dynamics, workload health, and long-term sustainability are discussed. This event must not be cancelled or shortened; it is the framework’s immune system against burnout and cultural drift.
-
- The Calibration is the team’s most human meeting, but it only works if people actually arrive as humans, not as task-processors still running on adrenaline from the last Micro-Cycle. CRAFT teams operate in deep asynchronous focus for days at a time; walking straight from that mode into a conversation about personal wellbeing and team dynamics produces shallow, guarded answers. The Energizer is the deliberate gear-shift that makes honest conversation possible.
- The Flow Orchestrator opens every Calibration with a short, non-work activity or question chosen in advance. It must take no longer than 10 minutes and require zero preparation from participants. The format rotates each month. Examples: a one-word round (“describe your last month in one word”); a personal “rose, bud, thorn” round about something outside of work; a quick imaginative prompt (“if the product were a dish right now, what would it be and why?”); or, for co-located teams, a brief physical movement break. The specific format matters less than the intention behind it.
- The only rule: the Energizer must be genuinely unrelated to technical work, delivery timelines, or product features. Those topics are off-limits until Part 1 begins. The Energizer’s entire purpose is to shift gears, lower defenses, and remind everyone in the room that the people sitting here are full humans before they are role-holders. The Calibration’s effectiveness (the quality of honest feedback, the willingness to flag real problems) depends directly on how safe and present people feel when Part 1 starts. The Energizer creates that condition.
-
- Each team member rates their personal experience of the CRAFT framework on three dimensions: Clarity (do I know what I should be doing?), Autonomy (do I have the tools and authority to act?), and Momentum (does the process feel fast and clear?).
- Are there old Agile habits resurfacing? Common regressions include: holding informal "mini-standups," waiting for synchronous approval instead of using the cockpit, writing planning documents that are too vague for the AI to act on, or skipping the Local Craft update.
- The Flow Orchestrator documents identified adoption blockers and assigns coaching actions to themselves. These are not team tasks; coaching is the Orchestrator’s personal responsibility.
- Knowledge Share: Each team member shares one thing they learned during the Micro-Cycle that others would benefit from knowing. This is not limited to AI or technical patterns (those belong in the Evolution’s Promotion Loop); it covers domain knowledge, problem-solving approaches, user insights, or anything that builds the team’s collective capability. Two minutes per person, no preparation required. The Flow Orchestrator captures anything that should be acted on.
-
- Is the pace of the Micro-Cycles sustainable? Are FDEs context-switching too frequently between Blueprints? Are Blueprints consistently too large, causing them to spill across cycles?
- Are there interpersonal blockers (communication gaps, misaligned expectations between the Product Strategist and FDEs, or unclear decision authority) creating friction?
- Identify systemic workload issues (not individual performance issues). If one FDE is consistently overloaded, the solution is structural (Blueprint sizing, automation investment, or team composition), not personal.
-
- Every identified issue must have a named owner, a concrete action, and a completion date before the meeting ends. Vague commitments are not allowed.
- All commitments are posted to a dedicated "Team Health" sector on the State of the Craft cockpit immediately. They are reviewed at the next Calibration to check completion.
- The Flow Orchestrator is accountable for following up on all open Team Health items between Calibration events, not waiting until the next one to discover they were forgotten.
CRAFT Calibration
The pattern is consistent across the industry: developers using AI complete significantly more tasks and merge substantially more pull requests, but review queues balloon, bug rates climb, and organisational delivery metrics remain flat. The reason is straightforward: AI is an amplifier, not a fix. Strong practices get stronger; weak practices get weaker. A team that is already struggling with review bottlenecks will drown faster with AI, not swim better. Individual speed increases without system-level improvements create the illusion of progress while shifting the bottleneck downstream.
Why CRAFT teams are protected: The Acceleration Trap closes when teams measure output volume (tasks completed, PRs merged) without measuring outcomes (cycle time, quality, team health). CRAFT’s existing architecture directly prevents this: the Blueprint Queue Depth metric (Flow Metrics) catches growing backlogs before they become pressure; the Calibration Health Score tracks whether the humans governing the system are sustainable; Gate 1 automated verification absorbs the review burden that would otherwise balloon; and the CRAFT Calibration (Part 2: Workload & Wellbeing) forces a monthly structural check on pace sustainability.
The signal to watch: If Blueprint Queue Depth is growing while the Calibration Health Score is declining, the team is in the trap, taking on more work than the system can sustainably deliver. The Flow Orchestrator must treat this pattern as a Flow Sync trigger: reduce Blueprint intake, not increase pressure. Additionally, track work-in-progress per FDE, the number of active Blueprints per person. If this number is increasing while cycle time is stable, the team is accumulating invisible strain even if no one feels overloaded yet.
The perception gap: Studies consistently show that developers believe AI makes them faster while objective measurements show mixed or even negative results on complex tasks. Perception and reality diverge, which is exactly why CRAFT measures outcomes (Blueprint Cycle Time, Effort Weight Accuracy) rather than feelings (velocity points, task counts). The monthly Calibration exists to close this perception gap before it becomes a burnout crisis.
The CRAFT Release Strategy: Shipping in Waves
Building a feature is only half the battle. Getting it into the hands of real users, without overwhelming them, breaking existing workflows, or shipping untested code, is where disciplined release management becomes critical. Traditional teams often treat releases as a binary event: the feature is either live or it is not. CRAFT rejects this. In an AI-accelerated environment where features can be built in days instead of weeks, the release pipeline must be just as intentional and structured as the development pipeline. Without a deliberate release strategy, teams risk flooding users with a wall of changes they cannot absorb, burying critical improvements under a pile of minor updates, and eroding the trust they worked so hard to build.
CRAFT manages releases through Release Waves: controlled, phased rollouts that give users time to discover, learn, and adapt to new capabilities before the next wave arrives. Each wave is a curated set of changes, not a dump of everything that passed Gate 2 since the last deployment.
Release Wave Principles
Every release wave is governed by four non-negotiable principles:
- User Absorption Over Speed: The fact that the team can ship five features in a week does not mean it should. Users need time to discover a new capability, understand how it changes their workflow, and build new habits around it. Shipping too many changes simultaneously guarantees that most of them will be ignored, misunderstood, or resented. A release wave should contain a coherent, digestible set of changes, typically one major feature and a handful of supporting improvements or fixes.
- Verification Before Velocity: No feature enters a release wave until it has passed the full automated verification pipeline and received explicit human sign-off. AI-generated code is fast, but speed is meaningless if a regression reaches production. Automated tests, security scans, and staging validation are not optional gates; they are the price of admission.
- Communicate Before You Ship: Users should never be surprised by a change in their workflow. Every wave includes a communication plan: what is changing, why it matters, and where to get help. This applies to internal stakeholders as well: support teams, partner teams, and leadership should know what is coming before it lands.
- Observe After You Ship: A feature is not “done” when it reaches production. It is done when the team has confirmed, through metrics, logs, and user feedback, that it is working as intended in the real world. Every wave includes a mandatory observation window before the next wave is authorized.
Release Wave Structure
A release wave moves through four distinct phases. The Flow Orchestrator owns the overall wave cadence; the Product Strategist owns the prioritization of what enters each wave.
Phase 1: Wave Staging & Bundling
Not every feature that clears Gate 2 ships immediately. The Product Strategist groups completed features into coherent waves based on user impact, thematic fit, and dependency order. A wave should tell a story: “In this release, users can now do X, and we improved Y to support it.” Random collections of unrelated changes dilute user attention and complicate rollback if something goes wrong.
- Each wave has a Wave Manifest, a brief document listing every included change, its Blueprint reference, its risk rating, and its rollback plan.
- High-risk features (new integrations, data model changes, permission changes) are either the sole item in a wave or are gated behind a feature flag for progressive exposure.
- The Harness Engineer reviews the manifest and confirms that the combined set of changes does not introduce interaction risks that individual Gate 2 checks may have missed.
Phase 2: Automated Verification & Regression Testing
Before any wave reaches a single user, it must pass a comprehensive automated verification suite. This is not a rerun of unit tests; it is a dedicated release verification pipeline that tests the combined behavior of all changes in the wave together.
- End-to-End Test Suite: Automated browser or API tests that simulate real user journeys across the entire application. AI agents can be instrumental here, so FDEs should instruct their agents to generate and maintain E2E tests as part of every Blueprint execution, not as an afterthought.
- Regression Test Suite: A curated set of tests that verify existing functionality has not been broken by the new wave. This suite grows with every Micro-Cycle; the Promotion Loop should include rules requiring agents to add regression tests for every bug fix and every critical path.
- Performance & Load Testing: For waves that include backend changes, automated performance benchmarks catch degradation before users experience it. Thresholds should be defined in the Core Craft so agents bake them in automatically.
- Security Scan (SAST/DAST): A final security sweep of the combined wave. Even if individual features passed Gate 1 security checks, the combination may expose new attack surfaces.
- AI-Assisted Test Generation: AI agents excel at generating test cases from Blueprints. Teams should leverage this to maintain high coverage without manual test-writing overhead. The Core Craft should contain rules mandating minimum test coverage thresholds and specifying which test frameworks and patterns agents must use.
Phase 3: Rollout
How a wave reaches users is not a one-size-fits-all decision. A consumer platform serving millions of users has fundamentally different rollout needs than an internal tool used by fifty people, or a startup iterating with a small early-adopter community. CRAFT does not prescribe a single rollout model; it requires the team and organization to deliberately choose a rollout strategy that matches their context, and to document that choice in their Team Agreement so it is applied consistently. (The rollout model is a human release-process decision, not an agent instruction, so it belongs in the Team Agreement, alongside Release Wave cadence, not in the Core Craft.)
The one universal non-negotiable: the team must validate the wave internally before any external user sees it. What happens after that validation is a team or organizational decision. CRAFT provides two reference models; teams may adapt or blend them as needed.
Model A: Direct Rollout (Recommended for: internal tools, small user bases, early-stage products)
After the team has validated the wave in a staging or pre-production environment and confirmed it works in their own workflows, the wave ships directly to all users. This is the fastest path from verification to value, and it is perfectly appropriate when the team has high confidence in their automated test coverage, the user base is small enough that issues surface quickly through direct feedback channels, and the cost of a brief regression is low relative to the cost of delayed delivery.
- Team Validation (Day 1): The wave deploys to a staging or pre-production environment. The team actively tests the new features in their own workflows. Error rates, performance metrics, and logs are reviewed.
- General Availability (Day 2+): If team validation passes, the wave rolls out to all users. The communication plan activates: changelogs, in-app announcements, or onboarding nudges go live to help users discover and adopt the new capabilities.
Model B: Tiered Progressive Rollout (Recommended for: large user bases, regulated industries, high-risk changes)
For products with large or diverse user bases, a tiered approach reduces blast radius and provides confidence checkpoints before full exposure. Each tier expands the audience only after the previous tier shows healthy metrics.
- Tier 1: Internal & Canary (Day 1–2): The wave deploys to the team itself and a small canary group of opted-in users. The team actively uses the new features in their own workflows. Error rates, performance metrics, and user-facing logs are monitored in real time.
- Tier 2: Early Adopters (Day 3–5): If Tier 1 shows no regressions, the wave expands to a broader early-adopter segment, typically 10–20% of the user base. Support channels are monitored for unexpected friction. The Product Strategist reviews early feedback signals.
- Tier 3: General Availability (Day 5+): If Tier 2 metrics are healthy, the wave rolls out to all users. The communication plan activates alongside onboarding nudges to help users discover and adopt the new capabilities.
Choosing Your Model: The Product Strategist and Flow Orchestrator should decide on the team's default rollout model during Day 0 setup and record it in the Team Agreement. This default can be overridden per wave: a team that normally uses Model A might escalate to Model B for a particularly high-risk feature (e.g., a payment flow change or a data model migration). The Wave Manifest should explicitly state which model applies to each wave and why.
Emergency Halt (universal, applies to all models): Regardless of the chosen rollout model, the Flow Orchestrator can halt any rollout at any point and trigger an immediate rollback using the pre-defined rollback plan from the Wave Manifest. If error rates spike, performance degrades, or critical user feedback surfaces, the rollout stops. Speed of rollback is as important as speed of delivery. This is not optional; every team, regardless of size or rollout model, must have a tested rollback path before a wave leaves staging.
SLO-Based Automatic Progression (Enterprise Optimization): In enterprise environments, manually gatekeeping each rollout tier creates a bottleneck that negates the speed advantages of agentic development. Teams should define Service Level Objectives (SLOs) for each tier transition: measurable thresholds that, when met, automatically authorize progression to the next tier without requiring human approval. Example SLOs: error rate below 0.5% for 30 consecutive minutes, p95 response latency within 10% of baseline, and zero new critical security alerts. Conversely, if an SLO breach is detected at any tier, the pipeline automatically halts the rollout and triggers an Incident Flow Sync. This SLO-gated automation transforms the tiered rollout from a manually supervised process into a self-governing pipeline: humans define the thresholds, agents monitor and enforce them, and rollbacks execute automatically before degradation reaches end-users at scale. The Flow Orchestrator owns SLO definition and review; SLO thresholds are version-controlled in the Wave Manifest alongside rollback plans. Teams that implement SLO-gated progression consistently report 40–60% faster time-to-general-availability without increasing production incident rates.
Phase 4: Observation Window & Wave Close
After a wave reaches General Availability, the team enters a mandatory observation window (typically 2–3 days) before the next wave is authorized to begin its rollout. During this window:
- The Product Strategist monitors adoption metrics: Are users actually engaging with the new features? If not, the problem is likely discoverability or communication, not the feature itself.
- The Harness Engineer monitors error rates and security alerts for any delayed-onset issues that did not surface during progressive rollout.
- Support and feedback channels are actively triaged. Any bugs discovered are fast-tracked as hotfix Blueprints.
- Once the observation window closes cleanly, the Flow Orchestrator formally closes the wave on the State of the Craft cockpit and authorizes the next wave to begin staging.
Feature Flags & Progressive Exposure
Feature flags are a first-class citizen in the CRAFT release strategy. They decouple deployment (code reaching production) from release (users seeing the feature). This distinction is critical in an AI-accelerated pipeline where code reaches production far more frequently than users can absorb changes.
- Every high-risk feature must be wrapped in a feature flag. This is a Core Craft rule, not a suggestion. The FDE's AI agent should be instructed to implement feature flags as part of the Blueprint execution, not bolted on afterward.
- Flags enable safe experimentation: A/B testing, percentage-based rollouts, and user-segment targeting all become possible when features are flag-gated. This turns every release into a learning opportunity.
- Flags must have an expiration plan: A feature flag that lives forever becomes technical debt. The Wave Manifest should include a “flag cleanup” date for every flagged feature: the date by which the flag is either permanently enabled and the conditional code removed, or the feature is killed.
AI Agents in the Release Pipeline
AI agents are not limited to writing code; they are equally powerful in the release pipeline when properly instructed. Teams should leverage agents for:
- Automated Test Generation & Maintenance: Agents can generate E2E tests, regression suites, and edge-case scenarios directly from Blueprint specifications. As features evolve, agents update the corresponding tests, eliminating the manual maintenance burden that causes test suites to rot.
- Release Note Drafting: Agents can compile Wave Manifests, Blueprint descriptions, and commit messages into user-facing release notes and internal changelogs, saving the Product Strategist hours of manual summarization.
- Deployment Verification: Post-deployment smoke tests can be generated and executed by agents, providing instant confidence that the deployment was successful before the progressive rollout begins.
- Anomaly Detection: Agents monitoring production logs and metrics during the observation window can flag anomalies faster than human review, enabling earlier intervention when something goes wrong.
- Rollback Automation: When a rollback is triggered, agents can execute the pre-defined rollback plan from the Wave Manifest, verify the rollback was clean, and generate an incident report for the team, all within minutes.
The key constraint remains unchanged: humans authorize releases; agents execute and verify them. An AI agent should never autonomously decide to push a wave to General Availability. That decision belongs to the Product Strategist and Flow Orchestrator, informed by the data the agents surface.
CRAFT at Scale: Enterprise Multi-Team Collaboration
In enterprise environments, multiple CRAFT teams often operate within the same complex product. If these lightning-fast teams are not properly aligned, their AI agents will overwrite each other's architectures and create massive technical debt. CRAFT manages scaling through shared context and targeted alignment.
The Shared Core Craft
When multiple teams work on the same product, there is only ONE product backlog and ONE Core Craft file for the entire product repository. All AI agents across all teams must obey this single source of truth. When any single team executes a Promotion Loop during their CRAFT Evolution, that architectural or security update immediately hardens the rules for all other teams working in the repository.
Memory coherence is the multi-team breakpoint. At scale, the single structural failure that most often breaks multi-agent and multi-team setups is not model quality; it is context inconsistency across agents’ memory stores: different agents acting on stale, divergent, or contradictory versions of the same knowledge. The shared Core Craft is CRAFT’s primary defence (one version-controlled source of truth all agents obey), but teams must also ensure that ephemeral, machine-local auto-memories never silently override it (see Personal Rule Files & Auto-Generated Memories) and that promoted rules carry a clear version so every team and agent can confirm they are operating on the current baseline. When agents disagree, the tie-breaker is always the versioned Core Craft, never an individual agent’s private memory.
Cross-Team Alignment Syncs
To prevent collisions and maximize shared learning, humans must align their strategies before the AI generates code, and after it delivers results.
- Strategist Alignment: Product Strategists from the respective teams collaborate frequently to slice the overarching product vision into independent Blueprints, ensuring no two teams are building overlapping or conflicting features simultaneously.
- Orchestrator Sync (Platform, Skills & Governance): The Flow Orchestrators across the product group meet regularly to handle both governance and cross-team capability growth. This sync covers: requesting tool licenses from centralized platform teams; standardizing MCP server usage and shared GenAI workflow libraries; sharing new AI Skills, prompt patterns, or automation techniques that individual teams have validated and promoted to their Core Craft; enforcing enterprise data-privacy and compliance regulations; and managing the combined compute footprint and API budget of all AI agents across the product group. Note: In large enterprises with many CRAFT teams, this Orchestrator Sync becomes a critical mechanism for scaling quality. A single team’s breakthrough (a new MCP server, a powerful GenAI workflow, or an effective prompt pattern) can be shared across dozens of teams in a single sync, multiplying its value instantly. Orchestrators should come to this sync prepared with a short list of what their team validated in the last Micro-Cycle that others could benefit from.
Enterprise Promotion: The Open Platform Model
Within a single CRAFT team, the Promotion Loop moves validated knowledge from an individual FDE’s Local Craft into the team’s Core Craft. But in larger organisations, the value of a breakthrough doesn’t stop at the team boundary. A security guardrail discovered by one team is equally valuable to fifty others. A GenAI workflow that halved Blueprint cycle time in one product group should be available to the entire company, not locked inside a single repository.
CRAFT addresses this through a multi-tier promotion model: Local Craft → Team Core Craft → Organisational Craft (or departmental/divisional layers in between, depending on company size). Each tier has its own maintainer and its own review process, but the direction of knowledge flow is always the same: bottom-up.
Why an open platform, not a closed one: Many enterprises today manage development standards through closed, top-down governance bodies: a central architecture board or standards committee that defines rules in isolation and pushes them down to teams as mandates. These closed platforms have a structural flaw: the people writing the rules are disconnected from the people doing the work. Rules arrive late, miss real-world context, and are frequently ignored or worked around because they don’t reflect the reality teams face daily.
CRAFT explicitly rejects this model. The organisational knowledge platform must operate as an open system, following the established InnerSource model, the practice of applying open-source collaboration principles inside the walls of a single organisation. InnerSource gives CRAFT a proven, industry-validated pattern for exactly this problem (used at scale by companies such as PayPal, Bloomberg, and others to let one team contribute directly to another’s shared components, shrinking cross-team timelines from quarters to days). Its core principles map directly onto CRAFT’s multi-tier promotion:
“Open” means open to the organisation, not to the public. This is a critical distinction. CRAFT’s Open Platform Model applies open-source ways of working (anyone can contribute, transparent review, merit-based acceptance, bidirectional flow) strictly within the boundaries of the enterprise. Core Craft rules, security guardrails, GenAI workflows, and the Organisational Craft are shared across internal teams only; they are not published externally, open-sourced to the public, or exposed outside the organisation’s trust boundary. Any decision to release an artifact externally is a separate, deliberate act governed by the organisation’s open-source and IP policies, never a side effect of internal promotion. InnerSource is precisely the term for this: open collaboration, closed perimeter.
- Anyone can contribute: Any CRAFT team that validates a rule, pattern, or workflow through their Promotion Loop can propose it for promotion to the organisational level. Contributions are not gatekept by hierarchy; they are evaluated on merit and evidence.
- The Platform Team as Trusted Committer: In InnerSource, contributions from any team are reviewed by a designated Trusted Committer, a maintainer who reviews, mentors contributors, and safeguards quality without inventing the work themselves. In CRAFT, the enterprise Platform Team (or a Platform Owner in smaller organisations) plays exactly this role for the Organisational Craft. They review incoming contributions from every CRAFT team, ensure consistency, resolve conflicts between competing patterns, and maintain the organisational knowledge base, but they do not dictate rules in a vacuum. Critically, the Platform Team reviews at a broader scope than any single team can see: a security guardrail or context pattern that is safe within one team’s architecture may be unsafe when applied across dozens of teams with different tech stacks, data classifications, and compliance obligations. This broader-scope quality review is precisely why the Platform Team layer exists in larger enterprises: it is the safeguard that lets teams move fast locally while keeping the shared platform coherent and safe globally. Reviewing contributions takes real capacity; the Platform Team’s review workload must be explicitly planned for, and expected review timelines must be transparent to contributing teams (an InnerSource discipline, not an afterthought).
- Bidirectional flow, contribute up and pull hardened rules back down: Knowledge does not just flow one way. A team surfaces a validated rule, the Platform Team reviews and hardens it at organisational scope, and then every team, including the originating one, pulls the reviewed, organisation-grade version back into their environment. What a team gets back is stronger than what it contributed, because it has been stress-tested against the full portfolio. This is the compounding engine of enterprise CRAFT: each team’s local discovery, once hardened by the Platform Team, becomes every team’s baseline.
- Transparency and traceability: Every rule in the organisational knowledge base has a visible origin: which team proposed it, what evidence supported it, and what problem it solved. Teams adopting organisational rules can trace back to the source and understand why the rule exists, not just that it exists.
- Opt-in adoption with clear escalation: Organisational rules come in two tiers: mandatory (security-critical, compliance-driven) and recommended (best practices, efficiency patterns). Mandatory rules are enforced via shared pipeline components; recommended rules are available for teams to adopt voluntarily. This prevents the bureaucratic overreach that kills agility in enterprise governance.
The result is a system that hardens from the bottom up: practitioners on the ground discover what works, the Promotion Loop validates it at the team level, the Orchestrator Sync surfaces it across teams, and the Platform Owner curates it into the organisational knowledge base. Every rule in the system was battle-tested before it became a standard, not invented by a committee that hasn’t written production code in years.
Cross-Team Level: Flow Orchestrator surfaces the validated rule at the Orchestrator Sync → Other teams evaluate and optionally adopt it into their own Core Craft.
Organisational Level: The Orchestrator (or any team member) proposes the rule to the enterprise Platform Team, acting as InnerSource Trusted Committer → the Platform Team reviews the evidence at broader-than-team scope, checks for conflicts with existing organisational rules, and either accepts it (mandatory or recommended) or sends it back with feedback → Accepted rules are published to the organisational knowledge base and propagated to all teams via shared governance repositories or pipeline components → every team, including the originating one, pulls the hardened, organisation-grade version back into its environment.
The key principle: Knowledge flows upward because practitioners discover it. Governance flows downward only after practitioners have validated it. This is how CRAFT ensures that enterprise-scale governance is grounded in reality, not theory, and it is why teams trust and follow the rules instead of working around them.
The organisation, through the Platform Owner, must establish clear boundaries for each tier of promotion. These boundaries typically cover:
1. Maturity requirements: How long must a rule or pattern prove itself at the team level before it is eligible for organisational promotion? What evidence of effectiveness is required (metrics, adoption count, incident prevention)? The organisation decides these thresholds, not the contributing team.
2. Security and compliance review: Any contribution that touches security guardrails, data handling, authentication patterns, or compliance-sensitive domains must pass through a dedicated security review before promotion, regardless of how well it performed at the team level. A pattern that works securely in one team’s context may introduce vulnerabilities when applied broadly across different architectures and data classification levels.
3. Scope and compatibility checks: Does the proposed rule conflict with existing organisational rules? Does it apply universally or only to specific tech stacks, domains, or team profiles? The Platform Owner must verify that a new contribution does not silently override or contradict established standards.
4. Propagation control: How are accepted rules distributed to teams? Mandatory rules may require a defined grace period for adoption; recommended rules live in a catalog for voluntary use. Teams must never be surprised by a new constraint appearing in their pipeline without notice.
5. Challenge and deprecation process: Teams must have a clear path to challenge organisational rules that are outdated, harmful, or inapplicable to their context, with evidence. Rules that are never challenged are not necessarily good; they may simply be ignored. The Platform Owner should audit rule relevance on a regular cadence.
CRAFT does not prescribe the specific thresholds for these guardrails; every organisation operates at a different scale, risk profile, and regulatory environment. What CRAFT does prescribe is that these guardrails must exist, must be documented, and must be enforced consistently. An open platform without guardrails is not open; it is chaotic.
CRAFT Enterprise Promotion
Multi-Repository & Monorepo Governance
CRAFT assumes a shared Core Craft for a shared codebase. In enterprise environments, this is rarely that simple. Common scenarios require explicit guidance:
- Microservices across multiple repositories: Do not put the Core Craft inside a product repository. Instead, create a dedicated governance repository that contains only the Core Craft and shared GenAI Workflows. All product repositories reference it as a Git submodule (or sync via pipeline automation). When a Promotion Loop update is approved, it is merged into the governance repo and automatically propagates to all consuming repos on their next sync. The Orchestrator Sync is the coordination point for this propagation.
- Monorepos with multiple products or teams: Use a root-level Core Craft for rules that apply universally across all products in the repo, and subdirectory-level Core Craft files for product-specific rules. AI agents load both: the root-level file for universal guardrails and the relevant subdirectory file for product context. This mirrors the cascading context hierarchy already used for Blueprint → Core Craft → Local Craft.
- Frontend and backend in separate repositories: Treat each as a separate CRAFT team with its own Local Craft and its own contribution to the shared governance Core Craft. Cross-repo Blueprints (features that require simultaneous changes in both repos) must declare their inter-repo dependency in the
depends_onfield and coordinate execution through the Orchestrator Sync. - Rule of thumb: The Core Craft governance structure should mirror your deployment and ownership structure, not your code structure. If two teams deploy independently, they each own a Core Craft. If they share a deployment pipeline, they share a Core Craft.
AI Model Governance
The AI model itself is an operational dependency with a lifecycle, just like any third-party library or infrastructure component. CRAFT teams that do not govern their model usage actively will encounter unexpected regressions when providers deprecate or update models, budget overruns from unoptimized model selection, and audit gaps when they cannot demonstrate which model version produced which output. The Flow Orchestrator owns model governance; the Harness Engineer audits it.
- Model Version Pinning: Every agent configuration in the team’s tooling must reference a specific, pinned model version, not a floating alias like “latest” or “claude-sonnet.” A floating alias means that a provider-side model update can silently change agent behavior in production overnight with no code change in your repository. Pinned versions must be recorded in the Team Agreement alongside their selection rationale and displayed on the cockpit so the entire team has visibility. When upgrading to a new model version, the upgrade is treated with the same discipline as a Core Craft change: it requires a PR to the Team Agreement, behavioral regression testing against golden trajectories, and the Flow Orchestrator’s explicit approval. Model configuration is an infrastructure decision, not an AI agent instruction, so it does not belong in the Core Craft file itself.
- Model Selection by Task Type: Not every task requires the most capable or most expensive model. CRAFT teams should define a task-to-model mapping in the Team Agreement. As a reference starting point: use frontier-tier models (the most capable Claude, GPT, and Gemini tier available at the time) for architecture planning, complex multi-file refactoring, threat modeling, and Agentic Forecasting; use mid-tier models for typical feature Blueprint execution and code generation; use lightweight models for test generation, documentation, boilerplate, and release note drafting. This tiered approach can reduce AI compute costs by 40–70% with negligible quality impact if implemented with clear task boundaries. Teams should validate and tune their own mapping; these are starting heuristics, not fixed rules.
- Model Deprecation Response: When a provider announces a model deprecation, the Flow Orchestrator treats it as a planned maintenance event. The team identifies all pinned references to the deprecated model in their Team Agreement and agent configurations, evaluates available replacement models using golden trajectory comparison, selects a replacement and documents the rationale, and completes the migration before the provider’s end-of-life date. Treat deprecation timelines like security patch deadlines; they are not optional.
- Model API Availability & Fallback: The Team Agreement should define a fallback model for each primary model in use. If the primary model API returns repeated errors or latency spikes, the agent automatically falls back to the secondary model for the current Blueprint execution. The Flow Orchestrator is notified immediately. Fallback events are logged and reviewed at the next CRAFT Evolution to determine if the primary model is unreliable enough to warrant a permanent switch.
- Cost Per Blueprint Tracking: Token cost should be tracked at the Blueprint level, not just the team level. When the AI agent executes a Blueprint, the total token spend is logged against that Blueprint’s ID. This enables the Product Strategist to include real AI execution cost in Blueprint ROI calculations and gives the Flow Orchestrator precise data on which Blueprint types are the most expensive to execute, informing context loading optimization and model selection decisions.
Knowledge Threads: Managing AI Context
Generative AI models are highly susceptible to hallucinations when overwhelmed with irrelevant data or starved of necessary context. CRAFT manages this via a strict, cascading hierarchy of markdown files and shared workflows. Agents only read what they need, preventing their context windows from flooding.
Terminology: Skills, Workflows, and MCP Servers: what’s the difference? These three terms appear throughout CRAFT and are sometimes used interchangeably in team conversations. They are distinct:
- MCP Server (Model Context Protocol Server): A runtime service that exposes tools and data sources to an AI agent via a standardized protocol. Think of it as a plugin your agent can call at execution time: a database query tool, a browser, a file-system interface, a Jira connector. MCP servers give agents real-world capabilities beyond text generation. They are infrastructure components, not instructions.
- GenAI Workflow: A pre-configured, reusable prompt chain or automation sequence within your AI tooling (e.g., a Cursor workflow, a Windsurf workflow, a custom Copilot agent). A GenAI Workflow is saved as a configured routine that a team member invokes on demand, for example “run the Blueprint review workflow” or “run the release notes draft workflow.” It combines a prompt template with optional tool access and produces a structured output. Workflows live in the team’s shared tooling workspace and are shared across all FDEs.
- AI Skill (or Prompt Pattern): A validated, reusable instruction pattern or prompt technique that has proven effective for a specific task type, for example a specific way of prompting the agent to write defensive error handling, or a chain-of-thought structure that reduces hallucinations for database schema tasks. Skills are knowledge artifacts, not software components. They live in the Core Craft as rules or in the Local Craft as personal techniques until promoted. When the Promotion Loop promotes a Skill to the Core Craft, it becomes a rule all agents follow automatically, without a human invoking it.
- Agent-to-Agent Orchestration (Multi-Agent Coordination): As agentic workflows mature, individual agents increasingly need to coordinate with other agents, not just with human operators or external tools. An FDE’s primary coding agent may delegate a subtask to a specialised testing agent, which in turn invokes a security scanning agent, all within a single Blueprint execution. Emerging agent-to-agent protocols (such as A2A and other emerging open standards) enable this by allowing agents to discover each other’s capabilities, negotiate task delegation, and exchange structured results, sitting above the underlying system complexity rather than requiring custom integrations. For CRAFT teams, multi-agent orchestration introduces specific governance requirements: every agent-to-agent delegation must be logged to the same immutable audit trail as human-initiated actions; the Core Craft must define which agents are permitted to invoke which other agents (preventing unconstrained agent proliferation); and the Harness Engineer must include agent-to-agent interaction patterns in their Agentic Chain Verification and governance agent configurations. Multi-agent workflows are powerful force multipliers, but without explicit boundaries they create the same “shadow IT” risk that unchecked SaaS adoption created in the digital era. The Flow Orchestrator tracks agent inventory and inter-agent dependencies as part of their platform governance mandate. CRAFT treats inter-agent trust as zero-trust by default: no agent implicitly trusts another’s output; every delegation and handoff is validated, signed, and written to the same immutable audit trail as human-initiated actions, and the Core Craft explicitly defines which agents may invoke which others. The execution mechanics of coordinating agents (the orchestrator-and-subagent pattern) are covered in the Agentic Execution Discipline section.
The Blueprint (planning.md)
The tactical document for immediate execution. This is the direct output of the Blueprint CRAFTing phase. It is highly explicit, detailing the exact business goal, the desired outcome, what is explicitly out of scope, acceptance scenarios written in plain language, dependency declarations on other Blueprints, the technical How, the Harness Engineer’s risk and verification boundaries (including Product Risk Analysis and threat model), the Agentic Forecast weight, strict Human-in-the-Loop constraints, and a binary, checkable list of acceptance criteria the agent must execute against.
The Core Craft (project-instruction.md / agent.md / Shared Workflows)
The global brain of the product. It sits at the root of the repository and is treated as absolute law by all AI agents. Note: Depending on the Generative AI tooling your team uses, this file may take the name of the tool's default instruction file (e.g., agent.md, claude.md, or .clinerules). If your tool relies on a specific file as its primary source of truth, that file inherently becomes your Core Craft. Most modern AI coding tools support more than just a single instruction file. They provide a rule file system: a directory of individual rule files, each with its own activation mode (e.g., always active, triggered by file-pattern matching, activated by the model’s own judgment, or invoked manually). When splitting the Core Craft into purpose-specific files (as recommended below at the 200-line limit), FDEs must map those files to their tool’s native rule directory structure and configure the correct activation mode for each. A security-rules file, for instance, should be set to always-active; a frontend-patterns file should activate only when frontend code is in context. The Flow Orchestrator is responsible for documenting which rule directory structure and activation modes the team uses, and for reviewing this mapping at every CRAFT Evolution. It contains overarching architecture decisions, strict shared security guardrails (e.g., handling secrets), quality strategies, and mandatory coding standards. This layer also encompasses the shared, centralized GenAI Workflows configured in your tooling for the whole team to use.
security-rules.md for security guardrails, architecture-patterns.md for structural decisions, coding-standards.md for language and style conventions. Each file is loaded selectively: a Blueprint for a UI feature does not need database-migration rules, and vice versa. The main Core Craft file should contain only the universal rules that apply to every single Blueprint. The Flow Orchestrator owns Core Craft maintenance and reviews file size at every CRAFT Evolution. A bloated Core Craft degrades AI output quality faster than almost any other single factor.The Local Craft (dev-instructions.md & Local Workflows)
The individual Forward Deployed Engineer's sandbox. AI agents operate differently depending on the developer driving them. This file tracks a specific FDE's personal prompting habits, preferred workflow loops, and the unique, recurring mistakes made by their local agent instances. FDEs also experiment with local GenAI tool workflows here before promoting them.
The Promotion Loop (The Mechanism of System Learning)
It is easy to confuse the Promotion Loop with the CRAFT Evolution event, but they are distinctly different: CRAFT Evolution is the meeting, while the Promotion Loop is the specific knowledge management action that takes place during that meeting. It is the mechanical act of hardcoding human learnings into the AI's global brain.
- Identification: Throughout the cycle, if a Forward Deployed Engineer notices their AI consistently hallucinates a specific API call, attempts to bypass security, or executes highly inefficient loops, they document a corrective rule in their personal Local Craft. Similarly, they may build an effective new local GenAI workflow. The Promotion Loop is not limited to AI rule fixes; it also applies to human learnings: a clever architectural approach, a problem-solving technique, a user-interaction insight, or a workflow pattern that proved significantly more effective than the team’s current default. These are equally promotable.
- Validation & Inspection: During the synchronous CRAFT Evolution event, developers share these local insights. The team evaluates if the AI mistake is a systemic risk or if the new workflow is valuable enough for the whole team to adopt.
- Promotion & Cleanup: If validated, the constraint (or tool workflow) is physically copied out of the Local Craft and pasted into the Core Craft (or configured in the shared tool workspace). Crucially, the rule or workflow must then be deleted from the local setup to maintain a single source of truth and prevent conflicting instructions. This cleanup extends to the tool’s own rule file hierarchy: if the promoted rule existed as a personal or workspace-scoped rule file in the FDE’s local tool configuration, that file must also be removed or updated to reference the Core Craft version. Similarly, if the insight originated from the tool’s auto-generated memory store, the FDE should verify that the memory does not conflict with the newly promoted Core Craft rule; stale or contradictory auto-memories are a common source of agent confusion after promotions.
- Systemic Hardening: Because all agents are instructed to treat the Core Craft as absolute law, that specific mistake is instantly eradicated across the entire team, and new efficiencies are immediately scaled. The framework learns, adapts, and hardens in real-time.
CRAFT Promotion Loop
The Team Agreement
The Team Agreement is the team’s operational contract: a living document that captures all process decisions, governance policies, and infrastructure configurations that govern how the humans work together, but that AI agents do not need to read. It is explicitly not part of the Core Craft and is never loaded into an agent’s context window. Where the Core Craft tells the AI how to behave, the Team Agreement tells the humans how to operate.
What belongs in the Team Agreement:
- Micro-Cycle duration (e.g., 5 days) and the rationale behind it.
- Model governance: pinned model versions, task-to-model mappings, fallback model configurations, and model deprecation response plans.
- Budget and cost targets: API token budgets per Micro-Cycle, cost-per-Blueprint thresholds, and escalation rules when budgets are exceeded.
- Meeting cadences and timeboxes: any team-specific adjustments to Evolution, Calibration, or Flow Sync defaults.
- Release Wave cadence & rollout model: how frequently the team ships waves, the default rollout strategy (e.g., direct vs. tiered/canary), and any user-absorption constraints.
- Cockpit configuration: which tool the team uses, what custom fields are tracked, and how automated state transitions are wired.
- Team composition and role assignments: who holds which CRAFT role, and any role-combining decisions for small teams.
Visibility: Key operational parameters from the Team Agreement, especially Micro-Cycle duration, current model versions, and budget status, should be surfaced on the State of the Craft cockpit so they are visible to the entire team in real time without opening a separate document.
Ownership: The Flow Orchestrator maintains the Team Agreement and reviews it at every CRAFT Calibration. Changes follow the same PR discipline as the Core Craft: proposed via pull request, reviewed by at least one other team member, and merged with a clear rationale. The Team Agreement is version-controlled alongside the codebase but is never referenced by any AI agent configuration.
The distinction matters: The Core Craft has a strict 200-line budget because every line competes for the AI agent’s attention. Filling it with operational governance (model versions, budget limits, meeting schedules) wastes that budget on information the agent will never act on, while pushing out the security guardrails and coding standards it must follow. Keep the Core Craft for agent instructions. Keep the Team Agreement for human agreements.
Measuring CRAFT Success
CRAFT does not use velocity points or sprint burndowns. Success is measured by the health, speed, and sustainability of the overall system. If these signals are trending in the right direction, the team is executing CRAFT correctly.
The Meta-Signal: Agentic Forecasting Accuracy. Of all the metrics below, one stands above the rest as a composite indicator of overall team maturity: the accuracy of the AI-generated Effort Weights from Agentic Forecasting. When forecasting accuracy improves over time, it means the Core Craft context is rich and current, Blueprint specifications are precise enough for the AI to reason about scope, the team’s execution patterns are stable and predictable, and the codebase is well-structured enough for the agent to estimate impact reliably. Conversely, declining forecasting accuracy is an early warning that one or more of these foundations is degrading, before the impact shows up in cycle time or quality metrics. The Product Strategist and Flow Orchestrator should treat Effort Weight Accuracy (tracked under Flow Metrics) as the single best leading indicator of system health: when the AI can accurately predict how long work will take, the entire CRAFT system is functioning well.
1. Blueprint Cycle Time (How fast are we shipping?)
Time from a Blueprint entering “In Progress” to reaching “Done” in production. Should show a decreasing trend as the Core Craft matures. If cycle time is increasing, Blueprints are either too large, the pipeline has friction, or the team is in the Acceleration Trap.
2. Gate 1 First-Pass Rate (Are our AI instructions working?)
Percentage of PRs that pass the automated pipeline on first push. Target: above 70% and improving. A declining rate means the Core Craft rules are stale or Blueprints are under-specified; both are fixable system problems, not people problems.
3. Effort Weight Accuracy (Can we trust our delivery forecasts?)
How closely do AI-generated effort estimates match actual delivery time? Target: within 20% deviation. This is the single best leading indicator of overall system health. When the AI can accurately predict how long work takes, the entire CRAFT system is functioning well.
4. HITL Frequency Rate (How autonomous is our AI really?)
How often do engineers need to correct or override the AI agent. Should show a decreasing trend as the Core Craft hardens. A rising rate signals that agent instructions need attention.
5. API Cost per Blueprint (Are we spending wisely?)
Total AI inference cost divided by completed Blueprints. Should be stable or decreasing as the team optimises model selection and prompt efficiency. A spike indicates a process problem (looping agents, oversized context windows), not a budget problem.
6. Calibration Health Score (Is the team sustainable?)
Self-reported team health (Clarity, Autonomy, Momentum) from the monthly Calibration. Should be stable or improving. A declining score is a leading indicator of burnout; action is required immediately, not at the next Calibration.
The critical anti-pattern for leadership to watch: If Blueprint Cycle Time is decreasing while Gate 1 First-Pass Rate is also decreasing, the team is shipping faster by lowering quality standards. This is the AI equivalent of declaring bankruptcy to show profit. The Flow Orchestrator must flag this pattern immediately and the team must slow down to fix their Core Craft before resuming pace.
The business case in one sentence: AI makes individual developers faster. CRAFT makes the entire organisation faster, because it solves the bottleneck that AI creates.
-
- Blueprint Cycle Time: How long does it take from a Blueprint entering “In Progress” to reaching “Done” in production? This should shorten with each Micro-Cycle as the Core Craft matures and the AI makes fewer mistakes.
- Gate 1 Pass Rate: What percentage of feature branches pass the automated CI/CD pipeline on the first push? A low pass rate signals that either Blueprints are under-specified or the Core Craft security guardrails are not being followed. Both are fixable system problems.
- Blueprint Queue Depth: Is the backlog growing faster than the team can execute it? If yes, Blueprints may be too large, or the FDEs need more automation support. If no, the pipeline is healthy and the Strategist should accelerate Blueprint creation.
- Effort Weight Accuracy: How closely do the AI-generated Effort Weights from Agentic Forecasting match actual Blueprint execution time? This is tracked at every CRAFT Evolution (Part 3) by comparing forecasted weight against real cycle time. A consistently accurate forecasting model means the Product Strategist can trust ROI calculations and prioritization decisions. A consistently inaccurate one signals that either the Core Craft context fed to the forecasting agent is stale, the Blueprint specifications are too vague, or the team’s execution patterns have shifted enough to require a prompt update. Improving this metric over time is a direct measure of how well the team’s AI system understands its own codebase.
- Off-Hours Execution Ratio: What percentage of total agent execution time occurs outside core working hours (evenings, weekends, holidays)? A healthy CRAFT team should see 30–50% of agent compute happening off-hours, indicating that FDEs are consistently dispatching work before ending their sessions. A ratio near 0% signals that the team is not leveraging always-on execution. This metric is reviewed at every CRAFT Evolution alongside Blueprint Cycle Time, and teams that increase their off-hours ratio typically see a direct reduction in cycle time because Blueprints no longer wait for the next business day to resume execution.
-
- Hallucination Recurrence Rate: Is the same AI mistake appearing in multiple FDEs' Local Craft logs? If yes, it is a systemic issue that should have been promoted to the Core Craft. A declining recurrence rate is a direct signal that the Promotion Loop is working.
- Security Findings per Micro-Cycle: Are critical or high-severity SAST/DAST findings appearing in the pipeline? A declining trend confirms that the Harness Engineer's Core Craft guardrails are catching vulnerabilities before they reach staging.
- Gate 2 Rejection Rate: How often does the Product Strategist reject a staged feature? Frequent rejection signals a gap between Blueprint specification and FDE execution, typically caused by an ambiguous “Desired Outcome” section in the Blueprint.
- Mean Time to Recovery (MTTR): For P1 and P2 incidents, how long from detection to full service restoration? MTTR should trend downward as the team builds more reliable rollback paths, tightens HITL thresholds, and improves observability. A rising MTTR signals that incident response discipline is slipping or that the system is becoming harder to reason about under pressure.
- Test Coverage Trend: Is automated test coverage growing with each Micro-Cycle? Coverage should increase as Hardening Blueprints execute and as the Harness Engineer improves the acceptance criteria in new Blueprints. A flat or declining coverage trend in an AI-accelerated team is a significant risk signal; it means the system is building faster than it is verifying.
- HITL Frequency Rate: How often does an FDE need to correct, override, or restart an AI agent during Blueprint execution? This is tracked per Blueprint and reviewed at every CRAFT Evolution. A declining HITL Frequency Rate is the single strongest signal that the Core Craft is maturing; it means the agent is encountering fewer situations where human judgment must override its output. A flat or rising rate indicates that either the Core Craft is not capturing the corrections being made (the Promotion Loop is stalling), or that Blueprint specifications are too vague for agents to act on reliably. FDEs should log every intervention in their Local Craft with a brief reason code (e.g., hallucinated API, convention violation, scope drift, security boundary crossed) so the Evolution can identify which categories of intervention are declining and which persist. Target: a week-over-week decline during the first 3–6 Micro-Cycles, stabilising below 15% of total agent interactions for well-instrumented codebases.
-
Sustainability metrics ensure the team’s speed is durable, so the humans, the knowledge system, the infrastructure, and the environment can sustain the pace indefinitely. A team that burns through people, budgets, or platform stability to hit short-term throughput targets is not executing CRAFT; it is sprinting toward collapse.
- API Token Burn vs. Output Ratio: Is the team generating increasing value while holding or reducing token consumption? Declining efficiency signals that agent prompts are looping, context windows are polluted with irrelevant data, or HITL checkpoints are being hit excessively, all of which have specific remedies in the CRAFT system.
- CRAFT Calibration Health Score: After each monthly Calibration, does the team’s self-reported Clarity, Autonomy, and Momentum score improve? Stagnant or declining scores require the Flow Orchestrator to act, not wait until the next Calibration.
- Off-Hours Boundary Compliance: Always-on execution means the agents work around the clock, not the humans. Track when FDEs are actively interacting with agents (committing, reviewing, handling HITL checkpoints) versus when only dispatched agents are running. If human activity consistently extends deep into evenings and weekends, the team is not leveraging asynchronous orchestration; it is burning out its people under an AI-accelerated workload. The Flow Orchestrator should monitor this at every Calibration: a healthy pattern shows concentrated human activity during working hours with agent-only execution outside those hours. A pattern where humans and agents are both active at midnight signals a discipline failure, not dedication.
- Core Craft Churn Rate: How frequently are rules being added, modified, or removed from the Core Craft per Micro-Cycle? Moderate, steady churn (2–5 changes per cycle) signals a healthy, learning system: the Promotion Loop is operating and the team is continuously hardening agent behaviour. Zero churn over multiple cycles means the Promotion Loop has stalled: either FDEs are not logging learnings in their Local Craft, or the Evolution is skipping the Promotion Loop step. Excessive churn (10+ changes per cycle) signals instability: rules are being added reactively without sufficient validation, or the Core Craft is being used as a dumping ground for temporary fixes. The Flow Orchestrator tracks this metric and reviews the churn log at every Evolution.
- Promotion Loop Velocity: How many Local Craft insights are promoted to the Core Craft per Micro-Cycle? This is the direct measure of the team’s learning rate. A healthy team promotes 1–3 validated insights per cycle during the first 3–6 cycles, tapering to occasional promotions as the Core Craft matures. A velocity of zero for two or more consecutive cycles is an urgent signal: it means the team is either not encountering new agent failure patterns (unlikely), not documenting them in Local Craft (a discipline failure), or not running the Promotion Loop during Evolutions (a process failure). The Flow Orchestrator should diagnose which of these three causes applies and address it immediately.
- Model Availability & Fallback Rate: How often does the team’s primary AI model API return errors, timeouts, or degraded responses that trigger a fallback to the secondary model? Track this as a percentage of total API calls per Micro-Cycle. A rising fallback rate is an infrastructure risk signal: it means the team’s primary execution engine is unreliable and Blueprints are being executed on a potentially less capable model. The Flow Orchestrator reviews this at every Evolution. If the fallback rate exceeds 5% consistently, the team should evaluate whether the primary model should be permanently replaced, documented in the Team Agreement with the same PR discipline as any model change.
- Pipeline Reliability (Gate 1 Uptime & Execution Time): Is the automated CI/CD pipeline available and performing? Track Gate 1 uptime (percentage of time the pipeline is functional and accepting PRs) and mean Gate 1 execution time (how long from PR push to pass/fail result). A slow or flaky pipeline is the single fastest way to destroy CRAFT’s asynchronous flow: if FDEs cannot trust that Gate 1 will return results promptly, they stop pushing and start waiting, collapsing the continuous execution model into a synchronous queue. Target: 99.5%+ uptime and under 10 minutes mean execution time. The Flow Orchestrator owns pipeline health and escalates degradation to the platform team immediately.
- Context Window Efficiency: Are agents using their context budgets effectively, or is most of the window consumed by irrelevant files? This can be approximated by tracking the ratio of files loaded into agent context versus files actually modified or referenced during Blueprint execution. A low efficiency ratio (many files loaded, few used) indicates that Blueprint Context Loading Instructions are too broad, or that the Core Craft is not being split into purpose-specific files as recommended. Wasted context directly degrades agent output quality: every irrelevant file competes with your actual instructions for the agent’s attention. FDEs should review context loading patterns for completed Blueprints and tighten the instructions for future ones.
- Carbon-Aware Compute (GreenOps): AI model inference has a measurable environmental footprint. Token consumption maps directly to compute hours, which maps to energy usage and carbon emissions. CRAFT teams that track sustainability should log estimated carbon impact alongside token cost at the Blueprint level; most major cloud providers and AI API providers now expose carbon intensity data or regional energy mix information. This metric is not about guilt; it is about engineering discipline. The same practices that reduce carbon (smaller context windows, fewer retries, right-sized model selection, efficient prompts) also reduce cost and improve output quality. Teams that optimise for GreenOps typically see a 20–40% reduction in token spend as a side effect. The Flow Orchestrator reports this metric at the monthly Calibration alongside API Token Burn.
Implementing CRAFT: Getting Started
Adopting CRAFT is not a big-bang transformation. The framework is designed to be bootstrapped incrementally, starting with the foundational infrastructure and letting the process harden organically through each Micro-Cycle. Below is the recommended sequence for a team adopting CRAFT for the first time.
Day 0: Build the Foundation Before You Build Anything Else
Before a single line of AI-generated code is written, the team must establish the three non-negotiable foundations:
- Stand up the Core Craft: The Flow Orchestrator and FDEs collaborate to create the initial
project-instructions.md(or tool-equivalent) at the root of the repository. At a minimum, it must define: the tech stack and architecture principles, security non-negotiables (secrets handling, forbidden patterns), coding style standards, and which HITL checkpoints apply globally. This does not need to be perfect; it needs to exist. It will harden with every Micro-Cycle. Rather than starting from a blank file, teams can bootstrap the Core Craft from a persona-based agent framework (e.g., BMAD or RuFlo; see “Bootstrapping with Persona-Based Agent Frameworks” below). Installing such a framework first gives you a working set of agent personas, workflow templates, and default rules; the team then reviews, trims, and maps those defaults into the Core Craft, so the Core Craft starts already grounded in a proven baseline rather than being written from scratch. - Set up the State of the Craft cockpit: The Flow Orchestrator configures the team's live tracking tool. Blueprint states, pipeline health signals, and API budget visibility must be in place before work begins. A team flying blind on Day 1 will never build the habit of trusting the cockpit.
- Establish the AI toolchain and MCP servers: The FDEs confirm which Generative AI tools, MCP servers, and GenAI workflows are available. Any missing access (licenses, credentials, enterprise approvals) is flagged immediately to the Flow Orchestrator to unblock before development starts, not after.
Within CRAFT, these agent persona files map directly to GenAI Workflows and AI Skills in the Knowledge Threads hierarchy. They are tools that FDEs use during execution—not a replacement for the methodology itself. The critical distinction: a persona-based framework gives your agents structure and capabilities; CRAFT gives your team the governance, verification, knowledge management, and continuous improvement system that ensures those agents produce reliable, enterprise-grade results.
How to integrate: Install the agent framework into your repository. Review its agent definitions and map them to your Core Craft’s coding standards and security guardrails. Treat each agent persona file as a GenAI Workflow—version-controlled, reviewed via PR, and maintained through the Promotion Loop. Remove or override any default behaviors that conflict with your Core Craft rules. The framework accelerates Day 0 setup; CRAFT governs everything that happens after.
Brownfield Adoption: Starting on an Existing Codebase
Day 0 assumes a new project. Most enterprise teams are not starting from zero; they have a 3-year-old Rails monolith, a microservices ecosystem with undocumented conventions, and a team already running Scrum. CRAFT is explicitly designed to be adopted incrementally into existing environments. Do not attempt a big-bang transformation.
Stage 1: Build the Core Craft from what exists (Week 1–2)
- Use an AI agent to analyse the existing codebase and generate a first-draft Core Craft. Feed it the repository, any existing architecture docs, coding guidelines, and security policies. The output will be imperfect, so the team reviews and trims it to the 200-line maximum, removing anything stale or incorrect. This is faster than writing from scratch and more accurate than doing it from memory.
- Identify the existing test suite. If automated coverage is below 60%, designate the first Hardening Blueprints of the adoption to close that gap before AI-generated features rely on it.
- Identify the most critical HITL thresholds for this codebase (e.g., no AI modifications to payment logic, no schema migrations without Harness Engineer sign-off). Add these to the Core Craft first; they are non-negotiable before any AI agent touches the codebase.
Stage 2: Run CRAFT on new features only (First 2–4 Micro-Cycles)
- Do not convert the existing backlog to Blueprints overnight. Pick the next 2–3 new features and run the full Blueprint CRAFTing process for those. Let the existing team handle existing bugs and maintenance in their current way while the team learns the CRAFT rhythm.
- Run the CRAFT Evolution after each Micro-Cycle even if the cycle was short or imperfect. The Evolution is where the team learns; skipping it defeats the purpose.
Stage 3: Full migration (Micro-Cycle 5+)
- Once the team has run 3–4 full Micro-Cycles with confidence, migrate all new work to Blueprints. Legacy bug fixes and maintenance can continue informally for now, but new features and significant enhancements must follow the full CRAFT flow.
- A realistic timeline to stable CRAFT operation on a brownfield codebase: 4–6 Micro-Cycles. Teams that try to rush this consistently report higher Core Craft quality issues and lower Gate 1 pass rates in the first few months. Patience in the adoption stage compounds into velocity later.
Agent-Driven Team Onboarding
When a new team member joins a CRAFT team, they should be onboarded by an agent, not by scheduling a series of knowledge-transfer meetings. The team maintains an onboarding.md workflow file, an agent-executable document that a new team member runs with their AI agent on their first day.
The onboarding.md workflow typically instructs the agent to: walk the new member through the full Core Craft (reading each rule and explaining the reasoning behind it), review the team’s current HITL thresholds and what triggered their creation, summarise the Blueprints currently in progress and their status on the cockpit, explain the Local Craft conventions each FDE follows, and run a dry-run Blueprint review exercise using a recently completed Blueprint as a worked example. The agent asks questions and checks understanding rather than just presenting information passively.
Maintaining the onboarding workflow is the Flow Orchestrator’s responsibility. The onboarding.md is reviewed at every CRAFT Calibration (Part 1: Framework Adoption Health) and updated whenever: the Core Craft has a major structural change, a new tool or MCP server is added to the team’s toolchain, HITL thresholds change, or the team receives feedback that a new member was confused about something the workflow should have covered. An outdated onboarding workflow is an impediment; the Orchestrator treats it like any other blocker in the system.
A growing narrative in the industry claims that Generative AI makes junior developers obsolete. This is dangerously short-sighted. What AI actually eliminates is low-value repetitive work, not the need for humans who are learning to think critically about software. Juniors who grow up orchestrating AI agents develop fundamentally different, and arguably stronger, engineering instincts than those who spent years writing boilerplate by hand. They learn to reason about intent, context boundaries, verification strategies, and system-level thinking from day one rather than after years of mechanical practice.
With agentic workflows, a junior developer paired with a well-configured agent and a solid Core Craft can safely execute Blueprints that would previously have required mid-level experience, because the guardrails, HITL thresholds, and Gate 1 automation catch the mistakes that experience would normally prevent. The agent acts as both an accelerator and a teaching partner: it explains the reasoning behind code patterns, flags when the junior deviates from team conventions, and surfaces relevant Core Craft rules in context. The junior still makes the decisions; the agent ensures those decisions are informed.
Adaptive coaching agents: Teams can take this further by configuring agents that actively adapt their feedback to the developer’s experience level. The agent first assesses the developer’s current skill level and identifies specific knowledge gaps, whether through onboarding conversations, code review patterns, or the types of HITL halts the developer triggers. Once the baseline is established, the agent tailors its guidance during daily work: explaining why a pattern exists rather than just applying it, surfacing architectural reasoning behind decisions, recommending relevant Core Craft sections when the developer encounters unfamiliar territory, and progressively reducing hand-holding as competence grows. This turns every Blueprint execution into a structured learning opportunity: the junior receives contextual mentoring at the exact moment they need it, accelerating their path from junior to medior to senior without requiring constant senior developer time.
The result: juniors upskill faster, contribute meaningful output sooner, and develop the orchestration mindset that defines an effective FDE, all without compromising the team’s quality bar. Investing in junior talent is not a cost in the age of AI; it is a strategic advantage.
Skills for CRAFT Teams
A common question when adopting CRAFT is: what skills do our people actually need? The honest answer is that the scarce skill has moved upstream. Value no longer comes from typing code (agents do that cheaply) but from directing and verifying the system that produces it. Every CRAFT team member makes the transition from code generator to system steward and verifier. The skills below reflect that shift. They are deliberately stack-agnostic: CRAFT prescribes no language, framework, or model, so every skill is framed as “strong fundamentals in your team’s chosen tools,” never fluency in a specific one.
-
These skills are role-agnostic; without them, no CRAFT role functions. They matter more, not less, than in traditional teams: as raw coding commoditises, human skills rise in value.
- Critical thinking (the master skill): AI inverts the old equation: generation becomes cheap while evaluation becomes the bottleneck. Every CRAFT team member must judge not just whether agent output is correct, but whether it is appropriate, maintainable, and the right thing to build at all. Verification, judgment, and taste all descend from this one skill, which is also the skill most at risk of atrophy (see the meta-skill below).
- Context Management: Curating and continuously maintaining what each agent sees and excludes: the right files, the current rules, a minimal window. This is ongoing stewardship, not a one-time setup: preventing context rot, prompt drift, and stale memory Blueprint after Blueprint. The Core Craft, Local Craft, and Context Loading Instructions are all expressions of this skill.
- Verification & adversarial thinking: The habit of asking “how would I break this, and what did the agent get wrong?”, and building the checks that answer it. A builder must be able to switch into an independent-verifier mindset.
- Intent & specification clarity: Expressing the why and the desired outcome precisely enough that an agent cannot drift toward plausible-but-wrong work. Writing a good Blueprint is this skill in practice.
- Problem decomposition: Breaking an ambiguous need into tightly-scoped, executable units, the through-line of all agentic work.
- AI literacy: A working understanding of how LLMs, agents, MCP, and context windows behave, and their failure modes (hallucination, context rot, prompt injection). You cannot harness what you do not understand.
- Async written communication: CRAFT runs on the cockpit, Blueprints, and Craft files, not meetings. Clear writing is how the team coordinates.
- Judgment & taste: Reading the messy human signals an LLM misses; knowing the difference between output that merely works and output people actually value.
- Adaptability: The tooling shifts constantly; the Evolution and Calibration rhythm assumes people who keep learning.
-
The FDE carries the broadest skill range on the team: field-facing and build-facing at once.
- Software-engineering fundamentals in the team’s chosen stack: Full-stack capability in whatever the codebase actually uses. Specific languages and frameworks are table stakes, not the differentiator; fundamentals travel across stacks.
- Agent orchestration & MCP fluency: Driving AI agents to build features and wiring up the team’s chosen agent tooling and MCP servers.
- Building tests and observability into the software: Shipping automated tests and logs/metrics/traces as part of every Blueprint, not bolted on afterward.
- Field & customer skills (first-class): Empathy, active listening, and the ability to translate real user pain into a Blueprint, plus the range to explain trade-offs to a CTO and timelines to a non-technical sponsor. The technical solution is only part of an FDE’s job; understanding the real need is the rest.
- Product sense & radical ownership: Owning outcomes in the field, not just merged code.
-
The Harness Engineer combines verification depth, security, and system-efficiency skills.
- Eval design: Building and maintaining an eval suite that judges full agent trajectories (tool choice, argument validity, step count, cost, policy compliance), not just final output.
- Agent cost & efficiency optimization: A first-class skill. Understand whichever unit the organisation meters in (tokens, Agent Compute Units (ACUs), compute-time, or per-job/outcome), attribute cost per Blueprint, and drive it down through model tiering, context trimming, caching, and fewer retries/loops. The hard part is doing so without degrading quality: aggressive cost reduction hurts AI output in ways that compute reduction never did, so every optimization is paired with a quality check. ACUs, which meter active autonomous work rather than raw token throughput, matter increasingly as agents run longer and off-hours.
- Security & threat modeling: Prompt injection, data leakage through context, insecure MCP/tool permissions, and agent identity with least-privilege scoping.
- Guardrail & permission design: Turning evals into runtime guardrails; defining precisely what agents may and may not do.
- Observability & CI/CD: Instrumenting agent behaviour and designing the automated pipeline that is the real gate.
- Governance & compliance literacy: Mapping CRAFT’s structural controls to the team’s specific regulatory context.
-
The Strategist’s skills centre on judgment and the economics of agentic delivery.
- Agentic product judgment: Deciding what agents should do, how they should behave, and when they are working correctly, the defining product skill of the agentic era.
- AI-economics prioritization: Ranking work by business value against real execution cost (tokens or ACUs) and AI-specific risk, not value alone.
- Evaluation-framework literacy: Defining quality beyond “does it work,” and verifying business outcomes at Gate 2.
- Intent engineering & stakeholder influence: Expressing the “why” so clearly the agent cannot drift, and keeping stakeholders aligned so priorities do not thrash mid-execution.
- Responsible-AI ownership: Managing acceptable error rates, failure modes, and ethical guardrails, not just maintaining a feature list.
-
The Orchestrator’s skills span people, platform, and cost.
- Servant leadership & coaching: The multi-stance model: teaching, unblocking, coaching, and driving change without command-and-control.
- Change management: The human side of adoption, where most transformations fail: shielding the team and shifting the wider organisation.
- Platform-engineering literacy: Orchestrating (not necessarily building) paved roads, MCP access, and CI/CD with central platform teams.
- Cost governance / FinOps: Setting budgets, thresholds, and hard stops in the organisation’s unit (tokens or ACUs) with the same quality caveat the Harness Engineer applies.
- Cross-team scouting & translation: Moving validated patterns across teams and translating cockpit data into business language for leadership.
-
Across every role, one skill is both the through-line and the one most at risk: critical thinking under automation bias.
- The risk is real and measured: studies find a large majority of users trust AI output over their own judgment even when it is wrong. Skills like judgment, framing, and solution evaluation survive only through active use; when AI does the thinking, they atrophy.
- It is a team skill, not only an individual one: a technically brilliant team that cannot question each other’s reasoning makes worse decisions than a less-skilled team with a strong critical-thinking culture. CRAFT depends on people challenging assumptions, including the agent’s, without fear.
- CRAFT protects skills structurally: blameless post-incident reviews, the Context Reset, the monthly Calibration, mandatory HITL checkpoints, and agent-assisted junior upskilling all exist partly to keep human judgment sharp. Treat AI output as a first draft to be verified, never a final decision to be rubber-stamped.
The shape of a CRAFT professional is T-shaped: deep in one role’s craft, broadly literate across the whole system (context management, verification, AI failure modes, cost, governance). And the profile is more human than a traditional developer role, not less: communication, judgment, taste, and ownership rise in value precisely as raw code generation commoditises.
First Micro-Cycle: Learn by Doing, Not by Planning
The best way to learn CRAFT is to run a real Micro-Cycle on a scoped, low-risk feature. Deliberately choose something that touches all four roles so every team member experiences the full loop end-to-end.
- Forward Deployed Engineer: Draft the first real Blueprint in
planning.mdfrom a genuine user need, then add the technical layer, configure their Local Craft, set HITL thresholds in the AI tooling, and execute the Blueprint with the AI agent. Resist the urge to over-specify; a good first Blueprint is two pages maximum. Log every hallucination, every HITL halt, every prompt that worked or failed. - Product Strategist: Refine the Blueprint’s business Why, confirm the desired outcome and scope, prioritize it, and later run Gate 2 business verification. Practice owning the decision of what to build and when, not authoring the technical detail.
- Harness Engineer: Conduct the first PRA and add the initial acceptance criteria. The CI/CD pipeline gates do not need to be complete on Day 1, but at least one automated test must run as proof of concept.
- Flow Orchestrator: Observe the team's first execution actively. Note every friction point. At the end of the cycle, facilitate the first CRAFT Evolution with the specific goal of producing at least three Core Craft rules from the team's logs.
After the first Micro-Cycle, the team should hold a short informal debrief (separate from the formal Evolution) to answer: What felt right? What felt like we were fighting the framework? What would we do differently? These answers refine the next cycle.
CRAFT Anti-Patterns: What to Avoid
Most teams that struggle with CRAFT are not failing because of the technology; they are failing because they unconsciously drag old Agile habits into the new system. These are the most common anti-patterns and how to recognize them.
-
A Blueprint that says “build a login page” is useless. An AI agent needs explicit business context, acceptance criteria, security boundaries, and HITL thresholds to act autonomously. Vague Blueprints produce vague results, and the team loses trust in the AI engine fast.
-
Every time an FDE resolves an agent hallucination with a clever prompt fix and does not write it down, that fix disappears. The Local Craft is not optional documentation; it is the raw material for the Promotion Loop. No writes, no learning, no hardening.
-
The moment a team starts opening a Flow Sync to “check in” rather than to resolve a specific blocker, CRAFT degrades into Scrum. The State of the Craft cockpit replaces the standup. A Flow Sync is emergency surgery, not a morning coffee chat.
-
The Evolution is the framework's immune system. Teams that skip it because “things are going well” are accumulating technical debt in their AI instructions. The team thinks the AI is getting better when it is actually getting more fragile.
-
If a Strategist is in the FDE's workflow asking for status updates, something is wrong with the cockpit, not with the FDE. The Strategist's job is to prioritize the next Blueprint, not to manage the current one's execution.
-
HITL checkpoints are deliberately designed friction. An AI agent pausing before a database migration is working correctly. The anti-pattern is FDEs disabling HITL thresholds to “speed things up,” which removes the only safety net between the agent and a production incident.
-
If every local rule gets promoted to the Core Craft without proper validation, the global instruction file becomes so long and contradictory that the AI cannot parse it effectively. The Promotion Loop exists precisely to prevent this: validate first, promote only what is systemic.
-
If an FDE ships a feature and the staging environment has no logs, no metrics, and no traces, verification is impossible. Observability is not a post-launch concern in CRAFT; it is a Blueprint requirement. If an FDE's AI does not bake observability in, it is a Core Craft rule gap, not a product gap.
-
Informally editing the Core Craft mid-cycle without a PR, without a review, and without triggering behavioral regression tests. This is the most dangerous anti-pattern in agentic development: it is invisible, cumulative, and the damage is rarely noticed until production. A team member notices the agent is producing slightly worse output, makes a “quick fix” directly to
project-instructions.md, and does not document why. Three weeks later, the agent behaves inconsistently across Blueprints and no one can trace why. The Core Craft is version-controlled production infrastructure. Every change goes through a PR. -
Putting every piece of architectural knowledge, every code example, every edge-case rule into the Core Craft because “the AI might need it.” Context stuffing produces the opposite of what teams expect: agent output quality degrades as context grows beyond the optimal window, because the model’s attention gets diluted across irrelevant tokens. The 200-line limit exists precisely to prevent this. If a team is approaching the limit, the answer is always split-and-scope, not expand-and-hope.
-
Running an AI agent on a Blueprint with no explicit HITL thresholds, no loop detection constraints, and no token spend cap. Teams that do this are not practicing CRAFT; they are practicing hope. “The AI will stop when it’s done” is not a control. HITL thresholds are not bureaucracy; they are the mechanism by which humans remain the expert in the lead. An agent with no defined stopping conditions will eventually do something irreversible at the worst possible moment.
-
If agents only run while FDEs are at their desks, the team is operating at a fraction of its capacity. AI agents do not need sleep, coffee, or commute time. An FDE who powers down at 5pm without dispatching a single overnight task is treating the AI as a pair programmer that clocks out when they do. The anti-pattern is not occasional; it is systemic: if the cockpit shows zero agent activity between 6pm and 9am across an entire Micro-Cycle, the team is leaving its most powerful productivity multiplier idle for two-thirds of every day. The fix is cultural and structural: Blueprints should be tagged for off-hours executability, FDEs should build end-of-session dispatch into their daily routine, and the Evolution meeting should review off-hours throughput as a first-class metric.
-
A Blueprint is 90% complete. The remaining 10% (an edge case, a subtle system interaction, a concurrency concern) resists every prompt refinement the FDE attempts. Hours pass. The sunk cost of the current session makes starting over feel irrational, but closing the gap exceeds the cost of doing the remaining work differently. This is a scope recognition failure, not a prompting failure: the easy 90% follows patterns the AI handles well; the hard 10% requires novel reasoning about system-specific constraints that the agent lacks context for. The correct response is to commit the working 90%, revert the broken attempts, and decompose the remaining work into separate, tightly-scoped tasks, each with a fresh session and concentrated context loaded specifically for that sub-problem. Before re-executing, update the Local Craft (and flag for Core Craft promotion if the pattern is reusable) with whatever the failed attempts revealed about the system’s constraints. Three focused dispatches will always outperform an open-ended retry loop. Recognising the trap early is a skill the Flow Orchestrator should actively coach; FDEs who consistently log “session exceeded 40 turns on the last 10% of a Blueprint” in their Local Craft are exhibiting a pattern that the Evolution should address structurally.
Agentic Execution Discipline: Practical Guidance for FDEs
The following principles are not part of the CRAFT Engine’s workflow phases; they are practical execution habits that every Forward Deployed Engineer must internalise. Mastering these disciplines is what separates an FDE who uses AI from an FDE who orchestrates AI effectively.
1. Stale references. The agent references a file it read or modified more than 3–4 turns ago. Its internal model of that file is now competing with everything that happened since, and losing. The agent will make edits based on an outdated mental snapshot.
2. Error spirals. You have pasted more than two error messages into the same session. Each paste adds context that pulls the agent toward debugging symptoms rather than rethinking the approach. A fresh session with the error described in one sentence often resolves in one turn what three debugging turns could not.
3. Conversation length. The session exceeds roughly 30–40 turns. At that point, your Core Craft rules and Blueprint context are buried under pages of dialogue, and the agent’s effective behaviour has drifted from where it started.
When resetting, carry forward a one-paragraph summary of what was decided and what remains, not the full conversation. Log the reason for the reset in the Local Craft if it reveals a pattern (e.g., a Blueprint that consistently causes long sessions may need to be decomposed). Fresh context beats accumulated drift, every time.
When a Blueprint spans many files or touches multiple concerns, FDEs should not attempt to execute it in a single unbroken agent session. Instead, decompose the execution into dependency-ordered waves: sequential batches of work where each wave can run one or more agents in parallel.
The one-file-one-agent rule: Within a single wave, no two agents may modify the same file. Most AI agents edit files using text-matching; if Agent A modifies a file and Agent B tries to edit the same file, the text Agent B expects has already changed. The edit fails silently or produces corrupted output. If two concerns both require changes to the same file, those changes go to a single agent within that wave, or they are sequenced across separate waves.
Wave structure: Each wave completes fully (code committed, tests passing) before the next wave begins. This creates a clean checkpoint: agents in Wave 2 read the committed output of Wave 1, not a description of what should exist. Early waves establish foundations (shared types, utility functions, new patterns); later waves consume those foundations. When a wave fails, the FDE diagnoses whether the issue is a missing context problem (add the missing file to the next dispatch), a scope problem (split the task further), or a tooling problem (work around the limitation).
Recovery waves: When a wave produces output that is individually correct but inconsistent with prior waves, the FDE creates a targeted recovery wave, scoped to exactly the affected files with the missing context included. Fix forward with surgical precision rather than reverting entire waves. The cost of three focused dispatches is always lower than an open-ended retry loop on a single bloated session.
Why it matters: an agent given a clear verification signal produces markedly higher-quality output, because it has something concrete to self-correct against, with nothing ambiguous to hallucinate around. An agent with no self-check will confidently produce plausible, subtly wrong results. The Harness Engineer is accountable for ensuring every Blueprint type has an appropriate verification loop wired into the harness; the FDE ensures the agent is actually pointed at it during execution. A Blueprint whose only verification happens at Gate 1 is under-instrumented: push the fastest possible check as close to the agent’s execution loop as it will go.
The one rule that makes this work: subagents inherit nothing implicitly. Anything a subagent needs (file paths, prior decisions, user constraints, URLs) must be passed explicitly in its prompt, because it cannot see the coordinator’s history. This is the multi-agent expression of CRAFT’s Context Loading Instructions. Do not confuse this with Wave-Based Execution (which parallelises agents across different files to avoid edit collisions): coordinator/subagent is about isolating context; wave-based is about parallelising file work, and they compose well, since a coordinator can dispatch a wave of subagents. The governance around this (zero-trust between agents, signed handoffs, and the Core Craft’s allow-list of which agents may invoke which) is covered under Agent-to-Agent Orchestration in Knowledge Threads.
The Next Step: Self-Hardening Agents
Everything above places a CRAFT team at what the wider field calls Orchestrated: agents execute and coordinate the work, and humans govern the system and harden the harness by hand. The Harness Engineer runs the root-cause analysis, decides what becomes a Core Craft rule, and keeps the Promotion Loop turning. The learning is real, but it is human-run. There is one more step, and it does not replace anything here: it adds a class of agents that take on part of the hardening itself, under supervision.
The principle is the one CRAFT already lives by, System Over Output. When something breaks in production, the reflex is to fix the output; a CRAFT team fixes the system so the whole class of failure cannot recur. Self-hardening agents automate the first half of that loop. A Hardening Agent watches the signals the team already produces, bug reports, incident alerts, error traces, failing evals, and when it finds a recurring or high-confidence issue it does two things in the background: it diagnoses and drafts a fix for the output, and it drafts the matching harness change, a new eval, a Core Craft rule, or a guardrail, so the same mistake is caught next time. It arrives not with a patch, but with a patch and a reason it will not happen again.
What keeps this safe is the discipline that already defines CRAFT: the human stays in the loop. The agent proposes; an engineer reviews and accepts or rejects. Nothing it drafts, neither the output fix nor the harness change, merges on its own. Each change clears the same Gate 1 and the same human review as any Blueprint, and the agent that drafts a change is never the instance that approves it (the propose-and-verify separation from the roles section holds here too). What the agent removes is the toil of noticing, diagnosing and drafting; what the human keeps is the judgement and the final say.
This is the move from Orchestrated toward AI-native: the system begins to improve itself rather than waiting for a person to improve it, which is the self-learning loop that defines the top of the maturity ladder. But it is AI-native with the accountability left in. Because an engineer accepts every change, a named human still answers for what ships and for how the system evolves. Cross that line, let the hardening agents merge their own changes with no human approval, and you reach the fully self-governing corner CRAFT deliberately does not recommend today, for the same reason it keeps humans on every other gate: an agent cannot be accountable, and hardening the system is one of the highest-stakes things a team does. Where a given CRAFT team lands, Orchestrated or the supervised edge of AI-native, is therefore an implementation choice. It depends on how much of the hardening loop you let the agents run, and you should widen that only as fast as your evals, observability and review capacity can keep the changes safe.
A few rules keep self-hardening on the safe side of the line:
- Propose, never merge. Hardening Agents open Blueprints and pull requests; they do not approve or deploy their own work. Every change clears Gate 1 and a human review.
- Separation of duties holds. The agent that drafts a fix is not the instance that signs off its risk analysis. Governance agents may check the work, but a human owns the accept.
- Harness changes get more scrutiny, not less. A new Core Craft rule or guardrail affects every future Blueprint, so it is reviewed harder than a one-off fix and lands as version-controlled Infrastructure as Code.
- Raise autonomy with your evidence. Widen what the agents may do only as eval coverage, observability and review throughput grow. The eval-to-guardrail lifecycle earns the trust; the review queue, not the model, is the real limit.
The CRAFT Commitment
CRAFT is not a process to be adopted partially. It is a system designed around one principle: that the combination of a small, expert human team and a well-instructed AI engine will consistently outperform any traditional development organization of any size. But this only holds true when the system is operated with discipline.
The Core Craft must be maintained. Blueprints must be explicit. HITL thresholds must be respected. The Promotion Loop must run. The Calibration must not be skipped. Anti-patterns must be called out and corrected by the team, not tolerated for the sake of short-term speed.
Teams that commit to this discipline will find that, within a few Micro-Cycles, the system begins to compound. Each Evolution hardens the AI's behavior. Each Orchestrator Sync spreads that improvement across the organization. Each Calibration strengthens the team's ability to sustain the pace. The result is not just faster software; it is a continuously self-improving engine for delivering business value, built on a foundation of human expertise, AI execution, and shared accountability.
The expert is always in the lead. The AI accelerates the execution. And the team’s real product is the system that produces the output, not the output itself. CRAFT makes all three possible at scale.
Version: 1.1
Released: April 2nd, 2026 (last updated July 2026).
Feedback? Please use the contact form!
Key Terms: CRAFT Glossary
A quick reference for the vocabulary used throughout this framework. Expand to scan the terms an implementer needs to hold in mind.
planning.md): a machine-readable, AI-executable spec with business goal, desired outcome, scope, acceptance criteria, technical How, risk boundaries, HITL thresholds, and Effort Weight.project-instructions.md / agent.md): the shared rules, guardrails, and standards every AI agent treats as absolute law. Hard-capped at 200 lines.dev-instructions.md): their prompting habits and the recurring mistakes of their local agent, before promotion.CRAFT FAQ
Common questions from teams evaluating or adopting the CRAFT framework.
-
CRAFT is not an acronym; it is a deliberate name. It captures what a team in the AI era actually does: it crafts the system that builds the software, rather than hand-crafting every line itself. Just as a master craftsperson combines deep expertise with precision tools to produce work neither could achieve alone, a CRAFT team combines human judgment with an AI execution engine, continuously shaping, tuning, and hardening the harness so that the system it produces is faster, safer, and more reliable every Micro-Cycle. The name reflects the framework’s core belief: building great software in the AI era is still a craft, but the object of that craft has shifted from the code itself to the optimized system that generates the code. It demands expertise, discipline, and care, not just automation.
-
Teams transitioning from Scrum will recognize overlaps, but CRAFT roles are not 1:1 renames; they are structural upgrades designed for AI-accelerated execution.
- Product Owner → Product Strategist: The Strategist absorbs the Product Owner’s prioritization authority but operates asynchronously. They do not attend sprint planning or grooming ceremonies (which do not exist in CRAFT). Instead, they continuously draft and prioritize Blueprints, run Agentic Forecasting to calculate ROI, manage Release Waves, and verify business outcomes via Gate 2. The Strategist’s scope is broader: they own the pace of value delivery (user absorption), not just the backlog order.
- Scrum Master → Flow Orchestrator: The Flow Orchestrator inherits the Scrum Master’s facilitation mandate but adds platform advocacy, AI model & cost governance, external stakeholder communication, and multi-stance coaching. Where a Scrum Master removes impediments and protects the sprint, the Flow Orchestrator eliminates friction across the entire system: technical infrastructure, team adoption, cross-team knowledge sharing, and AI sustainability. The role is significantly more technical and more strategic.
- Developer → Forward Deployed Engineer (FDE): The FDE replaces the traditional Developer role but owns the full stack and the user relationship. Unlike a Scrum Developer who builds what the backlog prescribes, the FDE embeds with users, surfaces real-world signal, defines the technical How in the Blueprint, orchestrates AI agents for execution, ships automated tests built into the software alongside every feature, and closes the feedback loop between the product and its users. They are engineers, user researchers, and AI operators in one.
- Developer/QA Engineer/Tester → Harness Engineer: The Harness Engineer is the biggest structural upgrade from Scrum. Rather than manually testing features at the end of a sprint, they build and continuously improve the system that produces and verifies output: the agent harness. This absorbs the traditional QA/tester mandate (now the independent verifier who owns evals, golden trajectories, and the human side of Gate 1 for work they did not build) and extends it with token/context optimization, security and AI-agent governance (permissions, data access, context consumption), and automated pipeline enforcement. They do not manually click through features; they define the guides and sensors the pipeline enforces on every push, and root-cause every escaped defect back into the harness. In enterprises, this role is often shared across teams or split: an embedded Harness Engineer for daily Blueprint-level tuning and shared AppSec / Platform Engineering experts for global standards.
Key structural difference: In Scrum, ceremonies (sprint planning, daily standup, sprint review, retrospective) create the rhythm. In CRAFT, artifacts create the rhythm: the Blueprint, the Core Craft, and the Cockpit drive continuous flow without synchronous ceremony overhead. The only mandatory synchronous events are the CRAFT Evolution (end of each Micro-Cycle) and the monthly CRAFT Calibration.
-
No. You need the four accountabilities covered, not four separate people. In a small or early-stage team, one person can hold more than one role (most commonly Forward Deployed Engineer + Harness Engineer), and the Product Strategist and Flow Orchestrator are frequently shared across several teams rather than embedded full-time. What must never be dropped, regardless of team size, is the accountability itself, especially independent verification. A single person combining roles must still enforce the deliberate context-switch: build, then reopen the work as an adversarial verifier. See the Small Team Note in the Ecosystem section.
-
Those are tools; CRAFT is the operating model around them. Giving individuals an AI coding assistant makes each developer faster, but it does not fix (and often worsens) the system-level bottlenecks: review queues balloon, AI-generated technical debt compounds, and instructions drift. CRAFT exists to make the whole team and organisation faster by treating the agent harness (instructions, context, guardrails, tests, verification, governance) as the primary product. The tools execute; CRAFT governs, verifies, and continuously hardens how they execute. See “System Over Output” and The Acceleration Trap.
-
A Blueprint is scoped by a single coherent business outcome, not by a technical layer or a fixed size. A good rule of thumb: small enough that an agent can execute it in one focused session (roughly 25–50 tool calls / 30–60 minutes of wall-clock execution before a natural checkpoint), and specified clearly enough to be tagged fully-autonomous or low-touch for off-hours dispatch. If a feature genuinely needs multiple sequential Blueprints (e.g., data model before API), group them under a Blueprint Epic. If your Blueprints consistently spill across Micro-Cycles or trigger long, looping sessions, they are too large, so decompose them.
-
CRAFT is model- and vendor-neutral. The framework’s controls (Core Craft rules, context loading discipline, gates, HITL checkpoints, and the Harness Engineer’s data-classification review) apply identically whether you run a frontier cloud API, a regional/sovereign endpoint, or a self-hosted open-weight model. Data residency and provider data-handling terms are exactly what the Harness Engineer validates before any data enters an agent’s context window (see the Harness Engineer role and Data Classification & Context Privacy). Some regulated contexts may prohibit certain cloud APIs entirely; pin an approved model in the Team Agreement and enforce it via model governance.
-
Yes: a solo builder can run CRAFT, and it is a strong fit for indie developers and tiny startups. One person holds all four accountabilities, supported by the AI engine. The discipline that makes it work is role-switching: you draft and build as the FDE, then deliberately close that mindset and re-open the work as the Harness Engineer (verify, break, harden) and the Strategist (is this the right thing?). The artifacts (Blueprint, Core Craft, Local Craft) and the two gates keep you honest when there is no second pair of eyes; the automated pipeline is your independent verifier. In regulated settings, separation of duties may still legally require a second person.
Read more
The three phases
CRAFT
Craft (write) the prompt with the following elements: Context, Register, Acting Role, Format, and Task.
ING
Validate the prompt and ensure it maintains an interactive approach. Keep in mind the importance of non-disclosure and staying goal-driven throughout the process.
AI
Continuously assess and refine the output based on the prompts output to improve the overall quality.