1 of 1 Pages
C
Anthropic Partner Academy · Exam Prep

Claude Certified Architect
Professional

A complete self-study course and reference for exam CCAR-P
Exam CCAR-P  ·  7 Domains  ·  63-Item Practice Exam  ·  120 Minutes
7 domains covered  ·  63 exam items + 56 domain practice questions  ·  Aligned to the official CCAR-P blueprint
Edition July 2026
This guide is built directly from the official Claude Certified Architect Professional Exam Guide (v1.0, effective July 2026) published by Anthropic on the Partner Academy. It covers every domain and task statement in the blueprint in full, with worked examples, sample items in the exact style of the real exam, and a complete 63-item practice exam weighted to match the official blueprint. This is an independent study guide. It is not produced, endorsed, or authorized by Anthropic. Exam details, model names, and pricing are current as of the edition date and can change. Always confirm against the official certification page before your exam. "Claude" and "Anthropic" are trademarks of Anthropic PBC.
Contents

Table of Contents

Click any entry to jump straight to it. You can also use the sidebar on the left at any time, filter chapters with the search box, and move with the / arrow keys.

Start Here

How to Use This Guide

One document, everything you need. This guide is written to be read start to finish like a book. No external course is required to use it, though pairing it with hands-on Claude API work is strongly recommended.

What this credential actually tests

The Claude Certified Architect Professional exam (CCAR-P) is not a trivia quiz about API parameters. It is written for the minimally qualified candidate (MQC): an experienced architect who can take a business problem, design a production-grade Claude solution for it, defend the trade-offs to stakeholders, and keep it safe, compliant, and observable once it ships. Every one of the 63 scored items on the real exam is written against a specific task statement in the official blueprint, so this guide is organized around that blueprint, domain by domain, task by task.

◆ The single most important habit

Don't just memorize facts: practice making trade-off decisions. Nearly every real exam item (see the sample questions in Section 8 of the official guide) presents a scenario and asks you to pick the best option among several plausible ones. The distractors are usually technically-true-but-wrong-for-this-situation. Train yourself to ask "what does this specific scenario actually need?" before answering.

How the guide is organized

  • Start Here (this section): how to use the guide, a 6-week study plan, and the full official exam blueprint and policies.
  • Domains 1-7: one chapter per content domain, in blueprint order. Each chapter opens with the official task statements, then explains every one of them in depth with diagrams, tables, and worked examples, then closes with a "Key Takeaways" card you can use for rapid review.
  • Practice Questions pages follow every domain chapter: 8 scenario-style items per domain (56 total) with click-to-reveal answers and rationale, written in the exact style and cognitive level of the real exam.
  • Full-Length Practice Exam: 63 items, weighted to match the official blueprint percentages exactly (11/8/12/10/9/9/4), simulating the real exam end to end.
  • Glossary and External Resources: a reference you can scan the night before the exam, plus links to official Anthropic documentation for deeper hands-on practice.

How to navigate

Use the left sidebar to jump to any chapter, or the Next / Previous buttons at the bottom of each page to move sequentially like a book. Your reading progress is tracked in the sidebar as you go. On mobile, tap the ☰ icon to open the chapter menu. Practice question answers are hidden by default: click ▸ Reveal answer to check yourself only after you've committed to a choice.

What you will NOT find here

No actual exam questions are reproduced anywhere in this guide. Doing so would violate the confidentiality agreement every candidate accepts before sitting the exam. Every sample and practice item here is original, written to match the blueprint's stated cognitive level and the style shown in the official guide's sample questions, not drawn from or reconstructed from the live item bank.

Start Here

Six-Week Study Plan

Built for a working architect who can dedicate roughly 4-6 hours a week. Compress to three weeks by doubling up if you're already running Claude in production; stretch to ten weeks if you're newer to LLM systems.

WeekFocusDeliverable / self-check
1Read the exam blueprint and policies in full. Read Domain 1 (Solution Design & Architecture) and Domain 2 (Models, Prompting & Context Engineering). Stand up a Claude API account and make your first calls.Complete the Domain 1 and Domain 2 practice question sets; score 6/8 or better before moving on.
2Read Domain 3 (Integration) in full. This is the highest-weighted domain (19%). Build a small RAG pipeline end to end (chunk, embed, index, retrieve, generate) and wire up one real MCP server.Complete the Domain 3 practice set. Write one paragraph explaining, from memory, the difference between MCP, direct API/CLI integration, and agent-to-agent protocols.
3Read Domain 4 (Evaluation, Testing & Optimization). Build an eval set of at least 20 test cases for the pipeline you built in Week 2 and run it before/after a prompt change.Complete the Domain 4 practice set. Produce one real eval report (even a spreadsheet) from your own pipeline.
4Read Domain 5 (Governance, Safety & Risk) and Domain 6 (Stakeholder Communication & Lifecycle Management). Draft a one-page architecture decision record (ADR) for your Week 2 project as if presenting to a client.Complete both practice sets. Have a peer or mentor read your ADR and give feedback.
5Read Domain 7 (Developer Productivity & Operational Enablement). Review the Glossary. Re-read every "Key Takeaways" card across all seven domains.Complete the Domain 7 practice set. Re-take any domain practice set you scored below 75% on originally.
6Take the full 63-item practice exam under timed conditions (120 minutes, no notes). Review every miss in the answer key, focusing on why the correct answer beat the distractor. Re-read the one or two domains where you're weakest.Score a practice pass rate of 80%+ (roughly matching the 720/1000 scaled cut score) before scheduling the real exam.
◆ Hands-on practice matters more than reading

The MQC profile in the official guide explicitly expects 6+ months of hands-on Claude/LLM production experience. If you're studying this guide without that background, budget real time to actually build: one small RAG app, one agent with 2-3 tools, one evaluation harness, and one MCP integration. Reading about trade-offs is not the same as having made them under a deadline.

Start Here · Authoritative Reference

Exam Blueprint & Policies

Summarized directly from the official Claude Certified Architect Professional Exam Guide (Version 1.0, effective July 2026, exam code CCAR-P). This is the authoritative scope of the exam. Everything else in this book is built to teach it.

Exam at a glance

Items63 scored items: multiple-choice and multiple-response (each item states how many responses to select)
Time limit120 minutes (plan ~135 minutes total seat time including check-in and survey)
DeliveryProctored via Pearson VUE: online proctored or test center
Passing scoreScaled score of 720 on a 100-1,000 scale (criterion-referenced, not curved)
Fee$175 USD (partner-tier discounts may apply)
Validity12 months from the date awarded; free on-time renewal assessment thereafter
RetakesWaiting periods of 14 / 30 / 90 days after the 1st / 2nd / 3rd fail; max 4 attempts per rolling 12 months

Content domains and weights

DomainWeight
1 · Solution Design & Architecture17%
2 · Models, Prompting & Context Engineering13%
3 · Integration19%
4 · Evaluation, Testing & Optimization16%
5 · Governance, Safety & Risk Management14%
6 · Stakeholder Communication & Lifecycle Mgmt14%
7 · Developer Productivity & Operational Enablement7%

Integration (19%) and Solution Design (17%) together make up more than a third of the exam: spend disproportionate study time on RAG design, connection protocols (MCP vs. API/CLI vs. agent-to-agent), and end-to-end architecture patterns.

Intended audience & minimally qualified candidate

This certification targets mid- to senior-level solution architects, AI/ML engineers, technical leads, and senior software engineers who own the full lifecycle of a Claude-based system: model selection, prompt/context engineering, tool and agent orchestration, and safety/compliance/governance, and who advise clients or internal stakeholders on architecture. It explicitly excludes entry-level developers, casual users, and roles limited to prompt writing without system design responsibility.

Recommended (not required) background: a foundation in software engineering best practices; 3+ years in systems architecture or platform engineering; 6+ months of hands-on production experience with Claude or comparable LLM systems; and experience delivering systems from discovery through operationalization. There are no mandatory prerequisites: the credential is awarded on exam performance alone.

Scoring & results

CCAR-P is criterion-referenced: you are measured against a fixed standard set by subject-matter experts, not ranked against other candidates. Your score report shows a pass/fail result, a scaled score (100-1,000, cut score 720), and the percentage of items you got right in each of the seven domains, useful for targeting a retake, but not itself the pass/fail determinant.

Conduct, retakes, and renewal

  • Exams are closed-book: no notes, translation tools, or AI assistants are permitted.
  • A government-issued photo ID matching your registration name is required.
  • Failing candidates can retake after 14 days (1st fail), 30 days (2nd), or 90 days (3rd); max 4 attempts per exam per rolling 12 months, full fee each time.
  • The credential is valid 12 months; renewing on time requires only a free, non-proctored assessment reviewing what changed since you certified. A lapsed credential requires the full exam again.
◆ Sample item style (from the official guide)

A team exposes a customer-support agent that can read tickets, draft replies, issue refunds, and delete user accounts. Support staff only ever need to read tickets and draft replies. Applying least-privilege principles, which change best reduces risk?

Correct answer: remove the refund and delete tools from the agent's configuration entirely. Logging and confirmation prompts are detective/compensating controls, not removal of unnecessary privilege, and a bigger model doesn't change authorization scope. This pattern, "which option actually eliminates the risk vs. which merely manages it", recurs constantly across the real exam.

Start Here · Technical Reference

Claude Platform & API Essentials

The concrete product and API knowledge the domain chapters assume you already have. If you've built on Claude for six months this is review; if not, read it carefully. The exam expects you to reason about these specifics, not just concepts. Exact model names, prices, and limits evolve, so verify current figures in the official docs (links on the Resources page); the reasoning patterns are what the exam tests.

P.1 The Claude model family

Claude is a family of models spanning a capability / speed / cost spectrum. As of this guide's edition the current line-up is below. You are not expected to memorize prices to the cent, but you must be able to reason about the relative trade-offs and pick a tier for a scenario.

ModelPositioningContext / max outputRelative cost & speed
Claude Haiku 4.5Fastest, near-frontier intelligence, lowest cost200K in / 64K outCheapest, fastest
Claude Sonnet 5Best balance of speed and intelligence, the default workhorse1M in / 128K outMid cost, fast
Claude Opus 4.8Complex agentic coding and enterprise reasoning1M in / 128K outHigher cost, moderate speed
Claude Fable 5Most capable widely-released model, built for long-running agents1M in / 128K outHighest cost, slower

Rough per-million-token pricing at this edition (input / output): Haiku 4.5 ≈ $1 / $5; Sonnet 5 ≈ $3 / $15; Opus 4.8 ≈ $5 / $25; Fable 5 ≈ $10 / $50. The pattern that matters: each step up the capability ladder is roughly 2-5× the cost of the one below, which is exactly why routing high-volume/simple traffic to a smaller tier and reserving the top tier for hard cases is the dominant cost architecture. All current models are multimodal (text + image/PDF input, text output), multilingual, and available on the Claude API plus Amazon Bedrock, Google Cloud (Vertex AI), and Microsoft Foundry.

◆ Model IDs are pinned snapshots

A model ID like claude-sonnet-5 or claude-opus-4-8 refers to a specific, fixed release, not an evergreen "latest" pointer. This matters for reproducibility and for diagnosing "model mismatch" regressions (Domain 4): pin the ID you evaluated against, and treat any version change as a trigger for re-evaluation.

P.2 The Messages API

Every Claude interaction is a request to the Messages API. The core shape:

  • system: the system prompt: role, reference material, guardrails, output-format rules (Domain 2). Sent once, separate from the turn-by-turn messages.
  • messages: an ordered array of turns, each with a role of user or assistant, alternating. Content can be text, images, documents, tool-use, and tool-result blocks.
  • max_tokens: the ceiling on output tokens for this response (counts toward the context window along with everything else).
  • Statelessness: the API has no server-side memory of prior turns: you resend the full relevant conversation history on every request. This is why context management and prompt caching (below) matter so much.
  • Stop reasons: each response reports why it ended: end_turn (natural completion), max_tokens (hit the output cap), tool_use (the model wants to call a tool), stop_sequence, or a refusal. Well-built systems branch on the stop reason rather than assuming completion.
  • usage: every response reports input, output, and cache token counts: the raw material for cost and observability instrumentation (Domains 3-4).

P.3 Tool use (function calling) and the agent loop

Tools are how Claude acts on the world: the mechanism beneath every workflow and agent in Domain 1. The loop:

  1. You send a request that includes a tools array. Each tool has a name, a description (prompt-engineer this like a docstring: it's how the model decides when to use it), and a JSON-Schema input_schema for its parameters.
  2. If Claude decides to use a tool, it returns a tool_use content block (with the tool name and structured input) and a stop reason of tool_use.
  3. Your code executes the tool and sends the result back as a tool_result block in a new user turn (referencing the tool_use ID). The model itself never runs your tools. It only requests them.
  4. Claude incorporates the result and either answers or requests another tool. This repeat-until-done cycle is the agent loop.

Key details the exam may probe: Claude can request multiple tools in parallel in one turn when they're independent (reducing round-trips); tool_choice can force, allow, or forbid tool use; and tool definitions count toward the context window and toward capability bloat (Domain 3): every tool you expose costs tokens and adds a decision the model can get wrong. Well-designed tools follow the agent-computer-interface (ACI) principles from "Building Effective Agents": clear names, thorough descriptions with examples, and inputs designed so mistakes are hard to make (e.g., absolute over relative file paths).

◆ Server tools vs. client tools

Some tools run on your side (client tools: you execute them and return results). Others are server tools Anthropic executes within the API call itself, such as web search, web fetch, code execution, and the memory tool. Server tools reduce integration work but still consume tokens and must be reasoned about for cost, latency, and, critically, the prompt-injection risk of pulling untrusted external content into context (Domain 5).

P.4 Thinking, adaptive reasoning, and effort

Modern Claude models can allocate internal reasoning ("thinking") before answering, improving accuracy on multi-step problems at the cost of extra output tokens and latency:

  • Extended thinking: an explicit, budgeted reasoning phase you enable, with a token budget that is a subset of max_tokens and billed as output tokens.
  • Adaptive thinking: newer models allocate thinking dynamically per request, so usage varies with problem difficulty: no fixed budget to set.
  • Effort: a parameter (e.g., on Opus 4.8 and Sonnet 5) controlling how much reasoning/work the model puts in; higher effort trades cost and latency for thoroughness. It defaults to high on several surfaces: set it explicitly to economize on simple tasks.
  • Interleaved thinking: the model can think between tool calls, reasoning about each result before the next action: important for reliable agents.

Thinking tokens count toward the context window. When passing tool results back mid-cycle you must return the unmodified thinking block that accompanied the tool request (it carries a cryptographic signature); how long previous thinking blocks persist across turns is model-dependent.

P.5 Prompt caching mechanics

Caching (introduced conceptually in Domain 2) is the highest-ROI cost/latency lever. The mechanics you should know:

  • What it does: marks a stable prompt prefix so repeated requests reuse the already-processed tokens instead of reprocessing them.
  • Cost model: a cache write costs ~1.25× normal input (5-minute TTL) or ~2× (1-hour TTL); a cache read/hit costs ~0.1× normal input. So caching pays off whenever a prefix is reused more than a couple of times within its lifetime.
  • TTL: 5 minutes by default (refreshed for free on each hit); a 1-hour option exists at higher write cost for prompts reused less often than every 5 minutes.
  • Ordering & hierarchy: the cache covers the prefix in the order tools → system → messages. A change at any level invalidates that level and everything after it (e.g., editing a tool definition busts the entire cache).
  • Breakpoint placement: put the cache boundary on the last block that stays identical across requests. Placing it on content that changes every request (a timestamp, the live user message) guarantees a permanent miss: the single most common caching mistake.
  • Minimums: there is a minimum cacheable prefix length (varies by model, on the order of 1K-4K tokens); shorter prefixes are silently not cached. Verify via the usage cache fields.

P.6 Context management features

The context window is a finite, decaying working memory (Domain 2's "context rot"). Beyond curating what you put in it, the platform offers:

  • 1M-token windows on Sonnet 5, Opus 4.8, and Fable 5 (200K on Haiku 4.5). More room is not automatically better. Accuracy still degrades as you fill it.
  • Compaction: server-side summarization of earlier conversation so a long-running session can continue past the window limit without you hand-rolling summarization.
  • Context editing: automatic clearing of stale tool results or thinking blocks to reclaim space in agentic loops.
  • Context awareness: some models track their own remaining token budget during a task, so they can manage long work against the space that's left.
  • Token counting: an API to estimate a request's token cost before sending it: use it to make deliberate trade-offs and avoid overflow (which returns a 400 "prompt is too long" if the input alone exceeds the window).

P.7 Retrieval building blocks (for RAG)

Domain 3 designs RAG pipelines; here are the components those designs are made of:

  • Embeddings: vector representations of text capturing semantic meaning, so "reset my password" and "I can't log in" land near each other. Produced by an embedding model (Anthropic recommends third-party embedding providers; embeddings are not generated by the core Claude chat models themselves).
  • Vector database / index: stores embeddings for fast nearest-neighbor (similarity) search, usually with metadata for filtering (date, document type, and, critically, access-control tags so retrieval respects the user's permissions).
  • Dense (semantic) vs. sparse (lexical/keyword, e.g., BM25) search: semantic search for fuzzy natural-language matching; lexical for exact terms (SKUs, error codes, citations). Hybrid search combines both.
  • Reranking: a second, more precise pass that reorders an initial broad candidate set to surface the truly most relevant chunks: the "recall then precision" two-stage pattern.
  • Citations: a Claude API feature that ties generated claims back to specific source passages, directly supporting groundedness and the anti-hallucination controls in Domains 4-5.

P.8 MCP: the Model Context Protocol

MCP is the open standard for connecting AI applications to external tools and data ("USB-C for AI"). Its architecture (tested in Domain 3):

  • Host: the AI application the user interacts with (e.g., Claude Desktop, an IDE, a custom app).
  • Client: the connector inside the host that maintains a 1:1 connection to a server.
  • Server: a program exposing capabilities over MCP: this is what you build or install to connect a data source or tool.
  • Server primitives: tools (actions the model can invoke), resources (data/context the server can supply), and prompts (reusable prompt templates the server offers).
  • Transports: local servers over stdio; remote servers over HTTP-based transport.

MCP's value is reusability: build one server and any MCP-compatible client can use it, versus writing bespoke glue per integration (direct API/CLI) or coordinating across trust boundaries (agent-to-agent). Because MCP servers can carry untrusted data into context and expose real actions, apply least-privilege scoping and prompt-injection defenses (Domain 5).

P.9 Skills, the Agent SDK, and Claude Code

  • Agent Skills: packaged, reusable procedural knowledge (instructions, scripts, reference files) that Claude discovers and loads only when relevant: progressive disclosure that keeps context lean (Domains 2-3).
  • Claude Agent SDK: Anthropic's framework for building custom agent harnesses (the loop, tool wiring, context/session management) without reinventing the plumbing, while still letting you see the underlying prompts, which "Building Effective Agents" stresses.
  • Claude Code: the agentic coding tool that applies Claude inside a development workflow: reading a codebase, editing across files, running tests and commands under human oversight, and the reference point for Domain 7's developer-enablement objectives (shared config, permission boundaries, reusable Skills).

P.10 Supporting API features worth knowing

  • Structured outputs: constrain responses to a JSON schema so downstream systems get reliably parseable output (fewer format-failure errors than free-text-plus-parsing).
  • Batch API: asynchronous processing of large request volumes at a significant discount, for non-latency-sensitive workloads (bulk classification, offline evals), a key cost lever in Domain 4.
  • Files API & PDF/vision support: upload and reference documents and images; a single request can include many pages/images up to request-size limits.
  • Streaming: tokens returned incrementally for responsive UX; the first token's latency (TTFT) is what caching and pre-warming optimize.
  • Deployment surfaces: Claude API, Amazon Bedrock, Google Cloud Vertex AI, and Microsoft Foundry, relevant to data-residency and compliance choices (Domain 5), since where the model runs affects which regulatory guarantees apply.
◆ Key takeaways: Platform Essentials
  • Know the four-tier model family and that each step up is ~2-5× the cost, the basis for routing architectures.
  • The Messages API is stateless; you resend history, which is why caching and context management matter.
  • Tool use is a loop: the model requests tools via tool_use, your code executes and returns tool_result; tools cost context and add bloat risk.
  • Caching: write ≈1.25×, read ≈0.1× input cost; place the breakpoint on the last identical block; tools→system→messages hierarchy governs invalidation.
  • RAG is built from embeddings, a vector index, dense/sparse/hybrid search, and reranking: match the mix to the data and query.
  • MCP = host / client / server exposing tools, resources, and prompts: chosen for reusable, standardized integration.
Domain 1 · Weight 17%

Solution Design & Architecture

The skill of turning a fuzzy business problem into a concrete, defensible system design, and choosing the simplest architecture that actually meets the requirement.

Official task statements

  • Translate business problems into Claude-based AI solutions
  • Design end-to-end architectures (input → processing → output → feedback loops)
  • Select appropriate architectural patterns (workflow, agentic, augmented LLM)
  • Design multi-agent systems and orchestration strategies
  • Apply decomposition techniques for complex problem solving
  • Align solutions to business value pillars (efficiency, transformation, productivity, cost, performance SLAs)

1.1 Translating business problems into solutions

Every architecture starts with a problem statement, not a technology choice. A recurring failure mode among junior architects is reaching for an agent when a single well-crafted prompt would do, or reaching for fine-tuning when better context engineering would do. The discipline is to work backward from the outcome:

  1. What decision or output does a human currently produce, and what does "good" look like for it?
  2. What information is required to produce that output, and where does it live today (documents, databases, APIs, tribal knowledge)?
  3. What is the acceptable error rate and the cost of an error? A drafting assistant that occasionally needs a human edit tolerates far more risk than a system that auto-approves loan decisions.
  4. What is the volume and latency requirement? Ten decisions a day tolerates a slow, expensive, heavily-reviewed pipeline; ten thousand a day does not.

Only after answering these should you pick a pattern. The Anthropic engineering guidance on agent design is blunt about this: "find the simplest solution possible, and only increase complexity when needed." Agentic systems trade latency and cost for flexibility. That trade only pays off when the task truly can't be predicted in advance.

1.2 End-to-end architecture: input → processing → output → feedback

Every production Claude system, no matter how simple or complex, can be described in four stages. Being able to draw and narrate this loop is one of the most commonly tested architecture skills:

◆ The four-stage loop
  • Input: how does data enter the system: a user message, a webhook, a scheduled batch job, a document upload? What normalization or PII handling happens before it reaches Claude?
  • Processing: the core reasoning layer: the model call(s), any retrieval, any tool/agent orchestration, any guardrail or safety check applied before and after generation.
  • Output: how the result is delivered: rendered to a user, written to a database, triggering a downstream action (an email send, a refund, a ticket update), and what human-in-the-loop gate, if any, sits between generation and action.
  • Feedback loop: how the system learns whether it worked: explicit user ratings, implicit signals (did the human edit the draft heavily?), logged evaluation traces, or escalation/override records, and how that signal flows back into prompt, retrieval, or eval improvements.

A design that stops at "output" without a feedback mechanism is incomplete for this exam's purposes: Domain 4 (Evaluation) and Domain 6 (Lifecycle Management) both assume the feedback loop exists and is instrumented from day one, not bolted on later.

1.3 Architectural patterns: augmented LLM, workflow, and agent

Anthropic's own engineering guidance ("Building Effective Agents") draws a precise vocabulary that the exam expects you to use correctly. Get comfortable with the distinction between a workflow (LLM calls orchestrated through code you wrote) and an agent (the LLM decides its own next steps and tool calls in a loop).

The augmented LLM (the base building block)

A single Claude call enhanced with retrieval, tools, and memory. Most production use cases, a support macro generator, a document summarizer, a classification step, never need to go beyond this. Always ask whether an augmented LLM call, possibly with good in-context examples, already solves the problem before adding orchestration.

Workflow patterns (predefined code paths)

PatternWhat it doesBest fit
Prompt chainingDecomposes a task into a fixed sequence of LLM calls, each processing the previous step's output, with optional programmatic "gate" checks between steps.Tasks that decompose cleanly and predictably, e.g., draft an outline → validate the outline against criteria → write the full document.
RoutingClassifies the input first, then sends it to a specialized downstream prompt or model.Distinct input categories that are best handled by different prompts or model sizes, e.g., route simple FAQs to Claude Haiku and complex escalations to Claude Sonnet or Opus.
Parallelization (sectioning)Splits an independent task into parallel subtasks whose outputs are aggregated programmatically.Guardrail checks running alongside the main response; multi-aspect evaluation; independent document sections.
Parallelization (voting)Runs the same task multiple times to obtain diverse outputs, then combines by majority or threshold.Code vulnerability review by several independent prompts; content moderation where false positives/negatives must be balanced.
Orchestrator-workersA central LLM call dynamically decomposes the task and delegates to worker calls, then synthesizes results.Tasks where subtasks can't be predicted up front: multi-file code changes, open-ended research and synthesis.
Evaluator-optimizerOne call generates, another evaluates and critiques in a loop until criteria are met.Tasks with clear evaluation criteria and demonstrable benefit from iterative refinement: literary translation, multi-pass search synthesis.

Agents (model-directed control flow)

An agent is an LLM that plans, calls tools based on environmental feedback (tool results, code execution output), and decides its own next step in a loop, typically until a stopping condition (task complete, max iterations, or a human checkpoint) is reached. Agents suit open-ended problems where the number of steps can't be predicted in advance and where you're willing to trust the model's judgment in a bounded, monitored environment. The cost is real: higher latency, higher token spend, and the possibility of compounding errors across many turns, which is exactly why Domains 4 and 5 (evaluation and guardrails) exist.

◆ Exam heuristic: workflow vs. agent

If you can draw the decision tree on a whiteboard before writing any code, it's a workflow. If the number and nature of steps genuinely depends on what the model discovers along the way, it's an agent. When an exam scenario describes a fixed, auditable sequence, the workflow answer is usually correct even if an "agentic" option sounds more impressive. Impressiveness is a distractor, not a design goal.

1.4 Multi-agent systems and orchestration strategies

When a single agent's context would grow too large, or when genuinely independent sub-domains of expertise are needed, multi-agent designs come into play. Two dominant shapes:

  • Orchestrator (lead) + subagents: A lead agent decomposes the goal, dispatches focused subagents (each with its own tightly-scoped tools and context window), and synthesizes their results. This keeps each subagent's context clean and lets subagents run in parallel, at the cost of coordination overhead and the need to pass compact, well-structured handoffs rather than raw context.
  • Peer-to-peer / agent-to-agent: Independent agents (potentially owned by different teams or organizations) communicate through a defined protocol rather than a shared orchestrator, useful when agents cross trust or organizational boundaries.

Multi-agent orchestration adds real cost. Every subagent call is billed independently, and coordination introduces new failure modes (a subagent stalling, conflicting subagent outputs, runaway recursive delegation). Justify multi-agent designs only when a single agent's context or tool surface would genuinely become unmanageable; otherwise a single well-tooled agent or a workflow is more reliable and cheaper.

1.5 Decomposition techniques for complex problems

Decomposition is the architect's core lever for controlling cost, latency, and reliability simultaneously. Useful techniques:

  • Functional decomposition: split by capability (retrieve → reason → format) so each step can use the cheapest model and simplest prompt that satisfies it.
  • Data decomposition: split a large input (a long document, a big dataset) into independently processable chunks, then merge: trades latency for parallelism and avoids context-window and context-rot problems.
  • Confidence-gated escalation: attempt the cheap/fast path first (small model, short prompt); escalate to a larger model or human review only when confidence is low or stakes are high.
  • Checkpointing: insert deterministic, code-based validation gates between LLM steps (schema validation, business-rule checks) so errors are caught before propagating downstream.

1.6 Aligning solutions to business value pillars

The exam expects architects to justify a design in business terms, not just technical ones. Learn to map every design decision to one or more of these pillars:

PillarWhat it meansTypical evidence
EfficiencyDoing the same work with less human time or costReduced average handling time, fewer FTEs needed per ticket volume
TransformationEnabling work that wasn't previously possible or economicalNew product capability, previously-uneconomical personalization at scale
ProductivityAmplifying the output of existing staffEngineers shipping more PRs per week with Claude Code; analysts covering more accounts
CostDirect spend on inference, infra, and staffing to run the system$/request, $/resolved-ticket, total cost of ownership vs. the human-only baseline
Performance SLAsContractual or operational commitments on latency, availability, and accuracyP95 response time, uptime, accuracy floor tied to a support/legal commitment

A strong architecture narrative states, explicitly, which pillar(s) the design optimizes for and which it consciously trades away. For example: "we chose Claude Haiku with a routing layer over a single large-model call because the SLA requires sub-second responses for 90% of traffic, accepting a small accuracy trade-off on the hardest 10% of cases, which we route to a slower, larger model."

◆ Key takeaways: Domain 1
  • Always start from the business problem and the required decision quality, latency, and volume, not from the coolest available pattern.
  • Know the augmented-LLM → workflow → agent complexity ladder and when to stop climbing it.
  • Every architecture needs all four stages: input, processing, output, and a feedback loop, a design missing feedback is incomplete.
  • Multi-agent systems add cost and coordination risk; justify them only when a single agent's scope is genuinely unmanageable.
  • Be able to name which business value pillar(s) (efficiency, transformation, productivity, cost, or SLA) a given design choice serves.
Domain 1 · Practice Questions

Solution Design & Architecture

8 scenario-style items. Commit to an answer before revealing the rationale.

Item 1 · Select one
A mid-size insurer wants Claude to draft responses to policy questions from a fixed FAQ document. Volume is roughly 200 requests/day, and every draft is reviewed by a human before sending. Which architecture best fits?
AA multi-agent system with a router, a retrieval agent, and a drafting agent
BAn augmented LLM call: retrieve relevant FAQ sections, then generate a draft in a single call
CAn autonomous agent empowered to search the web and send the reply directly
DA fine-tuned model trained on past policy Q&A pairs, called with no additional context
Correct: B. Low volume, a bounded knowledge source, and a human review gate mean the simplest augmented-LLM pattern (retrieval + single generation call) fully satisfies the requirement. A is unjustified complexity for a task with no real decomposition need. C removes the human gate the scenario requires. D throws away the ability to ground answers in the current FAQ and adds fine-tuning cost/latency for no stated benefit.
Item 2 · Select one
A support queue mixes simple order-status questions with complex billing disputes. Leadership wants faster average response times without sacrificing quality on hard cases. Which pattern most directly addresses this?
APrompt chaining: draft, then critique, then rewrite every ticket
BRouting: classify the ticket, send simple ones to a fast/cheap model and complex ones to a larger model
CVoting: run three models on every ticket and take the majority answer
DA single large model for all tickets with a longer system prompt
Correct: B. Routing is the textbook fit when inputs fall into genuinely distinct categories that warrant different handling: here, complexity/stakes. It directly reduces average latency and cost on the easy majority while preserving power on hard cases. A and C add cost/latency to every ticket, including the easy ones. D does nothing to differentiate simple from complex.
Item 3 · Select one
Which statement best distinguishes a "workflow" from an "agent" per Anthropic's architectural vocabulary?
AWorkflows use Claude; agents use a different underlying model class
BWorkflows orchestrate LLM calls through code you wrote; agents let the LLM dynamically direct its own process and tool use
CAgents are always faster than workflows because they skip planning
DWorkflows cannot use tools; only agents can call tools
Correct: B. The defining distinction is control flow: predefined code paths (workflow) vs. model-directed looping (agent). Both can use the same underlying models and both can call tools; agents are typically slower and costlier, not faster, because of their exploratory, multi-turn nature.
Item 4 · Select one
A code-review assistant must flag security vulnerabilities in submitted pull requests. The team wants to balance catching real issues against false-positive noise. Which workflow pattern is purpose-built for this trade-off?
AOrchestrator-workers
BParallelization (voting), where multiple independent review prompts must agree above a threshold before flagging
CPrompt chaining with a single reviewer step
DRouting by programming language only
Correct: B. Voting is explicitly suited to balancing false positives/negatives by requiring multiple independent judgments to agree. Orchestrator-workers fits unpredictable task decomposition, not a fixed review task. A single reviewer step or routing by language alone doesn't address the false-positive/negative trade-off at all.
Item 5 · Select one
A design is presented with a clear input stage, a well-tooled processing stage, and a polished output UI, but no mechanism to know whether generated answers were actually correct after the fact. From an architecture-completeness standpoint, what is missing?
AA larger context window
BA feedback loop connecting real-world outcomes back into evaluation and iteration
CA second model as a fallback
DA more detailed system prompt
Correct: B. The four-stage architecture loop (input → processing → output → feedback) is incomplete without feedback. Context size, fallback models, and prompt detail don't address the structural gap of never learning whether outputs were correct.
Item 6 · Select two
Which two factors most directly justify moving from a single-agent design to a multi-agent (orchestrator + subagents) design?
AThe task naturally decomposes into independent sub-domains that would otherwise overload one agent's context and tool surface
BThe team prefers using more advanced-sounding architecture in the pitch deck
CParallel execution of independent subtasks would materially reduce end-to-end latency
DThe customer specifically asked for "AI agents" by name
Correct: A and C. Genuine context/tool overload and real parallelism opportunities are legitimate engineering justifications. Terminology preference or a client's buzzword request are not engineering justifications and should not drive architecture.
Item 7 · Select one
A retail client says their goal is "let a small team of merchandisers handle triple the SKUs without hiring." Which business value pillar does this primarily map to?
ACost reduction only
BProductivity: amplifying existing staff output
CTransformation: enabling entirely new products
DPerformance SLA compliance
Correct: B. "Same team, more output" is the definition of productivity amplification. It's not primarily a cost-cutting story (headcount isn't shrinking), not a new product capability, and not an SLA statement.
Item 8 · Select one
During discovery, a stakeholder insists on an autonomous multi-agent system because "that's what's cutting-edge now," even though the task is a fixed three-step approval workflow with well-defined business rules. What is the architect's best response?
ABuild the multi-agent system as requested to satisfy the stakeholder
BRecommend the simpler workflow pattern, explaining the reliability, cost, and latency trade-offs of unnecessary agentic complexity
CRefuse to engage further until the stakeholder changes their mind
DBuild both and let the stakeholder choose after the fact
Correct: B. Part of the architect's job (see Domain 6) is communicating trade-offs and steering toward the right-sized solution, not the most fashionable one. Building unnecessary complexity, refusing to engage, or building two systems all fail to add value or move the engagement forward.
Domain 2 · Weight 13%

Claude Models, Prompting & Context Engineering

Choosing the right model, shaping its behavior, and managing the finite, decaying resource that is context.

Official task statements

  • Select appropriate Claude models based on trade-offs
  • Design system prompts, templates, and guardrails
  • Apply prompt engineering techniques (zero-shot, few-shot, chain-of-thought)
  • Optimize context windows and manage token usage
  • Implement prompt reuse strategies (caching, modular prompts, Skills)

2.1 Model selection trade-offs

The current Claude model family (as of mid-2026) spans a clear capability/latency/cost spectrum. You do not need to memorize exact prices, but you must be able to reason about the trade-off axes:

Model tierPositioningRelative latencyContext windowTypical fit
Claude Haiku (e.g., Haiku 4.5)Fastest, near-frontier intelligence at the lowest costFastest200k tokensHigh-volume classification, routing, extraction, latency-critical UX
Claude Sonnet (e.g., Sonnet 5)Best balance of speed and intelligenceFastUp to 1M tokensThe default workhorse for most agentic and coding workloads
Claude Opus (e.g., Opus 4.8)Complex agentic coding and enterprise-grade reasoningModerateUp to 1M tokensHighest-stakes reasoning, the hardest coding/agentic tasks, low-volume high-value decisions
Frontier tier (e.g., Claude Fable)Most capable widely released model, built for long-running agentsSlower1M tokensThe hardest long-horizon agentic work where capability matters more than cost or speed

The exam will not ask you to recite a price sheet, but it will ask you to reason like this: high volume + tight latency SLA + simple task → smallest capable model; low volume + high stakes + complex reasoning → largest capable model; mixed traffic → route between tiers. A common architecture is a router (Domain 1) that sends the bulk of easy traffic to Haiku and escalates ambiguous or high-stakes cases to Sonnet or Opus. The "efficient frontier" of cost vs. quality rarely lives at one single model choice.

Also weigh reasoning mode: modern Claude models support adaptive or extended thinking, which lets the model allocate more internal reasoning tokens to hard problems. This improves accuracy on multi-step reasoning at the cost of extra output tokens and latency: appropriate for complex planning or math-like tasks, wasteful for simple lookups.

2.2 System prompts, templates, and guardrails

The system prompt is the architectural control surface for a Claude application. A well-designed system prompt typically layers, in order:

  1. Role and objective: what the assistant is for, in plain terms.
  2. Static reference material: policies, product catalogs, tone guides (placed early and cached, see 2.5).
  3. Behavioral guardrails: explicit instructions on refusals, escalation triggers, tone boundaries, and what the model must never do (e.g., "never promise a refund amount; always direct to a human for anything above $500").
  4. Output format constraints: the exact structure downstream systems expect (JSON schema, a specific template), reducing parsing failures.

Templates (parameterized prompts with variable slots) let you standardize a family of related tasks, e.g., one template for "summarize document type X" reused across every document of that type, which both improves consistency and enables prompt caching (2.5).

2.3 Prompt engineering techniques

TechniqueWhat it isWhen to use
Zero-shotInstruction only, no worked examplesSimple, well-understood tasks where the model's general training already covers the pattern
Few-shotInstruction plus a small number of high-quality input/output examplesTasks with a specific desired format, edge cases, or house style the model wouldn't infer on its own. Anthropic's own guidance notes 20+ diverse, high-quality examples (made cheap via caching) often outperforms 2-3
Chain-of-thought (CoT)Explicitly instructing the model to reason step-by-step before answering, or providing space for it to "think" before committing to outputMulti-step reasoning, math, planning, or anywhere the model would otherwise jump to a plausible-but-wrong answer

On current Claude models, structured reasoning is also available as a first-class capability (adaptive/extended thinking) rather than purely a prompting trick, but classic CoT prompting ("think through this step by step") remains useful for models or modes without that feature enabled, and for making the reasoning process auditable to reviewers.

2.4 Context window optimization and token management

The context window is a working-memory budget, not a place to dump everything you might conceivably need. Two facts anchor this domain:

  • Context rot: accuracy and recall degrade as token count grows, even well within the nominal window limit. More context is not automatically better. Curating what's in context matters as much as how much room is available.
  • Everything counts: the system prompt, every message (including tool results, images, documents), tool definitions, and the model's own output (including any thinking tokens) all count against the window.

Practical optimization levers:

  • Summarization / compaction: periodically collapse older conversation turns into a compact summary rather than carrying full history forever, increasingly offered as a server-side feature so you don't have to hand-roll it.
  • Context/tool-result editing: clear stale tool results or superseded intermediate outputs from context once they've served their purpose.
  • Retrieval instead of stuffing: for large knowledge bases, retrieve only the relevant slice per request (see Domain 3's RAG content) instead of pasting entire corpora into every call.
  • Token counting before sending: estimate token usage ahead of a request to stay within budget and to make deliberate trade-off decisions instead of discovering overflow at runtime.

2.5 Prompt reuse: caching, modular prompts, and Skills

Prompt caching is the single highest-leverage cost/latency lever an architect controls. By marking a stable prefix (system instructions, static reference documents, tool definitions) as cacheable, repeated requests reuse that already-processed prefix instead of reprocessing it from scratch: cutting both cost (cached reads are billed at a small fraction of fresh input tokens) and time-to-first-token. The design rule that matters most for the exam: place static content first and put the cache boundary on the last block that stays identical across the requests you want to share a cache: a boundary placed on content that changes every request (a timestamp, the live user message) never gets a cache hit and silently costs more, not less.

Modular prompts decompose a large instruction set into composable pieces (a core persona block, a task-specific block, an output-format block) that can be assembled per request: easier to maintain, test, and independently cache than one monolithic prompt string.

Skills package reusable procedural knowledge (instructions, scripts, and reference files) that Claude can discover and load only when relevant, rather than keeping every possible capability's instructions resident in context at all times. This is the same "progressive disclosure" principle covered in Domain 3's discussion of tool and context strategy: load capability on demand, not everything up front.

◆ Key takeaways: Domain 2
  • Model choice is a trade-off across capability, latency, and cost: route traffic across tiers rather than picking one model for everything.
  • System prompts are the primary control surface: role, reference material, guardrails, and output format, in that order.
  • Match the prompting technique to the task: zero-shot for simple/familiar tasks, few-shot for format/style precision, chain-of-thought for multi-step reasoning.
  • Context is a decaying resource ("context rot"): curate aggressively; use compaction, context editing, and retrieval instead of context stuffing.
  • Prompt caching is a design decision, not an afterthought: static-first ordering and a stable cache breakpoint are what make it actually pay off.
Domain 2 · Practice Questions

Models, Prompting & Context Engineering

8 scenario-style items. Commit to an answer before revealing the rationale.

Item 1 · Select one
An application classifies 500,000 support tickets per day into 12 categories, with a strict sub-second latency requirement, and escalates only ambiguous cases to a human. Which model strategy is most appropriate?
AUse the largest available model for every ticket to maximize accuracy
BUse the fastest, smallest capable model for the bulk classification, with routing to a larger model or human only for low-confidence cases
CUse extended thinking on every call to improve reasoning quality
DBatch all tickets once per day using the largest model with no latency constraint
Correct: B. High volume plus a hard latency SLA plus a simple, well-understood task is the textbook case for the smallest capable model, with escalation reserved for the minority of hard cases. A and C add cost and latency with no stated accuracy problem to justify it. D ignores the stated real-time requirement.
Item 2 · Select one
A legal-drafting assistant must always follow a strict output structure (defined headings, clause numbering) that differs from what the model would naturally produce. Which prompting technique most directly addresses this?
AZero-shot instruction only
BFew-shot examples showing the exact desired structure
CLowering the temperature to 0
DSwitching to a smaller model
Correct: B. Few-shot examples are the most reliable way to convey a specific, non-default output format the model wouldn't otherwise infer. Temperature affects randomness, not structural compliance, and a smaller model doesn't address format adherence at all.
Item 3 · Select one
A team notices that as their multi-turn agent conversation grows past 60,000 tokens, answer quality and instruction-following measurably degrade, even though the model's context window is 200k tokens. What phenomenon does this describe, and what is a primary mitigation?
ARate limiting; mitigate by upgrading the API tier
BContext rot; mitigate by summarizing/compacting older turns and removing stale tool results
CModel deprecation; mitigate by pinning an older model version
DCache invalidation; mitigate by disabling prompt caching
Correct: B. Degrading accuracy and recall as token count grows, well within the nominal limit, is the definition of context rot. Compaction and context/tool-result editing are the direct mitigations. The other options describe unrelated failure modes.
Item 4 · Select one
An application sends an 8,000-token static policy document as part of the system prompt on every request, followed by a short, unique user question. The team enables prompt caching but places the cache breakpoint at the very end of the prompt, after the user's question. Cache hit rates remain at 0%. What is the most likely cause?
APrompt caching does not support system prompts
BThe breakpoint sits on content (the unique user question) that changes every request, so the prefix hash never matches a prior write
CThe policy document is too short to be cached
DCaching requires a paid add-on that was never enabled
Correct: B. Cache writes and lookback only work when the breakpoint sits on a block that is byte-identical across requests. Placing the breakpoint after the varying user text guarantees a miss every time; the fix is moving the breakpoint to the end of the static policy block, before the variable content.
Item 5 · Select one
Which best describes the relationship between "Skills" and standard system-prompt instructions, in terms of context management?
ASkills replace the need for any system prompt entirely
BSkills let procedural knowledge be discovered and loaded only when relevant, rather than keeping every instruction resident in context at all times
CSkills are only usable with the smallest models
DSkills increase token usage on every single request regardless of relevance
Correct: B. Skills implement progressive disclosure: instructions and reference material load on demand instead of bloating every request's context. They complement, not replace, the system prompt, and are model-agnostic.
Item 6 · Select one
A financial-services chatbot must never state a specific loan approval amount and must always redirect certain topics (bankruptcy, litigation) to a human specialist. Where does this behavior most reliably belong?
AAn informal comment in the internal engineering wiki
BAn explicit guardrail instruction in the system prompt, paired with downstream validation on output
CHoping the model infers the right boundary from general training
DA README file the model never sees
Correct: B. Guardrails must be explicit, in the model's actual input, and should be backed by a code-level check on the output for anything safety- or compliance-critical, never left to inference or documentation the model never reads.
Item 7 · Select one
A math-tutoring assistant frequently produces a plausible-looking but arithmetically wrong final answer, skipping intermediate steps. Which technique most directly targets this failure mode?
AFew-shot examples of unrelated tasks
BChain-of-thought prompting that requires the model to work through steps before giving a final answer
CReducing the system prompt length
DSwitching to automatic caching
Correct: B. Chain-of-thought reasoning is specifically effective against jumping straight to a plausible-but-wrong answer on multi-step problems. The other options don't address reasoning depth at all.
Item 8 · Select two
Which two changes would most directly reduce both cost and latency for a high-traffic application that repeatedly sends the same 6,000-token system prompt and tool definitions with every request?
AEnable prompt caching with the breakpoint placed after the static system prompt and tool definitions
BRewrite the system prompt in a different natural language
COrder the request so static content (system prompt, tools) precedes the varying user message
DIncrease the model's max_tokens output limit
Correct: A and C. Correct cache placement plus static-content-first ordering are exactly what makes a stable prefix cacheable and reusable. Translating the prompt has no cost/latency benefit, and raising max_tokens increases potential output size/cost rather than reducing it.
Domain 3 · Weight 19% (the largest domain)

Integration

Connecting Claude to real systems safely, efficiently, and observably: tools, retrieval, authentication, and protocol choice.

Official task statements

  • Evaluate tool/agent configuration for capability bloat
  • Analyze authentication and authorization requirements to identify security gaps
  • Evaluate accuracy-latency trade-offs and justify configuration decisions
  • Analyze observability challenges and select monitoring strategies at scale
  • Design a RAG pipeline with appropriate chunking and indexing strategies
  • Apply retrieval strategies matched to data shape and query pattern
  • Evaluate connection protocols and select the appropriate integration mechanism (MCP, API/CLI, agent-to-agent)
  • Evaluate progressive discovery vs. monolithic context strategy

3.1 Capability bloat in tool and agent configuration

Capability bloat is giving an agent more tools, permissions, or scope than the task requires. It causes three concrete problems: it enlarges the attack surface (Domain 5), it degrades tool-selection accuracy (the model must discriminate among more, often overlapping, tool definitions, and every extra tool definition also burns context tokens), and it increases the blast radius of any single failure or prompt injection. The corrective principle is least privilege: an agent should hold exactly the tools its task requires, no more. This is the same logic behind the official guide's own sample item: removing a refund/delete tool from a read-and-draft support agent eliminates the risk rather than merely monitoring it.

Practical checks for capability bloat: does every tool the agent can call actually get invoked in realistic task traces? Do multiple tools have overlapping, easily-confused purposes? Could two narrowly-scoped agents replace one broadly-scoped one?

3.2 Authentication and authorization gaps

Two distinct questions must both be answered for every integration: authentication (is this caller who it claims to be?) and authorization (is this caller allowed to do this specific thing?). Common architectural gaps to check for:

  • Over-privileged service credentials: an agent or MCP server using a single admin-level API key/service account instead of a scoped credential matching only the actions it needs.
  • Missing user-context propagation: a backend tool call that runs with the application's own broad permissions rather than the requesting end-user's actual permissions, silently letting a user access data or actions their own account shouldn't allow.
  • Unauthenticated or weakly-authenticated tool/MCP endpoints: internal tools exposed without verifying the caller at all, trusting network location as a substitute for identity.
  • No re-authorization at the action boundary: a multi-step agentic flow that authenticates once at the start of a session but never re-checks authorization before a sensitive downstream action (e.g., a refund) much later in a long-running agent loop.

The architecture answer is almost always to narrow scope and check identity/permission as close to the sensitive action as possible, not to add more logging around an over-broad permission (logging is a detective control, not a preventive one).

3.3 Accuracy-latency trade-offs

Every integration decision sits somewhere on an accuracy/latency/cost frontier, and the exam expects you to justify where you land, not just describe the options:

LeverImproves accuracyCosts
Larger modelBetter reasoning, fewer errors on hard casesHigher latency and $/request
More retrieved context (RAG)More grounding, fewer hallucinations, up to a pointMore tokens, slower time-to-first-token, risk of context rot if over-retrieved
Extended/adaptive thinkingBetter multi-step reasoningMore output tokens, higher latency
Multiple parallel calls (voting/ensembling)Higher confidence, fewer false positives/negativesMultiplies cost and adds coordination latency
Additional guardrail/validation passesFewer unsafe or malformed outputs reach productionExtra round-trip latency

A defensible answer names the SLA or business constraint driving the choice: "we cap retrieval at the top-5 chunks and use Sonnet rather than Opus because the product requires sub-2-second responses, and our eval set shows accuracy plateaus past 5 chunks for this corpus."

3.4 Observability at scale

A handful of manually-reviewed transcripts is not observability once a system handles meaningful production volume. Architect for:

  • Structured logging of every request/response pair, including token usage, latency, tool calls made, and any guardrail triggers: sufficient to reconstruct any single production incident after the fact.
  • Sampling-based human review at a statistically meaningful rate, stratified by risk (review 100% of high-stakes actions like refunds; sample 1-5% of routine chat).
  • Automated quality signals running continuously in production, not just pre-launch: reference-free evals, guardrail trigger rates, escalation rates, and user feedback (thumbs up/down, edit rates).
  • Drift detection: alerting when quality signals, latency, or cost move outside historical bounds, since a silent regression (e.g., after a document refresh breaks a RAG index) is far more common than a loud outage.
  • Cache/tool diagnostics: tracking cache hit rates and tool-call success/error rates as first-class operational metrics, not just an afterthought.

3.5 Designing a RAG pipeline: chunking and indexing

Retrieval-augmented generation grounds Claude's answers in a specific corpus rather than relying purely on parametric knowledge. A RAG pipeline has five stages, and the exam probes judgment at each:

  1. Ingestion: parsing source documents (PDFs, wikis, tickets, code) into clean text, preserving structure (headings, tables) where it carries meaning.
  2. Chunking: splitting documents into retrievable units. Chunk size is a trade-off: too small loses surrounding context needed to answer correctly; too large dilutes relevance and wastes tokens once retrieved. Match the strategy to the content: fixed-size chunking is simple but naively cuts across sentence and section boundaries; semantic/structural chunking (split at headings, paragraphs, or logical document sections) usually retrieves more coherent, self-contained units for policy documents, contracts, and technical docs.
  3. Embedding: converting chunks into vectors capturing semantic meaning.
  4. Indexing: storing vectors (and often metadata for filtering: date, document type, access-control tags) in a retrievable index. Access-control metadata at index time is what lets retrieval respect the same permissions the end user has in the source system, a frequent, easily-missed security gap (see 3.2).
  5. Retrieval + generation: at query time, embed the query, retrieve the top-k most relevant chunks (often re-ranked), and pass them to Claude alongside the user's question.

3.6 Retrieval strategies matched to data shape and query pattern

Data shape / query patternBest-fit retrieval strategy
Unstructured prose (policies, wikis, support articles), natural-language questionsDense vector (semantic) search over chunked, embedded text
Exact terms matter: product SKUs, legal citations, error codesKeyword/lexical search (BM25-style), or a hybrid of lexical + semantic search
Structured relational data (orders, transactions, inventory)Direct database query / text-to-SQL rather than vector retrieval over prose dumps
Multi-hop questions requiring combining several documents or relationships between entitiesGraph-based retrieval or agentic/iterative retrieval (retrieve, reason, retrieve again) rather than a single top-k pass
Very large corpora with diverse document typesTwo-stage retrieval: broad recall pass (cheap, wide net) followed by a precision re-ranking pass (more expensive, narrows to the best few)

A recurring exam trap: defaulting to vector search for everything. When the underlying data is genuinely structured (a transactional database) or requires exact-match precision (a part number), a direct query or lexical search beats semantic embedding search on both accuracy and cost.

3.7 Connection protocols: MCP vs. direct API/CLI vs. agent-to-agent

MechanismWhat it isBest fit
MCP (Model Context Protocol)An open standard ("USB-C for AI applications") that lets any MCP-compatible client connect to any MCP server exposing tools, data, and prompts: a standardized, reusable integration layerConnecting to an ecosystem of existing or third-party tools/data sources with minimal bespoke glue code; when the same integration should work across multiple AI clients (not just one custom app)
Direct API / CLI integrationBespoke code calling a specific API or invoking a specific command-line tool directlyA single, tightly-scoped, performance-sensitive integration where the overhead of a general protocol isn't justified, or where no MCP server exists and building one isn't worth it for a one-off use
Agent-to-agent protocolsPeer communication between independent agents, often across organizational or trust boundaries, without a shared central orchestratorCross-organization workflows, or architectures where agents owned by different teams/vendors need to negotiate and exchange tasks directly

Choosing among these is a real architecture decision, not a stylistic one: MCP buys you reusability and a growing ecosystem at the cost of a standardization layer; direct integration buys you simplicity and control for a narrow, stable use case; agent-to-agent buys you decentralization where no single party can or should own the whole orchestration.

3.8 Progressive discovery vs. monolithic context strategy

When an agent has access to many tools, data sources, or Skills, there are two opposing strategies for exposing them:

  • Monolithic context: load every tool definition, every reference document, every possible instruction into context up front, for every request. Simple to reason about, but wastes tokens (and money, and latency) on capability the current task never touches, and increases the chance the model gets confused among many similar options (see capability bloat, 3.1).
  • Progressive discovery: expose a small, high-level directory of available capabilities (e.g., a tool-search mechanism or Skill index), and let the model request more detail only for the specific tool/Skill/document it decides it needs, when it needs it. This scales far better as the number of available tools/Skills grows into the dozens or hundreds, keeping the resident context small and focused.

The exam heuristic: small, stable tool count → monolithic is fine and simpler; large or growing tool/Skill catalog → progressive discovery is required to avoid both context bloat and tool-selection errors.

◆ Key takeaways: Domain 3
  • Least privilege is the default lens for tool/agent scope: remove unneeded capability rather than merely monitor it.
  • Check authentication (who is this?) and authorization (are they allowed to do this specific thing?) separately, and as close to the sensitive action as possible.
  • Justify every accuracy/latency/cost trade-off against a stated SLA or business constraint, not in the abstract.
  • Observability at scale means structured logs, stratified sampling, continuous automated evals, and drift detection, not spot-checking transcripts.
  • Match chunking and retrieval strategy to the actual shape of the data and the query pattern: structured data and exact-match needs often beat vector search on cost and accuracy.
  • Choose MCP, direct API/CLI, or agent-to-agent deliberately based on reusability, ecosystem, and trust-boundary needs.
  • Use progressive discovery once the tool/Skill catalog grows large; monolithic context only stays efficient when the catalog is small and stable.
Domain 3 · Practice Questions

Integration

8 scenario-style items. Commit to an answer before revealing the rationale.

Item 1 · Select one
An internal MCP server exposes 40 tools to a single agent that, in practice, only ever needs 6 of them for its assigned task. What is the most direct risk this creates?
AThe agent will run out of tokens immediately
BCapability bloat: a larger attack surface and degraded tool-selection accuracy among overlapping options
CMCP servers can only expose 10 tools at a time, so this configuration will fail outright
DNo risk, since unused tools cost nothing
Correct: B. Unused, overly broad tool access is the definition of capability bloat: it burns context on unnecessary tool definitions, increases mis-selection risk, and expands what a compromised or misled agent could do. It won't crash outright, and unused tools aren't free. They still cost context tokens and add confusion risk.
Item 2 · Select one
A backend tool call for "fetch account details" runs using the application's own service-level API key rather than the requesting end-user's own permissions. What security gap does this represent?
AAn authentication gap only
BAn authorization gap: the tool call can access data beyond what the specific end user should be allowed to see
CNo gap, since the application itself is authenticated
DA latency issue, not a security issue
Correct: B. The application is authenticated, but without propagating the actual end user's permission scope, the call may return or act on data the specific user isn't authorized to see, a classic authorization (not authentication) gap.
Item 3 · Select one
A team retrieves the top-50 chunks for every RAG query "to be safe," each 500 tokens, for a corpus where evals show accuracy plateaus after 6 chunks. What is the most likely consequence?
AGuaranteed higher accuracy proportional to chunk count
BWasted tokens, higher latency and cost, and possible context-rot-driven accuracy degradation with no accuracy benefit past the plateau
CNo effect on cost since retrieval is free
DAutomatic deduplication of irrelevant chunks by the model
Correct: B. Once evals show a plateau, additional retrieved context adds cost and latency without benefit, and can actively hurt accuracy through context rot. Retrieval is not free, and the model doesn't silently discard irrelevant context without cost.
Item 4 · Select one
A support system's RAG index returns confident-sounding but factually wrong answers immediately after a scheduled document refresh, while model version and latency are unchanged. Where should the architect look first?
AThe model's temperature setting
BThe retrieval/indexing step: a broken re-index or mismatched embeddings likely returned stale or irrelevant chunks
CThe user's network connection
DThe context window size
Correct: B. A regression precisely coincident with a document refresh, with everything else held constant, points squarely at the retrieval/indexing layer: the model is confidently generating from bad or stale grounding context. Temperature, network, and window size are unrelated to a refresh event.
Item 5 · Select one
A knowledge base consists of structured transactional order records (order ID, date, amount, status). Support agents ask exact questions like "what is the status of order 48213?" Which retrieval approach is most appropriate?
AChunk the database export into prose paragraphs and use dense vector search
BDirect database query (or text-to-SQL) against the structured order records
CA large few-shot prompt listing all recent orders
DFine-tune a model on the order database
Correct: B. Exact-match lookups over genuinely structured, relational data are a textbook case for direct query, not vector search: semantic embedding search is built for fuzzy prose matching, not precise ID lookups, and would be both less accurate and less efficient here.
Item 6 · Select one
A vendor needs Claude-based agents at two different partner companies to negotiate a shared scheduling task without either company hosting a central orchestrator the other must trust. Which integration mechanism best fits?
AA single company-internal MCP server both partners are required to connect to
BAn agent-to-agent protocol allowing peer communication across the trust boundary without a shared central orchestrator
CHardcoding the scheduling logic into a shared CLI script
DA monolithic context strategy loading both companies' full tool catalogs into one agent
Correct: B. Cross-organization coordination without one party owning the orchestrator is precisely what agent-to-agent protocols address. Requiring one partner's MCP server or a shared script both implicitly force one side to host and be trusted by the other, not a peer arrangement.
Item 7 · Select one
An agent's available tool catalog is expected to grow from 15 to over 300 tools across many integrated systems over the next year. Which context strategy scales appropriately?
AContinue loading every tool definition into context on every request (monolithic context)
BProgressive discovery: expose a searchable directory of tools and let the model request full definitions only for tools relevant to the current task
CRandomly select 15 tools per request
DDisable tool use entirely once the catalog exceeds 50 tools
Correct: B. A large, growing tool catalog is exactly the scenario progressive discovery is designed for: keeping resident context small while still giving the model access to the full catalog on demand. Monolithic context does not scale to hundreds of tools; random selection or disabling tools abandons functionality rather than managing it.
Item 8 · Select two
Which two practices most directly support observability at production scale for a Claude-based system handling 100,000 requests/day?
AStructured logging of token usage, latency, tool calls, and guardrail triggers for every request
BManually reading a handful of transcripts once a quarter
CRisk-stratified sampling for human review, with 100% review of high-stakes actions
DDisabling logging to reduce storage costs
Correct: A and C. Structured, complete logging plus risk-stratified sampling are the pillars of observability at real production volume. Occasional manual spot-checks and disabling logging both leave the system effectively unmonitored.
Domain 4 · Weight 16%

Evaluation, Testing & Optimization

Proving a system works, catching regressions before users do, and diagnosing failures correctly instead of guessing.

Official task statements

  • Define evaluation metrics (accuracy, latency, cost, safety, security)
  • Design evaluation datasets and test frameworks using mixed methodologies
  • Conduct A/B testing and iterative improvements
  • Diagnose system issues (prompt failure, hallucinations, model mismatch)
  • Optimize token usage, latency, and cost-performance trade-offs
  • Monitor system performance using logging and observability tools

4.1 Defining evaluation metrics

"Is it good?" is not a metric. A production-ready eval plan states, per use case, concrete measurable targets across at least five dimensions:

DimensionExample metric
Accuracy / qualityExact-match or graded correctness against a labeled reference set; task completion rate; groundedness (does every claim trace to a retrieved source?)
LatencyP50/P95/P99 time-to-first-token and time-to-completion against an SLA
Cost$/request, $/resolved task, total monthly inference spend vs. budget
SafetyRate of harmful, biased, or policy-violating outputs; guardrail trigger/false-trigger rate
SecurityRate of successful prompt-injection or jailbreak attempts caught in red-teaming; rate of unauthorized data access attempts blocked

Define the target and the floor for each metric before building. Otherwise "better" has no fixed meaning and every stakeholder will argue from a different implicit bar.

Quantitative metrics you should be able to name

For classification and extraction tasks, know the standard information-retrieval quartet, because "accuracy" alone is misleading on imbalanced data:

  • Precision: of the items the system flagged/returned, what fraction were correct. High precision = few false positives.
  • Recall: of the items it should have flagged/returned, what fraction it actually caught. High recall = few false negatives.
  • F1: the harmonic mean of precision and recall, used when you need a single number balancing both.
  • Accuracy: fraction of all predictions that were correct; unreliable when classes are imbalanced (a "always say no fraud" model is 99% accurate on data that's 1% fraud, yet useless).

For RAG retrieval quality specifically, evaluate the retrieval step separately from generation: precision@k / recall@k (are the right chunks in the top-k?) and groundedness / faithfulness (does the generated answer actually follow from the retrieved chunks, with no fabricated additions?) plus answer relevance (does it address the question?). Diagnosing RAG failures means asking which of these three broke: retrieval (wrong chunks), grounding (right chunks, invented answer), or relevance (correct but off-topic).

A worked cost calculation

◆ Worked example · caching ROI

Scenario: 100,000 requests/day, each with a 5,000-token static system prompt + tools, a 500-token user message, and a 300-token response, on a model at $3 / $15 per million input/output tokens.

Without caching: input = 100,000 × 5,500 = 550M tokens/day × $3/M = $1,650; output = 100,000 × 300 = 30M × $15/M = $450. Total ≈ $2,100/day.

With the 5,000-token prefix cached (read at ~0.1×): cached input ≈ 500M × $0.30/M = $150; uncached input (the 500-token messages) = 50M × $3/M = $150; output unchanged at $450. Total ≈ $750/day: roughly a 64% cost reduction with zero accuracy impact. This is why caching is the first optimization to reach for.

4.2 Evaluation datasets and mixed-methodology test frameworks

A single evaluation technique is rarely sufficient. Combine at least these three methodologies:

  • Golden-set exact/graded evaluation: a curated set of representative inputs with known-correct (or expert-graded) outputs, run automatically on every change. Should include both common cases and known hard edge cases.
  • Model-graded evaluation ("LLM-as-judge"): using a separate Claude call to grade open-ended outputs against a rubric, at a scale human grading can't match: useful for catching subtler quality regressions, though it must itself be validated periodically against human judgment to confirm it isn't drifting or biased.
  • Human evaluation: expert or end-user review, essential for subjective quality, tone, and edge cases automated grading misses, usually applied via sampling rather than to every output.

Datasets should be built from real production traffic wherever possible (not only synthetic examples), refreshed as the product and corpus evolve, and explicitly include adversarial/edge cases (ambiguous questions, out-of-scope requests, known prior failure modes), not only "happy path" examples.

4.3 A/B testing and iterative improvement

Before shipping a prompt, model, or retrieval change to 100% of traffic, run a controlled comparison:

  1. Define the primary metric the change is meant to move (e.g., resolution rate) and guardrail metrics that must not regress (e.g., safety trigger rate, latency).
  2. Split traffic (or run the golden set through both variants) with a large enough sample to detect a meaningful difference. Small qualitative "it feels better" comparisons are not sufficient evidence for production changes at scale.
  3. Ship the winner only if the primary metric improves without regressing guardrail metrics; if it's ambiguous, gather more data rather than deciding on vibes.
  4. Treat every production system as a loop, not a one-time launch: keep measuring after shipping, since real-world traffic drifts from any pre-launch test set over time.

4.4 Diagnosing system issues

The exam repeatedly tests whether you can correctly localize a failure to the right layer instead of guessing. A useful diagnostic order:

SymptomLikely causeWhere to look
Confident, plausible, but factually wrong answers, especially right after a data changeRetrieval/indexing failure: stale, broken, or irrelevant chunks being retrievedRetrieval logs: what chunks were actually retrieved for this query?
Model ignores explicit instructions it previously followedPrompt regression (an edit broke something), or a context-window/ordering problem burying the instructionDiff the prompt against the last known-good version; check instruction placement
Fabricated facts, names, or citations with no traceable sourceHallucination: often from insufficient or absent grounding context, or a task pushing past the model's reliable knowledgeCheck whether the claim should have come from retrieval; add citations/verification requirements
Sudden broad quality drop across many unrelated tasks after a deployModel mismatch: a model or version swap that changed behavior, or a routing misconfiguration sending traffic to the wrong tierCompare model IDs/versions between the last-good and current deploy
Rising latency with no accuracy changeRetrieval or tool-call overhead, uncached prompts, or a scaling/infrastructure bottleneckCache-hit-rate telemetry, tool-call timing breakdown

Notice the pattern: three of the most common wrong first guesses on the real exam are blaming the model itself (temperature, "the weights changed") when the actual fault is in retrieval, prompt structure, or configuration. Always ask what specifically changed at the time the symptom appeared.

4.5 Optimizing token usage, latency, and cost-performance

Optimization is not "make it cheaper" in isolation. It's finding the best point on the cost/latency/accuracy frontier for the specific SLA. Levers, cheapest first:

  • Enable prompt caching correctly (Domain 2): usually the single highest-ROI lever with zero accuracy cost.
  • Right-size the model per request via routing rather than using one model for all traffic.
  • Trim retrieved context to the eval-validated minimum rather than "more is safer."
  • Batch non-latency-sensitive work (e.g., offline analysis, and Anthropic's Message Batches API for asynchronous workloads) instead of paying for synchronous, real-time pricing where a delay is acceptable.
  • Only reach for extended/adaptive thinking, multi-call voting, or larger models where evals show they actually move the accuracy metric that matters, otherwise they're pure cost with no benefit.

4.6 Monitoring with logging and observability tooling

Continuous production monitoring (distinct from one-time pre-launch evaluation) should track the same five metric dimensions from 4.1 on a live dashboard, with alerting thresholds and clear ownership for who responds when a threshold is breached. Treat evaluation as a lifecycle activity: pre-launch (does it meet the bar to ship?), continuous (is it still meeting the bar in production?), and triggered (did a change, such as a document refresh, a model upgrade, or a new prompt version, introduce a regression?).

◆ Key takeaways: Domain 4
  • Define numeric targets across accuracy, latency, cost, safety, and security before you build, not after.
  • Combine golden-set, model-graded, and human evaluation: no single method is sufficient alone.
  • A/B test changes against a primary metric and non-regressing guardrail metrics before full rollout.
  • Diagnose by asking "what changed?" first: retrieval/indexing failures are the most common cause of sudden, confident wrong answers, not the model itself.
  • Optimize cost/latency in order of ROI: caching first, then model routing, then context trimming, then batching. Reserve expensive techniques (bigger models, voting, extended thinking) for where evals prove they help.
Domain 4 · Practice Questions

Evaluation, Testing & Optimization

8 scenario-style items. Commit to an answer before revealing the rationale.

Item 1 · Select one
A team says their system "seems to work well" with no further specification before launch. What is the most important next step from an evaluation standpoint?
ALaunch immediately since qualitative confidence is sufficient
BDefine concrete, measurable targets across accuracy, latency, cost, safety, and security before shipping
CSkip evaluation and rely entirely on user complaints post-launch
DOnly measure cost, since that is easiest to quantify
Correct: B. "Seems to work well" is not a metric. A defensible launch requires explicit, measurable targets across all five core dimensions, established before shipping, not discovered afterward through user complaints.
Item 2 · Select one
Which combination of evaluation methodologies best covers both scale and nuance for a customer-facing generative assistant?
AGolden-set automated evaluation only
BHuman evaluation only, reviewing 100% of outputs
CA mix of golden-set automated evaluation, model-graded (LLM-as-judge) evaluation, and sampled human evaluation
DNo evaluation, relying solely on the model's stated confidence
Correct: C. Mixed methodology gives scale (automated, model-graded) plus ground truth on nuance (human, applied via sampling since 100% human review rarely scales). Any single method alone misses either scale or subtlety.
Item 3 · Select one
A new prompt version shows a 4% qualitative improvement on the team's gut sense after reading ten transcripts. What should happen before rolling it out to 100% of production traffic?
AShip immediately since the team is confident
BRun a proper A/B comparison against the current version on a sufficiently large sample, checking both the primary metric and guardrail metrics
CSkip testing since ten transcripts is already a representative sample
DOnly check cost impact, since quality was already judged sufficient
Correct: B. Ten transcripts and a gut feeling are not statistically meaningful evidence for a full rollout. A controlled comparison against both the primary and guardrail metrics is required before shipping broadly.
Item 4 · Select one
Immediately after a scheduled model version upgrade, an otherwise-unchanged system shows a broad quality drop across many unrelated task types. What is the most likely cause?
AA retrieval index problem, unrelated to the model change
BModel mismatch: the new model version behaves differently than the one the system was tuned/tested against
CUser error only
DA network latency spike
Correct: B. A broad regression precisely coincident with a model version change, with retrieval and infrastructure untouched, points to model mismatch: the new version's behavior differs from what prompts and evals were tuned against.
Item 5 · Select one
An assistant occasionally invents a plausible-sounding citation to a document that does not exist. Which underlying failure does this describe, and what is a primary mitigation?
ARate limiting; mitigate with request throttling
BHallucination; mitigate by requiring grounded citations tied to actually-retrieved source chunks and verifying claims against them
CLatency spike; mitigate by upgrading hardware
DCache invalidation; mitigate by disabling caching
Correct: B. Fabricating a nonexistent but plausible citation is a textbook hallucination. Grounding requirements and citation verification against retrieved sources are the standard mitigation; the other options are unrelated failure categories.
Item 6 · Select one
A team wants to reduce cost on a high-traffic pipeline. Which optimization should generally be tried first, before considering a smaller model or reduced retrieval?
AEnabling and correctly structuring prompt caching for the static portions of every request
BSwitching immediately to the cheapest available model regardless of task fit
CRemoving all safety guardrails to reduce token count
DDisabling logging to save storage costs
Correct: A. Prompt caching is typically the highest-ROI optimization because it reduces cost and latency with no accuracy trade-off, and should be exhausted before accuracy-impacting changes like downsizing the model. Removing guardrails is a safety regression, not a valid optimization, and disabling logging destroys observability for negligible savings.
Item 7 · Select one
Which statement best describes the appropriate relationship between pre-launch evaluation and post-launch monitoring?
APre-launch evaluation is sufficient; once a system passes, no further monitoring is needed
BEvaluation is a continuous lifecycle activity: pre-launch to establish a bar, continuous monitoring to confirm the bar still holds, and triggered re-evaluation after any meaningful change
CMonitoring is only needed if the pre-launch evaluation failed
DEvaluation and monitoring are unrelated activities owned by different, non-communicating teams
Correct: B. Real-world traffic and underlying data drift over time, so a system that passed evaluation once can still regress. Continuous and triggered re-evaluation, alongside the initial pre-launch bar, is the correct model.
Item 8 · Select two
Which two practices are hallmarks of a well-designed evaluation dataset for a production Claude application?
ABuilt entirely from synthetic, idealized "happy path" examples only
BIncludes real production traffic examples alongside deliberately chosen edge cases and known prior failure modes
CRefreshed periodically as the product, corpus, and user behavior evolve
DFixed permanently at launch and never revisited
Correct: B and C. Strong eval sets ground themselves in real traffic, deliberately include hard/edge cases, and evolve over time as the system and its inputs change. Synthetic-only, happy-path-only, or frozen-forever datasets all miss real-world failure modes.
Domain 5 · Weight 14%

Governance, Safety & Risk Management

Keeping a Claude system safe, compliant, and defensible: before, during, and after it ships.

Official task statements

  • Implement guardrails and safety controls
  • Identify risks, limitations, and failure modes of LLM systems
  • Apply human-in-the-loop validation strategies
  • Ensure compliance with regulations (e.g., GDPR, HIPAA, FedRAMP)
  • Address ethical AI considerations (bias, fairness, transparency)

5.1 Guardrails and safety controls

Guardrails belong at multiple layers, and a mature design uses several simultaneously rather than relying on any single one:

LayerExample control
InputClassifying and filtering incoming requests for prompt injection attempts, PII, or out-of-scope topics before they ever reach the main model call
System promptExplicit behavioral boundaries and escalation instructions (Domain 2)
Tool/action scopeLeast-privilege tool access: removing, not just monitoring, high-risk capabilities (Domain 3)
OutputA second pass (a separate classifier call, or deterministic code) that screens the generated response for policy violations before it reaches the user or triggers a downstream action
ActionRequiring human approval or a hard business-rule check before any high-consequence action (a refund above a threshold, an account deletion) actually executes

The recurring exam principle: removal beats detection, and detection beats nothing. Preventing a capability from existing is stronger than logging or flagging its misuse after the fact.

5.2 Risks, limitations, and failure modes of LLM systems

  • Hallucination: confident generation of false or unverifiable claims, especially outside the model's grounded context or reliable knowledge.
  • Prompt injection: malicious instructions hidden in retrieved documents, tool outputs, or user input that attempt to override the system's intended behavior: a particular risk whenever an agent processes untrusted external content (web pages, emails, documents) as part of its context.
  • Excessive agency: an agent taking actions beyond what a task actually required, especially in multi-step autonomous loops without sufficient checkpoints.
  • Data leakage: sensitive information from one user's context, retrieved documents, or training surfacing inappropriately in another user's session or output.
  • Model/knowledge drift: a system's behavior or accuracy shifting after a silent upstream change: a model version update, a data refresh, or a prompt edit made elsewhere.
  • Bias amplification: the system systematically producing worse or unfair outcomes for particular groups, whether from training data patterns, biased retrieval corpora, or unrepresentative eval sets that failed to catch it.

5.3 Human-in-the-loop (HITL) validation strategies

Not every action needs a human in the loop, and requiring one for everything defeats the purpose of automation. Calibrate HITL to risk:

Risk tierExampleHITL pattern
LowDraft generation, internal search summariesNo human gate required; sampled post-hoc review
MediumCustomer-facing replies, ticket categorizationHuman reviews before sending, or reviews a statistically sampled subset continuously
HighRefunds, account changes, medical or legal guidance, financial transactionsMandatory human approval before the action executes, every time, with no exceptions

Design HITL checkpoints at the point of irreversible or high-consequence action, not merely at the start of a session: a long-running agent that was approved to begin a task is not thereby pre-approved for every downstream action it might decide to take.

5.4 Regulatory compliance

You are not expected to be a lawyer, but you must recognize which regulatory regime is triggered by a given scenario and what architectural implication follows:

RegulationDomainKey architectural implication
GDPREU personal dataData minimization, the right to erasure/access, clear lawful basis for processing, and awareness of cross-border data transfer and retention rules, including what gets logged, cached, or retained by any AI system touching EU personal data
HIPAAUS protected health information (PHI)Business Associate Agreements with any vendor touching PHI, strict access controls and audit logging, and de-identification where full identifiability isn't required for the task
FedRAMPUS federal government cloud systemsRequires an authorized, accredited deployment environment and strict controls on data residency, encryption, and audit: a system can't simply "add" FedRAMP compliance after the fact; the underlying platform and hosting must already be authorized

The consistent exam pattern: identify which regulated data type or sector a scenario involves (health data → HIPAA, EU citizens' personal data → GDPR, US federal agency → FedRAMP), then pick the option that reduces unnecessary data exposure, adds required access controls/audit trails, or uses an appropriately accredited environment, not the option that merely adds disclaimers or ignores the regime because "the model is just giving information."

5.5 Ethical AI: bias, fairness, and transparency

  • Bias: actively test outputs across demographic and use-case slices, not just aggregate accuracy: a system can look accurate on average while performing far worse for a specific subgroup.
  • Fairness: define, with stakeholders, what fair treatment means for the specific use case (equal outcomes vs. equal treatment vs. equal opportunity can conflict), and pick an explicit standard rather than leaving it implicit.
  • Transparency: disclose to end users when they are interacting with an AI system, what data it uses, and its known limitations, especially in consequential domains (hiring, lending, healthcare, legal). Maintain internal documentation of model choice, guardrails, and known failure modes so decisions are auditable after the fact.
◆ Key takeaways: Domain 5
  • Layer guardrails across input, prompt, tool scope, output, and action: removal of unnecessary capability beats detection, and detection beats nothing.
  • Know the core LLM failure modes by name: hallucination, prompt injection, excessive agency, data leakage, model/knowledge drift, bias amplification.
  • Calibrate human-in-the-loop to risk tier, and place the checkpoint at the point of irreversible/high-consequence action, not just session start.
  • Match the regulation to the data/sector (GDPR: EU personal data, HIPAA: US health data, FedRAMP: US federal cloud) and pick the architecturally-appropriate control, not a disclaimer.
  • Test for bias across subgroups explicitly, define fairness with stakeholders rather than assuming it, and build in transparency about AI use, data, and limitations.
Domain 5 · Practice Questions

Governance, Safety & Risk Management

8 scenario-style items. Commit to an answer before revealing the rationale.

Item 1 · Select one
An agent that summarizes web pages occasionally follows hidden instructions embedded in the page content it retrieves, causing it to take unintended actions. What failure mode is this, and what is the most direct mitigation?
AHallucination; mitigate by increasing model size
BPrompt injection; mitigate by treating retrieved external content as untrusted data, not instructions, and constraining what actions the agent can take based on it
CModel drift; mitigate by pinning an older model version
DBias amplification; mitigate with fairness testing
Correct: B. Hidden instructions in untrusted external content hijacking agent behavior is the definition of prompt injection. The mitigation is architectural: isolate untrusted content, constrain downstream actions, and don't rely on the model alone to resist injected instructions.
Item 2 · Select one
A healthcare startup wants to build a Claude-powered assistant that processes patient protected health information (PHI) using a third-party vendor. What is the essential compliance prerequisite?
AA GDPR data processing agreement only
BA HIPAA Business Associate Agreement (BAA) with the vendor, plus strict access controls and audit logging around the PHI
CNo special agreement, since the AI model itself isn't a "provider"
DFedRAMP authorization, since any AI system automatically requires it
Correct: B. US protected health information triggers HIPAA, which requires a BAA with any vendor that touches PHI, plus access controls and audit logging. GDPR governs EU personal data specifically; FedRAMP governs US federal systems. Neither is the primary trigger here.
Item 3 · Select one
Which action best reflects a mature human-in-the-loop design for an agent capable of issuing customer refunds up to $10,000?
ARequire human approval only once, at the very start of the agent's session, regardless of how many refunds it later attempts
BRequire mandatory human approval at the specific point each refund action would execute, especially above a defined threshold
CNever allow the agent to touch refunds under any circumstances
DLog refunds after the fact with no approval gate
Correct: B. HITL checkpoints belong at the point of irreversible, high-consequence action: a single upfront approval doesn't cover every later refund attempt. Banning the capability entirely may be overly restrictive if the business need is legitimate and properly gated; post-hoc logging alone is a detective, not preventive, control.
Item 4 · Select one
An eval shows a hiring-screening assistant performs well on aggregate accuracy but has a meaningfully higher false-rejection rate for one demographic subgroup. What should the architect do?
AIgnore the finding since aggregate accuracy is acceptable
BInvestigate and address the subgroup disparity directly: through data, retrieval, prompt, or process changes, before further deployment in a consequential domain like hiring
CSimply stop reporting subgroup-level metrics going forward
DIncrease the overall sample size without addressing the disparity itself
Correct: B. Aggregate accuracy can mask serious subgroup disparities, exactly why bias testing must be done at the subgroup level, especially for consequential decisions like hiring. Ignoring, hiding, or diluting the metric doesn't address the underlying fairness problem.
Item 5 · Select one
A financial-services chatbot is being deployed for EU customers, storing full chat transcripts indefinitely with no way for a user to request deletion. What compliance gap does this most directly create?
AA HIPAA violation, since HIPAA applies to any personal data
BA GDPR gap: indefinite retention with no erasure mechanism conflicts with data minimization and the right to erasure for EU personal data
CNo gap, since chat transcripts aren't considered personal data
DA FedRAMP violation, since FedRAMP governs all customer data globally
Correct: B. EU customer personal data with indefinite retention and no erasure path is a direct GDPR data-minimization/right-to-erasure gap. HIPAA concerns US health data specifically; FedRAMP concerns US federal systems. Neither is the primary regime here, and chat transcripts containing personal data are very much in scope.
Item 6 · Select one
Which best exemplifies "removal beats detection" as a guardrail design principle?
AAdding a log entry every time a high-risk tool is called
BRemoving a delete-account tool entirely from an agent whose task never requires it
CAdding a confirmation dialog before every action, including harmless ones
DIncreasing the model's context window
Correct: B. Removing an unnecessary high-risk capability eliminates the risk outright. Logging and confirmations are compensating/detective controls that manage risk after the capability still exists; context window size is unrelated.
Item 7 · Select one
A government agency wants to deploy a Claude-based system to process federal case files in the cloud. Which requirement is most likely to gate the entire deployment, not just a feature within it?
AA well-written system prompt
BDeployment in a FedRAMP-authorized environment meeting the required data residency, encryption, and audit controls
CA larger context window model
DEnabling prompt caching
Correct: B. US federal government systems trigger FedRAMP requirements at the hosting/platform level: this is a gating architectural constraint on where and how the system can be deployed at all, not a feature-level tuning choice like prompt design, context size, or caching.
Item 8 · Select two
Which two practices best support transparency as an ethical AI principle for a consequential-decision system (e.g., loan underwriting assistance)?
ADisclosing to applicants that an AI system is involved in the process and what data it uses
BKeeping the model's role and limitations undisclosed to avoid confusing users
CMaintaining internal documentation of model choice, guardrails, and known failure modes for audit purposes
DAvoiding any subgroup-level performance reporting to keep messaging simple
Correct: A and C. Disclosure to affected users and maintained internal documentation are core transparency practices. Hiding the AI's involvement or suppressing subgroup reporting actively undermines transparency and fairness.
Domain 6 · Weight 14%

Stakeholder Communication & Lifecycle Management

The architect as translator: between business needs and technical trade-offs, and across the full life of a system, not just its launch.

Official task statements

  • Conduct structured discovery and requirement gathering
  • Communicate architectural decisions and trade-offs
  • Manage stakeholder feedback loops and expectation alignment (including SLAs)
  • Document architectures and provide implementation guidance
  • Support lifecycle phases (discovery, design, handoff, monitoring, iteration)

6.1 Structured discovery and requirement gathering

Discovery is where most project risk is created or avoided. A structured discovery covers, at minimum:

  • Business objective and success metric: tied to a specific value pillar (Domain 1): what number moves, and by how much, if this succeeds?
  • Current-state process: who does this today, how long does it take, what's the error rate now (the baseline any new system must beat)?
  • Data inventory: where does needed information live, who owns it, what's its quality and access-control status?
  • Constraints: regulatory (Domain 5), budget, existing technology commitments, timeline.
  • Risk tolerance: what does an acceptable error look like, and what does an unacceptable one look like, for this specific use case?

Skipping structured discovery is the single most common root cause of a project that technically "works" but fails to deliver the value the stakeholder actually wanted.

6.2 Communicating architectural decisions and trade-offs

Non-technical stakeholders don't need implementation detail; they need to understand what a decision costs them and why it was made. A reliable structure for any architecture decision record (ADR):

  1. Context: what problem or constraint prompted this decision.
  2. Options considered: at least two real alternatives, not a strawman.
  3. Decision: what was chosen.
  4. Trade-offs accepted: stated explicitly, in business terms ("we accept slightly higher cost per request in exchange for a 99.9% latency SLA the business requires").
  5. Reversibility: how hard would it be to change this decision later if requirements shift?

The exam frequently probes whether you default to jargon or to plain, decision-relevant language when a scenario describes presenting to an executive or non-technical client.

6.3 Managing stakeholder feedback loops and SLA alignment

Expectation misalignment, not technical failure, is the most common reason engagements sour. Concrete practices:

  • Put SLAs (latency, accuracy floor, uptime) in writing and tie them to the same metrics used in Domain 4's evaluation framework: don't let "fast" or "accurate" remain undefined between the team and the client.
  • Establish a recurring, structured feedback cadence (not just ad hoc escalations) so stakeholders see progress and can flag concerns early, before they compound.
  • When a stakeholder request conflicts with sound architecture (an unnecessary multi-agent system, an unrealistic accuracy guarantee), address it directly with trade-off language rather than silently complying or silently ignoring it.
  • Manage scope creep explicitly: every new requirement discovered mid-project should be evaluated against the original success metric and constraints, not simply absorbed.

6.4 Documenting architectures and implementation guidance

Documentation that only the original architect can use has failed its purpose. A complete architecture package typically includes:

  • A system diagram showing the four-stage loop (Domain 1: input, processing, output, feedback) and every external integration.
  • The rationale for model, prompt, and retrieval choices (so a future engineer doesn't "optimize" away a deliberate trade-off without understanding why it was made).
  • Guardrail and compliance controls in place, and why (Domain 5), for audit and handoff purposes.
  • Evaluation results and the metric definitions used to approve the system for launch (Domain 4).
  • Runbooks: what to check first when something breaks, who owns what, and how to roll back a change.

6.5 Lifecycle phases: discovery → design → handoff → monitoring → iteration

PhasePrimary activityExit criteria
DiscoveryStructured requirement gathering (6.1)Agreed success metric, constraints, and risk tolerance documented and signed off
DesignArchitecture selection and trade-off analysis (Domains 1-3)ADR(s) reviewed and approved by stakeholders; eval plan defined (Domain 4)
Build & validateImplementation, evaluation against the pre-defined barMetrics meet the agreed launch bar across accuracy, latency, cost, safety, security
HandoffDocumentation, runbooks, and knowledge transfer to the team that will operate the systemOperating team can independently diagnose and respond to a routine incident
MonitoringContinuous observability against the same metrics (Domain 4)Alerting is live; ownership for response is assigned
IterationOngoing improvement based on production feedback, drift, and evolving business needsChanges go through the same A/B and eval discipline as the original launch

A system architecture is never "done" at launch. The exam expects you to treat monitoring and iteration as designed-for phases, not an afterthought that happens only if something breaks loudly.

◆ Key takeaways: Domain 6
  • Structured discovery (objective, current state, data inventory, constraints, risk tolerance) prevents most downstream project failure.
  • Communicate architecture decisions in business trade-off language: context, options, decision, trade-offs accepted, reversibility.
  • Put SLAs in writing tied to concrete metrics, and address stakeholder requests that conflict with sound architecture directly, not silently.
  • Documentation must let someone other than the original architect operate and evolve the system.
  • Treat discovery, design, handoff, monitoring, and iteration as designed-for lifecycle phases, each with clear exit criteria, not a project that ends at launch.
Domain 6 · Practice Questions

Stakeholder Communication & Lifecycle Management

8 scenario-style items. Commit to an answer before revealing the rationale.

Item 1 · Select one
A project kicks off with a client request to "add AI to our support process," with no further detail gathered before design begins. What is the most significant risk this creates?
ANo risk, since AI can be added to any process
BThe delivered system may technically function but fail to move the actual business metric the client cared about, since success was never defined
CThe project will automatically cost too much
DThe system will definitely violate a regulation
Correct: B. Skipping structured discovery is the classic root cause of a technically-working system that misses the actual business goal, because the goal, baseline, and success metric were never established up front.
Item 2 · Select one
An architect must explain to a non-technical executive why the team chose Claude Sonnet with a routing layer over using the largest model for every request. Which explanation is most appropriate?
AA deep technical explanation of transformer attention mechanisms
B"We route simple requests to a faster, lower-cost model and reserve the most capable model for complex cases, meeting our latency SLA while controlling cost, with no meaningful quality loss on the majority of traffic"
CAvoiding the topic since executives don't need to understand architecture
DSimply stating "it's more efficient" with no further detail
Correct: B. Effective stakeholder communication translates the technical decision into business trade-off language: SLA, cost, and quality impact, without unnecessary jargon or vague hand-waving.
Item 3 · Select one
Midway through a project, a stakeholder asks for an unplanned new capability without discussing timeline or cost impact. What is the best next step?
ASilently add the capability without comment to keep the stakeholder happy
BEvaluate the request against the original success metric, constraints, and timeline, and communicate the trade-off explicitly before proceeding
CRefuse the request outright with no discussion
DAdd the capability but tell no one about the resulting delay
Correct: B. Scope changes should be evaluated against the agreed baseline and communicated transparently: silently absorbing scope, flatly refusing without discussion, and hiding impact are all failures of stakeholder management.
Item 4 · Select one
A completed system is handed off with only a brief verbal walkthrough and no written documentation. Six months later, the original architect has left the company, and the operating team cannot diagnose a production issue. What was missing?
AA larger model
BComplete documentation: system diagram, rationale for key decisions, guardrails, evaluation results, and runbooks: sufficient for someone other than the original architect to operate the system
CA different programming language
DMore frequent status meetings during the original build phase only
Correct: B. Documentation exists precisely so a system survives beyond its original architect. Model choice, language, and pre-launch meeting cadence don't address the handoff/knowledge-transfer gap that actually caused the failure.
Item 5 · Select one
Which lifecycle phase is most often incorrectly treated as optional or an afterthought, despite being explicitly part of a well-designed system's lifecycle?
ADiscovery
BMonitoring and iteration after launch
CInitial design
DThe kickoff meeting
Correct: B. Teams frequently treat launch as the finish line, neglecting monitoring and iteration, but production traffic drifts, requirements evolve, and this phase must be designed for, not left to happen only when something breaks loudly.
Item 6 · Select one
A client verbally agreed the system should be "fast and accurate," with no further specification, and now disputes whether the delivered system meets that bar. What should have been done earlier to prevent this dispute?
ANothing: verbal agreement is sufficient
BDefining and documenting concrete SLA metrics (e.g., P95 latency target, accuracy floor) in writing and tying them to the evaluation framework, agreed by both sides before build
CBuilding the system first and defining metrics afterward based on what it happened to achieve
DAvoiding any metric discussion to keep the relationship informal
Correct: B. Vague terms like "fast and accurate" invite exactly this kind of dispute. Written, concrete SLA metrics agreed before the build (not after) are the standard practice for expectation alignment.
Item 7 · Select one
Which best describes the purpose of an Architecture Decision Record (ADR)?
AA marketing document meant to impress the client with technical sophistication
BA structured record of context, options considered, the decision made, the trade-offs accepted, and how reversible the decision is
CA log of every line of code changed during implementation
DA record used only for legal compliance, never referenced again
Correct: B. An ADR exists to make architectural reasoning and trade-offs explicit and durable, for future team members, auditors, and stakeholders, not as marketing collateral or a code changelog.
Item 8 · Select two
Which two elements should a structured discovery process establish before design begins?
AThe exact final line-by-line prompt text
BThe business success metric and the acceptable error/risk tolerance for the use case
CThe current-state process and baseline it must improve upon
DThe specific vector database vendor to be used
Correct: B and C. Success metrics, risk tolerance, and the current-state baseline are discovery-level questions that shape everything downstream. Specific prompt text and vendor selection are design/implementation details that come later, once discovery has framed the problem.
Domain 7 · Weight 7%

Developer Productivity & Operational Enablement

Making the humans building and running the system faster and less error-prone: the smallest domain by weight, but a real differentiator for an architect advising a delivery team.

Official task statements

  • Configure Claude tools and environments for teams (e.g., Claude Code)
  • Improve developer workflows using AI-assisted tooling
  • Support debugging and operational issue resolution

7.1 Configuring Claude tools and environments for teams

Agentic coding tools such as Claude Code let a team apply Claude directly inside their development workflow: reading a codebase, making multi-file edits, running tests, and executing shell commands under human oversight. Architecting this for a team (not just an individual) involves:

  • Shared configuration: standardized project-level instructions (a checked-in configuration file describing conventions, architecture, and constraints) so every developer's AI-assisted sessions follow the same house rules rather than reinventing them per person.
  • Permission boundaries: scoping what actions an agentic coding tool may take autonomously (read files, run tests) versus what requires explicit developer approval (destructive commands, pushing to production branches), the same least-privilege principle from Domain 3, applied to developer tooling.
  • Reusable team knowledge: packaging common, repeated procedures (a deployment checklist, a code-review rubric, a scaffolding pattern) as reusable Skills or templates so the whole team benefits from one well-tested procedure instead of each engineer improvising their own prompt.
  • Plugin/extension governance: when a team adopts bundles of tools, connectors, and skills as installable packages, apply the same review discipline you'd apply to any new production dependency: provenance, scope, and update process.

7.2 Improving developer workflows with AI-assisted tooling

Beyond individual productivity, the architect's job is to identify where AI-assisted tooling changes the shape of a workflow, not just its speed:

  • Faster iteration on boilerplate and scaffolding, freeing engineer time for the judgment-heavy parts of a task.
  • Code review augmentation: a first automated pass catching obvious issues (style, common bugs, missing tests) before a human reviewer's time is spent, without replacing human review for architectural and business-logic correctness.
  • Documentation-as-you-go: generating and keeping documentation in sync with code changes, addressing the chronic problem of documentation drifting out of date.
  • Onboarding acceleration: new engineers using AI-assisted tools to understand an unfamiliar codebase faster than reading it cold.

The consistent theme, echoed from Domain 1: apply the same "start simple, add complexity only when justified" discipline to developer tooling adoption: measure whether a given AI-assisted workflow change actually reduces cycle time or defect rate before standardizing it team-wide.

7.3 Supporting debugging and operational issue resolution

The same architect who designs the system should make it fast to debug when it breaks. Practical patterns:

  • Reproducible traces: every production incident should be reconstructable from logs (Domain 3's observability practices): the exact prompt, retrieved context, tool calls, and model version involved.
  • AI-assisted root-causing: using Claude itself (with appropriate access to logs and code) to accelerate the same diagnostic process from Domain 4: narrowing down whether a regression traces to retrieval, prompt, or model/config change, while a human still makes the final call on production fixes.
  • Runbooks over tribal knowledge: operational procedures documented and kept current (Domain 6) rather than living only in one engineer's memory.
  • Fast rollback paths: any prompt, model, or configuration change should be revertible quickly once a regression is detected, not require a full redeploy cycle.
◆ Key takeaways: Domain 7
  • Standardize agentic coding tool configuration across a team: shared conventions, least-privilege permission boundaries, and reusable Skills/templates rather than per-developer improvisation.
  • Apply new AI-assisted workflows where they measurably change cycle time or defect rate, not adoption for its own sake.
  • Debugging support means reproducible traces, AI-assisted root-causing paired with human judgment, current runbooks, and fast rollback paths.
Domain 7 · Practice Questions

Developer Productivity & Operational Enablement

6 scenario-style items. Commit to an answer before revealing the rationale.

Item 1 · Select one
A team adopts an agentic coding tool where every developer configures it differently, with no shared conventions. What is the most direct consequence?
AGuaranteed faster delivery for the whole team
BInconsistent code style, duplicated effort re-solving the same configuration problems, and uneven safety/permission boundaries across developers
CNo consequence, since individual configuration is always preferable
DAutomatic compliance with the team's architecture standards
Correct: B. Without shared, checked-in configuration, teams lose consistency, duplicate effort, and risk uneven permission boundaries, exactly the problem standardized team-level configuration solves.
Item 2 · Select one
Which permission boundary best reflects least-privilege practice for an agentic coding tool operating in a shared repository?
AAllow the tool to push directly to the production branch without review
BAllow the tool to read files and run tests autonomously, but require explicit developer approval before destructive commands or production deploys
CGive the tool full administrative access to simplify configuration
DDisable the tool from running any commands at all, eliminating its usefulness
Correct: B. Scoping autonomous actions to low-risk operations while gating high-risk/destructive ones behind explicit approval is the least-privilege pattern applied to developer tooling: full access and no access are both wrong extremes.
Item 3 · Select one
A team wants to use AI-assisted code review. What is the most appropriate role for it?
AFully replacing human code review for all changes
BProviding a first automated pass on style, common bugs, and missing tests, while humans retain review responsibility for architectural and business-logic correctness
COnly reviewing code written by junior engineers
DReviewing code after it has already been deployed to production
Correct: B. AI-assisted review augments human review by catching routine issues early, freeing human attention for judgment-heavy correctness: it isn't positioned to fully replace human review, restrict itself to junior code, or review only post-deployment.
Item 4 · Select one
A production incident occurs, but the team cannot reconstruct which prompt version, retrieved context, and model version were involved at the time. What should have been in place beforehand?
AA larger context window
BReproducible traces via structured logging capturing the exact prompt, retrieved context, tool calls, and model version per request
CA faster model
DMore frequent stakeholder meetings
Correct: B. This is precisely what reproducible, structured logging exists to enable: without it, root-causing a production incident becomes guesswork. Model size, speed, and meeting cadence don't address the missing trace data.
Item 5 · Select one
A team wants to standardize a recurring, well-tested deployment checklist so every engineer follows the same validated procedure instead of improvising. What is the most appropriate mechanism?
AA verbal tradition passed between senior engineers
BPackaging the checklist as a reusable Skill or template the whole team can invoke consistently
CRelying on each engineer's memory of past deployments
DWriting it once in a document nobody is required to reference
Correct: B. Reusable, invokable Skills/templates are the mechanism for turning tribal knowledge into a consistent, team-wide, well-tested procedure: verbal tradition, memory, and an unreferenced document all fail to guarantee consistent use.
Item 6 · Select one
After a prompt change causes a quality regression in production, the team needs 45 minutes and a full redeploy to revert it. What operational capability was missing?
AA larger evaluation dataset
BA fast, low-friction rollback path for prompt/configuration changes, independent of a full redeploy cycle
CA bigger model
DMore guardrails on the input layer
Correct: B. The specific gap described is response time to revert a bad change: a fast rollback path decoupled from full redeployment. A larger eval set might have caught the issue earlier but doesn't address slow recovery; model size and input guardrails are unrelated to rollback speed.
Final Prep · Timed Simulation

Full-Length Practice Exam

63 items, weighted exactly to the official blueprint (11 / 8 / 12 / 10 / 9 / 9 / 4 across Domains 1-7). Set a 120-minute timer, answer on paper or in your head, then turn to the Answer Key & Rationale page to score yourself. Do not peek early. The value of a mock exam depends on honest timing pressure.

Domain 1: Solution Design & Architecture (Items 1-11)

1. A mid-size airline wants Claude to answer "where is my luggage" questions using live baggage-tracking data. Volume is high, latency must be near-instant, and the task is narrow and repetitive. Which pattern fits best?

  1. Multi-agent orchestrator with five subagents
  2. An augmented LLM call with a tool that queries the live baggage system
  3. An autonomous agent free to take any action on the airline's systems
  4. A prompt-chaining pipeline with five sequential drafting steps

2. Which best distinguishes a workflow from an agent?

  1. Workflows never call tools
  2. Workflows follow developer-defined code paths; agents let the model direct its own steps and tool use
  3. Agents are always cheaper to run
  4. Workflows only work with the smallest models

3. A customer-support pipeline needs a draft written, then automatically checked against a compliance rubric, then rewritten if it fails. Which pattern is the closest fit?

  1. Routing
  2. Evaluator-optimizer
  3. Simple augmented LLM with no additional steps
  4. Voting across five identical prompts

4. A leadership team wants "efficiency gains" from a new Claude system but cannot articulate a number. What should the architect do first?

  1. Proceed with the build and infer the metric later
  2. Work with stakeholders to define a concrete, measurable efficiency metric tied to the current-state baseline
  3. Assume cost reduction is always the intended metric
  4. Skip metric definition since "efficiency" is self-evident

5. Which scenario most clearly justifies an agent over a workflow?

  1. A fixed three-step approval process with known steps in advance
  2. An open-ended research task where the number and nature of needed steps can't be predicted ahead of time
  3. A single classification call
  4. A static document translation task

6. A design decomposes a large invoice-processing task into: (1) extract fields, (2) validate against business rules in code, (3) generate a summary. What technique is this?

  1. Voting
  2. Functional decomposition with a deterministic validation checkpoint
  3. Agent-to-agent negotiation
  4. Monolithic context loading

7. Select two. Which two are legitimate engineering justifications for a multi-agent design rather than a single agent?

  1. The task decomposes into independent sub-domains that would overload one agent's context/tools
  2. A stakeholder wants to see "agents" mentioned in the proposal
  3. Independent subtasks can run in parallel, meaningfully reducing latency
  4. It matches a trend seen in an unrelated case study

8. A design has clear input handling and a well-tooled processing stage, but no mechanism for learning whether outputs were actually correct after delivery. What is missing?

  1. A bigger model
  2. A feedback loop connecting outcomes back into evaluation and iteration
  3. More few-shot examples
  4. A second output format

9. "Same team of analysts, able to cover triple the client portfolios" describes which business value pillar?

  1. Cost reduction
  2. Productivity amplification
  3. Transformation
  4. SLA compliance

10. A stakeholder insists on the most complex architecture available "to be safe," for a task that is simple and predictable. What is the architect's best move?

  1. Comply without comment
  2. Recommend the simplest architecture that meets requirements, explaining the cost/reliability trade-offs of unnecessary complexity
  3. Build the complex version and a simple version in parallel indefinitely
  4. Disengage from the project

11. Which best describes the "augmented LLM" building block?

  1. A single Claude call enhanced with retrieval, tools, and/or memory
  2. A network of five or more coordinated agents
  3. A model that has been fine-tuned exclusively
  4. A workflow that never uses tools

Domain 2: Models, Prompting & Context Engineering (Items 12-19)

12. A high-volume, sub-second-latency ticket classifier with a clearly-bounded label set should default to which model tier?

  1. The largest, slowest available model for every request
  2. The fastest, smallest capable model, with escalation for low-confidence cases
  3. A model with the largest possible context window regardless of task size
  4. Whichever model is newest, regardless of fit

13. A prompt must reliably produce a very specific JSON structure the model doesn't produce by default. Which technique addresses this most directly?

  1. Zero-shot instruction only
  2. Few-shot examples demonstrating the exact target structure
  3. Lowering max_tokens
  4. Disabling tool use

14. As a multi-turn agent conversation grows, output quality degrades well before the nominal context limit is reached. What is this called, and what best mitigates it?

  1. Rate limiting; mitigate by increasing quota
  2. Context rot; mitigate with summarization/compaction and removal of stale content
  3. Cache invalidation; mitigate by disabling caching
  4. Model deprecation; mitigate by pinning a model ID

15. A team places its prompt-caching breakpoint immediately after the unique, per-request user question rather than after the static system prompt. What results?

  1. Optimal caching performance
  2. Near-zero cache hit rate, since the breakpoint sits on content that changes every request
  3. Automatically higher accuracy
  4. No effect either way

16. Which best describes "Skills" from a context-management perspective?

  1. They force all procedural instructions to load on every request
  2. They allow procedural knowledge to be discovered and loaded only when relevant to the current task
  3. They are a replacement for system prompts in all cases
  4. They only function with the largest models

17. A tutoring assistant skips reasoning steps and jumps to a wrong arithmetic answer. Which technique most directly helps?

  1. Chain-of-thought prompting requiring step-by-step reasoning before a final answer
  2. Removing all examples from the prompt
  3. Reducing the model's context window
  4. Disabling retrieval

18. Select two. Which two design choices most directly improve prompt-cache hit rates for a system with a large, static system prompt and a varying user message?

  1. Placing static content before the variable content
  2. Setting the cache breakpoint on the last block that is identical across requests
  3. Randomizing the order of static content each request
  4. Appending a timestamp before the cache breakpoint

19. A system prompt lists the assistant's role, then reference material, then explicit behavioral guardrails, then output-format requirements. What principle does this ordering reflect?

  1. Random ordering has no effect, so this is arbitrary
  2. A deliberate, layered system-prompt structure that establishes context before constraining behavior and output
  3. Guardrails should always be listed first, so this ordering is wrong
  4. Output format should never be specified in a system prompt

Domain 3: Integration (Items 20-31)

20. An agent configured with far more tools than its task requires shows degraded tool-selection accuracy and a larger attack surface. What is this called?

  1. Context rot
  2. Capability bloat
  3. Model drift
  4. Cache invalidation

21. A backend tool call executes using a shared application-level credential instead of the requesting user's actual permission scope. What gap does this represent?

  1. An authentication gap only
  2. An authorization gap: the call may exceed what this specific user should be allowed to do
  3. A latency issue only
  4. No gap, since the application itself is authenticated

22. A RAG system retrieves the top-40 chunks per query "to be thorough," though evals show accuracy plateaus at 6 chunks for this corpus. What is the likely consequence?

  1. Guaranteed proportional accuracy gains
  2. Wasted cost/latency and possible context-rot-driven accuracy loss with no benefit past the plateau
  3. No cost impact, since retrieval is free
  4. Automatic deduplication with no downside

23. Confident but wrong answers appear immediately after a scheduled document refresh, with model version and latency unchanged. Where should the architect look first?

  1. Temperature setting
  2. The retrieval/indexing layer for stale or broken chunks
  3. The user's device
  4. The context window size

24. A knowledge base is a structured table of transactional order records, and users ask for exact order statuses by ID. Which retrieval approach fits best?

  1. Chunk everything into prose and use dense vector search
  2. Direct database query / text-to-SQL against the structured records
  3. A giant few-shot prompt of all orders
  4. Fine-tuning on the order table

25. Two independent companies need their agents to negotiate a shared task without either hosting a central orchestrator the other must trust. Which integration mechanism fits best?

  1. A shared internal MCP server hosted by one company only
  2. An agent-to-agent protocol enabling peer communication across the trust boundary
  3. A hardcoded shared CLI script
  4. Monolithic context loading both companies' tool catalogs into one agent

26. A tool catalog is expected to grow from 20 to 400 tools over the next year. Which context strategy scales appropriately?

  1. Continue loading every tool definition on every request
  2. Progressive discovery: a searchable directory, with full definitions loaded only for relevant tools
  3. Randomly sample 20 tools per request
  4. Disable tool use once the catalog exceeds 50

27. Select two. Which two practices most directly support observability at scale for a system handling hundreds of thousands of daily requests?

  1. Structured logging of token usage, latency, tool calls, and guardrail triggers per request
  2. Occasional informal spot-checking with no fixed cadence
  3. Risk-stratified sampling with 100% review of high-stakes actions
  4. Disabling logs to reduce storage spend

28. An integration needs to connect to a growing ecosystem of third-party tools and data sources with minimal bespoke glue code, usable across multiple AI client applications. Which mechanism fits best?

  1. A one-off direct API integration per tool
  2. MCP (Model Context Protocol)
  3. A private, undocumented CLI wrapper
  4. Hardcoded credentials shared across tools

29. A support agent that only ever needs to read tickets and draft replies is also configured with tools to issue refunds and delete accounts. Applying least privilege, what is the best fix?

  1. Add audit logging to the refund/delete tools
  2. Remove the refund and delete tools from the agent's configuration entirely
  3. Add a confirmation dialog before refunds/deletions
  4. Use a larger, more reliable model

30. A multi-hop question requires combining facts from several related documents and understanding relationships between entities. Which retrieval approach is best suited?

  1. A single top-k vector search pass
  2. Graph-based or iterative/agentic retrieval that can traverse relationships and retrieve again as needed
  3. Keyword search only
  4. No retrieval at all

31. Which best describes chunking strategy trade-offs in a RAG pipeline?

  1. Chunk size has no effect on retrieval quality
  2. Chunks too small lose needed surrounding context; chunks too large dilute relevance and waste tokens once retrieved
  3. Larger chunks always improve accuracy with no downside
  4. Chunking should always be exactly 100 tokens regardless of content

Domain 4: Evaluation, Testing & Optimization (Items 32-41)

32. A team plans to launch with only the statement "it seems to work well" as their evaluation basis. What is the most important corrective step?

  1. Launch as planned
  2. Define measurable targets across accuracy, latency, cost, safety, and security before launch
  3. Measure only cost
  4. Rely entirely on post-launch user complaints

33. Which combination of evaluation methods best balances scale and nuance?

  1. Golden-set automation only
  2. A mix of golden-set automated evaluation, model-graded (LLM-as-judge) evaluation, and sampled human evaluation
  3. Human review of 100% of outputs only
  4. No structured evaluation, only model self-reported confidence

34. A new prompt "feels better" after reading ten transcripts. What should precede a full production rollout?

  1. Immediate 100% rollout
  2. A proper A/B comparison on a sufficiently large sample, checking the primary metric and guardrail metrics
  3. No further testing, since the team is confident
  4. Rollout based on cost impact alone

35. A system shows a broad quality drop across unrelated task types immediately after a model version upgrade, with retrieval and infrastructure unchanged. What is the likely cause?

  1. A retrieval indexing bug
  2. Model mismatch: the new version behaves differently than what prompts/evals were tuned against
  3. User error
  4. A network issue

36. An assistant occasionally fabricates a plausible but nonexistent citation. What failure mode is this, and what mitigates it?

  1. Rate limiting; mitigate with throttling
  2. Hallucination; mitigate with grounded citation requirements verified against retrieved sources
  3. Latency spike; mitigate with more hardware
  4. Cache invalidation; mitigate by disabling caching

37. A team wants to reduce cost on a high-traffic pipeline. Which optimization should generally be tried first?

  1. Correctly structured prompt caching for static prompt content
  2. Immediately switching to the cheapest model regardless of fit
  3. Removing safety guardrails to save tokens
  4. Disabling logging

38. Which best describes the correct relationship between pre-launch evaluation and post-launch monitoring?

  1. Pre-launch evaluation alone is sufficient forever
  2. Evaluation is continuous: pre-launch, ongoing monitoring, and triggered re-evaluation after meaningful changes
  3. Monitoring is needed only if pre-launch evaluation failed
  4. They are unrelated, separately-owned activities

39. Select two. Which two are hallmarks of a well-designed evaluation dataset?

  1. Built entirely from idealized synthetic happy-path examples
  2. Includes real production traffic and deliberately chosen edge/failure cases
  3. Refreshed periodically as the product and corpus evolve
  4. Frozen permanently at launch

40. Rising latency appears with no change in output accuracy. Which is the most efficient first diagnostic step?

  1. Rewrite the entire prompt from scratch
  2. Check cache-hit-rate telemetry and tool-call timing breakdowns for a specific bottleneck
  3. Assume the model itself has become slower with no further investigation
  4. Increase the retrieved chunk count

41. Which metric dimension is most directly measured by a red-teaming exercise attempting prompt injection and jailbreaks?

  1. Cost
  2. Security
  3. Latency
  4. Productivity

Domain 5: Governance, Safety & Risk Management (Items 42-50)

42. An agent summarizing web pages follows hidden instructions embedded in page content, taking unintended actions. What is this, and what best mitigates it?

  1. Hallucination; mitigate with a bigger model
  2. Prompt injection; mitigate by treating retrieved content as untrusted data and constraining resulting actions
  3. Model drift; mitigate by pinning a version
  4. Bias amplification; mitigate with fairness testing

43. A healthcare startup uses a third-party vendor to process protected health information (PHI) via Claude. What is the essential compliance prerequisite?

  1. A GDPR agreement only
  2. A HIPAA Business Associate Agreement plus strict access controls and audit logging
  3. No special agreement needed
  4. Automatic FedRAMP authorization

44. An agent can issue refunds up to $10,000. Which reflects mature human-in-the-loop design?

  1. One approval at session start covering all future refunds
  2. Mandatory human approval at the point each refund would execute, especially above a threshold
  3. Never allowing refunds under any circumstance
  4. Logging refunds after the fact with no approval gate

45. A hiring-screening tool shows good aggregate accuracy but a notably higher false-rejection rate for one demographic subgroup. What should happen?

  1. Ignore it since aggregate accuracy is fine
  2. Investigate and address the subgroup disparity before further deployment in this consequential domain
  3. Stop reporting subgroup metrics
  4. Increase sample size without addressing the disparity

46. An EU-facing chatbot retains full transcripts indefinitely with no deletion mechanism. What compliance gap does this create?

  1. A HIPAA violation
  2. A GDPR gap around data minimization and the right to erasure
  3. No gap, since chat isn't personal data
  4. A FedRAMP violation

47. Which best exemplifies "removal beats detection" as a guardrail principle?

  1. Logging every high-risk tool call
  2. Removing an unneeded delete-account tool from an agent entirely
  3. Adding confirmation dialogs to all actions, including harmless ones
  4. Expanding the context window

48. A US federal agency wants to process case files in the cloud using Claude. What requirement most likely gates the entire deployment?

  1. A well-written system prompt
  2. Deployment in a FedRAMP-authorized environment meeting required residency, encryption, and audit controls
  3. A larger context window
  4. Enabling prompt caching

49. Select two. Which two support transparency as an ethical AI principle in a consequential-decision system?

  1. Disclosing AI involvement and data use to affected users
  2. Keeping the model's role undisclosed to avoid confusion
  3. Maintaining internal documentation of model choice, guardrails, and known failure modes
  4. Avoiding subgroup-level performance reporting

50. Which is a legitimate example of "excessive agency" as an LLM system risk?

  1. A model correctly declining an out-of-scope request
  2. An autonomous multi-step agent taking actions well beyond what the original task required, without a checkpoint
  3. A model citing its retrieved sources accurately
  4. A model responding within its context window limit

Domain 6: Stakeholder Communication & Lifecycle Management (Items 51-59)

51. A project begins from "add AI to our support process" with no further detail gathered. What is the most significant risk?

  1. No risk at all
  2. A technically functional system that fails to move the actual business metric, since success was never defined
  3. Automatic budget overrun
  4. Guaranteed regulatory violation

52. An architect must explain to a non-technical executive why a routing layer with a smaller model was chosen over one large model for every request. Which explanation fits best?

  1. A detailed explanation of attention mechanisms
  2. A trade-off explanation tying the choice to latency SLA, cost, and negligible quality impact on the majority of traffic
  3. Avoiding the topic entirely
  4. "It's just more efficient," with no further detail

53. A stakeholder requests an unplanned new capability mid-project with no discussion of timeline or cost. What is the best next step?

  1. Silently add it
  2. Evaluate it against the original success metric and constraints, and communicate the trade-off before proceeding
  3. Refuse outright with no discussion
  4. Add it and hide the resulting delay

54. A system is handed off with only a verbal walkthrough and no written documentation; the original architect later leaves. What was missing?

  1. A bigger model
  2. Complete documentation enabling someone other than the original architect to operate the system
  3. A different programming language
  4. More pre-launch meetings only

55. Which lifecycle phase is most often incorrectly treated as optional?

  1. Discovery
  2. Monitoring and iteration after launch
  3. Initial design
  4. The kickoff meeting

56. A client verbally agreed the system should be "fast and accurate" with no further specification, and now disputes whether it meets that bar. What should have happened earlier?

  1. Nothing; verbal agreement suffices
  2. Defining concrete, written SLA metrics tied to the evaluation framework, agreed before build
  3. Building first, defining metrics afterward based on results
  4. Avoiding metric discussion to stay informal

57. What is the primary purpose of an Architecture Decision Record (ADR)?

  1. Marketing collateral for the client
  2. A structured record of context, options considered, the decision, trade-offs accepted, and reversibility
  3. A line-by-line code changelog
  4. A document used only once for legal sign-off

58. Select two. Which two should structured discovery establish before design begins?

  1. The exact final prompt text
  2. The business success metric and acceptable risk tolerance
  3. The current-state process and baseline to improve upon
  4. The specific vector database vendor

59. A team documents guardrails, evaluation results, and runbooks as part of handoff. What lifecycle purpose does this serve?

  1. Satisfying an arbitrary paperwork requirement only
  2. Enabling the operating team to independently diagnose and respond to incidents after handoff
  3. Replacing the need for any monitoring going forward
  4. Preventing any future iteration on the system

Domain 7: Developer Productivity & Operational Enablement (Items 60-63)

60. A team adopts an agentic coding tool with no shared team-level configuration; every developer configures it differently. What is the most direct consequence?

  1. Guaranteed faster delivery
  2. Inconsistent style, duplicated effort, and uneven safety/permission boundaries across developers
  3. No consequence
  4. Automatic compliance with architecture standards

61. Which permission boundary best reflects least-privilege practice for an agentic coding tool in a shared repository?

  1. Direct push access to production with no review
  2. Autonomous read/test access, with explicit approval required before destructive commands or deploys
  3. Full administrative access for simplicity
  4. No command execution allowed at all

62. After a production incident, the team cannot reconstruct the prompt version, retrieved context, or model version involved. What was missing beforehand?

  1. A larger context window
  2. Reproducible, structured logging capturing the exact request details per call
  3. A faster model
  4. More stakeholder meetings

63. A prompt change causes a regression, and reverting it requires 45 minutes and a full redeploy. What operational capability was missing?

  1. A larger evaluation dataset
  2. A fast, low-friction rollback path for prompt/configuration changes independent of full redeployment
  3. A bigger model
  4. More input-layer guardrails
◆ Scoring your practice exam

Count correct answers out of 63 and compare against the domain breakdown on the next page. The real exam reports a scaled score (100-1,000, cut score 720) rather than a raw percentage, but as a rough self-check, aim for at least 80% correct here (roughly 50/63) with no single domain below 70% before scheduling the real exam.

Final Prep

Answer Key & Rationale

Score yourself, then read every rationale, including for items you got right. The reasoning pattern matters more than the individual fact.

Domain 1 (Items 1-11)

#AnsRationale
1BHigh volume, narrow task, near-instant latency: a single augmented LLM call with a live-data tool is sufficient: no need for multi-agent, unrestricted autonomy, or a multi-step chain.
2BThe workflow/agent distinction is about who controls the sequence of steps: code (workflow) or the model itself (agent).
3BGenerate → evaluate against criteria → refine in a loop is the definition of evaluator-optimizer.
4BAn undefined goal must be made concrete and measurable before design: this is a discovery failure, not something to infer later.
5BUnpredictable step count/nature is the defining condition favoring an agent over a workflow.
6BSplitting by capability with a code-level validation gate between steps is functional decomposition with a checkpoint.
7A, CGenuine context/tool overload and real parallelism gains are engineering justifications; stakeholder buzzword preference and copying an unrelated case study are not.
8BA design without a feedback loop is architecturally incomplete regardless of how polished input/processing/output are.
9BSame staff, more output covered: the definition of productivity amplification, not cost cutting or transformation.
10BThe architect's role is to recommend the right-sized solution and explain trade-offs, not comply with or refuse fashionable-but-unjustified complexity.
11AThe augmented LLM (a single call plus retrieval/tools/memory) is the foundational building block beneath all workflow and agent patterns.

Domain 2 (Items 12-19)

#AnsRationale
12BHigh volume, tight SLA, bounded task: smallest capable model with escalation for uncertain cases, not the largest model for everything.
13BFew-shot examples are the reliable way to enforce a specific, non-default output structure.
14BDegradation well within the nominal limit is context rot; compaction and removing stale content are the direct mitigation.
15BA breakpoint on ever-changing content never matches a prior cache write: the hash differs every request.
16BSkills implement progressive, on-demand disclosure of procedural knowledge rather than permanent context residency.
17AChain-of-thought reasoning directly targets skipped-step, jump-to-a-wrong-answer failures on multi-step problems.
18A, BStatic-first ordering plus a breakpoint on the last identical block are exactly what makes a prefix cacheable; randomizing order or including a timestamp before the breakpoint breaks caching.
19BRole → reference material → guardrails → output format is a deliberate layering, not an arbitrary or incorrect order.

Domain 3 (Items 20-31)

#AnsRationale
20BExcess, unused tool scope causing selection errors and attack-surface growth is the definition of capability bloat.
21BThe application is authenticated, but without user-scoped permission propagation, this is specifically an authorization gap.
22BRetrieval beyond the eval-proven plateau adds cost/latency and risks context rot with zero accuracy upside.
23BA regression precisely timed to a document refresh, with model/latency unchanged, points at retrieval/indexing first.
24BExact-match lookups over genuinely structured data are better served by direct query than vector search over prose.
25BCross-organization peer coordination without a shared trusted orchestrator is exactly what agent-to-agent protocols address.
26BA large, fast-growing tool catalog requires progressive discovery to avoid both context bloat and selection errors.
27A, CStructured, complete logging plus risk-stratified sampling are the pillars of real production observability; occasional spot-checks and disabled logging are not.
28BMCP is purpose-built for reusable, standardized connections across an ecosystem of tools and multiple AI clients.
29BRemoving unneeded high-risk tools eliminates the risk; logging and confirmations only manage it after the fact.
30BMulti-hop, relationship-spanning questions need graph-based or iterative/agentic retrieval, not a single top-k pass.
31BChunk size is a real trade-off between lost context (too small) and diluted relevance/wasted tokens (too large).

Domain 4 (Items 32-41)

#AnsRationale
32B"Seems to work well" is not a metric; concrete targets across all five dimensions must precede launch.
33BMixed methodology (automated + model-graded + sampled human) covers both scale and nuance; any single method alone falls short.
34BA qualitative read of ten transcripts isn't sufficient evidence for a full rollout: a proper A/B test is required.
35BA broad regression precisely coincident with a model version change, all else equal, indicates model mismatch.
36BA fabricated, plausible-but-nonexistent citation is a textbook hallucination; grounded citation verification is the mitigation.
37APrompt caching is typically the highest-ROI, zero-accuracy-cost optimization and should be exhausted before accuracy-impacting changes.
38BEvaluation is a lifecycle activity: pre-launch, continuous, and triggered by change, not a one-time gate.
39B, CReal-traffic-plus-edge-case datasets, refreshed over time, are the hallmark of a strong eval set; synthetic-only or frozen-forever sets are not.
40BCache-hit and tool-timing telemetry pinpoint a specific latency bottleneck instead of guessing at the model itself.
41BPrompt injection and jailbreak red-teaming directly measure the security dimension of the evaluation framework.

Domain 5 (Items 42-50)

#AnsRationale
42BHidden instructions in untrusted content hijacking behavior is prompt injection; treat external content as data, not instructions.
43BUS health data triggers HIPAA specifically, requiring a Business Associate Agreement plus access controls/audit logging.
44BHITL checkpoints belong at the point of each high-consequence action, not a single upfront session approval.
45BA subgroup disparity hidden by good aggregate accuracy must be investigated and addressed directly, especially in hiring.
46BIndefinite retention with no erasure path for EU personal data is a direct GDPR data-minimization/right-to-erasure gap.
47BRemoving an unneeded high-risk capability eliminates the risk; logging and confirmations are compensating controls only.
48BUS federal systems require FedRAMP-authorized hosting: a gating platform-level constraint, not a feature-level tuning choice.
49A, CDisclosure to affected users and maintained internal documentation are transparency practices; hiding AI involvement or suppressing subgroup data undermines it.
50BAn agent acting well beyond its task scope without a checkpoint is the definition of excessive agency.

Domain 6 (Items 51-59)

#AnsRationale
51BSkipping discovery risks a system that works technically but misses the undefined actual business goal.
52BTranslate technical decisions into business trade-off language (SLA, cost, quality impact) for non-technical stakeholders.
53BNew scope should be evaluated against the original baseline and its trade-offs communicated, not silently absorbed or flatly refused.
54BComplete documentation is what lets a system survive beyond its original architect.
55BMonitoring and iteration after launch are the phase most often wrongly treated as optional.
56BVague terms invite disputes; concrete, written SLA metrics agreed before build are the standard practice.
57BAn ADR's purpose is a durable, structured record of context, options, decision, trade-offs, and reversibility.
58B, CSuccess metric, risk tolerance, and current-state baseline are discovery-level; exact prompt text and vendor choice come later in design.
59BHandoff documentation exists so the operating team can independently diagnose and respond to incidents.

Domain 7 (Items 60-63)

#AnsRationale
60BNo shared configuration leads to inconsistent style, duplicated effort, and uneven safety boundaries across a team.
61BLeast privilege for developer tooling means autonomous low-risk actions with explicit gates on destructive/high-risk ones.
62BReproducible, structured per-request logging is what enables root-causing a production incident after the fact.
63BA slow, high-friction revert path is the specific gap; the fix is a fast rollback mechanism decoupled from full redeploy.
Final Prep

Glossary

Every bolded or domain-critical term used in this guide, in one place for last-minute review.

AgentA system where the LLM dynamically directs its own process and tool usage in a loop, rather than following a predefined code path.
Agentic systemUmbrella term covering both workflows and agents: any system where an LLM and tools work together toward a goal.
Agent-to-agent protocolA communication mechanism allowing independent agents (often across organizational or trust boundaries) to coordinate without a shared central orchestrator.
Augmented LLMA single LLM call enhanced with retrieval, tools, and/or memory: the foundational building block of agentic systems.
Capability bloatGiving an agent more tools, permissions, or scope than its task requires, increasing attack surface and degrading tool-selection accuracy.
Chain-of-thought (CoT)A prompting technique requiring the model to reason step-by-step before producing a final answer, improving multi-step reasoning accuracy.
ChunkingSplitting source documents into retrievable units for a RAG pipeline; chunk size trades off context completeness against relevance and token cost.
CompactionAutomatically summarizing earlier parts of a long conversation so it can continue productively past context-window pressure.
Context editingRemoving or trimming stale tool results, thinking blocks, or superseded content from context to manage token usage.
Context rotThe degradation of accuracy and recall as token count grows, even within the nominal context window limit.
Context windowThe total span of tokens (input plus output) a model can reference in a single request: a finite "working memory," not equivalent to training knowledge.
Evaluator-optimizerA workflow pattern where one LLM call generates output and another evaluates/critiques it in an iterative refinement loop.
Excessive agencyAn agent taking actions beyond what a task actually required, especially in long autonomous loops lacking checkpoints.
Few-shot promptingProviding a small number of worked examples in the prompt to convey a desired format, style, or edge-case handling.
GuardrailA control (input filtering, system-prompt instruction, tool-scope limit, output check, or action gate) constraining model or system behavior for safety and compliance.
HallucinationConfident generation of false, fabricated, or unverifiable content, especially outside grounded context or reliable knowledge.
Human-in-the-loop (HITL)A design pattern requiring human review or approval at defined points, calibrated to the risk/consequence of the action.
Least privilegeThe principle that an agent or system should hold only the permissions/tools its task strictly requires, and no more.
MCP (Model Context Protocol)An open standard for connecting AI applications to external tools, data sources, and prompts through a common, reusable interface.
Model mismatchA quality regression caused by a change in model version/tier that behaves differently than the one prompts and evals were tuned against.
Multi-agent systemAn architecture using more than one agent: commonly an orchestrator plus specialized subagents, or peer agents communicating directly.
Orchestrator-workersA workflow pattern where a central LLM call dynamically decomposes a task, delegates to worker calls, and synthesizes their results.
Parallelization (sectioning / voting)Running independent subtasks concurrently (sectioning) or the same task multiple times for consensus (voting).
Progressive discoveryExposing a small directory of available tools/Skills/capabilities and loading full detail only on demand, instead of front-loading everything.
Prompt cachingReusing previously-processed prompt prefixes to reduce cost and latency on repeated or growing requests.
Prompt chainingDecomposing a task into a fixed sequence of LLM calls, each processing the prior step's output, with optional validation gates between steps.
Prompt injectionMalicious instructions embedded in untrusted input or retrieved content attempting to override a system's intended behavior.
RAG (retrieval-augmented generation)Grounding model output in a specific corpus by retrieving relevant content at query time and passing it into the prompt.
RoutingClassifying an input and directing it to a specialized downstream prompt, tool, or model tier.
SkillsPackaged, reusable procedural knowledge (instructions, scripts, reference files) that a model can discover and load only when relevant.
WorkflowAn agentic system where LLM calls and tools are orchestrated through predefined code paths, rather than model-directed looping.
GDPREU regulation governing personal data: data minimization, right to erasure/access, lawful basis for processing.
HIPAAUS regulation governing protected health information: requires Business Associate Agreements, access controls, and audit logging.
FedRAMPUS federal authorization framework governing cloud systems handling federal government data: gates hosting/platform choice.
SLA (service-level agreement)A defined, measurable commitment on latency, availability, or accuracy: should be written and tied to concrete metrics, not left vague.
ADR (Architecture Decision Record)A structured document capturing context, options considered, the decision made, accepted trade-offs, and reversibility.
Final Prep

External Resources & Further Reading

This guide is designed to be sufficient on its own: these links are optional deeper dives and official primary sources, useful for hands-on practice and for verifying anything that may change after this guide's July 2026 edition.

Official certification sources

  • Official Exam Guide (PDF): the authoritative blueprint this study guide is built from: search "Claude Certified Architect Professional Exam Guide" on Anthropic Partner Academy, or visit anthropic-partners.skilljar.com.
  • Anthropic Partner Academy certifications hub: anthropic-partners.skilljar.com/page/partner-certifications, for the FAQ, policies, and any prep courses added over time.
  • Pearson VUE (exam delivery): pearsonvue.com/us/en/anthropic.html, scheduling, system requirements, and accommodations.

Anthropic technical documentation

  • Claude Platform Docs: platform.claude.com/docs, the primary reference for models, the Messages API, tools, context management, prompt caching, extended/adaptive thinking, and Skills. Start with "Models overview," "Choosing a model," and "Features overview."
  • Prompt engineering guides: under Build with Claude → Prompt engineering: covers prompting best practices, chain-of-thought, and model-specific guidance.
  • Context management: Context windows, Compaction, Context editing, and Prompt caching pages: essential hands-on reading for Domain 2 and Domain 3.
  • Tools & agents: Tool use overview, MCP connector, Remote MCP servers, and Agent Skills overview: essential for Domain 3.
  • Claude Agent SDK: platform.claude.com/docs/en/agent-sdk/overview, for building custom agent harnesses referenced in Domain 1 and Domain 7.

Model Context Protocol

  • modelcontextprotocol.io: the open MCP specification, architecture concepts, and guides for building both MCP servers and clients: core reading for Domain 3's connection-protocol objectives.

Anthropic engineering & research writing

  • "Building Effective Agents" (anthropic.com/engineering): the primary source for the workflow/agent vocabulary (prompt chaining, routing, parallelization, orchestrator-workers, evaluator-optimizer) used throughout Domain 1.
  • "Effective context engineering for AI agents" (anthropic.com/engineering): deeper treatment of context rot and context management strategy for Domain 2.
  • "Effective harnesses for long-running agents" (anthropic.com/engineering): relevant to Domain 1's multi-agent orchestration and Domain 7's operational patterns.
  • Anthropic Transparency Hub (anthropic.com/transparency): model cards, responsible scaling policy, and safety documentation relevant to Domain 5.

Regulatory primary sources (for Domain 5)

  • GDPR: official text and guidance at gdpr.eu or your EU data protection authority.
  • HIPAA: U.S. Department of Health and Human Services, hhs.gov/hipaa.
  • FedRAMP: fedramp.gov for the authorization process and marketplace of authorized cloud offerings.
◆ A final note on hands-on practice

No amount of reading substitutes for building. Before sitting the exam, aim to have personally: made real Claude API calls across at least two model tiers; built a small RAG pipeline with your own chunking and retrieval choices; wired up one real tool or MCP integration; written and run an evaluation set of at least 20 cases; and drafted one architecture decision record as if presenting to a client. That hands-on foundation is what separates confident recall from genuine architectural judgment, which is exactly what this exam is built to measure.

Good luck on the exam, Amit.