Skip to content

Document Pulumi Agents and reorganize Infrastructure AI docs - #22287

Merged
kramhuber merged 12 commits into
masterfrom
mhuber/agents-ai-docs-scaffold
Oct 27, 2026
Merged

kramhuber merged 12 commits into
masterfrom
mhuber/agents-ai-docs-scaffold

Conversation

@kramhuber

@kramhuber kramhuber commented Oct 14, 2026 •

Copy link
Copy Markdown
Contributor

Adds documentation for Pulumi Agents covering pre-built and custom agents, configuration, integrations, permissions, tasks, events, schedules, and troubleshooting. Incorporates Neo as the pre-built personal agent while preserving its dedicated guides.

Reorganizes Infrastructure AI navigation into Get started, Concepts, Guides, Integrations, and Reference. Updates the landing pages to distinguish Pulumi Agents from using Pulumi with external coding agents, and preserves existing URLs.

Marketing site updated covered in https://github.com/pulumi/marketing-web/pull/252

@github-actions

github-actions Bot commented Oct 14, 2026 •

Copy link
Copy Markdown
Contributor

Sentinel — merge gate status

All gates green — nothing is blocking this merge.

Gate What it needs
✅ G1 review-ran Nothing to do: review current at 6de586eee.
✅ G2 findings-answered Nothing to do: every finding answered.
✅ G3 right-approver Nothing to do: approved by CamSoper, who has write access.
➖ G4 infra-evidence Doesn't apply to this PR: no changed path affects the deploy.
➖ G5 oversized-ack Doesn't apply to this PR: not oversized.

Evaluated at head 6de586eee.


Need help, or think a gate got it wrong? Ask in #docs on Slack.

@pulumi-bot

pulumi-bot commented Oct 14, 2026 •

Copy link
Copy Markdown
Collaborator

Your site preview for commit 6de586e is ready! 🎉

http://www-testing-pulumi-docs-origin-pr-22287-6de586ee.s3-website.us-west-2.amazonaws.com

Changed pages:

@pulumi-bot

pulumi-bot commented Oct 14, 2026 •

Copy link
Copy Markdown
Collaborator

Lighthouse Performance Report

Commit: 6de586e | Metric definitions

Page Device Score FCP LCP TBT CLS SI
Homepage Mobile 🔴 31 7.5s 14.1s 1643ms 0.004 7.5s
Homepage Desktop 🟡 83 1.3s 2.5s 0ms 0.000 1.3s
Install Pulumi Mobile 🟡 59 5.5s 12.7s 161ms 0.057 5.5s
Install Pulumi Desktop 🟡 79 1.0s 2.3s 0ms 0.166 1.0s
AWS Get Started Mobile 🔴 46 5.3s 8.9s 56ms 0.328 5.3s
AWS Get Started Desktop 🟡 86 1.0s 2.2s 0ms 0.069 1.0s

@kramhuber
kramhuber marked this pull request as ready for review October 20, 2026 16:11
@github-actions github-actions Bot added review:triaging Claude Triage is currently classifying the PR domain:website PR touches marketing, pricing, legal, or competitive landing pages domain:docs PR touches technical docs domain:mixed PR touches more than one domain domain:frontend PR touches Hugo templates, theme sources, or site assets (layouts/, theme/, assets/, static/) labels Oct 20, 2026
@pulumi-bot
pulumi-bot requested review from a team October 20, 2026 16:12
@github-actions github-actions Bot added review:in-progress Claude review is currently running and removed review:triaging Claude Triage is currently classifying the PR labels Oct 20, 2026

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🔧 One-click fixes for findings that block merge — each matches a Do this block on the author card. Commit one and the card picks up the fix; you can still disagree on the card instead.


Generated by Claude Code

@github-actions github-actions Bot added review:error Workflow failed before publishing a review; see Actions logs and removed review:in-progress Claude review is currently running labels Oct 20, 2026
@CamSoper

Copy link
Copy Markdown
Contributor

/new-review the last review run failed


Generated by Claude Code

@github-actions github-actions Bot added review:in-progress Claude review is currently running and removed review:error Workflow failed before publishing a review; see Actions logs labels Oct 22, 2026
@github-actions

github-actions Bot commented Oct 22, 2026 •

Copy link
Copy Markdown
Contributor

Reviewer's guide v3 — not for the author

Tip

Check the ⚠️ items, then approve. Your approval covers only those; links, shortcodes, metadata, and verified claims were checked by machine (receipts on the evidence page). Code samples are read, not compiled.

PR author: nothing here is yours. Your to-do list is the "Author action guide" comment.

Review requested from: @pulumi/docs-guild, @pulumi/docs-marketing-review, @pulumi/docs-tools — an approval from anyone with write access satisfies the merge gate.

Note

What this PR changes:

  • New Pulumi Agents section: overview, configure, custom agents, create and manage, manage, permissions, tasks, triggers, and the Task API reference
  • New cloud integration pages: AWS, Azure, Datadog, and Google Cloud, plus an integrations hub with logo links
  • New coding-agents section (overview and handoff) for third-party agents
  • Neo docs slimmed down and repositioned as the personal agent within Pulumi Agents; the MCP and CLI integration pages rewritten
  • Nav (menus.yml), docs home, llms.txt, and new integration-links / agent-cli-connection shortcodes updated, plus new logo SVGs

What would block a reader is setup steps or permission statements that don't match the shipped product, because readers grant real credentials based on them. The review ran claim verification, the Hugo build and link check, a frontmatter sweep, readthrough structure detectors, and Vale.

Review confidence:

Dimension Level Notes
mechanics HIGH
facts LOW Settled since this was written — see ✅ Resolved on the author card.
coherence MEDIUM → see F4, the Datadog page's step order
cross-sibling consistency MEDIUM Not yours to check: consistency between the new pages and the existing Neo pages was only spot-checked
code correctness HIGH

⚠️ Check these before approving

ID Where Finding
F4 content/docs/ai/agents/integrations/datadog.md L17-22 "Prepare Datadog access" grants permissions to the service account before "Create the credentials" step 1 creates that account. A reader can still finish, since the account can be created first and permissioned afterward. Confirm the order is acceptable, or ask the author to move account creation ahead of the permissions paragraph.
F24 content/docs/ai/agents/custom.md L47 Only the PR's own permissions page backs the claim that roles and credentials, not instructions, enforce an agent's access limits. If it's wrong, readers will over-trust prompt restrictions. Confirm with someone who knows the product, or accept the author's answer to F7.
F26 content/docs/ai/agents/integrations.md L78 Only sibling pages in this PR support the claim that Neo and configured agents share the same integration connections. That affects how admins reason about credential blast radius. Confirm it with someone who knows the product.
F28 content/docs/ai/agents/tasks.md L33 The rule that Slack channel membership alone grants no access to an agent's tasks rests only on the Slack integration page. It's a security-relevant statement, so confirm it with someone who knows the product.

Editorial stances introduced by this PR

Superlatives and comparisons the diff adds. Framing isn't fact-checkable, so confirm each is a stance the docs should take.

  • L44 content/docs/ai/agents/permissions.md — "To start a task, a teammate needs agent_task:create and access to the agent. For an agent with an assigned role, the teammate must hold that role directly…" — positioning (found by regex)

✅ What you can rubber-stamp

  • Facts: 314 factual claims checked — 175 verified clean, 3 flagged in the ⚠️ list, 136 settled — see the evidence page.
  • Mechanics: frontmatter sweep ran; Hugo build green; 122 added internal link(s) resolve; 5 detector finding(s) filed above.
  • Style: 15 advisory suggestions left with the author; never blocking.

Pre-existing issues in touched files: 2 — details on the evidence page.

Full evidence: verification trail, investigation log, review history.

Review v3 · updated 2026-10-23T18:18:33Z · head commit 6de586e


For the reviewer: something look wrong? Comment /update-review <your point> and the review re-checks with your input.

@github-actions

github-actions Bot commented Oct 22, 2026 •

Copy link
Copy Markdown
Contributor

Author action guide v3 — nothing blocks merge

Important

You = the PR author. Answer every item below before this PR can merge.

To answer: push a fix, or reply /update-review F1: <what you fixed, why it's wrong, or "accepting as-is — why">. A reply without /update-review at the start of a line doesn't count. Examples: How to answer at the bottom.

This PR adds a Pulumi Agents docs section (configuration, permissions, triggers, tasks, and cloud and MCP integrations) and reorganizes the Infrastructure AI docs. The review checked its facts, links, the Hugo build, readthrough structure, and style.

Style suggestions

Optional polish from pattern-based linting and the review's own read; never blocking.

content/docs/ai/agents/_index.md — 1 (1 heading capitalization)
  • line 47: [style] heading capitalization — Heading 'Use Pulumi Agents' should use sentence case (capitalize only the first word and proper nouns).
content/docs/ai/agents/integrations/azure.md — 1 (1 wordiness)
  • line 42: [style] wordiness — 'subsequent' is too wordy.
content/docs/ai/agents/integrations/datadog.md — 1 (1 wordiness)
  • line 33: [style] wordiness — 'Authorize' is too wordy.
content/docs/ai/agents/integrations/google-cloud.md — 1 (1 wordiness)
  • line 21: [style] wordiness — 'obtain' is too wordy.
content/docs/ai/agents/manage.md — 1 (1 wordiness)
  • line 48: [style] wordiness — 'it is' is too wordy.
content/docs/ai/agents/permissions.md — 1 (1 difficulty qualifier)
  • line 48: [style] difficulty qualifier — Avoid difficulty qualifier 'just' -- it judges difficulty for the reader (brand guide: voice, inclusive language).
content/docs/ai/agents/triggers.md — 2 (2 wordiness)
  • line 23: [style] wordiness — 'all of' is too wordy.
  • line 56: [style] wordiness — 'it is' is too wordy.
content/docs/ai/coding-agents/_index.md — 1 (1 heading capitalization)
  • line 16: [style] heading capitalization — Heading 'Pulumi Agent Skills' should use sentence case (capitalize only the first word and proper nouns).
content/docs/ai/neo/integrations/cli/_index.md — 2 (2 misspelling)
  • line 5: [style] misspelling — 'az' isn't in the dictionary or styles/Pulumi/ignore/tech-vocabulary.txt. Fix the spelling, or add the term if it's genuinely correct.
  • line 91: [style] misspelling — 'submenu' isn't in the dictionary or styles/Pulumi/ignore/tech-vocabulary.txt. Fix the spelling, or add the term if it's genuinely correct.
content/docs/ai/neo/integrations/mcp/_index.md — 3 (2 wordiness, 1 heading capitalization)
  • line 25: [style] wordiness — 'Authorize' is too wordy.
  • line 47: [style] wordiness — 'authorize' is too wordy.
  • line 104: [style] heading capitalization — Heading 'New Relic' should use sentence case (capitalize only the first word and proper nouns).
content/docs/ai/neo/integrations/slack/_index.md — 1 (1 article before product name)
  • line 49: [style] article before product name — Drop 'the' before 'Pulumi Cloud' unless it modifies a noun that follows (e.g., 'the Pulumi Cloud console').

✅ Resolved since last review

15 resolved items — click to expand
ID Where Finding
F1 content/docs/ai/neo/integrations/mcp/_index.md L87 The Honeycomb step says the Key ID and the Key Secret are both shown only once, but Honeycomb shows only the Key Secret once. Limit the warning to the secret. — ✅ fixed in 958d731
F16 content/docs/ai/neo/integrations/mcp/_index.md L55-60 "Atlassian Rovo MCP setup: in admin.atlassian.com open Rovo MCP and enable API token…" — verdict: unverifiable. Nothing public describes this product behavior. Confirm it matches the shipped product (details below). — ✅ fixed in 958d731; the rewritten Atlassian steps now match Atlassian's MCP-settings and service-account token docs, which the page cites
F7 — 121 claims about Pulumi's own behavior, unchecked because the review can't read github.com/pulumi/marketing-web/pull/252 — verdict: unverifiable — concede: CamSoper confirmed that PR author kramhuber owns Pulumi Agents and is the SME, and that the claims this group lists match the shipped product.
F8 content/docs/ai/agents/create-and-manage/_index.md L15 "In Pulumi Agents, you can start with a pre-built agent or write your own custom…" — verdict: unverifiable. Nothing public describes this product behavior. Confirm it matches the shipped product (details below). — concede: CamSoper confirmed that PR author kramhuber owns Pulumi Agents and is the SME, and that this behavior matches the shipped feature.
F9 content/docs/ai/agents/custom.md L40-42 "A Pulumi custom agent can read a repository's contribution instructions and open a pull…" — verdict: unverifiable. Nothing public describes this product behavior. Confirm it matches the shipped product (details below). — concede: CamSoper confirmed that PR author kramhuber owns Pulumi Agents and is the SME, and that this behavior matches the shipped feature.
F12 content/docs/ai/agents/permissions.md L26 "The Pulumi Agents configuration has a Role field in which a Pulumi Cloud role can…" — verdict: unverifiable. Nothing public describes this product behavior. Confirm it matches the shipped product (details below). — concede: CamSoper confirmed that PR author kramhuber owns Pulumi Agents and is the SME, and that this behavior matches the shipped feature.
F13 content/docs/ai/agents/triggers.md L6 "Pulumi Agents can be configured to start agent tasks automatically when a Pulumi…" — verdict: unverifiable. Nothing public describes this product behavior. Confirm it matches the shipped product (details below). — concede: CamSoper confirmed that PR author kramhuber owns Pulumi Agents and is the SME, and that this behavior matches the shipped feature.
F14 content/docs/ai/cli-for-agents/index.md L40 "By default, resource changes are recorded in Pulumi state and support state tracking…" — verdict: unverifiable. Nothing public describes this product behavior. Confirm it matches the shipped product (details below). — concede: CamSoper confirmed that PR author kramhuber owns Pulumi Agents and is the SME, and that this behavior matches the shipped feature.
F15 content/docs/ai/neo/integrations/mcp/_index.md L16 "For Pulumi Agents' MCP integrations, an organization administrator connects each…" — verdict: unverifiable. Nothing public describes this product behavior. Confirm it matches the shipped product (details below). — concede: CamSoper confirmed that PR author kramhuber owns Pulumi Agents and is the SME, and that this behavior matches the shipped feature.
F17 content/docs/ai/neo/integrations/mcp/_index.md L70-72 "Dash0 MCP integration setup: in Dash0 Settings > Endpoints copy the MCP endpoint URL…" — verdict: unverifiable. Nothing public describes this product behavior. Confirm it matches the shipped product (details below). — concede: CamSoper confirmed that PR author kramhuber owns Pulumi Agents and is the SME, and that this integration setup matches the shipped feature.
F18 content/docs/ai/neo/integrations/mcp/_index.md L74 "Dash0 uses regional endpoints, and Dash0's auth token documentation at…" — verdict: unverifiable. Nothing public describes this product behavior. Confirm it matches the shipped product (details below). — concede: CamSoper confirmed that PR author kramhuber owns Pulumi Agents and is the SME, and that this integration setup matches the shipped feature.
F19 content/docs/ai/neo/integrations/mcp/_index.md L106-108 "New Relic MCP integration setup: an administrator enables New Relic MCP Server > API…" — verdict: unverifiable. Nothing public describes this product behavior. Confirm it matches the shipped product (details below). — concede: CamSoper confirmed that PR author kramhuber owns Pulumi Agents and is the SME, and that this integration setup matches the shipped feature.
F20 content/docs/ai/neo/integrations/mcp/_index.md L108 "1. In the New Relic integration, enter your account's Region (us, eu, or jp)…" — verdict: unverifiable. Nothing public describes this product behavior. Confirm it matches the shipped product (details below). — concede: CamSoper confirmed that PR author kramhuber owns Pulumi Agents and is the SME, and that this integration setup matches the shipped feature.
F21 content/docs/ai/neo/integrations/mcp/_index.md L110 "The New Relic API key uses the automation account's permissions, and tools that require…" — verdict: unverifiable. Nothing public describes this product behavior. Confirm it matches the shipped product (details below). — concede: CamSoper confirmed that PR author kramhuber owns Pulumi Agents and is the SME, and that this integration setup matches the shipped feature.
F22 content/docs/ai/neo/integrations/mcp/_index.md L125-127 "For Sentry, create an internal integration under Settings > Custom Integrations, grant…" — verdict: unverifiable. Nothing public describes this product behavior. Confirm it matches the shipped product (details below). — concede: CamSoper confirmed that PR author kramhuber owns Pulumi Agents and is the SME, and that this integration setup matches the shipped feature.

Full evidence: verification trail, investigation log, review history.

Review v3 · updated 2026-10-23T18:18:33Z · head commit 6de586e


Please don't edit or delete this comment; it's the review's record.

@github-actions github-actions Bot added review:outstanding-issues Claude review completed; outstanding has author-actionable findings and removed review:in-progress Claude review is currently running labels Oct 22, 2026

@dschaller dschaller left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approved.

@github-actions github-actions Bot added review:stale New commits since last Claude review; refresh on next ready-transition or @claude mention and removed review:outstanding-issues Claude review completed; outstanding has author-actionable findings labels Oct 23, 2026
@kramhuber

Copy link
Copy Markdown
Contributor Author

/update-review with latest changes

@github-actions github-actions Bot added review:in-progress Claude review is currently running and removed review:stale New commits since last Claude review; refresh on next ready-transition or @claude mention labels Oct 23, 2026
@github-actions github-actions Bot added review:outstanding-issues Claude review completed; outstanding has author-actionable findings and removed review:in-progress Claude review is currently running labels Oct 23, 2026
@CamSoper

Copy link
Copy Markdown
Contributor

/update-review Confirm all unresolved findings -- @kramhuber is the owner of the functionality, he's the SME.

@github-actions github-actions Bot added review:in-progress Claude review is currently running review:no-blockers Claude review completed cleanly; outstanding is empty and removed review:outstanding-issues Claude review completed; outstanding has author-actionable findings review:in-progress Claude review is currently running labels Oct 23, 2026
@kramhuber
kramhuber merged commit 53ee778 into master Oct 27, 2026
27 checks passed
@kramhuber
kramhuber deleted the mhuber/agents-ai-docs-scaffold branch October 27, 2026 13:25

This branch was successfully deployed

1 active and 1 inactive deployments
testing — 6de586ee Deployed Oct 27, 2026 by kramhuber via Do cleanup #14974
production — 6de586ee Deployed Oct 27, 2026 by kramhuber via Record review outcome #14974
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

domain:docs PR touches technical docs domain:frontend PR touches Hugo templates, theme sources, or site assets (layouts/, theme/, assets/, static/) domain:mixed PR touches more than one domain review:no-blockers Claude review completed cleanly; outstanding is empty

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants