Repository navigation
docs(operations): post-W3 functional smoke test checklist - #412
KingInYellow18 wants to merge 5 commits into
Conversation
|
User kinginyellow18@proton.me does not have a PR Review subscription. Go to Team management and add this email to the PR Review subscription. |
|
Important Review skippedAuto reviews are disabled on base/target branches other than the default branch. Please check the settings in the CodeRabbit UI or the ⚙️ Run configurationConfiguration used: defaults Review profile: CHILL Plan: Pro Run ID: You can disable this status message by setting the Use the checkbox below for a quick retry:
✨ Finishing Touches🧪 Generate unit tests (beta)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
|
Warning This pull request is not mergeable via GitHub because a downstack PR is open. Once all requirements are satisfied, merge this PR as a stack on Graphite.
How to use the Graphite Merge QueueAdd the label graphite-queue to this PR to add it to the merge queue. You must have a Graphite account in order to use the merge queue. Sign up using this link. An organization admin has enabled the Graphite Merge Queue in this repository. Please do not merge from GitHub as this will restart CI on PRs being processed by the merge queue. This stack of pull requests is managed by Graphite. Learn more about stacking. |
Not up to standards ⛔🔴 Issues
|
| Category | Results |
|---|---|
| CodeStyle | 3 minor |
NEW Get contextual insights on your PRs based on Codacy's metrics, along with PR and Jira context, without leaving GitHub. Enable AI reviewer
TIP This summary will be updated as you push new changes.
There was a problem hiding this comment.
Code Review
This pull request adds a comprehensive functional smoke test document for Wave 3 deliverables and updates the stack progress tracking. The review feedback identifies the need to explicitly list required CLI tools like gh, gt, and jq as prerequisites and notes that the tests are specifically coupled to the yellow-plugins repository structure rather than being applicable to any generic git repository.
ⓘ You've reached your Qodo monthly free-tier limit. Reviews pause until next month — upgrade your plan to continue now, or link your paid account if you already have one. |
There was a problem hiding this comment.
Pull request overview
Adds an operations-facing, post–Wave 3 functional smoke test checklist intended to serve as the final closure gate for the EveryInc merge effort, and updates the merge plan to reflect current stack progress.
Changes:
- Add
docs/operations/post-w3-functional-smoke-test.mddocumenting an end-to-end functional acceptance checklist across yellow-review, yellow-docs, and yellow-debt behaviors. - Update
plans/everyinc-merge-remaining-work.mdwith a generated “Stack Progress” section reflecting completion status of prior stacked PRs.
Reviewed changes
Copilot reviewed 2 out of 2 changed files in this pull request and generated 7 comments.
| File | Description |
|---|---|
| plans/everyinc-merge-remaining-work.md | Adds a “Stack Progress” checklist to track stacked PR completion status for the EveryInc merge effort. |
| docs/operations/post-w3-functional-smoke-test.md | Introduces a post-W3 smoke test runbook/checklist for validating key Wave 3 plugin behaviors on a fresh Claude Code install. |
- Mark PR #412 (closure smoke test) complete in plans/everyinc-merge-remaining-work.md - Refresh AGENTS.md as canonical agent instruction set with current plugin list, validator coverage, and authoring rules - Remove obsolete RESEARCH/MERGE_PLAN.md.docx scratch artifact
64d6f91 to
127146d
Compare
03a96c9 to
6a0ab05
Compare
- Mark PR #412 (closure smoke test) complete in plans/everyinc-merge-remaining-work.md - Refresh AGENTS.md as canonical agent instruction set with current plugin list, validator coverage, and authoring rules - Remove obsolete RESEARCH/MERGE_PLAN.md.docx scratch artifact
127146d to
9af9ed2
Compare
6a0ab05 to
9323565
Compare
- Mark PR #412 (closure smoke test) complete in plans/everyinc-merge-remaining-work.md - Refresh AGENTS.md as canonical agent instruction set with current plugin list, validator coverage, and authoring rules - Remove obsolete RESEARCH/MERGE_PLAN.md.docx scratch artifact
9af9ed2 to
77d8834
Compare
9323565 to
773d8b1
Compare
- Mark PR #412 (closure smoke test) complete in plans/everyinc-merge-remaining-work.md - Refresh AGENTS.md as canonical agent instruction set with current plugin list, validator coverage, and authoring rules - Remove obsolete RESEARCH/MERGE_PLAN.md.docx scratch artifact
…canonical command names + slash-command fence Three clusters of bot threads on PR #412 smoke-test checklist: (1) Failure Handling section incorrectly named 'PR #411' but the checklist itself is on PR #412 — corrected to #412. (2) Section headings and inline command examples used the namespaced form /yellow-{plugin}:{dir}:{cmd} for /review:pr, /docs:review, and /debt:audit, but each plugin's CLAUDE.md documents the bare /<dir>:<cmd> form as the canonical user-facing invocation; bulk sed replaced. (3) The 'Verify clean state' code fence around /plugin marketplace list was tagged 'bash' but contains a Claude Code slash command (not valid shell); switched to 'text' fence and clarified it runs inside Claude Code, not a terminal.
773d8b1 to
ccb97cf
Compare
77d8834 to
422b558
Compare
- Mark PR #412 (closure smoke test) complete in plans/everyinc-merge-remaining-work.md - Refresh AGENTS.md as canonical agent instruction set with current plugin list, validator coverage, and authoring rules - Remove obsolete RESEARCH/MERGE_PLAN.md.docx scratch artifact
…canonical command names + slash-command fence Three clusters of bot threads on PR #412 smoke-test checklist: (1) Failure Handling section incorrectly named 'PR #411' but the checklist itself is on PR #412 — corrected to #412. (2) Section headings and inline command examples used the namespaced form /yellow-{plugin}:{dir}:{cmd} for /review:pr, /docs:review, and /debt:audit, but each plugin's CLAUDE.md documents the bare /<dir>:<cmd> form as the canonical user-facing invocation; bulk sed replaced. (3) The 'Verify clean state' code fence around /plugin marketplace list was tagged 'bash' but contains a Claude Code slash command (not valid shell); switched to 'text' fence and clarified it runs inside Claude Code, not a terminal.
…cal fields PR #412 thread (copilot): the C.3 v2.0 schema check listed only 4 of the 8 canonical v2.0 fields, allowing a partial/broken emitter to pass. Expanded to enumerate all 8 (finding/file/failure_scenario/confidence/category/severity/effort/fix) and added a note that the canonical list is in debt-conventions SKILL.md.
ccb97cf to
e14e802
Compare
422b558 to
00e38b2
Compare
- Mark PR #412 (closure smoke test) complete in plans/everyinc-merge-remaining-work.md - Refresh AGENTS.md as canonical agent instruction set with current plugin list, validator coverage, and authoring rules - Remove obsolete RESEARCH/MERGE_PLAN.md.docx scratch artifact
…canonical command names + slash-command fence Three clusters of bot threads on PR #412 smoke-test checklist: (1) Failure Handling section incorrectly named 'PR #411' but the checklist itself is on PR #412 — corrected to #412. (2) Section headings and inline command examples used the namespaced form /yellow-{plugin}:{dir}:{cmd} for /review:pr, /docs:review, and /debt:audit, but each plugin's CLAUDE.md documents the bare /<dir>:<cmd> form as the canonical user-facing invocation; bulk sed replaced. (3) The 'Verify clean state' code fence around /plugin marketplace list was tagged 'bash' but contains a Claude Code slash command (not valid shell); switched to 'text' fence and clarified it runs inside Claude Code, not a terminal.
…cal fields PR #412 thread (copilot): the C.3 v2.0 schema check listed only 4 of the 8 canonical v2.0 fields, allowing a partial/broken emitter to pass. Expanded to enumerate all 8 (finding/file/failure_scenario/confidence/category/severity/effort/fix) and added a note that the canonical list is in debt-conventions SKILL.md.
00e38b2 to
b2c5646
Compare
e14e802 to
9e4a3ee
Compare
- Mark PR #412 (closure smoke test) complete in plans/everyinc-merge-remaining-work.md - Refresh AGENTS.md as canonical agent instruction set with current plugin list, validator coverage, and authoring rules - Remove obsolete RESEARCH/MERGE_PLAN.md.docx scratch artifact
…canonical command names + slash-command fence Three clusters of bot threads on PR #412 smoke-test checklist: (1) Failure Handling section incorrectly named 'PR #411' but the checklist itself is on PR #412 — corrected to #412. (2) Section headings and inline command examples used the namespaced form /yellow-{plugin}:{dir}:{cmd} for /review:pr, /docs:review, and /debt:audit, but each plugin's CLAUDE.md documents the bare /<dir>:<cmd> form as the canonical user-facing invocation; bulk sed replaced. (3) The 'Verify clean state' code fence around /plugin marketplace list was tagged 'bash' but contains a Claude Code slash command (not valid shell); switched to 'text' fence and clarified it runs inside Claude Code, not a terminal.
…cal fields PR #412 thread (copilot): the C.3 v2.0 schema check listed only 4 of the 8 canonical v2.0 fields, allowing a partial/broken emitter to pass. Expanded to enumerate all 8 (finding/file/failure_scenario/confidence/category/severity/effort/fix) and added a note that the canonical list is in debt-conventions SKILL.md.
…ion, fix verbatim claim Three PR #412 advisory threads: (a) gemini — checklist invokes gh, gt, jq directly but didn't list them as prerequisites; added explicit prereq item with per-CLI rationale. (b) gemini — Section A said 'any git repo will work' but C.2 and C.4 are coupled to yellow-plugins' own paths and PR history; clarified that a yellow-plugins clone is recommended and noted which sections require substitution otherwise. (c) copilot — References section said 'reused from' release-checklist.md Section 3 sign-off block, but the block here added Claude Code version, catalog version, and a per-check results table; switched to 'adapted from' with an explicit list of the additions.
9e4a3ee to
bb50348
Compare
b2c5646 to
447341c
Compare
Merge activity
|
447341c to
df7420f
Compare
Final closure gate for the EveryInc merge effort. Adds docs/operations/post-w3-functional-smoke-test.md with a written checklist exercising the actual plugin behaviors Wave 3 added (review:pr end-to-end, docs:review end-to-end, debt:audit v2.0 schema confirmation, W3 #5 auto-trigger). Reuses Section 3 sign-off format from release-checklist.md verbatim. No changeset (docs-only, not in plugins/).
- Mark PR #412 (closure smoke test) complete in plans/everyinc-merge-remaining-work.md - Refresh AGENTS.md as canonical agent instruction set with current plugin list, validator coverage, and authoring rules - Remove obsolete RESEARCH/MERGE_PLAN.md.docx scratch artifact
…canonical command names + slash-command fence Three clusters of bot threads on PR #412 smoke-test checklist: (1) Failure Handling section incorrectly named 'PR #411' but the checklist itself is on PR #412 — corrected to #412. (2) Section headings and inline command examples used the namespaced form /yellow-{plugin}:{dir}:{cmd} for /review:pr, /docs:review, and /debt:audit, but each plugin's CLAUDE.md documents the bare /<dir>:<cmd> form as the canonical user-facing invocation; bulk sed replaced. (3) The 'Verify clean state' code fence around /plugin marketplace list was tagged 'bash' but contains a Claude Code slash command (not valid shell); switched to 'text' fence and clarified it runs inside Claude Code, not a terminal.
…cal fields PR #412 thread (copilot): the C.3 v2.0 schema check listed only 4 of the 8 canonical v2.0 fields, allowing a partial/broken emitter to pass. Expanded to enumerate all 8 (finding/file/failure_scenario/confidence/category/severity/effort/fix) and added a note that the canonical list is in debt-conventions SKILL.md.
…ion, fix verbatim claim Three PR #412 advisory threads: (a) gemini — checklist invokes gh, gt, jq directly but didn't list them as prerequisites; added explicit prereq item with per-CLI rationale. (b) gemini — Section A said 'any git repo will work' but C.2 and C.4 are coupled to yellow-plugins' own paths and PR history; clarified that a yellow-plugins clone is recommended and noted which sections require substitution otherwise. (c) copilot — References section said 'reused from' release-checklist.md Section 3 sign-off block, but the block here added Claude Code version, catalog version, and a per-check results table; switched to 'adapted from' with an explicit list of the additions.
bb50348 to
1ab10b9
Compare
Move everyinc-merge-remaining-work.md and everyinc-merge-wave3.md to plans/complete/. Both are fully delivered on main: - everyinc-merge-remaining-work.md: PRs #402, #403, #406, #410, #412 - everyinc-merge-wave3.md: 12 stack items shipped via PRs #287, #293, #296, #306, #307, #308, #310, #311, #312, plus #403/#406/#410 (rolled into the remaining-work plan) Updated wave3 stack-progress checkboxes for items #2/#5/#7 with PR refs and squash-commit SHAs.

Final closure gate for the EveryInc merge effort. Adds docs/operations/post-w3-functional-smoke-test.md with a written checklist exercising the actual plugin behaviors Wave 3 added (review:pr end-to-end, docs:review end-to-end, debt:audit v2.0 schema confirmation, W3 #5 auto-trigger). Reuses Section 3 sign-off format from release-checklist.md verbatim. No changeset (docs-only, not in plugins/).
Summary
Stack context
Test plan
Notes for reviewers
Greptile Summary
This PR adds
docs/operations/post-w3-functional-smoke-test.mdas the required closure gate for the EveryInc merge effort, substantially rewritesAGENTS.mdwith new sections covering manifest rules, hook authoring, and an agent audit checklist, appends a Stack Progress block to the merge plan, and deletes the binaryRESEARCH/MERGE_PLAN.md.docx.MEMORY.mdlink, plugin count discrepancy, andgh pr list --search 'plugins/'not matching by changed-file path); the C.3 schema-verification step can also silently pass when the findings array is empty.plans/everyinc-merge-remaining-work.md: Stack Progress block records PR docs(operations): post-W3 functional smoke test checklist #412 as completed before it has merged, misleading automated agents reading the plan.Confidence Score: 3/5
Not safe to merge: multiple substantive issues in the smoke-test document and merge plan remain unresolved from prior review rounds.
The smoke-test document — described as the required closure gate — contains several unresolved defects: blank sign-off (gate never executed), wrong PR number in Failure Handling (#411 instead of #412), broken MEMORY.md reference, plugin count mismatch (17 vs 18 in AGENTS.md), and a gh search step that won't match by changed-file path. The merge plan also marks this open PR as already completed, which would cause automated workflows to skip the gate entirely.
docs/operations/post-w3-functional-smoke-test.md and plans/everyinc-merge-remaining-work.md both need attention before merge.
Important Files Changed
Comments Outside Diff (3)
plans/everyinc-merge-remaining-work.md, line 667 (link)Item 5 records PR docs(operations): post-W3 functional smoke test checklist #412 as "completed 2026-05-06", but docs(operations): post-W3 functional smoke test checklist #412 is this very PR, currently open and under review. Any agent (e.g.
/workflows:work) that reads this plan to decide whether the smoke-test gate is closed will see it as done and may proceed with merge-effort finalisation even though the test has not been run and the PR has not landed.Prompt To Fix With AI
docs/operations/post-w3-functional-smoke-test.md, line 492 (link)The smoke test expects 17 plugins in the marketplace, but the updated AGENTS.md in this same PR lists 18 plugin directories:
gt-workflow,yellow-browser-test,yellow-chatprd,yellow-ci,yellow-codex,yellow-composio,yellow-core,yellow-council,yellow-debt,yellow-devin,yellow-docs,yellow-linear,yellow-mempalace,yellow-morph,yellow-research,yellow-review,yellow-ruvector, andyellow-semgrep. An executor running this checklist on the installed marketplace will see 18 and will not know whether the test is wrong or whether a plugin is unexpectedly missing.Prompt To Fix With AI
plans/everyinc-merge-remaining-work.md, line 437-438 (link)Stack item 5 specifies
Scope: docs/operations/release-checklist.md (extend with Section 3.5), but this PR does not modifyrelease-checklist.mdat all — the checklist landed in a new standalone file (docs/operations/post-w3-functional-smoke-test.md). Any agent that reads the plan'sScopefield to verify or re-run item 5 will look for Section 3.5 inrelease-checklist.md, find nothing, and incorrectly conclude the task is incomplete or needs re-execution. TheScope:field in the plan should be updated to reflect the actual deliverable path.Prompt To Fix With AI
Prompt To Fix All With AI
Reviews (10): Last reviewed commit: "docs(operations): add CLI prereqs, clari..." | Re-trigger Greptile