Skip to content

chore(release): v1.9.0-rc.0 — logo, CHANGELOG, roadmap, contributor docs#138

Open
richard-devbot wants to merge 1 commit into
mainfrom
fix/v1.9.0-patch-prep
Open

chore(release): v1.9.0-rc.0 — logo, CHANGELOG, roadmap, contributor docs#138
richard-devbot wants to merge 1 commit into
mainfrom
fix/v1.9.0-patch-prep

Conversation

@richard-devbot

@richard-devbot richard-devbot commented Jun 17, 2026

Copy link
Copy Markdown
Owner

What

Release-prep and planning artifacts for the v1.9.0 release candidate. Docs/meta only — no agent or application source changed.

Changes

  • Bump version 1.8.01.9.0-rc.0
  • README: logo + badges (version / 196 agents / 244 tests / MIT), v1.9.0 roadmap table, contributions-welcome callout
  • CHANGELOG: [1.9.0-rc] entry + [Unreleased] v1.9.0 planning section
  • .gitignore: ignore .DS_Store, loop runtime dirs (.rstack/runs, .rstack/worktrees), hook log noise
  • Add CONTRIBUTING.md, docs/AUDIT-CURRENT-STATE.md, docs/LOOP-ENGINEERING-UPGRADE-PLAN.md
  • Add docs/github-issues/ — backend loop-engineering v1 issue pack (already filed as [Epic] Backend Loop Engineering 0 - Control Plane Inventory #109[BLE-6.3] Tighten memory write policy #137)
  • Add .github/ISSUE_TEMPLATE/feature-request.md, scripts/push-loop-engineering-issues.sh

Verification

  • npm run validate → 196 agents pass
  • npm test244 pass, 0 fail

Notes

Corrected stale README test counts (was "207 pass / 11 in-progress" → now "244 pass / 0 fail"). Dashboard freshness feature is intentionally split into a separate PR.

🤖 Generated with Claude Code

Summary by CodeRabbit

  • New Features

    • Added GitHub issue template for feature requests to streamline contributions.
    • New contribution guidelines document with branching, CI, and release procedures.
  • Documentation

    • Updated README with v1.9.0-rc version, roadmap phases, and current limitations.
    • Added comprehensive contributing guide for developers.
    • Updated changelog documenting v1.9.0-rc release and upcoming features.
  • Chores

    • Bumped package version to 1.9.0-rc.0.
    • Updated .gitignore to exclude runtime artifacts and editor noise.
    • Added GitHub issue management script for backend engineering tasks.

Release-prep and planning artifacts for the v1.9.0 release candidate.
Docs/meta only — no agent or application source changed.

- Bump version 1.8.0 -> 1.9.0-rc.0 (package.json)
- README: add logo + badges (version / 196 agents / 244 tests / MIT),
  v1.9.0 roadmap table, and contributions-welcome callout
- CHANGELOG: add [1.9.0-rc] entry and [Unreleased] v1.9.0 planning section
- .gitignore: ignore .DS_Store, loop runtime dirs (.rstack/runs, .rstack/worktrees),
  and Claude Code hook log noise
- Add CONTRIBUTING.md (IP rules, CI requirements, review policy)
- Add docs/AUDIT-CURRENT-STATE.md (full current-state audit, owner-labelled)
- Add docs/LOOP-ENGINEERING-UPGRADE-PLAN.md (6-phase upgrade plan)
- Add docs/github-issues/ — backend loop-engineering v1 issue pack (filed as #109-#137)
- Add .github/ISSUE_TEMPLATE/feature-request.md
- Add scripts/push-loop-engineering-issues.sh (gh CLI issue filer)

Verified: npm run validate -> 196 agents pass. npm test -> 244 pass, 0 fail.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@qodo-code-review

Copy link
Copy Markdown

Qodo reviews are paused for this user.

Troubleshooting steps vary by plan Learn more →

On a Teams plan?
Reviews resume once this user has a paid seat and their Git account is linked in Qodo.
Link Git account →

Using GitHub Enterprise Server, GitLab Self-Managed, or Bitbucket Data Center?
These require an Enterprise plan - Contact us
Contact us →

@coderabbitai

coderabbitai Bot commented Jun 17, 2026

Copy link
Copy Markdown
Contributor

Review Change Stack

📝 Walkthrough

Walkthrough

Bumps the package to 1.9.0-rc.0 and adds project governance files (CONTRIBUTING.md, a feature-request issue template, .gitignore and CHANGELOG updates, README refreshes), a current-state audit, a loop engineering upgrade plan (Trinity comparison), 7 epics of BLE issue specification markdown files (Epics 0–6, 19 implementation issues), and a Bash script to push those specs as GitHub issues.

Changes

Loop Engineering v1.9.0-rc Planning and Governance

Layer / File(s) Summary
Project governance and release meta
package.json, .github/ISSUE_TEMPLATE/feature-request.md, .gitignore, CHANGELOG.md, README.md, CONTRIBUTING.md
Bumps version to 1.9.0-rc.0; adds a feature-request issue template; extends .gitignore with runtime/agent session paths; inserts a v1.9.0 planning block and v1.9.0-rc release entry in CHANGELOG; refreshes README badges, roadmap table, and limitations list; adds CONTRIBUTING.md covering branching, CI checks, IP rules, agent frontmatter schema, PR checklist, CodeRabbit handling, and the release process.
Current-state audit and loop engineering upgrade plan
docs/AUDIT-CURRENT-STATE.md, docs/LOOP-ENGINEERING-UPGRADE-PLAN.md, docs/github-issues/TRINITY-COMPARISON.md
Inventories the SDLC agent/harness system, catalogs 11 failing tests and loop engineering gaps by Phase 0–5; documents eight Trinity vs SDLC-rstack capability gaps with "what to copy" snippets and a sprint roadmap; adds a Trinity comparison summary with copy/don't-copy guidance and preserved SDLC-rstack strengths.
Issue pack index and legacy PHASE reference docs
docs/github-issues/README.md, docs/github-issues/PHASE-0-harness-bridge.md, docs/github-issues/PHASE-1-pipeline-state.md, docs/github-issues/PHASE-2-retry-validation.md, docs/github-issues/PHASE-3-goal-loop.md, docs/github-issues/PHASE-4-cost-observability.md, docs/github-issues/PHASE-5-parallel-safety.md
Adds an index page for the active BLE issue pack (7 epics, epic file list, contribution workflow, implementation policy, verification checklist); adds legacy PHASE-0 through PHASE-5 markdown files as historical reference capturing the earlier per-phase planning structure.
BLE Epic 0–1: Control plane inventory and harness state spine specs
docs/github-issues/backend-loop-engineering-v1/00-*.md, docs/github-issues/backend-loop-engineering-v1/01-*.md
Epic 0 specifies an rstack-agents inventory command (CLI + JSON mode, backend registry file) and a runtime-differences matrix across Pi, Claude Code, and CLI; Epic 1 specifies a Node-native pipeline-state rollup module, an rstack-agents pipeline status CLI subcommand, and normalization of SDLC agent artifact paths to canonical harness locations.
BLE Epic 2–3: Builder/validator contracts and retry/recovery loop specs
docs/github-issues/backend-loop-engineering-v1/02-*.md, docs/github-issues/backend-loop-engineering-v1/03-*.md
Epic 2 specifies builder contract completeness enforcement for PASS/DONE_WITH_CONCERNS, a validator sandbox policy (read-only Pi hook enforcement, event logging), and a validator registry mapping stage IDs to profiles; Epic 3 specifies a retry policy module (retry_recommendation → decision mapping), a resume-aware rstack-agents pipeline run command, and structured retry event logging to events.jsonl.
BLE Epic 4–6: Goal loop, guardrails/approvals/checkpoints, and cost/context/memory specs
docs/github-issues/backend-loop-engineering-v1/04-*.md, docs/github-issues/backend-loop-engineering-v1/05-*.md, docs/github-issues/backend-loop-engineering-v1/06-*.md
Epic 4 specifies a goal-check.js evaluator, an Agent 11 goal_evaluation contract update, and a bounded loop runner (max-iteration controlled, PASS/RETRY/ASK_USER/BLOCK outcomes); Epic 5 specifies expanded destructive-action gate coverage, critical-stage checkpointing with rollback events, and approval audit consistency validation; Epic 6 specifies cost/context field extraction from builder contracts into metrics.json and pipeline rollups, configurable context-pressure warning signals, and a tightened validator-approved-only memory write policy.
GitHub issue creation automation script
scripts/push-loop-engineering-issues.sh
Bash script supporting --dry-run/--apply modes that idempotently creates labels, ensures a milestone exists, and creates all Epic 0–6 epics and implementation issues from the BLE markdown files via the gh CLI, with title-based deduplication.

Estimated code review effort

🎯 2 (Simple) | ⏱️ ~10 minutes

Possibly related issues

  • #109 — The PR adds docs/github-issues/backend-loop-engineering-v1/00-epic-control-plane-inventory.md, 00-01-inventory-runtime-surfaces.md, and 00-02-document-runtime-differences.md, which directly define the planning work for this epic.
  • #110 — The PR adds 00-01-inventory-runtime-surfaces.md specifying the exact rstack-agents inventory command and .rstack/registry/backend-inventory.json output described in this issue.
  • #111 — The PR adds 00-02-document-runtime-differences.md specifying the runtime matrix across Pi, Claude Code, and CLI that this issue tracks.
  • #112 — The PR adds all four Phase 1 / Epic 1 harness-state-spine spec files and push-loop-engineering-issues.sh, which is the infrastructure this issue documents.
  • #113 — The PR adds 01-01-add-pipeline-state-rollup.md specifying the src/core/harness/pipeline-state.js module requirements this issue proposes to implement.
  • #115 — The PR adds 01-02-add-pipeline-status-cli.md defining the exact scope and requirements for the rstack-agents pipeline status command this issue describes.
  • #116 — The PR adds 01-03-normalize-sdlc-agent-paths.md specifying the canonical harness path normalization for agents 00, 06, 07, 08, 11.
  • #117 — The PR adds the Epic 2 overview and all three BLE-2.x spec files that are converted into this issue by the push script.
  • #119 — The PR adds 02-02-add-validator-sandbox-policy.md defining the validator read-only sandbox enforcement this issue tracks.
  • #120 — The PR adds 02-03-add-validator-registry.md specifying the validator registry module this issue proposes.
  • #121 — The PR adds 03-epic-retry-recovery-loop.md and its sub-issue spec files that define the BLE-3 epic this issue represents.
  • #123 — The PR adds 03-01-add-retry-policy-module.md with identical exported functions, validation mappings, and guardrail enforcement this issue specifies.
  • #124 — The PR adds 03-02-add-resume-aware-runner.md defining the rstack-agents pipeline run command requirements this issue tracks.
  • #125 — The PR adds 03-03-add-retry-event-trace.md specifying the structured events.jsonl retry logging and sdlc_trace rendering this issue addresses.
  • #126 — The PR adds 04-epic-goal-loop.md and the bounded loop runner and goal evaluator spec files that define the BLE-4 epic.
  • #127 — The PR adds 04-01-add-goal-evaluator.md specifying the goal-check.js module this issue proposes.
  • #128 — The PR adds 04-02-update-agent-11-goal-contract.md specifying the structured goal_evaluation object this issue requires Agent 11 to emit.
  • #129 — The PR adds 04-03-add-bounded-loop-runner.md defining the bounded loop runner requirements this issue tracks.
  • #130 — The PR adds 05-epic-guardrails-approvals-checkpoints.md and the three BLE-5.x spec files that constitute this epic.
  • #131 — The PR adds 05-01-strengthen-destructive-gates.md defining the destructive-action gate coverage expansion this issue specifies.
  • #132 — The PR adds 05-02-checkpoint-critical-stages.md defining the critical-stage checkpointing requirements this issue tracks.
  • #133 — The PR adds 05-03-add-approval-audit-consistency.md specifying the approval record validation and audit logging this issue requires.
  • #134 — The PR adds the Epic 6 overview and BLE-6.x spec files that define the cost/context/memory epic this issue represents.
  • #135 — The PR adds 06-01-populate-cost-context-fields.md specifying the cost/context extraction from builder contracts this issue proposes.

Poem

🐇 Hoppity-hop through docs so grand,
Seven epics, all carefully planned!
Loop engineering takes its cue,
From retry wrappers tried and true.
Goal checks, cost fields, memory tight—
The pipeline loops toward the light! 🌟

🚥 Pre-merge checks | ✅ 4 | ❌ 1

❌ Failed checks (1 warning)

Check name Status Explanation Resolution
Docstring Coverage ⚠️ Warning Docstring coverage is 0.00% which is insufficient. The required threshold is 80.00%. Write docstrings for the functions missing them to satisfy the coverage threshold.
✅ Passed checks (4 passed)
Check name Status Explanation
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check ✅ Passed The title accurately describes the main changes: version release (v1.9.0-rc.0), logo addition, CHANGELOG update, roadmap documentation, and contributor guidelines.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
📝 Generate docstrings
  • Create stacked PR
  • Commit on current branch
🧪 Generate unit tests (beta)

✅ Unit Test PR creation complete.

  • Create PR with unit tests
  • Commit unit tests in branch fix/v1.9.0-patch-prep

Comment @coderabbitai help to get the list of available commands and usage tips.

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 3

🧹 Nitpick comments (3)
docs/github-issues/TRINITY-COMPARISON.md (1)

33-46: ⚡ Quick win

Add language specifications to fenced code blocks.

All three ASCII architecture diagrams lack language specifications, which triggers markdownlint MD040 warnings. Mark them as text or ascii for consistency and linting compliance.

📝 Proposed fix for code block language specs
-```
+```text
 ┌─────────────────────────────────────────────────────────┐
 │  Trinity Platform                                      │
 │  ┌──────────────┐  ┌──────────────┐  ┌───────────────┐ │

Similarly update lines 73 and 143:

-```
+```text
 ┌─────────────────────────────────────────────────────────┐
 │  SDLC-rstack (current)                                 │
-```
+```text
 Phase 0 (harness bridge) ──→ Phase 1 (state + pipeline.yaml)

Also applies to: 73-87, 143-153

🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

In `@docs/github-issues/TRINITY-COMPARISON.md` around lines 33 - 46, Add language
specifications to the three fenced code blocks in the TRINITY-COMPARISON.md file
that contain ASCII architecture diagrams. The code blocks at lines 33-46, 73-87,
and 143-153 currently lack language identifiers after the opening triple
backticks. Modify each code block opening from ``` to ```text to comply with
markdownlint MD040 requirements and provide consistent language specifications
for the ASCII diagrams.

Source: Linters/SAST tools

docs/github-issues/backend-loop-engineering-v1/04-02-update-agent-11-goal-contract.md (1)

33-33: 💤 Low value

Minor: Rephrase double modal construction.

Line 33 uses "requires structured," which is nonstandard. Consider "Agent 11 prompt must include a structured goal_evaluation" for clarity.

🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

In
`@docs/github-issues/backend-loop-engineering-v1/04-02-update-agent-11-goal-contract.md`
at line 33, The checkbox item on line 33 uses the awkward phrasing "requires
structured" which is nonstandard English. Replace the text "Agent 11 prompt
requires structured `goal_evaluation`" with "Agent 11 prompt must include a
structured `goal_evaluation`" for better clarity and more standard phrasing.

Source: Linters/SAST tools

docs/github-issues/backend-loop-engineering-v1/04-03-add-bounded-loop-runner.md (1)

19-21: 💤 Low value

Minor: Vary sentence structure to avoid repetition.

Lines 19–21 start three successive sentences with "If". Consider restructuring for readability:

- If PASS, mark loop complete. RETRY resets only recommended_rerun_stages or failing stages. ASK_USER and BLOCK stop and report respectively.
🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

In
`@docs/github-issues/backend-loop-engineering-v1/04-03-add-bounded-loop-runner.md`
around lines 19 - 21, The three bullet points describing RETRY, ASK_USER, and
BLOCK behaviors all start with "If", creating repetitive sentence structure that
impacts readability. Restructure these bullet points to vary the sentence
patterns by either combining related actions into fewer statements or rephrasing
them to avoid starting each line with "If". For example, you could consolidate
the logic so that the three outcomes (RETRY resetting stages, ASK_USER stopping
and reporting, and BLOCK stopping and reporting) are presented with varied
grammatical structures while maintaining clarity about what each status does.

Source: Linters/SAST tools

🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In `@docs/AUDIT-CURRENT-STATE.md`:
- Around line 111-139: The AUDIT-CURRENT-STATE.md file in the Test suite section
documents 207 passing and 11 failing tests, but the actual current test run
shows 199 passing and 18 failing tests, indicating a regression since the audit
date. Update the test results table and summary in the "Failing tests (11)"
section to reflect the actual current numbers (18 failures instead of 11) and
add the newly failing tests to the table. Investigate and resolve the root
causes of the 18 failing tests by addressing the missing dependencies
(particularly `@earendil-works/pi-ai`) and the runtime errors mentioned in the
comment (fetch failures, command execution failures in rstack-agents.js). Run
npm test locally to verify all tests pass or document any expected failures
before merging this PR. Ensure the audit documentation accurately reflects the
current state of the test suite.

In `@docs/github-issues/TRINITY-COMPARISON.md`:
- Line 161: Update the reference statement that currently reads "23 issues
across 6 phases" to accurately reflect the counts from
docs/github-issues/README.md, which specifies "7 epics with 20 implementation
issues (27 total)". Replace the inaccurate numbers in the comparison file with
the correct totals and terminology to maintain consistency with the source
documentation.

In `@scripts/push-loop-engineering-issues.sh`:
- Around line 1-10: The script uses the gh CLI command multiple times without
validating that it is installed or that the user has repository access to $REPO,
which can result in cryptic error messages. Add pre-flight validation checks
immediately after the variable definitions (after line 9, before any function
definitions or main script logic). First, check that the gh command is available
in the PATH using a conditional with the command builtin, and exit with a clear
error message if it is not found. Second, validate that gh can access the target
repository specified in the $REPO variable by running gh repo view against it,
and exit with a helpful authentication error message if access is denied. These
two checks will catch configuration issues early and provide users with
actionable error messages before the script attempts to use gh in downstream
operations.

---

Nitpick comments:
In
`@docs/github-issues/backend-loop-engineering-v1/04-02-update-agent-11-goal-contract.md`:
- Line 33: The checkbox item on line 33 uses the awkward phrasing "requires
structured" which is nonstandard English. Replace the text "Agent 11 prompt
requires structured `goal_evaluation`" with "Agent 11 prompt must include a
structured `goal_evaluation`" for better clarity and more standard phrasing.

In
`@docs/github-issues/backend-loop-engineering-v1/04-03-add-bounded-loop-runner.md`:
- Around line 19-21: The three bullet points describing RETRY, ASK_USER, and
BLOCK behaviors all start with "If", creating repetitive sentence structure that
impacts readability. Restructure these bullet points to vary the sentence
patterns by either combining related actions into fewer statements or rephrasing
them to avoid starting each line with "If". For example, you could consolidate
the logic so that the three outcomes (RETRY resetting stages, ASK_USER stopping
and reporting, and BLOCK stopping and reporting) are presented with varied
grammatical structures while maintaining clarity about what each status does.

In `@docs/github-issues/TRINITY-COMPARISON.md`:
- Around line 33-46: Add language specifications to the three fenced code blocks
in the TRINITY-COMPARISON.md file that contain ASCII architecture diagrams. The
code blocks at lines 33-46, 73-87, and 143-153 currently lack language
identifiers after the opening triple backticks. Modify each code block opening
from ``` to ```text to comply with markdownlint MD040 requirements and provide
consistent language specifications for the ASCII diagrams.
🪄 Autofix (Beta)

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: Repository UI

Review profile: CHILL

Plan: Pro Plus

Run ID: baa62696-1c71-4471-9cee-57ae28058afd

📥 Commits

Reviewing files that changed from the base of the PR and between 6b7e8e7 and 23f62f0.

⛔ Files ignored due to path filters (1)
  • sdlc-rstack-logo.png is excluded by !**/*.png
📒 Files selected for processing (44)
  • .github/ISSUE_TEMPLATE/feature-request.md
  • .gitignore
  • CHANGELOG.md
  • CONTRIBUTING.md
  • README.md
  • docs/AUDIT-CURRENT-STATE.md
  • docs/LOOP-ENGINEERING-UPGRADE-PLAN.md
  • docs/github-issues/PHASE-0-harness-bridge.md
  • docs/github-issues/PHASE-1-pipeline-state.md
  • docs/github-issues/PHASE-2-retry-validation.md
  • docs/github-issues/PHASE-3-goal-loop.md
  • docs/github-issues/PHASE-4-cost-observability.md
  • docs/github-issues/PHASE-5-parallel-safety.md
  • docs/github-issues/README.md
  • docs/github-issues/TRINITY-COMPARISON.md
  • docs/github-issues/backend-loop-engineering-v1/00-01-inventory-runtime-surfaces.md
  • docs/github-issues/backend-loop-engineering-v1/00-02-document-runtime-differences.md
  • docs/github-issues/backend-loop-engineering-v1/00-epic-control-plane-inventory.md
  • docs/github-issues/backend-loop-engineering-v1/01-01-add-pipeline-state-rollup.md
  • docs/github-issues/backend-loop-engineering-v1/01-02-add-pipeline-status-cli.md
  • docs/github-issues/backend-loop-engineering-v1/01-03-normalize-sdlc-agent-paths.md
  • docs/github-issues/backend-loop-engineering-v1/01-epic-harness-state-spine.md
  • docs/github-issues/backend-loop-engineering-v1/02-01-enforce-builder-contract-completeness.md
  • docs/github-issues/backend-loop-engineering-v1/02-02-add-validator-sandbox-policy.md
  • docs/github-issues/backend-loop-engineering-v1/02-03-add-validator-registry.md
  • docs/github-issues/backend-loop-engineering-v1/02-epic-builder-validator-contracts.md
  • docs/github-issues/backend-loop-engineering-v1/03-01-add-retry-policy-module.md
  • docs/github-issues/backend-loop-engineering-v1/03-02-add-resume-aware-runner.md
  • docs/github-issues/backend-loop-engineering-v1/03-03-add-retry-event-trace.md
  • docs/github-issues/backend-loop-engineering-v1/03-epic-retry-recovery-loop.md
  • docs/github-issues/backend-loop-engineering-v1/04-01-add-goal-evaluator.md
  • docs/github-issues/backend-loop-engineering-v1/04-02-update-agent-11-goal-contract.md
  • docs/github-issues/backend-loop-engineering-v1/04-03-add-bounded-loop-runner.md
  • docs/github-issues/backend-loop-engineering-v1/04-epic-goal-loop.md
  • docs/github-issues/backend-loop-engineering-v1/05-01-strengthen-destructive-gates.md
  • docs/github-issues/backend-loop-engineering-v1/05-02-checkpoint-critical-stages.md
  • docs/github-issues/backend-loop-engineering-v1/05-03-add-approval-audit-consistency.md
  • docs/github-issues/backend-loop-engineering-v1/05-epic-guardrails-approvals-checkpoints.md
  • docs/github-issues/backend-loop-engineering-v1/06-01-populate-cost-context-fields.md
  • docs/github-issues/backend-loop-engineering-v1/06-02-add-context-pressure-warnings.md
  • docs/github-issues/backend-loop-engineering-v1/06-03-tighten-memory-write-policy.md
  • docs/github-issues/backend-loop-engineering-v1/06-epic-cost-context-memory.md
  • package.json
  • scripts/push-loop-engineering-issues.sh

Comment on lines +111 to +139
## 4. Test suite

### Summary

```
tests 218 total
pass 207
fail 11
```

### Failing tests (11)

| Test file | Category |
|-----------|----------|
| `extension-memory.test.js` | Pi extension |
| `extension-stage-attribution.test.js` | Pi extension |
| `harness-checkpoints-signatures.test.js` | Harness feature |
| `harness-observability.test.js` | Observability |
| `harness.test.js` | Core harness |
| `operator bridge runs sdlc_agents` | Operator bridge |
| `operator bridge reports unknown tools` | Operator bridge |
| `people-layer-approvals.test.js` | Approvals |
| `rstack Pi extension imports successfully` | Pi extension |
| `rstack Pi extension registers expected tools` | Pi extension |
| `resources_discover returns project-local overrides` | Pi extension |

**Pattern:** Most failures are in Pi extension and operator bridge areas — new infrastructure that is still being wired up. Core harness tests (contracts, evidence, stages, run-state, safe-write) **pass**. CI as-is would fail on a PR touching these files.

**Action required before any PR:** Fix the 11 failing tests or confirm they are expected failures from in-progress work and update the test suite accordingly. CI checks `npm test` — a red test suite blocks merging.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Potential issue | 🔴 Critical

🧩 Analysis chain

🏁 Script executed:

#!/bin/bash
# Verify current test status
npm test 2>&1 | tail -20
npm test 2>&1 | grep -E "pass|fail|total"

Repository: richard-devbot/SDLC-rstack

Length of output: 2800


Test suite status does not match documentation: 199 passing, 18 failing (not 0 as stated in PR objectives).

The current test run shows 199 pass, 18 fail, which conflicts with:

  • Audit documentation (lines 116–119): 207 pass, 11 fail
  • PR objectives claim: "244 tests pass with 0 failures"

The test suite has regressed since the audit date (2026-06-15): 8 fewer passing tests and 7 more failures. Multiple failures stem from missing dependencies (@earendil-works/pi-ai not found) and runtime errors (fetch failures, command execution failures in rstack-agents.js).

Before merge: Run npm test locally, resolve the 18 failing tests, and confirm the test suite passes before this PR is merged. The audit's documented baseline and the PR's stated objectives are inconsistent with the current state.

🧰 Tools
🪛 markdownlint-cli2 (0.22.1)

[warning] 115-115: Fenced code blocks should have a language specified

(MD040, fenced-code-language)

🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

In `@docs/AUDIT-CURRENT-STATE.md` around lines 111 - 139, The
AUDIT-CURRENT-STATE.md file in the Test suite section documents 207 passing and
11 failing tests, but the actual current test run shows 199 passing and 18
failing tests, indicating a regression since the audit date. Update the test
results table and summary in the "Failing tests (11)" section to reflect the
actual current numbers (18 failures instead of 11) and add the newly failing
tests to the table. Investigate and resolve the root causes of the 18 failing
tests by addressing the missing dependencies (particularly
`@earendil-works/pi-ai`) and the runtime errors mentioned in the comment (fetch
failures, command execution failures in rstack-agents.js). Run npm test locally
to verify all tests pass or document any expected failures before merging this
PR. Ensure the audit documentation accurately reflects the current state of the
test suite.


## Issue index

See `docs/github-issues/README.md` for all 23 issues across 6 phases.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Potential issue | 🟡 Minor

🧩 Analysis chain

🏁 Script executed:

#!/bin/bash
# Verify issue count in the BLE issue pack.
# Expected: Count epic overview files and implementation issue files.

find docs/github-issues/backend-loop-engineering-v1 -type f -name '*.md' | wc -l
echo "---"
find docs/github-issues/backend-loop-engineering-v1 -type f -name '*-epic-*.md' | wc -l
echo "Epic files above; implementation files below:"
find docs/github-issues/backend-loop-engineering-v1 -type f -name '[0-9][0-9]-[0-9][0-9]-*.md' | wc -l

Repository: richard-devbot/SDLC-rstack

Length of output: 128


🏁 Script executed:

cat docs/github-issues/README.md

Repository: richard-devbot/SDLC-rstack

Length of output: 4441


Update line 161 to reflect accurate issue count from docs/github-issues/README.md.

Line 161 claims "23 issues across 6 phases," but docs/github-issues/README.md clearly states 7 epics with 20 implementation issues (27 total). Update the reference to use the correct count.

🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

In `@docs/github-issues/TRINITY-COMPARISON.md` at line 161, Update the reference
statement that currently reads "23 issues across 6 phases" to accurately reflect
the counts from docs/github-issues/README.md, which specifies "7 epics with 20
implementation issues (27 total)". Replace the inaccurate numbers in the
comparison file with the correct totals and terminology to maintain consistency
with the source documentation.

Comment on lines +1 to +10
#!/usr/bin/env bash
# Create Backend Loop Engineering v1 GitHub issues from docs/github-issues.
set -euo pipefail

REPO="${RSTACK_GITHUB_REPO:-richard-devbot/SDLC-rstack}"
ROOT="$(cd "$(dirname "$0")/.." && pwd)"
ISSUE_ROOT="$ROOT/docs/github-issues/backend-loop-engineering-v1"
MILESTONE="Backend Loop Engineering v1"
APPLY=0

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Potential issue | 🟠 Major | ⚡ Quick win

Validate gh CLI availability and repository access before execution.

The script uses the gh CLI (lines 40, 51, 64–66, 74, 92) without checking that it is installed or that the user has access to the target repository. If gh is not available or the user lacks access to $REPO, the script will fail with a cryptic error from the subshell.

Add pre-flight checks near the top of the script (after line 9):

🛡️ Proposed fix: Add gh CLI and repo access validation
# Add after line 9, before the usage() function

# Validate gh CLI is available
if ! command -v gh &>/dev/null; then
  echo "Error: gh CLI is not installed or not in PATH" >&2
  exit 1
fi

# Validate gh can access the target repo (requires being authenticated)
if ! gh repo view "$REPO" >/dev/null 2>&1; then
  echo "Error: Cannot access repository '$REPO'. Check your gh authentication." >&2
  exit 1
fi
🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

In `@scripts/push-loop-engineering-issues.sh` around lines 1 - 10, The script uses
the gh CLI command multiple times without validating that it is installed or
that the user has repository access to $REPO, which can result in cryptic error
messages. Add pre-flight validation checks immediately after the variable
definitions (after line 9, before any function definitions or main script
logic). First, check that the gh command is available in the PATH using a
conditional with the command builtin, and exit with a clear error message if it
is not found. Second, validate that gh can access the target repository
specified in the $REPO variable by running gh repo view against it, and exit
with a helpful authentication error message if access is denied. These two
checks will catch configuration issues early and provide users with actionable
error messages before the script attempts to use gh in downstream operations.

@coderabbitai

coderabbitai Bot commented Jun 18, 2026

Copy link
Copy Markdown
Contributor

Note

Unit test generation is a public access feature. Expect some limitations and changes as we gather feedback and continue to improve it.


Generating unit tests... This may take up to 20 minutes.

@coderabbitai

coderabbitai Bot commented Jun 18, 2026

Copy link
Copy Markdown
Contributor

✅ Created PR with unit tests: #141

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants