Skip to content

Cap backup-test retry loop to stop multi-hour hangs#158

Merged
dboreham merged 1 commit into
mainfrom
dboreham/cap-backup-test-retries
Jul 1, 2026
Merged

Cap backup-test retry loop to stop multi-hour hangs#158
dboreham merged 1 commit into
mainfrom
dboreham/cap-backup-test-retries

Conversation

@dboreham

@dboreham dboreham commented Jul 1, 2026

Copy link
Copy Markdown
Member

The test wrapped each backup.sh call in a 50x readiness loop written for the old single-shot ensure_repo. Since ensure_repo now retries internally (30x/5s) to ride out S3 warmup, the two loops multiplied: a broken-S3 run ground on for ~2.5h (up to CI's 6h cap) instead of failing in ~5min.

ensure_repo already owns the warmup wait, so drop the outer loop to 3 attempts - enough to absorb a transient post-readiness hiccup without re-nesting the retries. Refs #155.

The test wrapped each backup.sh call in a 50x readiness loop written for
the old single-shot ensure_repo. Since ensure_repo now retries internally
(30x/5s) to ride out S3 warmup, the two loops multiplied: a broken-S3 run
ground on for ~2.5h (up to CI's 6h cap) instead of failing in ~5min.

ensure_repo already owns the warmup wait, so drop the outer loop to 3
attempts - enough to absorb a transient post-readiness hiccup without
re-nesting the retries. Refs #155.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
@dboreham dboreham merged commit e8685c8 into main Jul 1, 2026
6 of 7 checks passed
@dboreham dboreham deleted the dboreham/cap-backup-test-retries branch July 1, 2026 17:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant