fix(jobsdb): handle database connection errors in migration with retry logic (#4535) by deepshekhardas · Pull Request #6782 · rudderlabs/rudder-server
Navigation Menu
{{ message }}
rudderlabs / rudder-server Public
- Notifications You must be signed in to change notification settings
- Fork 26
Closed
deepshekhardas wants to merge 3 commits intorudderlabs:masterfrom
Closed
Conversation
Copy link Copy Markdown
deepshekhardas
commented
Mar 19, 2026
deepshekhardas
commented
Fixes #4535
Problem
The backupDSLoop encounters 'driver: bad connection' errors when trying to mark the end of backup operations. This happens when the database connection is lost during long-running migration operations.
Solution
- Add isRetryableError() function to detect retryable connection errors
- Add retryWithBackoff() function with exponential backoff (1s, 2s, 4s, max 30s)
- Wrap journalMarkDoneInTx with retry logic (up to 3 retries)
Changes
- Added helper functions for retryable error detection
- Applied retry logic to journal marking operations in migration
deepshekhardas added 3 commits
March 19, 2026 11:14Copy link Copy Markdown
github-actions
bot
commented
Apr 9, 2026
github-actions bot commented
Apr 9, 2026This PR is considered to be stale. It has been open 20 days with no further activity thus it is going to be closed in 7 days. To avoid such a case please consider removing the stale label manually or add a comment to the PR.
github-actions
bot
added
the
Stale
label
lokey
closed this
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters. Learn more about bidirectional Unicode characters
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment