Skip to content

fix: eliminate spurious "bucket operation fail after retries" logs during partial block cleanup - #7749

Merged
SungJin1212 merged 3 commits into
masterfrom
fix/partial-block-cleaner-spurious-retry-logs
Aug 6, 2026
Merged

fix: eliminate spurious "bucket operation fail after retries" logs during partial block cleanup#7749
SungJin1212 merged 3 commits into
masterfrom
fix/partial-block-cleaner-spurious-retry-logs

Conversation

@SungJin1212

@SungJin1212 SungJin1212 commented Aug 3, 2026

Copy link
Copy Markdown
Member

What this PR does:
I've noticed spurious error logs during partial block cleanup:

level=error msg="bucket operation fail after retries" err="file is not block visit marker" operation="Iter {tenantID}/{BlockUUID}"

Root cause

cleanUserPartialBlocks returned a sentinel error (ErrorNotBlockVisitMarker) from the Iter callback to fast-fail iteration when a non-visit-marker file was detected. Since the bucket client wraps BucketWithRetries internally, this error triggered 5 retries before logging the error.

Fix

Replace the sentinel error pattern with a simple boolean flag (hasNonVisitMarker). The callback no longer returns an error, so no retries occur.
Note: deletion behavior is unchanged, only the spurious retries and error logs are eliminated.

Which issue(s) this PR fixes:
Fixes #

Checklist

  • Tests updated
  • Documentation added
  • CHANGELOG.md updated - the order of entries should be [CHANGE], [FEATURE], [ENHANCEMENT], [BUGFIX]
  • docs/configuration/v1-guarantees.md updated if this PR introduces experimental flags

…ring partial block cleanup

Signed-off-by: SungJin1212 <tjdwls1201@gmail.com>
Comment thread CHANGELOG.md
if !IsBlockVisitMarker(file) {
// return error here to fail iteration fast
// to avoid going through all files
return ErrorNotBlockVisitMarker

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think ErrorNotBlockVisitMarker and IsNotBlockVisitMarkerError can be removed after this change

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, I've cleaned up to the latest commit

Signed-off-by: SungJin1212 <tjdwls1201@gmail.com>
Signed-off-by: SungJin1212 <tjdwls1201@gmail.com>

@friedrichg friedrichg left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!

@dosubot dosubot Bot added the lgtm This PR has been approved by a maintainer label Aug 6, 2026
@SungJin1212
SungJin1212 merged commit a8c6358 into master Aug 6, 2026
40 checks passed
@SungJin1212
SungJin1212 deleted the fix/partial-block-cleaner-spurious-retry-logs branch August 6, 2026 09:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

component/compactor lgtm This PR has been approved by a maintainer size/L type/bug

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants