Skip to content

refactor(storage): stream vacuum2 block gc #20402

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
dantengsky wants to merge 4 commits into
base: main
Choose a base branch
from
Open

refactor(storage): stream vacuum2 block gc #20402

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
ed176b4
refactor(storage): stream vacuum2 block gc
dantengsky Aug 27, 2026
1f35e8d
test(storage): cover vacuum2 streaming GC
dantengsky Aug 28, 2026
5381528
ci: fix vacuum2 S3 test invocation
dantengsky Aug 28, 2026
c6fc4e8
ci: reuse workspace test artifacts for S3 test
dantengsky Aug 30, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
19 changes: 18 additions & 1 deletion .github/actions/test_unit/action.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@ runs:
uses: ./.github/actions/setup_build_tool
with:
target: ${{ inputs.target }}
bypass_env_vars: RUSTFLAGS,RUSTDOCFLAGS,RUST_TEST_THREADS,RUST_LOG,RUST_BACKTRACE,RUST_MIN_STACK
bypass_env_vars: RUSTFLAGS,RUSTDOCFLAGS,RUST_TEST_THREADS,RUST_LOG,RUST_BACKTRACE,RUST_MIN_STACK,DATABEND_TEST_S3_BUCKET,DATABEND_TEST_S3_REGION,DATABEND_TEST_S3_ROOT

- shell: bash
run: |
Expand All @@ -25,6 +25,23 @@ runs:
RUST_MIN_STACK: 33554432
# RUST_BACKTRACE: 1

- name: Test vacuum2 streaming GC against AWS S3
if: env.RUNNER_PROVIDER == 'aws'
shell: bash
run: |
cargo nextest run \
--no-fail-fast \
--hide-progress-bar \
--run-ignored only \
--workspace \
real_s3::streaming_block_gc_across_list_pages
env:
DATABEND_TEST_S3_BUCKET: databend-ci
DATABEND_TEST_S3_REGION: us-east-2
DATABEND_TEST_S3_ROOT: stateful/vacuum2-ci/github-${{ github.run_id }}-${{ github.run_attempt }}
RUST_LOG: ERROR
RUST_MIN_STACK: 33554432

- name: Upload failure
if: failure()
uses: ./.github/actions/artifact_failure
Expand Down
Loading
Loading