Skip to content

Support date-only version folders and increase scan limit in list_import_summaries - #2143

Open
rohitkumarbhagat wants to merge 3 commits into
datacommonsorg:masterfrom
rohitkumarbhagat:fix-list-import-summaries
Open

Support date-only version folders and increase scan limit in list_import_summaries#2143
rohitkumarbhagat wants to merge 3 commits into
datacommonsorg:masterfrom
rohitkumarbhagat:fix-list-import-summaries

Conversation

@rohitkumarbhagat

Copy link
Copy Markdown
Contributor

Summary

  • Support YYYY-MM-DD date-only version folder naming in list_import_summaries.py alongside standard timestamp folders.
  • Increase GCS query _SCAN_LIMIT from 100 to 1000 to prevent truncation errors for imports with extensive run histories (e.g. scripts/entities:Schema).
  • Update associated unit tests and documentation bounds.

Verification

  • Tested with scripts/entities:Schema to verify recent version summaries are listed correctly.
  • Added unit tests for date-only version sorting in list_import_summaries_test.py.
  • Ran ./run_tests.sh -l and unit tests.

Add regex matching for YYYY-MM-DD version folders and increase
the scan limit to 1000 to support imports with large run histories.
@rohitkumarbhagat
rohitkumarbhagat enabled auto-merge (squash) August 6, 2026 15:59

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request increases the scan limit for import summaries from 100 to 1000 and introduces support for date-only version patterns (YYYY-MM-DD). The review feedback identifies a sorting bug that occurs when mixing underscore-separated and hyphen-separated date formats, as ASCII comparison will sort them incorrectly. It is recommended to normalize the separators in the sorting key to ensure correct ordering.

Comment thread agents/common/scripts/list_import_summaries.py
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant