Skip to content

Conversation

@di
Copy link
Member

@di di commented Feb 14, 2024

Follow on to #15368: In order to avoid deadlock, this PR introduces a one-to-many pair of backfill tasks that fan out tasks to individual files, which are modified in a per-file transaction.

@di di requested a review from a team as a code owner February 14, 2024 22:53
@di di requested a review from ewdurbin February 15, 2024 15:13
@di di force-pushed the fan-out-backfill-tasks branch from fbf0f41 to 37f9354 Compare February 15, 2024 15:21
@di di enabled auto-merge (squash) February 15, 2024 15:29
@di di merged commit 8b9f0d5 into pypi:main Feb 15, 2024
@di di deleted the fan-out-backfill-tasks branch February 15, 2024 15:45
@sentry-io
Copy link

sentry-io bot commented Feb 15, 2024

Suspect Issues

This pull request was deployed and Sentry observed the following issues:

  • ‼️ KeyError: 'backfill_metadata.batch_size' warehouse.packaging.tasks.backfill_metadata View Issue
  • ‼️ TooManyRequests: Too many requests warehouse.packaging.tasks.metadata_backfill_ind... View Issue
  • ‼️ ServiceError: 500 internal_error incident id a575f26b900b-f359f54e9c648a31 warehouse.packaging.tasks.metadata_backfill_ind... View Issue
  • ‼️ OSError: [Errno 36] File name too long: '/tmp/tmp64hec5o5/uselesscapitalquiz-3.141592653589793238462643383... warehouse.packaging.tasks.metadata_backfill_ind... View Issue
  • ‼️ KeyError: PosixPath('METADATA') warehouse.packaging.tasks.metadata_backfill_ind... View Issue

Did you find this useful? React with a 👍 or 👎

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants