-
Notifications
You must be signed in to change notification settings - Fork 332
Azure: Fix azure expires at prefix for the credentials refresh #2633
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Azure: Fix azure expires at prefix for the credentials refresh #2633
Conversation
dimas-b
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for catching this, @singhpk234 !
.../src/main/java/org/apache/polaris/core/storage/azure/AzureCredentialsStorageIntegration.java
Show resolved
Hide resolved
dimas-b
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Could you also add a note to CHANGELOG.md?
|
ACK, seems like we haven't frozen the CHANGELOG for 1.1, i put a PR for this here will add the CHANGELOG for this bug fix on the unreleased section so we can use this in prep of 1.2. |
2d3e463 to
a9e7d43
Compare
|
Thank you @dimas-b ! |
About the change
For the credential refresh endpoint for the ADLS its expected the expiration time should be sent with the prefix of
AZURE_SAS_TOKEN_EXPIRES_AT_MS_PREFIXwhich presently Polaris doesn't sends as the course of that the CredentialProvider responsible for the refresh fails the assertion here https://github.com/apache/iceberg/blob/main/azure/src/main/java/org/apache/iceberg/azure/adlsv2/VendedAdlsCredentialProvider.java#L123and hence not making it usable.
P.S I think we should also use constants for iceberg SDK in the StorageAccessProperty, but this is an orthogonal discussion for now.
Testing
Add a small UT