Skip to content

Conversation

@HonahX
Copy link
Contributor

@HonahX HonahX commented Jan 24, 2025

Updates Trino example to make it working again. There are 2 major part of changes

  1. Configure Polaris container to use test authenticator and token service
  2. Add fs.hadoop.enabled=true to enable Local Filesystem support for Trino

iceberg.rest-catalog.oauth2.token=principal:root;realm:default-realm
iceberg.rest-catalog.warehouse=polaris
# Required to support local filesystem: https://trino.io/docs/current/object-storage.html#configuration
fs.hadoop.enabled=true
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is related to a breaking change in Trino iceberg connector: link

We have to explicitly enable filesystem support : https://trino.io/docs/current/object-storage.html#configuration

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good catch ! Thanks !

## Build Polaris Image
Build Polaris Image while Docker is running
```
./gradlew :polaris-quarkus-server:assemble -Dquarkus.container-image.build=true
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

General question (not about this PR specificaly): should not we rename polaris-quarkus-server to polaris-server now ? @adutra thoughts ?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not opposed to a global renaming and removing the quarkus token from all module names 👍

iceberg.rest-catalog.oauth2.token=principal:root;realm:default-realm
iceberg.rest-catalog.warehouse=polaris
# Required to support local filesystem: https://trino.io/docs/current/object-storage.html#configuration
fs.hadoop.enabled=true
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good catch ! Thanks !

AZURE_CLIENT_SECRET: $AZURE_CLIENT_SECRET
# add aws keys as dropwizard config
JAVA_OPTS: -Ddw.awsAccessKey=$AWS_ACCESS_KEY_ID -Ddw.awsSecretKey=$AWS_SECRET_ACCESS_KEY
polaris.persistence.type: in-memory
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sorry I missed that docker-compose file, I should have adapted it to Quarkus earlier. My bad.

Copy link
Contributor

@flyrain flyrain left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, we could adapt the change after #804 is merged.

@HonahX
Copy link
Contributor Author

HonahX commented Jan 24, 2025

Thanks everyone for reviewing. I've created a draft PR #877 that contains a preview of what trino example will look like after #804 is merged.

I am happy to update the current one if #804 go first.

@flyrain flyrain merged commit 37a7763 into apache:main Jan 24, 2025
5 checks passed
@flyrain
Copy link
Contributor

flyrain commented Jan 24, 2025

Thanks @HonahX for the fix. Thanks @adutra @jbonofre and @eric-maynard for the review.

@HonahX HonahX deleted the honahx_fix_trino_example branch February 15, 2025 02:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants