Skip to content

Conversation

@nk1506
Copy link
Contributor

@nk1506 nk1506 commented Jul 31, 2024

Description

Fix for possible NPE.

Please delete options that are not relevant.

  • Bug fix (non-breaking change which fixes an issue)

Please delete options that are not relevant.

  • I have performed a self-review of my code
  • My changes generate no new warnings

kevinjqliu pushed a commit to kevinjqliu/polaris-catalog that referenced this pull request Jul 31, 2024
…pache#46)

* Squashed commit of the following:

Co-authored-by: Evgeny Zubatov <[email protected]>
Co-authored-by: Michael Collado <[email protected]>
Co-authored-by: Shannon Chen <[email protected]>
Co-authored-by: Eric Maynard <[email protected]>
Co-authored-by: Alvin Chen <[email protected]>

commit de0b4ee768a62221a480dce7da935a27a206d076
Merge: 1c19fc8 85e69a3
Author: Michael Collado <[email protected]>
Date:   Mon Jul 29 16:36:25 2024 -0700

    Merge commit '3e6e01aae203356ed972502dfa596d04ec5a8ca5' into mcollado-merge-oss

commit 1c19fc877231e34d5e8baa4a05902d13f6120050
Author: Michael Collado <[email protected]>
Date:   Mon Jul 29 16:25:05 2024 -0700

    Merge polaris-dev OSS contributions

commit a3fbf4ce4bc6c629bef308349b7c7a64c8335ac9
Author: Michael Collado <[email protected]>
Date:   Mon Jul 29 15:43:23 2024 -0700

    Fix token refresh in oauth service to work with client credentials (apache#37)

    The Iceberg REST client _does_ retry refreshing the auth token with
    client credentials, but it submits them in Basic Auth form rather than
    as form parameters. We need to base64/url-decode them in order to
    validate the credentials are correct. We also need to return an accepted
    tokenType during refresh.

    Tested with
    ```java
            RESTSessionCatalog sessionCatalog =
                    new RESTSessionCatalog(config -> HTTPClient.builder(config).uri(config.get(CatalogProperties.URI)).build(), null);
            sessionCatalog.initialize("demo", Map.of(
                    "uri", "http://localhost:8181/api/catalog",
                    "prefix", "catalog",
                    "credential", "$URLENCODED_CLIENTID:$URLENCODED_CLIENTSECRET",
                    "scope", "PRINCIPAL_ROLE:ALL",
                    "token-refresh-enabled", "true",
                    "warehouse", "martins_demo1"
            ));
            Field catalogAuth = RESTSessionCatalog.class.getDeclaredField("catalogAuth");
            catalogAuth.setAccessible(true);
            OAuth2Util.AuthSession authSession = (OAuth2Util.AuthSession) catalogAuth.get(sessionCatalog);

            Field client = RESTSessionCatalog.class.getDeclaredField("client");;
            client.setAccessible(true);
            RESTClient restClient = (RESTClient) client.get(sessionCatalog);
            for (int i = 0; i < 10; i++) {
                System.out.println(authSession.refresh(restClient));
                Thread.sleep(10000);
            }
    ```

commit 517cb6231d424fac59ceecb1845bdb0a3e065265
Author: Michael Collado <[email protected]>
Date:   Mon Jul 29 10:47:32 2024 -0700

    Changed reg test docker image to stop exposing aws credentials as env variables (apache#36)

    In the reg tests, when S3 credentials aren't present in the FileIO, the
    S3 client is falling back to the credentials in the environment
    variables, which have access to everything. This caused a previous bug
    to go uncaught.

    I verified that if I don't update the FileIO for a table, these tests
    fail now.

commit e418aefe8964c7c67b509f8eec43055f1c17a742
Author: Michael Collado <[email protected]>
Date:   Mon Jul 29 08:40:58 2024 -0700

    Fix error with catalog FileIO credentials and path construction (apache#35)

    Namespace directories were being constructed backwards. Unsure why the
    tests didn't catch this

    FileIO for table creation and update was also not updating credentials
    correctly due to several `fileIO` variables in scope and updating the
    wrong one. I've renamed the variables to be more clear what each fileIO
    is scoped to.

    Future change upcoming to improve reg tests to catch issues - fileIO is
    falling back to environment variables in the docker image

commit 7f37bb252cec7df07db3994bf981efe76a52639c
Author: Michael Collado <[email protected]>
Date:   Mon Jul 29 02:05:14 2024 -0700

    Fix validation to read table metadata file after fileio initialization with credentials (apache#34)

    TableMetadataParser was reading metadata file before FileIO was
    initialized with credentials. This was uncaught in the tests because the
    FileIO reads the test image's environment variables.

commit 0866f3ad54295a6d7822b9645f59996986d23acd
Author: Michael Collado <[email protected]>
Date:   Sun Jul 28 22:10:22 2024 -0700

    Fixed issue when creating table under namespace with custom location (apache#33)

    Tables were still being created with the default directory structure
    when their parent namespace had a custom location. This fixes the issue
    and adds a test proving the table is successfully created and that its
    location is under the custom namespace directory

commit ee701ff99120b948b5ed3120461a9aaf0842f944
Author: Michael Collado <[email protected]>
Date:   Sun Jul 28 20:53:52 2024 -0700

    Disallow overlapping base locations for table and namespaces and prevent table location from escaping via metadata file (apache#32)

    Two major changes included here:
    * Disables table locations and namespace locations from overlapping.
    Since namespaces can't overlap and tables can't overlap sibling
    namespaces or sibling tables, this prevents all table locations from
    overlapping within a catalog
    * Prevents metadata files from pointing at table locations outside of
    the table's base location

    Both of these features are controllable by feature flags. Because of
    existing unit and integration tests (notably the ones we import from
    Iceberg), I also made the TableMetadata location check and the namespace
    directory checking configurable at the catalog level. However, the
    overlap checking within a namespace is not configurable at the catalog
    level (this means there's a gap so that if a catalog allows metadata
    files to point to locations outside of the namespace directory, a
    table's location could overlap with a table in another directory).

    It is possible for a table or a namespace to _set_ its base-directory to
    something other than the default. However, tables and namespaces with
    overridden base locations still cannot overlap with sibling tables or
    namespaces.

commit 51ac320f60c103c2b10cd8d2910217010f38afdd
Author: Shannon Chen <[email protected]>
Date:   Sun Jul 28 23:13:59 2024 +0000

    The loadTable is current scoped to table location, this PR makes
    1. loadTable only scoped to table location + `metadata/` and `data/`.
    2. when refreshTable keep it only scoped to table location + `metadata`
    3. Throw user error when the user specify `write.metadata.path` or
    `write.data.path`

commit 838ba65849e7f4f0dd5dfcac0093262a165e52e4
Author: Eric Maynard <[email protected]>
Date:   Fri Jul 26 22:04:41 2024 -0700

    CREATE_TABLE shouldn't return credentials to read the table if the user doesn't have that privilege (apache#29)

    Before CREATE_TABLE returns credentials that can be used to read a
    table, Polaris should validate that the user has TABLE_READ_DATA on that
    table.

commit 96257f4fa54372fb565954024cbfe256de5d6f20
Author: Alvin Chen <[email protected]>
Date:   Fri Jul 26 15:43:35 2024 -0700

    Call metric init on IcebergRestConfigurationApi and IcebergRestOAuth2Api class (apache#30)

commit d6e057778811f20a462ad2746722e1a1427197cf
Author: Alvin Chen <[email protected]>
Date:   Fri Jul 26 10:22:34 2024 -0700

    Switch Metrics Emission from Ad-Hoc to Initialization-Based (apache#28)

    <!-- Please describe your change here and remove this comment -->
    Metrics are currently emitted in an ad-hoc fashion, meaning they will
    only be queriable in Prometheus if the corresponding API endpoint is
    invoked. This makes plotting difficult in Grafana, especially in the
    case where we need to aggregate across multiple metrics to reflect, for
    instance, the overall error rate across all endpoints in the
    application.
    Say we have metrics a, b, c. If b is null since the corresponding API
    has not yet been invoked, a+b+c would result in the value null, instead
    of the sum of a and c. This can be fixed in Grafana by "filling in" the
    metrics with a metric that is guaranteed to be present, say `up`. The
    promql query will then become:
    `(a or (up * 0)) + (b or (up * 0)) + (c or (up * 0))`
    However, the query becomes extremely large and slow. Thus to avoid this,
    we'll make sure the metrics are always emitted regardless of the
    corresponding API being called.

    We also add a counter metric to each endpoint to track the total number
    of invokes. Previously we had timers who have an attribute `count`.
    However, they are only incremented on successes (since we only record
    timer on success), therefore, they did not incorporate failures in the
    counts.

commit 20bf59b9b5e8dba9a35b932f036114b85375829b
Author: Eric Maynard <[email protected]>
Date:   Fri Jul 26 10:09:50 2024 -0700

    When a catalog is created or updated, we should check that the catalog
    does not have a location which overlaps with the location of an existing
    catalog.

* Squashed commit of the following:

commit b65dbc68c43e7c3ff0e1901e516c9749fda58ced
Author: Michael Collado <[email protected]>
Date:   Mon Jul 29 17:24:10 2024 -0700

    Fix Gradle formatting error in merge

* Update aws config to check for blank instead of null to address reg tests when aws keys are not available
List.of(getResolvedRootContainerEntity(), new ResolvedPolarisEntity(resolvedCacheEntry)));

ResolvedPolarisEntity resolvedRootContainerEntity = getResolvedRootContainerEntity();
return resolvedRootContainerEntity == null ? new PolarisResolvedPathWrapper(List.of(new ResolvedPolarisEntity(resolvedCacheEntry))):new PolarisResolvedPathWrapper(List.of(resolvedRootContainerEntity, new ResolvedPolarisEntity(resolvedCacheEntry))) ;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This line looks too long. How about wrapping like below?

    return resolvedRootContainerEntity == null
            ? new PolarisResolvedPathWrapper(List.of(new ResolvedPolarisEntity(resolvedCacheEntry)))
            : new PolarisResolvedPathWrapper(List.of(resolvedRootContainerEntity, new ResolvedPolarisEntity(resolvedCacheEntry))) ;

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I was hoping build will fail with spotless check.

@nk1506 nk1506 requested a review from ebyhr August 1, 2024 07:39
this.grantRecordsAsSecurable = grantRecordsAsSecurable;
}

public ResolvedPolarisEntity(EntityCacheEntry cacheEntry) {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
public ResolvedPolarisEntity(EntityCacheEntry cacheEntry) {
public ResolvedPolarisEntity(@NotNull EntityCacheEntry cacheEntry) {

}

public ResolvedPolarisEntity(EntityCacheEntry cacheEntry) {
Preconditions.checkNotNull(cacheEntry, "An entity cache can't be null.");
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The check is redundant, because recent JVMs throw meaningful NPEs telling that cacheEntry is null - the proposed message doesn't give any advice to users.

}

private class BasePolarisViewOperations extends BaseViewOperations {
protected class BasePolarisViewOperations extends BaseViewOperations {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why this change?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It was violating the visibility of BasePolarisViewOperations .

return new PolarisResolvedPathWrapper(
List.of(getResolvedRootContainerEntity(), new ResolvedPolarisEntity(resolvedCacheEntry)));

ResolvedPolarisEntity resolvedRootContainerEntity = getResolvedRootContainerEntity();
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks like there are more calls to getResolvedRootContainerEntity() that can fail with a direct or indirect NPE.
@collado-mike WDYT?

@annafil annafil requested review from a team and removed request for ebyhr August 1, 2024 18:21
}

@Override
protected BasePolarisViewOperations newViewOps(TableIdentifier identifier) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This seems unrelated to the NPE fix

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, Let me remove this and fix with separate PR.

Copy link
Member

@RussellSpitzer RussellSpitzer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks like all feedback was applied here, Approving and letting tests run. I'll let the original reviewers merge.

@takidau
Copy link
Contributor

takidau commented Aug 6, 2024

This has been sitting for a while, I'm just going to merge.

@takidau takidau merged commit 6606a72 into apache:main Aug 6, 2024
travis-bowen added a commit to travis-bowen/polaris that referenced this pull request Jun 20, 2025
* Generify MetaStoreManagerFactory.getOrCreateSessionSupplier (apache#1173)

No functional change.

* Adjust the type parameter to the Persistence supplier to
  cover all possible implementation types.

* Remove unnecessary fields from IcebergCatalogAdapter

* Adjust types at call sites of `getOrCreateSessionSupplier`.

* [Enhancement] Refactor Cleanup Task Handler (apache#516)

* refactor cleanup task handler

* format

* make base class abstract

* make cleanup task record

* simplify logger

* update test after merge

* update task handler register after merge

* fix test error after merge

* refine call context and ut after merge

* fix ci error (apache#1174)

* main: Update dependency org.junit:junit-bom to v5.12.1 (apache#1177)

* Publish 0.9.0 documentation (apache#1175)

* main: Update dependency gradle to v8.13 (apache#1063)

* main: Update dependency gradle to v8.13

* Adopt build-scripts to Gradle changes

See https://docs.gradle.org/8.13/userguide/upgrading_version_8.html#changes_to_jvmtestsuite

---------

Co-authored-by: Robert Stupp <[email protected]>

* Remove jetbrains-annotations (apache#1176)

The main intention of this change is to avoid confusion between
Jetbrains' `@NotNull` and Jakarta's `@Nonnull` (the latter
is standard in the Polaris codebase).

As a side effect `@Contract` is no longer available. However,
its value is realised only in tools that support it and Polaris
builds do not rely on it for producing artifacts. For a human
being the value of `@Contract` appears to be negligible compared
to javadoc. Therefore, in the interest of keeping annotation
dependencies concise, `@Contract` lines are removed.

Jetbrains' `@VisibleForTesting` is converted to the same
annotation from Guava (which is also standard in the Polaris
codebase).

* main: Update dependency com.google.cloud:google-cloud-storage-bom to v2.50.0 (apache#1178)

* Isolate Persistence objects in different threads. (apache#1166)

* Simplify PolarisGrantManager (apache#1171)

* Simplify PolarisGrantManager

Previously strongly typed methods redirected to typeless
lookup methods, while implementations had only the typeless
variant.

This change reverts the redirects from strongly typed methods
to existing typeless methods in implementations.

As a result it is possible to simplify the interface by removing
typeless lookup methods.

Existing call sites all have strongly typed parameters available
and use the typed lookup methods now.

For context: This refactoring seems valuable by itself, but it is
also needed for the upcoming NoSQL implementations for reasons
similar to apache#1112

* main: Update dependency com.github.spotbugs:spotbugs-annotations to v4.9.3 (apache#1180)

* main: Update mockito monorepo to v5.16.1 (apache#1182)

* main: Update dependency software.amazon.awssdk:bom to v2.31.1 (apache#1188)

* Remove extra run in dockerfile (apache#1185)

* Policy Store: Add PolicyEntity and PolicyTypes (apache#1133)

* Fix spark download and add check/cleanup (apache#1184)

* Update EclipseLink doc to 4.0 (apache#1198)

* Sync psql persistence (apache#1187)

* sync persistence config when using Postgres

* sync persistence config when using Postgres

* sync persistence config when using Postgres

* Revert change for 0.9.0

* Renovate: Group all Quarkus dependencies (apache#1206)

Quarkus-platform releases happen some time after the "actual" Quarkus release, which causes "broken" CI for Renovate PRs against for example the Quarkus Gradle plugin.

This change groups all Quarkus dependencies together to consistently bump all Quarkus-platform dependencies at once.

* The ASF Infra deployed a new parser, that requires a fix on our .asf.yaml (apache#1209)

* Let 'spotless' run on all java source directories (apache#1205)

Only runs on 'main', 'test', 'testFixtures', but not on others like 'intTest'. This change fixes this.

* commit (apache#1201)

* Move Polaris client into root dir (apache#1172)

* Move python client into root dir

* Fix paths for regtests

* Fix path for notebooks and docs

* Change the path within container for consistency

* Add License Header

* Fix the copy folder cmd to restore the original regtests layout

* Rearrange dir layout inside docker

* Rename classes in transactional persistence package (apache#1197)

* Refactors to support generic tables (apache#1147)

* rename polarisbasecatalog

* move catalog files

* more renames; introduce class

* add basic create/load methods

* some refactoring

* test stable

* small rename

* rename per review

* bump id

* move a file

* autolint

* rebase

* autolint

* changes per review

* autolint

* rename

* autolint

* fix merge conflict

* main: Update dependency ch.qos.logback:logback-classic to v1.5.18 (apache#1196)

* main: Update Quarkus Platform and Group (apache#1212)

* main: Update dependency boto3 to v1.37.16 (apache#1093)

* Use 'en-us' in all `Dockerfile`s and Gradle `Test` tasks (apache#1214)

Fixes apache#885
Supersedes apache#886

* main: Update dependency com.google.guava:guava to v33.4.5-jre (apache#1218)

* IcebergCatalogAdapter: close underlying catalog consistently (apache#1224)

With the revert of #b84f4624db8d0bd5b8920b0df719bcc15666008f by #ccf25df7b055e9d232b88a3f6fe8b4e0a2ab035a, we lost an extra benefit that was included in that change: a fix for the fact that IcebergCatalogHandlerWrapper does not always close its underlying `Catalog`, thus relying on `CallContext` to play the role of the "sweep vehicle" and close everything that was left unclosed at the end of the request processing.

This PR re-applies that fix again.

* Add BOM (Bill of Materials) (apache#1216)

Fixes apache#788

* Fix CI build after polaris.io (apache#1232)

* Add Apache Polaris Community Meeting from March 20, 2025 (apache#1234)

* Simplify `polaris` client script (apache#1220)

Address [SC2164](https://github.com/koalaman/shellcheck/wiki/SC2164), [SC2098](https://github.com/koalaman/shellcheck/wiki/SC2098), [SC2086](https://github.com/koalaman/shellcheck/wiki/SC2086)

Co-authored-by: Alexandre Dutra <[email protected]>

* Move polaris-admin-tool tests to separate package (apache#1227)

... and make the PG test-resource non-global.

* Let `PurgeCommand` inspect the results (apache#1226)

* Add type and converters for `MemorySize` (apache#1230)

The type allows human friendly memory size specifications like `32k` or `64M`, including support for smallrye-config and Jackson.

* Retire `polaris-reg-test` script (apache#1219)

* Nit: add misc-types to bom (apache#1241)

* JWTBroker: fix refresh token logic (apache#1242)

* Fix overzealous check in the Polaris CLI (apache#1237)

* fix

* adjust

* revert

* main: Update dependency software.amazon.awssdk:bom to v2.31.6 (apache#1245)

* main: Update dependency boto3 to v1.37.18 (apache#1244)

* Add zip+tar to publishable artifacts and add a `run.sh` script (apache#1082)

Adds the tar+zip distribution archives as publishable artifacts to Maven publication.

Also updates polaris-quarkus-admin to build as a "fast-jar" instead of an "uber-jar".

* Build: Add `pom.xml`, `pom.properties` and LICENSE+NOTICE to release jars (apache#1036)

Adds convenient, but not strictly necessary information to each generated "main" jar.

This includes `pom.properties` and `pom.xml` files where Maven places those, in `META-INF/maven/group-id/artifact-id/`. Also adds the `NOTICE` and `LICENSE` files in `META-INF`, which makes it easier for license scanners.

* Doc: catalog bootstrap steps for helm deployment (apache#1243)

* main: Update actions/setup-python digest to 8d9ed9a (apache#1249)

* main: Update dependency com.google.guava:guava to v33.4.6-jre (apache#1251)

* main: Update actions/stale digest to ba23c1c (apache#1250)

* Core: Add data compaction policy content parser and validator (apache#1238)

* main: Update gradle/actions digest to 06832c7 (apache#1255)

* Admin tool: fix Dockerfile.jvm (apache#1256)

* Implement GenericTableCatalog (apache#1231)

* add missing apis

* more tests, fixes

* clean up drop

* autolint

* changes per review

* revert iceberg messages to comply with oss tests

* another revert

* more iceberg catalog changes

* autolint

* wip

* refactor to subtype

* autolint

* rebase

* add another assert

* autolint

* add another best effort check

* autolint

* reduce metastore trips

* autolint

* API Spec: Add ConnectionConfigInfo to ExternalCatalog (apache#1026)

* API Spec: Add ConnectionConfigInfo to ExternalCatalog

Remove the currently unused remoteUrl field from the top-level ExternalCatalog
into the ConnectionConfigInfo as "uri" instead for better consistency;
remote catalogs in the future may be defined by arbitrary URIs that are not,
for example, http(s) URLs.

This is just the spec definition for now, so it's not yet wired into the
internal entity layer or persistence objects.

Allow extensibility of different connection types in the future even if we
start with only an ICEBERG_REST type.

Similarly, provide extensibility for different authn mechanisms to use
with the connection.

* Implement service interfaces for policies & generic tables (apache#1263)

* ready

* autolint

* main: Update registry.access.redhat.com/ubi9/openjdk-21-runtime Docker tag to v1.22-1 (apache#1268)

* main: Update dependency io.smallrye.common:smallrye-common-annotation to v2.11.0 (apache#1267)

* main: Update dependency io.smallrye.config:smallrye-config-core to v3.12.4 (apache#1266)

* Add openApiGenerate task as dependency for processResources (apache#1259)

* Core: Add policy content and validator for more maintenance policies (apache#1261)

* Better error message when sibling resolution fails (apache#1253)

* better error

* autolint

* better message

* Add CLI dependency update option (apache#1222)

* PySpark Reg Test Updates (apache#1262)

* PySpark Reg Test Updates

* Nits

---------

Co-authored-by: Travis Bowen <[email protected]>

* Update .asf.yaml adding dismiss_stale_reviews to true and require_last_push_approval to false (apache#1265)

* main: Update dependency software.amazon.awssdk:bom to v2.31.11 (apache#1279)

* main: Update dependency boto3 to v1.37.23 (apache#1278)

* main: Update dependency com.azure:azure-sdk-bom to v1.2.33 (apache#1275)

* Update team (apache#1282)

* Vend Azure credentials compatible with Iceberg 1.7 (apache#1252)

* update

* autolint

* fix

* autolint

* clean up

* autolint

* test

* autolint

* paranoid check

* typofix

* Add a note about nit/minor comments (apache#1280)

* Upgrade Iceberg to 1.8.1 (apache#1126)

* Policy Store: PolicyMappingRecord with Persistence Impl (apache#1104)

* Spark: Setup repository code structure and build (apache#1190)

* Added freshness aware table loading using metadata file location for ETag (apache#1037)

* Pulled in iceberg 1.8.0 spec changes for freshness aware table loading and added feature to Polaris

* Changed etag support to use entityId:version tuple

* fixed getresponse call

* Changed etagged response to record and gave default implementation to ETaggableEntity

* Made iceberg rest spec docs clearer

* Added HTTP Compliant ETag and IfNoneMatch representations and separated persistence from etag logic

* Changed ETag to be a record and improved semantics of IfNoneMatch

* Fixed semantics of if none match

* Removed ETag representation, consolidated in IfNoneMatch

* fixed if none match parsing

* Added table entity retrieval method to table operations

* removed accidental commit of pycache folders

* Fixed formatting

* Changed to use metadata location hash

* Ran formatting

* use sha256

* Moved out ETag functions to utility class and removed ETaggedLoadTableResponse

* Addressed comments

* Fixed IcebergTableLikeEntity package rename

* main: Update dependency io.opentelemetry.semconv:opentelemetry-semconv to v1.31.0 (apache#1288)

* Update LICENSE and NOTICE in the distributions (admin and server) (apache#1258)

* Gradle/Quarkus: make imageBuild task depend on jandex (apache#1290)

* Core: Clarify the atomicity of BasePersistence methods (apache#1274)

* Implement GenericTableCatalogAdapter (apache#1264)

* rebase

* more fixes

* autolint

* working on tests

* stable test

* autolint

* polish

* changes per review

* some changes per review

* grants

* autolint

* changes per review

* changes per review

* typofix

* Improve code-containment and efficiency of etag-aware loading (apache#1296)

* Improve code-containment and efficiency of etag-aware loading

-Make the hash generation resilient against null metadataLocation
-Use getResolvedPath instead of getPassthroughResolvedPath to avoid redundant persistence round-trip
-Only try to calculate the etag for comparison against ifNoneMatch if the ifNoneMatch is actually provided

* Add strict null-checking at callsites to generateETag, disallow passing null to generator

* Add TODO to refactor shared logic for etag generation

* Core: Add Endpoints and resource paths for Generic Table (apache#1286)

* main: Update dependency com.nimbusds:nimbus-jose-jwt to v10.1 (apache#1299)

* [JDBC] Part1 : ADD SQL script for Polaris setup (apache#1276)

* main: Update registry.access.redhat.com/ubi9/openjdk-21-runtime Docker tag to v1.22-1.1743605859 (apache#1300)

* done (apache#1297)

* Add Polaris Community Meeting for April 3, 2025 (apache#1304)

* Use config-file to define errorprone rule (apache#1233)

Also enabled a couple more simple rules, and adding suppressions/fixes for/to the code.

The two rules `EqualsGetClass` and `UnusedMethod`, which I think are useful, are not enabled yet, because that would mean actual code changes, which I do not want to do in this PR.

The rule `PatternMatchingInstanceof`, introduced in apache#393, is disabled in this PR. It does not work before errorrpone 2.37.0 (via apache#1213) - requires additional changes to enable the rule (see apache#1215).

* Add Yun as a contributor (apache#1310)

* Refactor CatalogHandler to comply with ErrorProne rules (apache#1312)

Fix the CI error after apache#1233

* Implement PolicyCatalog Stage 1: CRUD + ListPolicies (apache#1294)

* main: Update dependency io.opentelemetry:opentelemetry-bom to v1.49.0 (apache#1316)

* main: Update docker.io/jaegertracing/all-in-one Docker tag to v1.68.0 (apache#1317)

* main: Update dependency boto3 to v1.37.28 (apache#1328)

* main: Update dependency software.amazon.awssdk:bom to v2.31.16 (apache#1329)

* Make `BasePolaritsMetaStoreManagerTest` and `(Base)ResolverTest` reusable (apache#1308)

Moves the test cases into the `Base*` classes and make sure the classes can be reused by other persistence implementations.

* main: Update dependency io.opentelemetry.semconv:opentelemetry-semconv to v1.32.0 (apache#1293)

* main: Update mockito monorepo to v5.17.0 (apache#1311)

* PySpark Update AWS Region (apache#1302)

Co-authored-by: Travis Bowen <[email protected]>

* main: Update dependency com.nimbusds:nimbus-jose-jwt to v10.2 (apache#1334)

* main: Update dependency com.diffplug.spotless:spotless-plugin-gradle to v7.0.3 (apache#1335)

* Maven publication: Produce correct `<scm><tag>` in `pom.xml` (apache#1330)

`project.scm.tag` in a Maven pom is intended to refer to the SCM (Git) tag. We currently publish `main`, which is incorrect.

This change omits the SCM tag for snapshot builds, but emits the Git tag for releases.

* Remove `@StaticInitSafe` annotation (apache#1331)

There was an issue around mapped configurations having the `@StaticInitSafe` annotation that led to _two_ instances (a "static" one and a "somewhet application-scoped" one) - this was fixed in Quarkus 3.21. One bug in smallrye-config is fixed for Quarkus > 3.21.0, another issue however remains.

Since `@StaticInitSafe` annotated configs seem to cause some weird issues, it seems legit to remote that annotation altogether. This approach was [taken in Nessie](projectnessie/nessie#10606) as well. Investigations (via practical experiments) have proven that there's no measurable impact (runtime + heap) when doing this - and that's also been confirmed by Quarkus + Smallrye-config maintainers.

Hence this change remotes that annotation from the code base.

* Build/Release: Add a "generate digest" task and use for source tarball and Quarkus distributables (apache#1271)

* Ensure that digest and signature are generated for both Polaris-Server and admin tar/zip distribution
* Move "generate digest" functionality to a Gradle task

* main: Update dependency com.google.errorprone:error_prone_core to v2.37.0 (apache#1213)

* main: Update Quarkus Platform and Group to v3.21.1 (apache#1291)

* main: Update dependency io.netty:netty-codec-http2 to v4.2.0.Final (apache#1301)

* Remove unnecessary `clean` and `--no-build-cache` from Gradle invocations (apache#1338)

`quarkusAppPartsBuild --rerun` is the right way to force a Docker image build.

* Generalize bootstrapping in servers (apache#1313)

* Remove `instanceof` checks from `QuarkusProducers`.

* Remove the now unused `onStartup` method from `InMemoryPolarisMetaStoreManagerFactory`.

* Instead, call the good old `bootstrapRealms` method from `QuarkusProducers`.

* Add new config property to control which MetaStore types are bootstrapped automatically (defaults to `in-memory` as before).

* There is no bootstrap behaviour change in this PR, only refactorings to simplify code.

* Add info log message to indicate when a realm is bootstrapped in runtime using preset credentials.

Future enhancements may include pulling preset credentials from a secret manager like Vault for bootstrapping (s discussed in comments on apache#1228).

* main: Update actions/stale digest to 816d9db (apache#1341)

* main: Update dependency com.adobe.testing:s3mock-testcontainers to v4 (apache#1342)

* main: Update dependency org.eclipse.persistence:eclipselink to v4.0.6 (apache#1343)

* main: Update dependency io.quarkus to v3.21.2 (apache#1344)

* main: Update dependency com.google.guava:guava to v33.4.7-jre (apache#1340)

Co-authored-by: Robert Stupp <[email protected]>

* Spark: Add Namespaces and View support for SparkCatalog (apache#1332)

* Demote technical log messages to DEBUG in PolarisCallContextCatalogFactory (apache#1346)

These messages appear to be logging low-level technical details
about what is going on in the factory and are not likely to be
of interest to most users on a daily basis.

* Core/Service: Implement PolicyCatalog Stage 2: detach/attach/getApplicablePolicies (apache#1314)

* Spec: Add 'inherited' and 'namespace' Fields to GetApplicablePolicies API Response (apache#1277)

* Properly track bootstrappedRealms in InMemoryPolarisMetaStoreManagerFactory (apache#1352)

Fixes apache#1351

* Implement GenericTableCatalogAdapter; admin-related fixes (apache#1298)

* initial commit:

* debugging

* some polish

* autolint

* spec change

* bugfix

* bugfix

* various fixes

* another missing admin location

* autolint

* false by default

* fixes per review

* autolint

* more fixes

* DRY

* revert small change for a better error

* integration test

* extra test

* autolint

* stable

* wip

* rework subtypes a bit

* stable again

* autolint

* apply new lint rule

* errorprone again

* adjustments per review

* update golden files

* add another test

* clean up logic in PolarisAdminService

* autolint

* more fixes per review

* format

* Update versions in distribution LICENSE and NOTICE (apache#1350)

* Spark: Add CreateTable and LoadTable implementation for SparkCatalog (apache#1303)

* Add a weigher to the EntityCache based on approximate entity size (apache#490)

* initial commit

* autolint

* resolve conflicts

* autolint

* pull main

* Add multiplier

* account for name, too

* adjust multiplier

* add config

* autolint

* remove old cast

* more tests, fixes per review

* add precise weight test

* autolint

* populate credentials field for loadTableResponse (apache#1225)

* populate credentials field for loadTableResponse

* spotless

* spotless

* remove unused hashset

* fix merge

* fix empty credential case

* spotlessApply

---------

Co-authored-by: David Lu <[email protected]>

* main: Update dependency io.smallrye.common:smallrye-common-annotation to v2.12.0 (apache#1355)

* Build: Avoid adding duplicated projects for Intelij IDE usage (apache#1333)

* main: Update dependency org.junit:junit-bom to v5.12.2 (apache#1354)

* main: Update dependency org.apache.commons:commons-text to v1.13.1 (apache#1358)

* main: Update dependency boto3 to v1.37.33 (apache#1360)

* main: Update dependency software.amazon.awssdk:bom to v2.31.21 (apache#1361)

* main: Update dependency io.micrometer:micrometer-bom to v1.14.6 (apache#1362)

* main: Update dependency com.google.guava:guava to v33.4.8-jre (apache#1366)

* Update LICENSE/NOTICE with latest versions (apache#1364)

* Use "clean" LICENSE and NOTICE in published jar artifacts (apache#1292)

* main: Update dependency io.projectreactor.netty:reactor-netty-http to v1.2.5 (apache#1372)

* Add `Varint` type for variable-length integer encoding (apache#1229)

* main: Update docker.io/prom/prometheus Docker tag to v3.3.0 (apache#1375)

* Set version to 0.10.0-beta in prepaaration for the next release (apache#1370)

* Update the link to OpenAPI in the documentation (apache#1379)

* Integration test for Spark Client (apache#1349)

* add integration test

* add change

* add comments

* rebase main

* update class comments

* add base integration

* clean up comments

* main: Update dependency net.ltgt.gradle:gradle-errorprone-plugin to v4.2.0 (apache#1392)

* Add generic table documentations (apache#1374)

* add generic table documentation (incomplete)

* fix table and spacing

* remove documentation in client api since there is no implementation yet

* remove spacing

* minor fix - proof read

* review fix, wording

* add generic table documentation (incomplete)

* fix table and spacing

* remove documentation in client api since there is no implementation yet

* remove spacing

* minor fix - proof read

* review fix, wording

* proof read - punctuation fix

* change table privilege reference

* Unblock test `listNamespacesWithEmptyNamespace` (apache#1289)

* Unblock test `listNamespacesWithEmptyNamespace`

* Use `containsExactly` to simplify the test

* Fix empty namespace behavior

* Address comments

* Block dropping empty namespace

* Improve error messages

* Revamp the Quick Start page (apache#1367)

* First Draft with AWS

* try again

* try again

* try again

* try again

* try again

* try now

* should work

* AWS First Draft Complete

* ensure file changed

* Azure First Draft Complete

* Azure First Draft, pt. 2

* Azure Completed

* GCP First Draft

* GCP Verified

* File structure fixed

* Remove Trino-specific tutorial

* Restructured Quick Start

* Addresses minor comments from @eric-maynard

* Added reference to Deploying Polaris in Production

* Fix MD Link Checker

---------

Co-authored-by: Adnan Hemani <[email protected]>

* Update README with links to new Quickstart experience (apache#1393)

* Update the StorageConfiguration to invoke singleton client objects, a… (apache#1386)

* Update the StorageConfiguration to invoke singleton client objects, and add a test

* Fix formatting

* using guava suppliers

* Add aws region

* Cleanup and mock test

* Spark: Add rest table operations (drop, list, purge and rename etc) for Spark Client (apache#1368)

* Initial MVP implementation of Catalog Federation to remote Iceberg REST Catalogs (apache#1305)

* Initial prototype of catalog federation just passing special properties into internal properties.

Make Resolver federation-aware to properly handle "best-effort" resolution of
passthrough facade entities.

Targets will automatically reflect the longest-path that we happen to have stored
locally and resolve grants against that path (including the degenerate case
where the longest-path is just the catalog itself).

This provides Catalog-level RBAC for passthrough federation.

Sketch out persistence-layer flow for how connection secrets might be pushed
down into a secrets-management layer.

* Defined internal representation classes for connection config

* Construct and initialize federated iceberg catalog based on connection config

* Apply the same spec renames to the internal ConnectionConfiguration representations.

* Manually pick @XJDKC fixes for integration tests and omittign secrets in response objects

* Fix internal connection structs with updated naming from spec PR

* Push CreateCatalogRequest down to PolarisAdminService::createCatalog just like UpdateCatalogRequest in updateCatalog.

This is needed if we're going to make PolarisAdminService handle secrets management without ever putting the secrets
into a CatalogEntity.

* Add new interface UserSecretsManager along with a default implementation

The default UnsafeInMemorySecretsManager just uses an inmemory ConcurrentHashMap
to store secrets, but structurally illustrates the full flow of intended
implementations.

For mutual protection against a compromise of a secret store or the core
persistence store, the default implementation demonstrates storing only
an encrypted secret in the secret store, and a one-time-pad key in the
returned referencePayload; other implementations using standard crypto
protocols may choose to instead only utilize the remote secret store as
the encryption keystore while storing the ciphertext in the referencePayload
(e.g. using a KMS engine with Vault vs using a KV engine).

Additionally, it demonstrates the use of an integrity check by storing a
basic hashCode in the referencePayload as well.

* Wire in UserSecretsManager to createCatalog and federated Iceberg API handlers

Update the internal DPOs corresponding to the various ConnectionConfigInfo API objects
to no longer contain any possible fields for inline secrets, instead holding the
JSON-serializable UserSecretReference corresponding to external/offloaded secrets.

CreateCatalog for federated catalogs containing secrets will now first extract
UserSecretReferences from the CreateCatalogRequest, and the CatalogEntity will
populate the DPOs corresponding to ConnectionConfigInfos in a secondary pass
by pulling out the relevant extracted UserSecretReferences.

For federated catalog requests, when reconstituting the actual sensitive
secret configs, the UserSecretsManager will be used to obtain the secrets
by using the stored UserSecretReferences.

Remove vestigial internal properties from earlier prototypes.

* Since we already use commons-codec DigestUtils.sha256Hex, use that for the hash in UnsafeInMemorySecretsManager
just for consistency and to illustrate a typical scenario using a cryptographic hash.

* Rename the persistence-objects corresponding to API model objects with a new naming
convention that just takes the API model object name and appends "Dpo" as a suffix;

* Use UserSecretsManagerFactory to Produce the UserSecretsManager (#1)

* Move PolarisAuthenticationParameters to a top-level property according to the latest spec

* Create a Factory for UserSecretsManager

* Fix a typo in UnsafeInMemorySecretsManagerFactory

* Gate all federation logic behind a new FeatureConfiguration - ENABLE_CATALOG_FEDERATION

* Also rename some variables and method names to be consistent with prior rename to ConnectionConfigInfoDpo

* Change ConnectionType and AuthenticationType to be stored as int codes in persistence objects.

Address PR feedback for various nits and javadoc comments.

* Add javadoc comment to IcebergCatalogPropertiesProvider

* Add some constraints on the expected format of the URN in UserSecretReference and placeholders
for next steps where we'd provide a ResolvingUserSecretsManager for example if the runtime ever
needs to delegate to two different implementations of UserSecretsManager for different entities.

Reduce the `forEntity` argument to just PolarisEntityCore to make it more clear that the
implementation is supposed to extract the necessary identifier info from forEntity for
backend cleanup and tracking purposes.

---------

Co-authored-by: Rulin Xing <[email protected]>
Co-authored-by: Rulin Xing <[email protected]>

* Add Adnan and Neelesh to collaborators list (apache#1396)

* Replace authentication filters with Quarkus Security (apache#1373)

* Implement PolicyCatalogHandler and Add Policy Privileges Stage 1: CRUD + ListPolicies (apache#1357)

* Add PolicyCatalogHandler and tests

* Fix style

* Address review comments

* Address review comments 2

* fix nit

* Remove CallContext.getAuthenticatedPrincipal() (apache#1400)

* main: Update dependency info.picocli:picocli-codegen to v4.7.7 (apache#1408)

* main: Update dependency com.google.errorprone:error_prone_core to v2.38.0 (apache#1404)

* Add Polaris Community Meeting 2025-04-17 (apache#1409)

* main: Update dependency boto3 to v1.37.37 (apache#1412)

* EclipseLink: add PrimaryKey to policy mapping records JPA model (apache#1403)

* Re-instate dependencies between Docker Compose services (apache#1407)

* Do not rotate bootstrapped root credentials (apache#1414)

* Add Getting Started Button to the Apache Polaris Webshite Homepage (apache#1406)

* Core: change to return ApplicablePolicies (apache#1415)

* Rename the Snapshot Retention policy (apache#1284)

* Rename the Snapshot Retention policy

* Resolve comments

* Resolve comments

---------

Co-authored-by: Yufei Gu <yufei.apache.org>

* main: Update dependency com.adobe.testing:s3mock-testcontainers to v4.1.0 (apache#1419)

* rename snapshotRetention to snashotExpiry (apache#1420)

* main: Update registry.access.redhat.com/ubi9/openjdk-21-runtime Docker tag to v1.22-1.1744796716 (apache#1394)

* main: Update dependency software.amazon.awssdk:bom to v2.31.26 (apache#1413)

* main: Update dependency com.adobe.testing:s3mock-testcontainers to v4.1.1 (apache#1425)

* Fix releaseEmailTemplate task (apache#1384)

* Update distributions LICENSE and NOTICE with AWS SDK 2.31.26 update (apache#1423)

* Support snapshots=refs (apache#1405)

* initial commit

* autolint

* small revert

* rebase

* autolint

* simpler

* autolint

* tests

* autolint

* stable

* fix leak

* ready for review

* improved test

* autolint

* logic flip again

* Update service/common/src/main/java/org/apache/polaris/service/catalog/iceberg/IcebergCatalogHandler.java

Co-authored-by: Alexandre Dutra <[email protected]>

* Update integration-tests/src/main/java/org/apache/polaris/service/it/env/CatalogApi.java

Co-authored-by: Alexandre Dutra <[email protected]>

* adjustments for committed suggestions

* autolint

---------

Co-authored-by: Alexandre Dutra <[email protected]>

* Remove activatedPrincipalRoles property from AuthenticatedPolarisPrincipal (apache#1410)

This seems to be a leftover from when ActiveRolesProvider was introduced. The setter was still used, but the getter wasn't, which hints at the fact that this property can be safely removed.

As a bonus, AuthenticatedPolarisPrincipal now becomes immutable, which is imho a very good thing.

* Implement PolicyCatalogHandler and Add Policy Privileges Stage 2: AttachPolicy + DetachPolicy (apache#1416)

* add auth test for attach/detach

* apply formatter

* refactor authorizePolicyAttachmentOperation

* address comment

* better naming

* Ship eclipselink and PostgreSQL JDBC driver by default in Polaris distribution (apache#1411)

* Fix Connection Config DPOs (apache#1422)

* Fix connection config dpos

* Run spotlessApply

* Doc: Fix the issue that html tags are not working in Hugo (apache#1382)

* Implement PolicyCatalogHandler Stage 3: GetApplicablePolicies (apache#1421)

* [JDBC] Part2: Add Relational JDBC module (apache#1287)

* Bump version to 0.11.0-beta-incubating-SNAPSHOT (apache#1429)

* Make entity lookups by id honor the specified entity type (apache#1401)

* Make entity lookups by id honor the specified entity type

All implementations of `TransactionalPersistence.lookupEntityInCurrentTxn()` are currently ignoring the `typeCode` parameter completely and could potentially return an entity of the wrong type.

This can become very concerning during authentication, since a principal lookup could return some entity that is not a principal, and that would be considered a successful authentication.

* review

* Remove "test" Authenticator (apache#1399)

* Propagate SQLException as "caused by" (apache#1430)

* Remove logging for DbOps (apache#1433)

* Spark: Add regtests for Spark client to test built jars (apache#1402)

* main: Update dependency com.google.cloud:google-cloud-storage-bom to v2.51.0 (apache#1436)

* main: Update dependency org.testcontainers:testcontainers-bom to v1.21.0 (apache#1437)

* main: Update actions/setup-python digest to a26af69 (apache#1440)

* Spark-IT: use correct configurations (apache#1444)

... do not let Spark leak into Quarkus

* PolarisRestCatalogIntegrationTest: Always purge generic tables (apache#1443)

* Add missing Postgresql dependency (apache#1447)

* Add Request Timeouts  (apache#1431)

* add timeout

* add iceberg exception mapping

* dont use quarkus bom, disable timeout

* nits

* Fix sparks sql regtests with up to date config (apache#1454)

* Refactor BasePolarisTableOperations & BasePolarisViewOperations (apache#1426)

* initial copy paste

* Reorder

* view copy paste

* fixes, polish

* stable

* yank

* CODE_COPIED_TO_POLARIS comments

* autolint

* update license

* typofix

* update comments

* autolint

* Use .sha512 extension instead of -sha512 (apache#1449)

* main: Update dependency org.eclipse.microprofile.fault-tolerance:microprofile-fault-tolerance-api to v4.1.2 (apache#1451)

* Doc: Update Local Root Principal Credentials in Quickstart (apache#1452)

* Update the Getting Started Workflow with each Cloud Provider's Blob Storage (apache#1435)

* AWS First Draft

* Debug

* revert typo

* Add JQ to docker runtime

* Debug, pt2

* debug

* debug

* Allow Instance Profile Roles

* change random suffix

* change instance profile to regular IAM roles

* AWS Final Draft

* Azure First Draft

* debug

* Azure First Draft

* debug

* typo

* GCP First Try

* GCP Complete

* GCP Final

* add all jars to Spark

* refactor

* Implement PolicyCatalogAdapter (apache#1438)

* Generic Table/Policy Store: Move feature config check to Adapter and some small refactoring (apache#1465)

* update refs (apache#1464)

* [JDBC] Part3: Plumb JDBC module to Quarkus (apache#1371)

* Allow BasePolarisTableOperations to skip refreshing metadata after a commit (apache#1456)

* initial commit

* fix another test

* changes per comments

* visibility

* changes per review

* autolint

* oops

* main: Update dependency com.fasterxml.jackson:jackson-bom to v2.19.0 (apache#1455)

* Doc: Added set custom credentials instruction in README (apache#1461)

* Doc: Add policy documentation (apache#1460)

* main: Update dependency software.amazon.awssdk:bom to v2.31.30 (apache#1475)

* main: Update dependency gradle to v8.14 (apache#1459)

* main: Update dependency gradle to v8.14

* fix PR

---------

Co-authored-by: Robert Stupp <[email protected]>

* Remove unused class TokenInfoExchangeResponse (apache#1479)

This is an oversight from apache#1399.

* Upgrade Polaris to Iceberg 1.9.0 (apache#1309)

* Doc: Update on access-control policy docs (apache#1472)

* main: Update Quarkus Platform and Group (apache#1381)

* Added link to the Spark-Jupyter Notebook Getting Started from the main Getting Started Page (apache#1453)

* Added link to the Spark-Jupyter Notebook Getting Started from the main Quickstart page

* Typo

Co-authored-by: Eric Maynard <[email protected]>

* Suggestions as per @eric-maynard's review

* Fix Typo

---------

Co-authored-by: Eric Maynard <[email protected]>

* [JDBC] Support Policy (apache#1468)

* Refactor EntityCache into an interface (apache#1193)

* Refactor EntityCache to an interface

* fix

* spotless

* Remove unused PolarisCredentialVendor.validateAccessToLocations() (apache#1480)

* Remove unused PolarisCredentialVendor.validateAccessToLocations()

* review: remove ValidateAccessResult and comments

* Policy Store: Check whether Policy is in use before dropping and support `detach-all` flag (apache#1467)

* fix error (apache#1492)

* Ensure writeToPolicyMappingRecord update existing record if primary key equals in EclipseLink Persistence Impl (apache#1469)

* update PolicyMappingRecord if not exists

* update test

* add TODO

* Eliminate getCurrentContext() call in PolarisAuthorizerImpl (apache#1494)

* Add getting-started for Polaris Spark Client with Delta tables (apache#1488)

* Fix: Pull Postgres image automatically (apache#1495)

* Fix Outdated Information and add Information regarding `docker compose down` to Quickstart  (apache#1497)

* Fix Outdated Information and Add Information regarding docker compose down to Quickstart

* Revision 2

* Remove shutdown from README

* typo

* Upgrade Iceberg REST Spec to match Iceberg 1.8 (apache#1283)

* prep for review

* reset

* more changes

* fixes

* github action change

* another build change

* try api revert

* re-all

* custom type mappings, rebuild

* autolint

* polish

* yank custom types

* update

* autolint

* wip

* Revert build changes

* example

* autolint

* Fix FileIOExceptionsTest to conform to new Iceberg 1.8 API (apache#1501)

It looks like after apache#1283, this test no longer compiles as the Iceberg API has changed. I'm not sure how this wasn't caught by CI on that PR itself.

* JDBC: Optimize writeEntity calls (apache#1496)

* Remove transaction from atomic writes

* remove if-else

* main: Update registry.access.redhat.com/ubi9/openjdk-21-runtime Docker tag to v1.22-1.1745840590 (apache#1499)

* Support for external identity providers (apache#1397)

* JDBC: create objects without reflection (apache#1434)

* Include quarkus-container-image and README in the binary distributions (apache#1493)

* Site: Fix Management and Catalog Spec links (apache#1507)

* Lazy iteration over JDBC ResultSet (apache#1487)

* refactor

* autolint

* polish

* autolint

* changes per review

* autolint

* unwrapping caller

* changes per review

* Update distributions LICENSE and NOTICE with artifacts and versions sync (apache#1509)

* Avoid using deprecated `NestedField.of()` (apache#1514)

* Fix compile warning: unknown enum constant Id.NAME (apache#1513)

* Doc: Add getting started with JDBC source (apache#1470)

* Site: Add Polaris Spark client webpage under unreleased (apache#1503)

* fix merge error

* retrigger test

* Fix test failure (apache#1541)

* mitigate .snyk issue

* revert file in this pr

* add .snyk file

* retrigger

* move snyk file

* retrigger

* resolve conflict

* retrigger

* Revert "resolve conflict"

This reverts commit 5d6427150cab67aad7a4eca37142e87316f514fc.

* repick the change

---------

Co-authored-by: Dmitri Bourlatchkov <[email protected]>
Co-authored-by: danielhumanmod <[email protected]>
Co-authored-by: Mend Renovate <[email protected]>
Co-authored-by: JB Onofré <[email protected]>
Co-authored-by: Robert Stupp <[email protected]>
Co-authored-by: MonkeyCanCode <[email protected]>
Co-authored-by: Honah (Jonas) J. <[email protected]>
Co-authored-by: Eric Maynard <[email protected]>
Co-authored-by: Liam Bao <[email protected]>
Co-authored-by: Yufei Gu <[email protected]>
Co-authored-by: Alexandre Dutra <[email protected]>
Co-authored-by: Dennis Huo <[email protected]>
Co-authored-by: Travis Bowen <[email protected]>
Co-authored-by: Travis Bowen <[email protected]>
Co-authored-by: gh-yzou <[email protected]>
Co-authored-by: Mansehaj Singh <[email protected]>
Co-authored-by: Prashant Singh <[email protected]>
Co-authored-by: Juichang Lu <[email protected]>
Co-authored-by: David Lu <[email protected]>
Co-authored-by: gfakbar20 <[email protected]>
Co-authored-by: Adnan Hemani <[email protected]>
Co-authored-by: Adnan Hemani <[email protected]>
Co-authored-by: Neelesh Salian <[email protected]>
Co-authored-by: Rulin Xing <[email protected]>
Co-authored-by: Rulin Xing <[email protected]>
Co-authored-by: fabio-rizzo-01 <[email protected]>
Co-authored-by: Pierre Laporte <[email protected]>
Co-authored-by: Richard Liu <[email protected]>
Co-authored-by: Michael Collado <[email protected]>
Co-authored-by: Owen Lin (You-Cheng Lin) <[email protected]>
Co-authored-by: Eric Maynard <[email protected]>
Co-authored-by: Andrew Guterman <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants