Document how Polaris works with different cloud storage(S3, Azure Blob Storage, GCS).

[flyrain]

Is your feature request related to a problem? Please describe.

The topic was briefly mentioned in https://polaris.apache.org/in-dev/unreleased/configuration/ and https://polaris.apache.org/in-dev/unreleased/overview/#storage-configuration. They don't provide enough clear instruction how Polaris service provider to set them. Having a dedicated page with more detailed information will be helpful.

Describe the solution you'd like

No response

Describe alternatives you've considered

No response

Additional context

No response

[Abhijoyshirovmukherjee]

This is something necessary. Can anybody share any document or piece of how the polaris catalog would be integrated with the underlying storage to be queried with spark or flink.

Currently getting the following error while inserting or reading data from the iceberg table in blob using flink:
No File system for scheme: abfss

Note: Have tried to run it with spark with the same dependencies and it has worked for inserting but not for reading.

@flyrain @mr-nikhilgaikwad

[frHimanshu]

I'm up to submit a pr on this issue.

[adnanhemani]

@Abhijoyshirovmukherjee - can you confirm that this error is coming from Polaris and not the query engine itself? I've just put up a PR for this (#1435). Please feel free to take a look at how I've gotten this working for Spark and it may help you spot if there's anything that's missing.

[adnanhemani]

Given #1435 merged, should we close this @flyrain ?

[flyrain]

Per offline discussion with @adnanhemani, we will still need more doc on how different storage setup works.