Policy Management in Polaris

[flyrain]

Policy management ensures secure, compliant, and efficient data access and usage by automating rules for governance, access control, and operational consistency. I propose Polaris functions as a policy store, managing policies alongside associated entities such as catalogs, namespaces, and tables. The evaluation and enforcement of these policies are delegated to computational engines, such as Spark, Snowflake, and others. This approach ensures a clear separation of responsibilities, allowing Polaris to focus on policy definition and storage while leveraging the processing capabilities of these engines for enforcement.

Design doc: https://docs.google.com/document/d/1kIiVkFFg9tPa5SH70b9WwzbmclrzH3qWHKfCKXw5lbs/edit?tab=t.0#heading=h.nly223xz13km

[benhuds]

Thanks @flyrain ! Can you please add the proposal tag to this as well just so it appears in the open proposals view?

https://github.com/apache/polaris/issues?q=is%3Aissue%20state%3Aopen%20label%3Aproposal

[HonahX]

Hi everyone, as noted in the dev list email, I have written a proposal detailing the implementation design for adding Policy Store support to Polaris:

https://docs.google.com/document/d/1PYnCw8T1lMQfJCa1VRjk9kWMKFPtg8O0YiZ7CEoGh3Y/edit?usp=sharing

Appreciate your time in reviewing the proposal and would love to hear your thoughts and feedback!

[flyrain]

Thanks @HonahX. It'd be nice to create a separated issue for that, so that we can track the progress in here, Policy management