Data Plane Dynamic Configuration

[mpstefan]

Is your enhancement request related to a problem? Please describe.
The NKG data plane will not have a method to manage configuration once the project has a custom nginx container. The NKG project needs a method to configure the data plane outside of the ConfigMap that exists today. Ideally, this configuration should be dynamic and any changes should prompt the data plane to change based on its contents.

What would you like to be added:
A method to dynamically update NKG data plane settings and initial options to configure tracing for NGF and upstream zone size.

Why this is needed:
So users have a method configure the nginx data plane without breaking NKG functionality.

Additional context
Discussion

[sjberman]

The initial version of this should be for supporting tracing configuration.

An initial proposal draft was written up here: #931, though was not focused specifically on tracing.

https://github.com/nginxinc/nginx-gateway-fabric/blob/main/docs/proposals/control-plane-config.md can also be used as a reference.

[mpstefan]

Does the initial proposal need to be updated to include tracing configuration as the first configurable option? The proposal will need to be moved to implementable before design can begin.

[sjberman]

I'd say we can start with tracing.