Invalid value: "null" when field is removed from configuration and SSA is used to apply #103011
Description
What happened:
We are developing a new k8s controller and decided to use SSA completely. However, ran into an issue when I removed a field from the configuration. I have a custom resource with field called 'prop1' and it is not a required field (see snippet below). Using SSA, I created an object of this CR kind with 'prop1' specified and this was successful. I changed the configuration by removing 'prop1' and used the same code aka SSA to apply this configuration, but this time I received an error - Invalid value: "null": spec.prop1 in body must be of type object: "null".
...
prop1:
type: object
properties:
enabled:
type: boolean
required:
- enabled
...
What you expected to happen:
However, I was not expecting this error. I understand that 'prop1' is not nullable as per JSON schema, but then I didn't set it to null, I removed it from the configuration and ensured that field is not present in the request body. So, it seems that something in the API server sets it to null. And as per the documentation here, if I remove the field it is supposed to be deleted from the live object.
Can you please help me understand this behavior?
How to reproduce it (as minimally and precisely as possible):
Attached zip file containing testcrd.yaml, testcr1.yaml and testcr2.yaml
reproYaml.zip
$kubectl apply --server-side -f testcrd.yaml
customresourcedefinition.apiextensions.k8s.io/testones.example.com serverside-applied
$kubectl apply --server-side -f testcr1.yaml
testone.example.com/objectone serverside-applied
$kubectl apply --server-side -f testcr2.yaml
The TestOne "objectone" is invalid: spec.prop1: Invalid value: "null": spec.prop1 in body must be of type object: "null"
$kubectl describe testone objectone
Name: objectone
Namespace: default
Labels: <none>
Annotations: <none>
API Version: example.com/v1beta1
Kind: TestOne
Metadata:
Creation Timestamp: 2021-06-19T00:09:13Z
Generation: 1
Managed Fields:
API Version: example.com/v1beta1
Fields Type: FieldsV1
fieldsV1:
f:spec:
f:prop1:
f:enabled:
f:prop2:
f:enabled:
Manager: kubectl
Operation: Apply
Time: 2021-06-19T00:09:13Z
Resource Version: 27364718
Self Link: /apis/example.com/v1beta1/namespaces/default/testones/objectone
UID: 036de8a1-00fb-45e2-a675-ff1124470e04
Spec:
prop1:
Enabled: true
prop2:
Enabled: false
Events: <none>
Anything else we need to know?:
- Controller code is written in Java, though the above repro steps with kubectl seems to be equivalent
- The issue persists the same, though I remove the required from CRD
- CCA was NOT used
- Possibly related to Update sigs.k8s.io/structured-merge-diff to v4.0.3 #99014. If yes, which version of Kubernetes has the fix?
- Ofcourse, we can add 'nullable: true' to the CRD and it does help. However, I'm trying to understand where 'null' is coming from and also the documentation says that SSA is supposed to remove this field without erroring.
Environment:
-
Kubernetes version (use
kubectl version):
Client Version: version.Info{Major:"1", Minor:"20", GitVersion:"v1.20.4", GitCommit:"e87da0bd6e03ec3fea7933c4b5263d151aafd07c", GitTreeState:"clean", BuildDate:"2021-02-18T16:12:00Z", GoVersion:"go1.15.8", Compiler:"gc", Platform:"linux/amd64"}
Server Version: version.Info{Major:"1", Minor:"19", GitVersion:"v1.19.7", GitCommit:"8ab00ff68a1763b5a506a7073cb8e67b12dfbcd7", GitTreeState:"clean", BuildDate:"2021-03-10T23:40:01Z", GoVersion:"go1.15.5", Compiler:"gc", Platform:"linux/amd64"} -
Cloud provider or hardware configuration:
Azure Kubernetes Service -
OS (e.g:
cat /etc/os-release):
Ubuntu 18.04 -
Kernel (e.g.
uname -a): -
Install tools:
-
Network plugin and version (if this is a network-related bug):
-
Others: