Generated secret name doesn't match k8s regex

[ash211]

Running this spark-submit command:

./bin/spark-submit \
--deploy-mode cluster \
--class org.apache.spark.examples.SparkPi \
--master k8s://10.0.20.108:6443 \
--conf spark.executor.instances=5 \
--conf spark.kubernetes.driver.docker.image=$DRIVER_IMAGE \
--conf spark.kubernetes.executor.docker.image=$EXECUTOR_IMAGE \
--conf spark.kubernetes.submit.caCertFile=mycert.cert \
./examples/jars/spark-examples_2.11-2.2.0-SNAPSHOT.jar 1000

fails with this exception:

Exception in thread "main" io.fabric8.kubernetes.client.KubernetesClientException: Failure executing: POST at: https://10.0.20.108:6443/api/v1/namespaces/default/secrets. Message: Secret "spark-submission-server-secret-org.apache.spark.examples.SparkPi-1485304544199" is invalid: metadata.name: Invalid value: "spark-submission-server-secret-org.apache.spark.examples.SparkPi-1485304544199": must match the regex [a-z0-9]([-a-z0-9]*[a-z0-9])?(\.[a-z0-9]([-a-z0-9]*[a-z0-9])?)* (e.g. 'example.com'). Received status: Status(apiVersion=v1, code=422, details=StatusDetails(causes=[StatusCause(field=metadata.name, message=Invalid value: "spark-submission-server-secret-org.apache.spark.examples.SparkPi-1485304544199": must match the regex [a-z0-9]([-a-z0-9]*[a-z0-9])?(\.[a-z0-9]([-a-z0-9]*[a-z0-9])?)* (e.g. 'example.com'), reason=FieldValueInvalid, additionalProperties={})], group=null, kind=Secret, name=spark-submission-server-secret-org.apache.spark.examples.SparkPi-1485304544199, retryAfterSeconds=null, additionalProperties={}), kind=Status, message=Secret "spark-submission-server-secret-org.apache.spark.examples.SparkPi-1485304544199" is invalid: metadata.name: Invalid value: "spark-submission-server-secret-org.apache.spark.examples.SparkPi-1485304544199": must match the regex [a-z0-9]([-a-z0-9]*[a-z0-9])?(\.[a-z0-9]([-a-z0-9]*[a-z0-9])?)* (e.g. 'example.com'), metadata=ListMeta(resourceVersion=null, selfLink=null, additionalProperties={}), reason=Invalid, status=Failure, additionalProperties={}).

I can workaround by setting a spark.app.name like:

--conf spark.app.name=aash-sparkpi \

The generated secret names should match the k8s regex

[ash211]

The problem is the capital letters in spark-submission-server-secret-org.apache.spark.examples.SparkPi-1485304544199 aren't permitted by the regex [a-z0-9]([-a-z0-9]*[a-z0-9])?(\.[a-z0-9]([-a-z0-9]*[a-z0-9])?)*

The same problem exists with the service name derived from the kubernetes app id:

Exception in thread "main" io.fabric8.kubernetes.client.KubernetesClientException: Failure executing: POST at: https://10.0.20.108:6443/api/v1/namespaces/default/services. Message: Service "org.apache.spark.examples.SparkPi-1485332743824" is invalid: metadata.name: Invalid value: "org.apache.spark.examples.SparkPi-1485332743824": must match the regex [a-z]([-a-z0-9]*[a-z0-9])? (e.g. 'my-name' or 'abc-123'). Received status: Status(apiVersion=v1, code=422, details=StatusDetails(causes=[StatusCause(field=metadata.name, message=Invalid value: "org.apache.spark.examples.SparkPi-1485332743824": must match the regex [a-z]([-a-z0-9]*[a-z0-9])? (e.g. 'my-name' or 'abc-123'), reason=FieldValueInvalid, additionalProperties={})], group=null, kind=Service, name=org.apache.spark.examples.SparkPi-1485332743824, retryAfterSeconds=null, additionalProperties={}), kind=Status, message=Service "org.apache.spark.examples.SparkPi-1485332743824" is invalid: metadata.name: Invalid value: "org.apache.spark.examples.SparkPi-1485332743824": must match the regex [a-z]([-a-z0-9]*[a-z0-9])? (e.g. 'my-name' or 'abc-123'), metadata=ListMeta(resourceVersion=null, selfLink=null, additionalProperties={}), reason=Invalid, status=Failure, additionalProperties={}).

So we just need to lowercase these strings before sending to k8s