Skip to content

Conversation

@zwangsheng
Copy link
Contributor

Why are the changes needed?

Batch job should also submit with SPARK_USER_NAME.

See more in pre pr #3527 .

How was this patch tested?

  • Add some test cases that check the changes thoroughly including negative and positive cases if possible

  • Add screenshots for manual tests if appropriate

  • Run test locally before make a pull request

@zwangsheng
Copy link
Contributor Author

Seems CI fail not related to this, cc @pan3793. For this PR affect batch api, also cc @turboFei

@codecov-commenter
Copy link

codecov-commenter commented Oct 20, 2022

Codecov Report

Merging #3664 (76dee3e) into master (9d0b690) will increase coverage by 0.01%.
The diff coverage is 100.00%.

@@             Coverage Diff              @@
##             master    #3664      +/-   ##
============================================
+ Coverage     52.02%   52.03%   +0.01%     
  Complexity       13       13              
============================================
  Files           485      485              
  Lines         27202    27203       +1     
  Branches       3793     3793              
============================================
+ Hits          14151    14155       +4     
+ Misses        11685    11679       -6     
- Partials       1366     1369       +3     
Impacted Files Coverage Δ
...kyuubi/engine/spark/SparkBatchProcessBuilder.scala 96.96% <100.00%> (+0.09%) ⬆️
...ache/kyuubi/engine/spark/SparkProcessBuilder.scala 86.66% <100.00%> (ø)
...rg/apache/kyuubi/ctl/cmd/log/LogBatchCommand.scala 80.00% <0.00%> (-2.00%) ⬇️
...mon/src/main/scala/org/apache/kyuubi/Logging.scala 52.63% <0.00%> (-1.32%) ⬇️
...yuubi/server/metadata/jdbc/JDBCMetadataStore.scala 89.27% <0.00%> (-0.70%) ⬇️
...n/scala/org/apache/kyuubi/engine/ProcBuilder.scala 80.74% <0.00%> (-0.63%) ⬇️
...a/org/apache/kyuubi/service/TFrontendService.scala 91.17% <0.00%> (-0.30%) ⬇️
...in/scala/org/apache/kyuubi/config/KyuubiConf.scala 97.26% <0.00%> (-0.08%) ⬇️
...apache/kyuubi/engine/JpsApplicationOperation.scala 77.41% <0.00%> (ø)
...he/kyuubi/ha/client/etcd/EtcdDiscoveryClient.scala 66.87% <0.00%> (+0.62%) ⬆️
... and 3 more

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

@pan3793 pan3793 changed the title [SPARK][K8S][BATCH] Kyuubi submit batch with SPARK_USER_NAME when engine on kubernetes [SPARK][K8S][BATCH] Kyuubi should set env SPARK_USER_NAME on submitting Spark batch job to K8s Oct 20, 2022
@pan3793 pan3793 added this to the v1.6.1 milestone Oct 20, 2022
@pan3793
Copy link
Member

pan3793 commented Oct 20, 2022

Thanks, merging to master/1.6, also cc @cxzl25

@pan3793 pan3793 closed this in 5f8b57b Oct 20, 2022
pan3793 pushed a commit that referenced this pull request Oct 20, 2022
…AME on submitting Spark batch job to K8s

### _Why are the changes needed?_

Batch job should also submit with `SPARK_USER_NAME`.

See more in pre pr #3527 .

### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [ ] Add screenshots for manual tests if appropriate

- [x] [Run test](https://kyuubi.apache.org/docs/latest/develop_tools/testing.html#running-tests) locally before make a pull request

Closes #3664 from zwangsheng/feature/batch_with_user_name.

Closes #3664

76dee3e [zwangsheng] style
0d40508 [zwangsheng] fix
a1fcf7f [zwangsheng] fix

Authored-by: zwangsheng <[email protected]>
Signed-off-by: Cheng Pan <[email protected]>
(cherry picked from commit 5f8b57b)
Signed-off-by: Cheng Pan <[email protected]>
@cxzl25
Copy link
Contributor

cxzl25 commented Oct 20, 2022

+1, late LGTM.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants