Skip to content

Conversation

@GeorgeJahad
Copy link

@GeorgeJahad GeorgeJahad commented Feb 5, 2025

I've got a very rough version of the driver calling the armada client and running an executor.

Still has a lot of stuff hard coded that needs to be broken out into config parameters, but it works.

You can run it like so:

armadactl submit <SPARK-ROOT>/examples/spark-pi-driver.yaml

You'll need the latest client: richscott/armada@a08c3fc

@GeorgeJahad
Copy link
Author

You will need to build spark, and build and load the image:

./bin/docker-image-tool.sh -t testing build
kind load docker-image spark:testing --name armada

@ClifHouck ClifHouck merged commit 5d1fff1 into G-Research:clif/armada_integration Feb 7, 2025
2 of 4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants