Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GHA for Kurtosis #7196

Closed
macfarla opened this issue Jun 11, 2024 · 6 comments
Closed

GHA for Kurtosis #7196

macfarla opened this issue Jun 11, 2024 · 6 comments
Assignees
Labels
devops DevOps related task testing

Comments

@macfarla
Copy link
Contributor

Simple GHA workflow to spin up a kurtosis network from a simple config

maybe nightly?
maybe need large runners?

@macfarla macfarla added devops DevOps related task testing labels Jun 11, 2024
@lucassaldanha
Copy link
Member

GHA reference: https://github.com/marketplace/actions/kurtosis-assertoor-github-action

@macfarla
Copy link
Contributor Author

@cdivitotawela
Copy link
Contributor

I had a look of both GitHub actions. Looks like this https://github.com/marketplace/actions/kurtosis-assertoor-github-action wait for the assertoo tests to complete. I will investigate this action see how we can adopt it.

@cdivitotawela
Copy link
Contributor

Executed Kurtosis with Assertoor in GitHub actions for different combinations. Tests were executed in a private repo with 16-core(64GB memory) GitHub runner.

  • Basic test run_lifecycle_test takes about 30min
  • Running all Assertoor tests takes over 6hrs
  • Running multiple client combinations besu+teku, geth+teku, nethermind+teku is possible and these runs simultaneously. However including all possible supported options failed the GitHub action. It could be a resource issue
  • In the PoC latest Teku image has been used. It is possible to specify any image using the Kurtosis argument file

Next steps

  • Discuss where Kurtosis can add value in the CI. Given running all tests take longer time, it may best to select specific tests to run in CI
  • May be running all tests could be helpful before a release

@macfarla
Copy link
Contributor Author

macfarla commented Oct 8, 2024

TODO

  • add to readme how to run the workflow
  • allow choosing a different repo - so we can test PR branches
  • see if we can run the pectra tests

@cdivitotawela
Copy link
Contributor

GHA created in the private repository https://github.com/Consensys/protocols-devnets This supports running Kurtosis with Ethereum package on Besu for specific tag/branch/sha. Currently supports Assertoor stability checks only. Could add more Assertoor tests as required.

Adding Pectra tests will be handled in a separate issue

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
devops DevOps related task testing
Projects
None yet
Development

No branches or pull requests

3 participants