Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Consider incorporating datasets and config results from ZAP Benchmark #5

Open
Innixma opened this issue Apr 12, 2023 · 0 comments
Open

Comments

@Innixma
Copy link
Collaborator

Innixma commented Apr 12, 2023

Consider integrating the data and results from ZAP Benchmark: https://github.com/automl/zero-shot-automl-with-pretrained-models

  • We should be able to run SingleBestConfigScorer rather easily if we prepare the data properly
  • We could theoretically run the datasets on AutoGluon AutoMM and compare performance relative to what is recorded in ZAP.

Read their blog for more details: https://www.automl.org/4428-2/

@Innixma Innixma transferred this issue from Innixma/autogluon-zeroshot May 30, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant