Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reduced performance of Iterative labeling on 2 datasets #3

Open
d8w opened this issue Nov 21, 2019 · 0 comments
Open

Reduced performance of Iterative labeling on 2 datasets #3

d8w opened this issue Nov 21, 2019 · 0 comments
Assignees

Comments

@d8w
Copy link
Contributor

d8w commented Nov 21, 2019

The two datasets are:

  • SEMI_1053_jm1 - score was0.571, now is 0.227
  • SEMI_1217_click_prediction_small  - score was 0.502, now is 0.016

Note that the latest scores are based off the new D3M core released on 11/10 with version number v2019.11.10. As a result, both the primitive and pipeline were migrated to match the new core. The change to the primitive is minor, i.e. bumping up the version number and updating a dependency. The change to the pipeline repo is quite a bit: .meta is replaced by .yaml, which is a pipeline run file.

Also note that the datasets are using version 4 schema, so all the datasets are updated. The change to the two datasets are minor though.

@d8w d8w assigned d8w and Xuth Nov 21, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants