Skip to content

Commit

Permalink
Add performance dashboards to PHI leaderboard pages (#157)
Browse files Browse the repository at this point in the history
  • Loading branch information
tschaffter authored Sep 13, 2021
1 parent 28e1977 commit e71c5bd
Show file tree
Hide file tree
Showing 5 changed files with 7 additions and 11 deletions.
2 changes: 1 addition & 1 deletion wiki/608039-DateAnnotationLeaderboard.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@

### Annotation Location

<!-- ${synapsetable?query=select id as "Submission Id"%2C createdOn as "CreatedOn"%2C submitterid as Submitter%2C tool%5F%5Fapi%5Fversion as "NLP Sandbox Version"%2C location%5FF1%5Ftoken%5Fstrict as "i2b2 Score"%2C MCW%5Flocation%5FF1%5Ftoken%5Fstrict as "MCW score"%2C tool%5F%5Fname as "Tool Name"%2C tool%5F%5Fversion as "Tool Version"%2C tool%5F%5Furl as "Tool URL"%2C tool%5F%5Fdescription as "Tool Description"%2C tool%5F%5Flicense as "License"%2C dockerrepositoryname as "Image"%2C dockerdigest as "Image Digest"%2C dataset%5Fname as "i2b2 dataset"%2C dataset%5Fversion as "i2b2 dataset version"%2C MCW%5Fdataset%5Fname as "MCW dataset name"%2C MCW%5Fdataset%5Fversion as "MCW dataset version" from syn23747126 where evaluationid %3D9614652 and status %3D %27ACCEPTED%27&showquery=false} -->
${preview?entityId=syn26165068}

${synapsetable?query=select id as "Submission Id"%2C createdOn as "CreatedOn"%2C submitterid as Submitter%2C tool%5F%5Fapi%5Fversion as "NLP Sandbox Version"%2C location%5FF1%5Ftoken%5Fstrict as "i2b2 Score"%2C MCW%5Flocation%5FF1%5Ftoken%5Fstrict as "MCW score"%2C tool%5F%5Fname as "Tool Name"%2C tool%5F%5Fversion as "Tool Version"%2C tool%5F%5Furl as "Tool URL"%2C tool%5F%5Fdescription as "Tool Description"%2C tool%5F%5Flicense as "License"%2C dockerrepositoryname as "Image"%2C dockerdigest as "Image Digest"%2C dataset%5Fname as "i2b2 dataset"%2C dataset%5Fversion as "i2b2 dataset version"%2C MCW%5Fdataset%5Fname as "MCW dataset name"%2C MCW%5Fdataset%5Fversion as "MCW dataset version" from syn23747126 where evaluationid %3D9614652 and status %3D %27ACCEPTED%27 and MCW%5Fsubmission%5Fstatus %3D %27SCORED%27&showquery=false}

Expand Down
2 changes: 1 addition & 1 deletion wiki/608040-PersonNameAnnotationLeaderboard.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@

### Annotation Location

<!-- ${synapsetable?query=select id as "Submission Id"%2C createdOn as "CreatedOn"%2C submitterid as Submitter%2C tool%5F%5Fapi%5Fversion as "NLP Sandbox Version"%2C location%5FF1%5Ftoken%5Fstrict as "i2b2 Score"%2C MCW%5Flocation%5FF1%5Ftoken%5Fstrict as "MCW score"%2C tool%5F%5Fname as "Tool Name"%2C tool%5F%5Fversion as "Tool Version"%2C tool%5F%5Furl as "Tool URL"%2C tool%5F%5Fdescription as "Tool Description"%2C tool%5F%5Flicense as "License"%2C dockerrepositoryname as "Image"%2C dockerdigest as "Image Digest"%2C dataset%5Fname as "i2b2 dataset"%2C dataset%5Fversion as "i2b2 dataset version"%2C MCW%5Fdataset%5Fname as "MCW dataset name"%2C MCW%5Fdataset%5Fversion as "MCW dataset version" from syn23747126 where evaluationid %3D9614657 and status %3D %27ACCEPTED%27&showquery=false} -->
${preview?entityId=syn26165069}

${synapsetable?query=select id as "Submission Id"%2C createdOn as "CreatedOn"%2C submitterid as Submitter%2C tool%5F%5Fapi%5Fversion as "NLP Sandbox Version"%2C location%5FF1%5Ftoken%5Fstrict as "i2b2 Score"%2C MCW%5Flocation%5FF1%5Ftoken%5Fstrict as "MCW score"%2C tool%5F%5Fname as "Tool Name"%2C tool%5F%5Fversion as "Tool Version"%2C tool%5F%5Furl as "Tool URL"%2C tool%5F%5Fdescription as "Tool Description"%2C tool%5F%5Flicense as "License"%2C dockerrepositoryname as "Image"%2C dockerdigest as "Image Digest"%2C dataset%5Fname as "i2b2 dataset"%2C dataset%5Fversion as "i2b2 dataset version"%2C MCW%5Fdataset%5Fname as "MCW dataset name"%2C MCW%5Fdataset%5Fversion as "MCW dataset version" from syn23747126 where evaluationid %3D9614657 and status %3D %27ACCEPTED%27 and MCW%5Fsubmission%5Fstatus %3D %27SCORED%27&showquery=false}

Expand Down
8 changes: 3 additions & 5 deletions wiki/608041-LocationAnnotationLeaderboard.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,15 +2,13 @@
{row}
{column width=12}

### Annotation Location and Type
<!-- ### Annotation Location and Type
<!-- ${synapsetable?query=select id as "Submission Id"%2C createdOn as "CreatedOn"%2C submitterid as Submitter%2C tool%5F%5Fapi%5Fversion as "NLP Sandbox Version"%2C type%5FF1 as "i2b2 Score"%2C MCW%5Ftype%5FF1 as "MCW Score"%2C tool%5F%5Fname as "Tool Name"%2C tool%5F%5Fversion as "Tool Version"%2C tool%5F%5Furl as "Tool URL"%2C tool%5F%5Fdescription as "Tool Description"%2C tool%5F%5Flicense as "License"%2C dockerrepositoryname as "Image"%2C dockerdigest as "Image Digest"%2C dataset%5Fname as "i2b2 dataset"%2C dataset%5Fversion as "i2b2 dataset version"%2C MCW%5Fdataset%5Fname as "MCW dataset name"%2C MCW%5Fdataset%5Fversion as "MCW dataset version" from syn23747126 where evaluationid %3D 9614658 and status %3D%27ACCEPTED%27 and type%5FF1 is not null&showquery=false} -->

${synapsetable?query=select id as "Submission Id"%2C createdOn as "CreatedOn"%2C submitterid as Submitter%2C tool%5F%5Fapi%5Fversion as "NLP Sandbox Version"%2C type%5FF1 as "i2b2 Score"%2C MCW%5Ftype%5FF1 as "MCW Score"%2C tool%5F%5Fname as "Tool Name"%2C tool%5F%5Fversion as "Tool Version"%2C tool%5F%5Furl as "Tool URL"%2C tool%5F%5Fdescription as "Tool Description"%2C tool%5F%5Flicense as "License"%2C dockerrepositoryname as "Image"%2C dockerdigest as "Image Digest"%2C dataset%5Fname as "i2b2 dataset"%2C dataset%5Fversion as "i2b2 dataset version"%2C MCW%5Fdataset%5Fname as "MCW dataset name"%2C MCW%5Fdataset%5Fversion as "MCW dataset version" from syn23747126 where evaluationid %3D 9614658 and status %3D%27ACCEPTED%27 and type%5FF1 is not null and MCW%5Fsubmission%5Fstatus %3D %27SCORED%27&showquery=false}
${synapsetable?query=select id as "Submission Id"%2C createdOn as "CreatedOn"%2C submitterid as Submitter%2C tool%5F%5Fapi%5Fversion as "NLP Sandbox Version"%2C type%5FF1 as "i2b2 Score"%2C MCW%5Ftype%5FF1 as "MCW Score"%2C tool%5F%5Fname as "Tool Name"%2C tool%5F%5Fversion as "Tool Version"%2C tool%5F%5Furl as "Tool URL"%2C tool%5F%5Fdescription as "Tool Description"%2C tool%5F%5Flicense as "License"%2C dockerrepositoryname as "Image"%2C dockerdigest as "Image Digest"%2C dataset%5Fname as "i2b2 dataset"%2C dataset%5Fversion as "i2b2 dataset version"%2C MCW%5Fdataset%5Fname as "MCW dataset name"%2C MCW%5Fdataset%5Fversion as "MCW dataset version" from syn23747126 where evaluationid %3D 9614658 and status %3D%27ACCEPTED%27 and type%5FF1 is not null and MCW%5Fsubmission%5Fstatus %3D %27SCORED%27&showquery=false} -->

### Annotation Location

<!-- ${synapsetable?query=select id as "Submission Id"%2C createdOn as "CreatedOn"%2C submitterid as Submitter%2C tool%5F%5Fapi%5Fversion as "NLP Sandbox Version"%2C location%5FF1%5Ftoken%5Fstrict as "i2b2 Score"%2C MCW%5Flocation%5FF1%5Ftoken%5Fstrict as "MCW score"%2C tool%5F%5Fname as "Tool Name"%2C tool%5F%5Fversion as "Tool Version"%2C tool%5F%5Furl as "Tool URL"%2C tool%5F%5Fdescription as "Tool Description"%2C tool%5F%5Flicense as "License"%2C dockerrepositoryname as "Image"%2C dockerdigest as "Image Digest"%2C dataset%5Fname as "i2b2 dataset"%2C dataset%5Fversion as "i2b2 dataset version"%2C MCW%5Fdataset%5Fname as "MCW dataset name"%2C MCW%5Fdataset%5Fversion as "MCW dataset version" from syn23747126 where evaluationid %3D9614658 and status %3D %27ACCEPTED%27&showquery=false} -->
${preview?entityId=syn26165072}

${synapsetable?query=select id as "Submission Id"%2C createdOn as "CreatedOn"%2C submitterid as Submitter%2C tool%5F%5Fapi%5Fversion as "NLP Sandbox Version"%2C location%5FF1%5Ftoken%5Fstrict as "i2b2 Score"%2C MCW%5Flocation%5FF1%5Ftoken%5Fstrict as "MCW score"%2C tool%5F%5Fname as "Tool Name"%2C tool%5F%5Fversion as "Tool Version"%2C tool%5F%5Furl as "Tool URL"%2C tool%5F%5Fdescription as "Tool Description"%2C tool%5F%5Flicense as "License"%2C dockerrepositoryname as "Image"%2C dockerdigest as "Image Digest"%2C dataset%5Fname as "i2b2 dataset"%2C dataset%5Fversion as "i2b2 dataset version"%2C MCW%5Fdataset%5Fname as "MCW dataset name"%2C MCW%5Fdataset%5Fversion as "MCW dataset version" from syn23747126 where evaluationid %3D9614658 and status %3D %27ACCEPTED%27 and MCW%5Fsubmission%5Fstatus %3D %27SCORED%27&showquery=false}

Expand Down
3 changes: 1 addition & 2 deletions wiki/611107-IdAnnotationLeaderboard.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@

### Annotation Location

<!-- ${synapsetable?query=select id as "Submission Id"%2C createdOn as "CreatedOn"%2C submitterid as Submitter%2C tool%5F%5Fapi%5Fversion as "NLP Sandbox Version"%2C location%5FF1%5Ftoken%5Fstrict as "i2b2 Score"%2C MCW%5Flocation%5FF1%5Ftoken%5Fstrict as "MCW score"%2C tool%5F%5Fname as "Tool Name"%2C tool%5F%5Fversion as "Tool Version"%2C tool%5F%5Furl as "Tool URL"%2C tool%5F%5Fdescription as "Tool Description"%2C tool%5F%5Flicense as "License"%2C dockerrepositoryname as "Image"%2C dockerdigest as "Image Digest"%2C dataset%5Fname as "i2b2 dataset"%2C dataset%5Fversion as "i2b2 dataset version"%2C MCW%5Fdataset%5Fname as "MCW dataset name"%2C MCW%5Fdataset%5Fversion as "MCW dataset version" from syn23747126 where evaluationid %3D9614803 and status %3D %27ACCEPTED%27&showquery=false} -->
${preview?entityId=syn26165071}

${synapsetable?query=select id as "Submission Id"%2C createdOn as "CreatedOn"%2C submitterid as Submitter%2C tool%5F%5Fapi%5Fversion as "NLP Sandbox Version"%2C location%5FF1%5Ftoken%5Fstrict as "i2b2 Score"%2C MCW%5Flocation%5FF1%5Ftoken%5Fstrict as "MCW score"%2C tool%5F%5Fname as "Tool Name"%2C tool%5F%5Fversion as "Tool Version"%2C tool%5F%5Furl as "Tool URL"%2C tool%5F%5Fdescription as "Tool Description"%2C tool%5F%5Flicense as "License"%2C dockerrepositoryname as "Image"%2C dockerdigest as "Image Digest"%2C dataset%5Fname as "i2b2 dataset"%2C dataset%5Fversion as "i2b2 dataset version"%2C MCW%5Fdataset%5Fname as "MCW dataset name"%2C MCW%5Fdataset%5Fversion as "MCW dataset version" from syn23747126 where evaluationid %3D9614797 and status %3D %27ACCEPTED%27 and MCW%5Fsubmission%5Fstatus %3D %27SCORED%27&showquery=false}

Expand All @@ -15,6 +15,5 @@ ${synapsetable?query=select id as "Submission Id"%2C createdOn as "CreatedOn"%2C
- Latest version of the MCW dataset: `mcwdataset-20210525`
- Score definition: `F1 Score (token level)`


{column}
{row}
3 changes: 1 addition & 2 deletions wiki/611108-ContactAnnotationLeaderboard.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,11 +4,10 @@

### Annotation Location

<!-- ${synapsetable?query=select id as "Submission Id"%2C createdOn as "CreatedOn"%2C submitterid as Submitter%2C tool%5F%5Fapi%5Fversion as "NLP Sandbox Version"%2C location%5FF1%5Ftoken%5Fstrict as "i2b2 Score"%2C MCW%5Flocation%5FF1%5Ftoken%5Fstrict as "MCW score"%2C tool%5F%5Fname as "Tool Name"%2C tool%5F%5Fversion as "Tool Version"%2C tool%5F%5Furl as "Tool URL"%2C tool%5F%5Fdescription as "Tool Description"%2C tool%5F%5Flicense as "License"%2C dockerrepositoryname as "Image"%2C dockerdigest as "Image Digest"%2C dataset%5Fname as "i2b2 dataset"%2C dataset%5Fversion as "i2b2 dataset version"%2C MCW%5Fdataset%5Fname as "MCW dataset name"%2C MCW%5Fdataset%5Fversion as "MCW dataset version" from syn23747126 where evaluationid %3D9614799 and status %3D %27ACCEPTED%27&showquery=false} -->
${preview?entityId=syn26165070}

${synapsetable?query=select id as "Submission Id"%2C createdOn as "CreatedOn"%2C submitterid as Submitter%2C tool%5F%5Fapi%5Fversion as "NLP Sandbox Version"%2C location%5FF1%5Ftoken%5Fstrict as "i2b2 Score"%2C MCW%5Flocation%5FF1%5Ftoken%5Fstrict as "MCW score"%2C tool%5F%5Fname as "Tool Name"%2C tool%5F%5Fversion as "Tool Version"%2C tool%5F%5Furl as "Tool URL"%2C tool%5F%5Fdescription as "Tool Description"%2C tool%5F%5Flicense as "License"%2C dockerrepositoryname as "Image"%2C dockerdigest as "Image Digest"%2C dataset%5Fname as "i2b2 dataset"%2C dataset%5Fversion as "i2b2 dataset version"%2C MCW%5Fdataset%5Fname as "MCW dataset name"%2C MCW%5Fdataset%5Fversion as "MCW dataset version" from syn23747126 where evaluationid %3D9614799 and status %3D %27ACCEPTED%27 and MCW%5Fsubmission%5Fstatus %3D %27SCORED%27&showquery=false}


### Additional Information

- Latest schema version: `1.2.0`
Expand Down

0 comments on commit e71c5bd

Please sign in to comment.