-
Notifications
You must be signed in to change notification settings - Fork 1
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
fix ci: Set test coverage thresholds #84
Conversation
☂️ Python Coverage
Overall Coverage
New FilesNo new covered files... Modified FilesNo covered modified files...
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM with one thought that we might want to relax thresholdModified to 0 if I understand how it works correctly
@@ -56,3 +56,6 @@ jobs: | |||
sourceDir: app | |||
coverageFile: app/coverage_report.xml | |||
token: ${{ secrets.GITHUB_TOKEN }} | |||
thresholdAll: 0.8 | |||
thresholdNew: 0.9 | |||
thresholdModified: 0.8 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
thresholdModified: 0.8 | |
thresholdModified: 0.8 |
Is this file specific -- in other words, does this mean edits to a file with no pre-existing coverage will fail this check if the PR doesn't take coverage from 0 -> 80%?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
See #83 (comment)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I added an exclusion for app.py:
2f13d8e
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
So, I'd recommend that files with no pre-existing coverage be added to the omit
list rather than changing the threshold.
Ticket
Slack
Changes
Set test coverage thresholds.
The PR check will fail if thresholds aren't met.
Testing
Tested here: #83 (comment)
which now shows a red status.