Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add plots of bias and variance over time #302

Merged

Conversation

Damonamajor
Copy link
Contributor

@Damonamajor Damonamajor commented Dec 26, 2024

This takes the four charts from the recent presentation and replicates them in the performance report.

@Damonamajor Damonamajor linked an issue Dec 26, 2024 that may be closed by this pull request
4 tasks
@Damonamajor Damonamajor marked this pull request as ready for review December 26, 2024 23:06
Comment on lines 3 to 4
run_id: "2024-03-17-stupefied-maya"
year: "2024"
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

issue (blocking): It's fine to change this when testing, but let's not actually commit the changes here.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This was the baseline for 2025. I figured I would update it for this one. Do you want to leave it as 2024?

reports/performance/_model.qmd Show resolved Hide resolved
reports/performance/_model.qmd Outdated Show resolved Hide resolved
reports/performance/_model.qmd Outdated Show resolved Hide resolved
geom_line() +
geom_point() +
labs(
x = "Date",
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

suggestion: Let's make all the x-axis labels "Date" instead of "Month" (as below).


### Variance Ratio (FMV / Sale Price)

```{r _variance_ratio_chart}
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

suggestion: Be sure to disable message outputs from these chunks.

reports/performance/_model.qmd Show resolved Hide resolved
### Total FMV and Sale Price Variance
```{r _overall_variance_chart}
ggplot(
training_data_monthly_long %>% filter(Metric %in% c("variance_sale", "variance_fmv")),
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

suggestion: Let's run this through styler to fix long lines like this.

### Distribution of Sales and SSE

```{r _distribution_sales_sse_chart}
ggplot(training_data_monthly, aes(x = date)) +
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

suggestion: Let's flip the color scale on this one so sales are blue (and match the other plot with sales).

@Damonamajor Damonamajor requested a review from dfsnow January 2, 2025 00:31
Copy link
Member

@dfsnow dfsnow left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This looks set to go. Thanks @Damonamajor!

@dfsnow dfsnow merged commit cef253f into 2025-assessment-year Jan 2, 2025
4 checks passed
@dfsnow dfsnow deleted the 295-add-plots-of-bias-and-variance-over-time branch January 2, 2025 20:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add plots of bias and variance over time
2 participants