Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove redundant check and call compareScenarios also for runs that converged but had INFES #102

Merged
merged 4 commits into from
May 23, 2024
Merged
Show file tree
Hide file tree
Changes from 3 commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .buildlibrary
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
ValidationKey: '4210320'
ValidationKey: '4231245'
AcceptedWarnings:
- 'Warning: package ''.*'' was built under R version'
- 'Warning: namespace ''.*'' is not available and has been replaced'
Expand Down
5 changes: 3 additions & 2 deletions CITATION.cff
Original file line number Diff line number Diff line change
Expand Up @@ -2,8 +2,8 @@ cff-version: 1.2.0
message: If you use this software, please cite it using the metadata from this file.
type: software
title: 'modelstats: Run Analysis Tools'
version: 0.21.2
date-released: '2024-05-17'
version: 0.21.3
date-released: '2024-05-22'
abstract: A collection of tools to analyze model runs.
authors:
- family-names: Giannousakis
Expand All @@ -12,5 +12,6 @@ authors:
- family-names: Richters
given-names: Oliver
license: LGPL-3.0
keywords: ~
repository-code: https://github.com/pik-piam/modelstats

4 changes: 2 additions & 2 deletions DESCRIPTION
Original file line number Diff line number Diff line change
@@ -1,8 +1,8 @@
Package: modelstats
Type: Package
Title: Run Analysis Tools
Version: 0.21.2
Date: 2024-05-17
Version: 0.21.3
Date: 2024-05-22
Authors@R: c(
person("Anastasis", "Giannousakis", email = "[email protected]", role = c("aut","cre")),
person("Oliver", "Richters", role = "aut")
Expand Down
16 changes: 4 additions & 12 deletions R/modeltests.R
Original file line number Diff line number Diff line change
Expand Up @@ -304,17 +304,7 @@ evaluateRuns <- function(model, mydir, gitPath, compScen, email, mattermostToken
system(paste("rsync -e ssh -av fulldata.gdx", gdxOnRseServer))
}
cfg <- NULL
# Question: is this check really useful? 'Conv' has been checked 4 lines above already.
# Doesn't this check exclude runs that have 'converged (had INFES)' and
# wouldn't it be useful to also produce compareScenarios for these? The existence of the mif file only
# matters later on after the runtime check when it comes to compareScenarios. So why testing for it here?
if (any(grepl(basename(getwd()), rownames(filter(gRS, .data$Conv == "converged", .data$Mif %in% c("yes", "sumErr")))))) {
load("config.Rdata")
} else {
setwd("../")
message("Skipping ", i, " and changed back to ", normalizePath("."))
next
}
load("config.Rdata")
sameRuns <- gRS %>% filter(.data$Conv %in% c("converged", "converged (had INFES)"), # runs have to be converged
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think a cs2 is useful even if the run did not converge, specifically because one would want to look at why it didn't.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm not sure which runs you are interested in. I assume you mean the ones that are feasible but didn't make it to 100 iterations (status "not_converged"), right? Because runs that are infeasible don't write a mif file, so no cs2 could be run.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Exactly, those with status not_converged

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done

.data$Mif %in% c("yes", "sumErr"), # need to have mifs
grepl(cfg$title, rownames(gRS)), # must be the same scenario
Expand Down Expand Up @@ -354,6 +344,8 @@ evaluateRuns <- function(model, mydir, gitPath, compScen, email, mattermostToken
}
setwd("../")
message("Finished analysis for ", i, " and changed back to ", normalizePath("."))
} else {
message(i, "does not seem to have converged. Skipping!")
}
}

Expand Down Expand Up @@ -404,7 +396,7 @@ evaluateRuns <- function(model, mydir, gitPath, compScen, email, mattermostToken
pull(.data$runname)

if (length(oldRuns) > 0) {
message("Moving ", length(oldRuns), " runs with ctime older than ", daysback, " days (", Sys.Date() - daysback,") to 'archive':")
message("Moving ", length(oldRuns), " runs with timestamp older than ", daysback, " days (", Sys.Date() - daysback,") to 'archive':")
print(oldRuns)
system(paste("mv", paste(oldRuns, collapse = " "), "archive"))
}
Expand Down
6 changes: 3 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Run Analysis Tools

R package **modelstats**, version **0.21.2**
R package **modelstats**, version **0.21.3**

[![CRAN status](https://www.r-pkg.org/badges/version/modelstats)](https://cran.r-project.org/package=modelstats) [![R build status](https://github.com/pik-piam/modelstats/workflows/check/badge.svg)](https://github.com/pik-piam/modelstats/actions) [![codecov](https://codecov.io/gh/pik-piam/modelstats/branch/master/graph/badge.svg)](https://app.codecov.io/gh/pik-piam/modelstats) [![r-universe](https://pik-piam.r-universe.dev/badges/modelstats)](https://pik-piam.r-universe.dev/builds)

Expand Down Expand Up @@ -47,7 +47,7 @@ In case of questions / problems please contact Anastasis Giannousakis <giannou@p

To cite package **modelstats** in publications use:

Giannousakis A, Richters O (2024). _modelstats: Run Analysis Tools_. R package version 0.21.2, <https://github.com/pik-piam/modelstats>.
Giannousakis A, Richters O (2024). _modelstats: Run Analysis Tools_. R package version 0.21.3, <https://github.com/pik-piam/modelstats>.

A BibTeX entry for LaTeX users is

Expand All @@ -56,7 +56,7 @@ A BibTeX entry for LaTeX users is
title = {modelstats: Run Analysis Tools},
author = {Anastasis Giannousakis and Oliver Richters},
year = {2024},
note = {R package version 0.21.2},
note = {R package version 0.21.3},
url = {https://github.com/pik-piam/modelstats},
}
```