Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Develop satellite #182

Merged
merged 148 commits into from
Nov 20, 2023
Merged
Show file tree
Hide file tree
Changes from 115 commits
Commits
Show all changes
148 commits
Select commit Hold shift + click to select a range
f79aa1a
test
mlirenzhenmayi Oct 25, 2021
cfd8c19
back to track, end test
mlirenzhenmayi Oct 25, 2021
e285fbf
intialize to_generalize, daily tropomi no2 processing scripts
mlirenzhenmayi Oct 25, 2021
ae52aef
Merge pull request #26 from mlirenzhenmayi/develop_satellite
rschwant Oct 26, 2021
bc8c7be
Merge branch 'NOAA-CSL:develop_satellite' into develop_satellite
mebruckner Oct 26, 2021
96e349c
Merge branch 'develop' into develop_satellite
Oct 29, 2021
815a346
new readers
Nov 15, 2021
f25f4a1
Merge branch 'develop_satellite' of https://github.com/NOAA-CSL/MELOD…
Nov 15, 2021
d752f89
Merge branch 'NOAA-CSL-develop_satellite' into develop_satellite
Nov 15, 2021
efbc819
commit reader to new_monetio
Nov 15, 2021
34cc107
Delete melodies_monet/new_models directory
mebruckner Nov 15, 2021
e0a866d
Update driver.py
mebruckner Nov 15, 2021
2332d9c
Merge pull request #31 from mebruckner/develop_satellite
rrbuchholz Nov 16, 2021
3ab6368
moving omps examples
rrbuchholz Nov 17, 2021
38c97bc
adding MOPITT reader
rrbuchholz Nov 17, 2021
cdd5173
correcting typos
rrbuchholz Nov 18, 2021
19df499
name changes
rrbuchholz Nov 18, 2021
95cc3e7
add dictionary of variables
rrbuchholz Nov 18, 2021
f8bb3de
add try except
rrbuchholz Nov 18, 2021
100b567
Merge pull request #32 from rrbuchholz/develop_satellite
rrbuchholz Dec 2, 2021
5acb9e1
Start on run_modis_l2.py script, control_modis_l2.yaml for MODIS L2 d…
dwfncar Dec 5, 2021
8c1cef7
Added modis_l2 label in driver.observation.open_sat_obs.
dwfncar Dec 5, 2021
5cca0cb
In modis_l2.read_mfdataset, allow for environment variables, e.g. $HO…
dwfncar Dec 5, 2021
2fe6a8d
Added wrapper module for pyhdf.
dwfncar Dec 8, 2021
c7c15b8
Import hdfio methods in modis_l2.py.
dwfncar Dec 8, 2021
2a0e8bd
Read swath Latitude and Longitude arrays.
dwfncar Dec 8, 2021
6392d09
Call hdf_read for each variable in dictionary.
dwfncar Dec 8, 2021
1f913a6
Added unit_scale to modis_l2.py.
dwfncar Dec 8, 2021
c1a38f5
Return xr.Dataset granule from modis_l2.read_dataset.
dwfncar Dec 8, 2021
de450d8
Added debug config option within an observation block.
dwfncar Dec 9, 2021
dee312e
Set logging to DEBUG if debug flag is True in modis_l2 config block.
dwfncar Dec 9, 2021
9124477
Moved hdf wrapper lib to util subdir.
dwfncar Dec 30, 2021
bb38b04
Modified import path for hdfio.
dwfncar Dec 30, 2021
3c3aff5
Merge pull request #39 from NOAA-CSL/develop_swath
dwfncar Jan 7, 2022
6c6e4c5
Adding git ignores from develop branch.
dwfncar Feb 4, 2022
2c8c6dc
Removing doctree files from branch.
dwfncar Feb 7, 2022
f20de22
Merged develop into develop_satellite.
dwfncar Feb 7, 2022
da51435
Import modis_l2 from monetio.
dwfncar Mar 31, 2022
36c3b71
Use AOD_550_Dark_Target_Deep_Blue_Combined in example control file.
dwfncar Apr 1, 2022
fc19b08
Added xesmf and pyhdf requirements.
dwfncar Apr 3, 2022
f32869e
Start on utils.pair_obs. This will be moved to the analysis class as…
dwfncar Apr 3, 2022
a8b7c45
Start on utils.pair_obs. This will be moved to the analysis class as…
dwfncar Apr 3, 2022
25e4d2d
Added EarthCube short template.
dwfncar Apr 4, 2022
b015b32
Added header info.
dwfncar Apr 4, 2022
2fc8d32
Added technical contributions and methodology sections.
dwfncar Apr 4, 2022
ed579ac
Added pyhdf dependency to setup.py.
dwfncar Apr 7, 2022
3bc2957
moving files from new_monetio
Apr 14, 2022
0cc17e6
adding OMPS NM pairing tools to util
Apr 14, 2022
23d742b
driver changes to account for file location changes and new pairing code
Apr 14, 2022
c9cabab
dealing with merge issues
Apr 14, 2022
4152b75
Merge branch 'develop_satellite' of https://github.com/mebruckner/MEL…
Apr 14, 2022
ed489b1
driver fixes and new pairing code, moving monetio code, Satellite dif…
Apr 14, 2022
06596b1
Merge branch 'NOAA-CSL:develop_satellite' into develop_satellite
mebruckner Apr 14, 2022
399c95e
Update surfplots.py
mebruckner Apr 18, 2022
e08504b
Update surfplots.py
mebruckner Apr 18, 2022
72943cf
Update satellite_utilities.py
mebruckner Apr 18, 2022
5fa7b81
units fix
mebruckner Apr 18, 2022
ebaea09
reading tropomi l2 swath no2 data
May 12, 2022
333b659
Merge pull request #83 from mlirenzhenmayi/develop_satellite
dwfncar May 16, 2022
b43ba10
omps pairing with chunked processing
Jun 13, 2022
dd4c476
Merge branch 'develop_satellite' of https://github.com/mebruckner/MEL…
Jun 13, 2022
198d526
omps pairing with chunked processing
Jun 13, 2022
c84ae2a
Merge branch 'NOAA-CSL:develop_satellite' into develop_satellite
mebruckner Jun 13, 2022
46e46d3
Removed test model datafile.
davidfillmore Jul 7, 2022
4db5c3c
Added grid_swath file.
davidfillmore Jul 7, 2022
84283c5
Merge branch 'NOAA-CSL:develop_satellite' into develop_satellite
mebruckner Jul 19, 2022
e7764e0
driver changes
Jul 29, 2022
f5b894c
Merge branch 'develop_satellite' of https://github.com/mebruckner/MEL…
Jul 29, 2022
0a6fed3
Merge pull request #82 from mebruckner/develop_satellite
dwfncar Aug 2, 2022
19e523d
Updated doc strings.
dwfncar Aug 4, 2022
2627175
omps pairing and updates to plotting for xarray usage
Oct 20, 2022
db15c36
Adding MOPITT read via MONETIO
rrbuchholz Oct 25, 2022
593ee9d
initial attempt at time chunked pairing
Nov 3, 2022
b8d936d
Merge pull request #133 from rrbuchholz/develop_satellite
rrbuchholz Nov 4, 2022
927f2df
don't remember what I did. probably testing an attempt at time chunking
Nov 17, 2022
cfbaa55
Merge pull request #130 from mebruckner/develop_satellite
dwfncar Nov 18, 2022
c0d3c1f
Replacing develop_satellite surfplots.py with latest develop surfplot…
dwfncar Nov 18, 2022
d23a5d6
Removed surfplots.
davidfillmore Nov 18, 2022
dd3fa5a
Restored surfplots from develop branch.
davidfillmore Nov 18, 2022
1efe0bc
Removed surfplots.py.
davidfillmore Nov 18, 2022
b4b7a9f
Restored surfplots.py from develop branch.
davidfillmore Nov 18, 2022
3b5d387
Replacing setup.py with develop branch version.
davidfillmore Nov 18, 2022
fc4949a
Removing __init__.py in obsolet subdir, prior to develop merge.
davidfillmore Nov 18, 2022
cf4f6e9
Moving Monet-analysis-example-plots-cmaq-surf.ipynb to resolve merge …
davidfillmore Nov 18, 2022
aa96b5b
Adding satellite branch driver as separate file prior to develop -> d…
davidfillmore Nov 18, 2022
a6afe6e
Added driver file with develop_satellite (HEAD) and develop conflicts…
davidfillmore Nov 18, 2022
4b0f15e
Update develop -> develop_satellite driver merge conflicts.
davidfillmore Dec 5, 2022
a0f1442
Update util/__init__.py.
davidfillmore Dec 5, 2022
3f7f5b2
Added suggested conflict resolutions on ======= separator lines.
davidfillmore Dec 5, 2022
41c39e9
Removed file.
davidfillmore Dec 5, 2022
159645f
Merged develop -> develop_satellite.
dwfncar Jan 4, 2023
cae1c3e
Fixed a merge issue in open_sat_obs.
dwfncar Jan 26, 2023
eca2a3d
Update driver.py
mebruckner Feb 9, 2023
8c18f97
update satplots
mebruckner Feb 9, 2023
52be2c8
add documentation of apply_ak option
mebruckner Feb 9, 2023
4e2196d
Removed obsolete file. Gridding module is now grid_util.py.
dwfncar Feb 9, 2023
5e43797
Merge pull request #158 from mebruckner/develop_satellite
dwfncar Feb 9, 2023
7f3762c
fix local driver merge problems
Feb 10, 2023
35ced66
update reference for savefig in satplots
Feb 10, 2023
693eb5e
addition of omps level 3 pairing
Feb 13, 2023
f38c085
remove some things I was playing around with
Feb 13, 2023
8327863
Merge pull request #159 from mebruckner/develop_satellite
dwfncar Feb 23, 2023
2102555
New merge conflicts .
dwfncar Mar 23, 2023
3b46a70
Moved examples.
dwfncar Mar 23, 2023
1081bb5
Removed new_monetio subdir.
dwfncar Mar 23, 2023
f4e98b9
Added some conflict resolutions.
davidfillmore May 18, 2023
e1c0cb6
Modifications from scratch_for_merge_conflicts.
davidfillmore May 18, 2023
acf1273
saving working version of driver
Jun 1, 2023
c689271
fixed merge conflict
Jun 1, 2023
580cc9e
Merged develop to develop_satellite.
dwfncar Jun 1, 2023
b5f27e1
Removed new_monetio folder.
dwfncar Jun 1, 2023
e500452
Removed driver_sat.py file.
dwfncar Jun 1, 2023
eb6aa15
fixing open_sat_obs merge mistake
Jun 15, 2023
af0d8da
time-chunking implementation and various omps-nm pairing fixes
Jun 16, 2023
e29f9e9
Merge pull request #180 from mebruckner/develop_satellite
dwfncar Jun 19, 2023
582456a
edits made for using wisconsin aeromma wrf-chem files and airnow
Aug 5, 2023
ddf98c7
fixed some comments in driver and satellite_utilities
Aug 10, 2023
24254ba
removing personal copy commits didn't intend to share in pull to csl …
Aug 10, 2023
fb61b61
Merge pull request #186 from mebruckner/develop_satellite
dwfncar Aug 10, 2023
afe2e98
Update melodies_monet/driver.py
rrbuchholz Aug 10, 2023
a59624b
Update melodies_monet/driver.py
rrbuchholz Aug 10, 2023
cc5a5dd
Update examples/yaml/yaml/control_mopitt.yaml
rrbuchholz Aug 10, 2023
962cff8
Update driver.py
rrbuchholz Sep 7, 2023
8724813
Update driver.py
rrbuchholz Sep 7, 2023
9a2be08
Update driver.py
rrbuchholz Sep 7, 2023
a7d495b
Update driver.py
rrbuchholz Sep 7, 2023
8930abf
Update melodies_monet/util/time_interval_subset.py
rrbuchholz Sep 7, 2023
835d86e
Update driver.py
rrbuchholz Sep 7, 2023
b3c59cb
Update driver.py
rrbuchholz Sep 7, 2023
efc4585
Update driver.py
rrbuchholz Sep 7, 2023
eb9eeaf
Committing various changed to resolve PR comments.
dwfncar Sep 7, 2023
f21cee5
Update melodies_monet/driver.py
dwfncar Sep 7, 2023
19e1283
Added print warning if ozone_ppbv_varname list is longer than 1.
dwfncar Sep 7, 2023
92fc545
Removed yaml subdir.
dwfncar Sep 7, 2023
63d797e
Removed obsolete file.
dwfncar Sep 7, 2023
fcf5bb7
Restored calls to mask_and_scale and filter_obs in observation.open_obs.
dwfncar Sep 11, 2023
341d107
Restored observation.open_obs to develop branch version.
dwfncar Sep 11, 2023
61bc609
Fixed the docstring in open_sat_obs.
dwfncar Sep 26, 2023
601083b
Update driver.py
rrbuchholz Oct 5, 2023
33120bf
Update driver.py
rrbuchholz Oct 5, 2023
6ba312f
Update driver.py
rrbuchholz Oct 5, 2023
9285d53
Update driver.py
rrbuchholz Oct 5, 2023
0493213
Merge branch 'develop' into develop_satellite
dwfncar Oct 6, 2023
8689135
Added copyright headers.
dwfncar Oct 6, 2023
81eae19
Placed imports of xesmf in try except blocks.
dwfncar Oct 6, 2023
9de4ea4
Commenting assert line for now to see if CI tests will pass.
dwfncar Oct 23, 2023
5909ec8
Changed fill value back to -1 from -999.
davidfillmore Oct 23, 2023
e7b43e1
Merged develop to develop_satellite.
dwfncar Nov 2, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions docs/appendix/yaml.rst
Original file line number Diff line number Diff line change
Expand Up @@ -106,6 +106,10 @@ data (e.g., surf_only: True).
Typically this is set at the horizontal resolution of your model * 1.5. Setting
this to a smaller value will speed up the pairing process.

**apply_ak:** This is an optional argument used for pairing of satellite data. This
should be set to True when application of satellite averaging kernels or apriori data
to model observations is desired.

**mapping:** This is the mapping dictionary for all variables to be plotted.
For each observational dataset, add a mapping dictionary where the model
variable name is first (i.e., key) and the observation variable name is second
Expand Down
Loading