Cache Updates and Memory Fixes

What's Changed

• Ignoring type warnings in test_data_conversions.py by @talvandaalen in #223
• Allow passing a title for get_data_X functions by @kyungeonchoi in #205
• Bug fix: use latest version of backoff by @gordonwatts in #230
• Clean up by @gordonwatts in #231
• In Memory Cache - Include Datatype by @gordonwatts in #232
• Analysis Query Cache Improvements by @gordonwatts in #234

New Contributors

• @talvandaalen made their first contribution in #223
• @kyungeonchoi made their first contribution in #205

Full Changelog: 2.4.4...2.5.0

Titles, Cache Fixes

This is mostly a maintanance release.

• Caching improvements. A bug was found where multiple, different, queries generated the seme cache key. That has been fixed. However, this could cause your queries to re-trigger. This condition was rare.
• A title argument is now possible in the calls to render a query (thanks @kyungeonchoi !)
• Code clean up should reduce the number of spurious warnings (thanks @talvandaalen !)

What's Changed

• Ignoring type warnings in test_data_conversions.py by @talvandaalen in #223
• Allow passing a title for get_data_X functions by @kyungeonchoi in #205
• Bug fix: use latest version of backoff by @gordonwatts in #230
• Clean up by @gordonwatts in #231
• In Memory Cache - Include Datatype by @gordonwatts in #232
• Analysis Query Cache Improvements by @gordonwatts in #234

New Contributors

• @talvandaalen made their first contribution in #223
• @kyungeonchoi made their first contribution in #205

Full Changelog: 2.4.4...2.5

Release 2.4.4

Allow python functions as selects

V 2.4.4-Alpha.1

Adds python function selects

Python 3.10 Support

Can now be installed in a python 3.10 environment

Add default CMS backend API end point

• Default servicex.yaml file now has a cms_run1_aod backend

Version 2.4.1

Providing the same max range for pyarrow as coffea

PyHEP Upgrade

Lots of things were fixed after trying to run against the 70 TB of data for CMS Run1.

• Supports Python 3.9
• Will now report supported return types (parquet, root)
• Long filenames are hashed in the local cache to avoid OS limitations
• A request tittle can be passed to services to "name" the transform
• Support lists of URLS or a single URL for a file source as well as the more traditional dataset identifiers
• Support deleting a single datafile or a query status file
• api_endpoints now have names not just types
• A local file can be written that matches query hashes with request id's, and can safely be checked into a repo in order to quickly re-use other people's queries.
• Better status updates during running and downloading, and support py widgets in vscode.

Bug fix: ignore title when calculating hash

• Make sure title is ignored when calculating hash - it makes no difference in the way the data is calculated

Dataset Name

• Add an "english" readable property to the servicex dataset that contains the name. This can be quite long, depending on the dataset.