3.1.0

What's Changed

• Delete a Transform by @BenGalewsky in #521
• Updated xaod_usage documentation URL in ServiceX_frontend docs. by @RogerJanusiak in #541
• Cleanup cli by @BenGalewsky in #536
• Add pre-commit to developer extras [DROPS PYTHON 3.8 SUPPORT] by @ponyisi in #531
• Full changes from pre-commit and black by @ponyisi in #545
• Address #543 (ruamel.yaml changes) by @ponyisi in #546
• ci: Update pypa/gh-action-pypi-publish to v1.12.3 by @matthewfeickert in #547

New Contributors

• @RogerJanusiak made their first contribution in #541

Full Changelog: 3.0.1...3.1.0

3.0.1 - Bug Fixes

Lots of small bug fixes and rounding out the user experience after the large 3.0 push. In general, operations should be smoother, and some edge cases where files weren't downloaded were fixed!

As usual, please submit bug reports to github!

 

What's Changed

• Update the download progress bar (both unsigned and dowload) when initial transform request doesn't return all files by @ketan96-m in #478
• Add retries for s3 interactions with tenacity by @ponyisi in #479
• ci: Fix file name error by @matthewfeickert in #483
• Prevent user passing nfiles=0 when creating a sample by @ponyisi in #485
• Cache Collision when the user ignores the cache and hash is present in the db Fix #375 by @ketan96-m in #482
• Add XRootD dataset identifier class by @ponyisi in #481
• expose OutputFormatEnum instead of ResultFormat to user by @ponyisi in #484
• Multiple samples submitted together updates the database only once #417 by @ketan96-m in #486
• Caching behavior of permutation fix #396 by @ketan96-m in #488
• Better handling of tokens near expiry by @ponyisi in #487
• docs: Note that ReadTheDocs is the user docs by @matthewfeickert in #491
• Expose Delivery enum by @ponyisi in #489
• Single Database instance -- Resume request when client fails fixes #468 by @ketan96-m in #497
• docs: Add conda-forge badge to README by @matthewfeickert in #500
• Add Python 3.13 to test matrix by @ponyisi in #495
• Validate multi samples fixes #499 by @ketan96-m in #501
• Bump release version to 3.0.1-alpha.1 by @ponyisi in #511
• New argument fail_if_incomplete to raise an exception if any files fail by @ponyisi in #516
• Final refresh of progress bars when transform is complete by @ponyisi in #504
• Add cli command to list datasets by @BenGalewsky in #517
• Add documentation on YAML features by @ponyisi in #509
• Improve docstrings for Pydantic models by @ponyisi in #505
• Require tree name to be set for FuncADLQuery_Uproot queries by @ponyisi in #512
• Require namespace in Rucio DIDs by @ponyisi in #513
• Improve handling of error codes from server by @ponyisi in #510
• Add a test to make sure that we raise an exception if there is no servicex config file by @ponyisi in #514
• Delete Dataset From CLI by @BenGalewsky in #519
• Add some documentation on errors by @ponyisi in #508
• Do a preflight authentication call by @ponyisi in #520
• Remove view source code button from documentation by @kyungeonchoi in #522
• Introduce example of app testing with patches by @ponyisi in #523
• Add precommit hooks by @ponyisi in #524
• Update About page of documentation by @kyungeonchoi in #526
• Small cleanups of unused code by @ponyisi in #515
• Check for return value on dataset delete by @BenGalewsky in #529
• Avoid race condition between status monitoring and download tasks by @ponyisi in #532
• Eliminate unnecessary URL options from the command line. by @BenGalewsky in #530

Full Changelog: 3.0.0...3.0.1

3.0.1 - Release Candidate 1

Cleaning up bugs and performance issues from the 3.0.0 release.

What's Changed

• Update the download progress bar (both unsigned and dowload) when initial transform request doesn't return all files by @ketan96-m in #478
• Add retries for s3 interactions with tenacity by @ponyisi in #479
• ci: Fix file name error by @matthewfeickert in #483
• Prevent user passing nfiles=0 when creating a sample by @ponyisi in #485
• Cache Collision when the user ignores the cache and hash is present in the db Fix #375 by @ketan96-m in #482
• Add XRootD dataset identifier class by @ponyisi in #481
• expose OutputFormatEnum instead of ResultFormat to user by @ponyisi in #484
• Multiple samples submitted together updates the database only once #417 by @ketan96-m in #486
• Caching behavior of permutation fix #396 by @ketan96-m in #488
• Better handling of tokens near expiry by @ponyisi in #487
• docs: Note that ReadTheDocs is the user docs by @matthewfeickert in #491
• Expose Delivery enum by @ponyisi in #489
• Single Database instance -- Resume request when client fails fixes #468 by @ketan96-m in #497
• docs: Add conda-forge badge to README by @matthewfeickert in #500
• Add Python 3.13 to test matrix by @ponyisi in #495
• Validate multi samples fixes #499 by @ketan96-m in #501
• Bump release version to 3.0.1-alpha.1 by @ponyisi in #511
• New argument fail_if_incomplete to raise an exception if any files fail by @ponyisi in #516
• Final refresh of progress bars when transform is complete by @ponyisi in #504
• Add cli command to list datasets by @BenGalewsky in #517
• Add documentation on YAML features by @ponyisi in #509
• Improve docstrings for Pydantic models by @ponyisi in #505
• Require tree name to be set for FuncADLQuery_Uproot queries by @ponyisi in #512
• Require namespace in Rucio DIDs by @ponyisi in #513
• Improve handling of error codes from server by @ponyisi in #510
• Add a test to make sure that we raise an exception if there is no servicex config file by @ponyisi in #514
• Delete Dataset From CLI by @BenGalewsky in #519
• Add some documentation on errors by @ponyisi in #508
• Do a preflight authentication call by @ponyisi in #520
• Remove view source code button from documentation by @kyungeonchoi in #522
• Introduce example of app testing with patches by @ponyisi in #523
• Add precommit hooks by @ponyisi in #524
• Update About page of documentation by @kyungeonchoi in #526
• Small cleanups of unused code by @ponyisi in #515

Full Changelog: 3.0.0...3.0.1-rc-1

3.0.0

ServiceX frontend client 3.0.0

This release features a new client interface compared to the v2 series of the frontend. Usage, examples, and API documentation can be found at https://servicex-frontend.readthedocs.io/en/3.0.0/ .

Release Candidate 2

New version of the release candidate:

• Major documentation updates
• Minor stability improvements mostly centered around some flakey behavior we see in the backend when running large transforms.

What's Changed

• Awkward 2.0 support in servicex 2.0 by @gordonwatts in #317
• Deal with empty and bad dataset names by @gordonwatts in #314
• Safeguard against VMS version numbers in tree names returned by uproot by @gordonwatts in #327
• Open with post-fix filename fails by @gordonwatts in #338
• Remove pandas restrictions by @gordonwatts in #358
• Add 3.0_develop CI to master branch (as github demands) by @ponyisi in #414
• Update production CI by @ponyisi in #415
• Badges on readme by @ketan96-m in #461
• ci: Use astral-sh/setup-uv action to setup uv by @matthewfeickert in #466
• Resolves the progress bar final count not updating by @ketan96-m in #470
• Quick Proofread by @gordonwatts in #472
• Add retries on the get request of get_transform_status function by @kyungeonchoi in #469

Full Changelog: 3.0.0-rc-1...3.0.0-rc-2

Release Candidate 1

This RC1 includes the following since beta 2:

• Major improvements to the documentation
• Some minor stability fixes to help with strange returns from minio and better looking marching ants as the transforms run.

What's Changed

• Runnable tests in sphinx documentation by @ketan96-m in #421
• ci: Deploy 'latest' docs using GitHub Actions by @matthewfeickert in #442
• docs: Use ReadTheDocs url for docs by @matthewfeickert in #441
• ci: Unify docs build around Makefile by @matthewfeickert in #443
• Readthedocs with pyproject.toml by @ketan96-m in #457
• Examples for xAOD by @gordonwatts in #455
• Fix minio handling of buckets in rare cases by @ponyisi in #458
• Fix for colors with multiple progress bars by @ponyisi in #459
• Overhaul of ServiceX Docs for 3.0 release by @BenGalewsky in #444
• docs: Fix typo by @matthewfeickert in #460
• docs: Add sphinx-copybutton support by @matthewfeickert in #463

Full Changelog: 3.0.0-beta-1...3.0.0-rc-1

3.0.0-beta-2 - Minor stability imporvement when accessing a minio bucket.

A bunch of documentation changes, and a fix to how we access minio - making it a bit more robust. This prevents a race condition we were seeing making the minio data temporarily invalid.

What's Changed

• Runnable tests in sphinx documentation by @ketan96-m in #421
• ci: Deploy 'latest' docs using GitHub Actions by @matthewfeickert in #442
• docs: Use ReadTheDocs url for docs by @matthewfeickert in #441
• ci: Unify docs build around Makefile by @matthewfeickert in #443

Full Changelog: 3.0.0-beta-1...3.0.0-beta-2

3.0.0-beta-1

What's Changed

• Minor spelling, syntax, type changes by @gordonwatts in #269
• Typed FuncADL Datasets by @gordonwatts in #270
• Safe Downloaded Filenames by @gordonwatts in #271
• Robust sync async routines by @gordonwatts in #272
• Short Filenames by @gordonwatts in #273
• Fix removed type info by @gordonwatts in #276
• Change package name to servicex and make the imports easier by @BenGalewsky in #277
• Accept both .servicex and servicex.yaml config files by @talvandaalen in #298
• Correctly report not being able to find config file from path by @BenGalewsky in #299
• Handle missing cache_dir and expand bengal1 in path by @BenGalewsky in #300
• Dataset groups Revisted by @BenGalewsky in #301
• Clean up typer help messages by @BenGalewsky in #302
• Set Tree Operation by @BenGalewsky in #309
• Add operation to set the title of a dataset by @BenGalewsky in #310
• Find eventdataset by @BenGalewsky in #311
• Add a cache for the code generators by @prajwalkkumar in #305
• Agc fixes by @BenGalewsky in #315
• Change name of root-file result format by @BenGalewsky in #321
• Unittests for dataset.py by @prajwalkkumar in #323
• Add more tests to query_cache.py by @prajwalkkumar in #325
• Match the root file result format in the generated json to the expected value in the service by @BenGalewsky in #324
• Compress Progress bars to a single bar for dataset groups by @prajwalkkumar in #328
• Ignore workflow property in transform request object by @BenGalewsky in #334
• First DataBinder integration by @kyungeonchoi in #333
• Add test and typing for python functions as strings by @BenGalewsky in #336
• Update examples for servicex backend v1.3.2 by @kyungeonchoi in #339
• Databindereatstheworld by @BenGalewsky in #340
• feat: Use hatchling as the build backend by @matthewfeickert in #349
• fix: Add CLI entrypoint by @matthewfeickert in #350
• ci: Use trusted publishers for publishing to PyPI by @matthewfeickert in #353
• build: Remove nest-asyncio from core dependencies by @matthewfeickert in #356
• Multiple xrootdfiles by @BenGalewsky in #359
• build: Update typer lower bound to v0.12.1 by @matthewfeickert in #364
• ci: Use uv for all pip installs by @matthewfeickert in #365
• Process Transform Title and Log URL by @BenGalewsky in #366
• Allow timeout for transform submission by @gordonwatts in #369
• Upgrade to pydantic2 by @BenGalewsky in #368
• Use logging library for status updates by @gordonwatts in #371
• Handle unknown status code being returned in submission by @ponyisi in #372
• Add timeout to transform status by @gordonwatts in #374
• Properly display error from transform by @gordonwatts in #378
• Further clean up of error messages by @gordonwatts in #379
• Fix default progress bar for SignedURL by @kyungeonchoi in #380
• 3.0 Client Documentation by @ketan96-m in #377
• UprootRaw support for 3.0 client by @ponyisi in #381
• Restrict coverage stats by @ponyisi in #388
• Eliminate Pydantic warnings in tests by @ponyisi in #391
• Add some documentation on codegens by @ponyisi in #389
• Defaults for uproot-raw model by @ponyisi in #393
• Add "Pending lookup" status to enum by @ponyisi in #392
• Readthedocs deployement .yaml and requirements.txt files by @ketan96-m in #394
• Refactoring DataBinder YAML interfaces by @ponyisi in #386
• Properly handle transform cancellation. Fix tests by @ponyisi in #387
• Update miniopy-async to 1.20 by @ponyisi in #400
• General.ServiceX as an optional field by @kyungeonchoi in #402
• Fix status code enum by @ponyisi in #399
• Bump up miniopy-async version to 1.20.1 by @kyungeonchoi in #404
• Logging Kibana URL for transformers with failures by @ketan96-m in #403
• Remove databinder directory by @kyungeonchoi in #401
• Import query classes into servicex.query by @ponyisi in #405
• Add dataset keyword by @ponyisi in #406
• Coverage report to check the contexts under which the code was run by @ketan96-m in #409
• Add CI for scheduled tests of client + server by @ponyisi in #411
• Don't add failed results to cache by @ponyisi in #407
• Progress bar fresh changes color on completion and failure #397 by @ketan96-m in #408
• Cleanup servicex namespace by @ponyisi in #412
• Fix for function indentation in Python transformer by @ponyisi in #419
• Fix disappearing sample title by @kyungeonchoi in #420
• Refactor query class inheritance by @ponyisi in #410
• Display the tranform request id on failure by @ketan96-m in #422
• Use "guard list" for deliver() by @ponyisi in #413
• Fix Sample option NFiles for Dataset by @kyungeonchoi in #425
• Truncate sample name to 128 characters by @kyungeonchoi in #427
• Remove unnecessary method forwarding by @ponyisi in #416
• Robust HTTP connection by @kyungeonchoi in #426
• Change names following #362 by @ponyisi in #435
• Reduce library dependencies (addresses #432) by @ponyisi in #436
• Fix timeout configuration by @kyungeonchoi in #438
• Improve GuardList traceback handling by @ponyisi in #437
• Avoid minio connection if cache is sufficient by @ponyisi in #439
• Add lock to tinydb by @BenGalewsky in #440

New Contributors

• @prajwalkkumar made their first contribution in #305

Full Changelog: v2.8.0...3.0.0-beta-1

3.0.0-alpha.19

What's Changed

• Coverage report to check the contexts under which the code was run by @ketan96-m in #409
• Add CI for scheduled tests of client + server by @ponyisi in #411
• Don't add failed results to cache by @ponyisi in #407
• Progress bar fresh changes color on completion and failure #397 by @ketan96-m in #408
• Cleanup servicex namespace by @ponyisi in #412
• Fix for function indentation in Python transformer by @ponyisi in #419
• Fix disappearing sample title by @kyungeonchoi in #420
• Refactor query class inheritance by @ponyisi in #410

Full Changelog: 3.0.0-alpha.18...3.0.0-alpha.19

3.0.0-alpha.18

What's Changed

• Properly display error from transform by @gordonwatts in #378
• Further clean up of error messages by @gordonwatts in #379
• Fix default progress bar for SignedURL by @kyungeonchoi in #380
• 3.0 Client Documentation by @ketan96-m in #377
• UprootRaw support for 3.0 client by @ponyisi in #381
• Restrict coverage stats by @ponyisi in #388
• Eliminate Pydantic warnings in tests by @ponyisi in #391
• Add some documentation on codegens by @ponyisi in #389
• Defaults for uproot-raw model by @ponyisi in #393
• Add "Pending lookup" status to enum by @ponyisi in #392
• Readthedocs deployement .yaml and requirements.txt files by @ketan96-m in #394
• Refactoring DataBinder YAML interfaces by @ponyisi in #386
• Properly handle transform cancellation. Fix tests by @ponyisi in #387
• Update miniopy-async to 1.20 by @ponyisi in #400
• General.ServiceX as an optional field by @kyungeonchoi in #402
• Fix status code enum by @ponyisi in #399
• Bump up miniopy-async version to 1.20.1 by @kyungeonchoi in #404
• Logging Kibana URL for transformers with failures by @ketan96-m in #403
• Remove databinder directory by @kyungeonchoi in #401
• Import query classes into servicex.query by @ponyisi in #405
• Add dataset keyword by @ponyisi in #406

Full Changelog: 3.0.0-alpha.17...3.0.0-alpha.18