Loading error

[DaniChinwendu]

Polaris version

0.11.0

Python Version

3.11

Operating System

Colab(windows)

Installation

pip

Description

2025-01-16 02:13:03.088 | WARNING  | polaris.dataset._base:zarr_root:179 - You're loading data from a remote location. If the dataset is small enough, consider caching the dataset first using CompetitionSpecification.cache() for more performant data access.
---------------------------------------------------------------------------
ClientError                               Traceback (most recent call last)
[/usr/local/lib/python3.11/dist-packages/polaris/hub/storage.py](https://localhost:8080/#) in handle_s3_errors()
     45     try:
---> 46         yield
     47     except ClientError as e:

15 frames
ClientError: An error occurred (NotImplemented) when calling the GetObject operation: Header 'x-amz-checksum-mode' with value 'ENABLED' not implemented

The above exception was the direct cause of the following exception:

S3StoreException                          Traceback (most recent call last)
    [... skipping hidden 1 frame]

[/usr/local/lib/python3.11/dist-packages/polaris/hub/storage.py](https://localhost:8080/#) in handle_s3_errors()
     50             raise S3StoreCredentialsExpiredException(f"Error in S3Store: Credentials expired: {e}") from e
     51         else:
---> 52             raise S3StoreException(f"Error in S3Store: {e}") from e
     53     except BotoCoreError as e:
     54         raise S3StoreException(f"Error in S3Store: {e}") from e

S3StoreException: Error in S3Store: An error occurred (NotImplemented) when calling the GetObject operation: Header 'x-amz-checksum-mode' with value 'ENABLED' not implemented

Steps to reproduce

from polaris.hub.client import PolarisHubClient
client = PolarisHubClient()
client.login()
import polaris as po

competition = po.load_competition(f"asap-discovery/{CHALLENGE}")

Additional output

No response

[jhud]

I'm also getting this error using CloudFlare object storage in a totally unrelated project, and I can't find this error anywhere else on the internet. Only change I have made is the upgrade from boto3 package version 1.35 to 1.36. It might be related to that.

[cwognum]

This may be related: boto/boto3#4392

[jstlaurent]

@cwognum : I'm looking into this. Should have a fix soon.

[jstlaurent]

Fix is merged. I'll tag a new release as soon as CI is done.