-
Notifications
You must be signed in to change notification settings - Fork 91
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
c-blosc upgrade 1.18.1 -> 1.21.0 #283
c-blosc upgrade 1.18.1 -> 1.21.0 #283
Conversation
When trying to run on my local machine I got the following error
|
This fixes the file not found snappy issue when compiling c-blosc 6df653b IDK - how this will play with other machines. |
@@ -79,7 +79,7 @@ def blosc_extension(): | |||
include_dirs += [d for d in glob('c-blosc/internal-complibs/*/*/*') | |||
if os.path.isdir(d)] | |||
define_macros += [('HAVE_LZ4', 1), | |||
('HAVE_SNAPPY', 1), | |||
# ('HAVE_SNAPPY', 1), |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yeah I don't think we want to skip using Snappy. Did this move somewhere else? Is there a path we need to update?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Hmm...looks like they dropped Snappy
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
# ('HAVE_SNAPPY', 1), | |
('HAVE_SNAPPY', 0), # Blosc 1.19.0+ dropped Snappy |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I'll make this change and see if installation still succeeds
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Confirming that it did not work with the above change #283 (comment) . I get the same error #283 (comment)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Just to confirm, that's with 0
and not 1
, correct? If so, that's really weird
Could you please try None
as well?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
yep set to 0. Yeah I can try None too.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yep same issue with None. I can dig into how the macro passes information to the c-blosc build process
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Oh it seems like @joshmoore started on this very same PR but stopped because of a call #259
Do we want to proceed with this change or go down another path?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@kindjacket: explaining the #259 / #274 decisions -- we discussed that on that call that spending our time on the pure python implementation was probably a bigger win. However, as you can see in my #274, that turned out to be more work than (I) expected.
At this point, I'm inclined to say we temporarily drop snappy in order to get M1 fixed and then re-evaluate once that's working with the options being continue on the #274 path, or to first work on getting snappy working with c-block 1.21+.
@zarr-developers/core-devs : any objections?
@kindjacket : looks like we have a 👍 from @jakirkham as well (#268), any thoughts on getting this ready to merge? |
Hello @kindjacket! Thanks for updating this PR. We checked the lines you've touched for PEP 8 issues, and found: There are currently no PEP 8 issues detected in this Pull Request. Cheers! 🍻 Comment last updated at 2021-08-18 09:31:52 UTC |
a33735c
to
cacaf05
Compare
cacaf05
to
fbe4d36
Compare
whew Starting to look greenish. Edit: |
Actually can we leave the fixture data (instead of deleting it)? We will want this when we add back snappy (somehow 🤔) |
Good point. I didn't realize at first that it was an ordered list etc. etc. so I thought deletion was the appropriate way forward. I'll resurrect. |
This reverts commit a84a166.
Any thoughts on version number with the drop of snappy? |
I'm taking that at least as no objections. |
Thanks Josh! 😄 Sorry had to drop 😴 Though happy to trust your judgement on versions 🙂 Raised issue ( #285 ) about readding Snappy |
np. A heads up that while testing zarr-developers/zarr-python#773 I'm pretty sure that this PR changed the checksum of chunks in the zarr_implementations test. |
c-blosc submodule upgrade 1.18.1 -> 1.21.0 to fix issue #269
TODO:
tox -e py39
passes locallytox -e docs
passes locally