Support for Apple silicon?

[mcdullmedia]

Description

I tried running this under MacOS and was having the following error, even cpu mode is being set.

CUDA SETUP: Required library version not found: libsbitsandbytes_cpu.so. Maybe you need to compile it from source?
CUDA SETUP: Defaulting to libbitsandbytes_cpu.so...
(zsh: illegal hardware instruction python server.py --cpu --model llamacpp-7b)

Additional Context

I was running it under a MacBook Air M2, thanks.

[ThatCoffeeGuy]

It seems there's a comment about the same here as well, might worth following this thread too:
#393

[github-actions]

This issue has been closed due to inactivity for 30 days. If you believe it is still relevant, please leave a comment below.