Incorporate mistral.rs into swift MacOS app?

[kinchahoy]

Has anybody put together a set of swift bindings or a best practice guide on how to use mistral.rs inside a MacOS / iOS app? I've seen some reasonable ones for llama.cpp, but they tend to do a poor job of staying current with the package (and llama.cpp has poorer vision LLM support).

[simoncollins]

I haven't used it but it seems Mozilla's uniffi might be helpful here. It lets you generate bindings for several languages including Swift. It appears you need to either create an IDL for your interface or annotate the code with macros.

If you went this approach you'd probably want to create a Rust shim library with your application specific API and generate the bindings for that unless you need the full API of mistral.rs exposed.

There's a starter repo for iOS/Android which I assume will generalise to MacOS.

There's also a cargo plugin to create a Swift package that wraps your library.