brew services start does not set models

[codeinabox]

When I run brew services start tabbyml/tabby/tabby I am not able to get the clients to connect to the server. However, when I run tabby serve --device metal --model StarCoder-1B --chat-model Qwen2-1.5B-Instruct as per the documentation, it works fine.

Looking at the source code, the issue is that it is only running tabby serve --device metal, which does not set the models.

[zwpaper]

Hi @codeinabox, since there are various model options available, we do not have default models set.

Please follow the guide to create a configuration file, and then you should be all set to use the service.