It's a minimalist application to test your LLM.
Change values inside src/settings.ts
to match your configuration.
Then :
npm i && npm run start
You can find an api example code at api_example/main.py
.
Framework used is raglight.
python main.py