diff --git a/README.md b/README.md index 39cb8f661..772a97eaa 100644 --- a/README.md +++ b/README.md @@ -4,6 +4,18 @@ Multilingual Analysis of LLMs for Clinical Observations Built using the PhEval runner template (see instructions below). +# Usage +Let us start by documenting how to run the current version in a new folder. This has to be changed! +```shell +poetry install +poetry shell +mkdir myinputdirectory +mkdir myoutputdirectory +cp -r /path/to/promptdir myinputdirectory/ +cp inputdir/config.yaml myinputdirectory +pheval run -i myinputdirectory -r "malcorunner" -o myoutputdirectory -t tests +``` + ## Template Runner for PhEval This serves as a template repository designed for crafting a personalised PhEval runner. Presently, the runner executes a mock predictor found in `src/pheval_template/run/fake_predictor.py`. Nevertheless, the primary objective is to leverage this repository as a starting point to develop your own runner for your tool, allowing you to customise and override existing methods effortlessly, given that it already encompasses all the necessary setup for integration with PhEval. There are exemplary methods throughout the runner to provide an idea on how things could be implemented.