Skip to content

Commit

Permalink
update readme
Browse files Browse the repository at this point in the history
  • Loading branch information
samsja committed Nov 12, 2024
1 parent df018fe commit 6386027
Showing 1 changed file with 25 additions and 4 deletions.
29 changes: 25 additions & 4 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -38,14 +38,20 @@ A research paper about the framework and our INTELLECT-1 10B experiment is comin

## Getting Started

1. Install `uv`:
1. Clone:

```bash
git clone [email protected]:PrimeIntellect-ai/prime.git
```

2. Install `uv`:

```bash
curl -LsSf https://astral.sh/uv/install.sh | sh
source $HOME/.local/bin/env
```

2. Set up the environment:
3. Set up the environment:
```bash
sudo apt install iperf -y
uv venv
Expand All @@ -55,12 +61,27 @@ uv pip install flash-attn --no-build-isolation
git submodule update --init --recursive
```

3. Log into Hugging Face:
prime uses gated models tokenizers [mistralai/Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1), [meta-llama/Llama-2-7b-hf](https://huggingface.co/meta-llama/Llama-2-7b-hf) and pulls the [C4:en](https://huggingface.co/datasets/allenai/c4) dataset subset. It is required to request access to the models then log into Hugging Face with a read token to begin training.

4. Log into Hugging Face:
```bash
huggingface-cli login
```

all steps:

```
git clone [email protected]:PrimeIntellect-ai/prime.git
cd prime
curl -LsSf https://astral.sh/uv/install.sh | sh
source $HOME/.local/bin/env
sudo apt install iperf -y
uv venv
source .venv/bin/activate
uv sync --extra all
uv pip install flash-attn --no-build-isolation
git submodule update --init --recursive
```


### Quick Check

Expand Down

0 comments on commit 6386027

Please sign in to comment.