Is there a requirements.txt ?

[nottherealsanta]

No description provided.

[sonu27]

This doesn't use Python dependencies

[holstvoogd]

@sonu27 It does need some pythn for the model processing with convert-pth-to-ggml.py

I had some issues installing torch, but managed to install it using the nighly build:

pip3.11 install torch numpy sentencepiece --index-url https://download.pytorch.org/whl/nightly/cpu

[sonu27]

@holstvoogd ah understood, according to this you need Python 3.10, due to the lack of a torch wheel for 3.11 - https://til.simonwillison.net/llms/llama-7b-m2

[holstvoogd]

Ah, that explains why I had issues :)