Skip to content

"Illegal Instruction" error when converting 7B model to ggml FP16 format (Raspberry Pi 4, 8GB, Raspberry Pi OS, 64-bit) #401

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
lesp opened this issue Mar 22, 2023 · 1 comment
Labels
need more info The OP should provide more details about the issue

Comments

@lesp
Copy link

lesp commented Mar 22, 2023

Hello

I'm trying to replicate the process, using 7B on a Raspberry Pi 4 with 8GB of RAM.
I'm running the latest Raspberry Pi OS 64-bit, and all of the software has been updated.
I am following the guidance found in the Usage section of the README.md
I cloned the repo, downloaded 7B and placed it into /llama.cpp/models/7B, the contents of which are below

===7B Contents===

l-rw-r--r-- 1 les les  100 Mar 22 15:03 checklist.chk
-rw-r--r-- 1 les les  13G Mar 22 15:03 consolidated.00.pth
-rw-r--r-- 1 les les  101 Mar 22 15:04 params.json

===END of 7B Contents===

I have successfully installed all of the suggested Python modules.

When running this command python3 convert-pth-to-ggml.py models/7B/ 1 I see a short pause, around 5 -10 seconds. Then I receive an Illegal instruction error message and I can progress no more.

What am I doing wrong, and how can this be remedied?
I also tried Ubuntu 22.04 64-bit and the issue was the same.

Many thanks.

@gjmulder
Copy link
Collaborator

gjmulder commented Mar 22, 2023

Please review and use our issue template to provide more details so we can try and better understand your problem and attempt to answer you.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
need more info The OP should provide more details about the issue
Projects
None yet
Development

No branches or pull requests

2 participants