Anyplan to make CodeGenCPP?

[v3ss0n]

Llama models seesm to be not useful for code genration.

Any chance to get CodeGen models work on CPU ? https://github.com/salesforce/CodeGen

[v3ss0n]

Now since Discussion tab is opnened , i am going to open a topic and post there.

[AayushSameerShah]

Hey!!!! @v3ss0n
Looking for the same, I am willing to convert this: https://huggingface.co/NumbersStation/nsql-2B model into GGUF - which infact based on the CodeGen model.

Any luck with this?

[ruze00]

Why are there crickets for this question? Is it that Salesforce is too non-standard or something else?