GPT OSS
Collection
2 items
β’
Updated
β’
12
Detailed guide for using this model with llama.cpp:
https://github.com/ggml-org/llama.cpp/discussions/15396
Quick start:
llama-server -hf ggml-org/gpt-oss-120b-GGUF -c 0 --jinja
# Then, access http://localhost:8080
We're not able to determine the quantization variants.
Base model
openai/gpt-oss-120b