gpt-oss-120b

Detailed guide for using this model with llama.cpp:

https://github.com/ggml-org/llama.cpp/discussions/15396

Quick start:

llama-server -hf ggml-org/gpt-oss-120b-GGUF -c 0 --jinja

# Then, access http://localhost:8080
Downloads last month
19,732
GGUF
Model size
117B params
Architecture
gpt-oss
Hardware compatibility
Log In to view the estimation

We're not able to determine the quantization variants.

Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Model tree for ggml-org/gpt-oss-120b-GGUF

Quantized
(63)
this model

Collection including ggml-org/gpt-oss-120b-GGUF