Search results

server : improve infill stop criteria

examples

server

Status: Draft (not ready).

ggml-org/llama.cppnumber 12333

#12333 In ggml-org/llama.cpp;

· ggerganov opened on Mar 11, 2025

server : chunked prefill support

examples

server

Status: Draft (not ready).

ggml-org/llama.cppnumber 10718

#10718 In ggml-org/llama.cpp;

· ggerganov opened on Dec 8, 2024

speculative : add infill mode

examples

server

Status: Draft (not ready).

ggml-org/llama.cppnumber 10510

#10510 In ggml-org/llama.cpp;

· ggerganov opened on Nov 26, 2024