Skip to content

server: introduce API for serving / loading / unloading multiple models #31371

server: introduce API for serving / loading / unloading multiple models

server: introduce API for serving / loading / unloading multiple models #31371

Triggered via pull request November 29, 2025 22:29
Status Cancelled
Total duration 26m 22s
Artifacts

build.yml

on: pull_request
ios-xcode-build
0s
ios-xcode-build
macOS-latest-cmake-arm64
0s
macOS-latest-cmake-arm64
macOS-latest-cmake-x64
8m 13s
macOS-latest-cmake-x64
macOS-latest-cmake-arm64-webgpu
0s
macOS-latest-cmake-arm64-webgpu
ubuntu-latest-llguidance
0s
ubuntu-latest-llguidance
ubuntu-latest-cmake-rpc
0s
ubuntu-latest-cmake-rpc
ubuntu-24-cmake-vulkan-deb
0s
ubuntu-24-cmake-vulkan-deb
ubuntu-24-cmake-vulkan
0s
ubuntu-24-cmake-vulkan
ubuntu-24-cmake-webgpu
0s
ubuntu-24-cmake-webgpu
ubuntu-22-cmake-hip
0s
ubuntu-22-cmake-hip
ubuntu-22-cmake-musa
0s
ubuntu-22-cmake-musa
ubuntu-22-cmake-sycl
0s
ubuntu-22-cmake-sycl
ubuntu-22-cmake-sycl-fp16
0s
ubuntu-22-cmake-sycl-fp16
build-linux-cross  /  debian-13-loongarch64-cpu-cross
0s
build-linux-cross / debian-13-loongarch64-cpu-cross
build-linux-cross  /  debian-13-loongarch64-vulkan-cross
0s
build-linux-cross / debian-13-loongarch64-vulkan-cross
build-linux-cross  /  ubuntu-24-riscv64-cpu-spacemit-ime-cross
0s
build-linux-cross / ubuntu-24-riscv64-cpu-spacemit-ime-cross
build-cmake-pkg  /  linux
0s
build-cmake-pkg / linux
macOS-latest-cmake-ios
0s
macOS-latest-cmake-ios
macOS-latest-cmake-tvos
0s
macOS-latest-cmake-tvos
macOS-latest-cmake-visionos
0s
macOS-latest-cmake-visionos
ubuntu-latest-cmake-cuda
0s
ubuntu-latest-cmake-cuda
windows-latest-cmake-sycl
0s
windows-latest-cmake-sycl
windows-latest-cmake-hip
0s
windows-latest-cmake-hip
android-build
0s
android-build
ggml-ci-x64-cpu-low-perf
0s
ggml-ci-x64-cpu-low-perf
ggml-ci-arm64-cpu-low-perf
0s
ggml-ci-arm64-cpu-low-perf
ggml-ci-x64-cpu-high-perf
0s
ggml-ci-x64-cpu-high-perf
ggml-ci-arm64-cpu-high-perf
0s
ggml-ci-arm64-cpu-high-perf
ggml-ci-arm64-cpu-high-perf-sve
0s
ggml-ci-arm64-cpu-high-perf-sve
ggml-ci-x64-nvidia-cuda
0s
ggml-ci-x64-nvidia-cuda
ggml-ci-x64-nvidia-vulkan-cm
0s
ggml-ci-x64-nvidia-vulkan-cm
ggml-ci-x64-nvidia-vulkan-cm2
0s
ggml-ci-x64-nvidia-vulkan-cm2
ggml-ci-x64-cpu-amx
0s
ggml-ci-x64-cpu-amx
ggml-ci-x64-amd-vulkan
0s
ggml-ci-x64-amd-vulkan
ggml-ci-x64-amd-rocm
0s
ggml-ci-x64-amd-rocm
ggml-ci-mac-metal
0s
ggml-ci-mac-metal
ggml-ci-mac-vulkan
0s
ggml-ci-mac-vulkan
ggml-ci-arm64-cpu-kleidiai
0s
ggml-ci-arm64-cpu-kleidiai
ggml-ci-arm64-graviton4-kleidiai
7m 36s
ggml-ci-arm64-graviton4-kleidiai
Matrix: android-ndk-build
Matrix: openEuler-latest-cmake-cann
Matrix: ubuntu-cpu-cmake
Matrix: ubuntu-latest-cmake-sanitizer
Matrix: windows-2022-cmake-cuda
Matrix: windows-latest-cmake
Matrix: windows-msys2
Matrix: macOS-latest-swift
Fit to window
Zoom out
Zoom in

Annotations

55 errors
ubuntu-latest-llguidance
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
ubuntu-cpu-cmake (x64, ubuntu-22.04)
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
windows-2022-cmake-cuda (12.4)
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
ubuntu-22-cmake-sycl
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
android-build
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
ubuntu-latest-cmake-rpc
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
macOS-latest-cmake-tvos
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
macOS-latest-cmake-arm64-webgpu
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
ggml-ci-arm64-cpu-high-perf
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
ubuntu-latest-cmake-cuda
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
ubuntu-24-cmake-vulkan-deb
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
ubuntu-22-cmake-hip
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
ggml-ci-x64-amd-vulkan
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
windows-msys2 (UCRT64, ucrt-x86_64, Release)
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
ggml-ci-arm64-cpu-high-perf-sve
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
ggml-ci-x64-amd-rocm
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
ubuntu-22-cmake-musa
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
ggml-ci-mac-vulkan
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
ggml-ci-x64-cpu-high-perf
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
ubuntu-latest-cmake-sanitizer (ADDRESS, Debug)
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
macOS-latest-cmake-arm64
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
ubuntu-22-cmake-sycl-fp16
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
macOS-latest-cmake-visionos
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
ubuntu-24-cmake-webgpu
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
ios-xcode-build
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
ggml-ci-x64-cpu-amx
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
ubuntu-24-cmake-vulkan
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
macOS-latest-cmake-ios
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
windows-latest-cmake (cpu-x64 (static), x64, -G "Ninja Multi-Config" -D CMAKE_TOOLCHAIN_FILE=cmak...
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
ggml-ci-arm64-cpu-kleidiai
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
ggml-ci-arm64-cpu-low-perf
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
ggml-ci-x64-cpu-low-perf
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
ggml-ci-x64-nvidia-cuda
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
windows-latest-cmake-sycl
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
windows-latest-cmake-hip
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
ggml-ci-mac-metal
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
ggml-ci-x64-nvidia-vulkan-cm2
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
android-ndk-build (arm64-cpu, -D ANDROID_ABI=arm64-v8a -D ANDROID_PLATFORM=android-31 -D CMAKE_TO...
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
ubuntu-latest-cmake-sanitizer (THREAD, Debug)
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
ggml-ci-x64-nvidia-vulkan-cm
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
android-ndk-build (arm64-snapdragon, --preset arm64-android-snapdragon-release)
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
build-cmake-pkg / linux
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
ubuntu-cpu-cmake (arm64, ubuntu-22.04-arm)
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
ubuntu-latest-cmake-sanitizer (UNDEFINED, Debug)
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
windows-latest-cmake (openblas-x64, x64, -G "Ninja Multi-Config" -D CMAKE_TOOLCHAIN_FILE=cmake/x6...
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
windows-msys2 (CLANG64, clang-x86_64, Release)
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
windows-latest-cmake (vulkan-x64, x64, -DCMAKE_BUILD_TYPE=Release -DGGML_NATIVE=OFF -DLLAMA_BUILD...
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
windows-latest-cmake (llvm-arm64, arm64, -G "Ninja Multi-Config" -D CMAKE_TOOLCHAIN_FILE=cmake/ar...
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
build-linux-cross / debian-13-loongarch64-cpu-cross
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
windows-latest-cmake (llvm-arm64-opencl-adreno, arm64, -G "Ninja Multi-Config" -D CMAKE_TOOLCHAIN...
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
build-linux-cross / debian-13-loongarch64-vulkan-cross
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
build-linux-cross / ubuntu-24-riscv64-cpu-spacemit-ime-cross
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
CI
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
CI
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists
CI
Canceling since a higher priority waiting request for CI-refs/pull/17470/merge exists