agent-platform release v4.36.0
Added
modelServing.additionalRuntimes: more vLLM ClusterServingRuntimes beside the default, rendered from the same template (giantswarm/agent-platform#550). modelServing.runtime rendered exactly one runtime and every preset ran on it; an installation whose accelerator needs a different serving image for some models — a hardware-specific vLLM build for a unified-memory Blackwell node next to the upstream image the other presets run on — had to move every preset to that image or hand-write a runtime outside the chart. The new list renders one ClusterServingRuntime per entry: name required, a DNS-1123 subdomain and unique across the default and the list (a name already used fails the render naming the entry); every other field — image (registry, name, version), args, env, resources, shmSize, startupProbe, annotations, supportedModelFormats, nodeSelector, tolerations — the default runtime’s where the entry leaves it unset (a mapping field by field, a list whole: an entry’s env replaces the default’s two entries rather than extending them; an empty value inherits too); the GPU pool’s taint and label applied as on the default; the container on the same shell entrypoint (/bin/sh -c 'eval "exec vllm serve $@"' --) with the entry’s own base arguments, so its image must carry /bin/sh and vllm on PATH as well. A preset selects a runtime with spec.runtime. The discovery ConfigMap publishes every runtime’s name as spec.runtimes (the default first) next to spec.runtime; an empty list renders the default alone, and the default runtime’s document is unchanged. Mirrored in the meta chart, and tests/verify-mirrored-values.py (make verify-meta) now holds the modelServing.runtime and modelServing.additionalRuntimes blocks equal between the charts too — an additional runtime inherits from the forwarded default. make verify-runtimes asserts the render over ci/test-model-serving-runtimes-values.yaml (inheritance, the pool on every runtime, the entrypoint, the discovery list, the guards, the meta chart’s forwarded render); README “Additional runtimes”.