agent-platform release v4.38.0

Added

• Preset qwen3-8-flash-next-nvfp4: Qwen3.8-Flash-Next NVFP4 on one 128 GB unified-memory Blackwell node, served from an OCI model image on an installation-defined runtime (giantswarm/agent-platform#553). Qwen3.8-Flash-Next (125B total, 6B active, a 51B n-gram embedding table, 262k context, tools, reasoning, vision) had no shipped preset: NVIDIA’s NVFP4 checkpoint is 123.6 GiB on disk and does not fit the node next to a KV cache. The new preset serves the quantization-aware-distilled repack local-inference-lab/Qwen3.8-Flash-Next-NVFP4 (98.6 GiB, the n-gram table in NVFP4 too) with the community’s single-node recipe: the table read from disk (VLLM_PLE_TABLE_MEMORY=disk), MTP speculative decoding (--speculative-config='{"method":"mtp","num_speculative_tokens":4}'), the B12X load format, GDN decode kernel, linear and MoE backends, --quantization=modelopt_mixed, --kv-cache-dtype=fp8, --mamba-cache-mode=align, prefix caching, chunked prefill, --max-model-len=262144, --max-num-seqs=8, --max-num-batched-tokens=4096, --gpu-memory-utilization=0.80, the qwen3 reasoning parser, tools on with the qwen3_xml parser, fused activation quantization (--compilation-config='{"pass_config":{"fuse_act_quant":true}}'); nine runtime knobs (CUTE_DSL_ARCH=sm_121a, SAFETENSORS_FAST_GPU, VLLM_WORKER_MULTIPROC_METHOD=spawn, VLLM_SSM_CONV_STATE_LAYOUT=DS, the AOT compile flags, VLLM_USE_V2_MODEL_RUNNER, B12X_POLICY_MODE=auto) plus HOME, HF_HOME and VLLM_CACHE_ROOT under /tmp, because the modelcar path runs the runtime as a non-root uid on a read-only image; requests 4 vCPU / 48 GiB, limits 8 / 64 GiB; weightsGiB: 99 (the Hub’s size), overheadGiB: 20 (the table stays on disk, so about 74 GiB are resident and the rest of the 0.80 budget is the KV cache); predictor.timeout: 1800; licence other (the Qwen community licence). Two firsts among the shipped presets: spec.runtime: kserve-vllm-b12x names an additional runtime the installation defines from the B12X image through modelServing.additionalRuntimes (giantswarm/agent-platform#550) — the default upstream runtime cannot serve this architecture, and without the entry the InferenceService names a runtime that does not exist — and spec.model.storageUri is oci://gsoci.azurecr.io/giantswarm/models/qwen3-8-flash-next-nvfp4:7c4f1bc1a2d6 (the tag the first 12 characters of the checkpoint revision), the model as an OCI image a registry holds under that path, its host swapped by modelServing.modelImages.registry and pre-pulled through modelServing.prepull.modelPresets (giantswarm/agent-platform#551). make verify-wiring expects eleven shipped presets; verify-preset-weights and the eval check of verify-serving-slice cover the new file; verify-gpu-pool leaves the preset’s ConfigMap and its discovery entry out of the golden comparison while origin/main predates it.