agent-platform release v4.90.0

Changed

  • The serving slice on KServe v0.21.0, and a served model rolls without a surge pod (giantswarm/agent-platform#682). components.kserve-llmisvc-crd, components.kserve-llmisvc-resources and components.kserve-runtime-configs move to 0.7.x (giantswarm/kserve#101, #102). The kserve-runtime-configs: block passes kserve.llmisvcConfigs.rolloutStrategy: {maxSurge: 0, maxUnavailable: 1}. The controller merges it from the single-node presets into every LLMInferenceService, so a predictor’s roll stops the old pod before it starts the new one. A model that fills its GPU could never start the surge pod, and its roll never finished. The runtime stays llm-d-cuda:v0.8.0 (vLLM 0.23.0): the block pins the main image of the six GPU presets (kserve.llmisvcConfigs.images), since the 0.7.x presets name llm-d v0.9.0, whose vLLM 0.26.0 cannot load Gemma 4 (gemma-4-31b crash-loops on head_dim is a per-layer attribute). The presets’ v0.10.0 routers come with the charts. make verify-serving-slice holds the pinned image equal to the pre-pulled one.