agent-platform release v4.91.0
Added
agentgateway.inferenceExtension.enabled: true: the models Gateway resolves InferencePool backends (giantswarm/agent-platform#504; epic giantswarm/giantswarm#37639). An LLMInferenceService composed with the llm-d endpoint picker (a preset’s spec.router.scheduler: true) routes its /v1/* rules to an InferencePool. The platform’s agentgateway ran with the chart’s default inferenceExtension.enabled: false, so the route stayed ResolvedRefs=False BackendNotFound and the model never became Ready. The controller now runs with AGW_ENABLE_INFER_EXT and read access to inferencepools and their status, on the installation and on a workload cluster’s slice alike. Without the InferencePool CRD (no serving slice on the cluster) it waits for the CRD and routes everything else as before. Every installation rolls the agentgateway controller once (a new environment variable and two Role rules). The data plane and the routes are unchanged.