agent-platform release v4.31.0

Added

• The model-serving cache outlives a pool teardown, its claim gets a fast StorageClass by default, and vLLM’s compile cache lives on the claim (giantswarm/agent-platform#537). Measured on a GPU pool scaling from zero: every new pool downloaded the weights again (the Helm-owned serving namespace took the kept hf-cache claim down with it on uninstall), the weights loaded at the default gp3 baseline (8.8 GiB in 71 s = 124 MiB/s, the class’s cap), and torch.compile ran on every pod (its cache in an emptyDir). The connectivity chart now: (1) marks the serving namespace helm.sh/resource-policy: keep while modelServing.cache.enabled is on — an uninstall leaves the namespace, the claim and its volume behind, nothing else; a re-install adopts them; (2) renders a StorageClass of the claim’s own (modelServing.cache.storageClass, default create: true: <chart>-<claim> = agent-platform-connectivity-hf-cache, provisioner: ebs.csi.aws.com, gp3 at throughput: "1000" / iops: "4000", WaitForFirstConsumer, expansion allowed, reclaimPolicy: Delete — the claim is the durable object) and the applied claim references it; create: false with name references an existing class and renders none; pvc.storageClassName next to create: true is refused naming both; the default is AWS’s, another cloud sets provisioner and parameters; (3) adds VLLM_CACHE_ROOT=/mnt/models/.cache/vllm to modelServing.policies.env and mounts the runtime container’s /mnt/models read-write in both pod shapes, so a model’s compiled graphs persist in its cache directory. The meta chart mirrors every new default; tests/verify-mirrored-values.py now holds the whole modelServing.cache and modelServing.policies blocks equal between the charts (a forwarded env without the entry would drop it from every installation), with a second negative control in make verify-meta. An installation whose claim already exists on another class keeps it with storageClass.create: false and name: <its class> (storageClassName is immutable; the hook fails naming the field otherwise).