agent-platform release v4.82.0

Added

  • muse-glimmer-30b: Meta’s Muse Glimmer 30B on one 48 GB GPU, on vLLM’s own server image (giantswarm/agent-platform#597). Red Hat AI’s FP8 block quantization (RedHatAI/Muse-Glimmer-30B-FP8-block, 32 GiB, served from the signed model image giantswarm/models/muse-glimmer-30b-fp8:1deb4641ff84) at 32k context, four concurrent requests, one image per prompt, reasoning and tools with vLLM’s muse_glimmer parsers under vLLM v0.30.0’s Muse Glimmer chat template (chat-templates/muse-glimmer-30b.jinja). The model’s architecture and parsers first ship in vLLM 0.28.0 and the llm-d runtime carries an older vLLM, so the preset names its runtime in spec.template: gsoci.azurecr.io/giantswarm/vllm-openai:v0.30.0, the signed copy of vllm/vllm-openai that retagger pins by digest (giantswarm/retagger#1245). The well-known template’s command runs it unchanged. Sized for a g6e.2xlarge or g6e.4xlarge.