agent-platform release v4.33.0

Added

  • Preset qwen3-8-27b-l40s: Qwen3.8 27B NVFP4 on one 48 GB GPU (giantswarm/agent-platform#544). The shipped qwen3-8-27b is tuned for a 128 GB unified-memory Blackwell node and hosts on no size of the curated AWS accelerator families (giantswarm/agent-platform#535). The new preset serves the same Inferact NVFP4 repack on one L40S — g6e.2xlarge or g6e.4xlarge — with the flags a live probe proved: --gpu-memory-utilization=0.92, --max-model-len=65536, --max-num-seqs=4, --max-num-batched-tokens=8192, chunked prefill, prefix caching, one image per prompt, the qwen3 reasoning parser, tools on with the qwen3_coder parser, thinking off by default, no speculative decoding, no CUTE_DSL_ARCH, the model’s own chat template; requests 4 vCPU / 32 GiB, limits 8 / 48 GiB; weightsGiB: 25 (the Hub’s size), overheadGiB: 16; predictor.timeout: 1800. Ada has no native FP4: vLLM takes the Marlin weight-only FP4 path, loads 24.17 GiB of weights and keeps 14.65 GiB for the KV cache (222,822 tokens, 3.4 concurrent 64k requests). cluster-manager’s presetFit hosts it on 2xlarge and up of the L40S family (g6e.xlarge leaves a predictor 3 vCPU / 27.1 GiB) and on no L4, A10G or T4 size (25 + 16 = 41 GiB > 24). make verify-wiring expects ten shipped presets; verify-preset-weights and the eval check of verify-serving-slice cover the new file.