Observability

  • Changed

    • Update DNS dashboard to include memory requests.
    • Added Cluster Overviewdashboard.

    Fixed

    • fix alloy mixins generation
    • fix alloy mixins
    • fix Alloy / Logs Overview dashboard.
  • Changed

    • Upgrade chart to version 5.6.0
    • Upgrade mimir to 2.15.0
      • Ingester: Change -initial-delay for circuit breakers to begin when the first request is received, rather than at breaker activation.
      • Query-frontend: apply query pruning before query sharding instead of after.
      • Ingester: Replace cortex_discarded_samples_total label from sample-out-of-bounds to sample-timestamp-too-old.
      • Querier: The . pattern in regular expressions in PromQL matches newline characters. With this change regular expressions like .* match strings that include \n. To maintain the old behaviour, you will have to change regular expressions by replacing all . patterns with [^\n], e.g. foo[^\n]*. This upgrades PromQL compatibility from Prometheus 2.0 to 3.0. #9844
      • Ingester: improve performance of reading the WAL.
      • Querier: improve performance and memory consumption of queries that select many series.
      • more at https://github.com/grafana/mimir/blob/main/CHANGELOG.md#2150
  • Removed

    • Remove mimir datasource as it is now managed by the observability operator.
  • Added

    • Add Promtail overview dashboard.

    Changed

    • Updated DNS dashboard and show memory usage using cAdvisor metrics.
  • Changed

    • Fixed nodes overview dashboard to avoid master duplicating numbers.
    • Add observability organization label to GS private dashboards.
  • Added

    • Add “manual e2e” testing procedure.

    Changed

    • Add configuration for alertmanager component to be HA.
  • Changed

    • Add Ingress dummy paths to block access to the /swagger, /metrics, and /api/health endpoints by default.
    • upgrade grafana chart: 8.5.12 => 8.6.0
  • Added

    • Add alloy v0.7.0 as alloyEvents.

    Changed

    • Upgrade alloy-logs and alloy-metrics to chart 0.7.0.
      • Bumps alloy from 1.4.2 to 1.5.0
    • upgrade kube-prometheus-stack from 65.1.1 to 66.2.1
      • prometheus-operator CRDs from 0.75.0 to 0.78.1
      • prometheus-operator from 0.77.1 to 0.78.1
      • prometheus from 2.54.1 to 2.55.1
      • kube-state-metrics from 2.13.0 to 2.14.0
      • grafana from 8.5.0 to 8.6.0
  • Changed

    • Update alloy-app to 0.7.0.
      • Bumps alloy to 1.5.0 which includes a ciliumnetworkpolicy fix for clustering.
  • Changed

    • Upgrade Alloy upstream chart from 0.9.2 to 0.10.0
      • This bumps the version of Alloy from 1.4.2 to 1.5.0