Release Notes

For the service MetaKube Core.

2026

April 2026

2026-04-27

• Update containerd to 2.2.3 on Ubuntu nodes. Existing nodes will not be updated automatically. Recreate your nodes to get the update.

2026-04-21

• Add latest Kubernetes patch releases: 1.35.3, 1.34.6, 1.33.10
• Fix: Previously, the network ID for the floating IPs of a load balancer was not set. This could cause problems when having multiple external networks in an OpenStack project, because it wasn't possible to determine the network predictably. Now, the floating IPs for load balancers will always be taken from the floating IP pool which is chosen during cluster creation.

March 2026

2026-03-17

• Add latest Kubernetes patch releases: 1.35.2, 1.34.5, 1.33.9, 1.32.13

February 2026

2026-02-23

• Add support for new Kubernetes release and make it the new default version: 1.35.1
• Add latest Kubernetes patch releases
• Removed support for Kubernetes 1.31
• Removed support for Ubuntu 20

2025

September 2025

2025-09-23

• Add support for new Kubernetes release: 1.34.1
• Add latest Kubernetes patch releases: 1.32.9, 1.33.5

May 2025

2025-05-21

• Add support for Kubernetes 1.33.0 and make it the new default version

March 2025

2025-03-20

• Add support for 1.29.15, 1.30.11 ,1.31.7 & 1.32.3

February 2025

2025-02-27

• Upgrade containerd to 1.7.25 on Ubuntu nodes

2025-02-21

• Remove support for Kubernetes 1.28
• Upgrade all clusters on version 1.28 in regions DUS & HAM to 1.29

2025-02-20

• Create VolumeSnapshotClass for Ceph in regions FES, DUS & HAM

2025-02-13

• Update node-local-dns to 1.25.0
• Add support for Kubernetes 1.30.10, 1.31.6 & 1.32.2

2025-02-12

• Change CSI node plugin dns policy so they use node-local-dns for lookups

2025-02-10

• Fix: Can't scale to 0 with flatcar update operator present

2025-02-05

• Remove support for Kubernetes 1.28

January 2025

2025-01-24

• Add support for Kubernetes 1.29.13, 1.30.9, 1.31.5 & 1.32.1
• Update CoreDNS to 1.12.0

2025-01-22

• Fix Kubelet restart triggered by systemd-tmpfiles cleaning up Kubelet's lock file. This affected Ubuntu 24.04 nodes and requires a replacement of existing nodes to fully mitigate.

2025-01-21

• Resolve Node initialization deadlocks by recreating machine if Node hasn't joined within 2h

2025-01-16

• Address issues with slow LoadBalancer Service reconciliation in clusters with many load balancers by allowing concurrent syncs

2025-01-14

• Fix regression in machine initialization issues on AWS

2025-01-14

• Fix regression in machine initialization issues on AWS

2025-01-13

• Make Kubernetes 1.32.0 the new default version

2025-01-07

• Address issues with CSR signing for nodes in AWS clusters when their IP changed

2024

December 2024

2024-12-19

• Add support for Kubernetes 1.32.0

2024-12-17

• Add support for Kubernetes 1.31.4, 1.30.8 & 1.29.12
• Forbid cluster delete requests if cloud credentials are invalid This prevents clusters to get stuck in deletion because cloud resources can't be cleaned up.

2024-12-03

• Fix: Bug in API validation that rejected cloud credential update requests

November 2024

2024-11-29

• Make sys11-ceph the preferred default storage class

2024-11-28

• Update Cilium to 1.16.4

2024-11-25

• Update CoreDNS to 1.11.4

2024-11-22

• Update Calico version in Canal to 3.29 in clusters with version >= 1.29

2024-11-21

• Add support for Kubernetes 1.31.3, 1.30.7 & 1.29.11

2024-11-19

• Prevent rare condition that multiple apiserver instances share underlying hardware to improve stability

2024-11-13

• Fix: Cloud controller fails on AWS clusters on version 1.31.

2024-11-08

• Fix: Node local DNS update may leave orphaned Pods behind

2024-11-07

• Update Cilium to 1.15.10

October 2024

2024-10-28

• Add support for Kubernetes 1.31.2, 1.30.6, 1.29.11 & 1.28.15
• Update Cilium to 1.14.16 & Hubble to 0.13.1

2024-10-24

• Introduce Machine profiles to improve stability of Kubernetes Nodes under memory pressure.

2024-10-16

• Nodes join with the Machine's spec.template.spec.labels immediately instead of adding them retrospectively. If changed by an external actor, they're also no longer reverted.

2024-10-04

• Fix issue where updates to custom DNS ConfigMaps would not trigger a rolling update of the DaemonSet

2024-10-02

• MetaKube manages machine's OpenStack ports and servers separately. This allows using multiple OpenStack subnets in a network without unintended side effects.

2024-10-01

• Remove support for Kubernetes 1.27

September 2024

2024-09-26

• Add support for Kubernetes 1.31.1, 1.30.5, 1.29.9 & 1.28.14

2024-09-25

• Update CSI node plugin sidecar container images
• Update metrics server image

2024-09-24

• Fix issue where additional floating IPs could be created for a machine

August 2024

2024-08-22

• Add support for Kubernetes 1.31.0
• Add support for Kubernetes 1.30.4, 1.29.8 & 1.28.13

2024-08-21

• Set spec.providerID on Machines This may be used by third party consumers of Cluster API.

2024-08-20

• Fix issue where multiple OpenStack servers may have been created for a single Machine This could cause failures in the main loop of cluster autoscaler and prevent it from scaling up.

2024-08-13

• Update Calico to 3.27.4 and 3.28.1 respectively

2024-08-12

• Update CSI node plugin sidecar containers to the latest available patch versions

2024-08-08

• Return an error when MachineDeployment doesn't specify a single Security Group
• Update CoreDNS to 1.11.1 for clusters <= 1.28
• Fix: Regression prevented Kubelet from mounting NFS volumes

2024-08-07

• Fix: MachineDeployment annotation capacity.cluster-autoscaler.kubernetes.io/labels used wrong labels

2024-08-05

• Fix: Failure when applying changes to MachineDeployments due to timeout

2024-08-01

• Prevent HPA lock for CoreDNS DaemonSet when scaled to 0
• Fix: Unit missing from MachineDeployment Annotation for cluster autoscaler
• Omit unnecessary packages in machine initialization on Ubuntu

July 2024

2024-07-26

• Add support for Ubuntu 24.04 (Noble)
• Manage annotations on MachineDeployments that enable scaling up from zero with Pods using affinity or taints

2024-07-23

• Remove health indicators for cluster components running in the cluster
• Remove api that exposes metrics to indicate service health of such components

2024-07-19

• Add support for Kubernetes 1.30.3, 1.29.7 & 1.28.12

2024-07-17

• Replace dns autoscaler Deployment with HPA. In bigger clusters this reduces the replica count of the kube-system/coredns Deployment to a more appropriate value.
• Adjust cluster upgrade constraints to version skew policy change. Starting at 1.28, Kubernetes allows Kubelet to be up to three minor versions behind apiserver.

2024-07-16

• Allow OpenStack image IDs in the MachineDeployment's spec.template.spec.providerSpec.value.cloudProviderSpec.image field.

2024-07-01

• Remove support for Kubernetes 1.26

June 2024

2024-06-13

• Add support for Kubernetes 1.30.2, 1.29.6, 1.28.11 & 1.27.14

May 2024

2024-05-30

• Update node-exporter in kube-system namespace to 1.3.1

2024-05-28

• Add support for Kubernetes 1.29.4, 1.29.5, 1.28.9, 1.28.10, 1.27.13 & 1.27.14

2024-05-27

• Add support for Kubernetes 1.30.1
• See supported Kubernetes versions

2024-05-24

• Fix: connection issues with Konnectivity that could occur after multiple load balancer fail-overs

2024-05-17

• Fix: possible violations of version skew policy when a cluster is updated

2024-05-02

• Remove support for Kubernetes 1.25
• Kubernetes 1.26 is now deprecated and will be removed in the beginning of June 2024.

April 2024

2024-04-05

• Fix: Cluster deletion may get stuck waiting for deletion of PVs provisioned by custom CSI plugin

2024-04-03

• Fix: machine controller may excessively delete machine when scaling down

March 2024

2024-03-21

• Add support for Kubernetes 1.29.2

2024-03-15

• Fix bug that may cause cluster-autoscaler to fail to track nodes

2024-03-08

• Remove support for Kubernetes 1.24

2024-03-04

• Add support for Kubernetes 1.28.7, 1.27.11 & 1.26.14
• Move volume snapshot controller out of MetaKube cluster into SysEleven managed infrastructure. This avoids issues e.g. when a cluster doesn't have any nodes.

2024-03-01

• Update Calico to v3.27.2
• Update Cinder CSI node plugin to 1.29.0 in 1.28 clusters
• Update node-local-dns to 1.22.28

February 2024

2024-02-29

• Update node-local-dns to 0.7.0

2024-02-07

• Add support for Kubernetes 1.28.6

January 2024

2024-01-22

• Add support for Kubernetes 1.26.13 & 1.27.10

2024-01-03

• Update Calico to 3.26 in Canal

2024-01-02

• Remove support for Kubernetes 1.23
• See supported Kubernetes versions

2023

December 2023

2023-12-08

• Update Calico to 3.26.4
• Add support for Kubernetes 1.26.11 & 1.27.8

2023-12-01

• Change affinity type of CoreDNS Pods to "RequiredDuringSchedulingIgnoredDuringExecution". This avoids downtime in some rare cases and improves load balancing.

November 2023

2023-11-15

• Fix UI bug when selecting images

2023-11-14

• Enable CSI snapshot support

2023-11-12

• Add support for VolumeSnapshots of OpenStack Volumes

2023-11-09

• Add support for Kubernetes 1.27.7

October 2023

2023-10-25

• Add support for Kubernetes 1.25.14 & 1.26.9

2023-10-24

• Fix image update recommendation in UI

2023-10-18

• Raise limit of LoadBalancer services that can share one Octavia LB to 100.

2023-10-12

• Patch Calico in canal Pods to v3.23.5 and v3.25.2 respectively

2023-10-10

• Enable Calico metrics in canal Pods

2023-10-09

• Upgrade node-local-dns-cache to 1.22.23

2023-10-06

• Upgrade coredns to 1.9.4

2023-10-05

• Upgrade metrics-server to 0.6.4

September 2023

2023-09-22

• Fix issue where no storage class was annotated as default.

2023-09-18

• Fix issue where annotation wasn't removed from storage class after another was annotated.
• Add priorityClassName to Pods managed by SysEleven

2023-09-11

• Replace image registry with registry.k8s.io for several images. This prevents ImagePull errors for clusters with a lot of node churn.

2023-09-04

• Add support for Kubernetes 1.24.17, 1.25.13 & 1.26.8

August 2023

2023-08-02

• Remove support for Kubernetes 1.22
• See supported Kubernetes versions

2023-07-31

• Update konnectivity to v0.0.37 – Improves stability for connections from the API server to the cluster, e.g. kubectl logs ..., kubectl port-forward ...

2023-07-11

• Add support for Ubuntu 22.04 (Jammy)
• Fix: CSI node plugin crashes when node is under high load

2023-07-03

• Add StorageClass backed by Ceph in all clusters in the FES OpenStack region

June 2023

2023-06-30

• Add support for Kubernetes 1.24.15, 1.25.11 & 1.26.6
• Fix issue where controller-manager was stuck on 1.26 clusters that underwent ccm migration

2023-06-12

• Add support for Kubernetes 1.26.5

2023-06-09

• Add support for Kubernetes 1.24.14 and 1.25.10

May 2023

2023-05-02

• Add support for Kubernetes 1.24.13 and 1.25.9

April 2023

2023-04-27

• Fix: Cinder CSI plugin now correctly sets volume attach limits on CSINodes. Nodes will have to be recreated for it to take effect.

2023-04-13

• Fix bug where nodes couldn't be cleaned up when Floating IP was already deleted.

2023-04-05

• Add support for Kubernetes 1.24.12 and 1.25.8

2023-04-03

• Fix performance issue with cluster autoscaler in big clusters

March 2023

2023-03-30

• Replace references to "master" in the UI with "control plane"

2023-03-28

• Remove support for Kubernetes 1.21
• See supported Kubernetes versions and 1.22 upgrade guide.
• Manage cluster autoscaler outside of cluster

2023-03-27

• Replace use of registry k8s.gcr.io with registry.k8s.io

2023-03-20

• Allow setting default storage class. For more information, see storage classes.

2023-03-15

• Add support for Kubernetes 1.25.7 for clusters on SysEleven OpenStack Cloud. Check our migration guide for details.
• Improve behavior of cluster autoscaler when changing min_replicas or max_replicas. If the current replica count becomes out of bounds, it will now always be adjusted. This avoids an issue with the autoscaler where it would refuse to scale.

2023-03-14

• Add support for Kubernetes 1.24.11.

February 2023

2023-02-27

• Fix issue where changes to clusters weren't propagated in time. This also showed as cluster control plane components appearing "NotReady" on the dashboard.
• Fix an issue where MachineDeployment updates were refused, because SysEleven OpenStack Cloud API was slow.
• Fix ImagePullErrors with the user-ssh-keys-agent Pods.

2023-02-23

• Fix UI error due to the use of a removed API.

2023-02-13

• Add support for Kubernetes 1.23.16 and 1.24.10.

January 2023

2023-01-09

• Add support for Kubernetes 1.23.15 and 1.24.9.
• Fix: Permission issue that inhibited project deletion.

2023-01-06

• Remove support for Kubernetes version 1.20.

2022

December 2022

2022-12-12

• Add support for Kubernetes 1.24.8.

November 2022

2022-11-29

• Add field tenant-id in Secret cloud-config in the kube-system Namespace when cluster is using OpenStack username/password.

2022-11-23

• Add support for Kubernetes 1.23.13.

2022-11-18

• Update OpenStack cloud controller manager to version 1.24 in 1.23 clusters.

2022-11-11

• Update Calico to 3.23.4 in clusters with Kubernetes version >=1.22.

October 2022

2022-10-26

• Remove StorageClass sys11-quobyte-multi in clusters that don't reference it in existing PersistentVolumeClaims. You may also remove the StorageClass yourself if you no longer use it.
• No longer install StorageClass sys11-quobyte-multi in new clusters.

2022-10-19

• Remove StorageClass sys11-quobyte in clusters that don't reference it in a StatefulSet.
• Replace driver from in-tree to CSI driver in StorageClass sys11-quobyte in clusters that do reference it in a StatefulSet. This ensures that these StatefulSets can be scaled up if wanted. You may also remove the StorageClass yourself if you no longer use it.

2022-10-17

• Improve cluster name validation in UI
• Remove option of subnet ID in cluster creation wizard. This didn't work as intended as OpenStack chooses an arbitrary subnet from the network.

2022-10-10

• Remove limit range from default namespace.

September 2022

2022-09-26

• Provide support for Kubernetes versions 1.20.15, 1.21.14 and 1.22.13

2022-09-12

• Migrate all existing clusters from OpenVPN to Konnectivity. This improves reliability and performance of the kube-apiserver to cluster tunneling. For more information, check our documentation on Konnectivity.

August 2022

2022-08-31

• Remove support for Kubernetes 1.19

2022-08-25

• Remove Add-on panels in UI
• New clusters use Konnectivity instead of OpenVPN

2022-08-24

• Remove automatic updates for addons. Existing Addon resources remain and can be managed in different ways. See Migrate from a MetaKube Addon for details.

2022-08-22

• Switch the MetaKube API endpoint to 195.192.148.91

2022-08-19

• Fix: metrics-server fails to collect metrics due to RBAC regression

2022-08-17

• Add support for Kubernetes 1.23.8

2022-08-12

• Fix an issue where horizontal node autoscaler annotations weren't removed when it was disabled

2022-08-11

• Add support for Kubernetes 1.22.12. This contains a fix for a Kubelet bug.
• Fix an issue with machine deployments using AWS Spot instances
• Remove the option to leave PVs and Load Balancers behind when deleting a cluster. This could cause a deadlock in the cluster clean up.

July 2022

2022-07-05

• Source coredns image from external registry

June 2022

2022-06-30

• Remove possibility to install new addons

2022-06-20

• Fixes an issue, where the CSI controller plugin was not available in migrated clusters.

2022-06-15

• Deleted UI Theme picker that allowed choice between Dark vs Light modes is deleted. Light mode is the default and only mode now.
• Fixed some unintuitive behavior of cluster autoscaler. Setting min or max replicas in UI now changes the current replica count, if it's outside of bounds.
• Fixed a race condition that could lead to a deadlock in cluster deletion

2022-06-02

• Fixed a bug where a blocking write call caused the DNAT controller to never install NAT rules, which broke apiserver to Kubelet communication. This may have caused issues with kubectl logs|exec|port-forward as well as missing PodMetrics or NodeMetrics.
• Remove support for outdated Kubernetes patch versions 1.19.7, 1.20.8, 1.21.3
• Move CSI-controller out of MetaKube cluster. This fixes an issue where clusters got stuck deleting, because PVs could not be cleaned up.

May 2022

2022-05-16

• Fix issue where ssh-key-agent wrongfully removed authorized keys from machines.
• Fix issue with Flatcar nodes that use Containerd

2022-05-09

• Change default behavior of horizontal node autoscaler to ignore local volumes on scale down. See horizontal node autoscaling.

2022-05-05

• Add labels syseleven.de/managed=true and addons.syseleven.de/name to all managed addon resources.
• Remove obsolete form fields in UI.

2022-05-03

• Add-ons are deprecated. SysEleven plans to disable the add-ons in Q3 and will inform you in time (8 weeks before) about the exact date. You can read on migrate from a MetaKube add-ons here. Addons can now be deleted without removing their resources from the cluster.

April 2022

2022-04-28

• Fixed an issue where the UI would not show the actual state of a MetaKube cluster. This could lead to certain actions being disabled or deleted clusters being cleaned up.

Older Release Notes

For older release notes, please contact our support team