Verify elemental-operator against Rancher 2.14

[kkaempf]

Rancher 2.14 provisioning will update the CAPI stack from 1.10.x to 1.12.x, also bumping the API from v1beta1 to v1beta2.

Verify that elemental-operator is still fully functional in Rancher 2.14 and adapt as needed.

[juadk]

I can confirm that provisioning does not work with rancher 2.14, I triggered some tests yesterday and the cluster never goes to active status. Today, I'm focusing on next rancher validation (deadline is tomorrow) and I will switch back to rancher 2.14 and give logs.

[davidcassany]

I can confirm that provisioning does not work with rancher 2.14, I triggered some tests yesterday and the cluster never goes to active status. Today, I'm focusing on next rancher validation (deadline is tomorrow) and I will switch back to rancher 2.14 and give logs.

Thanks for the feedback @juadk

[juadk]

Yesterday, in the operator logs, I was able to see:

E0217 15:12:05.090650       1 controller.go:329] "Reconciler error" err="error reconciling machine inventory selector object: failed to set bootstrap plan: failed to get bootstrap plan: machine for machine inventory selector doesn't exist" controller="machineinventoryselector" controllerGroup="elemental.cattle.io" controllerKind="MachineInventorySelector" MachineInventorySelector="fleet-default/mycluster3-pool1-znmcb-fkrsf" namespace="fleet-default" name="mycluster3-pool1-znmcb-fkrsf" reconcileID="ea550339-3d05-4487-b3e4-5c091f1b93f2"
I0217 15:12:05.762704       1 machineselector_controller.go:124] "Reconciling machine inventory selector object" controller="machineinventoryselector" controllerGroup="elemental.cattle.io" controllerKind="MachineInventorySelector" MachineInventorySelector="fleet-default/mycluster3-pool1-znmcb-z2q9d" namespace="fleet-default" name="mycluster3-pool1-znmcb-z2q9d" reconcileID="e2ee8f4b-d029-41af-9b19-1a9d70d65332"
E0217 15:12:05.773695       1 controller.go:329] "Reconciler error" err="error reconciling machine inventory selector object: failed to set bootstrap plan: failed to get bootstrap plan: machine for machine inventory selector doesn't exist" controller="machineinventoryselector" controllerGroup="elemental.cattle.io" controllerKind="MachineInventorySelector" MachineInventorySelector="fleet-default/mycluster3-pool1-znmcb-z2q9d" namespace="fleet-default" name="mycluster3-pool1-znmcb-z2q9d" reconcileID="e2ee8f4b-d029-41af-9b19-1a9d70d65332"

Not sure it will help, tell me if you want special log. Right now, I only reproduce it in the CI, I have to rebuild my local env.

[ldevulder]

I was able to reproduce the issue manually, a simple K3s 1-node cluster is enough (in my local test I tried a 3-nodes one).

Here what I have on the UI:

And here some logs from a failing selector:

apiVersion: elemental.cattle.io/v1beta1
kind: MachineInventorySelector
metadata:
  annotations:
    cluster.x-k8s.io/cloned-from-groupkind: MachineInventorySelectorTemplate.elemental.cattle.io
    cluster.x-k8s.io/cloned-from-name: selector-three-node-cluster
  creationTimestamp: "2026-02-18T14:44:46Z"
  generation: 1
  labels:
    cattle.io/os: linux
    cluster.x-k8s.io/cluster-name: three-node-cluster
    cluster.x-k8s.io/control-plane: "true"
    cluster.x-k8s.io/deployment-name: three-node-cluster-pool-three-node-cluster
    cluster.x-k8s.io/set-name: three-node-cluster-pool-three-node-cluster-w454x
    machine-template-hash: 2223761741-w454x
    rke.cattle.io/cluster-name: three-node-cluster
    rke.cattle.io/control-plane-role: "true"
    rke.cattle.io/etcd-role: "true"
    rke.cattle.io/rke-machine-pool-name: pool-three-node-cluster
    rke.cattle.io/worker-role: "true"
  name: three-node-cluster-pool-three-node-cluster-w454x-9p5w9
  namespace: fleet-default
  ownerReferences:
  - apiVersion: cluster.x-k8s.io/v1beta2
    blockOwnerDeletion: true
    controller: true
    kind: Machine
    name: three-node-cluster-pool-three-node-cluster-w454x-9p5w9
    uid: 4aacc822-2299-490d-bcd1-c7294da2cd59
  resourceVersion: "9705"
  uid: e86fa86a-1065-4e75-95f7-4207da2299aa
spec:
  selector:
    matchExpressions:
    - key: cluster-id
      operator: In
      values:
      - id-three-node-cluster
    - key: pool-type
      operator: In
      values:
      - pool-three-node-cluster
status:
  conditions:
  - lastTransitionTime: "2026-02-18T14:44:46Z"
    message: 'failed to get bootstrap plan: machine for machine inventory selector
      doesn''t exist'
    reason: FailedToUpdatePlan
    status: "False"
    type: Ready
  - lastTransitionTime: "2026-02-18T14:44:47Z"
    message: ""
    reason: SuccessfullyAdoptedInventory
    status: "True"
    type: InventoryReady
  machineInventoryRef:
    name: node-3987c56f-4554-4d27-9df9-90d8fe74d512

[davidcassany]

@ldevulder @juadk thanks for the feedback and details, I am looking at it

[davidcassany]

Just merged #962 which aims to fix this issue (tagged as v1.9.0-rc1). This requires a new elemental-operator minor version (v1.9.x) and since the OS stream it is the same as in v1.8.x this required a duplicating elemental-operator package and its images in OBS (so both are built in the same project v1.8 and v1.9).

[juadk]

Thanks @davidcassany , ping me when you will have a new chart to test in 2.14.