Reconciler will detect and block on kubernetes resource collisions

[addyess]

Overview

• if N>1 ceph-csi charms are installed as different applications names on the same k8s cluster, the kubernetes resources it manages will clash with the others.
• The first charm to put the resources down "owns" the resource. Any resource with a label juju.io/application=<name-of-app> is considered the object's owner
• the newer charms should block if the kubnernetes cluster has any resource it wishes to install and the juju.io/application is different from its own

Details

• Depends on Update list-resources canonical/ops-lib-manifest#35
• Provides an update to the list-resources action to show the conflicting resources
  • example

config-missing: |-
  ConfigMap/ceph-2/ceph-config
  ConfigMap/ceph-2/ceph-csi-config
  ConfigMap/ceph-2/ceph-csi-encryption-kms-config
rbd-conflicting: |-
  ClusterRole/rbd-csi-nodeplugin
  ClusterRole/rbd-external-provisioner-runner
  ClusterRoleBinding/rbd-csi-nodeplugin
  ClusterRoleBinding/rbd-csi-provisioner-role
  StorageClass/ceph-ext4
  StorageClass/ceph-xfs
rbd-correct: CSIDriver/rbd.csi.ceph.com
rbd-missing: |-
  ClusterRole/rbd-csi-nodeplugin
  ClusterRole/rbd-external-provisioner-runner
  ClusterRoleBinding/rbd-csi-nodeplugin
  ClusterRoleBinding/rbd-csi-provisioner-role
  DaemonSet/ceph-2/csi-rbdplugin
  Deployment/ceph-2/csi-rbdplugin-provisioner
  Role/ceph-2/rbd-external-provisioner-cfg
  RoleBinding/ceph-2/rbd-csi-provisioner-role-cfg
  Secret/ceph-2/csi-rbd-secret
  Service/ceph-2/csi-metrics-rbdplugin
  Service/ceph-2/csi-rbdplugin-provisioner
  ServiceAccount/ceph-2/rbd-csi-nodeplugin
  ServiceAccount/ceph-2/rbd-csi-provisioner
  StorageClass/ceph-ext4
  StorageClass/ceph-xfs

• Each charm (not just the leader) can check for these conflicts and report to the user in juju status