Advertisement
Guest User

Untitled

a guest
Dec 14th, 2018
73
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 123.46 KB | None | 0 0
  1. kubectl logs openebs-provisioner-58887bfcf5-pvjqm --namespace openebs
  2. I1214 09:43:37.093081 1 volume.go:73] OpenEBS volume provisioner namespace openebs
  3. I1214 09:43:37.098322 1 leaderelection.go:187] attempting to acquire leader lease openebs/openebs.io-provisioner-iscsi...
  4. I1214 09:43:37.110491 1 leaderelection.go:196] successfully acquired lease openebs/openebs.io-provisioner-iscsi
  5. I1214 09:43:37.110661 1 controller.go:636] Starting provisioner controller openebs.io/provisioner-iscsi_openebs-provisioner-58887bfcf5-pvjqm_bae2a22c-ff84-11e8-ab56-3edc1dbd5eaf!
  6. I1214 09:43:37.111061 1 event.go:221] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"openebs", Name:"openebs.io-provisioner-iscsi", UID:"bae118ed-ff84-11e8-af52-0050569bbc99", APIVersion:"v1", ResourceVersion:"704732", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' openebs-provisioner-58887bfcf5-pvjqm_bae2a22c-ff84-11e8-ab56-3edc1dbd5eaf became leader
  7. I1214 09:43:37.210852 1 controller.go:685] Started provisioner controller openebs.io/provisioner-iscsi_openebs-provisioner-58887bfcf5-pvjqm_bae2a22c-ff84-11e8-ab56-3edc1dbd5eaf!
  8. I1214 09:54:14.925910 1 controller.go:991] provision "default/demo-vol1-claim" class "openebs-jiva-default": started
  9. I1214 09:54:14.934608 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"370b3b31-ff86-11e8-af52-0050569bbc99", APIVersion:"v1", ResourceVersion:"706564", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/demo-vol1-claim"
  10. E1214 09:54:14.972020 1 volume.go:170] HTTP Status error from maya-apiserver: Not Found
  11. I1214 09:54:14.972278 1 volume.go:105] CAS Volume Spec Created:
  12. {"metadata":{"name":"pvc-370b3b31-ff86-11e8-af52-0050569bbc99","namespace":"default","creationTimestamp":null,"labels":{"openebs.io/namespace":"default","openebs.io/persistentvolumeclaim":"demo-vol1-claim","openebs.io/storageclass":"openebs-jiva-default"}},"spec":{"capacity":"4G","iqn":"","targetPortal":"","targetIP":"","targetPort":"","replicas":"","casType":"","fsType":"","lun":0},"cloneSpec":{},"status":{"Phase":"","Message":"","Reason":""}}
  13. I1214 09:54:15.092682 1 volume.go:132] volume Successfully Created:
  14. {"apiVersion":"v1alpha1","kind":"CASVolume","metadata":{"annotations":{"openebs.io/storageclass-version":"704640"},"name":"pvc-370b3b31-ff86-11e8-af52-0050569bbc99"},"spec":{"capacity":"4G","casType":"jiva","fsType":"","iqn":"iqn.2016-09.com.openebs.jiva:pvc-370b3b31-ff86-11e8-af52-0050569bbc99","lun":0,"replicas":"3","targetIP":"\u003cno value\u003e","targetPort":"3260","targetPortal":"10.105.81.141:3260"},"status":{"Message":"","Phase":"","Reason":""}}
  15. E1214 09:54:15.169247 1 volume.go:170] HTTP Status error from maya-apiserver: Not Found
  16. E1214 09:54:15.169430 1 cas_provision.go:123] Failed to read volume: Not Found
  17. W1214 09:54:15.169744 1 controller.go:750] Retrying syncing claim "default/demo-vol1-claim" because failures 0 < threshold 15
  18. E1214 09:54:15.169794 1 controller.go:765] error syncing claim "default/demo-vol1-claim": failed to provision volume with StorageClass "openebs-jiva-default": Not Found
  19. I1214 09:54:15.169922 1 controller.go:991] provision "default/demo-vol1-claim" class "openebs-jiva-default": started
  20. I1214 09:54:15.170221 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"370b3b31-ff86-11e8-af52-0050569bbc99", APIVersion:"v1", ResourceVersion:"706564", FieldPath:""}): type: 'Warning' reason: 'ProvisioningFailed' failed to provision volume with StorageClass "openebs-jiva-default": Not Found
  21. I1214 09:54:15.191968 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"370b3b31-ff86-11e8-af52-0050569bbc99", APIVersion:"v1", ResourceVersion:"706567", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/demo-vol1-claim"
  22. E1214 09:54:15.265298 1 volume.go:170] HTTP Status error from maya-apiserver: Not Found
  23. I1214 09:54:15.265425 1 volume.go:105] CAS Volume Spec Created:
  24. {"metadata":{"name":"pvc-370b3b31-ff86-11e8-af52-0050569bbc99","namespace":"default","creationTimestamp":null,"labels":{"openebs.io/namespace":"default","openebs.io/persistentvolumeclaim":"demo-vol1-claim","openebs.io/storageclass":"openebs-jiva-default"}},"spec":{"capacity":"4G","iqn":"","targetPortal":"","targetIP":"","targetPort":"","replicas":"","casType":"","fsType":"","lun":0},"cloneSpec":{},"status":{"Phase":"","Message":"","Reason":""}}
  25. E1214 09:54:15.363291 1 volume.go:128] Internal Server Error: failed to create volume 'pvc-370b3b31-ff86-11e8-af52-0050569bbc99': response: services "pvc-370b3b31-ff86-11e8-af52-0050569bbc99-ctrl-svc" already exists
  26. E1214 09:54:15.363321 1 cas_provision.go:118] Failed to create volume: {PersistentVolumeReclaimPolicy:Delete PVName:pvc-370b3b31-ff86-11e8-af52-0050569bbc99 MountOptions:[] PVC:&PersistentVolumeClaim{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:demo-vol1-claim,GenerateName:,Namespace:default,SelfLink:/api/v1/namespaces/default/persistentvolumeclaims/demo-vol1-claim,UID:370b3b31-ff86-11e8-af52-0050569bbc99,ResourceVersion:706567,Generation:0,CreationTimestamp:2018-12-14 09:54:14 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{kubectl.kubernetes.io/last-applied-configuration: {"apiVersion":"v1","kind":"PersistentVolumeClaim","metadata":{"annotations":{},"name":"demo-vol1-claim","namespace":"default"},"spec":{"accessModes":["ReadWriteOnce"],"resources":{"requests":{"storage":"4G"}},"storageClassName":"openebs-jiva-default"}}
  27. ,volume.beta.kubernetes.io/storage-provisioner: openebs.io/provisioner-iscsi,},OwnerReferences:[],Finalizers:[kubernetes.io/pvc-protection],ClusterName:,Initializers:nil,},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{4 9} {<nil>} 4G DecimalSI},},},VolumeName:,Selector:nil,StorageClassName:*openebs-jiva-default,VolumeMode:nil,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:ResourceList{},Conditions:[],},} Parameters:map[] SelectedNode:nil AllowedTopologies:[]}, error: Internal Server Error: failed to create volume 'pvc-370b3b31-ff86-11e8-af52-0050569bbc99': response: services "pvc-370b3b31-ff86-11e8-af52-0050569bbc99-ctrl-svc" already exists
  28. W1214 09:54:15.363506 1 controller.go:750] Retrying syncing claim "default/demo-vol1-claim" because failures 1 < threshold 15
  29. E1214 09:54:15.363530 1 controller.go:765] error syncing claim "default/demo-vol1-claim": failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-370b3b31-ff86-11e8-af52-0050569bbc99': response: services "pvc-370b3b31-ff86-11e8-af52-0050569bbc99-ctrl-svc" already exists
  30. I1214 09:54:15.363601 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"370b3b31-ff86-11e8-af52-0050569bbc99", APIVersion:"v1", ResourceVersion:"706567", FieldPath:""}): type: 'Warning' reason: 'ProvisioningFailed' failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-370b3b31-ff86-11e8-af52-0050569bbc99': response: services "pvc-370b3b31-ff86-11e8-af52-0050569bbc99-ctrl-svc" already exists
  31. I1214 09:54:30.170013 1 controller.go:991] provision "default/demo-vol1-claim" class "openebs-jiva-default": started
  32. I1214 09:54:30.173326 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"370b3b31-ff86-11e8-af52-0050569bbc99", APIVersion:"v1", ResourceVersion:"706567", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/demo-vol1-claim"
  33. E1214 09:54:30.234203 1 volume.go:170] HTTP Status error from maya-apiserver: Not Found
  34. I1214 09:54:30.234364 1 volume.go:105] CAS Volume Spec Created:
  35. {"metadata":{"name":"pvc-370b3b31-ff86-11e8-af52-0050569bbc99","namespace":"default","creationTimestamp":null,"labels":{"openebs.io/namespace":"default","openebs.io/persistentvolumeclaim":"demo-vol1-claim","openebs.io/storageclass":"openebs-jiva-default"}},"spec":{"capacity":"4G","iqn":"","targetPortal":"","targetIP":"","targetPort":"","replicas":"","casType":"","fsType":"","lun":0},"cloneSpec":{},"status":{"Phase":"","Message":"","Reason":""}}
  36. E1214 09:54:30.320038 1 volume.go:128] Internal Server Error: failed to create volume 'pvc-370b3b31-ff86-11e8-af52-0050569bbc99': response: services "pvc-370b3b31-ff86-11e8-af52-0050569bbc99-ctrl-svc" already exists
  37. E1214 09:54:30.320075 1 cas_provision.go:118] Failed to create volume: {PersistentVolumeReclaimPolicy:Delete PVName:pvc-370b3b31-ff86-11e8-af52-0050569bbc99 MountOptions:[] PVC:&PersistentVolumeClaim{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:demo-vol1-claim,GenerateName:,Namespace:default,SelfLink:/api/v1/namespaces/default/persistentvolumeclaims/demo-vol1-claim,UID:370b3b31-ff86-11e8-af52-0050569bbc99,ResourceVersion:706567,Generation:0,CreationTimestamp:2018-12-14 09:54:14 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{kubectl.kubernetes.io/last-applied-configuration: {"apiVersion":"v1","kind":"PersistentVolumeClaim","metadata":{"annotations":{},"name":"demo-vol1-claim","namespace":"default"},"spec":{"accessModes":["ReadWriteOnce"],"resources":{"requests":{"storage":"4G"}},"storageClassName":"openebs-jiva-default"}}
  38. ,volume.beta.kubernetes.io/storage-provisioner: openebs.io/provisioner-iscsi,},OwnerReferences:[],Finalizers:[kubernetes.io/pvc-protection],ClusterName:,Initializers:nil,},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{4 9} {<nil>} 4G DecimalSI},},},VolumeName:,Selector:nil,StorageClassName:*openebs-jiva-default,VolumeMode:nil,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:ResourceList{},Conditions:[],},} Parameters:map[] SelectedNode:nil AllowedTopologies:[]}, error: Internal Server Error: failed to create volume 'pvc-370b3b31-ff86-11e8-af52-0050569bbc99': response: services "pvc-370b3b31-ff86-11e8-af52-0050569bbc99-ctrl-svc" already exists
  39. W1214 09:54:30.320245 1 controller.go:750] Retrying syncing claim "default/demo-vol1-claim" because failures 2 < threshold 15
  40. E1214 09:54:30.320271 1 controller.go:765] error syncing claim "default/demo-vol1-claim": failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-370b3b31-ff86-11e8-af52-0050569bbc99': response: services "pvc-370b3b31-ff86-11e8-af52-0050569bbc99-ctrl-svc" already exists
  41. I1214 09:54:30.320333 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"370b3b31-ff86-11e8-af52-0050569bbc99", APIVersion:"v1", ResourceVersion:"706567", FieldPath:""}): type: 'Warning' reason: 'ProvisioningFailed' failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-370b3b31-ff86-11e8-af52-0050569bbc99': response: services "pvc-370b3b31-ff86-11e8-af52-0050569bbc99-ctrl-svc" already exists
  42. I1214 09:55:30.320537 1 controller.go:991] provision "default/demo-vol1-claim" class "openebs-jiva-default": started
  43. I1214 09:55:30.324084 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"370b3b31-ff86-11e8-af52-0050569bbc99", APIVersion:"v1", ResourceVersion:"706567", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/demo-vol1-claim"
  44. E1214 09:55:30.371713 1 volume.go:170] HTTP Status error from maya-apiserver: Not Found
  45. I1214 09:55:30.371885 1 volume.go:105] CAS Volume Spec Created:
  46. {"metadata":{"name":"pvc-370b3b31-ff86-11e8-af52-0050569bbc99","namespace":"default","creationTimestamp":null,"labels":{"openebs.io/namespace":"default","openebs.io/persistentvolumeclaim":"demo-vol1-claim","openebs.io/storageclass":"openebs-jiva-default"}},"spec":{"capacity":"4G","iqn":"","targetPortal":"","targetIP":"","targetPort":"","replicas":"","casType":"","fsType":"","lun":0},"cloneSpec":{},"status":{"Phase":"","Message":"","Reason":""}}
  47. E1214 09:55:30.456393 1 volume.go:128] Internal Server Error: failed to create volume 'pvc-370b3b31-ff86-11e8-af52-0050569bbc99': response: services "pvc-370b3b31-ff86-11e8-af52-0050569bbc99-ctrl-svc" already exists
  48. E1214 09:55:30.456452 1 cas_provision.go:118] Failed to create volume: {PersistentVolumeReclaimPolicy:Delete PVName:pvc-370b3b31-ff86-11e8-af52-0050569bbc99 MountOptions:[] PVC:&PersistentVolumeClaim{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:demo-vol1-claim,GenerateName:,Namespace:default,SelfLink:/api/v1/namespaces/default/persistentvolumeclaims/demo-vol1-claim,UID:370b3b31-ff86-11e8-af52-0050569bbc99,ResourceVersion:706567,Generation:0,CreationTimestamp:2018-12-14 09:54:14 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{kubectl.kubernetes.io/last-applied-configuration: {"apiVersion":"v1","kind":"PersistentVolumeClaim","metadata":{"annotations":{},"name":"demo-vol1-claim","namespace":"default"},"spec":{"accessModes":["ReadWriteOnce"],"resources":{"requests":{"storage":"4G"}},"storageClassName":"openebs-jiva-default"}}
  49. ,volume.beta.kubernetes.io/storage-provisioner: openebs.io/provisioner-iscsi,},OwnerReferences:[],Finalizers:[kubernetes.io/pvc-protection],ClusterName:,Initializers:nil,},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{4 9} {<nil>} 4G DecimalSI},},},VolumeName:,Selector:nil,StorageClassName:*openebs-jiva-default,VolumeMode:nil,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:ResourceList{},Conditions:[],},} Parameters:map[] SelectedNode:nil AllowedTopologies:[]}, error: Internal Server Error: failed to create volume 'pvc-370b3b31-ff86-11e8-af52-0050569bbc99': response: services "pvc-370b3b31-ff86-11e8-af52-0050569bbc99-ctrl-svc" already exists
  50. W1214 09:55:30.456668 1 controller.go:750] Retrying syncing claim "default/demo-vol1-claim" because failures 3 < threshold 15
  51. E1214 09:55:30.456702 1 controller.go:765] error syncing claim "default/demo-vol1-claim": failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-370b3b31-ff86-11e8-af52-0050569bbc99': response: services "pvc-370b3b31-ff86-11e8-af52-0050569bbc99-ctrl-svc" already exists
  52. I1214 09:55:30.456828 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"370b3b31-ff86-11e8-af52-0050569bbc99", APIVersion:"v1", ResourceVersion:"706567", FieldPath:""}): type: 'Warning' reason: 'ProvisioningFailed' failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-370b3b31-ff86-11e8-af52-0050569bbc99': response: services "pvc-370b3b31-ff86-11e8-af52-0050569bbc99-ctrl-svc" already exists
  53. I1214 09:57:30.456982 1 controller.go:991] provision "default/demo-vol1-claim" class "openebs-jiva-default": started
  54. I1214 09:57:30.460502 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"370b3b31-ff86-11e8-af52-0050569bbc99", APIVersion:"v1", ResourceVersion:"706567", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/demo-vol1-claim"
  55. E1214 09:57:30.505061 1 volume.go:170] HTTP Status error from maya-apiserver: Not Found
  56. I1214 09:57:30.505205 1 volume.go:105] CAS Volume Spec Created:
  57. {"metadata":{"name":"pvc-370b3b31-ff86-11e8-af52-0050569bbc99","namespace":"default","creationTimestamp":null,"labels":{"openebs.io/namespace":"default","openebs.io/persistentvolumeclaim":"demo-vol1-claim","openebs.io/storageclass":"openebs-jiva-default"}},"spec":{"capacity":"4G","iqn":"","targetPortal":"","targetIP":"","targetPort":"","replicas":"","casType":"","fsType":"","lun":0},"cloneSpec":{},"status":{"Phase":"","Message":"","Reason":""}}
  58. E1214 09:57:30.595130 1 volume.go:128] Internal Server Error: failed to create volume 'pvc-370b3b31-ff86-11e8-af52-0050569bbc99': response: services "pvc-370b3b31-ff86-11e8-af52-0050569bbc99-ctrl-svc" already exists
  59. E1214 09:57:30.595161 1 cas_provision.go:118] Failed to create volume: {PersistentVolumeReclaimPolicy:Delete PVName:pvc-370b3b31-ff86-11e8-af52-0050569bbc99 MountOptions:[] PVC:&PersistentVolumeClaim{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:demo-vol1-claim,GenerateName:,Namespace:default,SelfLink:/api/v1/namespaces/default/persistentvolumeclaims/demo-vol1-claim,UID:370b3b31-ff86-11e8-af52-0050569bbc99,ResourceVersion:706567,Generation:0,CreationTimestamp:2018-12-14 09:54:14 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{kubectl.kubernetes.io/last-applied-configuration: {"apiVersion":"v1","kind":"PersistentVolumeClaim","metadata":{"annotations":{},"name":"demo-vol1-claim","namespace":"default"},"spec":{"accessModes":["ReadWriteOnce"],"resources":{"requests":{"storage":"4G"}},"storageClassName":"openebs-jiva-default"}}
  60. ,volume.beta.kubernetes.io/storage-provisioner: openebs.io/provisioner-iscsi,},OwnerReferences:[],Finalizers:[kubernetes.io/pvc-protection],ClusterName:,Initializers:nil,},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{4 9} {<nil>} 4G DecimalSI},},},VolumeName:,Selector:nil,StorageClassName:*openebs-jiva-default,VolumeMode:nil,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:ResourceList{},Conditions:[],},} Parameters:map[] SelectedNode:nil AllowedTopologies:[]}, error: Internal Server Error: failed to create volume 'pvc-370b3b31-ff86-11e8-af52-0050569bbc99': response: services "pvc-370b3b31-ff86-11e8-af52-0050569bbc99-ctrl-svc" already exists
  61. W1214 09:57:30.595286 1 controller.go:750] Retrying syncing claim "default/demo-vol1-claim" because failures 4 < threshold 15
  62. E1214 09:57:30.595307 1 controller.go:765] error syncing claim "default/demo-vol1-claim": failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-370b3b31-ff86-11e8-af52-0050569bbc99': response: services "pvc-370b3b31-ff86-11e8-af52-0050569bbc99-ctrl-svc" already exists
  63. I1214 09:57:30.595542 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"370b3b31-ff86-11e8-af52-0050569bbc99", APIVersion:"v1", ResourceVersion:"706567", FieldPath:""}): type: 'Warning' reason: 'ProvisioningFailed' failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-370b3b31-ff86-11e8-af52-0050569bbc99': response: services "pvc-370b3b31-ff86-11e8-af52-0050569bbc99-ctrl-svc" already exists
  64. I1214 10:01:30.595541 1 controller.go:991] provision "default/demo-vol1-claim" class "openebs-jiva-default": started
  65. I1214 10:01:30.599007 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"370b3b31-ff86-11e8-af52-0050569bbc99", APIVersion:"v1", ResourceVersion:"706567", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/demo-vol1-claim"
  66. E1214 10:01:30.647865 1 volume.go:170] HTTP Status error from maya-apiserver: Not Found
  67. I1214 10:01:30.648033 1 volume.go:105] CAS Volume Spec Created:
  68. {"metadata":{"name":"pvc-370b3b31-ff86-11e8-af52-0050569bbc99","namespace":"default","creationTimestamp":null,"labels":{"openebs.io/namespace":"default","openebs.io/persistentvolumeclaim":"demo-vol1-claim","openebs.io/storageclass":"openebs-jiva-default"}},"spec":{"capacity":"4G","iqn":"","targetPortal":"","targetIP":"","targetPort":"","replicas":"","casType":"","fsType":"","lun":0},"cloneSpec":{},"status":{"Phase":"","Message":"","Reason":""}}
  69. E1214 10:01:30.739573 1 volume.go:128] Internal Server Error: failed to create volume 'pvc-370b3b31-ff86-11e8-af52-0050569bbc99': response: services "pvc-370b3b31-ff86-11e8-af52-0050569bbc99-ctrl-svc" already exists
  70. E1214 10:01:30.739605 1 cas_provision.go:118] Failed to create volume: {PersistentVolumeReclaimPolicy:Delete PVName:pvc-370b3b31-ff86-11e8-af52-0050569bbc99 MountOptions:[] PVC:&PersistentVolumeClaim{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:demo-vol1-claim,GenerateName:,Namespace:default,SelfLink:/api/v1/namespaces/default/persistentvolumeclaims/demo-vol1-claim,UID:370b3b31-ff86-11e8-af52-0050569bbc99,ResourceVersion:706567,Generation:0,CreationTimestamp:2018-12-14 09:54:14 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{kubectl.kubernetes.io/last-applied-configuration: {"apiVersion":"v1","kind":"PersistentVolumeClaim","metadata":{"annotations":{},"name":"demo-vol1-claim","namespace":"default"},"spec":{"accessModes":["ReadWriteOnce"],"resources":{"requests":{"storage":"4G"}},"storageClassName":"openebs-jiva-default"}}
  71. ,volume.beta.kubernetes.io/storage-provisioner: openebs.io/provisioner-iscsi,},OwnerReferences:[],Finalizers:[kubernetes.io/pvc-protection],ClusterName:,Initializers:nil,},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{4 9} {<nil>} 4G DecimalSI},},},VolumeName:,Selector:nil,StorageClassName:*openebs-jiva-default,VolumeMode:nil,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:ResourceList{},Conditions:[],},} Parameters:map[] SelectedNode:nil AllowedTopologies:[]}, error: Internal Server Error: failed to create volume 'pvc-370b3b31-ff86-11e8-af52-0050569bbc99': response: services "pvc-370b3b31-ff86-11e8-af52-0050569bbc99-ctrl-svc" already exists
  72. W1214 10:01:30.739892 1 controller.go:750] Retrying syncing claim "default/demo-vol1-claim" because failures 5 < threshold 15
  73. E1214 10:01:30.739920 1 controller.go:765] error syncing claim "default/demo-vol1-claim": failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-370b3b31-ff86-11e8-af52-0050569bbc99': response: services "pvc-370b3b31-ff86-11e8-af52-0050569bbc99-ctrl-svc" already exists
  74. I1214 10:01:30.739994 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"370b3b31-ff86-11e8-af52-0050569bbc99", APIVersion:"v1", ResourceVersion:"706567", FieldPath:""}): type: 'Warning' reason: 'ProvisioningFailed' failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-370b3b31-ff86-11e8-af52-0050569bbc99': response: services "pvc-370b3b31-ff86-11e8-af52-0050569bbc99-ctrl-svc" already exists
  75. I1214 10:02:20.835216 1 controller.go:991] provision "default/demo-vol1-claim" class "openebs-jiva-default": started
  76. I1214 10:02:20.838615 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"5037a42f-ff87-11e8-af52-0050569bbc99", APIVersion:"v1", ResourceVersion:"708036", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/demo-vol1-claim"
  77. E1214 10:02:20.879013 1 volume.go:170] HTTP Status error from maya-apiserver: Not Found
  78. I1214 10:02:20.879166 1 volume.go:105] CAS Volume Spec Created:
  79. {"metadata":{"name":"pvc-5037a42f-ff87-11e8-af52-0050569bbc99","namespace":"default","creationTimestamp":null,"labels":{"openebs.io/namespace":"default","openebs.io/persistentvolumeclaim":"demo-vol1-claim","openebs.io/storageclass":"openebs-jiva-default"}},"spec":{"capacity":"4G","iqn":"","targetPortal":"","targetIP":"","targetPort":"","replicas":"","casType":"","fsType":"","lun":0},"cloneSpec":{},"status":{"Phase":"","Message":"","Reason":""}}
  80. I1214 10:02:20.981788 1 volume.go:132] volume Successfully Created:
  81. {"apiVersion":"v1alpha1","kind":"CASVolume","metadata":{"annotations":{"openebs.io/storageclass-version":"704640"},"name":"pvc-5037a42f-ff87-11e8-af52-0050569bbc99"},"spec":{"capacity":"4G","casType":"jiva","fsType":"","iqn":"iqn.2016-09.com.openebs.jiva:pvc-5037a42f-ff87-11e8-af52-0050569bbc99","lun":0,"replicas":"3","targetIP":"\u003cno value\u003e","targetPort":"3260","targetPortal":"10.108.47.39:3260"},"status":{"Message":"","Phase":"","Reason":""}}
  82. E1214 10:02:21.046173 1 volume.go:170] HTTP Status error from maya-apiserver: Not Found
  83. E1214 10:02:21.046313 1 cas_provision.go:123] Failed to read volume: Not Found
  84. W1214 10:02:21.046452 1 controller.go:750] Retrying syncing claim "default/demo-vol1-claim" because failures 0 < threshold 15
  85. E1214 10:02:21.046535 1 controller.go:765] error syncing claim "default/demo-vol1-claim": failed to provision volume with StorageClass "openebs-jiva-default": Not Found
  86. I1214 10:02:21.046490 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"5037a42f-ff87-11e8-af52-0050569bbc99", APIVersion:"v1", ResourceVersion:"708036", FieldPath:""}): type: 'Warning' reason: 'ProvisioningFailed' failed to provision volume with StorageClass "openebs-jiva-default": Not Found
  87. I1214 10:02:36.046738 1 controller.go:991] provision "default/demo-vol1-claim" class "openebs-jiva-default": started
  88. I1214 10:02:36.049762 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"5037a42f-ff87-11e8-af52-0050569bbc99", APIVersion:"v1", ResourceVersion:"708036", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/demo-vol1-claim"
  89. E1214 10:02:36.103653 1 volume.go:170] HTTP Status error from maya-apiserver: Not Found
  90. I1214 10:02:36.103909 1 volume.go:105] CAS Volume Spec Created:
  91. {"metadata":{"name":"pvc-5037a42f-ff87-11e8-af52-0050569bbc99","namespace":"default","creationTimestamp":null,"labels":{"openebs.io/namespace":"default","openebs.io/persistentvolumeclaim":"demo-vol1-claim","openebs.io/storageclass":"openebs-jiva-default"}},"spec":{"capacity":"4G","iqn":"","targetPortal":"","targetIP":"","targetPort":"","replicas":"","casType":"","fsType":"","lun":0},"cloneSpec":{},"status":{"Phase":"","Message":"","Reason":""}}
  92. E1214 10:02:36.218171 1 volume.go:128] Internal Server Error: failed to create volume 'pvc-5037a42f-ff87-11e8-af52-0050569bbc99': response: services "pvc-5037a42f-ff87-11e8-af52-0050569bbc99-ctrl-svc" already exists
  93. E1214 10:02:36.218203 1 cas_provision.go:118] Failed to create volume: {PersistentVolumeReclaimPolicy:Delete PVName:pvc-5037a42f-ff87-11e8-af52-0050569bbc99 MountOptions:[] PVC:&PersistentVolumeClaim{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:demo-vol1-claim,GenerateName:,Namespace:default,SelfLink:/api/v1/namespaces/default/persistentvolumeclaims/demo-vol1-claim,UID:5037a42f-ff87-11e8-af52-0050569bbc99,ResourceVersion:708036,Generation:0,CreationTimestamp:2018-12-14 10:02:06 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{kubectl.kubernetes.io/last-applied-configuration: {"apiVersion":"v1","kind":"PersistentVolumeClaim","metadata":{"annotations":{},"name":"demo-vol1-claim","namespace":"default"},"spec":{"accessModes":["ReadWriteOnce"],"resources":{"requests":{"storage":"4G"}},"storageClassName":"openebs-jiva-default"}}
  94. ,volume.beta.kubernetes.io/storage-provisioner: openebs.io/provisioner-iscsi,},OwnerReferences:[],Finalizers:[kubernetes.io/pvc-protection],ClusterName:,Initializers:nil,},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{4 9} {<nil>} 4G DecimalSI},},},VolumeName:,Selector:nil,StorageClassName:*openebs-jiva-default,VolumeMode:nil,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:ResourceList{},Conditions:[],},} Parameters:map[] SelectedNode:nil AllowedTopologies:[]}, error: Internal Server Error: failed to create volume 'pvc-5037a42f-ff87-11e8-af52-0050569bbc99': response: services "pvc-5037a42f-ff87-11e8-af52-0050569bbc99-ctrl-svc" already exists
  95. W1214 10:02:36.218381 1 controller.go:750] Retrying syncing claim "default/demo-vol1-claim" because failures 1 < threshold 15
  96. E1214 10:02:36.218406 1 controller.go:765] error syncing claim "default/demo-vol1-claim": failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-5037a42f-ff87-11e8-af52-0050569bbc99': response: services "pvc-5037a42f-ff87-11e8-af52-0050569bbc99-ctrl-svc" already exists
  97. I1214 10:02:36.218469 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"5037a42f-ff87-11e8-af52-0050569bbc99", APIVersion:"v1", ResourceVersion:"708036", FieldPath:""}): type: 'Warning' reason: 'ProvisioningFailed' failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-5037a42f-ff87-11e8-af52-0050569bbc99': response: services "pvc-5037a42f-ff87-11e8-af52-0050569bbc99-ctrl-svc" already exists
  98. I1214 10:03:06.218600 1 controller.go:991] provision "default/demo-vol1-claim" class "openebs-jiva-default": started
  99. I1214 10:03:06.222021 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"5037a42f-ff87-11e8-af52-0050569bbc99", APIVersion:"v1", ResourceVersion:"708036", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/demo-vol1-claim"
  100. E1214 10:03:06.262768 1 volume.go:170] HTTP Status error from maya-apiserver: Not Found
  101. I1214 10:03:06.263053 1 volume.go:105] CAS Volume Spec Created:
  102. {"metadata":{"name":"pvc-5037a42f-ff87-11e8-af52-0050569bbc99","namespace":"default","creationTimestamp":null,"labels":{"openebs.io/namespace":"default","openebs.io/persistentvolumeclaim":"demo-vol1-claim","openebs.io/storageclass":"openebs-jiva-default"}},"spec":{"capacity":"4G","iqn":"","targetPortal":"","targetIP":"","targetPort":"","replicas":"","casType":"","fsType":"","lun":0},"cloneSpec":{},"status":{"Phase":"","Message":"","Reason":""}}
  103. E1214 10:03:06.361269 1 volume.go:128] Internal Server Error: failed to create volume 'pvc-5037a42f-ff87-11e8-af52-0050569bbc99': response: services "pvc-5037a42f-ff87-11e8-af52-0050569bbc99-ctrl-svc" already exists
  104. E1214 10:03:06.361359 1 cas_provision.go:118] Failed to create volume: {PersistentVolumeReclaimPolicy:Delete PVName:pvc-5037a42f-ff87-11e8-af52-0050569bbc99 MountOptions:[] PVC:&PersistentVolumeClaim{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:demo-vol1-claim,GenerateName:,Namespace:default,SelfLink:/api/v1/namespaces/default/persistentvolumeclaims/demo-vol1-claim,UID:5037a42f-ff87-11e8-af52-0050569bbc99,ResourceVersion:708036,Generation:0,CreationTimestamp:2018-12-14 10:02:06 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{kubectl.kubernetes.io/last-applied-configuration: {"apiVersion":"v1","kind":"PersistentVolumeClaim","metadata":{"annotations":{},"name":"demo-vol1-claim","namespace":"default"},"spec":{"accessModes":["ReadWriteOnce"],"resources":{"requests":{"storage":"4G"}},"storageClassName":"openebs-jiva-default"}}
  105. ,volume.beta.kubernetes.io/storage-provisioner: openebs.io/provisioner-iscsi,},OwnerReferences:[],Finalizers:[kubernetes.io/pvc-protection],ClusterName:,Initializers:nil,},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{4 9} {<nil>} 4G DecimalSI},},},VolumeName:,Selector:nil,StorageClassName:*openebs-jiva-default,VolumeMode:nil,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:ResourceList{},Conditions:[],},} Parameters:map[] SelectedNode:nil AllowedTopologies:[]}, error: Internal Server Error: failed to create volume 'pvc-5037a42f-ff87-11e8-af52-0050569bbc99': response: services "pvc-5037a42f-ff87-11e8-af52-0050569bbc99-ctrl-svc" already exists
  106. W1214 10:03:06.361613 1 controller.go:750] Retrying syncing claim "default/demo-vol1-claim" because failures 2 < threshold 15
  107. E1214 10:03:06.361674 1 controller.go:765] error syncing claim "default/demo-vol1-claim": failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-5037a42f-ff87-11e8-af52-0050569bbc99': response: services "pvc-5037a42f-ff87-11e8-af52-0050569bbc99-ctrl-svc" already exists
  108. I1214 10:03:06.361729 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"5037a42f-ff87-11e8-af52-0050569bbc99", APIVersion:"v1", ResourceVersion:"708036", FieldPath:""}): type: 'Warning' reason: 'ProvisioningFailed' failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-5037a42f-ff87-11e8-af52-0050569bbc99': response: services "pvc-5037a42f-ff87-11e8-af52-0050569bbc99-ctrl-svc" already exists
  109. I1214 10:04:06.361872 1 controller.go:991] provision "default/demo-vol1-claim" class "openebs-jiva-default": started
  110. I1214 10:04:06.365380 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"5037a42f-ff87-11e8-af52-0050569bbc99", APIVersion:"v1", ResourceVersion:"708036", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/demo-vol1-claim"
  111. E1214 10:04:06.406631 1 volume.go:170] HTTP Status error from maya-apiserver: Not Found
  112. I1214 10:04:06.406789 1 volume.go:105] CAS Volume Spec Created:
  113. {"metadata":{"name":"pvc-5037a42f-ff87-11e8-af52-0050569bbc99","namespace":"default","creationTimestamp":null,"labels":{"openebs.io/namespace":"default","openebs.io/persistentvolumeclaim":"demo-vol1-claim","openebs.io/storageclass":"openebs-jiva-default"}},"spec":{"capacity":"4G","iqn":"","targetPortal":"","targetIP":"","targetPort":"","replicas":"","casType":"","fsType":"","lun":0},"cloneSpec":{},"status":{"Phase":"","Message":"","Reason":""}}
  114. E1214 10:04:06.537635 1 volume.go:128] Internal Server Error: failed to create volume 'pvc-5037a42f-ff87-11e8-af52-0050569bbc99': response: services "pvc-5037a42f-ff87-11e8-af52-0050569bbc99-ctrl-svc" already exists
  115. E1214 10:04:06.537665 1 cas_provision.go:118] Failed to create volume: {PersistentVolumeReclaimPolicy:Delete PVName:pvc-5037a42f-ff87-11e8-af52-0050569bbc99 MountOptions:[] PVC:&PersistentVolumeClaim{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:demo-vol1-claim,GenerateName:,Namespace:default,SelfLink:/api/v1/namespaces/default/persistentvolumeclaims/demo-vol1-claim,UID:5037a42f-ff87-11e8-af52-0050569bbc99,ResourceVersion:708036,Generation:0,CreationTimestamp:2018-12-14 10:02:06 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{kubectl.kubernetes.io/last-applied-configuration: {"apiVersion":"v1","kind":"PersistentVolumeClaim","metadata":{"annotations":{},"name":"demo-vol1-claim","namespace":"default"},"spec":{"accessModes":["ReadWriteOnce"],"resources":{"requests":{"storage":"4G"}},"storageClassName":"openebs-jiva-default"}}
  116. ,volume.beta.kubernetes.io/storage-provisioner: openebs.io/provisioner-iscsi,},OwnerReferences:[],Finalizers:[kubernetes.io/pvc-protection],ClusterName:,Initializers:nil,},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{4 9} {<nil>} 4G DecimalSI},},},VolumeName:,Selector:nil,StorageClassName:*openebs-jiva-default,VolumeMode:nil,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:ResourceList{},Conditions:[],},} Parameters:map[] SelectedNode:nil AllowedTopologies:[]}, error: Internal Server Error: failed to create volume 'pvc-5037a42f-ff87-11e8-af52-0050569bbc99': response: services "pvc-5037a42f-ff87-11e8-af52-0050569bbc99-ctrl-svc" already exists
  117. W1214 10:04:06.537821 1 controller.go:750] Retrying syncing claim "default/demo-vol1-claim" because failures 3 < threshold 15
  118. E1214 10:04:06.537846 1 controller.go:765] error syncing claim "default/demo-vol1-claim": failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-5037a42f-ff87-11e8-af52-0050569bbc99': response: services "pvc-5037a42f-ff87-11e8-af52-0050569bbc99-ctrl-svc" already exists
  119. I1214 10:04:06.537915 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"5037a42f-ff87-11e8-af52-0050569bbc99", APIVersion:"v1", ResourceVersion:"708036", FieldPath:""}): type: 'Warning' reason: 'ProvisioningFailed' failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-5037a42f-ff87-11e8-af52-0050569bbc99': response: services "pvc-5037a42f-ff87-11e8-af52-0050569bbc99-ctrl-svc" already exists
  120. I1214 10:06:06.538056 1 controller.go:991] provision "default/demo-vol1-claim" class "openebs-jiva-default": started
  121. I1214 10:06:06.541856 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"5037a42f-ff87-11e8-af52-0050569bbc99", APIVersion:"v1", ResourceVersion:"708036", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/demo-vol1-claim"
  122. E1214 10:06:06.587909 1 volume.go:170] HTTP Status error from maya-apiserver: Not Found
  123. I1214 10:06:06.588094 1 volume.go:105] CAS Volume Spec Created:
  124. {"metadata":{"name":"pvc-5037a42f-ff87-11e8-af52-0050569bbc99","namespace":"default","creationTimestamp":null,"labels":{"openebs.io/namespace":"default","openebs.io/persistentvolumeclaim":"demo-vol1-claim","openebs.io/storageclass":"openebs-jiva-default"}},"spec":{"capacity":"4G","iqn":"","targetPortal":"","targetIP":"","targetPort":"","replicas":"","casType":"","fsType":"","lun":0},"cloneSpec":{},"status":{"Phase":"","Message":"","Reason":""}}
  125. E1214 10:06:06.670939 1 volume.go:128] Internal Server Error: failed to create volume 'pvc-5037a42f-ff87-11e8-af52-0050569bbc99': response: services "pvc-5037a42f-ff87-11e8-af52-0050569bbc99-ctrl-svc" already exists
  126. E1214 10:06:06.671007 1 cas_provision.go:118] Failed to create volume: {PersistentVolumeReclaimPolicy:Delete PVName:pvc-5037a42f-ff87-11e8-af52-0050569bbc99 MountOptions:[] PVC:&PersistentVolumeClaim{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:demo-vol1-claim,GenerateName:,Namespace:default,SelfLink:/api/v1/namespaces/default/persistentvolumeclaims/demo-vol1-claim,UID:5037a42f-ff87-11e8-af52-0050569bbc99,ResourceVersion:708036,Generation:0,CreationTimestamp:2018-12-14 10:02:06 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{kubectl.kubernetes.io/last-applied-configuration: {"apiVersion":"v1","kind":"PersistentVolumeClaim","metadata":{"annotations":{},"name":"demo-vol1-claim","namespace":"default"},"spec":{"accessModes":["ReadWriteOnce"],"resources":{"requests":{"storage":"4G"}},"storageClassName":"openebs-jiva-default"}}
  127. ,volume.beta.kubernetes.io/storage-provisioner: openebs.io/provisioner-iscsi,},OwnerReferences:[],Finalizers:[kubernetes.io/pvc-protection],ClusterName:,Initializers:nil,},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{4 9} {<nil>} 4G DecimalSI},},},VolumeName:,Selector:nil,StorageClassName:*openebs-jiva-default,VolumeMode:nil,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:ResourceList{},Conditions:[],},} Parameters:map[] SelectedNode:nil AllowedTopologies:[]}, error: Internal Server Error: failed to create volume 'pvc-5037a42f-ff87-11e8-af52-0050569bbc99': response: services "pvc-5037a42f-ff87-11e8-af52-0050569bbc99-ctrl-svc" already exists
  128. W1214 10:06:06.671124 1 controller.go:750] Retrying syncing claim "default/demo-vol1-claim" because failures 4 < threshold 15
  129. E1214 10:06:06.671146 1 controller.go:765] error syncing claim "default/demo-vol1-claim": failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-5037a42f-ff87-11e8-af52-0050569bbc99': response: services "pvc-5037a42f-ff87-11e8-af52-0050569bbc99-ctrl-svc" already exists
  130. I1214 10:06:06.671230 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"5037a42f-ff87-11e8-af52-0050569bbc99", APIVersion:"v1", ResourceVersion:"708036", FieldPath:""}): type: 'Warning' reason: 'ProvisioningFailed' failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-5037a42f-ff87-11e8-af52-0050569bbc99': response: services "pvc-5037a42f-ff87-11e8-af52-0050569bbc99-ctrl-svc" already exists
  131. I1214 10:10:06.671395 1 controller.go:991] provision "default/demo-vol1-claim" class "openebs-jiva-default": started
  132. I1214 10:10:06.674837 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"5037a42f-ff87-11e8-af52-0050569bbc99", APIVersion:"v1", ResourceVersion:"708036", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/demo-vol1-claim"
  133. E1214 10:10:06.714209 1 volume.go:170] HTTP Status error from maya-apiserver: Not Found
  134. I1214 10:10:06.714401 1 volume.go:105] CAS Volume Spec Created:
  135. {"metadata":{"name":"pvc-5037a42f-ff87-11e8-af52-0050569bbc99","namespace":"default","creationTimestamp":null,"labels":{"openebs.io/namespace":"default","openebs.io/persistentvolumeclaim":"demo-vol1-claim","openebs.io/storageclass":"openebs-jiva-default"}},"spec":{"capacity":"4G","iqn":"","targetPortal":"","targetIP":"","targetPort":"","replicas":"","casType":"","fsType":"","lun":0},"cloneSpec":{},"status":{"Phase":"","Message":"","Reason":""}}
  136. E1214 10:10:06.836728 1 volume.go:128] Internal Server Error: failed to create volume 'pvc-5037a42f-ff87-11e8-af52-0050569bbc99': response: deployments.extensions "pvc-5037a42f-ff87-11e8-af52-0050569bbc99-rep" already exists
  137. E1214 10:10:06.836755 1 cas_provision.go:118] Failed to create volume: {PersistentVolumeReclaimPolicy:Delete PVName:pvc-5037a42f-ff87-11e8-af52-0050569bbc99 MountOptions:[] PVC:&PersistentVolumeClaim{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:demo-vol1-claim,GenerateName:,Namespace:default,SelfLink:/api/v1/namespaces/default/persistentvolumeclaims/demo-vol1-claim,UID:5037a42f-ff87-11e8-af52-0050569bbc99,ResourceVersion:708036,Generation:0,CreationTimestamp:2018-12-14 10:02:06 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{kubectl.kubernetes.io/last-applied-configuration: {"apiVersion":"v1","kind":"PersistentVolumeClaim","metadata":{"annotations":{},"name":"demo-vol1-claim","namespace":"default"},"spec":{"accessModes":["ReadWriteOnce"],"resources":{"requests":{"storage":"4G"}},"storageClassName":"openebs-jiva-default"}}
  138. ,volume.beta.kubernetes.io/storage-provisioner: openebs.io/provisioner-iscsi,},OwnerReferences:[],Finalizers:[kubernetes.io/pvc-protection],ClusterName:,Initializers:nil,},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{4 9} {<nil>} 4G DecimalSI},},},VolumeName:,Selector:nil,StorageClassName:*openebs-jiva-default,VolumeMode:nil,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:ResourceList{},Conditions:[],},} Parameters:map[] SelectedNode:nil AllowedTopologies:[]}, error: Internal Server Error: failed to create volume 'pvc-5037a42f-ff87-11e8-af52-0050569bbc99': response: deployments.extensions "pvc-5037a42f-ff87-11e8-af52-0050569bbc99-rep" already exists
  139. W1214 10:10:06.837177 1 controller.go:750] Retrying syncing claim "default/demo-vol1-claim" because failures 5 < threshold 15
  140. E1214 10:10:06.837205 1 controller.go:765] error syncing claim "default/demo-vol1-claim": failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-5037a42f-ff87-11e8-af52-0050569bbc99': response: deployments.extensions "pvc-5037a42f-ff87-11e8-af52-0050569bbc99-rep" already exists
  141. I1214 10:10:06.838042 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"5037a42f-ff87-11e8-af52-0050569bbc99", APIVersion:"v1", ResourceVersion:"708036", FieldPath:""}): type: 'Warning' reason: 'ProvisioningFailed' failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-5037a42f-ff87-11e8-af52-0050569bbc99': response: deployments.extensions "pvc-5037a42f-ff87-11e8-af52-0050569bbc99-rep" already exists
  142. I1214 10:12:05.816344 1 controller.go:991] provision "default/demo-vol1-claim" class "openebs-jiva-default": started
  143. I1214 10:12:05.819173 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"b2155d52-ff88-11e8-af52-0050569bbc99", APIVersion:"v1", ResourceVersion:"709790", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/demo-vol1-claim"
  144. E1214 10:12:05.865297 1 volume.go:170] HTTP Status error from maya-apiserver: Not Found
  145. I1214 10:12:05.865449 1 volume.go:105] CAS Volume Spec Created:
  146. {"metadata":{"name":"pvc-b2155d52-ff88-11e8-af52-0050569bbc99","namespace":"default","creationTimestamp":null,"labels":{"openebs.io/namespace":"default","openebs.io/persistentvolumeclaim":"demo-vol1-claim","openebs.io/storageclass":"openebs-jiva-default"}},"spec":{"capacity":"4G","iqn":"","targetPortal":"","targetIP":"","targetPort":"","replicas":"","casType":"","fsType":"","lun":0},"cloneSpec":{},"status":{"Phase":"","Message":"","Reason":""}}
  147. I1214 10:12:05.975436 1 volume.go:132] volume Successfully Created:
  148. {"apiVersion":"v1alpha1","kind":"CASVolume","metadata":{"annotations":{"openebs.io/storageclass-version":"704640"},"name":"pvc-b2155d52-ff88-11e8-af52-0050569bbc99"},"spec":{"capacity":"4G","casType":"jiva","fsType":"","iqn":"iqn.2016-09.com.openebs.jiva:pvc-b2155d52-ff88-11e8-af52-0050569bbc99","lun":0,"replicas":"3","targetIP":"\u003cno value\u003e","targetPort":"3260","targetPortal":"10.97.212.91:3260"},"status":{"Message":"","Phase":"","Reason":""}}
  149. E1214 10:12:06.106085 1 volume.go:170] HTTP Status error from maya-apiserver: Not Found
  150. E1214 10:12:06.106244 1 cas_provision.go:123] Failed to read volume: Not Found
  151. W1214 10:12:06.106295 1 controller.go:750] Retrying syncing claim "default/demo-vol1-claim" because failures 0 < threshold 15
  152. E1214 10:12:06.106325 1 controller.go:765] error syncing claim "default/demo-vol1-claim": failed to provision volume with StorageClass "openebs-jiva-default": Not Found
  153. I1214 10:12:06.106357 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"b2155d52-ff88-11e8-af52-0050569bbc99", APIVersion:"v1", ResourceVersion:"709790", FieldPath:""}): type: 'Warning' reason: 'ProvisioningFailed' failed to provision volume with StorageClass "openebs-jiva-default": Not Found
  154. I1214 10:12:21.106557 1 controller.go:991] provision "default/demo-vol1-claim" class "openebs-jiva-default": started
  155. I1214 10:12:21.111149 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"b2155d52-ff88-11e8-af52-0050569bbc99", APIVersion:"v1", ResourceVersion:"709790", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/demo-vol1-claim"
  156. E1214 10:12:21.152315 1 volume.go:170] HTTP Status error from maya-apiserver: Not Found
  157. I1214 10:12:21.152467 1 volume.go:105] CAS Volume Spec Created:
  158. {"metadata":{"name":"pvc-b2155d52-ff88-11e8-af52-0050569bbc99","namespace":"default","creationTimestamp":null,"labels":{"openebs.io/namespace":"default","openebs.io/persistentvolumeclaim":"demo-vol1-claim","openebs.io/storageclass":"openebs-jiva-default"}},"spec":{"capacity":"4G","iqn":"","targetPortal":"","targetIP":"","targetPort":"","replicas":"","casType":"","fsType":"","lun":0},"cloneSpec":{},"status":{"Phase":"","Message":"","Reason":""}}
  159. E1214 10:12:21.243680 1 volume.go:128] Internal Server Error: failed to create volume 'pvc-b2155d52-ff88-11e8-af52-0050569bbc99': response: services "pvc-b2155d52-ff88-11e8-af52-0050569bbc99-ctrl-svc" already exists
  160. E1214 10:12:21.243715 1 cas_provision.go:118] Failed to create volume: {PersistentVolumeReclaimPolicy:Delete PVName:pvc-b2155d52-ff88-11e8-af52-0050569bbc99 MountOptions:[] PVC:&PersistentVolumeClaim{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:demo-vol1-claim,GenerateName:,Namespace:default,SelfLink:/api/v1/namespaces/default/persistentvolumeclaims/demo-vol1-claim,UID:b2155d52-ff88-11e8-af52-0050569bbc99,ResourceVersion:709790,Generation:0,CreationTimestamp:2018-12-14 10:12:00 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{kubectl.kubernetes.io/last-applied-configuration: {"apiVersion":"v1","kind":"PersistentVolumeClaim","metadata":{"annotations":{},"name":"demo-vol1-claim","namespace":"default"},"spec":{"accessModes":["ReadWriteOnce"],"resources":{"requests":{"storage":"4G"}},"storageClassName":"openebs-jiva-default"}}
  161. ,volume.beta.kubernetes.io/storage-provisioner: openebs.io/provisioner-iscsi,},OwnerReferences:[],Finalizers:[kubernetes.io/pvc-protection],ClusterName:,Initializers:nil,},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{4 9} {<nil>} 4G DecimalSI},},},VolumeName:,Selector:nil,StorageClassName:*openebs-jiva-default,VolumeMode:nil,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:ResourceList{},Conditions:[],},} Parameters:map[] SelectedNode:nil AllowedTopologies:[]}, error: Internal Server Error: failed to create volume 'pvc-b2155d52-ff88-11e8-af52-0050569bbc99': response: services "pvc-b2155d52-ff88-11e8-af52-0050569bbc99-ctrl-svc" already exists
  162. W1214 10:12:21.243960 1 controller.go:750] Retrying syncing claim "default/demo-vol1-claim" because failures 1 < threshold 15
  163. E1214 10:12:21.243987 1 controller.go:765] error syncing claim "default/demo-vol1-claim": failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-b2155d52-ff88-11e8-af52-0050569bbc99': response: services "pvc-b2155d52-ff88-11e8-af52-0050569bbc99-ctrl-svc" already exists
  164. I1214 10:12:21.244064 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"b2155d52-ff88-11e8-af52-0050569bbc99", APIVersion:"v1", ResourceVersion:"709790", FieldPath:""}): type: 'Warning' reason: 'ProvisioningFailed' failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-b2155d52-ff88-11e8-af52-0050569bbc99': response: services "pvc-b2155d52-ff88-11e8-af52-0050569bbc99-ctrl-svc" already exists
  165. I1214 10:12:51.244276 1 controller.go:991] provision "default/demo-vol1-claim" class "openebs-jiva-default": started
  166. I1214 10:12:51.247763 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"b2155d52-ff88-11e8-af52-0050569bbc99", APIVersion:"v1", ResourceVersion:"709790", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/demo-vol1-claim"
  167. E1214 10:12:51.289525 1 volume.go:170] HTTP Status error from maya-apiserver: Not Found
  168. I1214 10:12:51.289676 1 volume.go:105] CAS Volume Spec Created:
  169. {"metadata":{"name":"pvc-b2155d52-ff88-11e8-af52-0050569bbc99","namespace":"default","creationTimestamp":null,"labels":{"openebs.io/namespace":"default","openebs.io/persistentvolumeclaim":"demo-vol1-claim","openebs.io/storageclass":"openebs-jiva-default"}},"spec":{"capacity":"4G","iqn":"","targetPortal":"","targetIP":"","targetPort":"","replicas":"","casType":"","fsType":"","lun":0},"cloneSpec":{},"status":{"Phase":"","Message":"","Reason":""}}
  170. E1214 10:12:51.375188 1 volume.go:128] Internal Server Error: failed to create volume 'pvc-b2155d52-ff88-11e8-af52-0050569bbc99': response: services "pvc-b2155d52-ff88-11e8-af52-0050569bbc99-ctrl-svc" already exists
  171. E1214 10:12:51.375226 1 cas_provision.go:118] Failed to create volume: {PersistentVolumeReclaimPolicy:Delete PVName:pvc-b2155d52-ff88-11e8-af52-0050569bbc99 MountOptions:[] PVC:&PersistentVolumeClaim{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:demo-vol1-claim,GenerateName:,Namespace:default,SelfLink:/api/v1/namespaces/default/persistentvolumeclaims/demo-vol1-claim,UID:b2155d52-ff88-11e8-af52-0050569bbc99,ResourceVersion:709790,Generation:0,CreationTimestamp:2018-12-14 10:12:00 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{kubectl.kubernetes.io/last-applied-configuration: {"apiVersion":"v1","kind":"PersistentVolumeClaim","metadata":{"annotations":{},"name":"demo-vol1-claim","namespace":"default"},"spec":{"accessModes":["ReadWriteOnce"],"resources":{"requests":{"storage":"4G"}},"storageClassName":"openebs-jiva-default"}}
  172. ,volume.beta.kubernetes.io/storage-provisioner: openebs.io/provisioner-iscsi,},OwnerReferences:[],Finalizers:[kubernetes.io/pvc-protection],ClusterName:,Initializers:nil,},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{4 9} {<nil>} 4G DecimalSI},},},VolumeName:,Selector:nil,StorageClassName:*openebs-jiva-default,VolumeMode:nil,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:ResourceList{},Conditions:[],},} Parameters:map[] SelectedNode:nil AllowedTopologies:[]}, error: Internal Server Error: failed to create volume 'pvc-b2155d52-ff88-11e8-af52-0050569bbc99': response: services "pvc-b2155d52-ff88-11e8-af52-0050569bbc99-ctrl-svc" already exists
  173. W1214 10:12:51.375370 1 controller.go:750] Retrying syncing claim "default/demo-vol1-claim" because failures 2 < threshold 15
  174. E1214 10:12:51.375399 1 controller.go:765] error syncing claim "default/demo-vol1-claim": failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-b2155d52-ff88-11e8-af52-0050569bbc99': response: services "pvc-b2155d52-ff88-11e8-af52-0050569bbc99-ctrl-svc" already exists
  175. I1214 10:12:51.375462 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"b2155d52-ff88-11e8-af52-0050569bbc99", APIVersion:"v1", ResourceVersion:"709790", FieldPath:""}): type: 'Warning' reason: 'ProvisioningFailed' failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-b2155d52-ff88-11e8-af52-0050569bbc99': response: services "pvc-b2155d52-ff88-11e8-af52-0050569bbc99-ctrl-svc" already exists
  176. I1214 10:13:51.375625 1 controller.go:991] provision "default/demo-vol1-claim" class "openebs-jiva-default": started
  177. I1214 10:13:51.379483 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"b2155d52-ff88-11e8-af52-0050569bbc99", APIVersion:"v1", ResourceVersion:"709790", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/demo-vol1-claim"
  178. E1214 10:13:51.422497 1 volume.go:170] HTTP Status error from maya-apiserver: Not Found
  179. I1214 10:13:51.422631 1 volume.go:105] CAS Volume Spec Created:
  180. {"metadata":{"name":"pvc-b2155d52-ff88-11e8-af52-0050569bbc99","namespace":"default","creationTimestamp":null,"labels":{"openebs.io/namespace":"default","openebs.io/persistentvolumeclaim":"demo-vol1-claim","openebs.io/storageclass":"openebs-jiva-default"}},"spec":{"capacity":"4G","iqn":"","targetPortal":"","targetIP":"","targetPort":"","replicas":"","casType":"","fsType":"","lun":0},"cloneSpec":{},"status":{"Phase":"","Message":"","Reason":""}}
  181. E1214 10:13:51.531722 1 volume.go:128] Internal Server Error: failed to create volume 'pvc-b2155d52-ff88-11e8-af52-0050569bbc99': response: services "pvc-b2155d52-ff88-11e8-af52-0050569bbc99-ctrl-svc" already exists
  182. E1214 10:13:51.531761 1 cas_provision.go:118] Failed to create volume: {PersistentVolumeReclaimPolicy:Delete PVName:pvc-b2155d52-ff88-11e8-af52-0050569bbc99 MountOptions:[] PVC:&PersistentVolumeClaim{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:demo-vol1-claim,GenerateName:,Namespace:default,SelfLink:/api/v1/namespaces/default/persistentvolumeclaims/demo-vol1-claim,UID:b2155d52-ff88-11e8-af52-0050569bbc99,ResourceVersion:709790,Generation:0,CreationTimestamp:2018-12-14 10:12:00 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{kubectl.kubernetes.io/last-applied-configuration: {"apiVersion":"v1","kind":"PersistentVolumeClaim","metadata":{"annotations":{},"name":"demo-vol1-claim","namespace":"default"},"spec":{"accessModes":["ReadWriteOnce"],"resources":{"requests":{"storage":"4G"}},"storageClassName":"openebs-jiva-default"}}
  183. ,volume.beta.kubernetes.io/storage-provisioner: openebs.io/provisioner-iscsi,},OwnerReferences:[],Finalizers:[kubernetes.io/pvc-protection],ClusterName:,Initializers:nil,},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{4 9} {<nil>} 4G DecimalSI},},},VolumeName:,Selector:nil,StorageClassName:*openebs-jiva-default,VolumeMode:nil,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:ResourceList{},Conditions:[],},} Parameters:map[] SelectedNode:nil AllowedTopologies:[]}, error: Internal Server Error: failed to create volume 'pvc-b2155d52-ff88-11e8-af52-0050569bbc99': response: services "pvc-b2155d52-ff88-11e8-af52-0050569bbc99-ctrl-svc" already exists
  184. W1214 10:13:51.531893 1 controller.go:750] Retrying syncing claim "default/demo-vol1-claim" because failures 3 < threshold 15
  185. E1214 10:13:51.531920 1 controller.go:765] error syncing claim "default/demo-vol1-claim": failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-b2155d52-ff88-11e8-af52-0050569bbc99': response: services "pvc-b2155d52-ff88-11e8-af52-0050569bbc99-ctrl-svc" already exists
  186. I1214 10:13:51.531960 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"b2155d52-ff88-11e8-af52-0050569bbc99", APIVersion:"v1", ResourceVersion:"709790", FieldPath:""}): type: 'Warning' reason: 'ProvisioningFailed' failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-b2155d52-ff88-11e8-af52-0050569bbc99': response: services "pvc-b2155d52-ff88-11e8-af52-0050569bbc99-ctrl-svc" already exists
  187. I1214 10:15:51.532169 1 controller.go:991] provision "default/demo-vol1-claim" class "openebs-jiva-default": started
  188. I1214 10:15:51.535766 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"b2155d52-ff88-11e8-af52-0050569bbc99", APIVersion:"v1", ResourceVersion:"709790", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/demo-vol1-claim"
  189. E1214 10:15:51.595860 1 volume.go:170] HTTP Status error from maya-apiserver: Not Found
  190. I1214 10:15:51.596178 1 volume.go:105] CAS Volume Spec Created:
  191. {"metadata":{"name":"pvc-b2155d52-ff88-11e8-af52-0050569bbc99","namespace":"default","creationTimestamp":null,"labels":{"openebs.io/namespace":"default","openebs.io/persistentvolumeclaim":"demo-vol1-claim","openebs.io/storageclass":"openebs-jiva-default"}},"spec":{"capacity":"4G","iqn":"","targetPortal":"","targetIP":"","targetPort":"","replicas":"","casType":"","fsType":"","lun":0},"cloneSpec":{},"status":{"Phase":"","Message":"","Reason":""}}
  192. E1214 10:15:51.692647 1 volume.go:128] Internal Server Error: failed to create volume 'pvc-b2155d52-ff88-11e8-af52-0050569bbc99': response: services "pvc-b2155d52-ff88-11e8-af52-0050569bbc99-ctrl-svc" already exists
  193. E1214 10:15:51.692678 1 cas_provision.go:118] Failed to create volume: {PersistentVolumeReclaimPolicy:Delete PVName:pvc-b2155d52-ff88-11e8-af52-0050569bbc99 MountOptions:[] PVC:&PersistentVolumeClaim{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:demo-vol1-claim,GenerateName:,Namespace:default,SelfLink:/api/v1/namespaces/default/persistentvolumeclaims/demo-vol1-claim,UID:b2155d52-ff88-11e8-af52-0050569bbc99,ResourceVersion:709790,Generation:0,CreationTimestamp:2018-12-14 10:12:00 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{kubectl.kubernetes.io/last-applied-configuration: {"apiVersion":"v1","kind":"PersistentVolumeClaim","metadata":{"annotations":{},"name":"demo-vol1-claim","namespace":"default"},"spec":{"accessModes":["ReadWriteOnce"],"resources":{"requests":{"storage":"4G"}},"storageClassName":"openebs-jiva-default"}}
  194. ,volume.beta.kubernetes.io/storage-provisioner: openebs.io/provisioner-iscsi,},OwnerReferences:[],Finalizers:[kubernetes.io/pvc-protection],ClusterName:,Initializers:nil,},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{4 9} {<nil>} 4G DecimalSI},},},VolumeName:,Selector:nil,StorageClassName:*openebs-jiva-default,VolumeMode:nil,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:ResourceList{},Conditions:[],},} Parameters:map[] SelectedNode:nil AllowedTopologies:[]}, error: Internal Server Error: failed to create volume 'pvc-b2155d52-ff88-11e8-af52-0050569bbc99': response: services "pvc-b2155d52-ff88-11e8-af52-0050569bbc99-ctrl-svc" already exists
  195. W1214 10:15:51.692938 1 controller.go:750] Retrying syncing claim "default/demo-vol1-claim" because failures 4 < threshold 15
  196. E1214 10:15:51.692981 1 controller.go:765] error syncing claim "default/demo-vol1-claim": failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-b2155d52-ff88-11e8-af52-0050569bbc99': response: services "pvc-b2155d52-ff88-11e8-af52-0050569bbc99-ctrl-svc" already exists
  197. I1214 10:15:51.692999 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"b2155d52-ff88-11e8-af52-0050569bbc99", APIVersion:"v1", ResourceVersion:"709790", FieldPath:""}): type: 'Warning' reason: 'ProvisioningFailed' failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-b2155d52-ff88-11e8-af52-0050569bbc99': response: services "pvc-b2155d52-ff88-11e8-af52-0050569bbc99-ctrl-svc" already exists
  198. E1214 10:19:51.693164 1 controller.go:820] claim "default/demo-vol1-claim" in work queue no longer exists
  199. I1214 10:22:05.782160 1 controller.go:991] provision "openebs/demo-vol1-claim0" class "openebs-jiva-default": started
  200. I1214 10:22:05.785182 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"openebs", Name:"demo-vol1-claim0", UID:"1af6d76e-ff8a-11e8-b6ae-0050569b3a3c", APIVersion:"v1", ResourceVersion:"711595", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "openebs/demo-vol1-claim0"
  201. E1214 10:22:05.828827 1 volume.go:170] HTTP Status error from maya-apiserver: Not Found
  202. I1214 10:22:05.828972 1 volume.go:105] CAS Volume Spec Created:
  203. {"metadata":{"name":"pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c","namespace":"openebs","creationTimestamp":null,"labels":{"openebs.io/namespace":"openebs","openebs.io/persistentvolumeclaim":"demo-vol1-claim0","openebs.io/storageclass":"openebs-jiva-default"}},"spec":{"capacity":"4G","iqn":"","targetPortal":"","targetIP":"","targetPort":"","replicas":"","casType":"","fsType":"","lun":0},"cloneSpec":{},"status":{"Phase":"","Message":"","Reason":""}}
  204. I1214 10:22:05.946906 1 volume.go:132] volume Successfully Created:
  205. {"apiVersion":"v1alpha1","kind":"CASVolume","metadata":{"annotations":{"openebs.io/storageclass-version":"704640"},"name":"pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c"},"spec":{"capacity":"4G","casType":"jiva","fsType":"","iqn":"iqn.2016-09.com.openebs.jiva:pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c","lun":0,"replicas":"3","targetIP":"\u003cno value\u003e","targetPort":"3260","targetPortal":"10.110.42.15:3260"},"status":{"Message":"","Phase":"","Reason":""}}
  206. E1214 10:22:06.085860 1 volume.go:170] HTTP Status error from maya-apiserver: Not Found
  207. E1214 10:22:06.086101 1 cas_provision.go:123] Failed to read volume: Not Found
  208. W1214 10:22:06.086746 1 controller.go:750] Retrying syncing claim "openebs/demo-vol1-claim0" because failures 0 < threshold 15
  209. E1214 10:22:06.086856 1 controller.go:765] error syncing claim "openebs/demo-vol1-claim0": failed to provision volume with StorageClass "openebs-jiva-default": Not Found
  210. I1214 10:22:06.086846 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"openebs", Name:"demo-vol1-claim0", UID:"1af6d76e-ff8a-11e8-b6ae-0050569b3a3c", APIVersion:"v1", ResourceVersion:"711595", FieldPath:""}): type: 'Warning' reason: 'ProvisioningFailed' failed to provision volume with StorageClass "openebs-jiva-default": Not Found
  211. I1214 10:22:06.086933 1 controller.go:991] provision "openebs/demo-vol1-claim0" class "openebs-jiva-default": started
  212. I1214 10:22:06.096474 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"openebs", Name:"demo-vol1-claim0", UID:"1af6d76e-ff8a-11e8-b6ae-0050569b3a3c", APIVersion:"v1", ResourceVersion:"711596", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "openebs/demo-vol1-claim0"
  213. E1214 10:22:06.140201 1 volume.go:170] HTTP Status error from maya-apiserver: Not Found
  214. I1214 10:22:06.140426 1 volume.go:105] CAS Volume Spec Created:
  215. {"metadata":{"name":"pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c","namespace":"openebs","creationTimestamp":null,"labels":{"openebs.io/namespace":"openebs","openebs.io/persistentvolumeclaim":"demo-vol1-claim0","openebs.io/storageclass":"openebs-jiva-default"}},"spec":{"capacity":"4G","iqn":"","targetPortal":"","targetIP":"","targetPort":"","replicas":"","casType":"","fsType":"","lun":0},"cloneSpec":{},"status":{"Phase":"","Message":"","Reason":""}}
  216. E1214 10:22:06.247266 1 volume.go:128] Internal Server Error: failed to create volume 'pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c': response: services "pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c-ctrl-svc" already exists
  217. E1214 10:22:06.247304 1 cas_provision.go:118] Failed to create volume: {PersistentVolumeReclaimPolicy:Delete PVName:pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c MountOptions:[] PVC:&PersistentVolumeClaim{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:demo-vol1-claim0,GenerateName:,Namespace:openebs,SelfLink:/api/v1/namespaces/openebs/persistentvolumeclaims/demo-vol1-claim0,UID:1af6d76e-ff8a-11e8-b6ae-0050569b3a3c,ResourceVersion:711596,Generation:0,CreationTimestamp:2018-12-14 10:22:05 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{kubectl.kubernetes.io/last-applied-configuration: {"apiVersion":"v1","kind":"PersistentVolumeClaim","metadata":{"annotations":{},"name":"demo-vol1-claim0","namespace":"openebs"},"spec":{"accessModes":["ReadWriteOnce"],"resources":{"requests":{"storage":"4G"}},"storageClassName":"openebs-jiva-default"}}
  218. ,volume.beta.kubernetes.io/storage-provisioner: openebs.io/provisioner-iscsi,},OwnerReferences:[],Finalizers:[kubernetes.io/pvc-protection],ClusterName:,Initializers:nil,},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{4 9} {<nil>} 4G DecimalSI},},},VolumeName:,Selector:nil,StorageClassName:*openebs-jiva-default,VolumeMode:nil,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:ResourceList{},Conditions:[],},} Parameters:map[] SelectedNode:nil AllowedTopologies:[]}, error: Internal Server Error: failed to create volume 'pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c': response: services "pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c-ctrl-svc" already exists
  219. W1214 10:22:06.247436 1 controller.go:750] Retrying syncing claim "openebs/demo-vol1-claim0" because failures 1 < threshold 15
  220. E1214 10:22:06.247460 1 controller.go:765] error syncing claim "openebs/demo-vol1-claim0": failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c': response: services "pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c-ctrl-svc" already exists
  221. I1214 10:22:06.247692 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"openebs", Name:"demo-vol1-claim0", UID:"1af6d76e-ff8a-11e8-b6ae-0050569b3a3c", APIVersion:"v1", ResourceVersion:"711596", FieldPath:""}): type: 'Warning' reason: 'ProvisioningFailed' failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c': response: services "pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c-ctrl-svc" already exists
  222. I1214 10:22:21.087006 1 controller.go:991] provision "openebs/demo-vol1-claim0" class "openebs-jiva-default": started
  223. I1214 10:22:21.090597 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"openebs", Name:"demo-vol1-claim0", UID:"1af6d76e-ff8a-11e8-b6ae-0050569b3a3c", APIVersion:"v1", ResourceVersion:"711596", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "openebs/demo-vol1-claim0"
  224. E1214 10:22:21.132025 1 volume.go:170] HTTP Status error from maya-apiserver: Not Found
  225. I1214 10:22:21.132221 1 volume.go:105] CAS Volume Spec Created:
  226. {"metadata":{"name":"pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c","namespace":"openebs","creationTimestamp":null,"labels":{"openebs.io/namespace":"openebs","openebs.io/persistentvolumeclaim":"demo-vol1-claim0","openebs.io/storageclass":"openebs-jiva-default"}},"spec":{"capacity":"4G","iqn":"","targetPortal":"","targetIP":"","targetPort":"","replicas":"","casType":"","fsType":"","lun":0},"cloneSpec":{},"status":{"Phase":"","Message":"","Reason":""}}
  227. E1214 10:22:21.216577 1 volume.go:128] Internal Server Error: failed to create volume 'pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c': response: services "pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c-ctrl-svc" already exists
  228. E1214 10:22:21.216615 1 cas_provision.go:118] Failed to create volume: {PersistentVolumeReclaimPolicy:Delete PVName:pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c MountOptions:[] PVC:&PersistentVolumeClaim{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:demo-vol1-claim0,GenerateName:,Namespace:openebs,SelfLink:/api/v1/namespaces/openebs/persistentvolumeclaims/demo-vol1-claim0,UID:1af6d76e-ff8a-11e8-b6ae-0050569b3a3c,ResourceVersion:711596,Generation:0,CreationTimestamp:2018-12-14 10:22:05 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{kubectl.kubernetes.io/last-applied-configuration: {"apiVersion":"v1","kind":"PersistentVolumeClaim","metadata":{"annotations":{},"name":"demo-vol1-claim0","namespace":"openebs"},"spec":{"accessModes":["ReadWriteOnce"],"resources":{"requests":{"storage":"4G"}},"storageClassName":"openebs-jiva-default"}}
  229. ,volume.beta.kubernetes.io/storage-provisioner: openebs.io/provisioner-iscsi,},OwnerReferences:[],Finalizers:[kubernetes.io/pvc-protection],ClusterName:,Initializers:nil,},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{4 9} {<nil>} 4G DecimalSI},},},VolumeName:,Selector:nil,StorageClassName:*openebs-jiva-default,VolumeMode:nil,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:ResourceList{},Conditions:[],},} Parameters:map[] SelectedNode:nil AllowedTopologies:[]}, error: Internal Server Error: failed to create volume 'pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c': response: services "pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c-ctrl-svc" already exists
  230. W1214 10:22:21.216965 1 controller.go:750] Retrying syncing claim "openebs/demo-vol1-claim0" because failures 2 < threshold 15
  231. E1214 10:22:21.217051 1 controller.go:765] error syncing claim "openebs/demo-vol1-claim0": failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c': response: services "pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c-ctrl-svc" already exists
  232. I1214 10:22:21.217078 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"openebs", Name:"demo-vol1-claim0", UID:"1af6d76e-ff8a-11e8-b6ae-0050569b3a3c", APIVersion:"v1", ResourceVersion:"711596", FieldPath:""}): type: 'Warning' reason: 'ProvisioningFailed' failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c': response: services "pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c-ctrl-svc" already exists
  233. I1214 10:23:21.217219 1 controller.go:991] provision "openebs/demo-vol1-claim0" class "openebs-jiva-default": started
  234. I1214 10:23:21.219798 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"openebs", Name:"demo-vol1-claim0", UID:"1af6d76e-ff8a-11e8-b6ae-0050569b3a3c", APIVersion:"v1", ResourceVersion:"711596", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "openebs/demo-vol1-claim0"
  235. E1214 10:23:21.259141 1 volume.go:170] HTTP Status error from maya-apiserver: Not Found
  236. I1214 10:23:21.259307 1 volume.go:105] CAS Volume Spec Created:
  237. {"metadata":{"name":"pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c","namespace":"openebs","creationTimestamp":null,"labels":{"openebs.io/namespace":"openebs","openebs.io/persistentvolumeclaim":"demo-vol1-claim0","openebs.io/storageclass":"openebs-jiva-default"}},"spec":{"capacity":"4G","iqn":"","targetPortal":"","targetIP":"","targetPort":"","replicas":"","casType":"","fsType":"","lun":0},"cloneSpec":{},"status":{"Phase":"","Message":"","Reason":""}}
  238. E1214 10:23:21.354149 1 volume.go:128] Internal Server Error: failed to create volume 'pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c': response: services "pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c-ctrl-svc" already exists
  239. E1214 10:23:21.354228 1 cas_provision.go:118] Failed to create volume: {PersistentVolumeReclaimPolicy:Delete PVName:pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c MountOptions:[] PVC:&PersistentVolumeClaim{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:demo-vol1-claim0,GenerateName:,Namespace:openebs,SelfLink:/api/v1/namespaces/openebs/persistentvolumeclaims/demo-vol1-claim0,UID:1af6d76e-ff8a-11e8-b6ae-0050569b3a3c,ResourceVersion:711596,Generation:0,CreationTimestamp:2018-12-14 10:22:05 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{kubectl.kubernetes.io/last-applied-configuration: {"apiVersion":"v1","kind":"PersistentVolumeClaim","metadata":{"annotations":{},"name":"demo-vol1-claim0","namespace":"openebs"},"spec":{"accessModes":["ReadWriteOnce"],"resources":{"requests":{"storage":"4G"}},"storageClassName":"openebs-jiva-default"}}
  240. ,volume.beta.kubernetes.io/storage-provisioner: openebs.io/provisioner-iscsi,},OwnerReferences:[],Finalizers:[kubernetes.io/pvc-protection],ClusterName:,Initializers:nil,},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{4 9} {<nil>} 4G DecimalSI},},},VolumeName:,Selector:nil,StorageClassName:*openebs-jiva-default,VolumeMode:nil,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:ResourceList{},Conditions:[],},} Parameters:map[] SelectedNode:nil AllowedTopologies:[]}, error: Internal Server Error: failed to create volume 'pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c': response: services "pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c-ctrl-svc" already exists
  241. W1214 10:23:21.354546 1 controller.go:750] Retrying syncing claim "openebs/demo-vol1-claim0" because failures 3 < threshold 15
  242. E1214 10:23:21.354592 1 controller.go:765] error syncing claim "openebs/demo-vol1-claim0": failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c': response: services "pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c-ctrl-svc" already exists
  243. I1214 10:23:21.354721 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"openebs", Name:"demo-vol1-claim0", UID:"1af6d76e-ff8a-11e8-b6ae-0050569b3a3c", APIVersion:"v1", ResourceVersion:"711596", FieldPath:""}): type: 'Warning' reason: 'ProvisioningFailed' failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c': response: services "pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c-ctrl-svc" already exists
  244. I1214 10:25:21.354908 1 controller.go:991] provision "openebs/demo-vol1-claim0" class "openebs-jiva-default": started
  245. I1214 10:25:21.359681 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"openebs", Name:"demo-vol1-claim0", UID:"1af6d76e-ff8a-11e8-b6ae-0050569b3a3c", APIVersion:"v1", ResourceVersion:"711596", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "openebs/demo-vol1-claim0"
  246. E1214 10:25:21.410902 1 volume.go:170] HTTP Status error from maya-apiserver: Not Found
  247. I1214 10:25:21.411097 1 volume.go:105] CAS Volume Spec Created:
  248. {"metadata":{"name":"pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c","namespace":"openebs","creationTimestamp":null,"labels":{"openebs.io/namespace":"openebs","openebs.io/persistentvolumeclaim":"demo-vol1-claim0","openebs.io/storageclass":"openebs-jiva-default"}},"spec":{"capacity":"4G","iqn":"","targetPortal":"","targetIP":"","targetPort":"","replicas":"","casType":"","fsType":"","lun":0},"cloneSpec":{},"status":{"Phase":"","Message":"","Reason":""}}
  249. E1214 10:25:21.498500 1 volume.go:128] Internal Server Error: failed to create volume 'pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c': response: services "pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c-ctrl-svc" already exists
  250. E1214 10:25:21.498532 1 cas_provision.go:118] Failed to create volume: {PersistentVolumeReclaimPolicy:Delete PVName:pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c MountOptions:[] PVC:&PersistentVolumeClaim{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:demo-vol1-claim0,GenerateName:,Namespace:openebs,SelfLink:/api/v1/namespaces/openebs/persistentvolumeclaims/demo-vol1-claim0,UID:1af6d76e-ff8a-11e8-b6ae-0050569b3a3c,ResourceVersion:711596,Generation:0,CreationTimestamp:2018-12-14 10:22:05 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{kubectl.kubernetes.io/last-applied-configuration: {"apiVersion":"v1","kind":"PersistentVolumeClaim","metadata":{"annotations":{},"name":"demo-vol1-claim0","namespace":"openebs"},"spec":{"accessModes":["ReadWriteOnce"],"resources":{"requests":{"storage":"4G"}},"storageClassName":"openebs-jiva-default"}}
  251. ,volume.beta.kubernetes.io/storage-provisioner: openebs.io/provisioner-iscsi,},OwnerReferences:[],Finalizers:[kubernetes.io/pvc-protection],ClusterName:,Initializers:nil,},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{4 9} {<nil>} 4G DecimalSI},},},VolumeName:,Selector:nil,StorageClassName:*openebs-jiva-default,VolumeMode:nil,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:ResourceList{},Conditions:[],},} Parameters:map[] SelectedNode:nil AllowedTopologies:[]}, error: Internal Server Error: failed to create volume 'pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c': response: services "pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c-ctrl-svc" already exists
  252. W1214 10:25:21.498703 1 controller.go:750] Retrying syncing claim "openebs/demo-vol1-claim0" because failures 4 < threshold 15
  253. E1214 10:25:21.498731 1 controller.go:765] error syncing claim "openebs/demo-vol1-claim0": failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c': response: services "pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c-ctrl-svc" already exists
  254. I1214 10:25:21.498827 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"openebs", Name:"demo-vol1-claim0", UID:"1af6d76e-ff8a-11e8-b6ae-0050569b3a3c", APIVersion:"v1", ResourceVersion:"711596", FieldPath:""}): type: 'Warning' reason: 'ProvisioningFailed' failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c': response: services "pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c-ctrl-svc" already exists
  255. I1214 10:29:21.498985 1 controller.go:991] provision "openebs/demo-vol1-claim0" class "openebs-jiva-default": started
  256. I1214 10:29:21.502354 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"openebs", Name:"demo-vol1-claim0", UID:"1af6d76e-ff8a-11e8-b6ae-0050569b3a3c", APIVersion:"v1", ResourceVersion:"711596", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "openebs/demo-vol1-claim0"
  257. E1214 10:29:21.542301 1 volume.go:170] HTTP Status error from maya-apiserver: Not Found
  258. I1214 10:29:21.542484 1 volume.go:105] CAS Volume Spec Created:
  259. {"metadata":{"name":"pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c","namespace":"openebs","creationTimestamp":null,"labels":{"openebs.io/namespace":"openebs","openebs.io/persistentvolumeclaim":"demo-vol1-claim0","openebs.io/storageclass":"openebs-jiva-default"}},"spec":{"capacity":"4G","iqn":"","targetPortal":"","targetIP":"","targetPort":"","replicas":"","casType":"","fsType":"","lun":0},"cloneSpec":{},"status":{"Phase":"","Message":"","Reason":""}}
  260. E1214 10:29:21.626279 1 volume.go:128] Internal Server Error: failed to create volume 'pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c': response: services "pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c-ctrl-svc" already exists
  261. E1214 10:29:21.626315 1 cas_provision.go:118] Failed to create volume: {PersistentVolumeReclaimPolicy:Delete PVName:pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c MountOptions:[] PVC:&PersistentVolumeClaim{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:demo-vol1-claim0,GenerateName:,Namespace:openebs,SelfLink:/api/v1/namespaces/openebs/persistentvolumeclaims/demo-vol1-claim0,UID:1af6d76e-ff8a-11e8-b6ae-0050569b3a3c,ResourceVersion:711596,Generation:0,CreationTimestamp:2018-12-14 10:22:05 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{kubectl.kubernetes.io/last-applied-configuration: {"apiVersion":"v1","kind":"PersistentVolumeClaim","metadata":{"annotations":{},"name":"demo-vol1-claim0","namespace":"openebs"},"spec":{"accessModes":["ReadWriteOnce"],"resources":{"requests":{"storage":"4G"}},"storageClassName":"openebs-jiva-default"}}
  262. ,volume.beta.kubernetes.io/storage-provisioner: openebs.io/provisioner-iscsi,},OwnerReferences:[],Finalizers:[kubernetes.io/pvc-protection],ClusterName:,Initializers:nil,},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{4 9} {<nil>} 4G DecimalSI},},},VolumeName:,Selector:nil,StorageClassName:*openebs-jiva-default,VolumeMode:nil,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:ResourceList{},Conditions:[],},} Parameters:map[] SelectedNode:nil AllowedTopologies:[]}, error: Internal Server Error: failed to create volume 'pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c': response: services "pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c-ctrl-svc" already exists
  263. W1214 10:29:21.626445 1 controller.go:750] Retrying syncing claim "openebs/demo-vol1-claim0" because failures 5 < threshold 15
  264. E1214 10:29:21.626479 1 controller.go:765] error syncing claim "openebs/demo-vol1-claim0": failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c': response: services "pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c-ctrl-svc" already exists
  265. I1214 10:29:21.626605 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"openebs", Name:"demo-vol1-claim0", UID:"1af6d76e-ff8a-11e8-b6ae-0050569b3a3c", APIVersion:"v1", ResourceVersion:"711596", FieldPath:""}): type: 'Warning' reason: 'ProvisioningFailed' failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c': response: services "pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c-ctrl-svc" already exists
  266. I1214 10:34:56.738971 1 controller.go:991] provision "default/demo-vol1-claim" class "openebs-jiva-default": started
  267. I1214 10:34:56.743254 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"e677166f-ff8b-11e8-af52-0050569bbc99", APIVersion:"v1", ResourceVersion:"713860", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/demo-vol1-claim"
  268. E1214 10:34:56.796684 1 volume.go:170] HTTP Status error from maya-apiserver: Not Found
  269. I1214 10:34:56.796853 1 volume.go:105] CAS Volume Spec Created:
  270. {"metadata":{"name":"pvc-e677166f-ff8b-11e8-af52-0050569bbc99","namespace":"default","creationTimestamp":null,"labels":{"openebs.io/namespace":"default","openebs.io/persistentvolumeclaim":"demo-vol1-claim","openebs.io/storageclass":"openebs-jiva-default"}},"spec":{"capacity":"4G","iqn":"","targetPortal":"","targetIP":"","targetPort":"","replicas":"","casType":"","fsType":"","lun":0},"cloneSpec":{},"status":{"Phase":"","Message":"","Reason":""}}
  271. I1214 10:34:56.909087 1 volume.go:132] volume Successfully Created:
  272. {"apiVersion":"v1alpha1","kind":"CASVolume","metadata":{"annotations":{"openebs.io/storageclass-version":"704640"},"name":"pvc-e677166f-ff8b-11e8-af52-0050569bbc99"},"spec":{"capacity":"4G","casType":"jiva","fsType":"","iqn":"iqn.2016-09.com.openebs.jiva:pvc-e677166f-ff8b-11e8-af52-0050569bbc99","lun":0,"replicas":"3","targetIP":"\u003cno value\u003e","targetPort":"3260","targetPortal":"10.97.87.115:3260"},"status":{"Message":"","Phase":"","Reason":""}}
  273. E1214 10:34:56.956843 1 volume.go:170] HTTP Status error from maya-apiserver: Not Found
  274. E1214 10:34:56.956993 1 cas_provision.go:123] Failed to read volume: Not Found
  275. W1214 10:34:56.957133 1 controller.go:750] Retrying syncing claim "default/demo-vol1-claim" because failures 0 < threshold 15
  276. E1214 10:34:56.957163 1 controller.go:765] error syncing claim "default/demo-vol1-claim": failed to provision volume with StorageClass "openebs-jiva-default": Not Found
  277. I1214 10:34:56.957265 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"e677166f-ff8b-11e8-af52-0050569bbc99", APIVersion:"v1", ResourceVersion:"713860", FieldPath:""}): type: 'Warning' reason: 'ProvisioningFailed' failed to provision volume with StorageClass "openebs-jiva-default": Not Found
  278. I1214 10:34:56.957307 1 controller.go:991] provision "default/demo-vol1-claim" class "openebs-jiva-default": started
  279. I1214 10:34:56.964235 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"e677166f-ff8b-11e8-af52-0050569bbc99", APIVersion:"v1", ResourceVersion:"713863", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/demo-vol1-claim"
  280. E1214 10:34:57.052450 1 volume.go:170] HTTP Status error from maya-apiserver: Not Found
  281. I1214 10:34:57.052642 1 volume.go:105] CAS Volume Spec Created:
  282. {"metadata":{"name":"pvc-e677166f-ff8b-11e8-af52-0050569bbc99","namespace":"default","creationTimestamp":null,"labels":{"openebs.io/namespace":"default","openebs.io/persistentvolumeclaim":"demo-vol1-claim","openebs.io/storageclass":"openebs-jiva-default"}},"spec":{"capacity":"4G","iqn":"","targetPortal":"","targetIP":"","targetPort":"","replicas":"","casType":"","fsType":"","lun":0},"cloneSpec":{},"status":{"Phase":"","Message":"","Reason":""}}
  283. E1214 10:34:57.189702 1 volume.go:128] Internal Server Error: failed to create volume 'pvc-e677166f-ff8b-11e8-af52-0050569bbc99': response: services "pvc-e677166f-ff8b-11e8-af52-0050569bbc99-ctrl-svc" already exists
  284. E1214 10:34:57.189737 1 cas_provision.go:118] Failed to create volume: {PersistentVolumeReclaimPolicy:Delete PVName:pvc-e677166f-ff8b-11e8-af52-0050569bbc99 MountOptions:[] PVC:&PersistentVolumeClaim{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:demo-vol1-claim,GenerateName:,Namespace:default,SelfLink:/api/v1/namespaces/default/persistentvolumeclaims/demo-vol1-claim,UID:e677166f-ff8b-11e8-af52-0050569bbc99,ResourceVersion:713863,Generation:0,CreationTimestamp:2018-12-14 10:34:56 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{kubectl.kubernetes.io/last-applied-configuration: {"apiVersion":"v1","kind":"PersistentVolumeClaim","metadata":{"annotations":{},"name":"demo-vol1-claim","namespace":"default"},"spec":{"accessModes":["ReadWriteOnce"],"resources":{"requests":{"storage":"4G"}},"storageClassName":"openebs-jiva-default"}}
  285. ,volume.beta.kubernetes.io/storage-provisioner: openebs.io/provisioner-iscsi,},OwnerReferences:[],Finalizers:[kubernetes.io/pvc-protection],ClusterName:,Initializers:nil,},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{4 9} {<nil>} 4G DecimalSI},},},VolumeName:,Selector:nil,StorageClassName:*openebs-jiva-default,VolumeMode:nil,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:ResourceList{},Conditions:[],},} Parameters:map[] SelectedNode:nil AllowedTopologies:[]}, error: Internal Server Error: failed to create volume 'pvc-e677166f-ff8b-11e8-af52-0050569bbc99': response: services "pvc-e677166f-ff8b-11e8-af52-0050569bbc99-ctrl-svc" already exists
  286. W1214 10:34:57.189910 1 controller.go:750] Retrying syncing claim "default/demo-vol1-claim" because failures 1 < threshold 15
  287. E1214 10:34:57.189933 1 controller.go:765] error syncing claim "default/demo-vol1-claim": failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-e677166f-ff8b-11e8-af52-0050569bbc99': response: services "pvc-e677166f-ff8b-11e8-af52-0050569bbc99-ctrl-svc" already exists
  288. I1214 10:34:57.189992 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"e677166f-ff8b-11e8-af52-0050569bbc99", APIVersion:"v1", ResourceVersion:"713863", FieldPath:""}): type: 'Warning' reason: 'ProvisioningFailed' failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-e677166f-ff8b-11e8-af52-0050569bbc99': response: services "pvc-e677166f-ff8b-11e8-af52-0050569bbc99-ctrl-svc" already exists
  289. I1214 10:35:11.957404 1 controller.go:991] provision "default/demo-vol1-claim" class "openebs-jiva-default": started
  290. I1214 10:35:11.960718 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"e677166f-ff8b-11e8-af52-0050569bbc99", APIVersion:"v1", ResourceVersion:"713863", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/demo-vol1-claim"
  291. E1214 10:35:12.003369 1 volume.go:170] HTTP Status error from maya-apiserver: Not Found
  292. I1214 10:35:12.003520 1 volume.go:105] CAS Volume Spec Created:
  293. {"metadata":{"name":"pvc-e677166f-ff8b-11e8-af52-0050569bbc99","namespace":"default","creationTimestamp":null,"labels":{"openebs.io/namespace":"default","openebs.io/persistentvolumeclaim":"demo-vol1-claim","openebs.io/storageclass":"openebs-jiva-default"}},"spec":{"capacity":"4G","iqn":"","targetPortal":"","targetIP":"","targetPort":"","replicas":"","casType":"","fsType":"","lun":0},"cloneSpec":{},"status":{"Phase":"","Message":"","Reason":""}}
  294. E1214 10:35:12.118713 1 volume.go:128] Internal Server Error: failed to create volume 'pvc-e677166f-ff8b-11e8-af52-0050569bbc99': response: services "pvc-e677166f-ff8b-11e8-af52-0050569bbc99-ctrl-svc" already exists
  295. E1214 10:35:12.118757 1 cas_provision.go:118] Failed to create volume: {PersistentVolumeReclaimPolicy:Delete PVName:pvc-e677166f-ff8b-11e8-af52-0050569bbc99 MountOptions:[] PVC:&PersistentVolumeClaim{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:demo-vol1-claim,GenerateName:,Namespace:default,SelfLink:/api/v1/namespaces/default/persistentvolumeclaims/demo-vol1-claim,UID:e677166f-ff8b-11e8-af52-0050569bbc99,ResourceVersion:713863,Generation:0,CreationTimestamp:2018-12-14 10:34:56 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{kubectl.kubernetes.io/last-applied-configuration: {"apiVersion":"v1","kind":"PersistentVolumeClaim","metadata":{"annotations":{},"name":"demo-vol1-claim","namespace":"default"},"spec":{"accessModes":["ReadWriteOnce"],"resources":{"requests":{"storage":"4G"}},"storageClassName":"openebs-jiva-default"}}
  296. ,volume.beta.kubernetes.io/storage-provisioner: openebs.io/provisioner-iscsi,},OwnerReferences:[],Finalizers:[kubernetes.io/pvc-protection],ClusterName:,Initializers:nil,},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{4 9} {<nil>} 4G DecimalSI},},},VolumeName:,Selector:nil,StorageClassName:*openebs-jiva-default,VolumeMode:nil,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:ResourceList{},Conditions:[],},} Parameters:map[] SelectedNode:nil AllowedTopologies:[]}, error: Internal Server Error: failed to create volume 'pvc-e677166f-ff8b-11e8-af52-0050569bbc99': response: services "pvc-e677166f-ff8b-11e8-af52-0050569bbc99-ctrl-svc" already exists
  297. W1214 10:35:12.118897 1 controller.go:750] Retrying syncing claim "default/demo-vol1-claim" because failures 2 < threshold 15
  298. E1214 10:35:12.118922 1 controller.go:765] error syncing claim "default/demo-vol1-claim": failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-e677166f-ff8b-11e8-af52-0050569bbc99': response: services "pvc-e677166f-ff8b-11e8-af52-0050569bbc99-ctrl-svc" already exists
  299. I1214 10:35:12.118966 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"e677166f-ff8b-11e8-af52-0050569bbc99", APIVersion:"v1", ResourceVersion:"713863", FieldPath:""}): type: 'Warning' reason: 'ProvisioningFailed' failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-e677166f-ff8b-11e8-af52-0050569bbc99': response: services "pvc-e677166f-ff8b-11e8-af52-0050569bbc99-ctrl-svc" already exists
  300. I1214 10:36:12.119137 1 controller.go:991] provision "default/demo-vol1-claim" class "openebs-jiva-default": started
  301. I1214 10:36:12.122019 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"e677166f-ff8b-11e8-af52-0050569bbc99", APIVersion:"v1", ResourceVersion:"713863", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/demo-vol1-claim"
  302. E1214 10:36:12.161670 1 volume.go:170] HTTP Status error from maya-apiserver: Not Found
  303. I1214 10:36:12.161825 1 volume.go:105] CAS Volume Spec Created:
  304. {"metadata":{"name":"pvc-e677166f-ff8b-11e8-af52-0050569bbc99","namespace":"default","creationTimestamp":null,"labels":{"openebs.io/namespace":"default","openebs.io/persistentvolumeclaim":"demo-vol1-claim","openebs.io/storageclass":"openebs-jiva-default"}},"spec":{"capacity":"4G","iqn":"","targetPortal":"","targetIP":"","targetPort":"","replicas":"","casType":"","fsType":"","lun":0},"cloneSpec":{},"status":{"Phase":"","Message":"","Reason":""}}
  305. E1214 10:36:12.249101 1 volume.go:128] Internal Server Error: failed to create volume 'pvc-e677166f-ff8b-11e8-af52-0050569bbc99': response: services "pvc-e677166f-ff8b-11e8-af52-0050569bbc99-ctrl-svc" already exists
  306. E1214 10:36:12.249139 1 cas_provision.go:118] Failed to create volume: {PersistentVolumeReclaimPolicy:Delete PVName:pvc-e677166f-ff8b-11e8-af52-0050569bbc99 MountOptions:[] PVC:&PersistentVolumeClaim{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:demo-vol1-claim,GenerateName:,Namespace:default,SelfLink:/api/v1/namespaces/default/persistentvolumeclaims/demo-vol1-claim,UID:e677166f-ff8b-11e8-af52-0050569bbc99,ResourceVersion:713863,Generation:0,CreationTimestamp:2018-12-14 10:34:56 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{kubectl.kubernetes.io/last-applied-configuration: {"apiVersion":"v1","kind":"PersistentVolumeClaim","metadata":{"annotations":{},"name":"demo-vol1-claim","namespace":"default"},"spec":{"accessModes":["ReadWriteOnce"],"resources":{"requests":{"storage":"4G"}},"storageClassName":"openebs-jiva-default"}}
  307. ,volume.beta.kubernetes.io/storage-provisioner: openebs.io/provisioner-iscsi,},OwnerReferences:[],Finalizers:[kubernetes.io/pvc-protection],ClusterName:,Initializers:nil,},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{4 9} {<nil>} 4G DecimalSI},},},VolumeName:,Selector:nil,StorageClassName:*openebs-jiva-default,VolumeMode:nil,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:ResourceList{},Conditions:[],},} Parameters:map[] SelectedNode:nil AllowedTopologies:[]}, error: Internal Server Error: failed to create volume 'pvc-e677166f-ff8b-11e8-af52-0050569bbc99': response: services "pvc-e677166f-ff8b-11e8-af52-0050569bbc99-ctrl-svc" already exists
  308. W1214 10:36:12.249511 1 controller.go:750] Retrying syncing claim "default/demo-vol1-claim" because failures 3 < threshold 15
  309. E1214 10:36:12.249562 1 controller.go:765] error syncing claim "default/demo-vol1-claim": failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-e677166f-ff8b-11e8-af52-0050569bbc99': response: services "pvc-e677166f-ff8b-11e8-af52-0050569bbc99-ctrl-svc" already exists
  310. I1214 10:36:12.249605 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"e677166f-ff8b-11e8-af52-0050569bbc99", APIVersion:"v1", ResourceVersion:"713863", FieldPath:""}): type: 'Warning' reason: 'ProvisioningFailed' failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-e677166f-ff8b-11e8-af52-0050569bbc99': response: services "pvc-e677166f-ff8b-11e8-af52-0050569bbc99-ctrl-svc" already exists
  311. I1214 10:37:21.626729 1 controller.go:991] provision "openebs/demo-vol1-claim0" class "openebs-jiva-default": started
  312. I1214 10:37:21.632101 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"openebs", Name:"demo-vol1-claim0", UID:"1af6d76e-ff8a-11e8-b6ae-0050569b3a3c", APIVersion:"v1", ResourceVersion:"711596", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "openebs/demo-vol1-claim0"
  313. E1214 10:37:21.686502 1 volume.go:170] HTTP Status error from maya-apiserver: Not Found
  314. I1214 10:37:21.686714 1 volume.go:105] CAS Volume Spec Created:
  315. {"metadata":{"name":"pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c","namespace":"openebs","creationTimestamp":null,"labels":{"openebs.io/namespace":"openebs","openebs.io/persistentvolumeclaim":"demo-vol1-claim0","openebs.io/storageclass":"openebs-jiva-default"}},"spec":{"capacity":"4G","iqn":"","targetPortal":"","targetIP":"","targetPort":"","replicas":"","casType":"","fsType":"","lun":0},"cloneSpec":{},"status":{"Phase":"","Message":"","Reason":""}}
  316. E1214 10:37:21.786538 1 volume.go:128] Internal Server Error: failed to create volume 'pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c': response: services "pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c-ctrl-svc" already exists
  317. E1214 10:37:21.786572 1 cas_provision.go:118] Failed to create volume: {PersistentVolumeReclaimPolicy:Delete PVName:pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c MountOptions:[] PVC:&PersistentVolumeClaim{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:demo-vol1-claim0,GenerateName:,Namespace:openebs,SelfLink:/api/v1/namespaces/openebs/persistentvolumeclaims/demo-vol1-claim0,UID:1af6d76e-ff8a-11e8-b6ae-0050569b3a3c,ResourceVersion:711596,Generation:0,CreationTimestamp:2018-12-14 10:22:05 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{kubectl.kubernetes.io/last-applied-configuration: {"apiVersion":"v1","kind":"PersistentVolumeClaim","metadata":{"annotations":{},"name":"demo-vol1-claim0","namespace":"openebs"},"spec":{"accessModes":["ReadWriteOnce"],"resources":{"requests":{"storage":"4G"}},"storageClassName":"openebs-jiva-default"}}
  318. ,volume.beta.kubernetes.io/storage-provisioner: openebs.io/provisioner-iscsi,},OwnerReferences:[],Finalizers:[kubernetes.io/pvc-protection],ClusterName:,Initializers:nil,},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{4 9} {<nil>} 4G DecimalSI},},},VolumeName:,Selector:nil,StorageClassName:*openebs-jiva-default,VolumeMode:nil,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:ResourceList{},Conditions:[],},} Parameters:map[] SelectedNode:nil AllowedTopologies:[]}, error: Internal Server Error: failed to create volume 'pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c': response: services "pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c-ctrl-svc" already exists
  319. W1214 10:37:21.786725 1 controller.go:750] Retrying syncing claim "openebs/demo-vol1-claim0" because failures 6 < threshold 15
  320. E1214 10:37:21.786750 1 controller.go:765] error syncing claim "openebs/demo-vol1-claim0": failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c': response: services "pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c-ctrl-svc" already exists
  321. I1214 10:37:21.786768 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"openebs", Name:"demo-vol1-claim0", UID:"1af6d76e-ff8a-11e8-b6ae-0050569b3a3c", APIVersion:"v1", ResourceVersion:"711596", FieldPath:""}): type: 'Warning' reason: 'ProvisioningFailed' failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c': response: services "pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c-ctrl-svc" already exists
  322. I1214 10:38:12.249819 1 controller.go:991] provision "default/demo-vol1-claim" class "openebs-jiva-default": started
  323. I1214 10:38:12.253255 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"e677166f-ff8b-11e8-af52-0050569bbc99", APIVersion:"v1", ResourceVersion:"713863", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/demo-vol1-claim"
  324. E1214 10:38:12.294742 1 volume.go:170] HTTP Status error from maya-apiserver: Not Found
  325. I1214 10:38:12.295101 1 volume.go:105] CAS Volume Spec Created:
  326. {"metadata":{"name":"pvc-e677166f-ff8b-11e8-af52-0050569bbc99","namespace":"default","creationTimestamp":null,"labels":{"openebs.io/namespace":"default","openebs.io/persistentvolumeclaim":"demo-vol1-claim","openebs.io/storageclass":"openebs-jiva-default"}},"spec":{"capacity":"4G","iqn":"","targetPortal":"","targetIP":"","targetPort":"","replicas":"","casType":"","fsType":"","lun":0},"cloneSpec":{},"status":{"Phase":"","Message":"","Reason":""}}
  327. E1214 10:38:12.378483 1 volume.go:128] Internal Server Error: failed to create volume 'pvc-e677166f-ff8b-11e8-af52-0050569bbc99': response: services "pvc-e677166f-ff8b-11e8-af52-0050569bbc99-ctrl-svc" already exists
  328. E1214 10:38:12.378530 1 cas_provision.go:118] Failed to create volume: {PersistentVolumeReclaimPolicy:Delete PVName:pvc-e677166f-ff8b-11e8-af52-0050569bbc99 MountOptions:[] PVC:&PersistentVolumeClaim{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:demo-vol1-claim,GenerateName:,Namespace:default,SelfLink:/api/v1/namespaces/default/persistentvolumeclaims/demo-vol1-claim,UID:e677166f-ff8b-11e8-af52-0050569bbc99,ResourceVersion:713863,Generation:0,CreationTimestamp:2018-12-14 10:34:56 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{kubectl.kubernetes.io/last-applied-configuration: {"apiVersion":"v1","kind":"PersistentVolumeClaim","metadata":{"annotations":{},"name":"demo-vol1-claim","namespace":"default"},"spec":{"accessModes":["ReadWriteOnce"],"resources":{"requests":{"storage":"4G"}},"storageClassName":"openebs-jiva-default"}}
  329. ,volume.beta.kubernetes.io/storage-provisioner: openebs.io/provisioner-iscsi,},OwnerReferences:[],Finalizers:[kubernetes.io/pvc-protection],ClusterName:,Initializers:nil,},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{4 9} {<nil>} 4G DecimalSI},},},VolumeName:,Selector:nil,StorageClassName:*openebs-jiva-default,VolumeMode:nil,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:ResourceList{},Conditions:[],},} Parameters:map[] SelectedNode:nil AllowedTopologies:[]}, error: Internal Server Error: failed to create volume 'pvc-e677166f-ff8b-11e8-af52-0050569bbc99': response: services "pvc-e677166f-ff8b-11e8-af52-0050569bbc99-ctrl-svc" already exists
  330. W1214 10:38:12.378704 1 controller.go:750] Retrying syncing claim "default/demo-vol1-claim" because failures 4 < threshold 15
  331. I1214 10:38:12.378794 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"e677166f-ff8b-11e8-af52-0050569bbc99", APIVersion:"v1", ResourceVersion:"713863", FieldPath:""}): type: 'Warning' reason: 'ProvisioningFailed' failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-e677166f-ff8b-11e8-af52-0050569bbc99': response: services "pvc-e677166f-ff8b-11e8-af52-0050569bbc99-ctrl-svc" already exists
  332. E1214 10:38:12.378829 1 controller.go:765] error syncing claim "default/demo-vol1-claim": failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-e677166f-ff8b-11e8-af52-0050569bbc99': response: services "pvc-e677166f-ff8b-11e8-af52-0050569bbc99-ctrl-svc" already exists
  333. E1214 10:42:12.378976 1 controller.go:820] claim "default/demo-vol1-claim" in work queue no longer exists
  334. I1214 10:52:50.850245 1 controller.go:991] provision "default/demo-vol1-claim" class "openebs-jiva-default": started
  335. I1214 10:52:50.853087 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"65a1923f-ff8e-11e8-b6ae-0050569b3a3c", APIVersion:"v1", ResourceVersion:"716973", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/demo-vol1-claim"
  336. E1214 10:52:50.888202 1 volume.go:170] HTTP Status error from maya-apiserver: Not Found
  337. I1214 10:52:50.888347 1 volume.go:105] CAS Volume Spec Created:
  338. {"metadata":{"name":"pvc-65a1923f-ff8e-11e8-b6ae-0050569b3a3c","namespace":"default","creationTimestamp":null,"labels":{"openebs.io/namespace":"default","openebs.io/persistentvolumeclaim":"demo-vol1-claim","openebs.io/storageclass":"openebs-jiva-default"}},"spec":{"capacity":"4G","iqn":"","targetPortal":"","targetIP":"","targetPort":"","replicas":"","casType":"","fsType":"","lun":0},"cloneSpec":{},"status":{"Phase":"","Message":"","Reason":""}}
  339. I1214 10:52:51.018861 1 volume.go:132] volume Successfully Created:
  340. {"apiVersion":"v1alpha1","kind":"CASVolume","metadata":{"annotations":{"openebs.io/storageclass-version":"704640"},"name":"pvc-65a1923f-ff8e-11e8-b6ae-0050569b3a3c"},"spec":{"capacity":"4G","casType":"jiva","fsType":"","iqn":"iqn.2016-09.com.openebs.jiva:pvc-65a1923f-ff8e-11e8-b6ae-0050569b3a3c","lun":0,"replicas":"3","targetIP":"\u003cno value\u003e","targetPort":"3260","targetPortal":"10.109.213.222:3260"},"status":{"Message":"","Phase":"","Reason":""}}
  341. E1214 10:52:51.082230 1 volume.go:170] HTTP Status error from maya-apiserver: Not Found
  342. E1214 10:52:51.082576 1 cas_provision.go:123] Failed to read volume: Not Found
  343. W1214 10:52:51.082635 1 controller.go:750] Retrying syncing claim "default/demo-vol1-claim" because failures 0 < threshold 15
  344. E1214 10:52:51.082663 1 controller.go:765] error syncing claim "default/demo-vol1-claim": failed to provision volume with StorageClass "openebs-jiva-default": Not Found
  345. I1214 10:52:51.082684 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"65a1923f-ff8e-11e8-b6ae-0050569b3a3c", APIVersion:"v1", ResourceVersion:"716973", FieldPath:""}): type: 'Warning' reason: 'ProvisioningFailed' failed to provision volume with StorageClass "openebs-jiva-default": Not Found
  346. I1214 10:53:06.082970 1 controller.go:991] provision "default/demo-vol1-claim" class "openebs-jiva-default": started
  347. I1214 10:53:06.086127 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"65a1923f-ff8e-11e8-b6ae-0050569b3a3c", APIVersion:"v1", ResourceVersion:"716973", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/demo-vol1-claim"
  348. E1214 10:53:06.133423 1 volume.go:170] HTTP Status error from maya-apiserver: Not Found
  349. I1214 10:53:06.133603 1 volume.go:105] CAS Volume Spec Created:
  350. {"metadata":{"name":"pvc-65a1923f-ff8e-11e8-b6ae-0050569b3a3c","namespace":"default","creationTimestamp":null,"labels":{"openebs.io/namespace":"default","openebs.io/persistentvolumeclaim":"demo-vol1-claim","openebs.io/storageclass":"openebs-jiva-default"}},"spec":{"capacity":"4G","iqn":"","targetPortal":"","targetIP":"","targetPort":"","replicas":"","casType":"","fsType":"","lun":0},"cloneSpec":{},"status":{"Phase":"","Message":"","Reason":""}}
  351. E1214 10:53:06.216126 1 volume.go:128] Internal Server Error: failed to create volume 'pvc-65a1923f-ff8e-11e8-b6ae-0050569b3a3c': response: services "pvc-65a1923f-ff8e-11e8-b6ae-0050569b3a3c-ctrl-svc" already exists
  352. E1214 10:53:06.216169 1 cas_provision.go:118] Failed to create volume: {PersistentVolumeReclaimPolicy:Delete PVName:pvc-65a1923f-ff8e-11e8-b6ae-0050569b3a3c MountOptions:[] PVC:&PersistentVolumeClaim{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:demo-vol1-claim,GenerateName:,Namespace:default,SelfLink:/api/v1/namespaces/default/persistentvolumeclaims/demo-vol1-claim,UID:65a1923f-ff8e-11e8-b6ae-0050569b3a3c,ResourceVersion:716973,Generation:0,CreationTimestamp:2018-12-14 10:52:49 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{kubectl.kubernetes.io/last-applied-configuration: {"apiVersion":"v1","kind":"PersistentVolumeClaim","metadata":{"annotations":{},"name":"demo-vol1-claim","namespace":"default"},"spec":{"accessModes":["ReadWriteOnce"],"resources":{"requests":{"storage":"4G"}},"storageClassName":"openebs-jiva-default"}}
  353. ,volume.beta.kubernetes.io/storage-provisioner: openebs.io/provisioner-iscsi,},OwnerReferences:[],Finalizers:[kubernetes.io/pvc-protection],ClusterName:,Initializers:nil,},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{4 9} {<nil>} 4G DecimalSI},},},VolumeName:,Selector:nil,StorageClassName:*openebs-jiva-default,VolumeMode:nil,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:ResourceList{},Conditions:[],},} Parameters:map[] SelectedNode:nil AllowedTopologies:[]}, error: Internal Server Error: failed to create volume 'pvc-65a1923f-ff8e-11e8-b6ae-0050569b3a3c': response: services "pvc-65a1923f-ff8e-11e8-b6ae-0050569b3a3c-ctrl-svc" already exists
  354. W1214 10:53:06.216309 1 controller.go:750] Retrying syncing claim "default/demo-vol1-claim" because failures 1 < threshold 15
  355. E1214 10:53:06.216335 1 controller.go:765] error syncing claim "default/demo-vol1-claim": failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-65a1923f-ff8e-11e8-b6ae-0050569b3a3c': response: services "pvc-65a1923f-ff8e-11e8-b6ae-0050569b3a3c-ctrl-svc" already exists
  356. I1214 10:53:06.216396 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"65a1923f-ff8e-11e8-b6ae-0050569b3a3c", APIVersion:"v1", ResourceVersion:"716973", FieldPath:""}): type: 'Warning' reason: 'ProvisioningFailed' failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-65a1923f-ff8e-11e8-b6ae-0050569b3a3c': response: services "pvc-65a1923f-ff8e-11e8-b6ae-0050569b3a3c-ctrl-svc" already exists
  357. I1214 10:53:21.787018 1 controller.go:991] provision "openebs/demo-vol1-claim0" class "openebs-jiva-default": started
  358. I1214 10:53:21.790698 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"openebs", Name:"demo-vol1-claim0", UID:"1af6d76e-ff8a-11e8-b6ae-0050569b3a3c", APIVersion:"v1", ResourceVersion:"711596", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "openebs/demo-vol1-claim0"
  359. E1214 10:53:21.836112 1 volume.go:170] HTTP Status error from maya-apiserver: Not Found
  360. I1214 10:53:21.836287 1 volume.go:105] CAS Volume Spec Created:
  361. {"metadata":{"name":"pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c","namespace":"openebs","creationTimestamp":null,"labels":{"openebs.io/namespace":"openebs","openebs.io/persistentvolumeclaim":"demo-vol1-claim0","openebs.io/storageclass":"openebs-jiva-default"}},"spec":{"capacity":"4G","iqn":"","targetPortal":"","targetIP":"","targetPort":"","replicas":"","casType":"","fsType":"","lun":0},"cloneSpec":{},"status":{"Phase":"","Message":"","Reason":""}}
  362. E1214 10:53:21.928820 1 volume.go:128] Internal Server Error: failed to create volume 'pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c': response: services "pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c-ctrl-svc" already exists
  363. E1214 10:53:21.928858 1 cas_provision.go:118] Failed to create volume: {PersistentVolumeReclaimPolicy:Delete PVName:pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c MountOptions:[] PVC:&PersistentVolumeClaim{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:demo-vol1-claim0,GenerateName:,Namespace:openebs,SelfLink:/api/v1/namespaces/openebs/persistentvolumeclaims/demo-vol1-claim0,UID:1af6d76e-ff8a-11e8-b6ae-0050569b3a3c,ResourceVersion:711596,Generation:0,CreationTimestamp:2018-12-14 10:22:05 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{kubectl.kubernetes.io/last-applied-configuration: {"apiVersion":"v1","kind":"PersistentVolumeClaim","metadata":{"annotations":{},"name":"demo-vol1-claim0","namespace":"openebs"},"spec":{"accessModes":["ReadWriteOnce"],"resources":{"requests":{"storage":"4G"}},"storageClassName":"openebs-jiva-default"}}
  364. ,volume.beta.kubernetes.io/storage-provisioner: openebs.io/provisioner-iscsi,},OwnerReferences:[],Finalizers:[kubernetes.io/pvc-protection],ClusterName:,Initializers:nil,},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{4 9} {<nil>} 4G DecimalSI},},},VolumeName:,Selector:nil,StorageClassName:*openebs-jiva-default,VolumeMode:nil,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:ResourceList{},Conditions:[],},} Parameters:map[] SelectedNode:nil AllowedTopologies:[]}, error: Internal Server Error: failed to create volume 'pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c': response: services "pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c-ctrl-svc" already exists
  365. W1214 10:53:21.929042 1 controller.go:750] Retrying syncing claim "openebs/demo-vol1-claim0" because failures 7 < threshold 15
  366. E1214 10:53:21.929071 1 controller.go:765] error syncing claim "openebs/demo-vol1-claim0": failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c': response: services "pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c-ctrl-svc" already exists
  367. I1214 10:53:21.929131 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"openebs", Name:"demo-vol1-claim0", UID:"1af6d76e-ff8a-11e8-b6ae-0050569b3a3c", APIVersion:"v1", ResourceVersion:"711596", FieldPath:""}): type: 'Warning' reason: 'ProvisioningFailed' failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c': response: services "pvc-1af6d76e-ff8a-11e8-b6ae-0050569b3a3c-ctrl-svc" already exists
  368. I1214 10:53:36.216529 1 controller.go:991] provision "default/demo-vol1-claim" class "openebs-jiva-default": started
  369. I1214 10:53:36.219368 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"65a1923f-ff8e-11e8-b6ae-0050569b3a3c", APIVersion:"v1", ResourceVersion:"716973", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/demo-vol1-claim"
  370. E1214 10:53:36.259202 1 volume.go:170] HTTP Status error from maya-apiserver: Not Found
  371. I1214 10:53:36.259334 1 volume.go:105] CAS Volume Spec Created:
  372. {"metadata":{"name":"pvc-65a1923f-ff8e-11e8-b6ae-0050569b3a3c","namespace":"default","creationTimestamp":null,"labels":{"openebs.io/namespace":"default","openebs.io/persistentvolumeclaim":"demo-vol1-claim","openebs.io/storageclass":"openebs-jiva-default"}},"spec":{"capacity":"4G","iqn":"","targetPortal":"","targetIP":"","targetPort":"","replicas":"","casType":"","fsType":"","lun":0},"cloneSpec":{},"status":{"Phase":"","Message":"","Reason":""}}
  373. E1214 10:53:36.352857 1 volume.go:128] Internal Server Error: failed to create volume 'pvc-65a1923f-ff8e-11e8-b6ae-0050569b3a3c': response: services "pvc-65a1923f-ff8e-11e8-b6ae-0050569b3a3c-ctrl-svc" already exists
  374. E1214 10:53:36.352896 1 cas_provision.go:118] Failed to create volume: {PersistentVolumeReclaimPolicy:Delete PVName:pvc-65a1923f-ff8e-11e8-b6ae-0050569b3a3c MountOptions:[] PVC:&PersistentVolumeClaim{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:demo-vol1-claim,GenerateName:,Namespace:default,SelfLink:/api/v1/namespaces/default/persistentvolumeclaims/demo-vol1-claim,UID:65a1923f-ff8e-11e8-b6ae-0050569b3a3c,ResourceVersion:716973,Generation:0,CreationTimestamp:2018-12-14 10:52:49 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{kubectl.kubernetes.io/last-applied-configuration: {"apiVersion":"v1","kind":"PersistentVolumeClaim","metadata":{"annotations":{},"name":"demo-vol1-claim","namespace":"default"},"spec":{"accessModes":["ReadWriteOnce"],"resources":{"requests":{"storage":"4G"}},"storageClassName":"openebs-jiva-default"}}
  375. ,volume.beta.kubernetes.io/storage-provisioner: openebs.io/provisioner-iscsi,},OwnerReferences:[],Finalizers:[kubernetes.io/pvc-protection],ClusterName:,Initializers:nil,},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{4 9} {<nil>} 4G DecimalSI},},},VolumeName:,Selector:nil,StorageClassName:*openebs-jiva-default,VolumeMode:nil,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:ResourceList{},Conditions:[],},} Parameters:map[] SelectedNode:nil AllowedTopologies:[]}, error: Internal Server Error: failed to create volume 'pvc-65a1923f-ff8e-11e8-b6ae-0050569b3a3c': response: services "pvc-65a1923f-ff8e-11e8-b6ae-0050569b3a3c-ctrl-svc" already exists
  376. W1214 10:53:36.353068 1 controller.go:750] Retrying syncing claim "default/demo-vol1-claim" because failures 2 < threshold 15
  377. E1214 10:53:36.353092 1 controller.go:765] error syncing claim "default/demo-vol1-claim": failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-65a1923f-ff8e-11e8-b6ae-0050569b3a3c': response: services "pvc-65a1923f-ff8e-11e8-b6ae-0050569b3a3c-ctrl-svc" already exists
  378. I1214 10:53:36.353234 1 event.go:221] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"demo-vol1-claim", UID:"65a1923f-ff8e-11e8-b6ae-0050569b3a3c", APIVersion:"v1", ResourceVersion:"716973", FieldPath:""}): type: 'Warning' reason: 'ProvisioningFailed' failed to provision volume with StorageClass "openebs-jiva-default": Internal Server Error: failed to create volume 'pvc-65a1923f-ff8e-11e8-b6ae-0050569b3a3c': response: services "pvc-65a1923f-ff8e-11e8-b6ae-0050569b3a3c-ctrl-svc" already exists
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement