API tools faq
paste
sonali_jadhav

vm creation issue

sonali_jadhav
Jul 10th, 2015
547
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 103.90 KB | None | 0 0
raw download clone embed print report
  1. 015-07-10 15:56:50,304 DEBUG [c.c.a.t.Request] (Work-Job-Executor-108:ctx-9c560947 job-4187/job-4188 ctx-9f5db50a) Seq 5-1214283049529773588: Executing: { Cmd , MgmtId: 59778234354585, via: 5(SeSolXS03), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StartCommand":{"vm":{"id":94,"name":"i-22-94-VM","bootloader":"CD","type":"User","cpus":1,"minSpeed":1000,"maxSpeed":1000,"minRam":1073741824,"maxRam":1073741824,"arch":"x86_64","os":"Other CentOS (64-bit)","platformEmulator":"Other install media","bootArgs":"","enableHA":false,"limitCpuUse":false,"enableDynamicallyScaleVm":false,"vncPassword":"CsRHHR7anHg3MRYb6vscdA==","params":{},"uuid":"56a99619-2ada-424b-8f15-d6aa5aee1924","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"48dad2c9-b913-442d-8d69-86e55a9dc195","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"876d490c-a1d4-3bfe-88b7-1bdb2479541b","id":1,"poolType":"NetworkFilesystem","host":"172.16.5.194","path":"/tank/primstore","port":2049,"url":"NetworkFilesystem://172.16.5.194/tank/primstore/?ROLE=Primary&STOREUUID=876d490c-a1d4-3bfe-88b7-1bdb2479541b"}},"name":"ROOT-94","size":21474836480,"path":"167964d5-398c-42c8-afeb-bc5f008ff7ff","volumeId":130,"vmName":"i-22-94-VM","accountId":22,"format":"VHD","provisioningType":"THIN","id":130,"deviceId":0,"hypervisorType":"XenServer"}},"diskSeq":0,"path":"167964d5-398c-42c8-afeb-bc5f008ff7ff","type":"ROOT","_details":{"managed":"false","storagePort":"2049","storageHost":"172.16.5.194","volumeSize":"21474836480"}},{"data":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/2/213/213-2-70f3dc19-ce4a-3f5c-9102-8eaaa9717d2d.iso","origUrl":"http://ftp.sunet.se/pub/Linux/distributions/centos/6.6/isos/x86_64/CentOS-6.6-x86_64-bin-DVD1.iso","uuid":"5c6870c5-c24f-4ba4-a846-f2c395f59f41","id":213,"format":"ISO","accountId":2,"checksum":"7b1fb1a11499b31271ded79da6af8584","hvm":true,"displayText":"CentOS 6.6 x86_64","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://192.168.48.10/tank/secstore","_role":"Image"}},"name":"213-2-70f3dc19-ce4a-3f5c-9102-8eaaa9717d2d","guestOsType":"Other CentOS (64-bit)","hypervisorType":"None"}},"diskSeq":3,"type":"ISO"}],"nics":[{"deviceId":0,"networkRateMbps":200,"defaultNic":true,"pxeDisable":false,"nicUuid":"c46c4564-9507-436e-9b60-14def086bf43","uuid":"5aa6781b-1fe4-4a82-8c0a-652cc6699515","ip":"10.1.1.178","netmask":"255.255.255.0","gateway":"10.1.1.1","mac":"02:00:5a:b3:00:03","dns1":"8.8.8.8","dns2":"8.8.4.4","broadcastType":"Vlan","type":"Guest","broadcastUri":"vlan://799","isolationUri":"vlan://799","isSecurityGroupEnabled":false,"name":"guest"}],"vcpuMaxLimit":16},"hostIp":"172.16.5.188","executeInSequence":false,"wait":0}}] }
  2. 2015-07-10 15:56:50,304 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-140:ctx-23496877) Seq 5-1214283049529773588: Executing request
  3. 2015-07-10 15:56:50,310 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-140:ctx-23496877) 1. The VM i-22-94-VM is in Starting state.
  4. 2015-07-10 15:56:50,334 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-140:ctx-23496877) Created VM 390ecfc4-73dc-75a3-27a5-409929c75749 for i-22-94-VM
  5. 2015-07-10 15:56:50,352 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-140:ctx-23496877) VBD 700e255d-aa4b-427c-ad09-3e30f10395ee created for com.cloud.agent.api.to.DiskTO@16453b7d
  6. 2015-07-10 15:56:50,384 WARN [c.c.h.x.r.CitrixResourceBase] (DirectAgent-140:ctx-23496877) createIsoSRbyURI failed! mountpoint: 192.168.48.10/tank/secstore/template/tmpl/2/213 due to This operation is not supported during an upgrade.
  7. This operation is not supported during an upgrade.
  8. at com.xensource.xenapi.Types.checkResponse(Types.java:706)
  9. at com.xensource.xenapi.Connection.dispatch(Connection.java:395)
  10. at com.cloud.hypervisor.xenserver.resource.XenServerConnectionPool$XenServerConnection.dispatch(XenServerConnectionPool.java:462)
  11. at com.xensource.xenapi.SR.create(SR.java:894)
  12. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.createIsoSRbyURI(CitrixResourceBase.java:5795)
  13. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.mount(CitrixResourceBase.java:1209)
  14. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.createVbd(CitrixResourceBase.java:1229)
  15. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.execute(CitrixResourceBase.java:1780)
  16. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:489)
  17. at com.cloud.hypervisor.xenserver.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:64)
  18. at com.cloud.hypervisor.xenserver.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:87)
  19. at com.cloud.hypervisor.xenserver.resource.XenServer620SP1Resource.executeRequest(XenServer620SP1Resource.java:65)
  20. at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:302)
  21. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  22. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  23. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  24. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  25. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  26. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  27. at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  28. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
  29. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
  30. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  31. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  32. at java.lang.Thread.run(Thread.java:744)
  33. 2015-07-10 15:56:50,385 WARN [c.c.h.x.r.CitrixResourceBase] (DirectAgent-140:ctx-23496877) Catch Exception: class com.cloud.utils.exception.CloudRuntimeException due to com.cloud.utils.exception.CloudRuntimeException: createIsoSRbyURI failed! mountpoint: 192.168.48.10/tank/secstore/template/tmpl/2/213 due to This operation is not supported during an upgrade.
  34. com.cloud.utils.exception.CloudRuntimeException: createIsoSRbyURI failed! mountpoint: 192.168.48.10/tank/secstore/template/tmpl/2/213 due to This operation is not supported during an upgrade.
  35. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.createIsoSRbyURI(CitrixResourceBase.java:5804)
  36. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.mount(CitrixResourceBase.java:1209)
  37. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.createVbd(CitrixResourceBase.java:1229)
  38. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.execute(CitrixResourceBase.java:1780)
  39. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:489)
  40. at com.cloud.hypervisor.xenserver.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:64)
  41. at com.cloud.hypervisor.xenserver.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:87)
  42. at com.cloud.hypervisor.xenserver.resource.XenServer620SP1Resource.executeRequest(XenServer620SP1Resource.java:65)
  43. at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:302)
  44. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  45. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  46. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  47. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  48. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  49. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  50. at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  51. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
  52. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
  53. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  54. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  55. at java.lang.Thread.run(Thread.java:744)
  56. Caused by: This operation is not supported during an upgrade.
  57. at com.xensource.xenapi.Types.checkResponse(Types.java:706)
  58. at com.xensource.xenapi.Connection.dispatch(Connection.java:395)
  59. at com.cloud.hypervisor.xenserver.resource.XenServerConnectionPool$XenServerConnection.dispatch(XenServerConnectionPool.java:462)
  60. at com.xensource.xenapi.SR.create(SR.java:894)
  61. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.createIsoSRbyURI(CitrixResourceBase.java:5795)
  62. ... 20 more
  63. 2015-07-10 15:56:50,387 WARN [c.c.h.x.r.CitrixResourceBase] (DirectAgent-140:ctx-23496877) Unable to start i-22-94-VM due to
  64. com.cloud.utils.exception.CloudRuntimeException: createIsoSRbyURI failed! mountpoint: 192.168.48.10/tank/secstore/template/tmpl/2/213 due to This operation is not supported during an upgrade.
  65. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.createIsoSRbyURI(CitrixResourceBase.java:5804)
  66. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.mount(CitrixResourceBase.java:1209)
  67. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.createVbd(CitrixResourceBase.java:1229)
  68. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.execute(CitrixResourceBase.java:1780)
  69. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:489)
  70. at com.cloud.hypervisor.xenserver.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:64)
  71. at com.cloud.hypervisor.xenserver.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:87)
  72. at com.cloud.hypervisor.xenserver.resource.XenServer620SP1Resource.executeRequest(XenServer620SP1Resource.java:65)
  73. at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:302)
  74. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  75. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  76. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  77. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  78. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  79. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  80. at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  81. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
  82. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
  83. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  84. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  85. at java.lang.Thread.run(Thread.java:744)
  86. Caused by: This operation is not supported during an upgrade.
  87. at com.xensource.xenapi.Types.checkResponse(Types.java:706)
  88. at com.xensource.xenapi.Connection.dispatch(Connection.java:395)
  89. at com.cloud.hypervisor.xenserver.resource.XenServerConnectionPool$XenServerConnection.dispatch(XenServerConnectionPool.java:462)
  90. at com.xensource.xenapi.SR.create(SR.java:894)
  91. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.createIsoSRbyURI(CitrixResourceBase.java:5795)
  92. ... 20 more
  93. 2015-07-10 15:56:50,404 WARN [c.c.h.x.r.CitrixResourceBase] (DirectAgent-140:ctx-23496877) Unable to clean up VBD due to
  94. You gave an invalid object reference. The object may have recently been deleted. The class parameter gives the type of reference given, and the handle parameter echoes the bad value given.
  95. at com.xensource.xenapi.Types.checkResponse(Types.java:693)
  96. at com.xensource.xenapi.Connection.dispatch(Connection.java:395)
  97. at com.cloud.hypervisor.xenserver.resource.XenServerConnectionPool$XenServerConnection.dispatch(XenServerConnectionPool.java:462)
  98. at com.xensource.xenapi.VBD.unplug(VBD.java:1109)
  99. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.handleVmStartFailure(CitrixResourceBase.java:1520)
  100. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.execute(CitrixResourceBase.java:1871)
  101. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:489)
  102. at com.cloud.hypervisor.xenserver.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:64)
  103. at com.cloud.hypervisor.xenserver.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:87)
  104. at com.cloud.hypervisor.xenserver.resource.XenServer620SP1Resource.executeRequest(XenServer620SP1Resource.java:65)
  105. at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:302)
  106. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  107. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  108. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  109. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  110. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  111. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  112. at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  113. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
  114. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
  115. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  116. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  117. at java.lang.Thread.run(Thread.java:744)
  118. 2015-07-10 15:56:50,405 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-140:ctx-23496877) The VM is in stopped state, detected problem during startup : i-22-94-VM
  119. 2015-07-10 15:56:50,405 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-140:ctx-23496877) Seq 5-1214283049529773588: Response Received:
  120. 2015-07-10 15:56:50,406 DEBUG [c.c.a.t.Request] (DirectAgent-140:ctx-23496877) Seq 5-1214283049529773588: Processing: { Ans: , MgmtId: 59778234354585, via: 5, Ver: v1, Flags: 10, [{"com.cloud.agent.api.StartAnswer":{"vm":{"id":94,"name":"i-22-94-VM","bootloader":"CD","type":"User","cpus":1,"minSpeed":1000,"maxSpeed":1000,"minRam":1073741824,"maxRam":1073741824,"arch":"x86_64","os":"Other CentOS (64-bit)","platformEmulator":"Other install media","bootArgs":"","enableHA":false,"limitCpuUse":false,"enableDynamicallyScaleVm":false,"vncPassword":"CsRHHR7anHg3MRYb6vscdA==","params":{},"uuid":"56a99619-2ada-424b-8f15-d6aa5aee1924","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"48dad2c9-b913-442d-8d69-86e55a9dc195","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"876d490c-a1d4-3bfe-88b7-1bdb2479541b","id":1,"poolType":"NetworkFilesystem","host":"172.16.5.194","path":"/tank/primstore","port":2049,"url":"NetworkFilesystem://172.16.5.194/tank/primstore/?ROLE=Primary&STOREUUID=876d490c-a1d4-3bfe-88b7-1bdb2479541b"}},"name":"ROOT-94","size":21474836480,"path":"167964d5-398c-42c8-afeb-bc5f008ff7ff","volumeId":130,"vmName":"i-22-94-VM","accountId":22,"format":"VHD","provisioningType":"THIN","id":130,"deviceId":0,"hypervisorType":"XenServer"}},"diskSeq":0,"path":"167964d5-398c-42c8-afeb-bc5f008ff7ff","type":"ROOT","_details":{"managed":"false","storagePort":"2049","storageHost":"172.16.5.194","volumeSize":"21474836480"}},{"data":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/2/213/213-2-70f3dc19-ce4a-3f5c-9102-8eaaa9717d2d.iso","origUrl":"http://ftp.sunet.se/pub/Linux/distributions/centos/6.6/isos/x86_64/CentOS-6.6-x86_64-bin-DVD1.iso","uuid":"5c6870c5-c24f-4ba4-a846-f2c395f59f41","id":213,"format":"ISO","accountId":2,"checksum":"7b1fb1a11499b31271ded79da6af8584","hvm":true,"displayText":"CentOS 6.6 x86_64","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://192.168.48.10/tank/secstore","_role":"Image"}},"name":"213-2-70f3dc19-ce4a-3f5c-9102-8eaaa9717d2d","guestOsType":"Other CentOS (64-bit)","hypervisorType":"None"}},"diskSeq":3,"type":"ISO"}],"nics":[{"deviceId":0,"networkRateMbps":200,"defaultNic":true,"pxeDisable":false,"nicUuid":"c46c4564-9507-436e-9b60-14def086bf43","uuid":"5aa6781b-1fe4-4a82-8c0a-652cc6699515","ip":"10.1.1.178","netmask":"255.255.255.0","gateway":"10.1.1.1","mac":"02:00:5a:b3:00:03","dns1":"8.8.8.8","dns2":"8.8.4.4","broadcastType":"Vlan","type":"Guest","broadcastUri":"vlan://799","isolationUri":"vlan://799","isSecurityGroupEnabled":false,"name":"guest"}],"vcpuMaxLimit":16},"_iqnToPath":{},"result":false,"details":"Unable to start i-22-94-VM due to ","wait":0}}] }
  121. 2015-07-10 15:56:50,406 DEBUG [c.c.a.t.Request] (Work-Job-Executor-108:ctx-9c560947 job-4187/job-4188 ctx-9f5db50a) Seq 5-1214283049529773588: Received: { Ans: , MgmtId: 59778234354585, via: 5, Ver: v1, Flags: 10, { StartAnswer } }
  122. 2015-07-10 15:56:50,454 INFO [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-108:ctx-9c560947 job-4187/job-4188 ctx-9f5db50a) Unable to start VM on Host[-5-Routing] due to Unable to start i-22-94-VM due to
  123. 2015-07-10 15:56:50,502 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-108:ctx-9c560947 job-4187/job-4188 ctx-9f5db50a) Cleaning up resources for the vm VM[User|i-22-94-VM] in Starting state
  124. 2015-07-10 15:56:50,508 DEBUG [c.c.a.t.Request] (Work-Job-Executor-108:ctx-9c560947 job-4187/job-4188 ctx-9f5db50a) Seq 5-1214283049529773589: Sending { Cmd , MgmtId: 59778234354585, via: 5(SeSolXS03), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"checkBeforeCleanup":false,"vmName":"i-22-94-VM","wait":0}}] }
  125. 2015-07-10 15:56:50,509 DEBUG [c.c.a.t.Request] (Work-Job-Executor-108:ctx-9c560947 job-4187/job-4188 ctx-9f5db50a) Seq 5-1214283049529773589: Executing: { Cmd , MgmtId: 59778234354585, via: 5(SeSolXS03), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"checkBeforeCleanup":false,"vmName":"i-22-94-VM","wait":0}}] }
  126. 2015-07-10 15:56:50,509 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-269:ctx-ce8fef44) Seq 5-1214283049529773589: Executing request
  127. 2015-07-10 15:56:50,515 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-269:ctx-ce8fef44) Seq 5-1214283049529773589: Response Received:
  128. 2015-07-10 15:56:50,515 DEBUG [c.c.a.t.Request] (DirectAgent-269:ctx-ce8fef44) Seq 5-1214283049529773589: Processing: { Ans: , MgmtId: 59778234354585, via: 5, Ver: v1, Flags: 10, [{"com.cloud.agent.api.StopAnswer":{"result":true,"details":"VM does not exist","wait":0}}] }
  129. 2015-07-10 15:56:50,515 DEBUG [c.c.a.t.Request] (Work-Job-Executor-108:ctx-9c560947 job-4187/job-4188 ctx-9f5db50a) Seq 5-1214283049529773589: Received: { Ans: , MgmtId: 59778234354585, via: 5, Ver: v1, Flags: 10, { StopAnswer } }
  130. 2015-07-10 15:56:50,529 DEBUG [c.c.n.NetworkModelImpl] (Work-Job-Executor-108:ctx-9c560947 job-4187/job-4188 ctx-9f5db50a) Service SecurityGroup is not supported in the network id=224
  131. 2015-07-10 15:56:50,533 DEBUG [o.a.c.e.o.NetworkOrchestrator] (Work-Job-Executor-108:ctx-9c560947 job-4187/job-4188 ctx-9f5db50a) Changing active number of nics for network id=224 on -1
  132. 2015-07-10 15:56:50,636 DEBUG [o.a.c.e.o.NetworkOrchestrator] (Work-Job-Executor-108:ctx-9c560947 job-4187/job-4188 ctx-9f5db50a) Asking VirtualRouter to release NicProfile[175-94-386fe6e8-0120-4e0b-9d19-943f6617d46b-10.1.1.178-null
  133. 2015-07-10 15:56:50,636 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-108:ctx-9c560947 job-4187/job-4188 ctx-9f5db50a) Successfully released network resources for the vm VM[User|i-22-94-VM]
  134. 2015-07-10 15:56:50,636 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-108:ctx-9c560947 job-4187/job-4188 ctx-9f5db50a) Successfully cleanued up resources for the vm VM[User|i-22-94-VM] in Starting state
  135. 2015-07-10 15:56:50,641 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-108:ctx-9c560947 job-4187/job-4188 ctx-9f5db50a) Root volume is ready, need to place VM in volume's cluster
  136. 2015-07-10 15:56:50,660 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-108:ctx-9c560947 job-4187/job-4188 ctx-9f5db50a) Deploy avoids pods: [], clusters: [], hosts: [5]
  137. 2015-07-10 15:56:50,662 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-108:ctx-9c560947 job-4187/job-4188 ctx-9f5db50a) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@2a8314bf
  138. 2015-07-10 15:56:50,662 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-108:ctx-9c560947 job-4187/job-4188 ctx-9f5db50a) Trying to allocate a host and storage pools from dc:1, pod:1,cluster:1, requested cpu: 1000, requested ram: 1073741824
  139. 2015-07-10 15:56:50,662 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-108:ctx-9c560947 job-4187/job-4188 ctx-9f5db50a) Is ROOT volume READY (pool already allocated)?: Yes
  140. 2015-07-10 15:56:50,662 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-108:ctx-9c560947 job-4187/job-4188 ctx-9f5db50a) DeploymentPlan has host_id specified, choosing this host and making no checks on this host: 5
  141. 2015-07-10 15:56:50,665 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-108:ctx-9c560947 job-4187/job-4188 ctx-9f5db50a) The specified host is in avoid set
  142. 2015-07-10 15:56:50,665 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-108:ctx-9c560947 job-4187/job-4188 ctx-9f5db50a) Cannnot deploy to specified host, returning.
  143. 2015-07-10 15:56:50,719 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-c20ce76a) Begin cleanup expired async-jobs
  144. 2015-07-10 15:56:50,730 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-c20ce76a) End cleanup expired async-jobs
  145. 2015-07-10 15:56:50,790 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-108:ctx-9c560947 job-4187/job-4188 ctx-9f5db50a) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: 5
  146. 2015-07-10 15:56:50,800 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-108:ctx-9c560947 job-4187/job-4188 ctx-9f5db50a) Hosts's actual total CPU: 57600 and CPU after applying overprovisioning: 57600
  147. 2015-07-10 15:56:50,800 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-108:ctx-9c560947 job-4187/job-4188 ctx-9f5db50a) Hosts's actual total RAM: 95574311424 and RAM after applying overprovisioning: 95574310912
  148. 2015-07-10 15:56:50,801 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-108:ctx-9c560947 job-4187/job-4188 ctx-9f5db50a) release cpu from host: 5, old used: 11000,reserved: 0, actual total: 57600, total with overprovisioning: 57600; new used: 10000,reserved:0; movedfromreserved: false,moveToReserveredfalse
  149. 2015-07-10 15:56:50,801 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-108:ctx-9c560947 job-4187/job-4188 ctx-9f5db50a) release mem from host: 5, old used: 9663676416,reserved: 0, total: 95574310912; new used: 8589934592,reserved:0; movedfromreserved: false,moveToReserveredfalse
  150. 2015-07-10 15:56:50,882 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-8182a86e) Found 12 routers to update status.
  151. 2015-07-10 15:56:50,885 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-8182a86e) Found 0 networks to update RvR status.
  152. 2015-07-10 15:56:50,954 ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-108:ctx-9c560947 job-4187/job-4188 ctx-9f5db50a) Invocation exception, caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[User|i-22-94-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  153. 2015-07-10 15:56:50,954 INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-108:ctx-9c560947 job-4187/job-4188 ctx-9f5db50a) Rethrow exception com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[User|i-22-94-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  154. 2015-07-10 15:56:50,954 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-108:ctx-9c560947 job-4187/job-4188) Done with run of VM work job: com.cloud.vm.VmWorkStart for VM 94, job origin: 4187
  155. 2015-07-10 15:56:50,954 ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-108:ctx-9c560947 job-4187/job-4188) Unable to complete AsyncJobVO {id:4188, userId: 21, accountId: 22, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAAWAAAAAAAAABUAAAAAAAAAXnQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAXBzcgAOamF2YS5sYW5nLkxvbmc7i-SQzI8j3wIAAUoABXZhbHVleHIAEGphdmEubGFuZy5OdW1iZXKGrJUdC5TgiwIAAHhwAAAAAAAAAAFzcQB-AAgAAAAAAAAABXBwcHEAfgAKcHNyABFqYXZhLnV0aWwuSGFzaE1hcAUH2sHDFmDRAwACRgAKbG9hZEZhY3RvckkACXRocmVzaG9sZHhwP0AAAAAAAAx3CAAAABAAAAABdAAKVm1QYXNzd29yZHQAHHJPMEFCWFFBRG5OaGRtVmtYM0JoYzNOM2IzSmt4cA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 59778234354585, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Jul 10 15:56:13 CEST 2015}, job origin:4187
  156. com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[User|i-22-94-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  157. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:947)
  158. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4480)
  159. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  160. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
  161. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  162. at java.lang.reflect.Method.invoke(Method.java:606)
  163. at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
  164. at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4636)
  165. at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:103)
  166. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
  167. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  168. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  169. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  170. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  171. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  172. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
  173. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  174. at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  175. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  176. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  177. at java.lang.Thread.run(Thread.java:744)
  178. 2015-07-10 15:56:50,966 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-108:ctx-9c560947 job-4187/job-4188) Complete async job-4188, jobStatus: FAILED, resultCode: 0, result: rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdAA1VW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW1VzZXJ8aS0yMi05NC1WTV11cgAeW0xqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnQ7AkYqPDz9IjkCAAB4cAAAABVzcgAbamF2YS5sYW5nLlN0YWNrVHJhY2VFbGVtZW50YQnFmiY23YUCAARJAApsaW5lTnVtYmVyTAAOZGVjbGFyaW5nQ2xhc3NxAH4ACkwACGZpbGVOYW1lcQB-AApMAAptZXRob2ROYW1lcQB-AAp4cAAAA7N0ACZjb20uY2xvdWQudm0uVmlydHVhbE1hY2hpbmVNYW5hZ2VySW1wbHQAHlZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwuamF2YXQAEG9yY2hlc3RyYXRlU3RhcnRzcQB-ABEAABGAcQB-ABNxAH4AFHEAfgAVc3EAfgAR_____nQAJHN1bi5yZWZsZWN0Lk5hdGl2ZU1ldGhvZEFjY2Vzc29ySW1wbHQAHU5hdGl2ZU1ldGhvZEFjY2Vzc29ySW1wbC5qYXZhdAAHaW52b2tlMHNxAH4AEQAAADlxAH4AGHEAfgAZdAAGaW52b2tlc3EAfgARAAAAK3QAKHN1bi5yZWZsZWN0LkRlbGVnYXRpbmdNZXRob2RBY2Nlc3NvckltcGx0ACFEZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsLmphdmFxAH4AHHNxAH4AEQAAAl50ABhqYXZhLmxhbmcucmVmbGVjdC5NZXRob2R0AAtNZXRob2QuamF2YXEAfgAcc3EAfgARAAAAa3QAImNvbS5jbG91ZC52bS5WbVdvcmtKb2JIYW5kbGVyUHJveHl0ABpWbVdvcmtKb2JIYW5kbGVyUHJveHkuamF2YXQAD2hhbmRsZVZtV29ya0pvYnNxAH4AEQAAEhxxAH4AE3EAfgAUcQB-ACZzcQB-ABEAAABndAAgY29tLmNsb3VkLnZtLlZtV29ya0pvYkRpc3BhdGNoZXJ0ABhWbVdvcmtKb2JEaXNwYXRjaGVyLmphdmF0AAZydW5Kb2JzcQB-ABEAAAIZdAA_b3JnLmFwYWNoZS5jbG91ZHN0YWNrLmZyYW1ld29yay5qb2JzLmltcGwuQXN5bmNKb2JNYW5hZ2VySW1wbCQ1dAAYQXN5bmNKb2JNYW5hZ2VySW1wbC5qYXZhdAAMcnVuSW5Db250ZXh0c3EAfgARAAAAMXQAPm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZSQxdAAbTWFuYWdlZENvbnRleHRSdW5uYWJsZS5qYXZhdAADcnVuc3EAfgARAAAAOHQAQm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5EZWZhdWx0TWFuYWdlZENvbnRleHQkMXQAGkRlZmF1bHRNYW5hZ2VkQ29udGV4dC5qYXZhdAAEY2FsbHNxAH4AEQAAAGd0AEBvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0cQB-ADZ0AA9jYWxsV2l0aENvbnRleHRzcQB-ABEAAAA1cQB-ADlxAH4ANnQADnJ1bldpdGhDb250ZXh0c3EAfgARAAAALnQAPG9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZXEAfgAycQB-ADNzcQB-ABEAAAHucQB-AC1xAH4ALnEAfgAzc3EAfgARAAAB13QALmphdmEudXRpbC5jb25jdXJyZW50LkV4ZWN1dG9ycyRSdW5uYWJsZUFkYXB0ZXJ0AA5FeGVjdXRvcnMuamF2YXEAfgA3c3EAfgARAAABBnQAH2phdmEudXRpbC5jb25jdXJyZW50LkZ1dHVyZVRhc2t0AA9GdXR1cmVUYXNrLmphdmFxAH4AM3NxAH4AEQAABHl0ACdqYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3J0ABdUaHJlYWRQb29sRXhlY3V0b3IuamF2YXQACXJ1bldvcmtlcnNxAH4AEQAAAmd0AC5qYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3IkV29ya2VycQB-AEhxAH4AM3NxAH4AEQAAAuh0ABBqYXZhLmxhbmcuVGhyZWFkdAALVGhyZWFkLmphdmFxAH4AM3NyACZqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlTGlzdPwPJTG17I4QAgABTAAEbGlzdHEAfgAMeHIALGphdmEudXRpbC5Db2xsZWN0aW9ucyRVbm1vZGlmaWFibGVDb2xsZWN0aW9uGUIAgMte9x4CAAFMAAFjdAAWTGphdmEvdXRpbC9Db2xsZWN0aW9uO3hwc3IAE2phdmEudXRpbC5BcnJheUxpc3R4gdIdmcdhnQMAAUkABHNpemV4cAAAAAB3BAAAAAB4cQB-AFR4c3IAEWphdmEubGFuZy5JbnRlZ2VyEuKgpPeBhzgCAAFJAAV2YWx1ZXhyABBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAAB4cAAAEO9zcQB-AFMAAAAAdwQAAAAAeHNyAA5qYXZhLmxhbmcuTG9uZzuL5JDMjyPfAgABSgAFdmFsdWV4cQB-AFYAAAAAAAAAAXZyABdjb20uY2xvdWQuZGMuRGF0YUNlbnRlctZnO985yvPOAgAAeHAA
  179. 2015-07-10 15:56:50,968 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-108:ctx-9c560947 job-4187/job-4188) Publish async job-4188 complete on message bus
  180. 2015-07-10 15:56:50,968 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-108:ctx-9c560947 job-4187/job-4188) Wake up jobs related to job-4188
  181. 2015-07-10 15:56:50,968 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-108:ctx-9c560947 job-4187/job-4188) Update db status for job-4188
  182. 2015-07-10 15:56:50,971 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-108:ctx-9c560947 job-4187/job-4188) Wake up jobs joined with job-4188 and disjoin all subjobs created from job- 4188
  183. 2015-07-10 15:56:51,014 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-108:ctx-9c560947 job-4187/job-4188) Done executing com.cloud.vm.VmWorkStart for job-4188
  184. 2015-07-10 15:56:51,017 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-108:ctx-9c560947 job-4187/job-4188) Remove job-4188 from job monitoring
  185. 2015-07-10 15:56:51,090 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-121:ctx-bf1756c7 job-4187 ctx-17b18e90) Sync job-4190 execution on object VmWorkJobQueue.94
  186. 2015-07-10 15:56:51,931 DEBUG [c.c.a.t.Request] (AgentManager-Handler-3:null) Seq 1-1147010530095927652: Executing: { Cmd , MgmtId: 249373720971888, via: 1, Ver: v1, Flags: 100011, [{"com.cloud.agent.api.routing.DhcpEntryCommand":{"vmMac":"02:00:5a:b3:00:03","vmIpAddress":"10.1.1.178","vmName":"sam01","defaultRouter":"10.1.1.1","defaultDns":"10.1.1.1","duid":"00:03:00:01:02:00:5a:b3:00:03","isDefault":true,"executeInSequence":false,"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.name":"r-93-VM","router.ip":"169.254.0.164"},"wait":0}}] }
  187. 2015-07-10 15:56:51,931 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-36:ctx-5b88265d) Seq 1-1147010530095927652: Executing request
  188. 2015-07-10 15:56:51,932 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-36:ctx-5b88265d) Executing command in VR: /opt/cloud/bin/router_proxy.sh edithosts.sh 169.254.0.164 -m 02:00:5a:b3:00:03 -4 10.1.1.178 -h sam01 -d 10.1.1.1 -n 10.1.1.1
  189. 2015-07-10 15:56:52,291 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-36:ctx-5b88265d) Seq 1-1147010530095927652: Response Received:
  190. 2015-07-10 15:56:52,291 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-36:ctx-5b88265d) Seq 1-1147010530095927652: MgmtId 249373720971888: Resp: Routing to peer
  191. 2015-07-10 15:56:52,361 DEBUG [c.c.a.t.Request] (AgentManager-Handler-2:null) Seq 1-1147010530095927653: Executing: { Cmd , MgmtId: 249373720971888, via: 1, Ver: v1, Flags: 100011, [{"com.cloud.agent.api.routing.SavePasswordCommand":{,"vmIpAddress":"10.1.1.178","vmName":"sam01","executeInSequence":false,"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"169.254.0.164","router.name":"r-93-VM"},"wait":0}},{"com.cloud.agent.api.routing.VmDataCommand":{"vmIpAddress":"10.1.1.178","vmName":"sam01","executeInSequence":false,"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"169.254.0.164","router.name":"r-93-VM"},"wait":0}}] }
  192. 2015-07-10 15:56:52,361 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-273:ctx-8613e8af) Seq 1-1147010530095927653: Executing request
  193. 2015-07-10 15:56:52,361 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-273:ctx-8613e8af) Executing command in VR: /opt/cloud/bin/router_proxy.sh savepassword.sh 169.254.0.164 -v 10.1.1.178 -p saved_password
  194. 2015-07-10 15:56:52,644 DEBUG [c.c.a.ApiServlet] (http-6443-exec-1:ctx-a1c5415a) ===START=== 115.114.134.114 -- GET command=queryAsyncJobResult&jobId=4813e78b-7a10-466b-9e45-d6ace9da326d&response=json&sessionkey=CSZ3bxfCiBHVVMoNcoSRgDXHFM4%3D&_=1436536614562
  195. 2015-07-10 15:56:52,652 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-273:ctx-8613e8af) Executing command in VR: /opt/cloud/bin/router_proxy.sh vmdata.py 169.254.0.164 -d eyIxMC4xLjEuMTc4IjpbWyJ1c2VyZGF0YSIsInVzZXItZGF0YSIsbnVsbF0sWyJtZXRhZGF0YSIsInNlcnZpY2Utb2ZmZXJpbmciLCIxIENvcmUsIDEgR0h6IGFuZCAxIEdCIl0sWyJtZXRhZGF0YSIsImF2YWlsYWJpbGl0eS16b25lIiwiU29sbmEiXSxbIm1ldGFkYXRhIiwibG9jYWwtaXB2NCIsIjEwLjEuMS4xNzgiXSxbIm1ldGFkYXRhIiwibG9jYWwtaG9zdG5hbWUiLCJzYW0wMSJdLFsibWV0YWRhdGEiLCJwdWJsaWMtaXB2NCIsIjE4OC45NS4zNi4xMTkiXSxbIm1ldGFkYXRhIiwicHVibGljLWhvc3RuYW1lIiwiMTg4Ljk1LjM2LjExOSJdLFsibWV0YWRhdGEiLCJpbnN0YW5jZS1pZCIsIjU2YTk5NjE5LTJhZGEtNDI0Yi04ZjE1LWQ2YWE1YWVlMTkyNCJdLFsibWV0YWRhdGEiLCJ2bS1pZCIsIjU2YTk5NjE5LTJhZGEtNDI0Yi04ZjE1LWQ2YWE1YWVlMTkyNCJdLFsibWV0YWRhdGEiLCJwdWJsaWMta2V5cyIsbnVsbF0sWyJtZXRhZGF0YSIsImNsb3VkLWlkZW50aWZpZXIiLCJDbG91ZFN0YWNrLXtkMDBlMGQyOS04YmQ3LTRhMWUtOGFkZi1jNWUzMWFjNDk2MzB9Il1dfQ==
  196. 2015-07-10 15:56:52,679 DEBUG [c.c.u.AccountManagerImpl] (http-6443-exec-1:ctx-a1c5415a ctx-d10ad8ad) Access to Acct[ffc3b30d-3e77-4650-bd3a-8a9c1214f2d1-Smalution] granted to Acct[ffc3b30d-3e77-4650-bd3a-8a9c1214f2d1-Smalution] by DomainChecker
  197. 2015-07-10 15:56:52,742 DEBUG [c.c.a.ApiServlet] (http-6443-exec-1:ctx-a1c5415a ctx-d10ad8ad) ===END=== 115.114.134.114 -- GET command=queryAsyncJobResult&jobId=4813e78b-7a10-466b-9e45-d6ace9da326d&response=json&sessionkey=CSZ3bxfCiBHVVMoNcoSRgDXHFM4%3D&_=1436536614562
  198. 2015-07-10 15:56:52,902 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-273:ctx-8613e8af) Seq 1-1147010530095927653: Response Received:
  199. 2015-07-10 15:56:52,902 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-273:ctx-8613e8af) Seq 1-1147010530095927653: MgmtId 249373720971888: Resp: Routing to peer
  200. 2015-07-10 15:56:53,104 DEBUG [c.c.a.t.Request] (AgentManager-Handler-8:null) Seq 4-1439744505875007976: Executing: { Cmd , MgmtId: 249373720971888, via: 4, Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StartCommand":{"vm":{"id":94,"name":"i-22-94-VM","bootloader":"CD","type":"User","cpus":1,"minSpeed":1000,"maxSpeed":1000,"minRam":1073741824,"maxRam":1073741824,"arch":"x86_64","os":"Other CentOS (64-bit)","platformEmulator":"Other install media","bootArgs":"","enableHA":false,"limitCpuUse":false,"enableDynamicallyScaleVm":false,"vncPassword":"CsRHHR7anHg3MRYb6vscdA==","params":{"Message.ReservedCapacityFreed.Flag":"false"},"uuid":"56a99619-2ada-424b-8f15-d6aa5aee1924","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"48dad2c9-b913-442d-8d69-86e55a9dc195","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"876d490c-a1d4-3bfe-88b7-1bdb2479541b","id":1,"poolType":"NetworkFilesystem","host":"172.16.5.194","path":"/tank/primstore","port":2049,"url":"NetworkFilesystem://172.16.5.194/tank/primstore/?ROLE=Primary&STOREUUID=876d490c-a1d4-3bfe-88b7-1bdb2479541b"}},"name":"ROOT-94","size":21474836480,"path":"167964d5-398c-42c8-afeb-bc5f008ff7ff","volumeId":130,"vmName":"i-22-94-VM","accountId":22,"format":"VHD","provisioningType":"THIN","id":130,"deviceId":0,"hypervisorType":"XenServer"}},"diskSeq":0,"path":"167964d5-398c-42c8-afeb-bc5f008ff7ff","type":"ROOT","_details":{"managed":"false","storagePort":"2049","storageHost":"172.16.5.194","volumeSize":"21474836480"}},{"data":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/2/213/213-2-70f3dc19-ce4a-3f5c-9102-8eaaa9717d2d.iso","origUrl":"http://ftp.sunet.se/pub/Linux/distributions/centos/6.6/isos/x86_64/CentOS-6.6-x86_64-bin-DVD1.iso","uuid":"5c6870c5-c24f-4ba4-a846-f2c395f59f41","id":213,"format":"ISO","accountId":2,"checksum":"7b1fb1a11499b31271ded79da6af8584","hvm":true,"displayText":"CentOS 6.6 x86_64","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://192.168.48.10/tank/secstore","_role":"Image"}},"name":"213-2-70f3dc19-ce4a-3f5c-9102-8eaaa9717d2d","guestOsType":"Other CentOS (64-bit)","hypervisorType":"None"}},"diskSeq":3,"type":"ISO"}],"nics":[{"deviceId":0,"networkRateMbps":200,"defaultNic":true,"pxeDisable":false,"nicUuid":"c46c4564-9507-436e-9b60-14def086bf43","uuid":"5aa6781b-1fe4-4a82-8c0a-652cc6699515","ip":"10.1.1.178","netmask":"255.255.255.0","gateway":"10.1.1.1","mac":"02:00:5a:b3:00:03","dns1":"8.8.8.8","dns2":"8.8.4.4","broadcastType":"Vlan","type":"Guest","broadcastUri":"vlan://799","isolationUri":"vlan://799","isSecurityGroupEnabled":false,"name":"guest"}],"vcpuMaxLimit":16},"hostIp":"172.16.5.198","executeInSequence":false,"wait":0}}] }
  201. 2015-07-10 15:56:53,105 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-137:ctx-76ce2125) Seq 4-1439744505875007976: Executing request
  202. 2015-07-10 15:56:53,112 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-137:ctx-76ce2125) 1. The VM i-22-94-VM is in Starting state.
  203. 2015-07-10 15:56:53,135 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-137:ctx-76ce2125) Created VM ccee12f7-f483-caa4-f865-d3171baa9112 for i-22-94-VM
  204. 2015-07-10 15:56:53,153 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-137:ctx-76ce2125) VBD d522f5fc-873f-4e65-fc8a-f73196cc5eca created for com.cloud.agent.api.to.DiskTO@60f9c808
  205. 2015-07-10 15:56:53,184 WARN [c.c.h.x.r.CitrixResourceBase] (DirectAgent-137:ctx-76ce2125) createIsoSRbyURI failed! mountpoint: 192.168.48.10/tank/secstore/template/tmpl/2/213 due to This operation is not supported during an upgrade.
  206. This operation is not supported during an upgrade.
  207. at com.xensource.xenapi.Types.checkResponse(Types.java:706)
  208. at com.xensource.xenapi.Connection.dispatch(Connection.java:395)
  209. at com.cloud.hypervisor.xenserver.resource.XenServerConnectionPool$XenServerConnection.dispatch(XenServerConnectionPool.java:462)
  210. at com.xensource.xenapi.SR.create(SR.java:894)
  211. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.createIsoSRbyURI(CitrixResourceBase.java:5795)
  212. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.mount(CitrixResourceBase.java:1209)
  213. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.createVbd(CitrixResourceBase.java:1229)
  214. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.execute(CitrixResourceBase.java:1780)
  215. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:489)
  216. at com.cloud.hypervisor.xenserver.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:64)
  217. at com.cloud.hypervisor.xenserver.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:87)
  218. at com.cloud.hypervisor.xenserver.resource.XenServer620SP1Resource.executeRequest(XenServer620SP1Resource.java:65)
  219. at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:302)
  220. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  221. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  222. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  223. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  224. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  225. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  226. at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  227. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
  228. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
  229. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  230. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  231. at java.lang.Thread.run(Thread.java:744)
  232. 2015-07-10 15:56:53,185 WARN [c.c.h.x.r.CitrixResourceBase] (DirectAgent-137:ctx-76ce2125) Catch Exception: class com.cloud.utils.exception.CloudRuntimeException due to com.cloud.utils.exception.CloudRuntimeException: createIsoSRbyURI failed! mountpoint: 192.168.48.10/tank/secstore/template/tmpl/2/213 due to This operation is not supported during an upgrade.
  233. com.cloud.utils.exception.CloudRuntimeException: createIsoSRbyURI failed! mountpoint: 192.168.48.10/tank/secstore/template/tmpl/2/213 due to This operation is not supported during an upgrade.
  234. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.createIsoSRbyURI(CitrixResourceBase.java:5804)
  235. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.mount(CitrixResourceBase.java:1209)
  236. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.createVbd(CitrixResourceBase.java:1229)
  237. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.execute(CitrixResourceBase.java:1780)
  238. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:489)
  239. at com.cloud.hypervisor.xenserver.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:64)
  240. at com.cloud.hypervisor.xenserver.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:87)
  241. at com.cloud.hypervisor.xenserver.resource.XenServer620SP1Resource.executeRequest(XenServer620SP1Resource.java:65)
  242. at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:302)
  243. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  244. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  245. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  246. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  247. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  248. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  249. at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  250. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
  251. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
  252. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  253. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  254. at java.lang.Thread.run(Thread.java:744)
  255. Caused by: This operation is not supported during an upgrade.
  256. at com.xensource.xenapi.Types.checkResponse(Types.java:706)
  257. at com.xensource.xenapi.Connection.dispatch(Connection.java:395)
  258. at com.cloud.hypervisor.xenserver.resource.XenServerConnectionPool$XenServerConnection.dispatch(XenServerConnectionPool.java:462)
  259. at com.xensource.xenapi.SR.create(SR.java:894)
  260. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.createIsoSRbyURI(CitrixResourceBase.java:5795)
  261. ... 20 more
  262. 2015-07-10 15:56:53,186 WARN [c.c.h.x.r.CitrixResourceBase] (DirectAgent-137:ctx-76ce2125) Unable to start i-22-94-VM due to
  263. com.cloud.utils.exception.CloudRuntimeException: createIsoSRbyURI failed! mountpoint: 192.168.48.10/tank/secstore/template/tmpl/2/213 due to This operation is not supported during an upgrade.
  264. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.createIsoSRbyURI(CitrixResourceBase.java:5804)
  265. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.mount(CitrixResourceBase.java:1209)
  266. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.createVbd(CitrixResourceBase.java:1229)
  267. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.execute(CitrixResourceBase.java:1780)
  268. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:489)
  269. at com.cloud.hypervisor.xenserver.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:64)
  270. at com.cloud.hypervisor.xenserver.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:87)
  271. at com.cloud.hypervisor.xenserver.resource.XenServer620SP1Resource.executeRequest(XenServer620SP1Resource.java:65)
  272. at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:302)
  273. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  274. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  275. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  276. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  277. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  278. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  279. at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  280. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
  281. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
  282. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  283. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  284. at java.lang.Thread.run(Thread.java:744)
  285. Caused by: This operation is not supported during an upgrade.
  286. at com.xensource.xenapi.Types.checkResponse(Types.java:706)
  287. at com.xensource.xenapi.Connection.dispatch(Connection.java:395)
  288. at com.cloud.hypervisor.xenserver.resource.XenServerConnectionPool$XenServerConnection.dispatch(XenServerConnectionPool.java:462)
  289. at com.xensource.xenapi.SR.create(SR.java:894)
  290. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.createIsoSRbyURI(CitrixResourceBase.java:5795)
  291. ... 20 more
  292. 2015-07-10 15:56:53,203 WARN [c.c.h.x.r.CitrixResourceBase] (DirectAgent-137:ctx-76ce2125) Unable to clean up VBD due to
  293. You gave an invalid object reference. The object may have recently been deleted. The class parameter gives the type of reference given, and the handle parameter echoes the bad value given.
  294. at com.xensource.xenapi.Types.checkResponse(Types.java:693)
  295. at com.xensource.xenapi.Connection.dispatch(Connection.java:395)
  296. at com.cloud.hypervisor.xenserver.resource.XenServerConnectionPool$XenServerConnection.dispatch(XenServerConnectionPool.java:462)
  297. at com.xensource.xenapi.VBD.unplug(VBD.java:1109)
  298. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.handleVmStartFailure(CitrixResourceBase.java:1520)
  299. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.execute(CitrixResourceBase.java:1871)
  300. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:489)
  301. at com.cloud.hypervisor.xenserver.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:64)
  302. at com.cloud.hypervisor.xenserver.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:87)
  303. at com.cloud.hypervisor.xenserver.resource.XenServer620SP1Resource.executeRequest(XenServer620SP1Resource.java:65)
  304. at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:302)
  305. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  306. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  307. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  308. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  309. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  310. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  311. at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  312. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
  313. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
  314. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  315. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  316. at java.lang.Thread.run(Thread.java:744)
  317. 2015-07-10 15:56:53,204 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-137:ctx-76ce2125) The VM is in stopped state, detected problem during startup : i-22-94-VM
  318. 2015-07-10 15:56:53,204 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-137:ctx-76ce2125) Seq 4-1439744505875007976: Response Received:
  319. 2015-07-10 15:56:53,205 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-137:ctx-76ce2125) Seq 4-1439744505875007976: MgmtId 249373720971888: Resp: Routing to peer
  320. 2015-07-10 15:56:53,439 DEBUG [c.c.a.t.Request] (AgentManager-Handler-4:null) Seq 4-1439744505875007977: Executing: { Cmd , MgmtId: 249373720971888, via: 4, Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"checkBeforeCleanup":false,"vmName":"i-22-94-VM","wait":0}}] }
  321. 2015-07-10 15:56:53,440 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-68:ctx-ed919843) Seq 4-1439744505875007977: Executing request
  322. 2015-07-10 15:56:53,468 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-68:ctx-ed919843) Seq 4-1439744505875007977: Response Received:
  323. 2015-07-10 15:56:53,468 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-68:ctx-ed919843) Seq 4-1439744505875007977: MgmtId 249373720971888: Resp: Routing to peer
  324. 2015-07-10 15:56:54,125 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-11:null) SeqA 11-101852: Processing Seq 11-101852: { Cmd , MgmtId: -1, via: 11, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":80,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
  325. 2015-07-10 15:56:54,185 DEBUG [c.c.a.t.Request] (AgentManager-Handler-14:null) Seq 1-1147010530095927654: Executing: { Cmd , MgmtId: 249373720971888, via: 1, Ver: v1, Flags: 100011, [{"com.cloud.agent.api.routing.DhcpEntryCommand":{"vmMac":"02:00:5a:b3:00:03","vmIpAddress":"10.1.1.178","vmName":"sam01","defaultRouter":"10.1.1.1","defaultDns":"10.1.1.1","duid":"00:03:00:01:02:00:5a:b3:00:03","isDefault":true,"executeInSequence":false,"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.name":"r-93-VM","router.ip":"169.254.0.164"},"wait":0}}] }
  326. 2015-07-10 15:56:54,185 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-11:ctx-499e7b1a) Seq 1-1147010530095927654: Executing request
  327. 2015-07-10 15:56:54,185 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-11:ctx-499e7b1a) Executing command in VR: /opt/cloud/bin/router_proxy.sh edithosts.sh 169.254.0.164 -m 02:00:5a:b3:00:03 -4 10.1.1.178 -h sam01 -d 10.1.1.1 -n 10.1.1.1
  328. 2015-07-10 15:56:54,328 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-11:null) SeqA 11-101852: Sending Seq 11-101852: { Ans: , MgmtId: 59778234354585, via: 11, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
  329. 2015-07-10 15:56:54,540 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-11:ctx-499e7b1a) Seq 1-1147010530095927654: Response Received:
  330. 2015-07-10 15:56:54,540 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-11:ctx-499e7b1a) Seq 1-1147010530095927654: MgmtId 249373720971888: Resp: Routing to peer
  331. 2015-07-10 15:56:54,609 DEBUG [c.c.a.t.Request] (AgentManager-Handler-13:null) Seq 1-1147010530095927655: Executing: { Cmd , MgmtId: 249373720971888, via: 1, Ver: v1, Flags: 100011, [{"com.cloud.agent.api.routing.SavePasswordCommand":{,"vmIpAddress":"10.1.1.178","vmName":"sam01","executeInSequence":false,"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"169.254.0.164","router.name":"r-93-VM"},"wait":0}},{"com.cloud.agent.api.routing.VmDataCommand":{"vmIpAddress":"10.1.1.178","vmName":"sam01","executeInSequence":false,"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"169.254.0.164","router.name":"r-93-VM"},"wait":0}}] }
  332. 2015-07-10 15:56:54,609 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-35:ctx-f52d52c4) Seq 1-1147010530095927655: Executing request
  333. 2015-07-10 15:56:54,609 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-35:ctx-f52d52c4) Executing command in VR: /opt/cloud/bin/router_proxy.sh savepassword.sh 169.254.0.164 -v 10.1.1.178 -p saved_password
  334. 2015-07-10 15:56:54,898 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-35:ctx-f52d52c4) Executing command in VR: /opt/cloud/bin/router_proxy.sh vmdata.py 169.254.0.164 -d eyIxMC4xLjEuMTc4IjpbWyJ1c2VyZGF0YSIsInVzZXItZGF0YSIsbnVsbF0sWyJtZXRhZGF0YSIsInNlcnZpY2Utb2ZmZXJpbmciLCIxIENvcmUsIDEgR0h6IGFuZCAxIEdCIl0sWyJtZXRhZGF0YSIsImF2YWlsYWJpbGl0eS16b25lIiwiU29sbmEiXSxbIm1ldGFkYXRhIiwibG9jYWwtaXB2NCIsIjEwLjEuMS4xNzgiXSxbIm1ldGFkYXRhIiwibG9jYWwtaG9zdG5hbWUiLCJzYW0wMSJdLFsibWV0YWRhdGEiLCJwdWJsaWMtaXB2NCIsIjE4OC45NS4zNi4xMTkiXSxbIm1ldGFkYXRhIiwicHVibGljLWhvc3RuYW1lIiwiMTg4Ljk1LjM2LjExOSJdLFsibWV0YWRhdGEiLCJpbnN0YW5jZS1pZCIsIjU2YTk5NjE5LTJhZGEtNDI0Yi04ZjE1LWQ2YWE1YWVlMTkyNCJdLFsibWV0YWRhdGEiLCJ2bS1pZCIsIjU2YTk5NjE5LTJhZGEtNDI0Yi04ZjE1LWQ2YWE1YWVlMTkyNCJdLFsibWV0YWRhdGEiLCJwdWJsaWMta2V5cyIsbnVsbF0sWyJtZXRhZGF0YSIsImNsb3VkLWlkZW50aWZpZXIiLCJDbG91ZFN0YWNrLXtkMDBlMGQyOS04YmQ3LTRhMWUtOGFkZi1jNWUzMWFjNDk2MzB9Il1dfQ==
  335. 2015-07-10 15:56:55,146 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-35:ctx-f52d52c4) Seq 1-1147010530095927655: Response Received:
  336. 2015-07-10 15:56:55,146 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-35:ctx-f52d52c4) Seq 1-1147010530095927655: MgmtId 249373720971888: Resp: Routing to peer
  337. 2015-07-10 15:56:55,337 DEBUG [c.c.a.t.Request] (AgentManager-Handler-6:null) Seq 1-1147010530095927656: Executing: { Cmd , MgmtId: 249373720971888, via: 1, Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StartCommand":{"vm":{"id":94,"name":"i-22-94-VM","bootloader":"CD","type":"User","cpus":1,"minSpeed":1000,"maxSpeed":1000,"minRam":1073741824,"maxRam":1073741824,"arch":"x86_64","os":"Other CentOS (64-bit)","platformEmulator":"Other install media","bootArgs":"","enableHA":false,"limitCpuUse":false,"enableDynamicallyScaleVm":false,"vncPassword":"CsRHHR7anHg3MRYb6vscdA==","params":{"Message.ReservedCapacityFreed.Flag":"false"},"uuid":"56a99619-2ada-424b-8f15-d6aa5aee1924","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"48dad2c9-b913-442d-8d69-86e55a9dc195","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"876d490c-a1d4-3bfe-88b7-1bdb2479541b","id":1,"poolType":"NetworkFilesystem","host":"172.16.5.194","path":"/tank/primstore","port":2049,"url":"NetworkFilesystem://172.16.5.194/tank/primstore/?ROLE=Primary&STOREUUID=876d490c-a1d4-3bfe-88b7-1bdb2479541b"}},"name":"ROOT-94","size":21474836480,"path":"167964d5-398c-42c8-afeb-bc5f008ff7ff","volumeId":130,"vmName":"i-22-94-VM","accountId":22,"format":"VHD","provisioningType":"THIN","id":130,"deviceId":0,"hypervisorType":"XenServer"}},"diskSeq":0,"path":"167964d5-398c-42c8-afeb-bc5f008ff7ff","type":"ROOT","_details":{"managed":"false","storagePort":"2049","storageHost":"172.16.5.194","volumeSize":"21474836480"}},{"data":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/2/213/213-2-70f3dc19-ce4a-3f5c-9102-8eaaa9717d2d.iso","origUrl":"http://ftp.sunet.se/pub/Linux/distributions/centos/6.6/isos/x86_64/CentOS-6.6-x86_64-bin-DVD1.iso","uuid":"5c6870c5-c24f-4ba4-a846-f2c395f59f41","id":213,"format":"ISO","accountId":2,"checksum":"7b1fb1a11499b31271ded79da6af8584","hvm":true,"displayText":"CentOS 6.6 x86_64","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://192.168.48.10/tank/secstore","_role":"Image"}},"name":"213-2-70f3dc19-ce4a-3f5c-9102-8eaaa9717d2d","guestOsType":"Other CentOS (64-bit)","hypervisorType":"None"}},"diskSeq":3,"type":"ISO"}],"nics":[{"deviceId":0,"networkRateMbps":200,"defaultNic":true,"pxeDisable":false,"nicUuid":"c46c4564-9507-436e-9b60-14def086bf43","uuid":"5aa6781b-1fe4-4a82-8c0a-652cc6699515","ip":"10.1.1.178","netmask":"255.255.255.0","gateway":"10.1.1.1","mac":"02:00:5a:b3:00:03","dns1":"8.8.8.8","dns2":"8.8.4.4","broadcastType":"Vlan","type":"Guest","broadcastUri":"vlan://799","isolationUri":"vlan://799","isSecurityGroupEnabled":false,"name":"guest"}],"vcpuMaxLimit":16},"hostIp":"172.16.5.199","executeInSequence":false,"wait":0}}] }
  338. 2015-07-10 15:56:55,337 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-279:ctx-4a1765b8) Seq 1-1147010530095927656: Executing request
  339. 2015-07-10 15:56:55,344 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-279:ctx-4a1765b8) 1. The VM i-22-94-VM is in Starting state.
  340. 2015-07-10 15:56:55,368 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-279:ctx-4a1765b8) Created VM 9f92ea62-746b-66db-52f3-dad0110de4d9 for i-22-94-VM
  341. 2015-07-10 15:56:55,386 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-279:ctx-4a1765b8) VBD 8effd6c5-56a1-acca-97d2-06f4ec465225 created for com.cloud.agent.api.to.DiskTO@3dd29bf2
  342. 2015-07-10 15:56:55,394 WARN [c.c.h.x.r.CitrixResourceBase] (DirectAgent-279:ctx-4a1765b8) createIsoSRbyURI failed! mountpoint: 192.168.48.10/tank/secstore/template/tmpl/2/213 due to This operation is not supported during an upgrade.
  343. This operation is not supported during an upgrade.
  344. at com.xensource.xenapi.Types.checkResponse(Types.java:706)
  345. at com.xensource.xenapi.Connection.dispatch(Connection.java:395)
  346. at com.cloud.hypervisor.xenserver.resource.XenServerConnectionPool$XenServerConnection.dispatch(XenServerConnectionPool.java:462)
  347. at com.xensource.xenapi.SR.create(SR.java:894)
  348. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.createIsoSRbyURI(CitrixResourceBase.java:5795)
  349. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.mount(CitrixResourceBase.java:1209)
  350. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.createVbd(CitrixResourceBase.java:1229)
  351. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.execute(CitrixResourceBase.java:1780)
  352. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:489)
  353. at com.cloud.hypervisor.xenserver.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:64)
  354. at com.cloud.hypervisor.xenserver.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:87)
  355. at com.cloud.hypervisor.xenserver.resource.XenServer620SP1Resource.executeRequest(XenServer620SP1Resource.java:65)
  356. at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:302)
  357. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  358. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  359. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  360. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  361. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  362. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  363. at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  364. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
  365. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
  366. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  367. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  368. at java.lang.Thread.run(Thread.java:744)
  369. 2015-07-10 15:56:55,397 WARN [c.c.h.x.r.CitrixResourceBase] (DirectAgent-279:ctx-4a1765b8) Catch Exception: class com.cloud.utils.exception.CloudRuntimeException due to com.cloud.utils.exception.CloudRuntimeException: createIsoSRbyURI failed! mountpoint: 192.168.48.10/tank/secstore/template/tmpl/2/213 due to This operation is not supported during an upgrade.
  370. com.cloud.utils.exception.CloudRuntimeException: createIsoSRbyURI failed! mountpoint: 192.168.48.10/tank/secstore/template/tmpl/2/213 due to This operation is not supported during an upgrade.
  371. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.createIsoSRbyURI(CitrixResourceBase.java:5804)
  372. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.mount(CitrixResourceBase.java:1209)
  373. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.createVbd(CitrixResourceBase.java:1229)
  374. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.execute(CitrixResourceBase.java:1780)
  375. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:489)
  376. at com.cloud.hypervisor.xenserver.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:64)
  377. at com.cloud.hypervisor.xenserver.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:87)
  378. at com.cloud.hypervisor.xenserver.resource.XenServer620SP1Resource.executeRequest(XenServer620SP1Resource.java:65)
  379. at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:302)
  380. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  381. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  382. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  383. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  384. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  385. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  386. at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  387. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
  388. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
  389. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  390. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  391. at java.lang.Thread.run(Thread.java:744)
  392. Caused by: This operation is not supported during an upgrade.
  393. at com.xensource.xenapi.Types.checkResponse(Types.java:706)
  394. at com.xensource.xenapi.Connection.dispatch(Connection.java:395)
  395. at com.cloud.hypervisor.xenserver.resource.XenServerConnectionPool$XenServerConnection.dispatch(XenServerConnectionPool.java:462)
  396. at com.xensource.xenapi.SR.create(SR.java:894)
  397. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.createIsoSRbyURI(CitrixResourceBase.java:5795)
  398. ... 20 more
  399. 2015-07-10 15:56:55,398 WARN [c.c.h.x.r.CitrixResourceBase] (DirectAgent-279:ctx-4a1765b8) Unable to start i-22-94-VM due to
  400. com.cloud.utils.exception.CloudRuntimeException: createIsoSRbyURI failed! mountpoint: 192.168.48.10/tank/secstore/template/tmpl/2/213 due to This operation is not supported during an upgrade.
  401. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.createIsoSRbyURI(CitrixResourceBase.java:5804)
  402. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.mount(CitrixResourceBase.java:1209)
  403. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.createVbd(CitrixResourceBase.java:1229)
  404. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.execute(CitrixResourceBase.java:1780)
  405. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:489)
  406. at com.cloud.hypervisor.xenserver.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:64)
  407. at com.cloud.hypervisor.xenserver.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:87)
  408. at com.cloud.hypervisor.xenserver.resource.XenServer620SP1Resource.executeRequest(XenServer620SP1Resource.java:65)
  409. at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:302)
  410. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  411. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  412. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  413. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  414. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  415. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  416. at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  417. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
  418. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
  419. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  420. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  421. at java.lang.Thread.run(Thread.java:744)
  422. Caused by: This operation is not supported during an upgrade.
  423. at com.xensource.xenapi.Types.checkResponse(Types.java:706)
  424. at com.xensource.xenapi.Connection.dispatch(Connection.java:395)
  425. at com.cloud.hypervisor.xenserver.resource.XenServerConnectionPool$XenServerConnection.dispatch(XenServerConnectionPool.java:462)
  426. at com.xensource.xenapi.SR.create(SR.java:894)
  427. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.createIsoSRbyURI(CitrixResourceBase.java:5795)
  428. ... 20 more
  429. 2015-07-10 15:56:55,420 WARN [c.c.h.x.r.CitrixResourceBase] (DirectAgent-279:ctx-4a1765b8) Unable to clean up VBD due to
  430. You gave an invalid object reference. The object may have recently been deleted. The class parameter gives the type of reference given, and the handle parameter echoes the bad value given.
  431. at com.xensource.xenapi.Types.checkResponse(Types.java:693)
  432. at com.xensource.xenapi.Connection.dispatch(Connection.java:395)
  433. at com.cloud.hypervisor.xenserver.resource.XenServerConnectionPool$XenServerConnection.dispatch(XenServerConnectionPool.java:462)
  434. at com.xensource.xenapi.VBD.unplug(VBD.java:1109)
  435. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.handleVmStartFailure(CitrixResourceBase.java:1520)
  436. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.execute(CitrixResourceBase.java:1871)
  437. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:489)
  438. at com.cloud.hypervisor.xenserver.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:64)
  439. at com.cloud.hypervisor.xenserver.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:87)
  440. at com.cloud.hypervisor.xenserver.resource.XenServer620SP1Resource.executeRequest(XenServer620SP1Resource.java:65)
  441. at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:302)
  442. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  443. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  444. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  445. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  446. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  447. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  448. at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  449. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
  450. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
  451. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  452. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  453. at java.lang.Thread.run(Thread.java:744)
  454. 2015-07-10 15:56:55,421 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-279:ctx-4a1765b8) The VM is in stopped state, detected problem during startup : i-22-94-VM
  455. 2015-07-10 15:56:55,421 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-279:ctx-4a1765b8) Seq 1-1147010530095927656: Response Received:
  456. 2015-07-10 15:56:55,423 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-279:ctx-4a1765b8) Seq 1-1147010530095927656: MgmtId 249373720971888: Resp: Routing to peer
  457. 2015-07-10 15:56:55,531 DEBUG [c.c.a.t.Request] (AgentManager-Handler-5:null) Seq 1-1147010530095927657: Executing: { Cmd , MgmtId: 249373720971888, via: 1, Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"checkBeforeCleanup":false,"vmName":"i-22-94-VM","wait":0}}] }
  458. 2015-07-10 15:56:55,531 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-281:ctx-63c22d63) Seq 1-1147010530095927657: Executing request
  459. 2015-07-10 15:56:55,537 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-281:ctx-63c22d63) Seq 1-1147010530095927657: Response Received:
  460. 2015-07-10 15:56:55,537 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-281:ctx-63c22d63) Seq 1-1147010530095927657: MgmtId 249373720971888: Resp: Routing to peer
  461. 2015-07-10 15:56:55,644 DEBUG [c.c.a.ApiServlet] (http-6443-exec-7:ctx-7009bfe4) ===START=== 115.114.134.114 -- GET command=queryAsyncJobResult&jobId=4813e78b-7a10-466b-9e45-d6ace9da326d&response=json&sessionkey=CSZ3bxfCiBHVVMoNcoSRgDXHFM4%3D&_=1436536617562
  462. 2015-07-10 15:56:55,669 DEBUG [c.c.u.AccountManagerImpl] (http-6443-exec-7:ctx-7009bfe4 ctx-f5eba5bf) Access to Acct[ffc3b30d-3e77-4650-bd3a-8a9c1214f2d1-Smalution] granted to Acct[ffc3b30d-3e77-4650-bd3a-8a9c1214f2d1-Smalution] by DomainChecker
  463. 2015-07-10 15:56:55,729 DEBUG [c.c.a.ApiServlet] (http-6443-exec-7:ctx-7009bfe4 ctx-f5eba5bf) ===END=== 115.114.134.114 -- GET command=queryAsyncJobResult&jobId=4813e78b-7a10-466b-9e45-d6ace9da326d&response=json&sessionkey=CSZ3bxfCiBHVVMoNcoSRgDXHFM4%3D&_=1436536617562
  464. 2015-07-10 15:56:56,204 DEBUG [c.c.a.t.Request] (AgentManager-Handler-10:null) Seq 1-1147010530095927658: Executing: { Cmd , MgmtId: 249373720971888, via: 1, Ver: v1, Flags: 100011, [{"com.cloud.agent.api.routing.DhcpEntryCommand":{"vmMac":"02:00:5a:b3:00:03","vmIpAddress":"10.1.1.178","vmName":"sam01","defaultRouter":"10.1.1.1","defaultDns":"10.1.1.1","duid":"00:03:00:01:02:00:5a:b3:00:03","isDefault":true,"executeInSequence":false,"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.name":"r-93-VM","router.ip":"169.254.0.164"},"wait":0}}] }
  465. 2015-07-10 15:56:56,204 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-283:ctx-02f08a9f) Seq 1-1147010530095927658: Executing request
  466. 2015-07-10 15:56:56,205 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-283:ctx-02f08a9f) Executing command in VR: /opt/cloud/bin/router_proxy.sh edithosts.sh 169.254.0.164 -m 02:00:5a:b3:00:03 -4 10.1.1.178 -h sam01 -d 10.1.1.1 -n 10.1.1.1
  467. 2015-07-10 15:56:56,555 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-283:ctx-02f08a9f) Seq 1-1147010530095927658: Response Received:
  468. 2015-07-10 15:56:56,556 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-283:ctx-02f08a9f) Seq 1-1147010530095927658: MgmtId 249373720971888: Resp: Routing to peer
  469. 2015-07-10 15:56:56,624 DEBUG [c.c.a.t.Request] (AgentManager-Handler-9:null) Seq 1-1147010530095927659: Executing: { Cmd , MgmtId: 249373720971888, via: 1, Ver: v1, Flags: 100011, [{"com.cloud.agent.api.routing.SavePasswordCommand":{,"vmIpAddress":"10.1.1.178","vmName":"sam01","executeInSequence":false,"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"169.254.0.164","router.name":"r-93-VM"},"wait":0}},{"com.cloud.agent.api.routing.VmDataCommand":{"vmIpAddress":"10.1.1.178","vmName":"sam01","executeInSequence":false,"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"169.254.0.164","router.name":"r-93-VM"},"wait":0}}] }
  470. 2015-07-10 15:56:56,624 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-141:ctx-d58697d4) Seq 1-1147010530095927659: Executing request
  471. 2015-07-10 15:56:56,624 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-141:ctx-d58697d4) Executing command in VR: /opt/cloud/bin/router_proxy.sh savepassword.sh 169.254.0.164 -v 10.1.1.178 -p saved_password
  472. 2015-07-10 15:56:56,917 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-141:ctx-d58697d4) Executing command in VR: /opt/cloud/bin/router_proxy.sh vmdata.py 169.254.0.164 -d eyIxMC4xLjEuMTc4IjpbWyJ1c2VyZGF0YSIsInVzZXItZGF0YSIsbnVsbF0sWyJtZXRhZGF0YSIsInNlcnZpY2Utb2ZmZXJpbmciLCIxIENvcmUsIDEgR0h6IGFuZCAxIEdCIl0sWyJtZXRhZGF0YSIsImF2YWlsYWJpbGl0eS16b25lIiwiU29sbmEiXSxbIm1ldGFkYXRhIiwibG9jYWwtaXB2NCIsIjEwLjEuMS4xNzgiXSxbIm1ldGFkYXRhIiwibG9jYWwtaG9zdG5hbWUiLCJzYW0wMSJdLFsibWV0YWRhdGEiLCJwdWJsaWMtaXB2NCIsIjE4OC45NS4zNi4xMTkiXSxbIm1ldGFkYXRhIiwicHVibGljLWhvc3RuYW1lIiwiMTg4Ljk1LjM2LjExOSJdLFsibWV0YWRhdGEiLCJpbnN0YW5jZS1pZCIsIjU2YTk5NjE5LTJhZGEtNDI0Yi04ZjE1LWQ2YWE1YWVlMTkyNCJdLFsibWV0YWRhdGEiLCJ2bS1pZCIsIjU2YTk5NjE5LTJhZGEtNDI0Yi04ZjE1LWQ2YWE1YWVlMTkyNCJdLFsibWV0YWRhdGEiLCJwdWJsaWMta2V5cyIsbnVsbF0sWyJtZXRhZGF0YSIsImNsb3VkLWlkZW50aWZpZXIiLCJDbG91ZFN0YWNrLXtkMDBlMGQyOS04YmQ3LTRhMWUtOGFkZi1jNWUzMWFjNDk2MzB9Il1dfQ==
  473. 2015-07-10 15:56:57,166 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-141:ctx-d58697d4) Seq 1-1147010530095927659: Response Received:
  474. 2015-07-10 15:56:57,166 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-141:ctx-d58697d4) Seq 1-1147010530095927659: MgmtId 249373720971888: Resp: Routing to peer
  475. 2015-07-10 15:56:57,356 DEBUG [c.c.a.t.Request] (AgentManager-Handler-15:null) Seq 5-199847233464569228: Executing: { Cmd , MgmtId: 249373720971888, via: 5, Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StartCommand":{"vm":{"id":94,"name":"i-22-94-VM","bootloader":"CD","type":"User","cpus":1,"minSpeed":1000,"maxSpeed":1000,"minRam":1073741824,"maxRam":1073741824,"arch":"x86_64","os":"Other CentOS (64-bit)","platformEmulator":"Other install media","bootArgs":"","enableHA":false,"limitCpuUse":false,"enableDynamicallyScaleVm":false,"vncPassword":"CsRHHR7anHg3MRYb6vscdA==","params":{"Message.ReservedCapacityFreed.Flag":"false"},"uuid":"56a99619-2ada-424b-8f15-d6aa5aee1924","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"48dad2c9-b913-442d-8d69-86e55a9dc195","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"876d490c-a1d4-3bfe-88b7-1bdb2479541b","id":1,"poolType":"NetworkFilesystem","host":"172.16.5.194","path":"/tank/primstore","port":2049,"url":"NetworkFilesystem://172.16.5.194/tank/primstore/?ROLE=Primary&STOREUUID=876d490c-a1d4-3bfe-88b7-1bdb2479541b"}},"name":"ROOT-94","size":21474836480,"path":"167964d5-398c-42c8-afeb-bc5f008ff7ff","volumeId":130,"vmName":"i-22-94-VM","accountId":22,"format":"VHD","provisioningType":"THIN","id":130,"deviceId":0,"hypervisorType":"XenServer"}},"diskSeq":0,"path":"167964d5-398c-42c8-afeb-bc5f008ff7ff","type":"ROOT","_details":{"managed":"false","storagePort":"2049","storageHost":"172.16.5.194","volumeSize":"21474836480"}},{"data":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/2/213/213-2-70f3dc19-ce4a-3f5c-9102-8eaaa9717d2d.iso","origUrl":"http://ftp.sunet.se/pub/Linux/distributions/centos/6.6/isos/x86_64/CentOS-6.6-x86_64-bin-DVD1.iso","uuid":"5c6870c5-c24f-4ba4-a846-f2c395f59f41","id":213,"format":"ISO","accountId":2,"checksum":"7b1fb1a11499b31271ded79da6af8584","hvm":true,"displayText":"CentOS 6.6 x86_64","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://192.168.48.10/tank/secstore","_role":"Image"}},"name":"213-2-70f3dc19-ce4a-3f5c-9102-8eaaa9717d2d","guestOsType":"Other CentOS (64-bit)","hypervisorType":"None"}},"diskSeq":3,"type":"ISO"}],"nics":[{"deviceId":0,"networkRateMbps":200,"defaultNic":true,"pxeDisable":false,"nicUuid":"c46c4564-9507-436e-9b60-14def086bf43","uuid":"5aa6781b-1fe4-4a82-8c0a-652cc6699515","ip":"10.1.1.178","netmask":"255.255.255.0","gateway":"10.1.1.1","mac":"02:00:5a:b3:00:03","dns1":"8.8.8.8","dns2":"8.8.4.4","broadcastType":"Vlan","type":"Guest","broadcastUri":"vlan://799","isolationUri":"vlan://799","isSecurityGroupEnabled":false,"name":"guest"}],"vcpuMaxLimit":16},"hostIp":"172.16.5.188","executeInSequence":false,"wait":0}}] }
  476. 2015-07-10 15:56:57,356 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-280:ctx-dc0664dd) Seq 5-199847233464569228: Executing request
  477. 2015-07-10 15:56:57,363 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-280:ctx-dc0664dd) 1. The VM i-22-94-VM is in Starting state.
  478. 2015-07-10 15:56:57,386 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-280:ctx-dc0664dd) Created VM 200f7468-1c54-b9bf-11b2-5fff52967729 for i-22-94-VM
  479. 2015-07-10 15:56:57,404 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-280:ctx-dc0664dd) VBD 86ead7a7-44d6-fa57-508b-1a9128991aaf created for com.cloud.agent.api.to.DiskTO@2b7fcd79
  480. 2015-07-10 15:56:57,437 WARN [c.c.h.x.r.CitrixResourceBase] (DirectAgent-280:ctx-dc0664dd) createIsoSRbyURI failed! mountpoint: 192.168.48.10/tank/secstore/template/tmpl/2/213 due to This operation is not supported during an upgrade.
  481. This operation is not supported during an upgrade.
  482. at com.xensource.xenapi.Types.checkResponse(Types.java:706)
  483. at com.xensource.xenapi.Connection.dispatch(Connection.java:395)
  484. at com.cloud.hypervisor.xenserver.resource.XenServerConnectionPool$XenServerConnection.dispatch(XenServerConnectionPool.java:462)
  485. at com.xensource.xenapi.SR.create(SR.java:894)
  486. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.createIsoSRbyURI(CitrixResourceBase.java:5795)
  487. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.mount(CitrixResourceBase.java:1209)
  488. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.createVbd(CitrixResourceBase.java:1229)
  489. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.execute(CitrixResourceBase.java:1780)
  490. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:489)
  491. at com.cloud.hypervisor.xenserver.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:64)
  492. at com.cloud.hypervisor.xenserver.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:87)
  493. at com.cloud.hypervisor.xenserver.resource.XenServer620SP1Resource.executeRequest(XenServer620SP1Resource.java:65)
  494. at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:302)
  495. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  496. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  497. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  498. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  499. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  500. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  501. at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  502. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
  503. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
  504. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  505. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  506. at java.lang.Thread.run(Thread.java:744)
  507. 2015-07-10 15:56:57,438 WARN [c.c.h.x.r.CitrixResourceBase] (DirectAgent-280:ctx-dc0664dd) Catch Exception: class com.cloud.utils.exception.CloudRuntimeException due to com.cloud.utils.exception.CloudRuntimeException: createIsoSRbyURI failed! mountpoint: 192.168.48.10/tank/secstore/template/tmpl/2/213 due to This operation is not supported during an upgrade.
  508. com.cloud.utils.exception.CloudRuntimeException: createIsoSRbyURI failed! mountpoint: 192.168.48.10/tank/secstore/template/tmpl/2/213 due to This operation is not supported during an upgrade.
  509. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.createIsoSRbyURI(CitrixResourceBase.java:5804)
  510. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.mount(CitrixResourceBase.java:1209)
  511. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.createVbd(CitrixResourceBase.java:1229)
  512. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.execute(CitrixResourceBase.java:1780)
  513. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:489)
  514. at com.cloud.hypervisor.xenserver.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:64)
  515. at com.cloud.hypervisor.xenserver.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:87)
  516. at com.cloud.hypervisor.xenserver.resource.XenServer620SP1Resource.executeRequest(XenServer620SP1Resource.java:65)
  517. at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:302)
  518. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  519. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  520. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  521. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  522. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  523. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  524. at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  525. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
  526. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
  527. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  528. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  529. at java.lang.Thread.run(Thread.java:744)
  530. Caused by: This operation is not supported during an upgrade.
  531. at com.xensource.xenapi.Types.checkResponse(Types.java:706)
  532. at com.xensource.xenapi.Connection.dispatch(Connection.java:395)
  533. at com.cloud.hypervisor.xenserver.resource.XenServerConnectionPool$XenServerConnection.dispatch(XenServerConnectionPool.java:462)
  534. at com.xensource.xenapi.SR.create(SR.java:894)
  535. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.createIsoSRbyURI(CitrixResourceBase.java:5795)
  536. ... 20 more
  537. 2015-07-10 15:56:57,439 WARN [c.c.h.x.r.CitrixResourceBase] (DirectAgent-280:ctx-dc0664dd) Unable to start i-22-94-VM due to
  538. com.cloud.utils.exception.CloudRuntimeException: createIsoSRbyURI failed! mountpoint: 192.168.48.10/tank/secstore/template/tmpl/2/213 due to This operation is not supported during an upgrade.
  539. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.createIsoSRbyURI(CitrixResourceBase.java:5804)
  540. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.mount(CitrixResourceBase.java:1209)
  541. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.createVbd(CitrixResourceBase.java:1229)
  542. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.execute(CitrixResourceBase.java:1780)
  543. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:489)
  544. at com.cloud.hypervisor.xenserver.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:64)
  545. at com.cloud.hypervisor.xenserver.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:87)
  546. at com.cloud.hypervisor.xenserver.resource.XenServer620SP1Resource.executeRequest(XenServer620SP1Resource.java:65)
  547. at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:302)
  548. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  549. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  550. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  551. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  552. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  553. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  554. at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  555. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
  556. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
  557. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  558. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  559. at java.lang.Thread.run(Thread.java:744)
  560. Caused by: This operation is not supported during an upgrade.
  561. at com.xensource.xenapi.Types.checkResponse(Types.java:706)
  562. at com.xensource.xenapi.Connection.dispatch(Connection.java:395)
  563. at com.cloud.hypervisor.xenserver.resource.XenServerConnectionPool$XenServerConnection.dispatch(XenServerConnectionPool.java:462)
  564. at com.xensource.xenapi.SR.create(SR.java:894)
  565. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.createIsoSRbyURI(CitrixResourceBase.java:5795)
  566. ... 20 more
  567. 2015-07-10 15:56:57,456 WARN [c.c.h.x.r.CitrixResourceBase] (DirectAgent-280:ctx-dc0664dd) Unable to clean up VBD due to
  568. You gave an invalid object reference. The object may have recently been deleted. The class parameter gives the type of reference given, and the handle parameter echoes the bad value given.
  569. at com.xensource.xenapi.Types.checkResponse(Types.java:693)
  570. at com.xensource.xenapi.Connection.dispatch(Connection.java:395)
  571. at com.cloud.hypervisor.xenserver.resource.XenServerConnectionPool$XenServerConnection.dispatch(XenServerConnectionPool.java:462)
  572. at com.xensource.xenapi.VBD.unplug(VBD.java:1109)
  573. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.handleVmStartFailure(CitrixResourceBase.java:1520)
  574. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.execute(CitrixResourceBase.java:1871)
  575. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:489)
  576. at com.cloud.hypervisor.xenserver.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:64)
  577. at com.cloud.hypervisor.xenserver.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:87)
  578. at com.cloud.hypervisor.xenserver.resource.XenServer620SP1Resource.executeRequest(XenServer620SP1Resource.java:65)
  579. at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:302)
  580. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  581. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  582. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  583. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  584. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  585. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  586. at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  587. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
  588. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
  589. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  590. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  591. at java.lang.Thread.run(Thread.java:744)
  592. 2015-07-10 15:56:57,457 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-280:ctx-dc0664dd) The VM is in stopped state, detected problem during startup : i-22-94-VM
  593. 2015-07-10 15:56:57,457 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-280:ctx-dc0664dd) Seq 5-199847233464569228: Response Received:
  594. 2015-07-10 15:56:57,458 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-280:ctx-dc0664dd) Seq 5-199847233464569228: MgmtId 249373720971888: Resp: Routing to peer
  595. 2015-07-10 15:56:57,561 DEBUG [c.c.a.t.Request] (AgentManager-Handler-12:null) Seq 5-199847233464569229: Executing: { Cmd , MgmtId: 249373720971888, via: 5, Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"checkBeforeCleanup":false,"vmName":"i-22-94-VM","wait":0}}] }
  596. 2015-07-10 15:56:57,561 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-282:ctx-f73d458d) Seq 5-199847233464569229: Executing request
  597. 2015-07-10 15:56:57,567 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-282:ctx-f73d458d) Seq 5-199847233464569229: Response Received:
  598. 2015-07-10 15:56:57,567 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-282:ctx-f73d458d) Seq 5-199847233464569229: MgmtId 249373720971888: Resp: Routing to peer
  599. 2015-07-10 15:56:57,647 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-65a6cefa) Resetting hosts suitable for reconnect
  600. 2015-07-10 15:56:57,650 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-65a6cefa) Completed resetting hosts suitable for reconnect
  601. 2015-07-10 15:56:57,650 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-65a6cefa) Acquiring hosts for clusters already owned by this management server
  602. 2015-07-10 15:56:57,652 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-65a6cefa) Completed acquiring hosts for clusters already owned by this management server
  603. 2015-07-10 15:56:57,652 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-65a6cefa) Acquiring hosts for clusters not owned by any management server
  604. 2015-07-10 15:56:57,652 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-65a6cefa) Completed acquiring hosts for clusters not owned by any management server
  605. 2015-07-10 15:56:58,646 DEBUG [c.c.a.ApiServlet] (http-6443-exec-6:ctx-37c34ae9) ===START=== 115.114.134.114 -- GET command=queryAsyncJobResult&jobId=4813e78b-7a10-466b-9e45-d6ace9da326d&response=json&sessionkey=CSZ3bxfCiBHVVMoNcoSRgDXHFM4%3D&_=1436536620564
  606. 2015-07-10 15:56:58,671 DEBUG [c.c.u.AccountManagerImpl] (http-6443-exec-6:ctx-37c34ae9 ctx-3595e6b2) Access to Acct[ffc3b30d-3e77-4650-bd3a-8a9c1214f2d1-Smalution] granted to Acct[ffc3b30d-3e77-4650-bd3a-8a9c1214f2d1-Smalution] by DomainChecker
  607. 2015-07-10 15:56:58,734 DEBUG [c.c.a.ApiServlet] (http-6443-exec-6:ctx-37c34ae9 ctx-3595e6b2) ===END=== 115.114.134.114 -- GET command=queryAsyncJobResult&jobId=4813e78b-7a10-466b-9e45-d6ace9da326d&response=json&sessionkey=CSZ3bxfCiBHVVMoNcoSRgDXHFM4%3D&_=1436536620564
  608. 2015-07-10 15:56:59,204 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgentCronJob-272:ctx-418e93d9) Ping from 5(SeSolXS03)
  609. 2015-07-10 15:56:59,205 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-272:ctx-418e93d9) Process host VM state report from ping process. host: 5
  610. 2015-07-10 15:56:59,215 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-272:ctx-418e93d9) Process VM state report. host: 5, number of records in report: 3
  611. 2015-07-10 15:56:59,215 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-272:ctx-418e93d9) VM state report. host: 5, vm id: 34, power state: PowerOn
  612. 2015-07-10 15:56:59,219 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-272:ctx-418e93d9) VM power state does not change, skip DB writing. vm id: 34
  613. 2015-07-10 15:56:59,219 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-272:ctx-418e93d9) VM state report. host: 5, vm id: 32, power state: PowerOn
  614. 2015-07-10 15:56:59,223 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-272:ctx-418e93d9) VM power state does not change, skip DB writing. vm id: 32
  615. 2015-07-10 15:56:59,223 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-272:ctx-418e93d9) VM state report. host: 5, vm id: 31, power state: PowerOn
  616. 2015-07-10 15:56:59,227 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-272:ctx-418e93d9) VM power state does not change, skip DB writing. vm id: 31
  617. 2015-07-10 15:56:59,232 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-272:ctx-418e93d9) Done with process of VM state report. host: 5
  618. 2015-07-10 15:57:00,263 DEBUG [c.c.v.UserVmManagerImpl] (API-Job-Executor-121:ctx-bf1756c7 job-4187 ctx-17b18e90) Destroying vm VM[User|i-22-94-VM] as it failed to create on Host with Id:null
  619. 2015-07-10 15:57:00,319 DEBUG [c.c.c.CapacityManagerImpl] (API-Job-Executor-121:ctx-bf1756c7 job-4187 ctx-17b18e90) VM state transitted from :Stopped to Error with event: OperationFailedToErrorvm's original host id: null new host id: null host id before state transition: null
  620. 2015-07-10 15:57:00,624 DEBUG [c.c.u.AccountManagerImpl] (API-Job-Executor-121:ctx-bf1756c7 job-4187 ctx-17b18e90) Access granted to Acct[ffc3b30d-3e77-4650-bd3a-8a9c1214f2d1-Smalution] to Domain:10/NSC/Smalution/ by AffinityGroupAccessChecker
  621. 2015-07-10 15:57:00,637 WARN [o.a.c.alerts] (API-Job-Executor-121:ctx-bf1756c7 job-4187 ctx-17b18e90) alertType:: 8 // dataCenterId:: 1 // podId:: 1 // clusterId:: null // message:: Failed to deploy Vm with Id: 94, on Host with Id: null
  622. 2015-07-10 15:57:00,719 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-f1e0b8e2) Begin cleanup expired async-jobs
  623. 2015-07-10 15:57:00,730 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-f1e0b8e2) End cleanup expired async-jobs
  624. 2015-07-10 15:57:00,766 DEBUG [c.c.s.StatsCollector] (StatsCollector-2:ctx-d9c3bb79) StorageCollector is running...
  625. 2015-07-10 15:57:00,828 DEBUG [c.c.a.t.Request] (StatsCollector-2:ctx-d9c3bb79) Seq 10-3037959423638120505: Received: { Ans: , MgmtId: 59778234354585, via: 10, Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
  626. 2015-07-10 15:57:00,833 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-278:ctx-6b4afa0c) Seq 1-1244400872037817166: Executing request
  627. 2015-07-10 15:57:00,966 ERROR [c.c.a.ApiAsyncJobDispatcher] (API-Job-Executor-121:ctx-bf1756c7 job-4187) Unexpected exception while executing org.apache.cloudstack.api.command.user.vm.DeployVMCmd
  628. com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM due to insufficient capacity
  629. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:613)
  630. at org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:242)
  631. at org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:212)
  632. at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3584)
  633. at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3227)
  634. at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3215)
  635. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  636. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
  637. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  638. at java.lang.reflect.Method.invoke(Method.java:606)
  639. at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
  640. at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
  641. at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
  642. at org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:106)
  643. at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
  644. at com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:51)
  645. at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
  646. at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
  647. at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
  648. at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
  649. at com.sun.proxy.$Proxy213.startVirtualMachine(Unknown Source)
  650. at org.apache.cloudstack.api.command.user.vm.DeployVMCmd.execute(DeployVMCmd.java:450)
  651. at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:141)
  652. at com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:108)
  653. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
  654. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  655. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  656. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  657. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  658. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  659. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
  660. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  661. at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  662. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  663. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  664. at java.lang.Thread.run(Thread.java:744)
  665. Caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[User|i-22-94-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  666. ... 35 more
  667. 2015-07-10 15:57:00,968 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-121:ctx-bf1756c7 job-4187) Complete async job-4187, jobStatus: FAILED, resultCode: 530, result: org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Unable to start a VM due to insufficient capacity"}
  668. 2015-07-10 15:57:00,970 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-121:ctx-bf1756c7 job-4187) Publish async job-4187 complete on message bus
  669. 2015-07-10 15:57:00,970 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-121:ctx-bf1756c7 job-4187) Wake up jobs related to job-4187
  670. 2015-07-10 15:57:00,970 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-121:ctx-bf1756c7 job-4187) Update db status for job-4187
  671. 2015-07-10 15:57:00,972 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-121:ctx-bf1756c7 job-4187) Wake up jobs joined with job-4187 and disjoin all subjobs created from job- 4187
  672. 2015-07-10 15:57:01,019 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-121:ctx-bf1756c7 job-4187) Done executing org.apache.cloudstack.api.command.user.vm.DeployVMCmd for job-4187
  673. 2015-07-10 15:57:01,019 INFO [o.a.c.f.j.i.AsyncJobMonitor] (API-Job-Executor-121:ctx-bf1756c7 job-4187) Remove job-4187 from job monitoring
  674. 2015-07-10 15:57:01,326 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-278:ctx-6b4afa0c) Seq 1-1244400872037817166: Response Received:
  675. 2015-07-10 15:57:01,326 DEBUG [c.c.a.t.Request] (StatsCollector-2:ctx-d9c3bb79) Seq 1-1244400872037817166: Received: { Ans: , MgmtId: 59778234354585, via: 1, Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
  676. 2015-07-10 15:57:01,643 DEBUG [c.c.a.ApiServlet] (http-6443-exec-12:ctx-b062cb83) ===START=== 115.114.134.114 -- GET command=queryAsyncJobResult&jobId=4813e78b-7a10-466b-9e45-d6ace9da326d&response=json&sessionkey=CSZ3bxfCiBHVVMoNcoSRgDXHFM4%3D&_=1436536623562
  677. 2015-07-10 15:57:01,670 DEBUG [c.c.u.AccountManagerImpl] (http-6443-exec-12:ctx-b062cb83 ctx-891e7808) Access to Acct[ffc3b30d-3e77-4650-bd3a-8a9c1214f2d1-Smalution] granted to Acct[ffc3b30d-3e77-4650-bd3a-8a9c1214f2d1-Smalution] by DomainChecker
  678. 2015-07-10 15:57:01,731 DEBUG [c.c.a.ApiServlet] (http-6443-exec-12:ctx-b062cb83 ctx-891e7808) ===END=== 115.114.134.114 -- GET command=queryAsyncJobResult&jobId=4813e78b-7a10-466b-9e45-d6ace9da326d&response=json&sessionkey=CSZ3bxfCiBHVVMoNcoSRgDXHFM4%3D&_=1436536623562
  679. 2015-07-10 15:57:02,048 DEBUG [c.c.a.ApiServlet] (http-6443-exec-8:ctx-465d0998) ===START=== 115.114.134.114 -- GET command=listVirtualMachines&id=56a99619-2ada-424b-8f15-d6aa5aee1924&response=json&sessionkey=CSZ3bxfCiBHVVMoNcoSRgDXHFM4%3D&_=1436536623962
  680. 2015-07-10 15:57:02,057 DEBUG [o.a.c.a.BaseCmd] (http-6443-exec-8:ctx-465d0998 ctx-9b782d6d) Ignoring paremeter displayvm as the caller is not authorized to pass it in
  681. 2015-07-10 15:57:02,062 DEBUG [o.a.c.a.BaseCmd] (http-6443-exec-8:ctx-465d0998 ctx-9b782d6d) Ignoring paremeter displayvm as the caller is not authorized to pass it in
  682. 2015-07-10 15:57:02,102 DEBUG [c.c.a.ApiServlet] (http-6443-exec-8:ctx-465d0998 ctx-9b782d6d) ===END=== 115.114.134.114 -- GET command=listVirtualMachines&id=56a99619-2ada-424b-8f15-d6aa5aee1924&response=json&sessionkey=CSZ3bxfCiBHVVMoNcoSRgDXHFM4%3D&_=1436536623962
  683. 2015-07-10 15:57:03,207 DEBUG [c.c.s.StatsCollector] (StatsCollector-1:ctx-7d855ebd) AutoScaling Monitor is running...
Advertisement
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!