API tools faq
paste
Guest User

mgmt

a guest
Apr 17th, 2015
294
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 243.24 KB | None | 0 0
raw download clone embed print report
  1. volume
  2. 2015-04-17 16:26:13,125 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Calling StoragePoolAllocators to find suitable pools
  3. 2015-04-17 16:26:13,127 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (consoleproxy-1:ctx-6fd77ab2) LocalStoragePoolAllocator trying to find storage pool to fit the vm
  4. 2015-04-17 16:26:13,127 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-6fd77ab2) ClusterScopeStoragePoolAllocator looking for storage pool
  5. 2015-04-17 16:26:13,127 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-6fd77ab2) Looking for pools in dc: 1 pod:1 cluster:1
  6. 2015-04-17 16:26:13,130 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-6fd77ab2) Found pools matching tags: [Pool[1|PreSetup]]
  7. 2015-04-17 16:26:13,132 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-6fd77ab2) Removing pool Pool[1|PreSetup] from avoid set, must have been inserted when searching for another disk's tag
  8. 2015-04-17 16:26:13,135 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] (consoleproxy-1:ctx-6fd77ab2) Checking if storage pool is suitable, name: null ,poolId: 1
  9. 2015-04-17 16:26:13,143 DEBUG [c.c.s.StorageManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Checking pool 1 for storage, totalSize: 1649254858752, usedBytes: 25165824, usedPct: 1.5258905478710012E-5, disable threshold: 0.85
  10. 2015-04-17 16:26:13,151 DEBUG [c.c.s.StorageManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Checking pool: 1 for volume allocation [Vol[1|vm=1|ROOT]], maxSize : 1649254858752, totalAllocatedSize : 0, askingSize : 0, allocated disable threshold: 0.85
  11. 2015-04-17 16:26:13,151 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-6fd77ab2) ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
  12. 2015-04-17 16:26:13,151 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Trying to find a potenial host and associated storage pools from the suitable host/pool lists for this VM
  13. 2015-04-17 16:26:13,151 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Checking if host: 5 can access any suitable storage pool for volume: ROOT
  14. 2015-04-17 16:26:13,152 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Host: 5 can access pool: 1
  15. 2015-04-17 16:26:13,153 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Found a potential host id: 5 name: cloud-host3.cgg.gov.in and associated storage pools for this VM
  16. 2015-04-17 16:26:13,155 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Returning Deployment Destination: Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(5)-Storage(Volume(1|ROOT-->Pool(1))]
  17. 2015-04-17 16:26:13,155 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Deployment found - P0=VM[ConsoleProxy|v-1-VM], P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(5)-Storage(Volume(1|ROOT-->Pool(1))]
  18. 2015-04-17 16:26:13,177 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-6fd77ab2) VM state transitted from :Starting to Starting with event: OperationRetryvm's original host id: null new host id: 5 host id before state transition: 2
  19. 2015-04-17 16:26:13,189 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  20. 2015-04-17 16:26:13,189 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Hosts's actual total RAM: 130926604032 and RAM after applying overprovisioning: 130926600192
  21. 2015-04-17 16:26:13,189 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-6fd77ab2) release cpu from host: 2, old used: 500,reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  22. 2015-04-17 16:26:13,189 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-6fd77ab2) release mem from host: 2, old used: 1073741824,reserved: 0, total: 130926600192; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  23. 2015-04-17 16:26:13,212 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  24. 2015-04-17 16:26:13,212 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-6fd77ab2) We are allocating VM, increasing the used capacity of this host:5
  25. 2015-04-17 16:26:13,212 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Current Used CPU: 0 , Free CPU:88000 ,Requested CPU: 500
  26. 2015-04-17 16:26:13,212 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Current Used RAM: 0 , Free RAM:130926600192 ,Requested RAM: 1073741824
  27. 2015-04-17 16:26:13,212 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-6fd77ab2) CPU STATS after allocation: for host: 5, old used: 0, old reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used:500, reserved:0; requested cpu:500,alloc_from_last:false
  28. 2015-04-17 16:26:13,213 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-6fd77ab2) RAM STATS after allocation: for host: 5, old used: 0, old reserved: 0, total: 130926600192; new used: 1073741824, reserved: 0; requested mem: 1073741824,alloc_from_last:false
  29. 2015-04-17 16:26:13,220 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-6fd77ab2) VM is being created in podId: 1
  30. 2015-04-17 16:26:13,229 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-6fd77ab2) Network id=200 is already implemented
  31. 2015-04-17 16:26:13,276 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-6fd77ab2) Network id=202 is already implemented
  32. 2015-04-17 16:26:13,332 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-6fd77ab2) Network id=201 is already implemented
  33. 2015-04-17 16:26:13,380 DEBUG [c.c.n.g.PodBasedNetworkGuru] (consoleproxy-1:ctx-6fd77ab2) Allocated a nic NicProfile[3-1-9e96f6c9-9799-4d8c-811e-103e40d7ce6d-10.3.4.115-null for VM[ConsoleProxy|v-1-VM]
  34. 2015-04-17 16:26:13,394 DEBUG [o.a.c.e.o.VolumeOrchestrator] (consoleproxy-1:ctx-6fd77ab2) Checking if we need to prepare 1 volumes for VM[ConsoleProxy|v-1-VM]
  35. 2015-04-17 16:26:13,418 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (consoleproxy-1:ctx-6fd77ab2) template 1 is already in store:1, type:Image
  36. 2015-04-17 16:26:13,429 DEBUG [o.a.c.s.d.PrimaryDataStoreImpl] (consoleproxy-1:ctx-6fd77ab2) Not found (templateId:1poolId:1) in template_spool_ref, persisting it
  37. 2015-04-17 16:26:13,443 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (consoleproxy-1:ctx-6fd77ab2) template 1 is already in store:1, type:Primary
  38. 2015-04-17 16:26:13,445 DEBUG [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-6fd77ab2) Found template routing-1 in storage pool 1 with VMTemplateStoragePool id: 151
  39. 2015-04-17 16:26:13,457 DEBUG [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-6fd77ab2) Acquire lock on VMTemplateStoragePool 151 with timeout 3600 seconds
  40. 2015-04-17 16:26:13,460 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-6fd77ab2) lock is acquired for VMTemplateStoragePool 151
  41. 2015-04-17 16:26:13,473 DEBUG [o.a.c.s.m.AncientDataMotionStrategy] (consoleproxy-1:ctx-6fd77ab2) copyAsync inspecting src type TEMPLATE copyAsync inspecting dest type TEMPLATE
  42. 2015-04-17 16:26:13,494 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-6fd77ab2) Seq 2-1843462230: Sending { Cmd , MgmtId: 46618217624527, via: 2(cloud-host1.cgg.gov.in), Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/1/","origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.3.4.40/ibm/CloudSecondary","_role":"Image"}},"name":"routing-1","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"CloudStore-1","id":1,"poolType":"PreSetup","host":"localhost","path":"/CloudStore-1","port":0,"url":"PreSetup://localhost//CloudStore-1/?ROLE=Primary&STOREUUID=CloudStore-1"}},"name":"routing-1","hypervisorType":"XenServer"}},"executeInSequence":false,"options":{},"wait":10800}}] }
  43. 2015-04-17 16:26:13,495 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-6fd77ab2) Seq 2-1843462230: Executing: { Cmd , MgmtId: 46618217624527, via: 2(cloud-host1.cgg.gov.in), Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/1/","origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.3.4.40/ibm/CloudSecondary","_role":"Image"}},"name":"routing-1","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"CloudStore-1","id":1,"poolType":"PreSetup","host":"localhost","path":"/CloudStore-1","port":0,"url":"PreSetup://localhost//CloudStore-1/?ROLE=Primary&STOREUUID=CloudStore-1"}},"name":"routing-1","hypervisorType":"XenServer"}},"executeInSequence":false,"options":{},"wait":10800}}] }
  44. 2015-04-17 16:26:13,495 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-434:ctx-d12c96fb) Seq 2-1843462230: Executing request
  45. 2015-04-17 16:26:13,947 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-51:ctx-5e2eb97a) Seq 2-751304730: Executing request
  46. 2015-04-17 16:26:14,486 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-51:ctx-5e2eb97a) Seq 2-751304730: Response Received:
  47. 2015-04-17 16:26:14,487 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-51:ctx-5e2eb97a) Seq 2-751304730: MgmtId 50788518005399: Resp: Routing to peer
  48. 2015-04-17 16:26:15,029 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-254ca65b) Found 0 routers to update status.
  49. 2015-04-17 16:26:15,032 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-254ca65b) Found 0 networks to update RvR status.
  50. 2015-04-17 16:26:15,620 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-434:ctx-d12c96fb) destoryVDIbyNameLabel failed due to there are 0 VDIs with name cloud-f1833f1a-a1e2-471a-8120-f6a1f360e07c
  51. 2015-04-17 16:26:15,621 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-434:ctx-d12c96fb) can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  52. 2015-04-17 16:26:15,621 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-434:ctx-d12c96fb) Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  53. com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  54. at com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copy_vhd_from_secondarystorage(XenServerStorageProcessor.java:848)
  55. at com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copyTemplateToPrimaryStorage(XenServerStorageProcessor.java:918)
  56. at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:75)
  57. at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:50)
  58. at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:609)
  59. at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59)
  60. at com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:106)
  61. at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216)
  62. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  63. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  64. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  65. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  66. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  67. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  68. at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  69. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
  70. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
  71. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  72. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  73. at java.lang.Thread.run(Thread.java:744)
  74. 2015-04-17 16:26:15,622 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-434:ctx-d12c96fb) Seq 2-1843462230: Response Received:
  75. 2015-04-17 16:26:15,622 DEBUG [c.c.a.t.Request] (DirectAgent-434:ctx-d12c96fb) Seq 2-1843462230: Processing: { Ans: , MgmtId: 46618217624527, via: 2, Ver: v1, Flags: 10, [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31","wait":0}}] }
  76. 2015-04-17 16:26:15,622 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-6fd77ab2) Seq 2-1843462230: Received: { Ans: , MgmtId: 46618217624527, via: 2, Ver: v1, Flags: 10, { CopyCmdAnswer } }
  77. 2015-04-17 16:26:15,643 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-6fd77ab2) releasing lock for VMTemplateStoragePool 151
  78. 2015-04-17 16:26:15,644 WARN [c.c.u.d.Merovingian2] (consoleproxy-1:ctx-6fd77ab2) Was unable to find lock for the key template_spool_ref151 and thread id 2071784721
  79. 2015-04-17 16:26:15,644 DEBUG [o.a.c.e.o.VolumeOrchestrator] (consoleproxy-1:ctx-6fd77ab2) Unable to create Vol[1|vm=1|ROOT]:Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  80. 2015-04-17 16:26:15,644 INFO [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Unable to contact resource.
  81. com.cloud.exception.StorageUnavailableException: Resource [StoragePool:1] is unreachable: Unable to create Vol[1|vm=1|ROOT]:Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  82. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.recreateVolume(VolumeOrchestrator.java:1204)
  83. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.prepare(VolumeOrchestrator.java:1256)
  84. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:963)
  85. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761)
  86. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:745)
  87. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.startProxy(ConsoleProxyManagerImpl.java:555)
  88. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.allocCapacity(ConsoleProxyManagerImpl.java:941)
  89. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:1666)
  90. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:157)
  91. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:118)
  92. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:35)
  93. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:88)
  94. at com.cloud.vm.SystemVmLoadScanner$1.runInContext(SystemVmLoadScanner.java:79)
  95. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  96. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  97. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  98. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  99. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  100. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  101. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
  102. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
  103. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
  104. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  105. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  106. at java.lang.Thread.run(Thread.java:744)
  107. 2015-04-17 16:26:15,652 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Cleaning up resources for the vm VM[ConsoleProxy|v-1-VM] in Starting state
  108. 2015-04-17 16:26:15,662 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-6fd77ab2) Seq 5-1993146459: Sending { Cmd , MgmtId: 46618217624527, via: 5(cloud-host3.cgg.gov.in), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"v-1-VM","wait":0}}] }
  109. 2015-04-17 16:26:15,663 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-6fd77ab2) Seq 5-1993146459: Executing: { Cmd , MgmtId: 46618217624527, via: 5(cloud-host3.cgg.gov.in), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"v-1-VM","wait":0}}] }
  110. 2015-04-17 16:26:15,663 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-187:ctx-686aefeb) Seq 5-1993146459: Executing request
  111. 2015-04-17 16:26:15,770 INFO [c.c.h.x.r.CitrixResourceBase] (DirectAgent-187:ctx-686aefeb) VM does not exist on XenServer0083e31e-13d1-4e07-96a4-3594d789e1d8
  112. 2015-04-17 16:26:15,770 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-187:ctx-686aefeb) Seq 5-1993146459: Response Received:
  113. 2015-04-17 16:26:15,771 DEBUG [c.c.a.t.Request] (DirectAgent-187:ctx-686aefeb) Seq 5-1993146459: Processing: { Ans: , MgmtId: 46618217624527, via: 5, Ver: v1, Flags: 10, [{"com.cloud.agent.api.StopAnswer":{"result":true,"details":"VM does not exist","wait":0}}] }
  114. 2015-04-17 16:26:15,771 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-6fd77ab2) Seq 5-1993146459: Received: { Ans: , MgmtId: 46618217624527, via: 5, Ver: v1, Flags: 10, { StopAnswer } }
  115. 2015-04-17 16:26:15,794 DEBUG [c.c.n.g.ControlNetworkGuru] (consoleproxy-1:ctx-6fd77ab2) Released nic: NicProfile[2-1-null-null-null
  116. 2015-04-17 16:26:15,814 DEBUG [c.c.d.d.DataCenterIpAddressDaoImpl] (consoleproxy-1:ctx-6fd77ab2) Releasing ip address for reservationId=9e96f6c9-9799-4d8c-811e-103e40d7ce6d, instance=3
  117. 2015-04-17 16:26:15,815 DEBUG [c.c.n.g.PodBasedNetworkGuru] (consoleproxy-1:ctx-6fd77ab2) Released nic: NicProfile[3-1-null-null-null
  118. 2015-04-17 16:26:15,824 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Successfully released network resources for the vm VM[ConsoleProxy|v-1-VM]
  119. 2015-04-17 16:26:15,824 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Successfully cleanued up resources for the vm VM[ConsoleProxy|v-1-VM] in Starting state
  120. 2015-04-17 16:26:15,831 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Deploy avoids pods: null, clusters: null, hosts: [1, 2, 3, 5]
  121. 2015-04-17 16:26:15,834 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-6fd77ab2) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@4f7533d2
  122. 2015-04-17 16:26:15,834 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Trying to allocate a host and storage pools from dc:1, pod:1,cluster:null, requested cpu: 500, requested ram: 1073741824
  123. 2015-04-17 16:26:15,834 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Is ROOT volume READY (pool already allocated)?: No
  124. 2015-04-17 16:26:15,834 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-6fd77ab2) Searching resources only under specified Pod: 1
  125. 2015-04-17 16:26:15,834 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-6fd77ab2) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Pod: 1
  126. 2015-04-17 16:26:15,852 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Checking resources in Cluster: 1 under Pod: 1
  127. 2015-04-17 16:26:15,852 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-6fd77ab2 FirstFitRoutingAllocator) Looking for hosts in dc: 1 pod:1 cluster:1
  128. 2015-04-17 16:26:15,860 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-6fd77ab2 FirstFitRoutingAllocator) FirstFitAllocator has 5 hosts to check for allocation: [Host[-2-Routing], Host[-1-Routing], Host[-3-Routing], Host[-5-Routing], Host[-4-Routing]]
  129. 2015-04-17 16:26:15,874 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-6fd77ab2 FirstFitRoutingAllocator) Found 5 hosts for allocation after prioritization: [Host[-2-Routing], Host[-1-Routing], Host[-3-Routing], Host[-5-Routing], Host[-4-Routing]]
  130. 2015-04-17 16:26:15,874 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-6fd77ab2 FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=1024
  131. 2015-04-17 16:26:15,874 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-6fd77ab2 FirstFitRoutingAllocator) Host name: cloud-host1.cgg.gov.in, hostId: 2 is in avoid set, skipping this and trying other available hosts
  132. 2015-04-17 16:26:15,874 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-6fd77ab2 FirstFitRoutingAllocator) Host name: cloud-host2.cgg.gov.in, hostId: 1 is in avoid set, skipping this and trying other available hosts
  133. 2015-04-17 16:26:15,874 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-6fd77ab2 FirstFitRoutingAllocator) Host name: cloud-host9.cgg.gov.in, hostId: 3 is in avoid set, skipping this and trying other available hosts
  134. 2015-04-17 16:26:15,874 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-6fd77ab2 FirstFitRoutingAllocator) Host name: cloud-host3.cgg.gov.in, hostId: 5 is in avoid set, skipping this and trying other available hosts
  135. 2015-04-17 16:26:15,888 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-6fd77ab2 FirstFitRoutingAllocator) Host: 4 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  136. 2015-04-17 16:26:15,888 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-6fd77ab2 FirstFitRoutingAllocator) Checking if host: 4 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  137. 2015-04-17 16:26:15,894 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-6fd77ab2 FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  138. 2015-04-17 16:26:15,894 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-6fd77ab2 FirstFitRoutingAllocator) Free CPU: 87500 , Requested CPU: 500
  139. 2015-04-17 16:26:15,894 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-6fd77ab2 FirstFitRoutingAllocator) Free RAM: 130389729280 , Requested RAM: 1073741824
  140. 2015-04-17 16:26:15,894 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-6fd77ab2 FirstFitRoutingAllocator) Host has enough CPU and RAM available
  141. 2015-04-17 16:26:15,894 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-6fd77ab2 FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 4, used: 500, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  142. 2015-04-17 16:26:15,894 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-6fd77ab2 FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 4, used: 536870912, reserved: 0, total: 130926600192; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  143. 2015-04-17 16:26:15,894 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-6fd77ab2 FirstFitRoutingAllocator) Found a suitable host, adding to list: 4
  144. 2015-04-17 16:26:15,894 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-6fd77ab2 FirstFitRoutingAllocator) Host Allocator returning 1 suitable hosts
  145. 2015-04-17 16:26:15,897 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Checking suitable pools for volume (Id, Type): (1,ROOT)
  146. 2015-04-17 16:26:15,897 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-6fd77ab2) We need to allocate new storagepool for this volume
  147. 2015-04-17 16:26:15,897 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Calling StoragePoolAllocators to find suitable pools
  148. 2015-04-17 16:26:15,899 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (consoleproxy-1:ctx-6fd77ab2) LocalStoragePoolAllocator trying to find storage pool to fit the vm
  149. 2015-04-17 16:26:15,899 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-6fd77ab2) ClusterScopeStoragePoolAllocator looking for storage pool
  150. 2015-04-17 16:26:15,899 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-6fd77ab2) Looking for pools in dc: 1 pod:1 cluster:1
  151. 2015-04-17 16:26:15,902 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-6fd77ab2) Found pools matching tags: [Pool[1|PreSetup]]
  152. 2015-04-17 16:26:15,905 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-6fd77ab2) Removing pool Pool[1|PreSetup] from avoid set, must have been inserted when searching for another disk's tag
  153. 2015-04-17 16:26:15,908 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] (consoleproxy-1:ctx-6fd77ab2) Checking if storage pool is suitable, name: null ,poolId: 1
  154. 2015-04-17 16:26:15,916 DEBUG [c.c.s.StorageManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Checking pool 1 for storage, totalSize: 1649254858752, usedBytes: 25165824, usedPct: 1.5258905478710012E-5, disable threshold: 0.85
  155. 2015-04-17 16:26:15,925 DEBUG [c.c.s.StorageManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Checking pool: 1 for volume allocation [Vol[1|vm=1|ROOT]], maxSize : 1649254858752, totalAllocatedSize : 0, askingSize : 0, allocated disable threshold: 0.85
  156. 2015-04-17 16:26:15,925 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-6fd77ab2) ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
  157. 2015-04-17 16:26:15,925 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Trying to find a potenial host and associated storage pools from the suitable host/pool lists for this VM
  158. 2015-04-17 16:26:15,925 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Checking if host: 4 can access any suitable storage pool for volume: ROOT
  159. 2015-04-17 16:26:15,926 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Host: 4 can access pool: 1
  160. 2015-04-17 16:26:15,927 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Found a potential host id: 4 name: cloud-host10.cgg.gov.in and associated storage pools for this VM
  161. 2015-04-17 16:26:15,929 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Returning Deployment Destination: Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(4)-Storage(Volume(1|ROOT-->Pool(1))]
  162. 2015-04-17 16:26:15,929 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Deployment found - P0=VM[ConsoleProxy|v-1-VM], P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(4)-Storage(Volume(1|ROOT-->Pool(1))]
  163. 2015-04-17 16:26:15,954 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-6fd77ab2) VM state transitted from :Starting to Starting with event: OperationRetryvm's original host id: null new host id: 4 host id before state transition: 5
  164. 2015-04-17 16:26:15,967 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  165. 2015-04-17 16:26:15,967 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Hosts's actual total RAM: 130926604032 and RAM after applying overprovisioning: 130926600192
  166. 2015-04-17 16:26:15,967 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-6fd77ab2) release cpu from host: 5, old used: 500,reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  167. 2015-04-17 16:26:15,967 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-6fd77ab2) release mem from host: 5, old used: 1073741824,reserved: 0, total: 130926600192; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  168. 2015-04-17 16:26:15,990 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  169. 2015-04-17 16:26:15,990 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-6fd77ab2) We are allocating VM, increasing the used capacity of this host:4
  170. 2015-04-17 16:26:15,990 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Current Used CPU: 500 , Free CPU:87500 ,Requested CPU: 500
  171. 2015-04-17 16:26:15,990 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Current Used RAM: 536870912 , Free RAM:130389729280 ,Requested RAM: 1073741824
  172. 2015-04-17 16:26:15,991 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-6fd77ab2) CPU STATS after allocation: for host: 4, old used: 500, old reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used:1000, reserved:0; requested cpu:500,alloc_from_last:false
  173. 2015-04-17 16:26:15,991 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-6fd77ab2) RAM STATS after allocation: for host: 4, old used: 536870912, old reserved: 0, total: 130926600192; new used: 1610612736, reserved: 0; requested mem: 1073741824,alloc_from_last:false
  174. 2015-04-17 16:26:15,999 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-6fd77ab2) VM is being created in podId: 1
  175. 2015-04-17 16:26:16,015 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-6fd77ab2) Network id=200 is already implemented
  176. 2015-04-17 16:26:16,060 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-6fd77ab2) Network id=202 is already implemented
  177. 2015-04-17 16:26:16,117 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-6fd77ab2) Network id=201 is already implemented
  178. 2015-04-17 16:26:16,165 DEBUG [c.c.n.g.PodBasedNetworkGuru] (consoleproxy-1:ctx-6fd77ab2) Allocated a nic NicProfile[3-1-9e96f6c9-9799-4d8c-811e-103e40d7ce6d-10.3.4.115-null for VM[ConsoleProxy|v-1-VM]
  179. 2015-04-17 16:26:16,179 DEBUG [o.a.c.e.o.VolumeOrchestrator] (consoleproxy-1:ctx-6fd77ab2) Checking if we need to prepare 1 volumes for VM[ConsoleProxy|v-1-VM]
  180. 2015-04-17 16:26:16,205 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (consoleproxy-1:ctx-6fd77ab2) template 1 is already in store:1, type:Image
  181. 2015-04-17 16:26:16,215 DEBUG [o.a.c.s.d.PrimaryDataStoreImpl] (consoleproxy-1:ctx-6fd77ab2) Not found (templateId:1poolId:1) in template_spool_ref, persisting it
  182. 2015-04-17 16:26:16,227 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (consoleproxy-1:ctx-6fd77ab2) template 1 is already in store:1, type:Primary
  183. 2015-04-17 16:26:16,230 DEBUG [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-6fd77ab2) Found template routing-1 in storage pool 1 with VMTemplateStoragePool id: 152
  184. 2015-04-17 16:26:16,242 DEBUG [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-6fd77ab2) Acquire lock on VMTemplateStoragePool 152 with timeout 3600 seconds
  185. 2015-04-17 16:26:16,246 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-6fd77ab2) lock is acquired for VMTemplateStoragePool 152
  186. 2015-04-17 16:26:16,261 DEBUG [o.a.c.s.m.AncientDataMotionStrategy] (consoleproxy-1:ctx-6fd77ab2) copyAsync inspecting src type TEMPLATE copyAsync inspecting dest type TEMPLATE
  187. 2015-04-17 16:26:16,283 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-6fd77ab2) Seq 3-1753874532: Sending { Cmd , MgmtId: 46618217624527, via: 3(cloud-host9.cgg.gov.in), Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/1/","origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.3.4.40/ibm/CloudSecondary","_role":"Image"}},"name":"routing-1","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"CloudStore-1","id":1,"poolType":"PreSetup","host":"localhost","path":"/CloudStore-1","port":0,"url":"PreSetup://localhost//CloudStore-1/?ROLE=Primary&STOREUUID=CloudStore-1"}},"name":"routing-1","hypervisorType":"XenServer"}},"executeInSequence":false,"options":{},"wait":10800}}] }
  188. 2015-04-17 16:26:16,285 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-6fd77ab2) Seq 3-1753874532: Executing: { Cmd , MgmtId: 46618217624527, via: 3(cloud-host9.cgg.gov.in), Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/1/","origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.3.4.40/ibm/CloudSecondary","_role":"Image"}},"name":"routing-1","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"CloudStore-1","id":1,"poolType":"PreSetup","host":"localhost","path":"/CloudStore-1","port":0,"url":"PreSetup://localhost//CloudStore-1/?ROLE=Primary&STOREUUID=CloudStore-1"}},"name":"routing-1","hypervisorType":"XenServer"}},"executeInSequence":false,"options":{},"wait":10800}}] }
  189. 2015-04-17 16:26:16,285 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-299:ctx-8a3a375d) Seq 3-1753874532: Executing request
  190. 2015-04-17 16:26:16,819 DEBUG [c.c.a.t.Request] (AgentManager-Handler-1:null) Seq 4-551616534: Executing: { Cmd , MgmtId: 50788518005399, via: 4, Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"s-32-VM","wait":0}}] }
  191. 2015-04-17 16:26:16,819 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-453:ctx-a2ce69b7) Seq 4-551616534: Executing request
  192. 2015-04-17 16:26:16,932 INFO [c.c.h.x.r.CitrixResourceBase] (DirectAgent-453:ctx-a2ce69b7) VM does not exist on XenServer34da61e1-04e7-40e2-b8f4-40c0157dca28
  193. 2015-04-17 16:26:16,937 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-453:ctx-a2ce69b7) Seq 4-551616534: Response Received:
  194. 2015-04-17 16:26:16,937 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-453:ctx-a2ce69b7) Seq 4-551616534: MgmtId 50788518005399: Resp: Routing to peer
  195. 2015-04-17 16:26:18,451 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-299:ctx-8a3a375d) destoryVDIbyNameLabel failed due to there are 0 VDIs with name cloud-27cde6dd-435b-4317-8e2c-3afcf84bf7e4
  196. 2015-04-17 16:26:18,456 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-299:ctx-8a3a375d) can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  197. 2015-04-17 16:26:18,456 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-299:ctx-8a3a375d) Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  198. com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  199. at com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copy_vhd_from_secondarystorage(XenServerStorageProcessor.java:848)
  200. at com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copyTemplateToPrimaryStorage(XenServerStorageProcessor.java:918)
  201. at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:75)
  202. at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:50)
  203. at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:609)
  204. at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59)
  205. at com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:106)
  206. at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216)
  207. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  208. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  209. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  210. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  211. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  212. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  213. at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  214. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
  215. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
  216. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  217. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  218. at java.lang.Thread.run(Thread.java:744)
  219. 2015-04-17 16:26:18,457 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-299:ctx-8a3a375d) Seq 3-1753874532: Response Received:
  220. 2015-04-17 16:26:18,458 DEBUG [c.c.a.t.Request] (DirectAgent-299:ctx-8a3a375d) Seq 3-1753874532: Processing: { Ans: , MgmtId: 46618217624527, via: 3, Ver: v1, Flags: 10, [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31","wait":0}}] }
  221. 2015-04-17 16:26:18,458 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-6fd77ab2) Seq 3-1753874532: Received: { Ans: , MgmtId: 46618217624527, via: 3, Ver: v1, Flags: 10, { CopyCmdAnswer } }
  222. 2015-04-17 16:26:18,479 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-6fd77ab2) releasing lock for VMTemplateStoragePool 152
  223. 2015-04-17 16:26:18,480 WARN [c.c.u.d.Merovingian2] (consoleproxy-1:ctx-6fd77ab2) Was unable to find lock for the key template_spool_ref152 and thread id 2071784721
  224. 2015-04-17 16:26:18,480 DEBUG [o.a.c.e.o.VolumeOrchestrator] (consoleproxy-1:ctx-6fd77ab2) Unable to create Vol[1|vm=1|ROOT]:Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  225. 2015-04-17 16:26:18,480 INFO [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Unable to contact resource.
  226. com.cloud.exception.StorageUnavailableException: Resource [StoragePool:1] is unreachable: Unable to create Vol[1|vm=1|ROOT]:Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  227. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.recreateVolume(VolumeOrchestrator.java:1204)
  228. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.prepare(VolumeOrchestrator.java:1256)
  229. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:963)
  230. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761)
  231. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:745)
  232. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.startProxy(ConsoleProxyManagerImpl.java:555)
  233. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.allocCapacity(ConsoleProxyManagerImpl.java:941)
  234. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:1666)
  235. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:157)
  236. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:118)
  237. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:35)
  238. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:88)
  239. at com.cloud.vm.SystemVmLoadScanner$1.runInContext(SystemVmLoadScanner.java:79)
  240. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  241. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  242. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  243. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  244. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  245. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  246. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
  247. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
  248. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
  249. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  250. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  251. at java.lang.Thread.run(Thread.java:744)
  252. 2015-04-17 16:26:18,488 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Cleaning up resources for the vm VM[ConsoleProxy|v-1-VM] in Starting state
  253. 2015-04-17 16:26:18,494 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-6fd77ab2) Seq 4-283115608: Sending { Cmd , MgmtId: 46618217624527, via: 4(cloud-host10.cgg.gov.in), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"v-1-VM","wait":0}}] }
  254. 2015-04-17 16:26:18,494 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-6fd77ab2) Seq 4-283115608: Executing: { Cmd , MgmtId: 46618217624527, via: 4(cloud-host10.cgg.gov.in), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"v-1-VM","wait":0}}] }
  255. 2015-04-17 16:26:18,495 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-463:ctx-f08b72c6) Seq 4-283115608: Executing request
  256. 2015-04-17 16:26:18,601 INFO [c.c.h.x.r.CitrixResourceBase] (DirectAgent-463:ctx-f08b72c6) VM does not exist on XenServer34da61e1-04e7-40e2-b8f4-40c0157dca28
  257. 2015-04-17 16:26:18,601 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-463:ctx-f08b72c6) Seq 4-283115608: Response Received:
  258. 2015-04-17 16:26:18,601 DEBUG [c.c.a.t.Request] (DirectAgent-463:ctx-f08b72c6) Seq 4-283115608: Processing: { Ans: , MgmtId: 46618217624527, via: 4, Ver: v1, Flags: 10, [{"com.cloud.agent.api.StopAnswer":{"result":true,"details":"VM does not exist","wait":0}}] }
  259. 2015-04-17 16:26:18,601 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-6fd77ab2) Seq 4-283115608: Received: { Ans: , MgmtId: 46618217624527, via: 4, Ver: v1, Flags: 10, { StopAnswer } }
  260. 2015-04-17 16:26:18,625 DEBUG [c.c.n.g.ControlNetworkGuru] (consoleproxy-1:ctx-6fd77ab2) Released nic: NicProfile[2-1-null-null-null
  261. 2015-04-17 16:26:18,646 DEBUG [c.c.d.d.DataCenterIpAddressDaoImpl] (consoleproxy-1:ctx-6fd77ab2) Releasing ip address for reservationId=9e96f6c9-9799-4d8c-811e-103e40d7ce6d, instance=3
  262. 2015-04-17 16:26:18,647 DEBUG [c.c.n.g.PodBasedNetworkGuru] (consoleproxy-1:ctx-6fd77ab2) Released nic: NicProfile[3-1-null-null-null
  263. 2015-04-17 16:26:18,655 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Successfully released network resources for the vm VM[ConsoleProxy|v-1-VM]
  264. 2015-04-17 16:26:18,655 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Successfully cleanued up resources for the vm VM[ConsoleProxy|v-1-VM] in Starting state
  265. 2015-04-17 16:26:18,664 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Deploy avoids pods: null, clusters: null, hosts: [1, 2, 3, 4, 5]
  266. 2015-04-17 16:26:18,666 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-6fd77ab2) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@4f7533d2
  267. 2015-04-17 16:26:18,666 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Trying to allocate a host and storage pools from dc:1, pod:1,cluster:null, requested cpu: 500, requested ram: 1073741824
  268. 2015-04-17 16:26:18,666 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Is ROOT volume READY (pool already allocated)?: No
  269. 2015-04-17 16:26:18,666 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-6fd77ab2) Searching resources only under specified Pod: 1
  270. 2015-04-17 16:26:18,666 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-6fd77ab2) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Pod: 1
  271. 2015-04-17 16:26:18,685 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Checking resources in Cluster: 1 under Pod: 1
  272. 2015-04-17 16:26:18,685 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-6fd77ab2 FirstFitRoutingAllocator) Looking for hosts in dc: 1 pod:1 cluster:1
  273. 2015-04-17 16:26:18,692 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-6fd77ab2 FirstFitRoutingAllocator) FirstFitAllocator has 5 hosts to check for allocation: [Host[-2-Routing], Host[-1-Routing], Host[-5-Routing], Host[-4-Routing], Host[-3-Routing]]
  274. 2015-04-17 16:26:18,706 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-6fd77ab2 FirstFitRoutingAllocator) Found 5 hosts for allocation after prioritization: [Host[-2-Routing], Host[-1-Routing], Host[-5-Routing], Host[-4-Routing], Host[-3-Routing]]
  275. 2015-04-17 16:26:18,707 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-6fd77ab2 FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=1024
  276. 2015-04-17 16:26:18,707 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-6fd77ab2 FirstFitRoutingAllocator) Host name: cloud-host1.cgg.gov.in, hostId: 2 is in avoid set, skipping this and trying other available hosts
  277. 2015-04-17 16:26:18,707 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-6fd77ab2 FirstFitRoutingAllocator) Host name: cloud-host2.cgg.gov.in, hostId: 1 is in avoid set, skipping this and trying other available hosts
  278. 2015-04-17 16:26:18,707 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-6fd77ab2 FirstFitRoutingAllocator) Host name: cloud-host3.cgg.gov.in, hostId: 5 is in avoid set, skipping this and trying other available hosts
  279. 2015-04-17 16:26:18,707 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-6fd77ab2 FirstFitRoutingAllocator) Host name: cloud-host10.cgg.gov.in, hostId: 4 is in avoid set, skipping this and trying other available hosts
  280. 2015-04-17 16:26:18,707 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-6fd77ab2 FirstFitRoutingAllocator) Host name: cloud-host9.cgg.gov.in, hostId: 3 is in avoid set, skipping this and trying other available hosts
  281. 2015-04-17 16:26:18,707 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-6fd77ab2 FirstFitRoutingAllocator) Host Allocator returning 0 suitable hosts
  282. 2015-04-17 16:26:18,707 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-6fd77ab2) No suitable hosts found
  283. 2015-04-17 16:26:18,707 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-6fd77ab2) No suitable hosts found under this Cluster: 1
  284. 2015-04-17 16:26:18,710 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Could not find suitable Deployment Destination for this VM under any clusters, returning.
  285. 2015-04-17 16:26:18,711 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-6fd77ab2) Searching resources only under specified Pod: 1
  286. 2015-04-17 16:26:18,711 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-6fd77ab2) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Pod: 1
  287. 2015-04-17 16:26:18,719 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-6fd77ab2) Removing from the clusterId list these clusters from avoid set: [1]
  288. 2015-04-17 16:26:18,719 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-6fd77ab2) No clusters found after removing disabled clusters and clusters in avoid list, returning.
  289. 2015-04-17 16:26:18,741 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-6fd77ab2) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: 4
  290. 2015-04-17 16:26:18,755 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  291. 2015-04-17 16:26:18,755 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Hosts's actual total RAM: 130926604032 and RAM after applying overprovisioning: 130926600192
  292. 2015-04-17 16:26:18,755 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-6fd77ab2) release cpu from host: 4, old used: 500,reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  293. 2015-04-17 16:26:18,755 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-6fd77ab2) release mem from host: 4, old used: 1073741824,reserved: 0, total: 130926600192; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  294. 2015-04-17 16:26:18,764 WARN [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-6fd77ab2) Exception while trying to start console proxy
  295. com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-1-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  296. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:922)
  297. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761)
  298. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:745)
  299. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.startProxy(ConsoleProxyManagerImpl.java:555)
  300. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.allocCapacity(ConsoleProxyManagerImpl.java:941)
  301. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:1666)
  302. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:157)
  303. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:118)
  304. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:35)
  305. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:88)
  306. at com.cloud.vm.SystemVmLoadScanner$1.runInContext(SystemVmLoadScanner.java:79)
  307. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  308. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  309. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  310. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  311. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  312. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  313. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
  314. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
  315. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
  316. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  317. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  318. at java.lang.Thread.run(Thread.java:744)
  319. 2015-04-17 16:26:20,295 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-e6a5c971) Resetting hosts suitable for reconnect
  320. 2015-04-17 16:26:20,298 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-e6a5c971) Completed resetting hosts suitable for reconnect
  321. 2015-04-17 16:26:20,298 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-e6a5c971) Acquiring hosts for clusters already owned by this management server
  322. 2015-04-17 16:26:20,301 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-e6a5c971) Completed acquiring hosts for clusters already owned by this management server
  323. 2015-04-17 16:26:20,301 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-e6a5c971) Acquiring hosts for clusters not owned by any management server
  324. 2015-04-17 16:26:20,302 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-e6a5c971) Completed acquiring hosts for clusters not owned by any management server
  325. 2015-04-17 16:26:21,873 DEBUG [c.c.s.StatsCollector] (StatsCollector-1:ctx-fe2354bc) HostStatsCollector is running...
  326. 2015-04-17 16:26:21,892 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-464:ctx-816f2084) Seq 1-439550049: Executing request
  327. 2015-04-17 16:26:22,210 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-464:ctx-816f2084) Seq 1-439550049: Response Received:
  328. 2015-04-17 16:26:22,210 DEBUG [c.c.a.t.Request] (StatsCollector-1:ctx-fe2354bc) Seq 1-439550049: Received: { Ans: , MgmtId: 46618217624527, via: 1, Ver: v1, Flags: 10, { GetHostStatsAnswer } }
  329. 2015-04-17 16:26:22,226 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-465:ctx-b7769a17) Seq 2-1843462231: Executing request
  330. 2015-04-17 16:26:22,409 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-465:ctx-b7769a17) Seq 2-1843462231: Response Received:
  331. 2015-04-17 16:26:22,410 DEBUG [c.c.a.t.Request] (StatsCollector-1:ctx-fe2354bc) Seq 2-1843462231: Received: { Ans: , MgmtId: 46618217624527, via: 2, Ver: v1, Flags: 10, { GetHostStatsAnswer } }
  332. 2015-04-17 16:26:22,425 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-466:ctx-166afe3f) Seq 3-1753874533: Executing request
  333. 2015-04-17 16:26:22,725 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-466:ctx-166afe3f) Seq 3-1753874533: Response Received:
  334. 2015-04-17 16:26:22,725 DEBUG [c.c.a.t.Request] (StatsCollector-1:ctx-fe2354bc) Seq 3-1753874533: Received: { Ans: , MgmtId: 46618217624527, via: 3, Ver: v1, Flags: 10, { GetHostStatsAnswer } }
  335. 2015-04-17 16:26:22,740 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-467:ctx-b399f89a) Seq 4-283115609: Executing request
  336. 2015-04-17 16:26:22,873 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-104:ctx-014be2df) Ping from 2(cloud-host1.cgg.gov.in)
  337. 2015-04-17 16:26:23,124 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-467:ctx-b399f89a) Seq 4-283115609: Response Received:
  338. 2015-04-17 16:26:23,124 DEBUG [c.c.a.t.Request] (StatsCollector-1:ctx-fe2354bc) Seq 4-283115609: Received: { Ans: , MgmtId: 46618217624527, via: 4, Ver: v1, Flags: 10, { GetHostStatsAnswer } }
  339. 2015-04-17 16:26:23,133 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-468:ctx-91988f81) Seq 5-1993146460: Executing request
  340. 2015-04-17 16:26:23,137 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-305:ctx-8698e96f) Ping from 3(cloud-host9.cgg.gov.in)
  341. 2015-04-17 16:26:23,470 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-196:ctx-3ee71d8e) Ping from 4(cloud-host10.cgg.gov.in)
  342. 2015-04-17 16:26:23,539 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-468:ctx-91988f81) Seq 5-1993146460: Response Received:
  343. 2015-04-17 16:26:23,540 DEBUG [c.c.a.t.Request] (StatsCollector-1:ctx-fe2354bc) Seq 5-1993146460: Received: { Ans: , MgmtId: 46618217624527, via: 5, Ver: v1, Flags: 10, { GetHostStatsAnswer } }
  344. 2015-04-17 16:26:24,073 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-469:ctx-fce91f84) Seq 2-1843462149: Executing request
  345. 2015-04-17 16:26:24,271 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-469:ctx-fce91f84) Seq 2-1843462149: Response Received:
  346. 2015-04-17 16:26:24,272 DEBUG [c.c.a.t.Request] (DirectAgent-469:ctx-fce91f84) Seq 2-1843462149: Processing: { Ans: , MgmtId: 46618217624527, via: 2, Ver: v1, Flags: 10, [{"com.cloud.agent.api.ClusterSyncAnswer":{"_clusterId":1,"_newStates":{},"_isExecuted":false,"result":true,"wait":0}}] }
  347. 2015-04-17 16:26:24,587 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-307:ctx-595098ae) Ping from 5(cloud-host3.cgg.gov.in)
  348. 2015-04-17 16:26:24,695 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-470:ctx-41f7f736) Seq 3-1753874437: Executing request
  349. 2015-04-17 16:26:24,813 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-470:ctx-41f7f736) Seq 3-1753874437: Response Received:
  350. 2015-04-17 16:26:24,813 DEBUG [c.c.a.t.Request] (DirectAgent-470:ctx-41f7f736) Seq 3-1753874437: Processing: { Ans: , MgmtId: 46618217624527, via: 3, Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}}] }
  351. 2015-04-17 16:26:25,119 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-13:ctx-996ab745) Seq 4-283115525: Executing request
  352. 2015-04-17 16:26:25,232 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-13:ctx-996ab745) Seq 4-283115525: Response Received:
  353. 2015-04-17 16:26:25,232 DEBUG [c.c.a.t.Request] (DirectAgent-13:ctx-996ab745) Seq 4-283115525: Processing: { Ans: , MgmtId: 46618217624527, via: 4, Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}}] }
  354. 2015-04-17 16:26:26,484 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-471:ctx-242f119d) Seq 5-1993146373: Executing request
  355. 2015-04-17 16:26:26,608 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-471:ctx-242f119d) Seq 5-1993146373: Response Received:
  356. 2015-04-17 16:26:26,608 DEBUG [c.c.a.t.Request] (DirectAgent-471:ctx-242f119d) Seq 5-1993146373: Processing: { Ans: , MgmtId: 46618217624527, via: 5, Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}}] }
  357. 2015-04-17 16:26:28,563 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-472:ctx-6360657b) Seq 1-315228192: Executing request
  358. 2015-04-17 16:26:28,884 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-472:ctx-6360657b) Seq 1-315228192: Response Received:
  359. 2015-04-17 16:26:28,884 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-472:ctx-6360657b) Seq 1-315228192: MgmtId 50788518005399: Resp: Routing to peer
  360. 2015-04-17 16:26:28,917 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-309:ctx-5ca29ebe) Seq 2-751304731: Executing request
  361. 2015-04-17 16:26:29,108 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-309:ctx-5ca29ebe) Seq 2-751304731: Response Received:
  362. 2015-04-17 16:26:29,109 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-309:ctx-5ca29ebe) Seq 2-751304731: MgmtId 50788518005399: Resp: Routing to peer
  363. 2015-04-17 16:26:29,141 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-84:ctx-d747e6aa) Seq 3-1314127894: Executing request
  364. 2015-04-17 16:26:29,466 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-84:ctx-d747e6aa) Seq 3-1314127894: Response Received:
  365. 2015-04-17 16:26:29,466 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-84:ctx-d747e6aa) Seq 3-1314127894: MgmtId 50788518005399: Resp: Routing to peer
  366. 2015-04-17 16:26:29,500 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-44:ctx-f193e308) Seq 4-551616535: Executing request
  367. 2015-04-17 16:26:29,816 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-44:ctx-f193e308) Seq 4-551616535: Response Received:
  368. 2015-04-17 16:26:29,817 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-44:ctx-f193e308) Seq 4-551616535: MgmtId 50788518005399: Resp: Routing to peer
  369. 2015-04-17 16:26:29,847 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-311:ctx-817c9435) Seq 5-749666325: Executing request
  370. 2015-04-17 16:26:30,153 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-311:ctx-817c9435) Seq 5-749666325: Response Received:
  371. 2015-04-17 16:26:30,154 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-311:ctx-817c9435) Seq 5-749666325: MgmtId 50788518005399: Resp: Routing to peer
  372. 2015-04-17 16:26:30,454 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-474:ctx-76c607e1) Ping from 1(cloud-host2.cgg.gov.in)
  373. 2015-04-17 16:26:31,426 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-477:ctx-f7e5c538) Seq 1-439549956: Executing request
  374. 2015-04-17 16:26:31,544 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-477:ctx-f7e5c538) Seq 1-439549956: Response Received:
  375. 2015-04-17 16:26:31,544 DEBUG [c.c.a.t.Request] (DirectAgent-477:ctx-f7e5c538) Seq 1-439549956: Processing: { Ans: , MgmtId: 46618217624527, via: 1, Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}}] }
  376. 2015-04-17 16:26:34,394 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-9ae426f7) Zone 1 is ready to launch console proxy
  377. 2015-04-17 16:26:34,394 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-9ae426f7) Expand console proxy standby capacity for zone CGG-CLOUD-ZONE
  378. 2015-04-17 16:26:34,405 INFO [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-9ae426f7) Found a stopped console proxy, bring it up to running pool. proxy vm id : 1
  379. 2015-04-17 16:26:34,441 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
  380. 2015-04-17 16:26:34,441 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9ae426f7) Successfully transitioned to start state for VM[ConsoleProxy|v-1-VM] reservation id = 3f6bfca8-6c31-4d67-a2a0-d9312e19a522
  381. 2015-04-17 16:26:34,450 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9ae426f7) Trying to deploy VM, vm has dcId: 1 and podId: 1
  382. 2015-04-17 16:26:34,450 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9ae426f7) Deploy avoids pods: null, clusters: null, hosts: null
  383. 2015-04-17 16:26:34,460 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Deploy avoids pods: null, clusters: null, hosts: null
  384. 2015-04-17 16:26:34,463 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@4f7533d2
  385. 2015-04-17 16:26:34,463 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Trying to allocate a host and storage pools from dc:1, pod:1,cluster:null, requested cpu: 500, requested ram: 1073741824
  386. 2015-04-17 16:26:34,463 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Is ROOT volume READY (pool already allocated)?: No
  387. 2015-04-17 16:26:34,463 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-9ae426f7) Searching resources only under specified Pod: 1
  388. 2015-04-17 16:26:34,463 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-9ae426f7) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Pod: 1
  389. 2015-04-17 16:26:34,482 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Checking resources in Cluster: 1 under Pod: 1
  390. 2015-04-17 16:26:34,482 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Looking for hosts in dc: 1 pod:1 cluster:1
  391. 2015-04-17 16:26:34,489 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) FirstFitAllocator has 5 hosts to check for allocation: [Host[-4-Routing], Host[-3-Routing], Host[-1-Routing], Host[-2-Routing], Host[-5-Routing]]
  392. 2015-04-17 16:26:34,505 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Found 5 hosts for allocation after prioritization: [Host[-4-Routing], Host[-3-Routing], Host[-1-Routing], Host[-2-Routing], Host[-5-Routing]]
  393. 2015-04-17 16:26:34,505 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=1024
  394. 2015-04-17 16:26:34,518 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host: 4 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  395. 2015-04-17 16:26:34,518 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Checking if host: 4 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  396. 2015-04-17 16:26:34,524 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  397. 2015-04-17 16:26:34,524 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  398. 2015-04-17 16:26:34,524 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Free RAM: 130926600192 , Requested RAM: 1073741824
  399. 2015-04-17 16:26:34,524 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host has enough CPU and RAM available
  400. 2015-04-17 16:26:34,524 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 4, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  401. 2015-04-17 16:26:34,524 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 4, used: 0, reserved: 0, total: 130926600192; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  402. 2015-04-17 16:26:34,524 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Found a suitable host, adding to list: 4
  403. 2015-04-17 16:26:34,538 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host: 3 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  404. 2015-04-17 16:26:34,538 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Checking if host: 3 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  405. 2015-04-17 16:26:34,542 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  406. 2015-04-17 16:26:34,542 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  407. 2015-04-17 16:26:34,542 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Free RAM: 130926600192 , Requested RAM: 1073741824
  408. 2015-04-17 16:26:34,542 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host has enough CPU and RAM available
  409. 2015-04-17 16:26:34,542 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 3, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  410. 2015-04-17 16:26:34,542 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 3, used: 0, reserved: 0, total: 130926600192; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  411. 2015-04-17 16:26:34,542 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Found a suitable host, adding to list: 3
  412. 2015-04-17 16:26:34,552 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host: 1 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  413. 2015-04-17 16:26:34,552 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  414. 2015-04-17 16:26:34,555 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  415. 2015-04-17 16:26:34,555 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  416. 2015-04-17 16:26:34,555 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Free RAM: 130926600192 , Requested RAM: 1073741824
  417. 2015-04-17 16:26:34,555 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host has enough CPU and RAM available
  418. 2015-04-17 16:26:34,555 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 1, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  419. 2015-04-17 16:26:34,555 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 1, used: 0, reserved: 0, total: 130926600192; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  420. 2015-04-17 16:26:34,555 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Found a suitable host, adding to list: 1
  421. 2015-04-17 16:26:34,565 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host: 2 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  422. 2015-04-17 16:26:34,565 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Checking if host: 2 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  423. 2015-04-17 16:26:34,569 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  424. 2015-04-17 16:26:34,569 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  425. 2015-04-17 16:26:34,569 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Free RAM: 130926600192 , Requested RAM: 1073741824
  426. 2015-04-17 16:26:34,569 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host has enough CPU and RAM available
  427. 2015-04-17 16:26:34,569 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 2, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  428. 2015-04-17 16:26:34,569 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 2, used: 0, reserved: 0, total: 130926600192; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  429. 2015-04-17 16:26:34,569 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Found a suitable host, adding to list: 2
  430. 2015-04-17 16:26:34,582 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host: 5 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  431. 2015-04-17 16:26:34,582 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Checking if host: 5 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  432. 2015-04-17 16:26:34,587 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  433. 2015-04-17 16:26:34,587 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  434. 2015-04-17 16:26:34,587 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Free RAM: 130926600192 , Requested RAM: 1073741824
  435. 2015-04-17 16:26:34,587 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host has enough CPU and RAM available
  436. 2015-04-17 16:26:34,587 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 5, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  437. 2015-04-17 16:26:34,587 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 5, used: 0, reserved: 0, total: 130926600192; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  438. 2015-04-17 16:26:34,587 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Found a suitable host, adding to list: 5
  439. 2015-04-17 16:26:34,587 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host Allocator returning 5 suitable hosts
  440. 2015-04-17 16:26:34,590 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Checking suitable pools for volume (Id, Type): (1,ROOT)
  441. 2015-04-17 16:26:34,590 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) We need to allocate new storagepool for this volume
  442. 2015-04-17 16:26:34,590 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Calling StoragePoolAllocators to find suitable pools
  443. 2015-04-17 16:26:34,593 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (consoleproxy-1:ctx-9ae426f7) LocalStoragePoolAllocator trying to find storage pool to fit the vm
  444. 2015-04-17 16:26:34,593 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9ae426f7) ClusterScopeStoragePoolAllocator looking for storage pool
  445. 2015-04-17 16:26:34,593 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9ae426f7) Looking for pools in dc: 1 pod:1 cluster:1
  446. 2015-04-17 16:26:34,596 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9ae426f7) Found pools matching tags: [Pool[1|PreSetup]]
  447. 2015-04-17 16:26:34,598 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9ae426f7) Removing pool Pool[1|PreSetup] from avoid set, must have been inserted when searching for another disk's tag
  448. 2015-04-17 16:26:34,601 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] (consoleproxy-1:ctx-9ae426f7) Checking if storage pool is suitable, name: null ,poolId: 1
  449. 2015-04-17 16:26:34,609 DEBUG [c.c.s.StorageManagerImpl] (consoleproxy-1:ctx-9ae426f7) Checking pool 1 for storage, totalSize: 1649254858752, usedBytes: 25165824, usedPct: 1.5258905478710012E-5, disable threshold: 0.85
  450. 2015-04-17 16:26:34,618 DEBUG [c.c.s.StorageManagerImpl] (consoleproxy-1:ctx-9ae426f7) Checking pool: 1 for volume allocation [Vol[1|vm=1|ROOT]], maxSize : 1649254858752, totalAllocatedSize : 0, askingSize : 0, allocated disable threshold: 0.85
  451. 2015-04-17 16:26:34,618 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9ae426f7) ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
  452. 2015-04-17 16:26:34,618 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Trying to find a potenial host and associated storage pools from the suitable host/pool lists for this VM
  453. 2015-04-17 16:26:34,618 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Checking if host: 4 can access any suitable storage pool for volume: ROOT
  454. 2015-04-17 16:26:34,619 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Host: 4 can access pool: 1
  455. 2015-04-17 16:26:34,620 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Found a potential host id: 4 name: cloud-host10.cgg.gov.in and associated storage pools for this VM
  456. 2015-04-17 16:26:34,622 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Returning Deployment Destination: Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(4)-Storage(Volume(1|ROOT-->Pool(1))]
  457. 2015-04-17 16:26:34,622 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9ae426f7) Deployment found - P0=VM[ConsoleProxy|v-1-VM], P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(4)-Storage(Volume(1|ROOT-->Pool(1))]
  458. 2015-04-17 16:26:34,641 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) VM state transitted from :Starting to Starting with event: OperationRetryvm's original host id: null new host id: 4 host id before state transition: null
  459. 2015-04-17 16:26:34,657 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  460. 2015-04-17 16:26:34,657 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) We are allocating VM, increasing the used capacity of this host:4
  461. 2015-04-17 16:26:34,657 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) Current Used CPU: 0 , Free CPU:88000 ,Requested CPU: 500
  462. 2015-04-17 16:26:34,657 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) Current Used RAM: 0 , Free RAM:130926600192 ,Requested RAM: 1073741824
  463. 2015-04-17 16:26:34,657 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) CPU STATS after allocation: for host: 4, old used: 0, old reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used:500, reserved:0; requested cpu:500,alloc_from_last:false
  464. 2015-04-17 16:26:34,657 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) RAM STATS after allocation: for host: 4, old used: 0, old reserved: 0, total: 130926600192; new used: 1073741824, reserved: 0; requested mem: 1073741824,alloc_from_last:false
  465. 2015-04-17 16:26:34,665 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9ae426f7) VM is being created in podId: 1
  466. 2015-04-17 16:26:34,674 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-9ae426f7) Network id=200 is already implemented
  467. 2015-04-17 16:26:34,720 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-9ae426f7) Network id=202 is already implemented
  468. 2015-04-17 16:26:34,780 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-9ae426f7) Network id=201 is already implemented
  469. 2015-04-17 16:26:34,834 DEBUG [c.c.n.g.PodBasedNetworkGuru] (consoleproxy-1:ctx-9ae426f7) Allocated a nic NicProfile[3-1-3f6bfca8-6c31-4d67-a2a0-d9312e19a522-10.3.4.199-null for VM[ConsoleProxy|v-1-VM]
  470. 2015-04-17 16:26:34,848 DEBUG [o.a.c.e.o.VolumeOrchestrator] (consoleproxy-1:ctx-9ae426f7) Checking if we need to prepare 1 volumes for VM[ConsoleProxy|v-1-VM]
  471. 2015-04-17 16:26:34,848 DEBUG [c.c.s.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-f7031e2e) Zone 1 is ready to launch secondary storage VM
  472. 2015-04-17 16:26:34,860 INFO [c.c.s.PremiumSecondaryStorageManagerImpl] (secstorage-1:ctx-f7031e2e) No running secondary storage vms found in datacenter id=1, starting one
  473. 2015-04-17 16:26:34,872 INFO [c.c.s.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-f7031e2e) No stopped secondary storage vm is available, need to allocate a new secondary storage vm
  474. 2015-04-17 16:26:34,877 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (consoleproxy-1:ctx-9ae426f7) template 1 is already in store:1, type:Image
  475. 2015-04-17 16:26:34,877 DEBUG [c.c.s.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-f7031e2e) Assign secondary storage vm from a newly started instance for request from data center : 1
  476. 2015-04-17 16:26:34,887 DEBUG [o.a.c.s.d.PrimaryDataStoreImpl] (consoleproxy-1:ctx-9ae426f7) Not found (templateId:1poolId:1) in template_spool_ref, persisting it
  477. 2015-04-17 16:26:34,900 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (consoleproxy-1:ctx-9ae426f7) template 1 is already in store:1, type:Primary
  478. 2015-04-17 16:26:34,903 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-f7031e2e) Found existing network configuration for offering [Network Offering [1-Public-System-Public-Network]: Ntwk[200|Public|1]
  479. 2015-04-17 16:26:34,903 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-f7031e2e) Releasing lock for Acct[444824f0-e439-11e4-b2f4-8e87d1b74cef-system]
  480. 2015-04-17 16:26:34,904 DEBUG [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-9ae426f7) Found template routing-1 in storage pool 1 with VMTemplateStoragePool id: 153
  481. 2015-04-17 16:26:34,916 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-f7031e2e) Found existing network configuration for offering [Network Offering [3-Control-System-Control-Network]: Ntwk[202|Control|3]
  482. 2015-04-17 16:26:34,916 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-f7031e2e) Releasing lock for Acct[444824f0-e439-11e4-b2f4-8e87d1b74cef-system]
  483. 2015-04-17 16:26:34,918 DEBUG [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-9ae426f7) Acquire lock on VMTemplateStoragePool 153 with timeout 3600 seconds
  484. 2015-04-17 16:26:34,922 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-9ae426f7) lock is acquired for VMTemplateStoragePool 153
  485. 2015-04-17 16:26:34,922 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-f7031e2e) Found existing network configuration for offering [Network Offering [2-Management-System-Management-Network]: Ntwk[201|Management|2]
  486. 2015-04-17 16:26:34,922 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-f7031e2e) Releasing lock for Acct[444824f0-e439-11e4-b2f4-8e87d1b74cef-system]
  487. 2015-04-17 16:26:34,928 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-f7031e2e) Found existing network configuration for offering [Network Offering [4-Storage-System-Storage-Network]: Ntwk[203|Storage|4]
  488. 2015-04-17 16:26:34,928 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-f7031e2e) Releasing lock for Acct[444824f0-e439-11e4-b2f4-8e87d1b74cef-system]
  489. 2015-04-17 16:26:34,935 DEBUG [o.a.c.s.m.AncientDataMotionStrategy] (consoleproxy-1:ctx-9ae426f7) copyAsync inspecting src type TEMPLATE copyAsync inspecting dest type TEMPLATE
  490. 2015-04-17 16:26:34,959 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-9ae426f7) Seq 3-1753874534: Sending { Cmd , MgmtId: 46618217624527, via: 3(cloud-host9.cgg.gov.in), Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/1/","origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.3.4.40/ibm/CloudSecondary","_role":"Image"}},"name":"routing-1","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"CloudStore-1","id":1,"poolType":"PreSetup","host":"localhost","path":"/CloudStore-1","port":0,"url":"PreSetup://localhost//CloudStore-1/?ROLE=Primary&STOREUUID=CloudStore-1"}},"name":"routing-1","hypervisorType":"XenServer"}},"executeInSequence":false,"options":{},"wait":10800}}] }
  491. 2015-04-17 16:26:34,959 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-9ae426f7) Seq 3-1753874534: Executing: { Cmd , MgmtId: 46618217624527, via: 3(cloud-host9.cgg.gov.in), Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/1/","origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.3.4.40/ibm/CloudSecondary","_role":"Image"}},"name":"routing-1","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"CloudStore-1","id":1,"poolType":"PreSetup","host":"localhost","path":"/CloudStore-1","port":0,"url":"PreSetup://localhost//CloudStore-1/?ROLE=Primary&STOREUUID=CloudStore-1"}},"name":"routing-1","hypervisorType":"XenServer"}},"executeInSequence":false,"options":{},"wait":10800}}] }
  492. 2015-04-17 16:26:34,960 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-313:ctx-10d974ee) Seq 3-1753874534: Executing request
  493. 2015-04-17 16:26:34,974 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-f7031e2e) Allocating entries for VM: VM[SecondaryStorageVm|s-33-VM]
  494. 2015-04-17 16:26:34,980 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-f7031e2e) Allocating nics for VM[SecondaryStorageVm|s-33-VM]
  495. 2015-04-17 16:26:34,982 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-f7031e2e) Allocating nic for vm VM[SecondaryStorageVm|s-33-VM] in network Ntwk[200|Public|1] with requested profile NicProfile[0-0-null-null-null
  496. 2015-04-17 16:26:35,011 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-f7031e2e) Allocating nic for vm VM[SecondaryStorageVm|s-33-VM] in network Ntwk[202|Control|3] with requested profile null
  497. 2015-04-17 16:26:35,026 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-f7031e2e) Allocating nic for vm VM[SecondaryStorageVm|s-33-VM] in network Ntwk[201|Management|2] with requested profile null
  498. 2015-04-17 16:26:35,049 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-f7031e2e) Allocating nic for vm VM[SecondaryStorageVm|s-33-VM] in network Ntwk[203|Storage|4] with requested profile null
  499. 2015-04-17 16:26:35,073 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-f7031e2e) Allocating disks for VM[SecondaryStorageVm|s-33-VM]
  500. 2015-04-17 16:26:35,088 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-f7031e2e) Allocation completed for VM: VM[SecondaryStorageVm|s-33-VM]
  501. 2015-04-17 16:26:35,108 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-f7031e2e) received secondary storage vm alert
  502. 2015-04-17 16:26:35,108 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-f7031e2e) New secondary storage vm created, zone: CGG-CLOUD-ZONE, secStorageVm: s-33-VM, public IP: null, private IP: null
  503. 2015-04-17 16:26:35,145 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
  504. 2015-04-17 16:26:35,145 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-f7031e2e) Successfully transitioned to start state for VM[SecondaryStorageVm|s-33-VM] reservation id = 40b537fe-2625-49fe-bdfe-55758da77455
  505. 2015-04-17 16:26:35,155 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-f7031e2e) Trying to deploy VM, vm has dcId: 1 and podId: null
  506. 2015-04-17 16:26:35,155 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-f7031e2e) Deploy avoids pods: null, clusters: null, hosts: null
  507. 2015-04-17 16:26:35,164 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-f7031e2e) Deploy avoids pods: null, clusters: null, hosts: null
  508. 2015-04-17 16:26:35,166 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-f7031e2e) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@4f7533d2
  509. 2015-04-17 16:26:35,166 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-f7031e2e) Trying to allocate a host and storage pools from dc:1, pod:null,cluster:null, requested cpu: 500, requested ram: 536870912
  510. 2015-04-17 16:26:35,166 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-f7031e2e) Is ROOT volume READY (pool already allocated)?: No
  511. 2015-04-17 16:26:35,167 DEBUG [c.c.d.FirstFitPlanner] (secstorage-1:ctx-f7031e2e) Searching all possible resources under this Zone: 1
  512. 2015-04-17 16:26:35,169 DEBUG [c.c.d.FirstFitPlanner] (secstorage-1:ctx-f7031e2e) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
  513. 2015-04-17 16:26:35,186 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-f7031e2e) Checking resources in Cluster: 1 under Pod: 1
  514. 2015-04-17 16:26:35,187 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) Looking for hosts in dc: 1 pod:1 cluster:1
  515. 2015-04-17 16:26:35,195 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) FirstFitAllocator has 5 hosts to check for allocation: [Host[-3-Routing], Host[-5-Routing], Host[-1-Routing], Host[-2-Routing], Host[-4-Routing]]
  516. 2015-04-17 16:26:35,209 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) Found 5 hosts for allocation after prioritization: [Host[-3-Routing], Host[-5-Routing], Host[-1-Routing], Host[-2-Routing], Host[-4-Routing]]
  517. 2015-04-17 16:26:35,209 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=512
  518. 2015-04-17 16:26:35,223 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) Host: 3 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  519. 2015-04-17 16:26:35,223 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) Checking if host: 3 has enough capacity for requested CPU: 500 and requested RAM: 536870912 , cpuOverprovisioningFactor: 1.0
  520. 2015-04-17 16:26:35,228 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  521. 2015-04-17 16:26:35,228 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  522. 2015-04-17 16:26:35,228 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) Free RAM: 130926600192 , Requested RAM: 536870912
  523. 2015-04-17 16:26:35,228 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) Host has enough CPU and RAM available
  524. 2015-04-17 16:26:35,228 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 3, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  525. 2015-04-17 16:26:35,228 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 3, used: 0, reserved: 0, total: 130926600192; requested mem: 536870912,alloc_from_last_host?:false ,considerReservedCapacity?: true
  526. 2015-04-17 16:26:35,228 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) Found a suitable host, adding to list: 3
  527. 2015-04-17 16:26:35,242 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) Host: 5 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  528. 2015-04-17 16:26:35,242 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) Checking if host: 5 has enough capacity for requested CPU: 500 and requested RAM: 536870912 , cpuOverprovisioningFactor: 1.0
  529. 2015-04-17 16:26:35,247 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  530. 2015-04-17 16:26:35,247 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  531. 2015-04-17 16:26:35,247 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) Free RAM: 130926600192 , Requested RAM: 536870912
  532. 2015-04-17 16:26:35,247 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) Host has enough CPU and RAM available
  533. 2015-04-17 16:26:35,247 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 5, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  534. 2015-04-17 16:26:35,247 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 5, used: 0, reserved: 0, total: 130926600192; requested mem: 536870912,alloc_from_last_host?:false ,considerReservedCapacity?: true
  535. 2015-04-17 16:26:35,247 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) Found a suitable host, adding to list: 5
  536. 2015-04-17 16:26:35,261 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) Host: 1 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  537. 2015-04-17 16:26:35,261 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 536870912 , cpuOverprovisioningFactor: 1.0
  538. 2015-04-17 16:26:35,266 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  539. 2015-04-17 16:26:35,266 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  540. 2015-04-17 16:26:35,266 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) Free RAM: 130926600192 , Requested RAM: 536870912
  541. 2015-04-17 16:26:35,266 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) Host has enough CPU and RAM available
  542. 2015-04-17 16:26:35,266 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 1, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  543. 2015-04-17 16:26:35,266 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 1, used: 0, reserved: 0, total: 130926600192; requested mem: 536870912,alloc_from_last_host?:false ,considerReservedCapacity?: true
  544. 2015-04-17 16:26:35,266 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) Found a suitable host, adding to list: 1
  545. 2015-04-17 16:26:35,280 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) Host: 2 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  546. 2015-04-17 16:26:35,280 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) Checking if host: 2 has enough capacity for requested CPU: 500 and requested RAM: 536870912 , cpuOverprovisioningFactor: 1.0
  547. 2015-04-17 16:26:35,285 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  548. 2015-04-17 16:26:35,285 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  549. 2015-04-17 16:26:35,285 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) Free RAM: 130926600192 , Requested RAM: 536870912
  550. 2015-04-17 16:26:35,285 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) Host has enough CPU and RAM available
  551. 2015-04-17 16:26:35,285 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 2, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  552. 2015-04-17 16:26:35,285 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 2, used: 0, reserved: 0, total: 130926600192; requested mem: 536870912,alloc_from_last_host?:false ,considerReservedCapacity?: true
  553. 2015-04-17 16:26:35,285 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) Found a suitable host, adding to list: 2
  554. 2015-04-17 16:26:35,300 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) Host: 4 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  555. 2015-04-17 16:26:35,300 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) Checking if host: 4 has enough capacity for requested CPU: 500 and requested RAM: 536870912 , cpuOverprovisioningFactor: 1.0
  556. 2015-04-17 16:26:35,305 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  557. 2015-04-17 16:26:35,305 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) Free CPU: 87500 , Requested CPU: 500
  558. 2015-04-17 16:26:35,305 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) Free RAM: 129852858368 , Requested RAM: 536870912
  559. 2015-04-17 16:26:35,305 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) Host has enough CPU and RAM available
  560. 2015-04-17 16:26:35,305 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 4, used: 500, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  561. 2015-04-17 16:26:35,305 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 4, used: 1073741824, reserved: 0, total: 130926600192; requested mem: 536870912,alloc_from_last_host?:false ,considerReservedCapacity?: true
  562. 2015-04-17 16:26:35,305 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) Found a suitable host, adding to list: 4
  563. 2015-04-17 16:26:35,305 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-f7031e2e FirstFitRoutingAllocator) Host Allocator returning 5 suitable hosts
  564. 2015-04-17 16:26:35,308 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-f7031e2e) Checking suitable pools for volume (Id, Type): (33,ROOT)
  565. 2015-04-17 16:26:35,308 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-f7031e2e) We need to allocate new storagepool for this volume
  566. 2015-04-17 16:26:35,308 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-f7031e2e) Calling StoragePoolAllocators to find suitable pools
  567. 2015-04-17 16:26:35,310 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (secstorage-1:ctx-f7031e2e) LocalStoragePoolAllocator trying to find storage pool to fit the vm
  568. 2015-04-17 16:26:35,310 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (secstorage-1:ctx-f7031e2e) ClusterScopeStoragePoolAllocator looking for storage pool
  569. 2015-04-17 16:26:35,310 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (secstorage-1:ctx-f7031e2e) Looking for pools in dc: 1 pod:1 cluster:1
  570. 2015-04-17 16:26:35,314 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (secstorage-1:ctx-f7031e2e) Found pools matching tags: [Pool[1|PreSetup]]
  571. 2015-04-17 16:26:35,317 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (secstorage-1:ctx-f7031e2e) Removing pool Pool[1|PreSetup] from avoid set, must have been inserted when searching for another disk's tag
  572. 2015-04-17 16:26:35,320 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] (secstorage-1:ctx-f7031e2e) Checking if storage pool is suitable, name: null ,poolId: 1
  573. 2015-04-17 16:26:35,327 DEBUG [c.c.s.StorageManagerImpl] (secstorage-1:ctx-f7031e2e) Checking pool 1 for storage, totalSize: 1649254858752, usedBytes: 25165824, usedPct: 1.5258905478710012E-5, disable threshold: 0.85
  574. 2015-04-17 16:26:35,337 DEBUG [c.c.s.StorageManagerImpl] (secstorage-1:ctx-f7031e2e) Checking pool: 1 for volume allocation [Vol[33|vm=33|ROOT]], maxSize : 1649254858752, totalAllocatedSize : 0, askingSize : 0, allocated disable threshold: 0.85
  575. 2015-04-17 16:26:35,337 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (secstorage-1:ctx-f7031e2e) ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
  576. 2015-04-17 16:26:35,337 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-f7031e2e) Trying to find a potenial host and associated storage pools from the suitable host/pool lists for this VM
  577. 2015-04-17 16:26:35,337 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-f7031e2e) Checking if host: 3 can access any suitable storage pool for volume: ROOT
  578. 2015-04-17 16:26:35,338 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-f7031e2e) Host: 3 can access pool: 1
  579. 2015-04-17 16:26:35,339 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-f7031e2e) Found a potential host id: 3 name: cloud-host9.cgg.gov.in and associated storage pools for this VM
  580. 2015-04-17 16:26:35,341 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-f7031e2e) Returning Deployment Destination: Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(3)-Storage(Volume(33|ROOT-->Pool(1))]
  581. 2015-04-17 16:26:35,341 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-f7031e2e) Deployment found - P0=VM[SecondaryStorageVm|s-33-VM], P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(3)-Storage(Volume(33|ROOT-->Pool(1))]
  582. 2015-04-17 16:26:35,360 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e) VM state transitted from :Starting to Starting with event: OperationRetryvm's original host id: null new host id: 3 host id before state transition: null
  583. 2015-04-17 16:26:35,378 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  584. 2015-04-17 16:26:35,378 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e) We are allocating VM, increasing the used capacity of this host:3
  585. 2015-04-17 16:26:35,378 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e) Current Used CPU: 0 , Free CPU:88000 ,Requested CPU: 500
  586. 2015-04-17 16:26:35,378 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e) Current Used RAM: 0 , Free RAM:130926600192 ,Requested RAM: 536870912
  587. 2015-04-17 16:26:35,378 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e) CPU STATS after allocation: for host: 3, old used: 0, old reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used:500, reserved:0; requested cpu:500,alloc_from_last:false
  588. 2015-04-17 16:26:35,378 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e) RAM STATS after allocation: for host: 3, old used: 0, old reserved: 0, total: 130926600192; new used: 536870912, reserved: 0; requested mem: 536870912,alloc_from_last:false
  589. 2015-04-17 16:26:35,386 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-f7031e2e) VM is being created in podId: 1
  590. 2015-04-17 16:26:35,396 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-f7031e2e) Network id=200 is already implemented
  591. 2015-04-17 16:26:35,445 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-f7031e2e) Network id=202 is already implemented
  592. 2015-04-17 16:26:35,499 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-f7031e2e) Network id=201 is already implemented
  593. 2015-04-17 16:26:35,549 DEBUG [c.c.n.g.PodBasedNetworkGuru] (secstorage-1:ctx-f7031e2e) Allocated a nic NicProfile[130-33-40b537fe-2625-49fe-bdfe-55758da77455-10.3.4.111-null for VM[SecondaryStorageVm|s-33-VM]
  594. 2015-04-17 16:26:35,564 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-f7031e2e) Network id=203 is already implemented
  595. 2015-04-17 16:26:35,614 DEBUG [c.c.n.g.PodBasedNetworkGuru] (secstorage-1:ctx-f7031e2e) Allocated a nic NicProfile[131-33-40b537fe-2625-49fe-bdfe-55758da77455-10.3.4.137-null for VM[SecondaryStorageVm|s-33-VM]
  596. 2015-04-17 16:26:35,627 DEBUG [o.a.c.e.o.VolumeOrchestrator] (secstorage-1:ctx-f7031e2e) Checking if we need to prepare 1 volumes for VM[SecondaryStorageVm|s-33-VM]
  597. 2015-04-17 16:26:35,651 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (secstorage-1:ctx-f7031e2e) template 1 is already in store:1, type:Image
  598. 2015-04-17 16:26:35,664 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (secstorage-1:ctx-f7031e2e) template 1 is already in store:1, type:Primary
  599. 2015-04-17 16:26:35,667 DEBUG [o.a.c.s.v.VolumeServiceImpl] (secstorage-1:ctx-f7031e2e) Found template routing-1 in storage pool 1 with VMTemplateStoragePool id: 153
  600. 2015-04-17 16:26:35,678 DEBUG [o.a.c.s.v.VolumeServiceImpl] (secstorage-1:ctx-f7031e2e) Acquire lock on VMTemplateStoragePool 153 with timeout 3600 seconds
  601. 2015-04-17 16:26:37,130 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-313:ctx-10d974ee) destoryVDIbyNameLabel failed due to there are 0 VDIs with name cloud-3ceef8dc-f5af-49be-9361-1d908b4e9879
  602. 2015-04-17 16:26:37,136 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-313:ctx-10d974ee) can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  603. 2015-04-17 16:26:37,136 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-313:ctx-10d974ee) Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  604. com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  605. at com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copy_vhd_from_secondarystorage(XenServerStorageProcessor.java:848)
  606. at com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copyTemplateToPrimaryStorage(XenServerStorageProcessor.java:918)
  607. at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:75)
  608. at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:50)
  609. at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:609)
  610. at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59)
  611. at com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:106)
  612. at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216)
  613. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  614. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  615. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  616. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  617. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  618. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  619. at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  620. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
  621. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
  622. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  623. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  624. at java.lang.Thread.run(Thread.java:744)
  625. 2015-04-17 16:26:37,137 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-313:ctx-10d974ee) Seq 3-1753874534: Response Received:
  626. 2015-04-17 16:26:37,137 DEBUG [c.c.a.t.Request] (DirectAgent-313:ctx-10d974ee) Seq 3-1753874534: Processing: { Ans: , MgmtId: 46618217624527, via: 3, Ver: v1, Flags: 10, [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31","wait":0}}] }
  627. 2015-04-17 16:26:37,138 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-9ae426f7) Seq 3-1753874534: Received: { Ans: , MgmtId: 46618217624527, via: 3, Ver: v1, Flags: 10, { CopyCmdAnswer } }
  628. 2015-04-17 16:26:37,155 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-9ae426f7) releasing lock for VMTemplateStoragePool 153
  629. 2015-04-17 16:26:37,156 WARN [c.c.u.d.Merovingian2] (consoleproxy-1:ctx-9ae426f7) Was unable to find lock for the key template_spool_ref153 and thread id 2071784721
  630. 2015-04-17 16:26:37,156 DEBUG [o.a.c.e.o.VolumeOrchestrator] (consoleproxy-1:ctx-9ae426f7) Unable to create Vol[1|vm=1|ROOT]:Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  631. 2015-04-17 16:26:37,156 INFO [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9ae426f7) Unable to contact resource.
  632. com.cloud.exception.StorageUnavailableException: Resource [StoragePool:1] is unreachable: Unable to create Vol[1|vm=1|ROOT]:Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  633. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.recreateVolume(VolumeOrchestrator.java:1204)
  634. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.prepare(VolumeOrchestrator.java:1256)
  635. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:963)
  636. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761)
  637. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:745)
  638. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.startProxy(ConsoleProxyManagerImpl.java:555)
  639. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.allocCapacity(ConsoleProxyManagerImpl.java:941)
  640. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:1666)
  641. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:157)
  642. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:118)
  643. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:35)
  644. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:88)
  645. at com.cloud.vm.SystemVmLoadScanner$1.runInContext(SystemVmLoadScanner.java:79)
  646. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  647. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  648. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  649. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  650. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  651. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  652. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
  653. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
  654. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
  655. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  656. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  657. at java.lang.Thread.run(Thread.java:744)
  658. 2015-04-17 16:26:37,162 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9ae426f7) Cleaning up resources for the vm VM[ConsoleProxy|v-1-VM] in Starting state
  659. 2015-04-17 16:26:37,167 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-9ae426f7) Seq 4-283115610: Sending { Cmd , MgmtId: 46618217624527, via: 4(cloud-host10.cgg.gov.in), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"v-1-VM","wait":0}}] }
  660. 2015-04-17 16:26:37,167 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-9ae426f7) Seq 4-283115610: Executing: { Cmd , MgmtId: 46618217624527, via: 4(cloud-host10.cgg.gov.in), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"v-1-VM","wait":0}}] }
  661. 2015-04-17 16:26:37,167 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-479:ctx-7b485667) Seq 4-283115610: Executing request
  662. 2015-04-17 16:26:37,281 INFO [c.c.h.x.r.CitrixResourceBase] (DirectAgent-479:ctx-7b485667) VM does not exist on XenServer34da61e1-04e7-40e2-b8f4-40c0157dca28
  663. 2015-04-17 16:26:37,282 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-479:ctx-7b485667) Seq 4-283115610: Response Received:
  664. 2015-04-17 16:26:37,282 DEBUG [c.c.a.t.Request] (DirectAgent-479:ctx-7b485667) Seq 4-283115610: Processing: { Ans: , MgmtId: 46618217624527, via: 4, Ver: v1, Flags: 10, [{"com.cloud.agent.api.StopAnswer":{"result":true,"details":"VM does not exist","wait":0}}] }
  665. 2015-04-17 16:26:37,282 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-9ae426f7) Seq 4-283115610: Received: { Ans: , MgmtId: 46618217624527, via: 4, Ver: v1, Flags: 10, { StopAnswer } }
  666. 2015-04-17 16:26:37,300 DEBUG [c.c.n.g.ControlNetworkGuru] (consoleproxy-1:ctx-9ae426f7) Released nic: NicProfile[2-1-null-null-null
  667. 2015-04-17 16:26:37,317 DEBUG [c.c.d.d.DataCenterIpAddressDaoImpl] (consoleproxy-1:ctx-9ae426f7) Releasing ip address for reservationId=3f6bfca8-6c31-4d67-a2a0-d9312e19a522, instance=3
  668. 2015-04-17 16:26:37,318 DEBUG [c.c.n.g.PodBasedNetworkGuru] (consoleproxy-1:ctx-9ae426f7) Released nic: NicProfile[3-1-null-null-null
  669. 2015-04-17 16:26:37,327 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9ae426f7) Successfully released network resources for the vm VM[ConsoleProxy|v-1-VM]
  670. 2015-04-17 16:26:37,327 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9ae426f7) Successfully cleanued up resources for the vm VM[ConsoleProxy|v-1-VM] in Starting state
  671. 2015-04-17 16:26:37,333 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Deploy avoids pods: null, clusters: null, hosts: [4]
  672. 2015-04-17 16:26:37,336 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@4f7533d2
  673. 2015-04-17 16:26:37,336 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Trying to allocate a host and storage pools from dc:1, pod:1,cluster:null, requested cpu: 500, requested ram: 1073741824
  674. 2015-04-17 16:26:37,336 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Is ROOT volume READY (pool already allocated)?: No
  675. 2015-04-17 16:26:37,336 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-9ae426f7) Searching resources only under specified Pod: 1
  676. 2015-04-17 16:26:37,336 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-9ae426f7) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Pod: 1
  677. 2015-04-17 16:26:37,354 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Checking resources in Cluster: 1 under Pod: 1
  678. 2015-04-17 16:26:37,355 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Looking for hosts in dc: 1 pod:1 cluster:1
  679. 2015-04-17 16:26:37,363 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) FirstFitAllocator has 5 hosts to check for allocation: [Host[-2-Routing], Host[-3-Routing], Host[-4-Routing], Host[-1-Routing], Host[-5-Routing]]
  680. 2015-04-17 16:26:37,379 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Found 5 hosts for allocation after prioritization: [Host[-2-Routing], Host[-3-Routing], Host[-4-Routing], Host[-1-Routing], Host[-5-Routing]]
  681. 2015-04-17 16:26:37,379 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=1024
  682. 2015-04-17 16:26:37,392 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host: 2 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  683. 2015-04-17 16:26:37,392 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Checking if host: 2 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  684. 2015-04-17 16:26:37,396 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  685. 2015-04-17 16:26:37,397 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  686. 2015-04-17 16:26:37,397 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Free RAM: 130926600192 , Requested RAM: 1073741824
  687. 2015-04-17 16:26:37,397 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host has enough CPU and RAM available
  688. 2015-04-17 16:26:37,397 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 2, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  689. 2015-04-17 16:26:37,397 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 2, used: 0, reserved: 0, total: 130926600192; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  690. 2015-04-17 16:26:37,397 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Found a suitable host, adding to list: 2
  691. 2015-04-17 16:26:37,410 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host: 3 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  692. 2015-04-17 16:26:37,410 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Checking if host: 3 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  693. 2015-04-17 16:26:37,416 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  694. 2015-04-17 16:26:37,416 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Free CPU: 87500 , Requested CPU: 500
  695. 2015-04-17 16:26:37,416 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Free RAM: 130389729280 , Requested RAM: 1073741824
  696. 2015-04-17 16:26:37,416 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host has enough CPU and RAM available
  697. 2015-04-17 16:26:37,416 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 3, used: 500, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  698. 2015-04-17 16:26:37,416 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 3, used: 536870912, reserved: 0, total: 130926600192; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  699. 2015-04-17 16:26:37,416 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Found a suitable host, adding to list: 3
  700. 2015-04-17 16:26:37,416 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host name: cloud-host10.cgg.gov.in, hostId: 4 is in avoid set, skipping this and trying other available hosts
  701. 2015-04-17 16:26:37,431 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host: 1 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  702. 2015-04-17 16:26:37,432 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  703. 2015-04-17 16:26:37,436 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  704. 2015-04-17 16:26:37,437 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  705. 2015-04-17 16:26:37,437 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Free RAM: 130926600192 , Requested RAM: 1073741824
  706. 2015-04-17 16:26:37,437 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host has enough CPU and RAM available
  707. 2015-04-17 16:26:37,437 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 1, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  708. 2015-04-17 16:26:37,437 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 1, used: 0, reserved: 0, total: 130926600192; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  709. 2015-04-17 16:26:37,437 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Found a suitable host, adding to list: 1
  710. 2015-04-17 16:26:37,450 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host: 5 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  711. 2015-04-17 16:26:37,450 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Checking if host: 5 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  712. 2015-04-17 16:26:37,456 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  713. 2015-04-17 16:26:37,456 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  714. 2015-04-17 16:26:37,456 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Free RAM: 130926600192 , Requested RAM: 1073741824
  715. 2015-04-17 16:26:37,456 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host has enough CPU and RAM available
  716. 2015-04-17 16:26:37,456 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 5, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  717. 2015-04-17 16:26:37,456 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 5, used: 0, reserved: 0, total: 130926600192; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  718. 2015-04-17 16:26:37,456 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Found a suitable host, adding to list: 5
  719. 2015-04-17 16:26:37,456 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host Allocator returning 4 suitable hosts
  720. 2015-04-17 16:26:37,459 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Checking suitable pools for volume (Id, Type): (1,ROOT)
  721. 2015-04-17 16:26:37,459 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) We need to allocate new storagepool for this volume
  722. 2015-04-17 16:26:37,459 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Calling StoragePoolAllocators to find suitable pools
  723. 2015-04-17 16:26:37,461 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (consoleproxy-1:ctx-9ae426f7) LocalStoragePoolAllocator trying to find storage pool to fit the vm
  724. 2015-04-17 16:26:37,462 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9ae426f7) ClusterScopeStoragePoolAllocator looking for storage pool
  725. 2015-04-17 16:26:37,462 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9ae426f7) Looking for pools in dc: 1 pod:1 cluster:1
  726. 2015-04-17 16:26:37,464 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9ae426f7) Found pools matching tags: [Pool[1|PreSetup]]
  727. 2015-04-17 16:26:37,467 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9ae426f7) Removing pool Pool[1|PreSetup] from avoid set, must have been inserted when searching for another disk's tag
  728. 2015-04-17 16:26:37,470 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] (consoleproxy-1:ctx-9ae426f7) Checking if storage pool is suitable, name: null ,poolId: 1
  729. 2015-04-17 16:26:37,478 DEBUG [c.c.s.StorageManagerImpl] (consoleproxy-1:ctx-9ae426f7) Checking pool 1 for storage, totalSize: 1649254858752, usedBytes: 25165824, usedPct: 1.5258905478710012E-5, disable threshold: 0.85
  730. 2015-04-17 16:26:37,488 DEBUG [c.c.s.StorageManagerImpl] (consoleproxy-1:ctx-9ae426f7) Checking pool: 1 for volume allocation [Vol[1|vm=1|ROOT]], maxSize : 1649254858752, totalAllocatedSize : 0, askingSize : 0, allocated disable threshold: 0.85
  731. 2015-04-17 16:26:37,488 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9ae426f7) ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
  732. 2015-04-17 16:26:37,488 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Trying to find a potenial host and associated storage pools from the suitable host/pool lists for this VM
  733. 2015-04-17 16:26:37,488 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Checking if host: 2 can access any suitable storage pool for volume: ROOT
  734. 2015-04-17 16:26:37,489 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Host: 2 can access pool: 1
  735. 2015-04-17 16:26:37,490 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Found a potential host id: 2 name: cloud-host1.cgg.gov.in and associated storage pools for this VM
  736. 2015-04-17 16:26:37,492 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Returning Deployment Destination: Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(2)-Storage(Volume(1|ROOT-->Pool(1))]
  737. 2015-04-17 16:26:37,492 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9ae426f7) Deployment found - P0=VM[ConsoleProxy|v-1-VM], P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(2)-Storage(Volume(1|ROOT-->Pool(1))]
  738. 2015-04-17 16:26:37,512 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) VM state transitted from :Starting to Starting with event: OperationRetryvm's original host id: null new host id: 2 host id before state transition: 4
  739. 2015-04-17 16:26:37,525 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  740. 2015-04-17 16:26:37,525 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) Hosts's actual total RAM: 130926604032 and RAM after applying overprovisioning: 130926600192
  741. 2015-04-17 16:26:37,525 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) release cpu from host: 4, old used: 500,reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  742. 2015-04-17 16:26:37,525 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) release mem from host: 4, old used: 1073741824,reserved: 0, total: 130926600192; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  743. 2015-04-17 16:26:37,547 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  744. 2015-04-17 16:26:37,547 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) We are allocating VM, increasing the used capacity of this host:2
  745. 2015-04-17 16:26:37,547 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) Current Used CPU: 0 , Free CPU:88000 ,Requested CPU: 500
  746. 2015-04-17 16:26:37,547 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) Current Used RAM: 0 , Free RAM:130926600192 ,Requested RAM: 1073741824
  747. 2015-04-17 16:26:37,547 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) CPU STATS after allocation: for host: 2, old used: 0, old reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used:500, reserved:0; requested cpu:500,alloc_from_last:false
  748. 2015-04-17 16:26:37,547 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) RAM STATS after allocation: for host: 2, old used: 0, old reserved: 0, total: 130926600192; new used: 1073741824, reserved: 0; requested mem: 1073741824,alloc_from_last:false
  749. 2015-04-17 16:26:37,554 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9ae426f7) VM is being created in podId: 1
  750. 2015-04-17 16:26:37,563 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-9ae426f7) Network id=200 is already implemented
  751. 2015-04-17 16:26:37,610 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-9ae426f7) Network id=202 is already implemented
  752. 2015-04-17 16:26:37,669 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-9ae426f7) Network id=201 is already implemented
  753. 2015-04-17 16:26:37,716 DEBUG [c.c.n.g.PodBasedNetworkGuru] (consoleproxy-1:ctx-9ae426f7) Allocated a nic NicProfile[3-1-3f6bfca8-6c31-4d67-a2a0-d9312e19a522-10.3.4.133-null for VM[ConsoleProxy|v-1-VM]
  754. 2015-04-17 16:26:37,729 DEBUG [o.a.c.e.o.VolumeOrchestrator] (consoleproxy-1:ctx-9ae426f7) Checking if we need to prepare 1 volumes for VM[ConsoleProxy|v-1-VM]
  755. 2015-04-17 16:26:37,754 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (consoleproxy-1:ctx-9ae426f7) template 1 is already in store:1, type:Image
  756. 2015-04-17 16:26:37,764 DEBUG [o.a.c.s.d.PrimaryDataStoreImpl] (consoleproxy-1:ctx-9ae426f7) Not found (templateId:1poolId:1) in template_spool_ref, persisting it
  757. 2015-04-17 16:26:37,779 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (consoleproxy-1:ctx-9ae426f7) template 1 is already in store:1, type:Primary
  758. 2015-04-17 16:26:37,782 DEBUG [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-9ae426f7) Found template routing-1 in storage pool 1 with VMTemplateStoragePool id: 154
  759. 2015-04-17 16:26:37,794 DEBUG [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-9ae426f7) Acquire lock on VMTemplateStoragePool 154 with timeout 3600 seconds
  760. 2015-04-17 16:26:37,797 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-9ae426f7) lock is acquired for VMTemplateStoragePool 154
  761. 2015-04-17 16:26:37,810 DEBUG [o.a.c.s.m.AncientDataMotionStrategy] (consoleproxy-1:ctx-9ae426f7) copyAsync inspecting src type TEMPLATE copyAsync inspecting dest type TEMPLATE
  762. 2015-04-17 16:26:37,832 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-9ae426f7) Seq 5-1993146461: Sending { Cmd , MgmtId: 46618217624527, via: 5(cloud-host3.cgg.gov.in), Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/1/","origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.3.4.40/ibm/CloudSecondary","_role":"Image"}},"name":"routing-1","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"CloudStore-1","id":1,"poolType":"PreSetup","host":"localhost","path":"/CloudStore-1","port":0,"url":"PreSetup://localhost//CloudStore-1/?ROLE=Primary&STOREUUID=CloudStore-1"}},"name":"routing-1","hypervisorType":"XenServer"}},"executeInSequence":false,"options":{},"wait":10800}}] }
  763. 2015-04-17 16:26:37,832 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-9ae426f7) Seq 5-1993146461: Executing: { Cmd , MgmtId: 46618217624527, via: 5(cloud-host3.cgg.gov.in), Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/1/","origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.3.4.40/ibm/CloudSecondary","_role":"Image"}},"name":"routing-1","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"CloudStore-1","id":1,"poolType":"PreSetup","host":"localhost","path":"/CloudStore-1","port":0,"url":"PreSetup://localhost//CloudStore-1/?ROLE=Primary&STOREUUID=CloudStore-1"}},"name":"routing-1","hypervisorType":"XenServer"}},"executeInSequence":false,"options":{},"wait":10800}}] }
  764. 2015-04-17 16:26:37,833 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-480:ctx-5c1b21df) Seq 5-1993146461: Executing request
  765. 2015-04-17 16:26:39,996 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-480:ctx-5c1b21df) destoryVDIbyNameLabel failed due to there are 0 VDIs with name cloud-fb5929c2-3a1c-446c-86bc-6280082f9adf
  766. 2015-04-17 16:26:39,997 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-480:ctx-5c1b21df) can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  767. 2015-04-17 16:26:39,998 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-480:ctx-5c1b21df) Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  768. com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  769. at com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copy_vhd_from_secondarystorage(XenServerStorageProcessor.java:848)
  770. at com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copyTemplateToPrimaryStorage(XenServerStorageProcessor.java:918)
  771. at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:75)
  772. at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:50)
  773. at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:609)
  774. at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59)
  775. at com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:106)
  776. at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216)
  777. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  778. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  779. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  780. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  781. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  782. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  783. at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  784. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
  785. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
  786. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  787. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  788. at java.lang.Thread.run(Thread.java:744)
  789. 2015-04-17 16:26:39,999 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-480:ctx-5c1b21df) Seq 5-1993146461: Response Received:
  790. 2015-04-17 16:26:39,999 DEBUG [c.c.a.t.Request] (DirectAgent-480:ctx-5c1b21df) Seq 5-1993146461: Processing: { Ans: , MgmtId: 46618217624527, via: 5, Ver: v1, Flags: 10, [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31","wait":0}}] }
  791. 2015-04-17 16:26:39,999 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-9ae426f7) Seq 5-1993146461: Received: { Ans: , MgmtId: 46618217624527, via: 5, Ver: v1, Flags: 10, { CopyCmdAnswer } }
  792. 2015-04-17 16:26:40,023 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-9ae426f7) releasing lock for VMTemplateStoragePool 154
  793. 2015-04-17 16:26:40,024 WARN [c.c.u.d.Merovingian2] (consoleproxy-1:ctx-9ae426f7) Was unable to find lock for the key template_spool_ref154 and thread id 2071784721
  794. 2015-04-17 16:26:40,024 DEBUG [o.a.c.e.o.VolumeOrchestrator] (consoleproxy-1:ctx-9ae426f7) Unable to create Vol[1|vm=1|ROOT]:Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  795. 2015-04-17 16:26:40,024 INFO [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9ae426f7) Unable to contact resource.
  796. com.cloud.exception.StorageUnavailableException: Resource [StoragePool:1] is unreachable: Unable to create Vol[1|vm=1|ROOT]:Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  797. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.recreateVolume(VolumeOrchestrator.java:1204)
  798. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.prepare(VolumeOrchestrator.java:1256)
  799. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:963)
  800. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761)
  801. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:745)
  802. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.startProxy(ConsoleProxyManagerImpl.java:555)
  803. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.allocCapacity(ConsoleProxyManagerImpl.java:941)
  804. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:1666)
  805. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:157)
  806. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:118)
  807. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:35)
  808. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:88)
  809. at com.cloud.vm.SystemVmLoadScanner$1.runInContext(SystemVmLoadScanner.java:79)
  810. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  811. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  812. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  813. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  814. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  815. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  816. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
  817. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
  818. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
  819. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  820. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  821. at java.lang.Thread.run(Thread.java:744)
  822. 2015-04-17 16:26:40,032 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9ae426f7) Cleaning up resources for the vm VM[ConsoleProxy|v-1-VM] in Starting state
  823. 2015-04-17 16:26:40,038 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-9ae426f7) Seq 2-1843462232: Sending { Cmd , MgmtId: 46618217624527, via: 2(cloud-host1.cgg.gov.in), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"v-1-VM","wait":0}}] }
  824. 2015-04-17 16:26:40,038 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-9ae426f7) Seq 2-1843462232: Executing: { Cmd , MgmtId: 46618217624527, via: 2(cloud-host1.cgg.gov.in), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"v-1-VM","wait":0}}] }
  825. 2015-04-17 16:26:40,039 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-481:ctx-c12847b6) Seq 2-1843462232: Executing request
  826. 2015-04-17 16:26:40,119 INFO [c.c.h.x.r.CitrixResourceBase] (DirectAgent-481:ctx-c12847b6) VM does not exist on XenServer23e67e4d-e952-40f3-a646-3a4e782d2db1
  827. 2015-04-17 16:26:40,119 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-481:ctx-c12847b6) Seq 2-1843462232: Response Received:
  828. 2015-04-17 16:26:40,119 DEBUG [c.c.a.t.Request] (DirectAgent-481:ctx-c12847b6) Seq 2-1843462232: Processing: { Ans: , MgmtId: 46618217624527, via: 2, Ver: v1, Flags: 10, [{"com.cloud.agent.api.StopAnswer":{"result":true,"details":"VM does not exist","wait":0}}] }
  829. 2015-04-17 16:26:40,119 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-9ae426f7) Seq 2-1843462232: Received: { Ans: , MgmtId: 46618217624527, via: 2, Ver: v1, Flags: 10, { StopAnswer } }
  830. 2015-04-17 16:26:40,143 DEBUG [c.c.n.g.ControlNetworkGuru] (consoleproxy-1:ctx-9ae426f7) Released nic: NicProfile[2-1-null-null-null
  831. 2015-04-17 16:26:40,167 DEBUG [c.c.d.d.DataCenterIpAddressDaoImpl] (consoleproxy-1:ctx-9ae426f7) Releasing ip address for reservationId=3f6bfca8-6c31-4d67-a2a0-d9312e19a522, instance=3
  832. 2015-04-17 16:26:40,169 DEBUG [c.c.n.g.PodBasedNetworkGuru] (consoleproxy-1:ctx-9ae426f7) Released nic: NicProfile[3-1-null-null-null
  833. 2015-04-17 16:26:40,179 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9ae426f7) Successfully released network resources for the vm VM[ConsoleProxy|v-1-VM]
  834. 2015-04-17 16:26:40,180 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9ae426f7) Successfully cleanued up resources for the vm VM[ConsoleProxy|v-1-VM] in Starting state
  835. 2015-04-17 16:26:40,193 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Deploy avoids pods: null, clusters: null, hosts: [2, 4]
  836. 2015-04-17 16:26:40,195 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@4f7533d2
  837. 2015-04-17 16:26:40,195 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Trying to allocate a host and storage pools from dc:1, pod:1,cluster:null, requested cpu: 500, requested ram: 1073741824
  838. 2015-04-17 16:26:40,195 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Is ROOT volume READY (pool already allocated)?: No
  839. 2015-04-17 16:26:40,196 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-9ae426f7) Searching resources only under specified Pod: 1
  840. 2015-04-17 16:26:40,196 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-9ae426f7) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Pod: 1
  841. 2015-04-17 16:26:40,217 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Checking resources in Cluster: 1 under Pod: 1
  842. 2015-04-17 16:26:40,217 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Looking for hosts in dc: 1 pod:1 cluster:1
  843. 2015-04-17 16:26:40,225 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) FirstFitAllocator has 5 hosts to check for allocation: [Host[-4-Routing], Host[-5-Routing], Host[-2-Routing], Host[-1-Routing], Host[-3-Routing]]
  844. 2015-04-17 16:26:40,249 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Found 5 hosts for allocation after prioritization: [Host[-4-Routing], Host[-5-Routing], Host[-2-Routing], Host[-1-Routing], Host[-3-Routing]]
  845. 2015-04-17 16:26:40,249 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=1024
  846. 2015-04-17 16:26:40,249 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host name: cloud-host10.cgg.gov.in, hostId: 4 is in avoid set, skipping this and trying other available hosts
  847. 2015-04-17 16:26:40,266 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host: 5 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  848. 2015-04-17 16:26:40,266 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Checking if host: 5 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  849. 2015-04-17 16:26:40,273 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  850. 2015-04-17 16:26:40,273 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  851. 2015-04-17 16:26:40,273 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Free RAM: 130926600192 , Requested RAM: 1073741824
  852. 2015-04-17 16:26:40,273 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host has enough CPU and RAM available
  853. 2015-04-17 16:26:40,273 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 5, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  854. 2015-04-17 16:26:40,273 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 5, used: 0, reserved: 0, total: 130926600192; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  855. 2015-04-17 16:26:40,273 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Found a suitable host, adding to list: 5
  856. 2015-04-17 16:26:40,274 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host name: cloud-host1.cgg.gov.in, hostId: 2 is in avoid set, skipping this and trying other available hosts
  857. 2015-04-17 16:26:40,290 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host: 1 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  858. 2015-04-17 16:26:40,290 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  859. 2015-04-17 16:26:40,294 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  860. 2015-04-17 16:26:40,294 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  861. 2015-04-17 16:26:40,294 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Free RAM: 130926600192 , Requested RAM: 1073741824
  862. 2015-04-17 16:26:40,294 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host has enough CPU and RAM available
  863. 2015-04-17 16:26:40,294 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 1, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  864. 2015-04-17 16:26:40,294 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 1, used: 0, reserved: 0, total: 130926600192; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  865. 2015-04-17 16:26:40,294 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Found a suitable host, adding to list: 1
  866. 2015-04-17 16:26:40,307 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host: 3 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  867. 2015-04-17 16:26:40,307 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Checking if host: 3 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  868. 2015-04-17 16:26:40,318 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  869. 2015-04-17 16:26:40,318 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Free CPU: 87500 , Requested CPU: 500
  870. 2015-04-17 16:26:40,318 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Free RAM: 130389729280 , Requested RAM: 1073741824
  871. 2015-04-17 16:26:40,318 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host has enough CPU and RAM available
  872. 2015-04-17 16:26:40,318 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 3, used: 500, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  873. 2015-04-17 16:26:40,318 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 3, used: 536870912, reserved: 0, total: 130926600192; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  874. 2015-04-17 16:26:40,318 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Found a suitable host, adding to list: 3
  875. 2015-04-17 16:26:40,318 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host Allocator returning 3 suitable hosts
  876. 2015-04-17 16:26:40,323 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Checking suitable pools for volume (Id, Type): (1,ROOT)
  877. 2015-04-17 16:26:40,323 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) We need to allocate new storagepool for this volume
  878. 2015-04-17 16:26:40,323 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Calling StoragePoolAllocators to find suitable pools
  879. 2015-04-17 16:26:40,325 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (consoleproxy-1:ctx-9ae426f7) LocalStoragePoolAllocator trying to find storage pool to fit the vm
  880. 2015-04-17 16:26:40,325 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9ae426f7) ClusterScopeStoragePoolAllocator looking for storage pool
  881. 2015-04-17 16:26:40,325 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9ae426f7) Looking for pools in dc: 1 pod:1 cluster:1
  882. 2015-04-17 16:26:40,328 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9ae426f7) Found pools matching tags: [Pool[1|PreSetup]]
  883. 2015-04-17 16:26:40,331 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9ae426f7) Removing pool Pool[1|PreSetup] from avoid set, must have been inserted when searching for another disk's tag
  884. 2015-04-17 16:26:40,333 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] (consoleproxy-1:ctx-9ae426f7) Checking if storage pool is suitable, name: null ,poolId: 1
  885. 2015-04-17 16:26:40,343 DEBUG [c.c.s.StorageManagerImpl] (consoleproxy-1:ctx-9ae426f7) Checking pool 1 for storage, totalSize: 1649254858752, usedBytes: 25165824, usedPct: 1.5258905478710012E-5, disable threshold: 0.85
  886. 2015-04-17 16:26:40,354 DEBUG [c.c.s.StorageManagerImpl] (consoleproxy-1:ctx-9ae426f7) Checking pool: 1 for volume allocation [Vol[1|vm=1|ROOT]], maxSize : 1649254858752, totalAllocatedSize : 0, askingSize : 0, allocated disable threshold: 0.85
  887. 2015-04-17 16:26:40,354 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9ae426f7) ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
  888. 2015-04-17 16:26:40,354 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Trying to find a potenial host and associated storage pools from the suitable host/pool lists for this VM
  889. 2015-04-17 16:26:40,354 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Checking if host: 5 can access any suitable storage pool for volume: ROOT
  890. 2015-04-17 16:26:40,355 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Host: 5 can access pool: 1
  891. 2015-04-17 16:26:40,357 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Found a potential host id: 5 name: cloud-host3.cgg.gov.in and associated storage pools for this VM
  892. 2015-04-17 16:26:40,358 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Returning Deployment Destination: Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(5)-Storage(Volume(1|ROOT-->Pool(1))]
  893. 2015-04-17 16:26:40,358 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9ae426f7) Deployment found - P0=VM[ConsoleProxy|v-1-VM], P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(5)-Storage(Volume(1|ROOT-->Pool(1))]
  894. 2015-04-17 16:26:40,386 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) VM state transitted from :Starting to Starting with event: OperationRetryvm's original host id: null new host id: 5 host id before state transition: 2
  895. 2015-04-17 16:26:40,401 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  896. 2015-04-17 16:26:40,401 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) Hosts's actual total RAM: 130926604032 and RAM after applying overprovisioning: 130926600192
  897. 2015-04-17 16:26:40,401 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) release cpu from host: 2, old used: 500,reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  898. 2015-04-17 16:26:40,401 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) release mem from host: 2, old used: 1073741824,reserved: 0, total: 130926600192; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  899. 2015-04-17 16:26:40,426 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  900. 2015-04-17 16:26:40,426 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) We are allocating VM, increasing the used capacity of this host:5
  901. 2015-04-17 16:26:40,426 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) Current Used CPU: 0 , Free CPU:88000 ,Requested CPU: 500
  902. 2015-04-17 16:26:40,426 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) Current Used RAM: 0 , Free RAM:130926600192 ,Requested RAM: 1073741824
  903. 2015-04-17 16:26:40,427 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) CPU STATS after allocation: for host: 5, old used: 0, old reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used:500, reserved:0; requested cpu:500,alloc_from_last:false
  904. 2015-04-17 16:26:40,427 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) RAM STATS after allocation: for host: 5, old used: 0, old reserved: 0, total: 130926600192; new used: 1073741824, reserved: 0; requested mem: 1073741824,alloc_from_last:false
  905. 2015-04-17 16:26:40,434 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9ae426f7) VM is being created in podId: 1
  906. 2015-04-17 16:26:40,444 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-9ae426f7) Network id=200 is already implemented
  907. 2015-04-17 16:26:40,490 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-9ae426f7) Network id=202 is already implemented
  908. 2015-04-17 16:26:40,548 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-9ae426f7) Network id=201 is already implemented
  909. 2015-04-17 16:26:40,597 DEBUG [c.c.n.g.PodBasedNetworkGuru] (consoleproxy-1:ctx-9ae426f7) Allocated a nic NicProfile[3-1-3f6bfca8-6c31-4d67-a2a0-d9312e19a522-10.3.4.141-null for VM[ConsoleProxy|v-1-VM]
  910. 2015-04-17 16:26:40,610 DEBUG [o.a.c.e.o.VolumeOrchestrator] (consoleproxy-1:ctx-9ae426f7) Checking if we need to prepare 1 volumes for VM[ConsoleProxy|v-1-VM]
  911. 2015-04-17 16:26:40,636 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (consoleproxy-1:ctx-9ae426f7) template 1 is already in store:1, type:Image
  912. 2015-04-17 16:26:40,645 DEBUG [o.a.c.s.d.PrimaryDataStoreImpl] (consoleproxy-1:ctx-9ae426f7) Not found (templateId:1poolId:1) in template_spool_ref, persisting it
  913. 2015-04-17 16:26:40,657 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (consoleproxy-1:ctx-9ae426f7) template 1 is already in store:1, type:Primary
  914. 2015-04-17 16:26:40,659 DEBUG [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-9ae426f7) Found template routing-1 in storage pool 1 with VMTemplateStoragePool id: 155
  915. 2015-04-17 16:26:40,671 DEBUG [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-9ae426f7) Acquire lock on VMTemplateStoragePool 155 with timeout 3600 seconds
  916. 2015-04-17 16:26:40,675 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-9ae426f7) lock is acquired for VMTemplateStoragePool 155
  917. 2015-04-17 16:26:40,683 INFO [o.a.c.s.v.VolumeServiceImpl] (secstorage-1:ctx-f7031e2e) Unable to acquire lock on VMTemplateStoragePool 153
  918. 2015-04-17 16:26:40,686 ERROR [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-f7031e2e) Failed to start instance VM[SecondaryStorageVm|s-33-VM]
  919. com.cloud.utils.exception.CloudRuntimeException: Unable to acquire lock on VMTemplateStoragePool: 153
  920. at org.apache.cloudstack.storage.volume.VolumeServiceImpl.createBaseImageAsync(VolumeServiceImpl.java:460)
  921. at org.apache.cloudstack.storage.volume.VolumeServiceImpl.createVolumeFromTemplateAsync(VolumeServiceImpl.java:604)
  922. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.recreateVolume(VolumeOrchestrator.java:1192)
  923. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.prepare(VolumeOrchestrator.java:1256)
  924. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:963)
  925. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761)
  926. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:745)
  927. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.startSecStorageVm(SecondaryStorageManagerImpl.java:261)
  928. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.allocCapacity(SecondaryStorageManagerImpl.java:694)
  929. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.expandPool(SecondaryStorageManagerImpl.java:1278)
  930. at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:123)
  931. at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:50)
  932. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:111)
  933. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:35)
  934. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:88)
  935. at com.cloud.vm.SystemVmLoadScanner$1.runInContext(SystemVmLoadScanner.java:79)
  936. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  937. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  938. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  939. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  940. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  941. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  942. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
  943. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
  944. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
  945. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  946. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  947. at java.lang.Thread.run(Thread.java:744)
  948. 2015-04-17 16:26:40,688 DEBUG [o.a.c.s.m.AncientDataMotionStrategy] (consoleproxy-1:ctx-9ae426f7) copyAsync inspecting src type TEMPLATE copyAsync inspecting dest type TEMPLATE
  949. 2015-04-17 16:26:40,694 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-f7031e2e) Cleaning up resources for the vm VM[SecondaryStorageVm|s-33-VM] in Starting state
  950. 2015-04-17 16:26:40,699 DEBUG [c.c.a.t.Request] (secstorage-1:ctx-f7031e2e) Seq 3-1753874535: Sending { Cmd , MgmtId: 46618217624527, via: 3(cloud-host9.cgg.gov.in), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"s-33-VM","wait":0}}] }
  951. 2015-04-17 16:26:40,699 DEBUG [c.c.a.t.Request] (secstorage-1:ctx-f7031e2e) Seq 3-1753874535: Executing: { Cmd , MgmtId: 46618217624527, via: 3(cloud-host9.cgg.gov.in), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"s-33-VM","wait":0}}] }
  952. 2015-04-17 16:26:40,699 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-482:ctx-e29afe01) Seq 3-1753874535: Executing request
  953. 2015-04-17 16:26:40,715 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-9ae426f7) Seq 1-439550050: Sending { Cmd , MgmtId: 46618217624527, via: 1(cloud-host2.cgg.gov.in), Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/1/","origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.3.4.40/ibm/CloudSecondary","_role":"Image"}},"name":"routing-1","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"CloudStore-1","id":1,"poolType":"PreSetup","host":"localhost","path":"/CloudStore-1","port":0,"url":"PreSetup://localhost//CloudStore-1/?ROLE=Primary&STOREUUID=CloudStore-1"}},"name":"routing-1","hypervisorType":"XenServer"}},"executeInSequence":false,"options":{},"wait":10800}}] }
  954. 2015-04-17 16:26:40,715 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-9ae426f7) Seq 1-439550050: Executing: { Cmd , MgmtId: 46618217624527, via: 1(cloud-host2.cgg.gov.in), Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/1/","origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.3.4.40/ibm/CloudSecondary","_role":"Image"}},"name":"routing-1","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"CloudStore-1","id":1,"poolType":"PreSetup","host":"localhost","path":"/CloudStore-1","port":0,"url":"PreSetup://localhost//CloudStore-1/?ROLE=Primary&STOREUUID=CloudStore-1"}},"name":"routing-1","hypervisorType":"XenServer"}},"executeInSequence":false,"options":{},"wait":10800}}] }
  955. 2015-04-17 16:26:40,716 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-133:ctx-2e20e732) Seq 1-439550050: Executing request
  956. 2015-04-17 16:26:40,810 INFO [c.c.h.x.r.CitrixResourceBase] (DirectAgent-482:ctx-e29afe01) VM does not exist on XenServer1d86cc04-ef64-48d9-b00c-734c21144945
  957. 2015-04-17 16:26:40,810 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-482:ctx-e29afe01) Seq 3-1753874535: Response Received:
  958. 2015-04-17 16:26:40,810 DEBUG [c.c.a.t.Request] (DirectAgent-482:ctx-e29afe01) Seq 3-1753874535: Processing: { Ans: , MgmtId: 46618217624527, via: 3, Ver: v1, Flags: 10, [{"com.cloud.agent.api.StopAnswer":{"result":true,"details":"VM does not exist","wait":0}}] }
  959. 2015-04-17 16:26:40,810 DEBUG [c.c.a.t.Request] (secstorage-1:ctx-f7031e2e) Seq 3-1753874535: Received: { Ans: , MgmtId: 46618217624527, via: 3, Ver: v1, Flags: 10, { StopAnswer } }
  960. 2015-04-17 16:26:40,837 DEBUG [c.c.n.g.ControlNetworkGuru] (secstorage-1:ctx-f7031e2e) Released nic: NicProfile[129-33-null-null-null
  961. 2015-04-17 16:26:40,856 DEBUG [c.c.d.d.DataCenterIpAddressDaoImpl] (secstorage-1:ctx-f7031e2e) Releasing ip address for reservationId=40b537fe-2625-49fe-bdfe-55758da77455, instance=130
  962. 2015-04-17 16:26:40,857 DEBUG [c.c.n.g.PodBasedNetworkGuru] (secstorage-1:ctx-f7031e2e) Released nic: NicProfile[130-33-null-null-null
  963. 2015-04-17 16:26:40,879 DEBUG [c.c.d.d.DataCenterIpAddressDaoImpl] (secstorage-1:ctx-f7031e2e) Releasing ip address for reservationId=40b537fe-2625-49fe-bdfe-55758da77455, instance=131
  964. 2015-04-17 16:26:40,880 DEBUG [c.c.n.g.PodBasedNetworkGuru] (secstorage-1:ctx-f7031e2e) Released nic: NicProfile[131-33-null-null-null
  965. 2015-04-17 16:26:40,890 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-f7031e2e) Successfully released network resources for the vm VM[SecondaryStorageVm|s-33-VM]
  966. 2015-04-17 16:26:40,890 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-f7031e2e) Successfully cleanued up resources for the vm VM[SecondaryStorageVm|s-33-VM] in Starting state
  967. 2015-04-17 16:26:40,920 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: 3
  968. 2015-04-17 16:26:40,933 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  969. 2015-04-17 16:26:40,933 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e) Hosts's actual total RAM: 130926604032 and RAM after applying overprovisioning: 130926600192
  970. 2015-04-17 16:26:40,934 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e) release cpu from host: 3, old used: 500,reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  971. 2015-04-17 16:26:40,934 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-f7031e2e) release mem from host: 3, old used: 536870912,reserved: 0, total: 130926600192; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  972. 2015-04-17 16:26:40,943 WARN [c.c.s.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-f7031e2e) Exception while trying to start secondary storage vm
  973. com.cloud.exception.AgentUnavailableException: Resource [Host:3] is unreachable: Host 3: Unable to start instance due to Unable to acquire lock on VMTemplateStoragePool: 153
  974. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1073)
  975. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761)
  976. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:745)
  977. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.startSecStorageVm(SecondaryStorageManagerImpl.java:261)
  978. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.allocCapacity(SecondaryStorageManagerImpl.java:694)
  979. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.expandPool(SecondaryStorageManagerImpl.java:1278)
  980. at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:123)
  981. at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:50)
  982. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:111)
  983. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:35)
  984. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:88)
  985. at com.cloud.vm.SystemVmLoadScanner$1.runInContext(SystemVmLoadScanner.java:79)
  986. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  987. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  988. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  989. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  990. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  991. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  992. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
  993. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
  994. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
  995. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  996. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  997. at java.lang.Thread.run(Thread.java:744)
  998. Caused by: com.cloud.utils.exception.CloudRuntimeException: Unable to acquire lock on VMTemplateStoragePool: 153
  999. at org.apache.cloudstack.storage.volume.VolumeServiceImpl.createBaseImageAsync(VolumeServiceImpl.java:460)
  1000. at org.apache.cloudstack.storage.volume.VolumeServiceImpl.createVolumeFromTemplateAsync(VolumeServiceImpl.java:604)
  1001. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.recreateVolume(VolumeOrchestrator.java:1192)
  1002. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.prepare(VolumeOrchestrator.java:1256)
  1003. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:963)
  1004. ... 23 more
  1005. 2015-04-17 16:26:40,945 INFO [c.c.s.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-f7031e2e) Unable to start secondary storage vm for standby capacity, secStorageVm vm Id : 33, will recycle it and start a new one
  1006. 2015-04-17 16:26:40,945 INFO [c.c.s.PremiumSecondaryStorageManagerImpl] (secstorage-1:ctx-f7031e2e) Primary secondary storage is not even started, wait until next turn
  1007. 2015-04-17 16:26:42,889 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-133:ctx-2e20e732) destoryVDIbyNameLabel failed due to there are 0 VDIs with name cloud-c17f4cce-ba59-4b04-90d1-e7cf11793fc2
  1008. 2015-04-17 16:26:42,889 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-133:ctx-2e20e732) can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  1009. 2015-04-17 16:26:42,889 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-133:ctx-2e20e732) Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  1010. com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  1011. at com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copy_vhd_from_secondarystorage(XenServerStorageProcessor.java:848)
  1012. at com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copyTemplateToPrimaryStorage(XenServerStorageProcessor.java:918)
  1013. at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:75)
  1014. at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:50)
  1015. at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:609)
  1016. at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59)
  1017. at com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:106)
  1018. at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216)
  1019. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  1020. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  1021. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  1022. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  1023. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  1024. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  1025. at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  1026. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
  1027. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
  1028. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  1029. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  1030. at java.lang.Thread.run(Thread.java:744)
  1031. 2015-04-17 16:26:42,890 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-133:ctx-2e20e732) Seq 1-439550050: Response Received:
  1032. 2015-04-17 16:26:42,891 DEBUG [c.c.a.t.Request] (DirectAgent-133:ctx-2e20e732) Seq 1-439550050: Processing: { Ans: , MgmtId: 46618217624527, via: 1, Ver: v1, Flags: 10, [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31","wait":0}}] }
  1033. 2015-04-17 16:26:42,891 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-9ae426f7) Seq 1-439550050: Received: { Ans: , MgmtId: 46618217624527, via: 1, Ver: v1, Flags: 10, { CopyCmdAnswer } }
  1034. 2015-04-17 16:26:42,912 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-9ae426f7) releasing lock for VMTemplateStoragePool 155
  1035. 2015-04-17 16:26:42,913 WARN [c.c.u.d.Merovingian2] (consoleproxy-1:ctx-9ae426f7) Was unable to find lock for the key template_spool_ref155 and thread id 2071784721
  1036. 2015-04-17 16:26:42,913 DEBUG [o.a.c.e.o.VolumeOrchestrator] (consoleproxy-1:ctx-9ae426f7) Unable to create Vol[1|vm=1|ROOT]:Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  1037. 2015-04-17 16:26:42,913 INFO [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9ae426f7) Unable to contact resource.
  1038. com.cloud.exception.StorageUnavailableException: Resource [StoragePool:1] is unreachable: Unable to create Vol[1|vm=1|ROOT]:Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  1039. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.recreateVolume(VolumeOrchestrator.java:1204)
  1040. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.prepare(VolumeOrchestrator.java:1256)
  1041. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:963)
  1042. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761)
  1043. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:745)
  1044. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.startProxy(ConsoleProxyManagerImpl.java:555)
  1045. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.allocCapacity(ConsoleProxyManagerImpl.java:941)
  1046. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:1666)
  1047. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:157)
  1048. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:118)
  1049. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:35)
  1050. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:88)
  1051. at com.cloud.vm.SystemVmLoadScanner$1.runInContext(SystemVmLoadScanner.java:79)
  1052. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  1053. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  1054. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  1055. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  1056. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  1057. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  1058. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
  1059. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
  1060. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
  1061. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  1062. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  1063. at java.lang.Thread.run(Thread.java:744)
  1064. 2015-04-17 16:26:42,932 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9ae426f7) Cleaning up resources for the vm VM[ConsoleProxy|v-1-VM] in Starting state
  1065. 2015-04-17 16:26:42,937 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-9ae426f7) Seq 5-1993146462: Sending { Cmd , MgmtId: 46618217624527, via: 5(cloud-host3.cgg.gov.in), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"v-1-VM","wait":0}}] }
  1066. 2015-04-17 16:26:42,938 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-9ae426f7) Seq 5-1993146462: Executing: { Cmd , MgmtId: 46618217624527, via: 5(cloud-host3.cgg.gov.in), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"v-1-VM","wait":0}}] }
  1067. 2015-04-17 16:26:42,938 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-484:ctx-1ce85103) Seq 5-1993146462: Executing request
  1068. 2015-04-17 16:26:43,050 INFO [c.c.h.x.r.CitrixResourceBase] (DirectAgent-484:ctx-1ce85103) VM does not exist on XenServer0083e31e-13d1-4e07-96a4-3594d789e1d8
  1069. 2015-04-17 16:26:43,050 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-484:ctx-1ce85103) Seq 5-1993146462: Response Received:
  1070. 2015-04-17 16:26:43,050 DEBUG [c.c.a.t.Request] (DirectAgent-484:ctx-1ce85103) Seq 5-1993146462: Processing: { Ans: , MgmtId: 46618217624527, via: 5, Ver: v1, Flags: 10, [{"com.cloud.agent.api.StopAnswer":{"result":true,"details":"VM does not exist","wait":0}}] }
  1071. 2015-04-17 16:26:43,050 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-9ae426f7) Seq 5-1993146462: Received: { Ans: , MgmtId: 46618217624527, via: 5, Ver: v1, Flags: 10, { StopAnswer } }
  1072. 2015-04-17 16:26:43,074 DEBUG [c.c.n.g.ControlNetworkGuru] (consoleproxy-1:ctx-9ae426f7) Released nic: NicProfile[2-1-null-null-null
  1073. 2015-04-17 16:26:43,092 DEBUG [c.c.d.d.DataCenterIpAddressDaoImpl] (consoleproxy-1:ctx-9ae426f7) Releasing ip address for reservationId=3f6bfca8-6c31-4d67-a2a0-d9312e19a522, instance=3
  1074. 2015-04-17 16:26:43,093 DEBUG [c.c.n.g.PodBasedNetworkGuru] (consoleproxy-1:ctx-9ae426f7) Released nic: NicProfile[3-1-null-null-null
  1075. 2015-04-17 16:26:43,104 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9ae426f7) Successfully released network resources for the vm VM[ConsoleProxy|v-1-VM]
  1076. 2015-04-17 16:26:43,104 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9ae426f7) Successfully cleanued up resources for the vm VM[ConsoleProxy|v-1-VM] in Starting state
  1077. 2015-04-17 16:26:43,111 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Deploy avoids pods: null, clusters: null, hosts: [2, 4, 5]
  1078. 2015-04-17 16:26:43,113 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@4f7533d2
  1079. 2015-04-17 16:26:43,113 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Trying to allocate a host and storage pools from dc:1, pod:1,cluster:null, requested cpu: 500, requested ram: 1073741824
  1080. 2015-04-17 16:26:43,113 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Is ROOT volume READY (pool already allocated)?: No
  1081. 2015-04-17 16:26:43,113 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-9ae426f7) Searching resources only under specified Pod: 1
  1082. 2015-04-17 16:26:43,113 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-9ae426f7) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Pod: 1
  1083. 2015-04-17 16:26:43,131 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Checking resources in Cluster: 1 under Pod: 1
  1084. 2015-04-17 16:26:43,131 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Looking for hosts in dc: 1 pod:1 cluster:1
  1085. 2015-04-17 16:26:43,138 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) FirstFitAllocator has 5 hosts to check for allocation: [Host[-1-Routing], Host[-4-Routing], Host[-3-Routing], Host[-5-Routing], Host[-2-Routing]]
  1086. 2015-04-17 16:26:43,154 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Found 5 hosts for allocation after prioritization: [Host[-1-Routing], Host[-4-Routing], Host[-3-Routing], Host[-5-Routing], Host[-2-Routing]]
  1087. 2015-04-17 16:26:43,154 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=1024
  1088. 2015-04-17 16:26:43,168 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host: 1 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  1089. 2015-04-17 16:26:43,168 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  1090. 2015-04-17 16:26:43,174 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  1091. 2015-04-17 16:26:43,174 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  1092. 2015-04-17 16:26:43,174 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Free RAM: 130926600192 , Requested RAM: 1073741824
  1093. 2015-04-17 16:26:43,174 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host has enough CPU and RAM available
  1094. 2015-04-17 16:26:43,174 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 1, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1095. 2015-04-17 16:26:43,174 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 1, used: 0, reserved: 0, total: 130926600192; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1096. 2015-04-17 16:26:43,174 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Found a suitable host, adding to list: 1
  1097. 2015-04-17 16:26:43,174 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host name: cloud-host10.cgg.gov.in, hostId: 4 is in avoid set, skipping this and trying other available hosts
  1098. 2015-04-17 16:26:43,188 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host: 3 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  1099. 2015-04-17 16:26:43,188 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Checking if host: 3 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  1100. 2015-04-17 16:26:43,194 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  1101. 2015-04-17 16:26:43,194 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  1102. 2015-04-17 16:26:43,194 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Free RAM: 130926600192 , Requested RAM: 1073741824
  1103. 2015-04-17 16:26:43,194 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host has enough CPU and RAM available
  1104. 2015-04-17 16:26:43,194 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 3, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1105. 2015-04-17 16:26:43,194 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 3, used: 0, reserved: 0, total: 130926600192; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1106. 2015-04-17 16:26:43,194 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Found a suitable host, adding to list: 3
  1107. 2015-04-17 16:26:43,194 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host name: cloud-host3.cgg.gov.in, hostId: 5 is in avoid set, skipping this and trying other available hosts
  1108. 2015-04-17 16:26:43,194 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host name: cloud-host1.cgg.gov.in, hostId: 2 is in avoid set, skipping this and trying other available hosts
  1109. 2015-04-17 16:26:43,194 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host Allocator returning 2 suitable hosts
  1110. 2015-04-17 16:26:43,197 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Checking suitable pools for volume (Id, Type): (1,ROOT)
  1111. 2015-04-17 16:26:43,197 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) We need to allocate new storagepool for this volume
  1112. 2015-04-17 16:26:43,197 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Calling StoragePoolAllocators to find suitable pools
  1113. 2015-04-17 16:26:43,199 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (consoleproxy-1:ctx-9ae426f7) LocalStoragePoolAllocator trying to find storage pool to fit the vm
  1114. 2015-04-17 16:26:43,199 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9ae426f7) ClusterScopeStoragePoolAllocator looking for storage pool
  1115. 2015-04-17 16:26:43,199 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9ae426f7) Looking for pools in dc: 1 pod:1 cluster:1
  1116. 2015-04-17 16:26:43,205 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9ae426f7) Found pools matching tags: [Pool[1|PreSetup]]
  1117. 2015-04-17 16:26:43,208 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9ae426f7) Removing pool Pool[1|PreSetup] from avoid set, must have been inserted when searching for another disk's tag
  1118. 2015-04-17 16:26:43,210 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] (consoleproxy-1:ctx-9ae426f7) Checking if storage pool is suitable, name: null ,poolId: 1
  1119. 2015-04-17 16:26:43,219 DEBUG [c.c.s.StorageManagerImpl] (consoleproxy-1:ctx-9ae426f7) Checking pool 1 for storage, totalSize: 1649254858752, usedBytes: 25165824, usedPct: 1.5258905478710012E-5, disable threshold: 0.85
  1120. 2015-04-17 16:26:43,228 DEBUG [c.c.s.StorageManagerImpl] (consoleproxy-1:ctx-9ae426f7) Checking pool: 1 for volume allocation [Vol[1|vm=1|ROOT]], maxSize : 1649254858752, totalAllocatedSize : 0, askingSize : 0, allocated disable threshold: 0.85
  1121. 2015-04-17 16:26:43,228 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9ae426f7) ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
  1122. 2015-04-17 16:26:43,228 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Trying to find a potenial host and associated storage pools from the suitable host/pool lists for this VM
  1123. 2015-04-17 16:26:43,228 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Checking if host: 1 can access any suitable storage pool for volume: ROOT
  1124. 2015-04-17 16:26:43,229 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Host: 1 can access pool: 1
  1125. 2015-04-17 16:26:43,230 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Found a potential host id: 1 name: cloud-host2.cgg.gov.in and associated storage pools for this VM
  1126. 2015-04-17 16:26:43,232 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Returning Deployment Destination: Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(1)-Storage(Volume(1|ROOT-->Pool(1))]
  1127. 2015-04-17 16:26:43,232 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9ae426f7) Deployment found - P0=VM[ConsoleProxy|v-1-VM], P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(1)-Storage(Volume(1|ROOT-->Pool(1))]
  1128. 2015-04-17 16:26:43,256 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) VM state transitted from :Starting to Starting with event: OperationRetryvm's original host id: null new host id: 1 host id before state transition: 5
  1129. 2015-04-17 16:26:43,269 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  1130. 2015-04-17 16:26:43,269 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) Hosts's actual total RAM: 130926604032 and RAM after applying overprovisioning: 130926600192
  1131. 2015-04-17 16:26:43,269 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) release cpu from host: 5, old used: 500,reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  1132. 2015-04-17 16:26:43,269 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) release mem from host: 5, old used: 1073741824,reserved: 0, total: 130926600192; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  1133. 2015-04-17 16:26:43,294 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  1134. 2015-04-17 16:26:43,294 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) We are allocating VM, increasing the used capacity of this host:1
  1135. 2015-04-17 16:26:43,294 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) Current Used CPU: 0 , Free CPU:88000 ,Requested CPU: 500
  1136. 2015-04-17 16:26:43,294 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) Current Used RAM: 0 , Free RAM:130926600192 ,Requested RAM: 1073741824
  1137. 2015-04-17 16:26:43,294 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) CPU STATS after allocation: for host: 1, old used: 0, old reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used:500, reserved:0; requested cpu:500,alloc_from_last:false
  1138. 2015-04-17 16:26:43,294 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) RAM STATS after allocation: for host: 1, old used: 0, old reserved: 0, total: 130926600192; new used: 1073741824, reserved: 0; requested mem: 1073741824,alloc_from_last:false
  1139. 2015-04-17 16:26:43,302 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9ae426f7) VM is being created in podId: 1
  1140. 2015-04-17 16:26:43,310 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-9ae426f7) Network id=200 is already implemented
  1141. 2015-04-17 16:26:43,360 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-9ae426f7) Network id=202 is already implemented
  1142. 2015-04-17 16:26:43,418 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-9ae426f7) Network id=201 is already implemented
  1143. 2015-04-17 16:26:43,469 DEBUG [c.c.n.g.PodBasedNetworkGuru] (consoleproxy-1:ctx-9ae426f7) Allocated a nic NicProfile[3-1-3f6bfca8-6c31-4d67-a2a0-d9312e19a522-10.3.4.170-null for VM[ConsoleProxy|v-1-VM]
  1144. 2015-04-17 16:26:43,482 DEBUG [o.a.c.e.o.VolumeOrchestrator] (consoleproxy-1:ctx-9ae426f7) Checking if we need to prepare 1 volumes for VM[ConsoleProxy|v-1-VM]
  1145. 2015-04-17 16:26:43,506 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (consoleproxy-1:ctx-9ae426f7) template 1 is already in store:1, type:Image
  1146. 2015-04-17 16:26:43,515 DEBUG [o.a.c.s.d.PrimaryDataStoreImpl] (consoleproxy-1:ctx-9ae426f7) Not found (templateId:1poolId:1) in template_spool_ref, persisting it
  1147. 2015-04-17 16:26:43,528 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (consoleproxy-1:ctx-9ae426f7) template 1 is already in store:1, type:Primary
  1148. 2015-04-17 16:26:43,531 DEBUG [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-9ae426f7) Found template routing-1 in storage pool 1 with VMTemplateStoragePool id: 156
  1149. 2015-04-17 16:26:43,544 DEBUG [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-9ae426f7) Acquire lock on VMTemplateStoragePool 156 with timeout 3600 seconds
  1150. 2015-04-17 16:26:43,547 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-9ae426f7) lock is acquired for VMTemplateStoragePool 156
  1151. 2015-04-17 16:26:43,561 DEBUG [o.a.c.s.m.AncientDataMotionStrategy] (consoleproxy-1:ctx-9ae426f7) copyAsync inspecting src type TEMPLATE copyAsync inspecting dest type TEMPLATE
  1152. 2015-04-17 16:26:43,582 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-9ae426f7) Seq 3-1753874536: Sending { Cmd , MgmtId: 46618217624527, via: 3(cloud-host9.cgg.gov.in), Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/1/","origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.3.4.40/ibm/CloudSecondary","_role":"Image"}},"name":"routing-1","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"CloudStore-1","id":1,"poolType":"PreSetup","host":"localhost","path":"/CloudStore-1","port":0,"url":"PreSetup://localhost//CloudStore-1/?ROLE=Primary&STOREUUID=CloudStore-1"}},"name":"routing-1","hypervisorType":"XenServer"}},"executeInSequence":false,"options":{},"wait":10800}}] }
  1153. 2015-04-17 16:26:43,583 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-9ae426f7) Seq 3-1753874536: Executing: { Cmd , MgmtId: 46618217624527, via: 3(cloud-host9.cgg.gov.in), Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/1/","origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.3.4.40/ibm/CloudSecondary","_role":"Image"}},"name":"routing-1","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"CloudStore-1","id":1,"poolType":"PreSetup","host":"localhost","path":"/CloudStore-1","port":0,"url":"PreSetup://localhost//CloudStore-1/?ROLE=Primary&STOREUUID=CloudStore-1"}},"name":"routing-1","hypervisorType":"XenServer"}},"executeInSequence":false,"options":{},"wait":10800}}] }
  1154. 2015-04-17 16:26:43,583 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-485:ctx-c1c9774c) Seq 3-1753874536: Executing request
  1155. 2015-04-17 16:26:45,029 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-8ff0dfa0) Found 0 routers to update status.
  1156. 2015-04-17 16:26:45,033 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-8ff0dfa0) Found 0 networks to update RvR status.
  1157. 2015-04-17 16:26:45,750 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-485:ctx-c1c9774c) destoryVDIbyNameLabel failed due to there are 0 VDIs with name cloud-cced1a95-70e4-4198-8543-573334c1a395
  1158. 2015-04-17 16:26:45,751 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-485:ctx-c1c9774c) can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  1159. 2015-04-17 16:26:45,751 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-485:ctx-c1c9774c) Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  1160. com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  1161. at com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copy_vhd_from_secondarystorage(XenServerStorageProcessor.java:848)
  1162. at com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copyTemplateToPrimaryStorage(XenServerStorageProcessor.java:918)
  1163. at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:75)
  1164. at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:50)
  1165. at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:609)
  1166. at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59)
  1167. at com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:106)
  1168. at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216)
  1169. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  1170. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  1171. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  1172. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  1173. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  1174. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  1175. at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  1176. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
  1177. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
  1178. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  1179. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  1180. at java.lang.Thread.run(Thread.java:744)
  1181. 2015-04-17 16:26:45,752 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-485:ctx-c1c9774c) Seq 3-1753874536: Response Received:
  1182. 2015-04-17 16:26:45,752 DEBUG [c.c.a.t.Request] (DirectAgent-485:ctx-c1c9774c) Seq 3-1753874536: Processing: { Ans: , MgmtId: 46618217624527, via: 3, Ver: v1, Flags: 10, [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31","wait":0}}] }
  1183. 2015-04-17 16:26:45,752 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-9ae426f7) Seq 3-1753874536: Received: { Ans: , MgmtId: 46618217624527, via: 3, Ver: v1, Flags: 10, { CopyCmdAnswer } }
  1184. 2015-04-17 16:26:45,771 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-9ae426f7) releasing lock for VMTemplateStoragePool 156
  1185. 2015-04-17 16:26:45,772 WARN [c.c.u.d.Merovingian2] (consoleproxy-1:ctx-9ae426f7) Was unable to find lock for the key template_spool_ref156 and thread id 2071784721
  1186. 2015-04-17 16:26:45,772 DEBUG [o.a.c.e.o.VolumeOrchestrator] (consoleproxy-1:ctx-9ae426f7) Unable to create Vol[1|vm=1|ROOT]:Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  1187. 2015-04-17 16:26:45,772 INFO [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9ae426f7) Unable to contact resource.
  1188. com.cloud.exception.StorageUnavailableException: Resource [StoragePool:1] is unreachable: Unable to create Vol[1|vm=1|ROOT]:Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  1189. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.recreateVolume(VolumeOrchestrator.java:1204)
  1190. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.prepare(VolumeOrchestrator.java:1256)
  1191. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:963)
  1192. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761)
  1193. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:745)
  1194. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.startProxy(ConsoleProxyManagerImpl.java:555)
  1195. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.allocCapacity(ConsoleProxyManagerImpl.java:941)
  1196. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:1666)
  1197. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:157)
  1198. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:118)
  1199. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:35)
  1200. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:88)
  1201. at com.cloud.vm.SystemVmLoadScanner$1.runInContext(SystemVmLoadScanner.java:79)
  1202. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  1203. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  1204. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  1205. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  1206. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  1207. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  1208. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
  1209. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
  1210. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
  1211. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  1212. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  1213. at java.lang.Thread.run(Thread.java:744)
  1214. 2015-04-17 16:26:45,780 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9ae426f7) Cleaning up resources for the vm VM[ConsoleProxy|v-1-VM] in Starting state
  1215. 2015-04-17 16:26:45,786 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-9ae426f7) Seq 1-439550051: Sending { Cmd , MgmtId: 46618217624527, via: 1(cloud-host2.cgg.gov.in), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"v-1-VM","wait":0}}] }
  1216. 2015-04-17 16:26:45,786 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-9ae426f7) Seq 1-439550051: Executing: { Cmd , MgmtId: 46618217624527, via: 1(cloud-host2.cgg.gov.in), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"v-1-VM","wait":0}}] }
  1217. 2015-04-17 16:26:45,787 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-321:ctx-7fca1d00) Seq 1-439550051: Executing request
  1218. 2015-04-17 16:26:45,890 INFO [c.c.h.x.r.CitrixResourceBase] (DirectAgent-321:ctx-7fca1d00) VM does not exist on XenServer6b4ea60d-1501-446c-9507-86b9bd3dc8d6
  1219. 2015-04-17 16:26:45,890 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-321:ctx-7fca1d00) Seq 1-439550051: Response Received:
  1220. 2015-04-17 16:26:45,890 DEBUG [c.c.a.t.Request] (DirectAgent-321:ctx-7fca1d00) Seq 1-439550051: Processing: { Ans: , MgmtId: 46618217624527, via: 1, Ver: v1, Flags: 10, [{"com.cloud.agent.api.StopAnswer":{"result":true,"details":"VM does not exist","wait":0}}] }
  1221. 2015-04-17 16:26:45,890 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-9ae426f7) Seq 1-439550051: Received: { Ans: , MgmtId: 46618217624527, via: 1, Ver: v1, Flags: 10, { StopAnswer } }
  1222. 2015-04-17 16:26:45,913 DEBUG [c.c.n.g.ControlNetworkGuru] (consoleproxy-1:ctx-9ae426f7) Released nic: NicProfile[2-1-null-null-null
  1223. 2015-04-17 16:26:45,935 DEBUG [c.c.d.d.DataCenterIpAddressDaoImpl] (consoleproxy-1:ctx-9ae426f7) Releasing ip address for reservationId=3f6bfca8-6c31-4d67-a2a0-d9312e19a522, instance=3
  1224. 2015-04-17 16:26:45,936 DEBUG [c.c.n.g.PodBasedNetworkGuru] (consoleproxy-1:ctx-9ae426f7) Released nic: NicProfile[3-1-null-null-null
  1225. 2015-04-17 16:26:45,944 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9ae426f7) Successfully released network resources for the vm VM[ConsoleProxy|v-1-VM]
  1226. 2015-04-17 16:26:45,944 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9ae426f7) Successfully cleanued up resources for the vm VM[ConsoleProxy|v-1-VM] in Starting state
  1227. 2015-04-17 16:26:45,951 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Deploy avoids pods: null, clusters: null, hosts: [1, 2, 4, 5]
  1228. 2015-04-17 16:26:45,954 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@4f7533d2
  1229. 2015-04-17 16:26:45,954 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Trying to allocate a host and storage pools from dc:1, pod:1,cluster:null, requested cpu: 500, requested ram: 1073741824
  1230. 2015-04-17 16:26:45,954 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Is ROOT volume READY (pool already allocated)?: No
  1231. 2015-04-17 16:26:45,954 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-9ae426f7) Searching resources only under specified Pod: 1
  1232. 2015-04-17 16:26:45,954 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-9ae426f7) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Pod: 1
  1233. 2015-04-17 16:26:45,971 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Checking resources in Cluster: 1 under Pod: 1
  1234. 2015-04-17 16:26:45,971 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Looking for hosts in dc: 1 pod:1 cluster:1
  1235. 2015-04-17 16:26:45,978 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) FirstFitAllocator has 5 hosts to check for allocation: [Host[-4-Routing], Host[-1-Routing], Host[-3-Routing], Host[-2-Routing], Host[-5-Routing]]
  1236. 2015-04-17 16:26:45,992 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Found 5 hosts for allocation after prioritization: [Host[-4-Routing], Host[-1-Routing], Host[-3-Routing], Host[-2-Routing], Host[-5-Routing]]
  1237. 2015-04-17 16:26:45,992 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=1024
  1238. 2015-04-17 16:26:45,992 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host name: cloud-host10.cgg.gov.in, hostId: 4 is in avoid set, skipping this and trying other available hosts
  1239. 2015-04-17 16:26:45,993 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host name: cloud-host2.cgg.gov.in, hostId: 1 is in avoid set, skipping this and trying other available hosts
  1240. 2015-04-17 16:26:46,008 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host: 3 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  1241. 2015-04-17 16:26:46,008 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Checking if host: 3 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  1242. 2015-04-17 16:26:46,017 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  1243. 2015-04-17 16:26:46,017 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  1244. 2015-04-17 16:26:46,017 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Free RAM: 130926600192 , Requested RAM: 1073741824
  1245. 2015-04-17 16:26:46,017 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host has enough CPU and RAM available
  1246. 2015-04-17 16:26:46,017 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 3, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1247. 2015-04-17 16:26:46,017 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 3, used: 0, reserved: 0, total: 130926600192; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1248. 2015-04-17 16:26:46,017 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Found a suitable host, adding to list: 3
  1249. 2015-04-17 16:26:46,017 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host name: cloud-host1.cgg.gov.in, hostId: 2 is in avoid set, skipping this and trying other available hosts
  1250. 2015-04-17 16:26:46,017 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host name: cloud-host3.cgg.gov.in, hostId: 5 is in avoid set, skipping this and trying other available hosts
  1251. 2015-04-17 16:26:46,017 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host Allocator returning 1 suitable hosts
  1252. 2015-04-17 16:26:46,020 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Checking suitable pools for volume (Id, Type): (1,ROOT)
  1253. 2015-04-17 16:26:46,020 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) We need to allocate new storagepool for this volume
  1254. 2015-04-17 16:26:46,020 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Calling StoragePoolAllocators to find suitable pools
  1255. 2015-04-17 16:26:46,023 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (consoleproxy-1:ctx-9ae426f7) LocalStoragePoolAllocator trying to find storage pool to fit the vm
  1256. 2015-04-17 16:26:46,023 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9ae426f7) ClusterScopeStoragePoolAllocator looking for storage pool
  1257. 2015-04-17 16:26:46,023 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9ae426f7) Looking for pools in dc: 1 pod:1 cluster:1
  1258. 2015-04-17 16:26:46,026 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9ae426f7) Found pools matching tags: [Pool[1|PreSetup]]
  1259. 2015-04-17 16:26:46,028 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9ae426f7) Removing pool Pool[1|PreSetup] from avoid set, must have been inserted when searching for another disk's tag
  1260. 2015-04-17 16:26:46,031 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] (consoleproxy-1:ctx-9ae426f7) Checking if storage pool is suitable, name: null ,poolId: 1
  1261. 2015-04-17 16:26:46,039 DEBUG [c.c.s.StorageManagerImpl] (consoleproxy-1:ctx-9ae426f7) Checking pool 1 for storage, totalSize: 1649254858752, usedBytes: 25165824, usedPct: 1.5258905478710012E-5, disable threshold: 0.85
  1262. 2015-04-17 16:26:46,048 DEBUG [c.c.s.StorageManagerImpl] (consoleproxy-1:ctx-9ae426f7) Checking pool: 1 for volume allocation [Vol[1|vm=1|ROOT]], maxSize : 1649254858752, totalAllocatedSize : 0, askingSize : 0, allocated disable threshold: 0.85
  1263. 2015-04-17 16:26:46,048 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9ae426f7) ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
  1264. 2015-04-17 16:26:46,048 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Trying to find a potenial host and associated storage pools from the suitable host/pool lists for this VM
  1265. 2015-04-17 16:26:46,048 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Checking if host: 3 can access any suitable storage pool for volume: ROOT
  1266. 2015-04-17 16:26:46,049 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Host: 3 can access pool: 1
  1267. 2015-04-17 16:26:46,051 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Found a potential host id: 3 name: cloud-host9.cgg.gov.in and associated storage pools for this VM
  1268. 2015-04-17 16:26:46,052 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Returning Deployment Destination: Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(3)-Storage(Volume(1|ROOT-->Pool(1))]
  1269. 2015-04-17 16:26:46,052 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9ae426f7) Deployment found - P0=VM[ConsoleProxy|v-1-VM], P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(3)-Storage(Volume(1|ROOT-->Pool(1))]
  1270. 2015-04-17 16:26:46,073 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) VM state transitted from :Starting to Starting with event: OperationRetryvm's original host id: null new host id: 3 host id before state transition: 1
  1271. 2015-04-17 16:26:46,086 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  1272. 2015-04-17 16:26:46,086 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) Hosts's actual total RAM: 130926604032 and RAM after applying overprovisioning: 130926600192
  1273. 2015-04-17 16:26:46,086 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) release cpu from host: 1, old used: 500,reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  1274. 2015-04-17 16:26:46,086 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) release mem from host: 1, old used: 1073741824,reserved: 0, total: 130926600192; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  1275. 2015-04-17 16:26:46,109 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  1276. 2015-04-17 16:26:46,109 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) We are allocating VM, increasing the used capacity of this host:3
  1277. 2015-04-17 16:26:46,109 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) Current Used CPU: 0 , Free CPU:88000 ,Requested CPU: 500
  1278. 2015-04-17 16:26:46,109 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) Current Used RAM: 0 , Free RAM:130926600192 ,Requested RAM: 1073741824
  1279. 2015-04-17 16:26:46,109 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) CPU STATS after allocation: for host: 3, old used: 0, old reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used:500, reserved:0; requested cpu:500,alloc_from_last:false
  1280. 2015-04-17 16:26:46,109 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) RAM STATS after allocation: for host: 3, old used: 0, old reserved: 0, total: 130926600192; new used: 1073741824, reserved: 0; requested mem: 1073741824,alloc_from_last:false
  1281. 2015-04-17 16:26:46,116 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9ae426f7) VM is being created in podId: 1
  1282. 2015-04-17 16:26:46,126 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-9ae426f7) Network id=200 is already implemented
  1283. 2015-04-17 16:26:46,173 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-9ae426f7) Network id=202 is already implemented
  1284. 2015-04-17 16:26:46,233 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-9ae426f7) Network id=201 is already implemented
  1285. 2015-04-17 16:26:46,279 DEBUG [c.c.n.g.PodBasedNetworkGuru] (consoleproxy-1:ctx-9ae426f7) Allocated a nic NicProfile[3-1-3f6bfca8-6c31-4d67-a2a0-d9312e19a522-10.3.4.105-null for VM[ConsoleProxy|v-1-VM]
  1286. 2015-04-17 16:26:46,291 DEBUG [o.a.c.e.o.VolumeOrchestrator] (consoleproxy-1:ctx-9ae426f7) Checking if we need to prepare 1 volumes for VM[ConsoleProxy|v-1-VM]
  1287. 2015-04-17 16:26:46,319 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (consoleproxy-1:ctx-9ae426f7) template 1 is already in store:1, type:Image
  1288. 2015-04-17 16:26:46,332 DEBUG [o.a.c.s.d.PrimaryDataStoreImpl] (consoleproxy-1:ctx-9ae426f7) Not found (templateId:1poolId:1) in template_spool_ref, persisting it
  1289. 2015-04-17 16:26:46,344 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (consoleproxy-1:ctx-9ae426f7) template 1 is already in store:1, type:Primary
  1290. 2015-04-17 16:26:46,347 DEBUG [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-9ae426f7) Found template routing-1 in storage pool 1 with VMTemplateStoragePool id: 157
  1291. 2015-04-17 16:26:46,358 DEBUG [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-9ae426f7) Acquire lock on VMTemplateStoragePool 157 with timeout 3600 seconds
  1292. 2015-04-17 16:26:46,363 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-9ae426f7) lock is acquired for VMTemplateStoragePool 157
  1293. 2015-04-17 16:26:46,375 DEBUG [o.a.c.s.m.AncientDataMotionStrategy] (consoleproxy-1:ctx-9ae426f7) copyAsync inspecting src type TEMPLATE copyAsync inspecting dest type TEMPLATE
  1294. 2015-04-17 16:26:46,395 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-9ae426f7) Seq 4-283115611: Sending { Cmd , MgmtId: 46618217624527, via: 4(cloud-host10.cgg.gov.in), Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/1/","origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.3.4.40/ibm/CloudSecondary","_role":"Image"}},"name":"routing-1","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"CloudStore-1","id":1,"poolType":"PreSetup","host":"localhost","path":"/CloudStore-1","port":0,"url":"PreSetup://localhost//CloudStore-1/?ROLE=Primary&STOREUUID=CloudStore-1"}},"name":"routing-1","hypervisorType":"XenServer"}},"executeInSequence":false,"options":{},"wait":10800}}] }
  1295. 2015-04-17 16:26:46,396 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-9ae426f7) Seq 4-283115611: Executing: { Cmd , MgmtId: 46618217624527, via: 4(cloud-host10.cgg.gov.in), Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/1/","origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.3.4.40/ibm/CloudSecondary","_role":"Image"}},"name":"routing-1","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"CloudStore-1","id":1,"poolType":"PreSetup","host":"localhost","path":"/CloudStore-1","port":0,"url":"PreSetup://localhost//CloudStore-1/?ROLE=Primary&STOREUUID=CloudStore-1"}},"name":"routing-1","hypervisorType":"XenServer"}},"executeInSequence":false,"options":{},"wait":10800}}] }
  1296. 2015-04-17 16:26:46,397 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-487:ctx-52fb845e) Seq 4-283115611: Executing request
  1297. 2015-04-17 16:26:46,865 DEBUG [c.c.a.t.Request] (AgentManager-Handler-7:null) Seq 4-551616536: Executing: { Cmd , MgmtId: 50788518005399, via: 4, Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"s-33-VM","wait":0}}] }
  1298. 2015-04-17 16:26:46,866 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-488:ctx-2407bdcb) Seq 4-551616536: Executing request
  1299. 2015-04-17 16:26:46,973 INFO [c.c.h.x.r.CitrixResourceBase] (DirectAgent-488:ctx-2407bdcb) VM does not exist on XenServer34da61e1-04e7-40e2-b8f4-40c0157dca28
  1300. 2015-04-17 16:26:46,973 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-488:ctx-2407bdcb) Seq 4-551616536: Response Received:
  1301. 2015-04-17 16:26:46,974 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-488:ctx-2407bdcb) Seq 4-551616536: MgmtId 50788518005399: Resp: Routing to peer
  1302. 2015-04-17 16:26:48,552 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-487:ctx-52fb845e) destoryVDIbyNameLabel failed due to there are 0 VDIs with name cloud-e1398a47-8e4b-4395-b955-4f81c9c1cc5c
  1303. 2015-04-17 16:26:48,552 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-487:ctx-52fb845e) can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  1304. 2015-04-17 16:26:48,552 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-487:ctx-52fb845e) Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  1305. com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  1306. at com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copy_vhd_from_secondarystorage(XenServerStorageProcessor.java:848)
  1307. at com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copyTemplateToPrimaryStorage(XenServerStorageProcessor.java:918)
  1308. at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:75)
  1309. at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:50)
  1310. at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:609)
  1311. at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59)
  1312. at com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:106)
  1313. at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216)
  1314. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  1315. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  1316. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  1317. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  1318. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  1319. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  1320. at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  1321. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
  1322. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
  1323. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  1324. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  1325. at java.lang.Thread.run(Thread.java:744)
  1326. 2015-04-17 16:26:48,553 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-487:ctx-52fb845e) Seq 4-283115611: Response Received:
  1327. 2015-04-17 16:26:48,553 DEBUG [c.c.a.t.Request] (DirectAgent-487:ctx-52fb845e) Seq 4-283115611: Processing: { Ans: , MgmtId: 46618217624527, via: 4, Ver: v1, Flags: 10, [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31","wait":0}}] }
  1328. 2015-04-17 16:26:48,554 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-9ae426f7) Seq 4-283115611: Received: { Ans: , MgmtId: 46618217624527, via: 4, Ver: v1, Flags: 10, { CopyCmdAnswer } }
  1329. 2015-04-17 16:26:48,572 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-9ae426f7) releasing lock for VMTemplateStoragePool 157
  1330. 2015-04-17 16:26:48,573 WARN [c.c.u.d.Merovingian2] (consoleproxy-1:ctx-9ae426f7) Was unable to find lock for the key template_spool_ref157 and thread id 2071784721
  1331. 2015-04-17 16:26:48,573 DEBUG [o.a.c.e.o.VolumeOrchestrator] (consoleproxy-1:ctx-9ae426f7) Unable to create Vol[1|vm=1|ROOT]:Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  1332. 2015-04-17 16:26:48,573 INFO [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9ae426f7) Unable to contact resource.
  1333. com.cloud.exception.StorageUnavailableException: Resource [StoragePool:1] is unreachable: Unable to create Vol[1|vm=1|ROOT]:Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  1334. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.recreateVolume(VolumeOrchestrator.java:1204)
  1335. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.prepare(VolumeOrchestrator.java:1256)
  1336. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:963)
  1337. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761)
  1338. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:745)
  1339. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.startProxy(ConsoleProxyManagerImpl.java:555)
  1340. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.allocCapacity(ConsoleProxyManagerImpl.java:941)
  1341. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:1666)
  1342. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:157)
  1343. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:118)
  1344. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:35)
  1345. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:88)
  1346. at com.cloud.vm.SystemVmLoadScanner$1.runInContext(SystemVmLoadScanner.java:79)
  1347. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  1348. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  1349. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  1350. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  1351. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  1352. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  1353. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
  1354. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
  1355. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
  1356. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  1357. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  1358. at java.lang.Thread.run(Thread.java:744)
  1359. 2015-04-17 16:26:48,582 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9ae426f7) Cleaning up resources for the vm VM[ConsoleProxy|v-1-VM] in Starting state
  1360. 2015-04-17 16:26:48,588 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-9ae426f7) Seq 3-1753874537: Sending { Cmd , MgmtId: 46618217624527, via: 3(cloud-host9.cgg.gov.in), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"v-1-VM","wait":0}}] }
  1361. 2015-04-17 16:26:48,588 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-9ae426f7) Seq 3-1753874537: Executing: { Cmd , MgmtId: 46618217624527, via: 3(cloud-host9.cgg.gov.in), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"v-1-VM","wait":0}}] }
  1362. 2015-04-17 16:26:48,588 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-489:ctx-87fc6062) Seq 3-1753874537: Executing request
  1363. 2015-04-17 16:26:48,696 INFO [c.c.h.x.r.CitrixResourceBase] (DirectAgent-489:ctx-87fc6062) VM does not exist on XenServer1d86cc04-ef64-48d9-b00c-734c21144945
  1364. 2015-04-17 16:26:48,696 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-489:ctx-87fc6062) Seq 3-1753874537: Response Received:
  1365. 2015-04-17 16:26:48,696 DEBUG [c.c.a.t.Request] (DirectAgent-489:ctx-87fc6062) Seq 3-1753874537: Processing: { Ans: , MgmtId: 46618217624527, via: 3, Ver: v1, Flags: 10, [{"com.cloud.agent.api.StopAnswer":{"result":true,"details":"VM does not exist","wait":0}}] }
  1366. 2015-04-17 16:26:48,696 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-9ae426f7) Seq 3-1753874537: Received: { Ans: , MgmtId: 46618217624527, via: 3, Ver: v1, Flags: 10, { StopAnswer } }
  1367. 2015-04-17 16:26:48,718 DEBUG [c.c.n.g.ControlNetworkGuru] (consoleproxy-1:ctx-9ae426f7) Released nic: NicProfile[2-1-null-null-null
  1368. 2015-04-17 16:26:48,737 DEBUG [c.c.d.d.DataCenterIpAddressDaoImpl] (consoleproxy-1:ctx-9ae426f7) Releasing ip address for reservationId=3f6bfca8-6c31-4d67-a2a0-d9312e19a522, instance=3
  1369. 2015-04-17 16:26:48,738 DEBUG [c.c.n.g.PodBasedNetworkGuru] (consoleproxy-1:ctx-9ae426f7) Released nic: NicProfile[3-1-null-null-null
  1370. 2015-04-17 16:26:48,746 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9ae426f7) Successfully released network resources for the vm VM[ConsoleProxy|v-1-VM]
  1371. 2015-04-17 16:26:48,747 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9ae426f7) Successfully cleanued up resources for the vm VM[ConsoleProxy|v-1-VM] in Starting state
  1372. 2015-04-17 16:26:48,754 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Deploy avoids pods: null, clusters: null, hosts: [1, 2, 3, 4, 5]
  1373. 2015-04-17 16:26:48,756 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@4f7533d2
  1374. 2015-04-17 16:26:48,756 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Trying to allocate a host and storage pools from dc:1, pod:1,cluster:null, requested cpu: 500, requested ram: 1073741824
  1375. 2015-04-17 16:26:48,756 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Is ROOT volume READY (pool already allocated)?: No
  1376. 2015-04-17 16:26:48,756 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-9ae426f7) Searching resources only under specified Pod: 1
  1377. 2015-04-17 16:26:48,756 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-9ae426f7) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Pod: 1
  1378. 2015-04-17 16:26:48,773 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Checking resources in Cluster: 1 under Pod: 1
  1379. 2015-04-17 16:26:48,773 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Looking for hosts in dc: 1 pod:1 cluster:1
  1380. 2015-04-17 16:26:48,781 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) FirstFitAllocator has 5 hosts to check for allocation: [Host[-4-Routing], Host[-5-Routing], Host[-3-Routing], Host[-2-Routing], Host[-1-Routing]]
  1381. 2015-04-17 16:26:48,797 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Found 5 hosts for allocation after prioritization: [Host[-4-Routing], Host[-5-Routing], Host[-3-Routing], Host[-2-Routing], Host[-1-Routing]]
  1382. 2015-04-17 16:26:48,797 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=1024
  1383. 2015-04-17 16:26:48,797 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host name: cloud-host10.cgg.gov.in, hostId: 4 is in avoid set, skipping this and trying other available hosts
  1384. 2015-04-17 16:26:48,797 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host name: cloud-host3.cgg.gov.in, hostId: 5 is in avoid set, skipping this and trying other available hosts
  1385. 2015-04-17 16:26:48,797 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host name: cloud-host9.cgg.gov.in, hostId: 3 is in avoid set, skipping this and trying other available hosts
  1386. 2015-04-17 16:26:48,797 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host name: cloud-host1.cgg.gov.in, hostId: 2 is in avoid set, skipping this and trying other available hosts
  1387. 2015-04-17 16:26:48,797 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host name: cloud-host2.cgg.gov.in, hostId: 1 is in avoid set, skipping this and trying other available hosts
  1388. 2015-04-17 16:26:48,797 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9ae426f7 FirstFitRoutingAllocator) Host Allocator returning 0 suitable hosts
  1389. 2015-04-17 16:26:48,797 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) No suitable hosts found
  1390. 2015-04-17 16:26:48,797 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) No suitable hosts found under this Cluster: 1
  1391. 2015-04-17 16:26:48,800 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9ae426f7) Could not find suitable Deployment Destination for this VM under any clusters, returning.
  1392. 2015-04-17 16:26:48,801 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-9ae426f7) Searching resources only under specified Pod: 1
  1393. 2015-04-17 16:26:48,801 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-9ae426f7) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Pod: 1
  1394. 2015-04-17 16:26:48,809 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-9ae426f7) Removing from the clusterId list these clusters from avoid set: [1]
  1395. 2015-04-17 16:26:48,809 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-9ae426f7) No clusters found after removing disabled clusters and clusters in avoid list, returning.
  1396. 2015-04-17 16:26:48,829 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: 3
  1397. 2015-04-17 16:26:48,844 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  1398. 2015-04-17 16:26:48,844 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) Hosts's actual total RAM: 130926604032 and RAM after applying overprovisioning: 130926600192
  1399. 2015-04-17 16:26:48,844 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) release cpu from host: 3, old used: 500,reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  1400. 2015-04-17 16:26:48,844 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9ae426f7) release mem from host: 3, old used: 1073741824,reserved: 0, total: 130926600192; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  1401. 2015-04-17 16:26:48,853 WARN [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-9ae426f7) Exception while trying to start console proxy
  1402. com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-1-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  1403. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:922)
  1404. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761)
  1405. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:745)
  1406. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.startProxy(ConsoleProxyManagerImpl.java:555)
  1407. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.allocCapacity(ConsoleProxyManagerImpl.java:941)
  1408. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:1666)
  1409. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:157)
  1410. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:118)
  1411. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:35)
  1412. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:88)
  1413. at com.cloud.vm.SystemVmLoadScanner$1.runInContext(SystemVmLoadScanner.java:79)
  1414. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  1415. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  1416. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  1417. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  1418. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  1419. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  1420. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
  1421. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
  1422. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
  1423. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  1424. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  1425. at java.lang.Thread.run(Thread.java:744)
Advertisement
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!