Advertisement
Guest User

cloudstack-management-log

a guest
Nov 27th, 2014
281
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 394.33 KB | None | 0 0
  1. ===START=== 10.3.4.7 -- GET apiKey=BJ3Ma7AbVQYFU3zZASKULq8JQd9SaGGKIqiA01_ryevqnyaVkNoawmRORwqHBCBs-O4rDMd03BNKcGZd7lj7jg&command=listConfigurations&name=default.page.size&response=json&signature=xMOA0z46ZSJhwIOZ/GLVd1IlyjE%3D
  2. 2014-11-26 23:57:49,161 DEBUG [c.c.a.ApiServer] (catalina-exec-25:ctx-158f8382 ctx-b96daffa) apiKey does not map to a valid user -- ignoring request, apiKey: BJ3Ma7AbVQYFU3zZASKULq8JQd9SaGGKIqiA01_ryevqnyaVkNoawmRORwqHBCBs-O4rDMd03BNKcGZd7lj7jg
  3. 2014-11-26 23:57:49,162 DEBUG [c.c.a.ApiServlet] (catalina-exec-25:ctx-158f8382 ctx-b96daffa) ===END=== 10.3.4.7 -- GET apiKey=BJ3Ma7AbVQYFU3zZASKULq8JQd9SaGGKIqiA01_ryevqnyaVkNoawmRORwqHBCBs-O4rDMd03BNKcGZd7lj7jg&command=listConfigurations&name=default.page.size&response=json&signature=xMOA0z46ZSJhwIOZ/GLVd1IlyjE%3D
  4. 2014-11-26 23:57:49,162 DEBUG [c.c.a.ApiServer] (catalina-exec-9:ctx-e28adc04 ctx-97fd9e18) apiKey does not map to a valid user -- ignoring request, apiKey: BJ3Ma7AbVQYFU3zZASKULq8JQd9SaGGKIqiA01_ryevqnyaVkNoawmRORwqHBCBs-O4rDMd03BNKcGZd7lj7jg
  5. 2014-11-26 23:57:49,163 DEBUG [c.c.a.ApiServlet] (catalina-exec-9:ctx-e28adc04 ctx-97fd9e18) ===END=== 10.3.4.7 -- GET apiKey=BJ3Ma7AbVQYFU3zZASKULq8JQd9SaGGKIqiA01_ryevqnyaVkNoawmRORwqHBCBs-O4rDMd03BNKcGZd7lj7jg&command=listConfigurations&name=default.page.size&response=json&signature=xMOA0z46ZSJhwIOZ/GLVd1IlyjE%3D
  6. 2014-11-26 23:57:50,787 DEBUG [c.c.a.t.Request] (AgentManager-Handler-12:null) Seq 2-2114716024: Processing: { Ans: , MgmtId: 226850023912365, via: 2, Ver: v1, Flags: 10, [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 3e1f2113-438a-05e7-1b46-4c9b14d56144","wait":0}}] }
  7. 2014-11-26 23:57:50,788 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-eaef1096) Seq 2-2114716024: Received: { Ans: , MgmtId: 226850023912365, via: 2, Ver: v1, Flags: 10, { CopyCmdAnswer } }
  8. 2014-11-26 23:57:50,811 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-eaef1096) releasing lock for VMTemplateStoragePool 659
  9. 2014-11-26 23:57:50,811 WARN [c.c.u.d.Merovingian2] (consoleproxy-1:ctx-eaef1096) Was unable to find lock for the key template_spool_ref659 and thread id 1994469474
  10. 2014-11-26 23:57:50,812 DEBUG [o.a.c.e.o.VolumeOrchestrator] (consoleproxy-1:ctx-eaef1096) Unable to create Vol[1|vm=1|ROOT]:Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 3e1f2113-438a-05e7-1b46-4c9b14d56144
  11. 2014-11-26 23:57:50,812 INFO [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-eaef1096) Unable to contact resource.
  12. com.cloud.exception.StorageUnavailableException: Resource [StoragePool:2] is unreachable: Unable to create Vol[1|vm=1|ROOT]:Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 3e1f2113-438a-05e7-1b46-4c9b14d56144
  13. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.recreateVolume(VolumeOrchestrator.java:1202)
  14. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.prepare(VolumeOrchestrator.java:1254)
  15. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:962)
  16. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761)
  17. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:745)
  18. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.startProxy(ConsoleProxyManagerImpl.java:555)
  19. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.allocCapacity(ConsoleProxyManagerImpl.java:941)
  20. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:1666)
  21. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:157)
  22. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:118)
  23. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:35)
  24. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:88)
  25. at com.cloud.vm.SystemVmLoadScanner$1.runInContext(SystemVmLoadScanner.java:79)
  26. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  27. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  28. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  29. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  30. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  31. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  32. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
  33. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
  34. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
  35. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  36. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  37. at java.lang.Thread.run(Thread.java:744)
  38. 2014-11-26 23:57:50,820 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-eaef1096) Cleaning up resources for the vm VM[ConsoleProxy|v-1-VM] in Starting state
  39. 2014-11-26 23:57:50,830 DEBUG [c.c.a.m.ClusteredAgentAttache] (consoleproxy-1:ctx-eaef1096) Seq 3-1990132096: Forwarding Seq 3-1990132096: { Cmd , MgmtId: 226850023912365, via: 3(cloud-host8.cgg.gov.in), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"v-1-VM","wait":0}}] } to 68995168937102
  40. 2014-11-26 23:57:50,909 DEBUG [c.c.a.t.Request] (AgentManager-Handler-13:null) Seq 3-1990132096: Processing: { Ans: , MgmtId: 226850023912365, via: 3, Ver: v1, Flags: 10, [{"com.cloud.agent.api.StopAnswer":{"result":true,"details":"VM does not exist","wait":0}}] }
  41. 2014-11-26 23:57:50,909 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-eaef1096) Seq 3-1990132096: Received: { Ans: , MgmtId: 226850023912365, via: 3, Ver: v1, Flags: 10, { StopAnswer } }
  42. 2014-11-26 23:57:50,935 DEBUG [c.c.n.g.ControlNetworkGuru] (consoleproxy-1:ctx-eaef1096) Released nic: NicProfile[2-1-null-null-null
  43. 2014-11-26 23:57:50,956 DEBUG [c.c.d.d.DataCenterIpAddressDaoImpl] (consoleproxy-1:ctx-eaef1096) Releasing ip address for reservationId=fdb32e4f-3c58-4819-92a7-f6b17b3af5d9, instance=3
  44. 2014-11-26 23:57:50,957 DEBUG [c.c.n.g.PodBasedNetworkGuru] (consoleproxy-1:ctx-eaef1096) Released nic: NicProfile[3-1-null-null-null
  45. 2014-11-26 23:57:50,965 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-eaef1096) Successfully released network resources for the vm VM[ConsoleProxy|v-1-VM]
  46. 2014-11-26 23:57:50,965 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-eaef1096) Successfully cleanued up resources for the vm VM[ConsoleProxy|v-1-VM] in Starting state
  47. 2014-11-26 23:57:50,974 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-eaef1096) Deploy avoids pods: null, clusters: null, hosts: [1, 3, 4, 5]
  48. 2014-11-26 23:57:50,977 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-eaef1096) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@1ca8cb54
  49. 2014-11-26 23:57:50,977 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-eaef1096) Trying to allocate a host and storage pools from dc:1, pod:1,cluster:null, requested cpu: 500, requested ram: 1073741824
  50. 2014-11-26 23:57:50,977 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-eaef1096) Is ROOT volume READY (pool already allocated)?: No
  51. 2014-11-26 23:57:50,977 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-eaef1096) Searching resources only under specified Pod: 1
  52. 2014-11-26 23:57:50,977 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-eaef1096) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Pod: 1
  53. 2014-11-26 23:57:51,000 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-eaef1096) Checking resources in Cluster: 1 under Pod: 1
  54. 2014-11-26 23:57:51,000 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-eaef1096 FirstFitRoutingAllocator) Looking for hosts in dc: 1 pod:1 cluster:1
  55. 2014-11-26 23:57:51,010 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-eaef1096 FirstFitRoutingAllocator) FirstFitAllocator has 5 hosts to check for allocation: [Host[-3-Routing], Host[-4-Routing], Host[-1-Routing], Host[-2-Routing], Host[-5-Routing]]
  56. 2014-11-26 23:57:51,031 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-eaef1096 FirstFitRoutingAllocator) Found 5 hosts for allocation after prioritization: [Host[-3-Routing], Host[-4-Routing], Host[-1-Routing], Host[-2-Routing], Host[-5-Routing]]
  57. 2014-11-26 23:57:51,031 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-eaef1096 FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=1024
  58. 2014-11-26 23:57:51,031 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-eaef1096 FirstFitRoutingAllocator) Host name: cloud-host8.cgg.gov.in, hostId: 3 is in avoid set, skipping this and trying other available hosts
  59. 2014-11-26 23:57:51,031 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-eaef1096 FirstFitRoutingAllocator) Host name: cloud-host9.cgg.gov.in, hostId: 4 is in avoid set, skipping this and trying other available hosts
  60. 2014-11-26 23:57:51,031 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-eaef1096 FirstFitRoutingAllocator) Host name: cloud-host6.cgg.gov.in, hostId: 1 is in avoid set, skipping this and trying other available hosts
  61. 2014-11-26 23:57:51,048 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-eaef1096 FirstFitRoutingAllocator) Host: 2 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  62. 2014-11-26 23:57:51,048 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-eaef1096 FirstFitRoutingAllocator) Checking if host: 2 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  63. 2014-11-26 23:57:51,055 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-eaef1096 FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  64. 2014-11-26 23:57:51,055 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-eaef1096 FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  65. 2014-11-26 23:57:51,055 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-eaef1096 FirstFitRoutingAllocator) Free RAM: 132226129920 , Requested RAM: 1073741824
  66. 2014-11-26 23:57:51,055 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-eaef1096 FirstFitRoutingAllocator) Host has enough CPU and RAM available
  67. 2014-11-26 23:57:51,055 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-eaef1096 FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 2, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  68. 2014-11-26 23:57:51,055 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-eaef1096 FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 2, used: 0, reserved: 0, total: 132226129920; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  69. 2014-11-26 23:57:51,055 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-eaef1096 FirstFitRoutingAllocator) Found a suitable host, adding to list: 2
  70. 2014-11-26 23:57:51,055 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-eaef1096 FirstFitRoutingAllocator) Host name: cloud-host7.cgg.gov.in, hostId: 5 is in avoid set, skipping this and trying other available hosts
  71. 2014-11-26 23:57:51,055 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-eaef1096 FirstFitRoutingAllocator) Host Allocator returning 1 suitable hosts
  72. 2014-11-26 23:57:51,059 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-eaef1096) Checking suitable pools for volume (Id, Type): (1,ROOT)
  73. 2014-11-26 23:57:51,059 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-eaef1096) We need to allocate new storagepool for this volume
  74. 2014-11-26 23:57:51,059 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-eaef1096) Calling StoragePoolAllocators to find suitable pools
  75. 2014-11-26 23:57:51,062 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (consoleproxy-1:ctx-eaef1096) LocalStoragePoolAllocator trying to find storage pool to fit the vm
  76. 2014-11-26 23:57:51,062 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-eaef1096) ClusterScopeStoragePoolAllocator looking for storage pool
  77. 2014-11-26 23:57:51,062 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-eaef1096) Looking for pools in dc: 1 pod:1 cluster:1
  78. 2014-11-26 23:57:51,066 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-eaef1096) Found pools matching tags: [Pool[2|PreSetup]]
  79. 2014-11-26 23:57:51,069 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-eaef1096) Removing pool Pool[2|PreSetup] from avoid set, must have been inserted when searching for another disk's tag
  80. 2014-11-26 23:57:51,072 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] (consoleproxy-1:ctx-eaef1096) Checking if storage pool is suitable, name: null ,poolId: 2
  81. 2014-11-26 23:57:51,082 DEBUG [c.c.s.StorageManagerImpl] (consoleproxy-1:ctx-eaef1096) Checking pool 2 for storage, totalSize: 1649254858752, usedBytes: 297795584, usedPct: 1.8056371483140182E-4, disable threshold: 0.85
  82. 2014-11-26 23:57:51,091 DEBUG [c.c.s.StorageManagerImpl] (consoleproxy-1:ctx-eaef1096) Checking pool: 2 for volume allocation [Vol[1|vm=1|ROOT]], maxSize : 1649254858752, totalAllocatedSize : 0, askingSize : 0, allocated disable threshold: 0.85
  83. 2014-11-26 23:57:51,091 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-eaef1096) ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
  84. 2014-11-26 23:57:51,091 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-eaef1096) Trying to find a potenial host and associated storage pools from the suitable host/pool lists for this VM
  85. 2014-11-26 23:57:51,092 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-eaef1096) Checking if host: 2 can access any suitable storage pool for volume: ROOT
  86. 2014-11-26 23:57:51,093 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-eaef1096) Host: 2 can access pool: 2
  87. 2014-11-26 23:57:51,094 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-eaef1096) Found a potential host id: 2 name: cloud-host10.cgg.gov.in and associated storage pools for this VM
  88. 2014-11-26 23:57:51,096 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-eaef1096) Returning Deployment Destination: Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(2)-Storage(Volume(1|ROOT-->Pool(2))]
  89. 2014-11-26 23:57:51,096 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-eaef1096) Deployment found - P0=VM[ConsoleProxy|v-1-VM], P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(2)-Storage(Volume(1|ROOT-->Pool(2))]
  90. 2014-11-26 23:57:51,123 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-eaef1096) VM state transitted from :Starting to Starting with event: OperationRetryvm's original host id: null new host id: 2 host id before state transition: 3
  91. 2014-11-26 23:57:51,138 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-eaef1096) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  92. 2014-11-26 23:57:51,138 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-eaef1096) Hosts's actual total RAM: 132226133760 and RAM after applying overprovisioning: 132226129920
  93. 2014-11-26 23:57:51,138 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-eaef1096) release cpu from host: 3, old used: 1000,reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used: 500,reserved:0; movedfromreserved: false,moveToReserveredfalse
  94. 2014-11-26 23:57:51,138 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-eaef1096) release mem from host: 3, old used: 1610612736,reserved: 0, total: 132226129920; new used: 536870912,reserved:0; movedfromreserved: false,moveToReserveredfalse
  95. 2014-11-26 23:57:51,162 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-eaef1096) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  96. 2014-11-26 23:57:51,162 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-eaef1096) We are allocating VM, increasing the used capacity of this host:2
  97. 2014-11-26 23:57:51,162 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-eaef1096) Current Used CPU: 0 , Free CPU:88000 ,Requested CPU: 500
  98. 2014-11-26 23:57:51,162 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-eaef1096) Current Used RAM: 0 , Free RAM:132226129920 ,Requested RAM: 1073741824
  99. 2014-11-26 23:57:51,162 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-eaef1096) CPU STATS after allocation: for host: 2, old used: 0, old reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used:500, reserved:0; requested cpu:500,alloc_from_last:false
  100. 2014-11-26 23:57:51,162 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-eaef1096) RAM STATS after allocation: for host: 2, old used: 0, old reserved: 0, total: 132226129920; new used: 1073741824, reserved: 0; requested mem: 1073741824,alloc_from_last:false
  101. 2014-11-26 23:57:51,169 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-eaef1096) VM is being created in podId: 1
  102. 2014-11-26 23:57:51,178 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-eaef1096) Network id=200 is already implemented
  103. 2014-11-26 23:57:51,192 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-aa276462) Found 0 routers to update status.
  104. 2014-11-26 23:57:51,195 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-aa276462) Found 0 networks to update RvR status.
  105. 2014-11-26 23:57:51,230 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-eaef1096) Network id=202 is already implemented
  106. 2014-11-26 23:57:51,292 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-eaef1096) Network id=201 is already implemented
  107. 2014-11-26 23:57:51,346 DEBUG [c.c.n.g.PodBasedNetworkGuru] (consoleproxy-1:ctx-eaef1096) Allocated a nic NicProfile[3-1-fdb32e4f-3c58-4819-92a7-f6b17b3af5d9-10.3.4.159-null for VM[ConsoleProxy|v-1-VM]
  108. 2014-11-26 23:57:51,360 DEBUG [o.a.c.e.o.VolumeOrchestrator] (consoleproxy-1:ctx-eaef1096) Checking if we need to prepare 1 volumes for VM[ConsoleProxy|v-1-VM]
  109. 2014-11-26 23:57:51,391 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (consoleproxy-1:ctx-eaef1096) template 1 is already in store:1, type:Image
  110. 2014-11-26 23:57:51,404 DEBUG [o.a.c.s.d.PrimaryDataStoreImpl] (consoleproxy-1:ctx-eaef1096) Not found (templateId:1poolId:2) in template_spool_ref, persisting it
  111. 2014-11-26 23:57:51,418 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (consoleproxy-1:ctx-eaef1096) template 1 is already in store:2, type:Primary
  112. 2014-11-26 23:57:51,421 DEBUG [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-eaef1096) Found template routing-1 in storage pool 2 with VMTemplateStoragePool id: 660
  113. 2014-11-26 23:57:51,438 DEBUG [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-eaef1096) Acquire lock on VMTemplateStoragePool 660 with timeout 3600 seconds
  114. 2014-11-26 23:57:51,442 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-eaef1096) lock is acquired for VMTemplateStoragePool 660
  115. 2014-11-26 23:57:51,455 DEBUG [o.a.c.s.m.AncientDataMotionStrategy] (consoleproxy-1:ctx-eaef1096) copyAsync inspecting src type TEMPLATE copyAsync inspecting dest type TEMPLATE
  116. 2014-11-26 23:57:51,479 DEBUG [c.c.a.m.ClusteredAgentAttache] (consoleproxy-1:ctx-eaef1096) Seq 2-2114716025: Forwarding Seq 2-2114716025: { Cmd , MgmtId: 226850023912365, via: 2(cloud-host10.cgg.gov.in), Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/1/","origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"9cd0b1ae-758b-11e4-aa51-ba311310a163","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.3.4.40/ibm/share1","_role":"Image"}},"name":"routing-1","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"9cd0b1ae-758b-11e4-aa51-ba311310a163","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"CloudStore-2","id":2,"poolType":"PreSetup","host":"localhost","path":"/CloudStore-2","port":0,"url":"PreSetup://localhost//CloudStore-2/?ROLE=Primary&STOREUUID=CloudStore-2"}},"name":"routing-1","hypervisorType":"XenServer"}},"executeInSequence":false,"options":{},"wait":10800}}] } to 68995168937102
  117. 2014-11-26 23:57:54,552 DEBUG [c.c.a.t.Request] (AgentManager-Handler-14:null) Seq 2-2114716025: Processing: { Ans: , MgmtId: 226850023912365, via: 2, Ver: v1, Flags: 10, [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 3e1f2113-438a-05e7-1b46-4c9b14d56144","wait":0}}] }
  118. 2014-11-26 23:57:54,552 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-eaef1096) Seq 2-2114716025: Received: { Ans: , MgmtId: 226850023912365, via: 2, Ver: v1, Flags: 10, { CopyCmdAnswer } }
  119. 2014-11-26 23:57:54,573 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-eaef1096) releasing lock for VMTemplateStoragePool 660
  120. 2014-11-26 23:57:54,574 WARN [c.c.u.d.Merovingian2] (consoleproxy-1:ctx-eaef1096) Was unable to find lock for the key template_spool_ref660 and thread id 1994469474
  121. 2014-11-26 23:57:54,575 DEBUG [o.a.c.e.o.VolumeOrchestrator] (consoleproxy-1:ctx-eaef1096) Unable to create Vol[1|vm=1|ROOT]:Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 3e1f2113-438a-05e7-1b46-4c9b14d56144
  122. 2014-11-26 23:57:54,575 INFO [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-eaef1096) Unable to contact resource.
  123. com.cloud.exception.StorageUnavailableException: Resource [StoragePool:2] is unreachable: Unable to create Vol[1|vm=1|ROOT]:Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 3e1f2113-438a-05e7-1b46-4c9b14d56144
  124. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.recreateVolume(VolumeOrchestrator.java:1202)
  125. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.prepare(VolumeOrchestrator.java:1254)
  126. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:962)
  127. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761)
  128. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:745)
  129. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.startProxy(ConsoleProxyManagerImpl.java:555)
  130. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.allocCapacity(ConsoleProxyManagerImpl.java:941)
  131. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:1666)
  132. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:157)
  133. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:118)
  134. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:35)
  135. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:88)
  136. at com.cloud.vm.SystemVmLoadScanner$1.runInContext(SystemVmLoadScanner.java:79)
  137. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  138. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  139. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  140. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  141. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  142. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  143. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
  144. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
  145. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
  146. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  147. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  148. at java.lang.Thread.run(Thread.java:744)
  149. 2014-11-26 23:57:54,583 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-eaef1096) Cleaning up resources for the vm VM[ConsoleProxy|v-1-VM] in Starting state
  150. 2014-11-26 23:57:54,593 DEBUG [c.c.a.m.ClusteredAgentAttache] (consoleproxy-1:ctx-eaef1096) Seq 2-2114716026: Forwarding Seq 2-2114716026: { Cmd , MgmtId: 226850023912365, via: 2(cloud-host10.cgg.gov.in), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"v-1-VM","wait":0}}] } to 68995168937102
  151. 2014-11-26 23:57:54,626 DEBUG [c.c.s.StatsCollector] (StatsCollector-1:ctx-c31795d1) HostStatsCollector is running...
  152. 2014-11-26 23:57:54,655 DEBUG [c.c.a.m.ClusteredAgentAttache] (StatsCollector-1:ctx-c31795d1) Seq 1-619512182: Forwarding null to 68995168937102
  153. 2014-11-26 23:57:54,699 DEBUG [c.c.a.t.Request] (AgentManager-Handler-15:null) Seq 2-2114716026: Processing: { Ans: , MgmtId: 226850023912365, via: 2, Ver: v1, Flags: 10, [{"com.cloud.agent.api.StopAnswer":{"result":true,"details":"VM does not exist","wait":0}}] }
  154. 2014-11-26 23:57:54,699 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-eaef1096) Seq 2-2114716026: Received: { Ans: , MgmtId: 226850023912365, via: 2, Ver: v1, Flags: 10, { StopAnswer } }
  155. 2014-11-26 23:57:54,725 DEBUG [c.c.n.g.ControlNetworkGuru] (consoleproxy-1:ctx-eaef1096) Released nic: NicProfile[2-1-null-null-null
  156. 2014-11-26 23:57:54,745 DEBUG [c.c.d.d.DataCenterIpAddressDaoImpl] (consoleproxy-1:ctx-eaef1096) Releasing ip address for reservationId=fdb32e4f-3c58-4819-92a7-f6b17b3af5d9, instance=3
  157. 2014-11-26 23:57:54,747 DEBUG [c.c.n.g.PodBasedNetworkGuru] (consoleproxy-1:ctx-eaef1096) Released nic: NicProfile[3-1-null-null-null
  158. 2014-11-26 23:57:54,757 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-eaef1096) Successfully released network resources for the vm VM[ConsoleProxy|v-1-VM]
  159. 2014-11-26 23:57:54,757 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-eaef1096) Successfully cleanued up resources for the vm VM[ConsoleProxy|v-1-VM] in Starting state
  160. 2014-11-26 23:57:54,766 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-eaef1096) Deploy avoids pods: null, clusters: null, hosts: [1, 2, 3, 4, 5]
  161. 2014-11-26 23:57:54,769 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-eaef1096) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@1ca8cb54
  162. 2014-11-26 23:57:54,769 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-eaef1096) Trying to allocate a host and storage pools from dc:1, pod:1,cluster:null, requested cpu: 500, requested ram: 1073741824
  163. 2014-11-26 23:57:54,769 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-eaef1096) Is ROOT volume READY (pool already allocated)?: No
  164. 2014-11-26 23:57:54,769 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-eaef1096) Searching resources only under specified Pod: 1
  165. 2014-11-26 23:57:54,769 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-eaef1096) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Pod: 1
  166. 2014-11-26 23:57:54,791 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-eaef1096) Checking resources in Cluster: 1 under Pod: 1
  167. 2014-11-26 23:57:54,791 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-eaef1096 FirstFitRoutingAllocator) Looking for hosts in dc: 1 pod:1 cluster:1
  168. 2014-11-26 23:57:54,800 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-eaef1096 FirstFitRoutingAllocator) FirstFitAllocator has 5 hosts to check for allocation: [Host[-2-Routing], Host[-3-Routing], Host[-1-Routing], Host[-5-Routing], Host[-4-Routing]]
  169. 2014-11-26 23:57:54,818 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-eaef1096 FirstFitRoutingAllocator) Found 5 hosts for allocation after prioritization: [Host[-2-Routing], Host[-3-Routing], Host[-1-Routing], Host[-5-Routing], Host[-4-Routing]]
  170. 2014-11-26 23:57:54,819 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-eaef1096 FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=1024
  171. 2014-11-26 23:57:54,819 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-eaef1096 FirstFitRoutingAllocator) Host name: cloud-host10.cgg.gov.in, hostId: 2 is in avoid set, skipping this and trying other available hosts
  172. 2014-11-26 23:57:54,819 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-eaef1096 FirstFitRoutingAllocator) Host name: cloud-host8.cgg.gov.in, hostId: 3 is in avoid set, skipping this and trying other available hosts
  173. 2014-11-26 23:57:54,819 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-eaef1096 FirstFitRoutingAllocator) Host name: cloud-host6.cgg.gov.in, hostId: 1 is in avoid set, skipping this and trying other available hosts
  174. 2014-11-26 23:57:54,819 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-eaef1096 FirstFitRoutingAllocator) Host name: cloud-host7.cgg.gov.in, hostId: 5 is in avoid set, skipping this and trying other available hosts
  175. 2014-11-26 23:57:54,819 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-eaef1096 FirstFitRoutingAllocator) Host name: cloud-host9.cgg.gov.in, hostId: 4 is in avoid set, skipping this and trying other available hosts
  176. 2014-11-26 23:57:54,819 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-eaef1096 FirstFitRoutingAllocator) Host Allocator returning 0 suitable hosts
  177. 2014-11-26 23:57:54,819 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-eaef1096) No suitable hosts found
  178. 2014-11-26 23:57:54,819 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-eaef1096) No suitable hosts found under this Cluster: 1
  179. 2014-11-26 23:57:54,822 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-eaef1096) Could not find suitable Deployment Destination for this VM under any clusters, returning.
  180. 2014-11-26 23:57:54,823 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-eaef1096) Searching resources only under specified Pod: 1
  181. 2014-11-26 23:57:54,823 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-eaef1096) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Pod: 1
  182. 2014-11-26 23:57:54,832 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-eaef1096) Removing from the clusterId list these clusters from avoid set: [1]
  183. 2014-11-26 23:57:54,832 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-eaef1096) No clusters found after removing disabled clusters and clusters in avoid list, returning.
  184. 2014-11-26 23:57:54,859 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-eaef1096) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: 2
  185. 2014-11-26 23:57:54,874 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-eaef1096) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  186. 2014-11-26 23:57:54,874 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-eaef1096) Hosts's actual total RAM: 132226133760 and RAM after applying overprovisioning: 132226129920
  187. 2014-11-26 23:57:54,874 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-eaef1096) release cpu from host: 2, old used: 500,reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  188. 2014-11-26 23:57:54,874 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-eaef1096) release mem from host: 2, old used: 1073741824,reserved: 0, total: 132226129920; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  189. 2014-11-26 23:57:54,881 WARN [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-eaef1096) Exception while trying to start console proxy
  190. com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-1-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  191. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:921)
  192. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761)
  193. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:745)
  194. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.startProxy(ConsoleProxyManagerImpl.java:555)
  195. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.allocCapacity(ConsoleProxyManagerImpl.java:941)
  196. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:1666)
  197. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:157)
  198. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:118)
  199. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:35)
  200. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:88)
  201. at com.cloud.vm.SystemVmLoadScanner$1.runInContext(SystemVmLoadScanner.java:79)
  202. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  203. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  204. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  205. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  206. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  207. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  208. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
  209. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
  210. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
  211. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  212. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  213. at java.lang.Thread.run(Thread.java:744)
  214. 2014-11-26 23:57:54,970 DEBUG [c.c.a.t.Request] (StatsCollector-1:ctx-c31795d1) Seq 1-619512182: Received: { Ans: , MgmtId: 226850023912365, via: 1, Ver: v1, Flags: 10, { GetHostStatsAnswer } }
  215. 2014-11-26 23:57:54,992 DEBUG [c.c.a.m.ClusteredAgentAttache] (StatsCollector-1:ctx-c31795d1) Seq 2-2114716027: Forwarding null to 68995168937102
  216. 2014-11-26 23:57:55,292 DEBUG [c.c.a.t.Request] (StatsCollector-1:ctx-c31795d1) Seq 2-2114716027: Received: { Ans: , MgmtId: 226850023912365, via: 2, Ver: v1, Flags: 10, { GetHostStatsAnswer } }
  217. 2014-11-26 23:57:55,308 DEBUG [c.c.a.m.ClusteredAgentAttache] (StatsCollector-1:ctx-c31795d1) Seq 3-1990132097: Forwarding null to 68995168937102
  218. 2014-11-26 23:57:55,496 DEBUG [c.c.a.t.Request] (StatsCollector-1:ctx-c31795d1) Seq 3-1990132097: Received: { Ans: , MgmtId: 226850023912365, via: 3, Ver: v1, Flags: 10, { GetHostStatsAnswer } }
  219. 2014-11-26 23:57:55,516 DEBUG [c.c.a.m.ClusteredAgentAttache] (StatsCollector-1:ctx-c31795d1) Seq 4-853737850: Forwarding null to 68995168937102
  220. 2014-11-26 23:57:55,822 DEBUG [c.c.a.t.Request] (StatsCollector-1:ctx-c31795d1) Seq 4-853737850: Received: { Ans: , MgmtId: 226850023912365, via: 4, Ver: v1, Flags: 10, { GetHostStatsAnswer } }
  221. 2014-11-26 23:57:55,846 DEBUG [c.c.a.m.ClusteredAgentAttache] (StatsCollector-1:ctx-c31795d1) Seq 5-1497235804: Forwarding null to 68995168937102
  222. 2014-11-26 23:57:56,149 DEBUG [c.c.a.t.Request] (StatsCollector-1:ctx-c31795d1) Seq 5-1497235804: Received: { Ans: , MgmtId: 226850023912365, via: 5, Ver: v1, Flags: 10, { GetHostStatsAnswer } }
  223. 2014-11-26 23:58:08,058 DEBUG [c.c.s.StatsCollector] (StatsCollector-2:ctx-b2a79760) VmStatsCollector is running...
  224. 2014-11-26 23:58:09,235 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-4137fc8f) Zone 1 is ready to launch console proxy
  225. 2014-11-26 23:58:09,236 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-4137fc8f) Expand console proxy standby capacity for zone CGG-Zone1
  226. 2014-11-26 23:58:09,248 INFO [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-4137fc8f) Found a stopped console proxy, bring it up to running pool. proxy vm id : 1
  227. 2014-11-26 23:58:09,286 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
  228. 2014-11-26 23:58:09,286 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-4137fc8f) Successfully transitioned to start state for VM[ConsoleProxy|v-1-VM] reservation id = a27d6142-4790-45a5-8db3-b7fba5d810d0
  229. 2014-11-26 23:58:09,292 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-4137fc8f) Trying to deploy VM, vm has dcId: 1 and podId: 1
  230. 2014-11-26 23:58:09,292 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-4137fc8f) Deploy avoids pods: null, clusters: null, hosts: null
  231. 2014-11-26 23:58:09,302 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Deploy avoids pods: null, clusters: null, hosts: null
  232. 2014-11-26 23:58:09,304 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@1ca8cb54
  233. 2014-11-26 23:58:09,304 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Trying to allocate a host and storage pools from dc:1, pod:1,cluster:null, requested cpu: 500, requested ram: 1073741824
  234. 2014-11-26 23:58:09,304 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Is ROOT volume READY (pool already allocated)?: No
  235. 2014-11-26 23:58:09,305 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-4137fc8f) Searching resources only under specified Pod: 1
  236. 2014-11-26 23:58:09,305 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-4137fc8f) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Pod: 1
  237. 2014-11-26 23:58:09,323 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Checking resources in Cluster: 1 under Pod: 1
  238. 2014-11-26 23:58:09,324 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Looking for hosts in dc: 1 pod:1 cluster:1
  239. 2014-11-26 23:58:09,334 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) FirstFitAllocator has 5 hosts to check for allocation: [Host[-5-Routing], Host[-2-Routing], Host[-3-Routing], Host[-4-Routing], Host[-1-Routing]]
  240. 2014-11-26 23:58:09,353 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Found 5 hosts for allocation after prioritization: [Host[-5-Routing], Host[-2-Routing], Host[-3-Routing], Host[-4-Routing], Host[-1-Routing]]
  241. 2014-11-26 23:58:09,353 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=1024
  242. 2014-11-26 23:58:09,359 DEBUG [c.c.s.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-af4b2363) Zone 1 is ready to launch secondary storage VM
  243. 2014-11-26 23:58:09,369 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host: 5 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  244. 2014-11-26 23:58:09,369 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Checking if host: 5 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  245. 2014-11-26 23:58:09,370 INFO [c.c.s.PremiumSecondaryStorageManagerImpl] (secstorage-1:ctx-af4b2363) No running secondary storage vms found in datacenter id=1, starting one
  246. 2014-11-26 23:58:09,375 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  247. 2014-11-26 23:58:09,375 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  248. 2014-11-26 23:58:09,375 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Free RAM: 132226129920 , Requested RAM: 1073741824
  249. 2014-11-26 23:58:09,375 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host has enough CPU and RAM available
  250. 2014-11-26 23:58:09,376 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 5, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  251. 2014-11-26 23:58:09,376 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 5, used: 0, reserved: 0, total: 132226129920; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  252. 2014-11-26 23:58:09,376 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Found a suitable host, adding to list: 5
  253. 2014-11-26 23:58:09,382 INFO [c.c.s.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-af4b2363) No stopped secondary storage vm is available, need to allocate a new secondary storage vm
  254. 2014-11-26 23:58:09,387 DEBUG [c.c.s.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-af4b2363) Assign secondary storage vm from a newly started instance for request from data center : 1
  255. 2014-11-26 23:58:09,392 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host: 2 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  256. 2014-11-26 23:58:09,392 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Checking if host: 2 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  257. 2014-11-26 23:58:09,397 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  258. 2014-11-26 23:58:09,397 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  259. 2014-11-26 23:58:09,397 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Free RAM: 132226129920 , Requested RAM: 1073741824
  260. 2014-11-26 23:58:09,397 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host has enough CPU and RAM available
  261. 2014-11-26 23:58:09,397 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 2, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  262. 2014-11-26 23:58:09,397 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 2, used: 0, reserved: 0, total: 132226129920; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  263. 2014-11-26 23:58:09,397 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Found a suitable host, adding to list: 2
  264. 2014-11-26 23:58:09,411 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-af4b2363) Found existing network configuration for offering [Network Offering [1-Public-System-Public-Network]: Ntwk[200|Public|1]
  265. 2014-11-26 23:58:09,411 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-af4b2363) Releasing lock for Acct[c6a1e0a2-758b-11e4-aa51-ba311310a163-system]
  266. 2014-11-26 23:58:09,416 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host: 3 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  267. 2014-11-26 23:58:09,417 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Checking if host: 3 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  268. 2014-11-26 23:58:09,419 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-af4b2363) Found existing network configuration for offering [Network Offering [3-Control-System-Control-Network]: Ntwk[202|Control|3]
  269. 2014-11-26 23:58:09,419 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-af4b2363) Releasing lock for Acct[c6a1e0a2-758b-11e4-aa51-ba311310a163-system]
  270. 2014-11-26 23:58:09,423 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  271. 2014-11-26 23:58:09,423 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  272. 2014-11-26 23:58:09,423 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Free RAM: 132226129920 , Requested RAM: 1073741824
  273. 2014-11-26 23:58:09,423 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host has enough CPU and RAM available
  274. 2014-11-26 23:58:09,423 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 3, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  275. 2014-11-26 23:58:09,423 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 3, used: 0, reserved: 0, total: 132226129920; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  276. 2014-11-26 23:58:09,423 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Found a suitable host, adding to list: 3
  277. 2014-11-26 23:58:09,427 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-af4b2363) Found existing network configuration for offering [Network Offering [2-Management-System-Management-Network]: Ntwk[201|Management|2]
  278. 2014-11-26 23:58:09,427 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-af4b2363) Releasing lock for Acct[c6a1e0a2-758b-11e4-aa51-ba311310a163-system]
  279. 2014-11-26 23:58:09,434 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-af4b2363) Found existing network configuration for offering [Network Offering [4-Storage-System-Storage-Network]: Ntwk[203|Storage|4]
  280. 2014-11-26 23:58:09,434 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-af4b2363) Releasing lock for Acct[c6a1e0a2-758b-11e4-aa51-ba311310a163-system]
  281. 2014-11-26 23:58:09,439 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host: 4 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  282. 2014-11-26 23:58:09,439 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Checking if host: 4 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  283. 2014-11-26 23:58:09,444 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  284. 2014-11-26 23:58:09,444 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  285. 2014-11-26 23:58:09,444 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Free RAM: 132226129920 , Requested RAM: 1073741824
  286. 2014-11-26 23:58:09,444 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host has enough CPU and RAM available
  287. 2014-11-26 23:58:09,444 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 4, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  288. 2014-11-26 23:58:09,444 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 4, used: 0, reserved: 0, total: 132226129920; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  289. 2014-11-26 23:58:09,445 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Found a suitable host, adding to list: 4
  290. 2014-11-26 23:58:09,458 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host: 1 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  291. 2014-11-26 23:58:09,458 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  292. 2014-11-26 23:58:09,463 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  293. 2014-11-26 23:58:09,463 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  294. 2014-11-26 23:58:09,463 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Free RAM: 130926600192 , Requested RAM: 1073741824
  295. 2014-11-26 23:58:09,463 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host has enough CPU and RAM available
  296. 2014-11-26 23:58:09,463 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 1, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  297. 2014-11-26 23:58:09,463 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 1, used: 0, reserved: 0, total: 130926600192; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  298. 2014-11-26 23:58:09,463 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Found a suitable host, adding to list: 1
  299. 2014-11-26 23:58:09,463 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host Allocator returning 5 suitable hosts
  300. 2014-11-26 23:58:09,466 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Checking suitable pools for volume (Id, Type): (1,ROOT)
  301. 2014-11-26 23:58:09,466 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) We need to allocate new storagepool for this volume
  302. 2014-11-26 23:58:09,466 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Calling StoragePoolAllocators to find suitable pools
  303. 2014-11-26 23:58:09,469 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (consoleproxy-1:ctx-4137fc8f) LocalStoragePoolAllocator trying to find storage pool to fit the vm
  304. 2014-11-26 23:58:09,469 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-4137fc8f) ClusterScopeStoragePoolAllocator looking for storage pool
  305. 2014-11-26 23:58:09,469 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-4137fc8f) Looking for pools in dc: 1 pod:1 cluster:1
  306. 2014-11-26 23:58:09,471 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-4137fc8f) Found pools matching tags: [Pool[2|PreSetup]]
  307. 2014-11-26 23:58:09,473 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-4137fc8f) Removing pool Pool[2|PreSetup] from avoid set, must have been inserted when searching for another disk's tag
  308. 2014-11-26 23:58:09,475 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] (consoleproxy-1:ctx-4137fc8f) Checking if storage pool is suitable, name: null ,poolId: 2
  309. 2014-11-26 23:58:09,481 DEBUG [c.c.s.StorageManagerImpl] (consoleproxy-1:ctx-4137fc8f) Checking pool 2 for storage, totalSize: 1649254858752, usedBytes: 297795584, usedPct: 1.8056371483140182E-4, disable threshold: 0.85
  310. 2014-11-26 23:58:09,484 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-af4b2363) Allocating entries for VM: VM[SecondaryStorageVm|s-134-VM]
  311. 2014-11-26 23:58:09,488 DEBUG [c.c.s.StorageManagerImpl] (consoleproxy-1:ctx-4137fc8f) Checking pool: 2 for volume allocation [Vol[1|vm=1|ROOT]], maxSize : 1649254858752, totalAllocatedSize : 0, askingSize : 0, allocated disable threshold: 0.85
  312. 2014-11-26 23:58:09,488 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-4137fc8f) ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
  313. 2014-11-26 23:58:09,488 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Trying to find a potenial host and associated storage pools from the suitable host/pool lists for this VM
  314. 2014-11-26 23:58:09,488 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Checking if host: 5 can access any suitable storage pool for volume: ROOT
  315. 2014-11-26 23:58:09,489 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Host: 5 can access pool: 2
  316. 2014-11-26 23:58:09,490 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-af4b2363) Allocating nics for VM[SecondaryStorageVm|s-134-VM]
  317. 2014-11-26 23:58:09,490 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Found a potential host id: 5 name: cloud-host7.cgg.gov.in and associated storage pools for this VM
  318. 2014-11-26 23:58:09,491 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Returning Deployment Destination: Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(5)-Storage(Volume(1|ROOT-->Pool(2))]
  319. 2014-11-26 23:58:09,491 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-4137fc8f) Deployment found - P0=VM[ConsoleProxy|v-1-VM], P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(5)-Storage(Volume(1|ROOT-->Pool(2))]
  320. 2014-11-26 23:58:09,492 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-af4b2363) Allocating nic for vm VM[SecondaryStorageVm|s-134-VM] in network Ntwk[200|Public|1] with requested profile NicProfile[0-0-null-null-null
  321. 2014-11-26 23:58:09,509 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) VM state transitted from :Starting to Starting with event: OperationRetryvm's original host id: null new host id: 5 host id before state transition: null
  322. 2014-11-26 23:58:09,517 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-af4b2363) Allocating nic for vm VM[SecondaryStorageVm|s-134-VM] in network Ntwk[202|Control|3] with requested profile null
  323. 2014-11-26 23:58:09,523 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  324. 2014-11-26 23:58:09,523 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) We are allocating VM, increasing the used capacity of this host:5
  325. 2014-11-26 23:58:09,523 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) Current Used CPU: 0 , Free CPU:88000 ,Requested CPU: 500
  326. 2014-11-26 23:58:09,523 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) Current Used RAM: 0 , Free RAM:132226129920 ,Requested RAM: 1073741824
  327. 2014-11-26 23:58:09,523 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) CPU STATS after allocation: for host: 5, old used: 0, old reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used:500, reserved:0; requested cpu:500,alloc_from_last:false
  328. 2014-11-26 23:58:09,523 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) RAM STATS after allocation: for host: 5, old used: 0, old reserved: 0, total: 132226129920; new used: 1073741824, reserved: 0; requested mem: 1073741824,alloc_from_last:false
  329. 2014-11-26 23:58:09,530 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-4137fc8f) VM is being created in podId: 1
  330. 2014-11-26 23:58:09,530 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-af4b2363) Allocating nic for vm VM[SecondaryStorageVm|s-134-VM] in network Ntwk[201|Management|2] with requested profile null
  331. 2014-11-26 23:58:09,537 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-4137fc8f) Network id=200 is already implemented
  332. 2014-11-26 23:58:09,553 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-af4b2363) Allocating nic for vm VM[SecondaryStorageVm|s-134-VM] in network Ntwk[203|Storage|4] with requested profile null
  333. 2014-11-26 23:58:09,572 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-af4b2363) Allocating disks for VM[SecondaryStorageVm|s-134-VM]
  334. 2014-11-26 23:58:09,581 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-af4b2363) Allocation completed for VM: VM[SecondaryStorageVm|s-134-VM]
  335. 2014-11-26 23:58:09,584 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-4137fc8f) Network id=202 is already implemented
  336. 2014-11-26 23:58:09,603 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-af4b2363) received secondary storage vm alert
  337. 2014-11-26 23:58:09,603 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-af4b2363) New secondary storage vm created, zone: CGG-Zone1, secStorageVm: s-134-VM, public IP: null, private IP: null
  338. 2014-11-26 23:58:09,634 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
  339. 2014-11-26 23:58:09,634 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-af4b2363) Successfully transitioned to start state for VM[SecondaryStorageVm|s-134-VM] reservation id = 062563ba-e3b6-47ab-96b9-dfb284286b3b
  340. 2014-11-26 23:58:09,649 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-af4b2363) Trying to deploy VM, vm has dcId: 1 and podId: null
  341. 2014-11-26 23:58:09,649 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-af4b2363) Deploy avoids pods: null, clusters: null, hosts: null
  342. 2014-11-26 23:58:09,654 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-4137fc8f) Network id=201 is already implemented
  343. 2014-11-26 23:58:09,666 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-af4b2363) Deploy avoids pods: null, clusters: null, hosts: null
  344. 2014-11-26 23:58:09,668 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-af4b2363) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@1ca8cb54
  345. 2014-11-26 23:58:09,668 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-af4b2363) Trying to allocate a host and storage pools from dc:1, pod:null,cluster:null, requested cpu: 500, requested ram: 536870912
  346. 2014-11-26 23:58:09,668 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-af4b2363) Is ROOT volume READY (pool already allocated)?: No
  347. 2014-11-26 23:58:09,668 DEBUG [c.c.d.FirstFitPlanner] (secstorage-1:ctx-af4b2363) Searching all possible resources under this Zone: 1
  348. 2014-11-26 23:58:09,671 DEBUG [c.c.d.FirstFitPlanner] (secstorage-1:ctx-af4b2363) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
  349. 2014-11-26 23:58:09,688 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-af4b2363) Checking resources in Cluster: 1 under Pod: 1
  350. 2014-11-26 23:58:09,688 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) Looking for hosts in dc: 1 pod:1 cluster:1
  351. 2014-11-26 23:58:09,695 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) FirstFitAllocator has 5 hosts to check for allocation: [Host[-4-Routing], Host[-2-Routing], Host[-1-Routing], Host[-3-Routing], Host[-5-Routing]]
  352. 2014-11-26 23:58:09,705 DEBUG [c.c.n.g.PodBasedNetworkGuru] (consoleproxy-1:ctx-4137fc8f) Allocated a nic NicProfile[3-1-a27d6142-4790-45a5-8db3-b7fba5d810d0-10.3.4.186-null for VM[ConsoleProxy|v-1-VM]
  353. 2014-11-26 23:58:09,713 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) Found 5 hosts for allocation after prioritization: [Host[-4-Routing], Host[-2-Routing], Host[-1-Routing], Host[-3-Routing], Host[-5-Routing]]
  354. 2014-11-26 23:58:09,713 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=512
  355. 2014-11-26 23:58:09,716 DEBUG [o.a.c.e.o.VolumeOrchestrator] (consoleproxy-1:ctx-4137fc8f) Checking if we need to prepare 1 volumes for VM[ConsoleProxy|v-1-VM]
  356. 2014-11-26 23:58:09,728 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) Host: 4 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  357. 2014-11-26 23:58:09,728 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) Checking if host: 4 has enough capacity for requested CPU: 500 and requested RAM: 536870912 , cpuOverprovisioningFactor: 1.0
  358. 2014-11-26 23:58:09,733 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  359. 2014-11-26 23:58:09,733 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  360. 2014-11-26 23:58:09,733 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) Free RAM: 132226129920 , Requested RAM: 536870912
  361. 2014-11-26 23:58:09,733 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) Host has enough CPU and RAM available
  362. 2014-11-26 23:58:09,733 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 4, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  363. 2014-11-26 23:58:09,733 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 4, used: 0, reserved: 0, total: 132226129920; requested mem: 536870912,alloc_from_last_host?:false ,considerReservedCapacity?: true
  364. 2014-11-26 23:58:09,733 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) Found a suitable host, adding to list: 4
  365. 2014-11-26 23:58:09,740 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (consoleproxy-1:ctx-4137fc8f) template 1 is already in store:1, type:Image
  366. 2014-11-26 23:58:09,748 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) Host: 2 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  367. 2014-11-26 23:58:09,748 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) Checking if host: 2 has enough capacity for requested CPU: 500 and requested RAM: 536870912 , cpuOverprovisioningFactor: 1.0
  368. 2014-11-26 23:58:09,750 DEBUG [o.a.c.s.d.PrimaryDataStoreImpl] (consoleproxy-1:ctx-4137fc8f) Not found (templateId:1poolId:2) in template_spool_ref, persisting it
  369. 2014-11-26 23:58:09,754 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  370. 2014-11-26 23:58:09,755 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  371. 2014-11-26 23:58:09,755 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) Free RAM: 132226129920 , Requested RAM: 536870912
  372. 2014-11-26 23:58:09,755 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) Host has enough CPU and RAM available
  373. 2014-11-26 23:58:09,755 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 2, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  374. 2014-11-26 23:58:09,755 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 2, used: 0, reserved: 0, total: 132226129920; requested mem: 536870912,alloc_from_last_host?:false ,considerReservedCapacity?: true
  375. 2014-11-26 23:58:09,755 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) Found a suitable host, adding to list: 2
  376. 2014-11-26 23:58:09,762 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (consoleproxy-1:ctx-4137fc8f) template 1 is already in store:2, type:Primary
  377. 2014-11-26 23:58:09,765 DEBUG [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-4137fc8f) Found template routing-1 in storage pool 2 with VMTemplateStoragePool id: 661
  378. 2014-11-26 23:58:09,776 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) Host: 1 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  379. 2014-11-26 23:58:09,776 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 536870912 , cpuOverprovisioningFactor: 1.0
  380. 2014-11-26 23:58:09,778 DEBUG [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-4137fc8f) Acquire lock on VMTemplateStoragePool 661 with timeout 3600 seconds
  381. 2014-11-26 23:58:09,781 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  382. 2014-11-26 23:58:09,781 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  383. 2014-11-26 23:58:09,781 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) Free RAM: 130926600192 , Requested RAM: 536870912
  384. 2014-11-26 23:58:09,781 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) Host has enough CPU and RAM available
  385. 2014-11-26 23:58:09,781 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 1, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  386. 2014-11-26 23:58:09,781 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 1, used: 0, reserved: 0, total: 130926600192; requested mem: 536870912,alloc_from_last_host?:false ,considerReservedCapacity?: true
  387. 2014-11-26 23:58:09,781 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) Found a suitable host, adding to list: 1
  388. 2014-11-26 23:58:09,782 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-4137fc8f) lock is acquired for VMTemplateStoragePool 661
  389. 2014-11-26 23:58:09,793 DEBUG [o.a.c.s.m.AncientDataMotionStrategy] (consoleproxy-1:ctx-4137fc8f) copyAsync inspecting src type TEMPLATE copyAsync inspecting dest type TEMPLATE
  390. 2014-11-26 23:58:09,796 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) Host: 3 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  391. 2014-11-26 23:58:09,796 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) Checking if host: 3 has enough capacity for requested CPU: 500 and requested RAM: 536870912 , cpuOverprovisioningFactor: 1.0
  392. 2014-11-26 23:58:09,801 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  393. 2014-11-26 23:58:09,801 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  394. 2014-11-26 23:58:09,801 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) Free RAM: 132226129920 , Requested RAM: 536870912
  395. 2014-11-26 23:58:09,801 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) Host has enough CPU and RAM available
  396. 2014-11-26 23:58:09,801 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 3, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  397. 2014-11-26 23:58:09,801 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 3, used: 0, reserved: 0, total: 132226129920; requested mem: 536870912,alloc_from_last_host?:false ,considerReservedCapacity?: true
  398. 2014-11-26 23:58:09,801 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) Found a suitable host, adding to list: 3
  399. 2014-11-26 23:58:09,816 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) Host: 5 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  400. 2014-11-26 23:58:09,816 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) Checking if host: 5 has enough capacity for requested CPU: 500 and requested RAM: 536870912 , cpuOverprovisioningFactor: 1.0
  401. 2014-11-26 23:58:09,817 DEBUG [c.c.a.m.ClusteredAgentAttache] (consoleproxy-1:ctx-4137fc8f) Seq 2-2114716028: Forwarding Seq 2-2114716028: { Cmd , MgmtId: 226850023912365, via: 2(cloud-host10.cgg.gov.in), Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/1/","origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"9cd0b1ae-758b-11e4-aa51-ba311310a163","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.3.4.40/ibm/share1","_role":"Image"}},"name":"routing-1","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"9cd0b1ae-758b-11e4-aa51-ba311310a163","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"CloudStore-2","id":2,"poolType":"PreSetup","host":"localhost","path":"/CloudStore-2","port":0,"url":"PreSetup://localhost//CloudStore-2/?ROLE=Primary&STOREUUID=CloudStore-2"}},"name":"routing-1","hypervisorType":"XenServer"}},"executeInSequence":false,"options":{},"wait":10800}}] } to 68995168937102
  402. 2014-11-26 23:58:09,822 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  403. 2014-11-26 23:58:09,822 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) Free CPU: 87500 , Requested CPU: 500
  404. 2014-11-26 23:58:09,822 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) Free RAM: 131152388096 , Requested RAM: 536870912
  405. 2014-11-26 23:58:09,822 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) Host has enough CPU and RAM available
  406. 2014-11-26 23:58:09,822 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 5, used: 500, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  407. 2014-11-26 23:58:09,822 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 5, used: 1073741824, reserved: 0, total: 132226129920; requested mem: 536870912,alloc_from_last_host?:false ,considerReservedCapacity?: true
  408. 2014-11-26 23:58:09,822 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) Found a suitable host, adding to list: 5
  409. 2014-11-26 23:58:09,822 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-af4b2363 FirstFitRoutingAllocator) Host Allocator returning 5 suitable hosts
  410. 2014-11-26 23:58:09,825 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-af4b2363) Checking suitable pools for volume (Id, Type): (134,ROOT)
  411. 2014-11-26 23:58:09,825 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-af4b2363) We need to allocate new storagepool for this volume
  412. 2014-11-26 23:58:09,825 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-af4b2363) Calling StoragePoolAllocators to find suitable pools
  413. 2014-11-26 23:58:09,828 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (secstorage-1:ctx-af4b2363) LocalStoragePoolAllocator trying to find storage pool to fit the vm
  414. 2014-11-26 23:58:09,828 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (secstorage-1:ctx-af4b2363) ClusterScopeStoragePoolAllocator looking for storage pool
  415. 2014-11-26 23:58:09,828 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (secstorage-1:ctx-af4b2363) Looking for pools in dc: 1 pod:1 cluster:1
  416. 2014-11-26 23:58:09,831 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (secstorage-1:ctx-af4b2363) Found pools matching tags: [Pool[2|PreSetup]]
  417. 2014-11-26 23:58:09,834 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (secstorage-1:ctx-af4b2363) Removing pool Pool[2|PreSetup] from avoid set, must have been inserted when searching for another disk's tag
  418. 2014-11-26 23:58:09,837 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] (secstorage-1:ctx-af4b2363) Checking if storage pool is suitable, name: null ,poolId: 2
  419. 2014-11-26 23:58:09,845 DEBUG [c.c.s.StorageManagerImpl] (secstorage-1:ctx-af4b2363) Checking pool 2 for storage, totalSize: 1649254858752, usedBytes: 297795584, usedPct: 1.8056371483140182E-4, disable threshold: 0.85
  420. 2014-11-26 23:58:09,853 DEBUG [c.c.s.StorageManagerImpl] (secstorage-1:ctx-af4b2363) Checking pool: 2 for volume allocation [Vol[134|vm=134|ROOT]], maxSize : 1649254858752, totalAllocatedSize : 0, askingSize : 0, allocated disable threshold: 0.85
  421. 2014-11-26 23:58:09,853 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (secstorage-1:ctx-af4b2363) ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
  422. 2014-11-26 23:58:09,853 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-af4b2363) Trying to find a potenial host and associated storage pools from the suitable host/pool lists for this VM
  423. 2014-11-26 23:58:09,853 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-af4b2363) Checking if host: 4 can access any suitable storage pool for volume: ROOT
  424. 2014-11-26 23:58:09,854 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-af4b2363) Host: 4 can access pool: 2
  425. 2014-11-26 23:58:09,855 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-af4b2363) Found a potential host id: 4 name: cloud-host9.cgg.gov.in and associated storage pools for this VM
  426. 2014-11-26 23:58:09,857 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-af4b2363) Returning Deployment Destination: Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(4)-Storage(Volume(134|ROOT-->Pool(2))]
  427. 2014-11-26 23:58:09,857 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-af4b2363) Deployment found - P0=VM[SecondaryStorageVm|s-134-VM], P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(4)-Storage(Volume(134|ROOT-->Pool(2))]
  428. 2014-11-26 23:58:09,877 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363) VM state transitted from :Starting to Starting with event: OperationRetryvm's original host id: null new host id: 4 host id before state transition: null
  429. 2014-11-26 23:58:09,894 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  430. 2014-11-26 23:58:09,894 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363) We are allocating VM, increasing the used capacity of this host:4
  431. 2014-11-26 23:58:09,894 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363) Current Used CPU: 0 , Free CPU:88000 ,Requested CPU: 500
  432. 2014-11-26 23:58:09,894 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363) Current Used RAM: 0 , Free RAM:132226129920 ,Requested RAM: 536870912
  433. 2014-11-26 23:58:09,894 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363) CPU STATS after allocation: for host: 4, old used: 0, old reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used:500, reserved:0; requested cpu:500,alloc_from_last:false
  434. 2014-11-26 23:58:09,894 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363) RAM STATS after allocation: for host: 4, old used: 0, old reserved: 0, total: 132226129920; new used: 536870912, reserved: 0; requested mem: 536870912,alloc_from_last:false
  435. 2014-11-26 23:58:09,901 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-af4b2363) VM is being created in podId: 1
  436. 2014-11-26 23:58:09,910 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-af4b2363) Network id=200 is already implemented
  437. 2014-11-26 23:58:09,959 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-af4b2363) Network id=202 is already implemented
  438. 2014-11-26 23:58:10,026 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-af4b2363) Network id=201 is already implemented
  439. 2014-11-26 23:58:10,075 DEBUG [c.c.n.g.PodBasedNetworkGuru] (secstorage-1:ctx-af4b2363) Allocated a nic NicProfile[534-134-062563ba-e3b6-47ab-96b9-dfb284286b3b-10.3.4.187-null for VM[SecondaryStorageVm|s-134-VM]
  440. 2014-11-26 23:58:10,091 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-af4b2363) Network id=203 is already implemented
  441. 2014-11-26 23:58:10,142 DEBUG [c.c.n.g.PodBasedNetworkGuru] (secstorage-1:ctx-af4b2363) Allocated a nic NicProfile[535-134-062563ba-e3b6-47ab-96b9-dfb284286b3b-10.3.4.150-null for VM[SecondaryStorageVm|s-134-VM]
  442. 2014-11-26 23:58:10,154 DEBUG [o.a.c.e.o.VolumeOrchestrator] (secstorage-1:ctx-af4b2363) Checking if we need to prepare 1 volumes for VM[SecondaryStorageVm|s-134-VM]
  443. 2014-11-26 23:58:10,180 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (secstorage-1:ctx-af4b2363) template 1 is already in store:1, type:Image
  444. 2014-11-26 23:58:10,192 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (secstorage-1:ctx-af4b2363) template 1 is already in store:2, type:Primary
  445. 2014-11-26 23:58:10,195 DEBUG [o.a.c.s.v.VolumeServiceImpl] (secstorage-1:ctx-af4b2363) Found template routing-1 in storage pool 2 with VMTemplateStoragePool id: 661
  446. 2014-11-26 23:58:10,205 DEBUG [o.a.c.s.v.VolumeServiceImpl] (secstorage-1:ctx-af4b2363) Acquire lock on VMTemplateStoragePool 661 with timeout 3600 seconds
  447. 2014-11-26 23:58:11,995 DEBUG [c.c.a.t.Request] (AgentManager-Handler-6:null) Seq 2-2114716028: Processing: { Ans: , MgmtId: 226850023912365, via: 2, Ver: v1, Flags: 10, [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 3e1f2113-438a-05e7-1b46-4c9b14d56144","wait":0}}] }
  448. 2014-11-26 23:58:11,996 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-4137fc8f) Seq 2-2114716028: Received: { Ans: , MgmtId: 226850023912365, via: 2, Ver: v1, Flags: 10, { CopyCmdAnswer } }
  449. 2014-11-26 23:58:12,020 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-4137fc8f) releasing lock for VMTemplateStoragePool 661
  450. 2014-11-26 23:58:12,021 WARN [c.c.u.d.Merovingian2] (consoleproxy-1:ctx-4137fc8f) Was unable to find lock for the key template_spool_ref661 and thread id 1994469474
  451. 2014-11-26 23:58:12,021 DEBUG [o.a.c.e.o.VolumeOrchestrator] (consoleproxy-1:ctx-4137fc8f) Unable to create Vol[1|vm=1|ROOT]:Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 3e1f2113-438a-05e7-1b46-4c9b14d56144
  452. 2014-11-26 23:58:12,021 INFO [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-4137fc8f) Unable to contact resource.
  453. com.cloud.exception.StorageUnavailableException: Resource [StoragePool:2] is unreachable: Unable to create Vol[1|vm=1|ROOT]:Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 3e1f2113-438a-05e7-1b46-4c9b14d56144
  454. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.recreateVolume(VolumeOrchestrator.java:1202)
  455. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.prepare(VolumeOrchestrator.java:1254)
  456. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:962)
  457. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761)
  458. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:745)
  459. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.startProxy(ConsoleProxyManagerImpl.java:555)
  460. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.allocCapacity(ConsoleProxyManagerImpl.java:941)
  461. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:1666)
  462. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:157)
  463. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:118)
  464. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:35)
  465. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:88)
  466. at com.cloud.vm.SystemVmLoadScanner$1.runInContext(SystemVmLoadScanner.java:79)
  467. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  468. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  469. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  470. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  471. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  472. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  473. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
  474. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
  475. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
  476. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  477. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  478. at java.lang.Thread.run(Thread.java:744)
  479. 2014-11-26 23:58:12,029 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-4137fc8f) Cleaning up resources for the vm VM[ConsoleProxy|v-1-VM] in Starting state
  480. 2014-11-26 23:58:12,038 DEBUG [c.c.a.m.ClusteredAgentAttache] (consoleproxy-1:ctx-4137fc8f) Seq 5-1497235805: Forwarding Seq 5-1497235805: { Cmd , MgmtId: 226850023912365, via: 5(cloud-host7.cgg.gov.in), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"v-1-VM","wait":0}}] } to 68995168937102
  481. 2014-11-26 23:58:12,149 DEBUG [c.c.a.t.Request] (AgentManager-Handler-7:null) Seq 5-1497235805: Processing: { Ans: , MgmtId: 226850023912365, via: 5, Ver: v1, Flags: 10, [{"com.cloud.agent.api.StopAnswer":{"result":true,"details":"VM does not exist","wait":0}}] }
  482. 2014-11-26 23:58:12,149 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-4137fc8f) Seq 5-1497235805: Received: { Ans: , MgmtId: 226850023912365, via: 5, Ver: v1, Flags: 10, { StopAnswer } }
  483. 2014-11-26 23:58:12,173 DEBUG [c.c.n.g.ControlNetworkGuru] (consoleproxy-1:ctx-4137fc8f) Released nic: NicProfile[2-1-null-null-null
  484. 2014-11-26 23:58:12,191 DEBUG [c.c.d.d.DataCenterIpAddressDaoImpl] (consoleproxy-1:ctx-4137fc8f) Releasing ip address for reservationId=a27d6142-4790-45a5-8db3-b7fba5d810d0, instance=3
  485. 2014-11-26 23:58:12,192 DEBUG [c.c.n.g.PodBasedNetworkGuru] (consoleproxy-1:ctx-4137fc8f) Released nic: NicProfile[3-1-null-null-null
  486. 2014-11-26 23:58:12,201 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-4137fc8f) Successfully released network resources for the vm VM[ConsoleProxy|v-1-VM]
  487. 2014-11-26 23:58:12,201 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-4137fc8f) Successfully cleanued up resources for the vm VM[ConsoleProxy|v-1-VM] in Starting state
  488. 2014-11-26 23:58:12,209 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Deploy avoids pods: null, clusters: null, hosts: [5]
  489. 2014-11-26 23:58:12,211 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@1ca8cb54
  490. 2014-11-26 23:58:12,211 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Trying to allocate a host and storage pools from dc:1, pod:1,cluster:null, requested cpu: 500, requested ram: 1073741824
  491. 2014-11-26 23:58:12,211 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Is ROOT volume READY (pool already allocated)?: No
  492. 2014-11-26 23:58:12,211 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-4137fc8f) Searching resources only under specified Pod: 1
  493. 2014-11-26 23:58:12,211 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-4137fc8f) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Pod: 1
  494. 2014-11-26 23:58:12,230 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Checking resources in Cluster: 1 under Pod: 1
  495. 2014-11-26 23:58:12,230 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Looking for hosts in dc: 1 pod:1 cluster:1
  496. 2014-11-26 23:58:12,238 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) FirstFitAllocator has 5 hosts to check for allocation: [Host[-2-Routing], Host[-5-Routing], Host[-3-Routing], Host[-1-Routing], Host[-4-Routing]]
  497. 2014-11-26 23:58:12,255 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Found 5 hosts for allocation after prioritization: [Host[-2-Routing], Host[-5-Routing], Host[-3-Routing], Host[-1-Routing], Host[-4-Routing]]
  498. 2014-11-26 23:58:12,255 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=1024
  499. 2014-11-26 23:58:12,269 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host: 2 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  500. 2014-11-26 23:58:12,269 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Checking if host: 2 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  501. 2014-11-26 23:58:12,277 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  502. 2014-11-26 23:58:12,277 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  503. 2014-11-26 23:58:12,277 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Free RAM: 132226129920 , Requested RAM: 1073741824
  504. 2014-11-26 23:58:12,277 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host has enough CPU and RAM available
  505. 2014-11-26 23:58:12,277 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 2, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  506. 2014-11-26 23:58:12,277 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 2, used: 0, reserved: 0, total: 132226129920; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  507. 2014-11-26 23:58:12,277 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Found a suitable host, adding to list: 2
  508. 2014-11-26 23:58:12,277 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host name: cloud-host7.cgg.gov.in, hostId: 5 is in avoid set, skipping this and trying other available hosts
  509. 2014-11-26 23:58:12,291 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host: 3 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  510. 2014-11-26 23:58:12,291 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Checking if host: 3 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  511. 2014-11-26 23:58:12,296 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  512. 2014-11-26 23:58:12,297 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  513. 2014-11-26 23:58:12,297 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Free RAM: 132226129920 , Requested RAM: 1073741824
  514. 2014-11-26 23:58:12,297 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host has enough CPU and RAM available
  515. 2014-11-26 23:58:12,297 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 3, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  516. 2014-11-26 23:58:12,297 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 3, used: 0, reserved: 0, total: 132226129920; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  517. 2014-11-26 23:58:12,297 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Found a suitable host, adding to list: 3
  518. 2014-11-26 23:58:12,311 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host: 1 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  519. 2014-11-26 23:58:12,311 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  520. 2014-11-26 23:58:12,316 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  521. 2014-11-26 23:58:12,316 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  522. 2014-11-26 23:58:12,316 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Free RAM: 130926600192 , Requested RAM: 1073741824
  523. 2014-11-26 23:58:12,316 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host has enough CPU and RAM available
  524. 2014-11-26 23:58:12,316 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 1, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  525. 2014-11-26 23:58:12,316 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 1, used: 0, reserved: 0, total: 130926600192; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  526. 2014-11-26 23:58:12,316 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Found a suitable host, adding to list: 1
  527. 2014-11-26 23:58:12,330 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host: 4 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  528. 2014-11-26 23:58:12,330 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Checking if host: 4 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  529. 2014-11-26 23:58:12,335 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  530. 2014-11-26 23:58:12,335 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Free CPU: 87500 , Requested CPU: 500
  531. 2014-11-26 23:58:12,335 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Free RAM: 131689259008 , Requested RAM: 1073741824
  532. 2014-11-26 23:58:12,335 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host has enough CPU and RAM available
  533. 2014-11-26 23:58:12,335 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 4, used: 500, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  534. 2014-11-26 23:58:12,335 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 4, used: 536870912, reserved: 0, total: 132226129920; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  535. 2014-11-26 23:58:12,335 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Found a suitable host, adding to list: 4
  536. 2014-11-26 23:58:12,335 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host Allocator returning 4 suitable hosts
  537. 2014-11-26 23:58:12,339 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Checking suitable pools for volume (Id, Type): (1,ROOT)
  538. 2014-11-26 23:58:12,339 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) We need to allocate new storagepool for this volume
  539. 2014-11-26 23:58:12,339 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Calling StoragePoolAllocators to find suitable pools
  540. 2014-11-26 23:58:12,341 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (consoleproxy-1:ctx-4137fc8f) LocalStoragePoolAllocator trying to find storage pool to fit the vm
  541. 2014-11-26 23:58:12,341 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-4137fc8f) ClusterScopeStoragePoolAllocator looking for storage pool
  542. 2014-11-26 23:58:12,341 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-4137fc8f) Looking for pools in dc: 1 pod:1 cluster:1
  543. 2014-11-26 23:58:12,344 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-4137fc8f) Found pools matching tags: [Pool[2|PreSetup]]
  544. 2014-11-26 23:58:12,348 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-4137fc8f) Removing pool Pool[2|PreSetup] from avoid set, must have been inserted when searching for another disk's tag
  545. 2014-11-26 23:58:12,351 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] (consoleproxy-1:ctx-4137fc8f) Checking if storage pool is suitable, name: null ,poolId: 2
  546. 2014-11-26 23:58:12,358 DEBUG [c.c.s.StorageManagerImpl] (consoleproxy-1:ctx-4137fc8f) Checking pool 2 for storage, totalSize: 1649254858752, usedBytes: 297795584, usedPct: 1.8056371483140182E-4, disable threshold: 0.85
  547. 2014-11-26 23:58:12,367 DEBUG [c.c.s.StorageManagerImpl] (consoleproxy-1:ctx-4137fc8f) Checking pool: 2 for volume allocation [Vol[1|vm=1|ROOT]], maxSize : 1649254858752, totalAllocatedSize : 0, askingSize : 0, allocated disable threshold: 0.85
  548. 2014-11-26 23:58:12,367 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-4137fc8f) ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
  549. 2014-11-26 23:58:12,367 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Trying to find a potenial host and associated storage pools from the suitable host/pool lists for this VM
  550. 2014-11-26 23:58:12,367 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Checking if host: 2 can access any suitable storage pool for volume: ROOT
  551. 2014-11-26 23:58:12,368 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Host: 2 can access pool: 2
  552. 2014-11-26 23:58:12,369 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Found a potential host id: 2 name: cloud-host10.cgg.gov.in and associated storage pools for this VM
  553. 2014-11-26 23:58:12,371 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Returning Deployment Destination: Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(2)-Storage(Volume(1|ROOT-->Pool(2))]
  554. 2014-11-26 23:58:12,371 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-4137fc8f) Deployment found - P0=VM[ConsoleProxy|v-1-VM], P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(2)-Storage(Volume(1|ROOT-->Pool(2))]
  555. 2014-11-26 23:58:12,393 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) VM state transitted from :Starting to Starting with event: OperationRetryvm's original host id: null new host id: 2 host id before state transition: 5
  556. 2014-11-26 23:58:12,406 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  557. 2014-11-26 23:58:12,406 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) Hosts's actual total RAM: 132226133760 and RAM after applying overprovisioning: 132226129920
  558. 2014-11-26 23:58:12,406 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) release cpu from host: 5, old used: 500,reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  559. 2014-11-26 23:58:12,406 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) release mem from host: 5, old used: 1073741824,reserved: 0, total: 132226129920; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  560. 2014-11-26 23:58:12,429 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  561. 2014-11-26 23:58:12,429 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) We are allocating VM, increasing the used capacity of this host:2
  562. 2014-11-26 23:58:12,429 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) Current Used CPU: 0 , Free CPU:88000 ,Requested CPU: 500
  563. 2014-11-26 23:58:12,429 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) Current Used RAM: 0 , Free RAM:132226129920 ,Requested RAM: 1073741824
  564. 2014-11-26 23:58:12,429 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) CPU STATS after allocation: for host: 2, old used: 0, old reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used:500, reserved:0; requested cpu:500,alloc_from_last:false
  565. 2014-11-26 23:58:12,429 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) RAM STATS after allocation: for host: 2, old used: 0, old reserved: 0, total: 132226129920; new used: 1073741824, reserved: 0; requested mem: 1073741824,alloc_from_last:false
  566. 2014-11-26 23:58:12,436 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-4137fc8f) VM is being created in podId: 1
  567. 2014-11-26 23:58:12,445 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-4137fc8f) Network id=200 is already implemented
  568. 2014-11-26 23:58:12,497 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-4137fc8f) Network id=202 is already implemented
  569. 2014-11-26 23:58:12,557 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-4137fc8f) Network id=201 is already implemented
  570. 2014-11-26 23:58:12,608 DEBUG [c.c.n.g.PodBasedNetworkGuru] (consoleproxy-1:ctx-4137fc8f) Allocated a nic NicProfile[3-1-a27d6142-4790-45a5-8db3-b7fba5d810d0-10.3.4.131-null for VM[ConsoleProxy|v-1-VM]
  571. 2014-11-26 23:58:12,621 DEBUG [o.a.c.e.o.VolumeOrchestrator] (consoleproxy-1:ctx-4137fc8f) Checking if we need to prepare 1 volumes for VM[ConsoleProxy|v-1-VM]
  572. 2014-11-26 23:58:12,649 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (consoleproxy-1:ctx-4137fc8f) template 1 is already in store:1, type:Image
  573. 2014-11-26 23:58:12,659 DEBUG [o.a.c.s.d.PrimaryDataStoreImpl] (consoleproxy-1:ctx-4137fc8f) Not found (templateId:1poolId:2) in template_spool_ref, persisting it
  574. 2014-11-26 23:58:12,672 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (consoleproxy-1:ctx-4137fc8f) template 1 is already in store:2, type:Primary
  575. 2014-11-26 23:58:12,675 DEBUG [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-4137fc8f) Found template routing-1 in storage pool 2 with VMTemplateStoragePool id: 662
  576. 2014-11-26 23:58:12,688 DEBUG [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-4137fc8f) Acquire lock on VMTemplateStoragePool 662 with timeout 3600 seconds
  577. 2014-11-26 23:58:12,691 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-4137fc8f) lock is acquired for VMTemplateStoragePool 662
  578. 2014-11-26 23:58:12,713 DEBUG [o.a.c.s.m.AncientDataMotionStrategy] (consoleproxy-1:ctx-4137fc8f) copyAsync inspecting src type TEMPLATE copyAsync inspecting dest type TEMPLATE
  579. 2014-11-26 23:58:12,735 DEBUG [c.c.a.m.ClusteredAgentAttache] (consoleproxy-1:ctx-4137fc8f) Seq 1-619512183: Forwarding Seq 1-619512183: { Cmd , MgmtId: 226850023912365, via: 1(cloud-host6.cgg.gov.in), Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/1/","origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"9cd0b1ae-758b-11e4-aa51-ba311310a163","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.3.4.40/ibm/share1","_role":"Image"}},"name":"routing-1","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"9cd0b1ae-758b-11e4-aa51-ba311310a163","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"CloudStore-2","id":2,"poolType":"PreSetup","host":"localhost","path":"/CloudStore-2","port":0,"url":"PreSetup://localhost//CloudStore-2/?ROLE=Primary&STOREUUID=CloudStore-2"}},"name":"routing-1","hypervisorType":"XenServer"}},"executeInSequence":false,"options":{},"wait":10800}}] } to 68995168937102
  580. 2014-11-26 23:58:14,908 DEBUG [c.c.a.t.Request] (AgentManager-Handler-8:null) Seq 1-619512183: Processing: { Ans: , MgmtId: 226850023912365, via: 1, Ver: v1, Flags: 10, [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 3e1f2113-438a-05e7-1b46-4c9b14d56144","wait":0}}] }
  581. 2014-11-26 23:58:14,908 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-4137fc8f) Seq 1-619512183: Received: { Ans: , MgmtId: 226850023912365, via: 1, Ver: v1, Flags: 10, { CopyCmdAnswer } }
  582. 2014-11-26 23:58:14,928 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-4137fc8f) releasing lock for VMTemplateStoragePool 662
  583. 2014-11-26 23:58:14,929 WARN [c.c.u.d.Merovingian2] (consoleproxy-1:ctx-4137fc8f) Was unable to find lock for the key template_spool_ref662 and thread id 1994469474
  584. 2014-11-26 23:58:14,929 DEBUG [o.a.c.e.o.VolumeOrchestrator] (consoleproxy-1:ctx-4137fc8f) Unable to create Vol[1|vm=1|ROOT]:Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 3e1f2113-438a-05e7-1b46-4c9b14d56144
  585. 2014-11-26 23:58:14,929 INFO [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-4137fc8f) Unable to contact resource.
  586. com.cloud.exception.StorageUnavailableException: Resource [StoragePool:2] is unreachable: Unable to create Vol[1|vm=1|ROOT]:Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 3e1f2113-438a-05e7-1b46-4c9b14d56144
  587. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.recreateVolume(VolumeOrchestrator.java:1202)
  588. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.prepare(VolumeOrchestrator.java:1254)
  589. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:962)
  590. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761)
  591. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:745)
  592. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.startProxy(ConsoleProxyManagerImpl.java:555)
  593. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.allocCapacity(ConsoleProxyManagerImpl.java:941)
  594. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:1666)
  595. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:157)
  596. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:118)
  597. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:35)
  598. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:88)
  599. at com.cloud.vm.SystemVmLoadScanner$1.runInContext(SystemVmLoadScanner.java:79)
  600. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  601. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  602. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  603. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  604. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  605. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  606. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
  607. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
  608. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
  609. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  610. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  611. at java.lang.Thread.run(Thread.java:744)
  612. 2014-11-26 23:58:14,937 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-4137fc8f) Cleaning up resources for the vm VM[ConsoleProxy|v-1-VM] in Starting state
  613. 2014-11-26 23:58:14,946 DEBUG [c.c.a.m.ClusteredAgentAttache] (consoleproxy-1:ctx-4137fc8f) Seq 2-2114716029: Forwarding Seq 2-2114716029: { Cmd , MgmtId: 226850023912365, via: 2(cloud-host10.cgg.gov.in), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"v-1-VM","wait":0}}] } to 68995168937102
  614. 2014-11-26 23:58:15,056 DEBUG [c.c.a.t.Request] (AgentManager-Handler-9:null) Seq 2-2114716029: Processing: { Ans: , MgmtId: 226850023912365, via: 2, Ver: v1, Flags: 10, [{"com.cloud.agent.api.StopAnswer":{"result":true,"details":"VM does not exist","wait":0}}] }
  615. 2014-11-26 23:58:15,056 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-4137fc8f) Seq 2-2114716029: Received: { Ans: , MgmtId: 226850023912365, via: 2, Ver: v1, Flags: 10, { StopAnswer } }
  616. 2014-11-26 23:58:15,082 DEBUG [c.c.n.g.ControlNetworkGuru] (consoleproxy-1:ctx-4137fc8f) Released nic: NicProfile[2-1-null-null-null
  617. 2014-11-26 23:58:15,102 DEBUG [c.c.d.d.DataCenterIpAddressDaoImpl] (consoleproxy-1:ctx-4137fc8f) Releasing ip address for reservationId=a27d6142-4790-45a5-8db3-b7fba5d810d0, instance=3
  618. 2014-11-26 23:58:15,104 DEBUG [c.c.n.g.PodBasedNetworkGuru] (consoleproxy-1:ctx-4137fc8f) Released nic: NicProfile[3-1-null-null-null
  619. 2014-11-26 23:58:15,114 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-4137fc8f) Successfully released network resources for the vm VM[ConsoleProxy|v-1-VM]
  620. 2014-11-26 23:58:15,114 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-4137fc8f) Successfully cleanued up resources for the vm VM[ConsoleProxy|v-1-VM] in Starting state
  621. 2014-11-26 23:58:15,122 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Deploy avoids pods: null, clusters: null, hosts: [2, 5]
  622. 2014-11-26 23:58:15,124 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@1ca8cb54
  623. 2014-11-26 23:58:15,124 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Trying to allocate a host and storage pools from dc:1, pod:1,cluster:null, requested cpu: 500, requested ram: 1073741824
  624. 2014-11-26 23:58:15,124 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Is ROOT volume READY (pool already allocated)?: No
  625. 2014-11-26 23:58:15,125 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-4137fc8f) Searching resources only under specified Pod: 1
  626. 2014-11-26 23:58:15,125 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-4137fc8f) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Pod: 1
  627. 2014-11-26 23:58:15,145 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Checking resources in Cluster: 1 under Pod: 1
  628. 2014-11-26 23:58:15,145 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Looking for hosts in dc: 1 pod:1 cluster:1
  629. 2014-11-26 23:58:15,152 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) FirstFitAllocator has 5 hosts to check for allocation: [Host[-1-Routing], Host[-5-Routing], Host[-3-Routing], Host[-4-Routing], Host[-2-Routing]]
  630. 2014-11-26 23:58:15,168 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Found 5 hosts for allocation after prioritization: [Host[-1-Routing], Host[-5-Routing], Host[-3-Routing], Host[-4-Routing], Host[-2-Routing]]
  631. 2014-11-26 23:58:15,168 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=1024
  632. 2014-11-26 23:58:15,182 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host: 1 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  633. 2014-11-26 23:58:15,182 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  634. 2014-11-26 23:58:15,188 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  635. 2014-11-26 23:58:15,188 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  636. 2014-11-26 23:58:15,188 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Free RAM: 130926600192 , Requested RAM: 1073741824
  637. 2014-11-26 23:58:15,188 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host has enough CPU and RAM available
  638. 2014-11-26 23:58:15,188 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 1, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  639. 2014-11-26 23:58:15,188 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 1, used: 0, reserved: 0, total: 130926600192; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  640. 2014-11-26 23:58:15,188 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Found a suitable host, adding to list: 1
  641. 2014-11-26 23:58:15,188 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host name: cloud-host7.cgg.gov.in, hostId: 5 is in avoid set, skipping this and trying other available hosts
  642. 2014-11-26 23:58:15,203 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host: 3 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  643. 2014-11-26 23:58:15,203 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Checking if host: 3 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  644. 2014-11-26 23:58:15,209 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  645. 2014-11-26 23:58:15,209 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  646. 2014-11-26 23:58:15,209 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Free RAM: 132226129920 , Requested RAM: 1073741824
  647. 2014-11-26 23:58:15,209 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host has enough CPU and RAM available
  648. 2014-11-26 23:58:15,209 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 3, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  649. 2014-11-26 23:58:15,209 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 3, used: 0, reserved: 0, total: 132226129920; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  650. 2014-11-26 23:58:15,209 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Found a suitable host, adding to list: 3
  651. 2014-11-26 23:58:15,211 INFO [o.a.c.s.v.VolumeServiceImpl] (secstorage-1:ctx-af4b2363) Unable to acquire lock on VMTemplateStoragePool 661
  652. 2014-11-26 23:58:15,213 ERROR [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-af4b2363) Failed to start instance VM[SecondaryStorageVm|s-134-VM]
  653. java.lang.NullPointerException
  654. at org.apache.cloudstack.storage.volume.VolumeServiceImpl.createBaseImageAsync(VolumeServiceImpl.java:454)
  655. at org.apache.cloudstack.storage.volume.VolumeServiceImpl.createVolumeFromTemplateAsync(VolumeServiceImpl.java:603)
  656. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.recreateVolume(VolumeOrchestrator.java:1190)
  657. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.prepare(VolumeOrchestrator.java:1254)
  658. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:962)
  659. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761)
  660. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:745)
  661. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.startSecStorageVm(SecondaryStorageManagerImpl.java:261)
  662. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.allocCapacity(SecondaryStorageManagerImpl.java:694)
  663. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.expandPool(SecondaryStorageManagerImpl.java:1278)
  664. at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:123)
  665. at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:50)
  666. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:111)
  667. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:35)
  668. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:88)
  669. at com.cloud.vm.SystemVmLoadScanner$1.runInContext(SystemVmLoadScanner.java:79)
  670. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  671. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  672. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  673. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  674. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  675. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  676. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
  677. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
  678. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
  679. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  680. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  681. at java.lang.Thread.run(Thread.java:744)
  682. 2014-11-26 23:58:15,221 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-af4b2363) Cleaning up resources for the vm VM[SecondaryStorageVm|s-134-VM] in Starting state
  683. 2014-11-26 23:58:15,228 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host: 4 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  684. 2014-11-26 23:58:15,228 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Checking if host: 4 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  685. 2014-11-26 23:58:15,228 DEBUG [c.c.a.m.ClusteredAgentAttache] (secstorage-1:ctx-af4b2363) Seq 4-853737851: Forwarding Seq 4-853737851: { Cmd , MgmtId: 226850023912365, via: 4(cloud-host9.cgg.gov.in), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"s-134-VM","wait":0}}] } to 68995168937102
  686. 2014-11-26 23:58:15,234 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  687. 2014-11-26 23:58:15,234 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Free CPU: 87500 , Requested CPU: 500
  688. 2014-11-26 23:58:15,234 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Free RAM: 131689259008 , Requested RAM: 1073741824
  689. 2014-11-26 23:58:15,234 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host has enough CPU and RAM available
  690. 2014-11-26 23:58:15,234 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 4, used: 500, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  691. 2014-11-26 23:58:15,234 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 4, used: 536870912, reserved: 0, total: 132226129920; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  692. 2014-11-26 23:58:15,234 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Found a suitable host, adding to list: 4
  693. 2014-11-26 23:58:15,234 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host name: cloud-host10.cgg.gov.in, hostId: 2 is in avoid set, skipping this and trying other available hosts
  694. 2014-11-26 23:58:15,234 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host Allocator returning 3 suitable hosts
  695. 2014-11-26 23:58:15,237 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Checking suitable pools for volume (Id, Type): (1,ROOT)
  696. 2014-11-26 23:58:15,237 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) We need to allocate new storagepool for this volume
  697. 2014-11-26 23:58:15,237 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Calling StoragePoolAllocators to find suitable pools
  698. 2014-11-26 23:58:15,240 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (consoleproxy-1:ctx-4137fc8f) LocalStoragePoolAllocator trying to find storage pool to fit the vm
  699. 2014-11-26 23:58:15,240 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-4137fc8f) ClusterScopeStoragePoolAllocator looking for storage pool
  700. 2014-11-26 23:58:15,240 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-4137fc8f) Looking for pools in dc: 1 pod:1 cluster:1
  701. 2014-11-26 23:58:15,243 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-4137fc8f) Found pools matching tags: [Pool[2|PreSetup]]
  702. 2014-11-26 23:58:15,246 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-4137fc8f) Removing pool Pool[2|PreSetup] from avoid set, must have been inserted when searching for another disk's tag
  703. 2014-11-26 23:58:15,249 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] (consoleproxy-1:ctx-4137fc8f) Checking if storage pool is suitable, name: null ,poolId: 2
  704. 2014-11-26 23:58:15,258 DEBUG [c.c.s.StorageManagerImpl] (consoleproxy-1:ctx-4137fc8f) Checking pool 2 for storage, totalSize: 1649254858752, usedBytes: 297795584, usedPct: 1.8056371483140182E-4, disable threshold: 0.85
  705. 2014-11-26 23:58:15,266 DEBUG [c.c.s.StorageManagerImpl] (consoleproxy-1:ctx-4137fc8f) Checking pool: 2 for volume allocation [Vol[1|vm=1|ROOT]], maxSize : 1649254858752, totalAllocatedSize : 0, askingSize : 0, allocated disable threshold: 0.85
  706. 2014-11-26 23:58:15,266 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-4137fc8f) ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
  707. 2014-11-26 23:58:15,266 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Trying to find a potenial host and associated storage pools from the suitable host/pool lists for this VM
  708. 2014-11-26 23:58:15,266 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Checking if host: 1 can access any suitable storage pool for volume: ROOT
  709. 2014-11-26 23:58:15,267 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Host: 1 can access pool: 2
  710. 2014-11-26 23:58:15,269 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Found a potential host id: 1 name: cloud-host6.cgg.gov.in and associated storage pools for this VM
  711. 2014-11-26 23:58:15,270 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Returning Deployment Destination: Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(1)-Storage(Volume(1|ROOT-->Pool(2))]
  712. 2014-11-26 23:58:15,271 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-4137fc8f) Deployment found - P0=VM[ConsoleProxy|v-1-VM], P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(1)-Storage(Volume(1|ROOT-->Pool(2))]
  713. 2014-11-26 23:58:15,293 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) VM state transitted from :Starting to Starting with event: OperationRetryvm's original host id: null new host id: 1 host id before state transition: 2
  714. 2014-11-26 23:58:15,308 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  715. 2014-11-26 23:58:15,308 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) Hosts's actual total RAM: 132226133760 and RAM after applying overprovisioning: 132226129920
  716. 2014-11-26 23:58:15,308 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) release cpu from host: 2, old used: 500,reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  717. 2014-11-26 23:58:15,308 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) release mem from host: 2, old used: 1073741824,reserved: 0, total: 132226129920; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  718. 2014-11-26 23:58:15,332 DEBUG [c.c.a.t.Request] (AgentManager-Handler-10:null) Seq 4-853737851: Processing: { Ans: , MgmtId: 226850023912365, via: 4, Ver: v1, Flags: 10, [{"com.cloud.agent.api.StopAnswer":{"result":true,"details":"VM does not exist","wait":0}}] }
  719. 2014-11-26 23:58:15,332 DEBUG [c.c.a.t.Request] (secstorage-1:ctx-af4b2363) Seq 4-853737851: Received: { Ans: , MgmtId: 226850023912365, via: 4, Ver: v1, Flags: 10, { StopAnswer } }
  720. 2014-11-26 23:58:15,339 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  721. 2014-11-26 23:58:15,339 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) We are allocating VM, increasing the used capacity of this host:1
  722. 2014-11-26 23:58:15,339 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) Current Used CPU: 0 , Free CPU:88000 ,Requested CPU: 500
  723. 2014-11-26 23:58:15,339 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) Current Used RAM: 0 , Free RAM:130926600192 ,Requested RAM: 1073741824
  724. 2014-11-26 23:58:15,339 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) CPU STATS after allocation: for host: 1, old used: 0, old reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used:500, reserved:0; requested cpu:500,alloc_from_last:false
  725. 2014-11-26 23:58:15,339 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) RAM STATS after allocation: for host: 1, old used: 0, old reserved: 0, total: 130926600192; new used: 1073741824, reserved: 0; requested mem: 1073741824,alloc_from_last:false
  726. 2014-11-26 23:58:15,346 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-4137fc8f) VM is being created in podId: 1
  727. 2014-11-26 23:58:15,354 DEBUG [c.c.n.g.ControlNetworkGuru] (secstorage-1:ctx-af4b2363) Released nic: NicProfile[533-134-null-null-null
  728. 2014-11-26 23:58:15,357 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-4137fc8f) Network id=200 is already implemented
  729. 2014-11-26 23:58:15,371 DEBUG [c.c.d.d.DataCenterIpAddressDaoImpl] (secstorage-1:ctx-af4b2363) Releasing ip address for reservationId=062563ba-e3b6-47ab-96b9-dfb284286b3b, instance=534
  730. 2014-11-26 23:58:15,372 DEBUG [c.c.n.g.PodBasedNetworkGuru] (secstorage-1:ctx-af4b2363) Released nic: NicProfile[534-134-null-null-null
  731. 2014-11-26 23:58:15,391 DEBUG [c.c.d.d.DataCenterIpAddressDaoImpl] (secstorage-1:ctx-af4b2363) Releasing ip address for reservationId=062563ba-e3b6-47ab-96b9-dfb284286b3b, instance=535
  732. 2014-11-26 23:58:15,392 DEBUG [c.c.n.g.PodBasedNetworkGuru] (secstorage-1:ctx-af4b2363) Released nic: NicProfile[535-134-null-null-null
  733. 2014-11-26 23:58:15,399 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-af4b2363) Successfully released network resources for the vm VM[SecondaryStorageVm|s-134-VM]
  734. 2014-11-26 23:58:15,399 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-af4b2363) Successfully cleanued up resources for the vm VM[SecondaryStorageVm|s-134-VM] in Starting state
  735. 2014-11-26 23:58:15,412 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-4137fc8f) Network id=202 is already implemented
  736. 2014-11-26 23:58:15,420 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: 4
  737. 2014-11-26 23:58:15,433 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  738. 2014-11-26 23:58:15,433 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363) Hosts's actual total RAM: 132226133760 and RAM after applying overprovisioning: 132226129920
  739. 2014-11-26 23:58:15,433 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363) release cpu from host: 4, old used: 500,reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  740. 2014-11-26 23:58:15,433 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-af4b2363) release mem from host: 4, old used: 536870912,reserved: 0, total: 132226129920; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  741. 2014-11-26 23:58:15,440 WARN [c.c.s.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-af4b2363) Exception while trying to start secondary storage vm
  742. com.cloud.exception.AgentUnavailableException: Resource [Host:4] is unreachable: Host 4: Unable to start instance due to null
  743. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1072)
  744. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761)
  745. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:745)
  746. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.startSecStorageVm(SecondaryStorageManagerImpl.java:261)
  747. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.allocCapacity(SecondaryStorageManagerImpl.java:694)
  748. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.expandPool(SecondaryStorageManagerImpl.java:1278)
  749. at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:123)
  750. at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:50)
  751. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:111)
  752. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:35)
  753. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:88)
  754. at com.cloud.vm.SystemVmLoadScanner$1.runInContext(SystemVmLoadScanner.java:79)
  755. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  756. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  757. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  758. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  759. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  760. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  761. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
  762. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
  763. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
  764. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  765. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  766. at java.lang.Thread.run(Thread.java:744)
  767. Caused by: java.lang.NullPointerException
  768. at org.apache.cloudstack.storage.volume.VolumeServiceImpl.createBaseImageAsync(VolumeServiceImpl.java:454)
  769. at org.apache.cloudstack.storage.volume.VolumeServiceImpl.createVolumeFromTemplateAsync(VolumeServiceImpl.java:603)
  770. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.recreateVolume(VolumeOrchestrator.java:1190)
  771. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.prepare(VolumeOrchestrator.java:1254)
  772. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:962)
  773. ... 23 more
  774. 2014-11-26 23:58:15,442 INFO [c.c.s.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-af4b2363) Unable to start secondary storage vm for standby capacity, secStorageVm vm Id : 134, will recycle it and start a new one
  775. 2014-11-26 23:58:15,442 INFO [c.c.s.PremiumSecondaryStorageManagerImpl] (secstorage-1:ctx-af4b2363) Primary secondary storage is not even started, wait until next turn
  776. 2014-11-26 23:58:15,477 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-4137fc8f) Network id=201 is already implemented
  777. 2014-11-26 23:58:15,526 DEBUG [c.c.n.g.PodBasedNetworkGuru] (consoleproxy-1:ctx-4137fc8f) Allocated a nic NicProfile[3-1-a27d6142-4790-45a5-8db3-b7fba5d810d0-10.3.4.133-null for VM[ConsoleProxy|v-1-VM]
  778. 2014-11-26 23:58:15,538 DEBUG [o.a.c.e.o.VolumeOrchestrator] (consoleproxy-1:ctx-4137fc8f) Checking if we need to prepare 1 volumes for VM[ConsoleProxy|v-1-VM]
  779. 2014-11-26 23:58:15,564 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (consoleproxy-1:ctx-4137fc8f) template 1 is already in store:1, type:Image
  780. 2014-11-26 23:58:15,574 DEBUG [o.a.c.s.d.PrimaryDataStoreImpl] (consoleproxy-1:ctx-4137fc8f) Not found (templateId:1poolId:2) in template_spool_ref, persisting it
  781. 2014-11-26 23:58:15,588 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (consoleproxy-1:ctx-4137fc8f) template 1 is already in store:2, type:Primary
  782. 2014-11-26 23:58:15,590 DEBUG [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-4137fc8f) Found template routing-1 in storage pool 2 with VMTemplateStoragePool id: 663
  783. 2014-11-26 23:58:15,602 DEBUG [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-4137fc8f) Acquire lock on VMTemplateStoragePool 663 with timeout 3600 seconds
  784. 2014-11-26 23:58:15,605 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-4137fc8f) lock is acquired for VMTemplateStoragePool 663
  785. 2014-11-26 23:58:15,619 DEBUG [o.a.c.s.m.AncientDataMotionStrategy] (consoleproxy-1:ctx-4137fc8f) copyAsync inspecting src type TEMPLATE copyAsync inspecting dest type TEMPLATE
  786. 2014-11-26 23:58:15,645 DEBUG [c.c.a.m.ClusteredAgentAttache] (consoleproxy-1:ctx-4137fc8f) Seq 4-853737852: Forwarding Seq 4-853737852: { Cmd , MgmtId: 226850023912365, via: 4(cloud-host9.cgg.gov.in), Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/1/","origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"9cd0b1ae-758b-11e4-aa51-ba311310a163","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.3.4.40/ibm/share1","_role":"Image"}},"name":"routing-1","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"9cd0b1ae-758b-11e4-aa51-ba311310a163","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"CloudStore-2","id":2,"poolType":"PreSetup","host":"localhost","path":"/CloudStore-2","port":0,"url":"PreSetup://localhost//CloudStore-2/?ROLE=Primary&STOREUUID=CloudStore-2"}},"name":"routing-1","hypervisorType":"XenServer"}},"executeInSequence":false,"options":{},"wait":10800}}] } to 68995168937102
  787. 2014-11-26 23:58:17,809 DEBUG [c.c.a.t.Request] (AgentManager-Handler-11:null) Seq 4-853737852: Processing: { Ans: , MgmtId: 226850023912365, via: 4, Ver: v1, Flags: 10, [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 3e1f2113-438a-05e7-1b46-4c9b14d56144","wait":0}}] }
  788. 2014-11-26 23:58:17,809 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-4137fc8f) Seq 4-853737852: Received: { Ans: , MgmtId: 226850023912365, via: 4, Ver: v1, Flags: 10, { CopyCmdAnswer } }
  789. 2014-11-26 23:58:17,834 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-4137fc8f) releasing lock for VMTemplateStoragePool 663
  790. 2014-11-26 23:58:17,835 WARN [c.c.u.d.Merovingian2] (consoleproxy-1:ctx-4137fc8f) Was unable to find lock for the key template_spool_ref663 and thread id 1994469474
  791. 2014-11-26 23:58:17,835 DEBUG [o.a.c.e.o.VolumeOrchestrator] (consoleproxy-1:ctx-4137fc8f) Unable to create Vol[1|vm=1|ROOT]:Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 3e1f2113-438a-05e7-1b46-4c9b14d56144
  792. 2014-11-26 23:58:17,835 INFO [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-4137fc8f) Unable to contact resource.
  793. com.cloud.exception.StorageUnavailableException: Resource [StoragePool:2] is unreachable: Unable to create Vol[1|vm=1|ROOT]:Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 3e1f2113-438a-05e7-1b46-4c9b14d56144
  794. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.recreateVolume(VolumeOrchestrator.java:1202)
  795. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.prepare(VolumeOrchestrator.java:1254)
  796. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:962)
  797. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761)
  798. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:745)
  799. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.startProxy(ConsoleProxyManagerImpl.java:555)
  800. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.allocCapacity(ConsoleProxyManagerImpl.java:941)
  801. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:1666)
  802. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:157)
  803. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:118)
  804. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:35)
  805. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:88)
  806. at com.cloud.vm.SystemVmLoadScanner$1.runInContext(SystemVmLoadScanner.java:79)
  807. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  808. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  809. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  810. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  811. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  812. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  813. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
  814. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
  815. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
  816. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  817. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  818. at java.lang.Thread.run(Thread.java:744)
  819. 2014-11-26 23:58:17,844 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-4137fc8f) Cleaning up resources for the vm VM[ConsoleProxy|v-1-VM] in Starting state
  820. 2014-11-26 23:58:17,853 DEBUG [c.c.a.m.ClusteredAgentAttache] (consoleproxy-1:ctx-4137fc8f) Seq 1-619512184: Forwarding Seq 1-619512184: { Cmd , MgmtId: 226850023912365, via: 1(cloud-host6.cgg.gov.in), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"v-1-VM","wait":0}}] } to 68995168937102
  821. 2014-11-26 23:58:17,963 DEBUG [c.c.a.t.Request] (AgentManager-Handler-12:null) Seq 1-619512184: Processing: { Ans: , MgmtId: 226850023912365, via: 1, Ver: v1, Flags: 10, [{"com.cloud.agent.api.StopAnswer":{"result":true,"details":"VM does not exist","wait":0}}] }
  822. 2014-11-26 23:58:17,963 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-4137fc8f) Seq 1-619512184: Received: { Ans: , MgmtId: 226850023912365, via: 1, Ver: v1, Flags: 10, { StopAnswer } }
  823. 2014-11-26 23:58:17,989 DEBUG [c.c.n.g.ControlNetworkGuru] (consoleproxy-1:ctx-4137fc8f) Released nic: NicProfile[2-1-null-null-null
  824. 2014-11-26 23:58:18,017 DEBUG [c.c.d.d.DataCenterIpAddressDaoImpl] (consoleproxy-1:ctx-4137fc8f) Releasing ip address for reservationId=a27d6142-4790-45a5-8db3-b7fba5d810d0, instance=3
  825. 2014-11-26 23:58:18,018 DEBUG [c.c.n.g.PodBasedNetworkGuru] (consoleproxy-1:ctx-4137fc8f) Released nic: NicProfile[3-1-null-null-null
  826. 2014-11-26 23:58:18,029 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-4137fc8f) Successfully released network resources for the vm VM[ConsoleProxy|v-1-VM]
  827. 2014-11-26 23:58:18,029 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-4137fc8f) Successfully cleanued up resources for the vm VM[ConsoleProxy|v-1-VM] in Starting state
  828. 2014-11-26 23:58:18,039 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Deploy avoids pods: null, clusters: null, hosts: [1, 2, 5]
  829. 2014-11-26 23:58:18,041 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@1ca8cb54
  830. 2014-11-26 23:58:18,041 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Trying to allocate a host and storage pools from dc:1, pod:1,cluster:null, requested cpu: 500, requested ram: 1073741824
  831. 2014-11-26 23:58:18,042 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Is ROOT volume READY (pool already allocated)?: No
  832. 2014-11-26 23:58:18,042 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-4137fc8f) Searching resources only under specified Pod: 1
  833. 2014-11-26 23:58:18,042 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-4137fc8f) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Pod: 1
  834. 2014-11-26 23:58:18,064 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Checking resources in Cluster: 1 under Pod: 1
  835. 2014-11-26 23:58:18,065 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Looking for hosts in dc: 1 pod:1 cluster:1
  836. 2014-11-26 23:58:18,073 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) FirstFitAllocator has 5 hosts to check for allocation: [Host[-5-Routing], Host[-3-Routing], Host[-1-Routing], Host[-2-Routing], Host[-4-Routing]]
  837. 2014-11-26 23:58:18,092 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Found 5 hosts for allocation after prioritization: [Host[-5-Routing], Host[-3-Routing], Host[-1-Routing], Host[-2-Routing], Host[-4-Routing]]
  838. 2014-11-26 23:58:18,092 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=1024
  839. 2014-11-26 23:58:18,092 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host name: cloud-host7.cgg.gov.in, hostId: 5 is in avoid set, skipping this and trying other available hosts
  840. 2014-11-26 23:58:18,109 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host: 3 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  841. 2014-11-26 23:58:18,109 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Checking if host: 3 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  842. 2014-11-26 23:58:18,115 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  843. 2014-11-26 23:58:18,115 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  844. 2014-11-26 23:58:18,115 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Free RAM: 132226129920 , Requested RAM: 1073741824
  845. 2014-11-26 23:58:18,115 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host has enough CPU and RAM available
  846. 2014-11-26 23:58:18,116 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 3, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  847. 2014-11-26 23:58:18,116 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 3, used: 0, reserved: 0, total: 132226129920; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  848. 2014-11-26 23:58:18,116 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Found a suitable host, adding to list: 3
  849. 2014-11-26 23:58:18,116 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host name: cloud-host6.cgg.gov.in, hostId: 1 is in avoid set, skipping this and trying other available hosts
  850. 2014-11-26 23:58:18,116 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host name: cloud-host10.cgg.gov.in, hostId: 2 is in avoid set, skipping this and trying other available hosts
  851. 2014-11-26 23:58:18,133 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host: 4 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  852. 2014-11-26 23:58:18,133 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Checking if host: 4 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  853. 2014-11-26 23:58:18,139 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  854. 2014-11-26 23:58:18,139 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  855. 2014-11-26 23:58:18,140 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Free RAM: 132226129920 , Requested RAM: 1073741824
  856. 2014-11-26 23:58:18,140 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host has enough CPU and RAM available
  857. 2014-11-26 23:58:18,140 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 4, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  858. 2014-11-26 23:58:18,140 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 4, used: 0, reserved: 0, total: 132226129920; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  859. 2014-11-26 23:58:18,140 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Found a suitable host, adding to list: 4
  860. 2014-11-26 23:58:18,140 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host Allocator returning 2 suitable hosts
  861. 2014-11-26 23:58:18,143 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Checking suitable pools for volume (Id, Type): (1,ROOT)
  862. 2014-11-26 23:58:18,143 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) We need to allocate new storagepool for this volume
  863. 2014-11-26 23:58:18,143 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Calling StoragePoolAllocators to find suitable pools
  864. 2014-11-26 23:58:18,146 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (consoleproxy-1:ctx-4137fc8f) LocalStoragePoolAllocator trying to find storage pool to fit the vm
  865. 2014-11-26 23:58:18,146 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-4137fc8f) ClusterScopeStoragePoolAllocator looking for storage pool
  866. 2014-11-26 23:58:18,146 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-4137fc8f) Looking for pools in dc: 1 pod:1 cluster:1
  867. 2014-11-26 23:58:18,149 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-4137fc8f) Found pools matching tags: [Pool[2|PreSetup]]
  868. 2014-11-26 23:58:18,152 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-4137fc8f) Removing pool Pool[2|PreSetup] from avoid set, must have been inserted when searching for another disk's tag
  869. 2014-11-26 23:58:18,155 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] (consoleproxy-1:ctx-4137fc8f) Checking if storage pool is suitable, name: null ,poolId: 2
  870. 2014-11-26 23:58:18,164 DEBUG [c.c.s.StorageManagerImpl] (consoleproxy-1:ctx-4137fc8f) Checking pool 2 for storage, totalSize: 1649254858752, usedBytes: 297795584, usedPct: 1.8056371483140182E-4, disable threshold: 0.85
  871. 2014-11-26 23:58:18,172 DEBUG [c.c.s.StorageManagerImpl] (consoleproxy-1:ctx-4137fc8f) Checking pool: 2 for volume allocation [Vol[1|vm=1|ROOT]], maxSize : 1649254858752, totalAllocatedSize : 0, askingSize : 0, allocated disable threshold: 0.85
  872. 2014-11-26 23:58:18,172 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-4137fc8f) ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
  873. 2014-11-26 23:58:18,172 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Trying to find a potenial host and associated storage pools from the suitable host/pool lists for this VM
  874. 2014-11-26 23:58:18,172 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Checking if host: 3 can access any suitable storage pool for volume: ROOT
  875. 2014-11-26 23:58:18,173 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Host: 3 can access pool: 2
  876. 2014-11-26 23:58:18,174 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Found a potential host id: 3 name: cloud-host8.cgg.gov.in and associated storage pools for this VM
  877. 2014-11-26 23:58:18,176 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Returning Deployment Destination: Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(3)-Storage(Volume(1|ROOT-->Pool(2))]
  878. 2014-11-26 23:58:18,176 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-4137fc8f) Deployment found - P0=VM[ConsoleProxy|v-1-VM], P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(3)-Storage(Volume(1|ROOT-->Pool(2))]
  879. 2014-11-26 23:58:18,199 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) VM state transitted from :Starting to Starting with event: OperationRetryvm's original host id: null new host id: 3 host id before state transition: 1
  880. 2014-11-26 23:58:18,214 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  881. 2014-11-26 23:58:18,214 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) Hosts's actual total RAM: 130926604032 and RAM after applying overprovisioning: 130926600192
  882. 2014-11-26 23:58:18,214 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) release cpu from host: 1, old used: 500,reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  883. 2014-11-26 23:58:18,214 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) release mem from host: 1, old used: 1073741824,reserved: 0, total: 130926600192; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  884. 2014-11-26 23:58:18,240 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  885. 2014-11-26 23:58:18,240 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) We are allocating VM, increasing the used capacity of this host:3
  886. 2014-11-26 23:58:18,240 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) Current Used CPU: 0 , Free CPU:88000 ,Requested CPU: 500
  887. 2014-11-26 23:58:18,240 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) Current Used RAM: 0 , Free RAM:132226129920 ,Requested RAM: 1073741824
  888. 2014-11-26 23:58:18,240 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) CPU STATS after allocation: for host: 3, old used: 0, old reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used:500, reserved:0; requested cpu:500,alloc_from_last:false
  889. 2014-11-26 23:58:18,240 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) RAM STATS after allocation: for host: 3, old used: 0, old reserved: 0, total: 132226129920; new used: 1073741824, reserved: 0; requested mem: 1073741824,alloc_from_last:false
  890. 2014-11-26 23:58:18,247 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-4137fc8f) VM is being created in podId: 1
  891. 2014-11-26 23:58:18,258 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-4137fc8f) Network id=200 is already implemented
  892. 2014-11-26 23:58:18,313 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-4137fc8f) Network id=202 is already implemented
  893. 2014-11-26 23:58:18,377 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-4137fc8f) Network id=201 is already implemented
  894. 2014-11-26 23:58:18,430 DEBUG [c.c.n.g.PodBasedNetworkGuru] (consoleproxy-1:ctx-4137fc8f) Allocated a nic NicProfile[3-1-a27d6142-4790-45a5-8db3-b7fba5d810d0-10.3.4.101-null for VM[ConsoleProxy|v-1-VM]
  895. 2014-11-26 23:58:18,445 DEBUG [o.a.c.e.o.VolumeOrchestrator] (consoleproxy-1:ctx-4137fc8f) Checking if we need to prepare 1 volumes for VM[ConsoleProxy|v-1-VM]
  896. 2014-11-26 23:58:18,473 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (consoleproxy-1:ctx-4137fc8f) template 1 is already in store:1, type:Image
  897. 2014-11-26 23:58:18,483 DEBUG [o.a.c.s.d.PrimaryDataStoreImpl] (consoleproxy-1:ctx-4137fc8f) Not found (templateId:1poolId:2) in template_spool_ref, persisting it
  898. 2014-11-26 23:58:18,498 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (consoleproxy-1:ctx-4137fc8f) template 1 is already in store:2, type:Primary
  899. 2014-11-26 23:58:18,501 DEBUG [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-4137fc8f) Found template routing-1 in storage pool 2 with VMTemplateStoragePool id: 664
  900. 2014-11-26 23:58:18,513 DEBUG [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-4137fc8f) Acquire lock on VMTemplateStoragePool 664 with timeout 3600 seconds
  901. 2014-11-26 23:58:18,517 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-4137fc8f) lock is acquired for VMTemplateStoragePool 664
  902. 2014-11-26 23:58:18,531 DEBUG [o.a.c.s.m.AncientDataMotionStrategy] (consoleproxy-1:ctx-4137fc8f) copyAsync inspecting src type TEMPLATE copyAsync inspecting dest type TEMPLATE
  903. 2014-11-26 23:58:18,557 DEBUG [c.c.a.m.ClusteredAgentAttache] (consoleproxy-1:ctx-4137fc8f) Seq 1-619512185: Forwarding Seq 1-619512185: { Cmd , MgmtId: 226850023912365, via: 1(cloud-host6.cgg.gov.in), Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/1/","origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"9cd0b1ae-758b-11e4-aa51-ba311310a163","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.3.4.40/ibm/share1","_role":"Image"}},"name":"routing-1","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"9cd0b1ae-758b-11e4-aa51-ba311310a163","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"CloudStore-2","id":2,"poolType":"PreSetup","host":"localhost","path":"/CloudStore-2","port":0,"url":"PreSetup://localhost//CloudStore-2/?ROLE=Primary&STOREUUID=CloudStore-2"}},"name":"routing-1","hypervisorType":"XenServer"}},"executeInSequence":false,"options":{},"wait":10800}}] } to 68995168937102
  904. 2014-11-26 23:58:20,726 DEBUG [c.c.a.t.Request] (AgentManager-Handler-13:null) Seq 1-619512185: Processing: { Ans: , MgmtId: 226850023912365, via: 1, Ver: v1, Flags: 10, [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 3e1f2113-438a-05e7-1b46-4c9b14d56144","wait":0}}] }
  905. 2014-11-26 23:58:20,726 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-4137fc8f) Seq 1-619512185: Received: { Ans: , MgmtId: 226850023912365, via: 1, Ver: v1, Flags: 10, { CopyCmdAnswer } }
  906. 2014-11-26 23:58:20,750 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-4137fc8f) releasing lock for VMTemplateStoragePool 664
  907. 2014-11-26 23:58:20,750 WARN [c.c.u.d.Merovingian2] (consoleproxy-1:ctx-4137fc8f) Was unable to find lock for the key template_spool_ref664 and thread id 1994469474
  908. 2014-11-26 23:58:20,751 DEBUG [o.a.c.e.o.VolumeOrchestrator] (consoleproxy-1:ctx-4137fc8f) Unable to create Vol[1|vm=1|ROOT]:Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 3e1f2113-438a-05e7-1b46-4c9b14d56144
  909. 2014-11-26 23:58:20,751 INFO [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-4137fc8f) Unable to contact resource.
  910. com.cloud.exception.StorageUnavailableException: Resource [StoragePool:2] is unreachable: Unable to create Vol[1|vm=1|ROOT]:Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 3e1f2113-438a-05e7-1b46-4c9b14d56144
  911. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.recreateVolume(VolumeOrchestrator.java:1202)
  912. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.prepare(VolumeOrchestrator.java:1254)
  913. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:962)
  914. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761)
  915. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:745)
  916. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.startProxy(ConsoleProxyManagerImpl.java:555)
  917. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.allocCapacity(ConsoleProxyManagerImpl.java:941)
  918. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:1666)
  919. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:157)
  920. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:118)
  921. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:35)
  922. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:88)
  923. at com.cloud.vm.SystemVmLoadScanner$1.runInContext(SystemVmLoadScanner.java:79)
  924. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  925. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  926. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  927. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  928. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  929. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  930. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
  931. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
  932. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
  933. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  934. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  935. at java.lang.Thread.run(Thread.java:744)
  936. 2014-11-26 23:58:20,760 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-4137fc8f) Cleaning up resources for the vm VM[ConsoleProxy|v-1-VM] in Starting state
  937. 2014-11-26 23:58:20,770 DEBUG [c.c.a.m.ClusteredAgentAttache] (consoleproxy-1:ctx-4137fc8f) Seq 3-1990132098: Forwarding Seq 3-1990132098: { Cmd , MgmtId: 226850023912365, via: 3(cloud-host8.cgg.gov.in), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"v-1-VM","wait":0}}] } to 68995168937102
  938. 2014-11-26 23:58:20,849 DEBUG [c.c.a.t.Request] (AgentManager-Handler-14:null) Seq 3-1990132098: Processing: { Ans: , MgmtId: 226850023912365, via: 3, Ver: v1, Flags: 10, [{"com.cloud.agent.api.StopAnswer":{"result":true,"details":"VM does not exist","wait":0}}] }
  939. 2014-11-26 23:58:20,849 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-4137fc8f) Seq 3-1990132098: Received: { Ans: , MgmtId: 226850023912365, via: 3, Ver: v1, Flags: 10, { StopAnswer } }
  940. 2014-11-26 23:58:20,875 DEBUG [c.c.n.g.ControlNetworkGuru] (consoleproxy-1:ctx-4137fc8f) Released nic: NicProfile[2-1-null-null-null
  941. 2014-11-26 23:58:20,904 DEBUG [c.c.d.d.DataCenterIpAddressDaoImpl] (consoleproxy-1:ctx-4137fc8f) Releasing ip address for reservationId=a27d6142-4790-45a5-8db3-b7fba5d810d0, instance=3
  942. 2014-11-26 23:58:20,906 DEBUG [c.c.n.g.PodBasedNetworkGuru] (consoleproxy-1:ctx-4137fc8f) Released nic: NicProfile[3-1-null-null-null
  943. 2014-11-26 23:58:20,917 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-4137fc8f) Successfully released network resources for the vm VM[ConsoleProxy|v-1-VM]
  944. 2014-11-26 23:58:20,917 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-4137fc8f) Successfully cleanued up resources for the vm VM[ConsoleProxy|v-1-VM] in Starting state
  945. 2014-11-26 23:58:20,926 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Deploy avoids pods: null, clusters: null, hosts: [1, 2, 3, 5]
  946. 2014-11-26 23:58:20,929 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@1ca8cb54
  947. 2014-11-26 23:58:20,929 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Trying to allocate a host and storage pools from dc:1, pod:1,cluster:null, requested cpu: 500, requested ram: 1073741824
  948. 2014-11-26 23:58:20,929 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Is ROOT volume READY (pool already allocated)?: No
  949. 2014-11-26 23:58:20,929 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-4137fc8f) Searching resources only under specified Pod: 1
  950. 2014-11-26 23:58:20,929 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-4137fc8f) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Pod: 1
  951. 2014-11-26 23:58:20,950 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Checking resources in Cluster: 1 under Pod: 1
  952. 2014-11-26 23:58:20,950 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Looking for hosts in dc: 1 pod:1 cluster:1
  953. 2014-11-26 23:58:20,960 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) FirstFitAllocator has 5 hosts to check for allocation: [Host[-2-Routing], Host[-3-Routing], Host[-1-Routing], Host[-5-Routing], Host[-4-Routing]]
  954. 2014-11-26 23:58:20,977 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Found 5 hosts for allocation after prioritization: [Host[-2-Routing], Host[-3-Routing], Host[-1-Routing], Host[-5-Routing], Host[-4-Routing]]
  955. 2014-11-26 23:58:20,977 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=1024
  956. 2014-11-26 23:58:20,977 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host name: cloud-host10.cgg.gov.in, hostId: 2 is in avoid set, skipping this and trying other available hosts
  957. 2014-11-26 23:58:20,977 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host name: cloud-host8.cgg.gov.in, hostId: 3 is in avoid set, skipping this and trying other available hosts
  958. 2014-11-26 23:58:20,977 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host name: cloud-host6.cgg.gov.in, hostId: 1 is in avoid set, skipping this and trying other available hosts
  959. 2014-11-26 23:58:20,977 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host name: cloud-host7.cgg.gov.in, hostId: 5 is in avoid set, skipping this and trying other available hosts
  960. 2014-11-26 23:58:20,994 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host: 4 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  961. 2014-11-26 23:58:20,994 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Checking if host: 4 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  962. 2014-11-26 23:58:21,000 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  963. 2014-11-26 23:58:21,000 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  964. 2014-11-26 23:58:21,000 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Free RAM: 132226129920 , Requested RAM: 1073741824
  965. 2014-11-26 23:58:21,000 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host has enough CPU and RAM available
  966. 2014-11-26 23:58:21,000 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 4, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  967. 2014-11-26 23:58:21,000 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 4, used: 0, reserved: 0, total: 132226129920; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  968. 2014-11-26 23:58:21,000 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Found a suitable host, adding to list: 4
  969. 2014-11-26 23:58:21,000 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host Allocator returning 1 suitable hosts
  970. 2014-11-26 23:58:21,004 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Checking suitable pools for volume (Id, Type): (1,ROOT)
  971. 2014-11-26 23:58:21,004 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) We need to allocate new storagepool for this volume
  972. 2014-11-26 23:58:21,004 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Calling StoragePoolAllocators to find suitable pools
  973. 2014-11-26 23:58:21,011 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (consoleproxy-1:ctx-4137fc8f) LocalStoragePoolAllocator trying to find storage pool to fit the vm
  974. 2014-11-26 23:58:21,011 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-4137fc8f) ClusterScopeStoragePoolAllocator looking for storage pool
  975. 2014-11-26 23:58:21,011 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-4137fc8f) Looking for pools in dc: 1 pod:1 cluster:1
  976. 2014-11-26 23:58:21,016 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-4137fc8f) Found pools matching tags: [Pool[2|PreSetup]]
  977. 2014-11-26 23:58:21,019 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-4137fc8f) Removing pool Pool[2|PreSetup] from avoid set, must have been inserted when searching for another disk's tag
  978. 2014-11-26 23:58:21,022 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] (consoleproxy-1:ctx-4137fc8f) Checking if storage pool is suitable, name: null ,poolId: 2
  979. 2014-11-26 23:58:21,031 DEBUG [c.c.s.StorageManagerImpl] (consoleproxy-1:ctx-4137fc8f) Checking pool 2 for storage, totalSize: 1649254858752, usedBytes: 297795584, usedPct: 1.8056371483140182E-4, disable threshold: 0.85
  980. 2014-11-26 23:58:21,041 DEBUG [c.c.s.StorageManagerImpl] (consoleproxy-1:ctx-4137fc8f) Checking pool: 2 for volume allocation [Vol[1|vm=1|ROOT]], maxSize : 1649254858752, totalAllocatedSize : 0, askingSize : 0, allocated disable threshold: 0.85
  981. 2014-11-26 23:58:21,041 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-4137fc8f) ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
  982. 2014-11-26 23:58:21,041 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Trying to find a potenial host and associated storage pools from the suitable host/pool lists for this VM
  983. 2014-11-26 23:58:21,041 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Checking if host: 4 can access any suitable storage pool for volume: ROOT
  984. 2014-11-26 23:58:21,042 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Host: 4 can access pool: 2
  985. 2014-11-26 23:58:21,043 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Found a potential host id: 4 name: cloud-host9.cgg.gov.in and associated storage pools for this VM
  986. 2014-11-26 23:58:21,045 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Returning Deployment Destination: Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(4)-Storage(Volume(1|ROOT-->Pool(2))]
  987. 2014-11-26 23:58:21,045 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-4137fc8f) Deployment found - P0=VM[ConsoleProxy|v-1-VM], P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(4)-Storage(Volume(1|ROOT-->Pool(2))]
  988. 2014-11-26 23:58:21,071 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) VM state transitted from :Starting to Starting with event: OperationRetryvm's original host id: null new host id: 4 host id before state transition: 3
  989. 2014-11-26 23:58:21,086 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  990. 2014-11-26 23:58:21,086 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) Hosts's actual total RAM: 132226133760 and RAM after applying overprovisioning: 132226129920
  991. 2014-11-26 23:58:21,086 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) release cpu from host: 3, old used: 1000,reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used: 500,reserved:0; movedfromreserved: false,moveToReserveredfalse
  992. 2014-11-26 23:58:21,086 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) release mem from host: 3, old used: 1610612736,reserved: 0, total: 132226129920; new used: 536870912,reserved:0; movedfromreserved: false,moveToReserveredfalse
  993. 2014-11-26 23:58:21,113 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  994. 2014-11-26 23:58:21,113 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) We are allocating VM, increasing the used capacity of this host:4
  995. 2014-11-26 23:58:21,113 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) Current Used CPU: 0 , Free CPU:88000 ,Requested CPU: 500
  996. 2014-11-26 23:58:21,113 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) Current Used RAM: 0 , Free RAM:132226129920 ,Requested RAM: 1073741824
  997. 2014-11-26 23:58:21,113 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) CPU STATS after allocation: for host: 4, old used: 0, old reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used:500, reserved:0; requested cpu:500,alloc_from_last:false
  998. 2014-11-26 23:58:21,113 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) RAM STATS after allocation: for host: 4, old used: 0, old reserved: 0, total: 132226129920; new used: 1073741824, reserved: 0; requested mem: 1073741824,alloc_from_last:false
  999. 2014-11-26 23:58:21,120 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-4137fc8f) VM is being created in podId: 1
  1000. 2014-11-26 23:58:21,130 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-4137fc8f) Network id=200 is already implemented
  1001. 2014-11-26 23:58:21,181 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-4137fc8f) Network id=202 is already implemented
  1002. 2014-11-26 23:58:21,193 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-7c8a9df1) Found 0 routers to update status.
  1003. 2014-11-26 23:58:21,196 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-7c8a9df1) Found 0 networks to update RvR status.
  1004. 2014-11-26 23:58:21,243 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-4137fc8f) Network id=201 is already implemented
  1005. 2014-11-26 23:58:21,295 DEBUG [c.c.n.g.PodBasedNetworkGuru] (consoleproxy-1:ctx-4137fc8f) Allocated a nic NicProfile[3-1-a27d6142-4790-45a5-8db3-b7fba5d810d0-10.3.4.186-null for VM[ConsoleProxy|v-1-VM]
  1006. 2014-11-26 23:58:21,310 DEBUG [o.a.c.e.o.VolumeOrchestrator] (consoleproxy-1:ctx-4137fc8f) Checking if we need to prepare 1 volumes for VM[ConsoleProxy|v-1-VM]
  1007. 2014-11-26 23:58:21,337 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (consoleproxy-1:ctx-4137fc8f) template 1 is already in store:1, type:Image
  1008. 2014-11-26 23:58:21,348 DEBUG [o.a.c.s.d.PrimaryDataStoreImpl] (consoleproxy-1:ctx-4137fc8f) Not found (templateId:1poolId:2) in template_spool_ref, persisting it
  1009. 2014-11-26 23:58:21,371 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (consoleproxy-1:ctx-4137fc8f) template 1 is already in store:2, type:Primary
  1010. 2014-11-26 23:58:21,374 DEBUG [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-4137fc8f) Found template routing-1 in storage pool 2 with VMTemplateStoragePool id: 665
  1011. 2014-11-26 23:58:21,386 DEBUG [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-4137fc8f) Acquire lock on VMTemplateStoragePool 665 with timeout 3600 seconds
  1012. 2014-11-26 23:58:21,390 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-4137fc8f) lock is acquired for VMTemplateStoragePool 665
  1013. 2014-11-26 23:58:21,403 DEBUG [o.a.c.s.m.AncientDataMotionStrategy] (consoleproxy-1:ctx-4137fc8f) copyAsync inspecting src type TEMPLATE copyAsync inspecting dest type TEMPLATE
  1014. 2014-11-26 23:58:21,427 DEBUG [c.c.a.m.ClusteredAgentAttache] (consoleproxy-1:ctx-4137fc8f) Seq 2-2114716030: Forwarding Seq 2-2114716030: { Cmd , MgmtId: 226850023912365, via: 2(cloud-host10.cgg.gov.in), Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/1/","origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"9cd0b1ae-758b-11e4-aa51-ba311310a163","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.3.4.40/ibm/share1","_role":"Image"}},"name":"routing-1","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"9cd0b1ae-758b-11e4-aa51-ba311310a163","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"CloudStore-2","id":2,"poolType":"PreSetup","host":"localhost","path":"/CloudStore-2","port":0,"url":"PreSetup://localhost//CloudStore-2/?ROLE=Primary&STOREUUID=CloudStore-2"}},"name":"routing-1","hypervisorType":"XenServer"}},"executeInSequence":false,"options":{},"wait":10800}}] } to 68995168937102
  1015. 2014-11-26 23:58:23,602 DEBUG [c.c.a.t.Request] (AgentManager-Handler-15:null) Seq 2-2114716030: Processing: { Ans: , MgmtId: 226850023912365, via: 2, Ver: v1, Flags: 10, [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 3e1f2113-438a-05e7-1b46-4c9b14d56144","wait":0}}] }
  1016. 2014-11-26 23:58:23,602 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-4137fc8f) Seq 2-2114716030: Received: { Ans: , MgmtId: 226850023912365, via: 2, Ver: v1, Flags: 10, { CopyCmdAnswer } }
  1017. 2014-11-26 23:58:23,624 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-4137fc8f) releasing lock for VMTemplateStoragePool 665
  1018. 2014-11-26 23:58:23,625 WARN [c.c.u.d.Merovingian2] (consoleproxy-1:ctx-4137fc8f) Was unable to find lock for the key template_spool_ref665 and thread id 1994469474
  1019. 2014-11-26 23:58:23,625 DEBUG [o.a.c.e.o.VolumeOrchestrator] (consoleproxy-1:ctx-4137fc8f) Unable to create Vol[1|vm=1|ROOT]:Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 3e1f2113-438a-05e7-1b46-4c9b14d56144
  1020. 2014-11-26 23:58:23,625 INFO [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-4137fc8f) Unable to contact resource.
  1021. com.cloud.exception.StorageUnavailableException: Resource [StoragePool:2] is unreachable: Unable to create Vol[1|vm=1|ROOT]:Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 3e1f2113-438a-05e7-1b46-4c9b14d56144
  1022. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.recreateVolume(VolumeOrchestrator.java:1202)
  1023. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.prepare(VolumeOrchestrator.java:1254)
  1024. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:962)
  1025. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761)
  1026. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:745)
  1027. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.startProxy(ConsoleProxyManagerImpl.java:555)
  1028. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.allocCapacity(ConsoleProxyManagerImpl.java:941)
  1029. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:1666)
  1030. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:157)
  1031. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:118)
  1032. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:35)
  1033. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:88)
  1034. at com.cloud.vm.SystemVmLoadScanner$1.runInContext(SystemVmLoadScanner.java:79)
  1035. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  1036. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  1037. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  1038. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  1039. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  1040. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  1041. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
  1042. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
  1043. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
  1044. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  1045. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  1046. at java.lang.Thread.run(Thread.java:744)
  1047. 2014-11-26 23:58:23,633 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-4137fc8f) Cleaning up resources for the vm VM[ConsoleProxy|v-1-VM] in Starting state
  1048. 2014-11-26 23:58:23,643 DEBUG [c.c.a.m.ClusteredAgentAttache] (consoleproxy-1:ctx-4137fc8f) Seq 4-853737853: Forwarding Seq 4-853737853: { Cmd , MgmtId: 226850023912365, via: 4(cloud-host9.cgg.gov.in), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"v-1-VM","wait":0}}] } to 68995168937102
  1049. 2014-11-26 23:58:23,749 DEBUG [c.c.a.t.Request] (AgentManager-Handler-1:null) Seq 4-853737853: Processing: { Ans: , MgmtId: 226850023912365, via: 4, Ver: v1, Flags: 10, [{"com.cloud.agent.api.StopAnswer":{"result":true,"details":"VM does not exist","wait":0}}] }
  1050. 2014-11-26 23:58:23,749 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-4137fc8f) Seq 4-853737853: Received: { Ans: , MgmtId: 226850023912365, via: 4, Ver: v1, Flags: 10, { StopAnswer } }
  1051. 2014-11-26 23:58:23,775 DEBUG [c.c.n.g.ControlNetworkGuru] (consoleproxy-1:ctx-4137fc8f) Released nic: NicProfile[2-1-null-null-null
  1052. 2014-11-26 23:58:23,797 DEBUG [c.c.d.d.DataCenterIpAddressDaoImpl] (consoleproxy-1:ctx-4137fc8f) Releasing ip address for reservationId=a27d6142-4790-45a5-8db3-b7fba5d810d0, instance=3
  1053. 2014-11-26 23:58:23,799 DEBUG [c.c.n.g.PodBasedNetworkGuru] (consoleproxy-1:ctx-4137fc8f) Released nic: NicProfile[3-1-null-null-null
  1054. 2014-11-26 23:58:23,820 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-4137fc8f) Successfully released network resources for the vm VM[ConsoleProxy|v-1-VM]
  1055. 2014-11-26 23:58:23,820 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-4137fc8f) Successfully cleanued up resources for the vm VM[ConsoleProxy|v-1-VM] in Starting state
  1056. 2014-11-26 23:58:23,830 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Deploy avoids pods: null, clusters: null, hosts: [1, 2, 3, 4, 5]
  1057. 2014-11-26 23:58:23,833 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@1ca8cb54
  1058. 2014-11-26 23:58:23,833 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Trying to allocate a host and storage pools from dc:1, pod:1,cluster:null, requested cpu: 500, requested ram: 1073741824
  1059. 2014-11-26 23:58:23,833 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Is ROOT volume READY (pool already allocated)?: No
  1060. 2014-11-26 23:58:23,833 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-4137fc8f) Searching resources only under specified Pod: 1
  1061. 2014-11-26 23:58:23,833 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-4137fc8f) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Pod: 1
  1062. 2014-11-26 23:58:23,854 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Checking resources in Cluster: 1 under Pod: 1
  1063. 2014-11-26 23:58:23,854 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Looking for hosts in dc: 1 pod:1 cluster:1
  1064. 2014-11-26 23:58:23,863 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) FirstFitAllocator has 5 hosts to check for allocation: [Host[-1-Routing], Host[-4-Routing], Host[-2-Routing], Host[-5-Routing], Host[-3-Routing]]
  1065. 2014-11-26 23:58:23,882 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Found 5 hosts for allocation after prioritization: [Host[-1-Routing], Host[-4-Routing], Host[-2-Routing], Host[-5-Routing], Host[-3-Routing]]
  1066. 2014-11-26 23:58:23,882 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=1024
  1067. 2014-11-26 23:58:23,882 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host name: cloud-host6.cgg.gov.in, hostId: 1 is in avoid set, skipping this and trying other available hosts
  1068. 2014-11-26 23:58:23,882 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host name: cloud-host9.cgg.gov.in, hostId: 4 is in avoid set, skipping this and trying other available hosts
  1069. 2014-11-26 23:58:23,882 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host name: cloud-host10.cgg.gov.in, hostId: 2 is in avoid set, skipping this and trying other available hosts
  1070. 2014-11-26 23:58:23,882 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host name: cloud-host7.cgg.gov.in, hostId: 5 is in avoid set, skipping this and trying other available hosts
  1071. 2014-11-26 23:58:23,882 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host name: cloud-host8.cgg.gov.in, hostId: 3 is in avoid set, skipping this and trying other available hosts
  1072. 2014-11-26 23:58:23,882 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-4137fc8f FirstFitRoutingAllocator) Host Allocator returning 0 suitable hosts
  1073. 2014-11-26 23:58:23,882 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) No suitable hosts found
  1074. 2014-11-26 23:58:23,882 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) No suitable hosts found under this Cluster: 1
  1075. 2014-11-26 23:58:23,887 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-4137fc8f) Could not find suitable Deployment Destination for this VM under any clusters, returning.
  1076. 2014-11-26 23:58:23,887 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-4137fc8f) Searching resources only under specified Pod: 1
  1077. 2014-11-26 23:58:23,887 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-4137fc8f) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Pod: 1
  1078. 2014-11-26 23:58:23,896 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-4137fc8f) Removing from the clusterId list these clusters from avoid set: [1]
  1079. 2014-11-26 23:58:23,897 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-4137fc8f) No clusters found after removing disabled clusters and clusters in avoid list, returning.
  1080. 2014-11-26 23:58:23,920 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: 4
  1081. 2014-11-26 23:58:23,934 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  1082. 2014-11-26 23:58:23,934 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) Hosts's actual total RAM: 132226133760 and RAM after applying overprovisioning: 132226129920
  1083. 2014-11-26 23:58:23,934 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) release cpu from host: 4, old used: 500,reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  1084. 2014-11-26 23:58:23,934 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-4137fc8f) release mem from host: 4, old used: 1073741824,reserved: 0, total: 132226129920; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  1085. 2014-11-26 23:58:23,941 WARN [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-4137fc8f) Exception while trying to start console proxy
  1086. com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-1-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  1087. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:921)
  1088. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761)
  1089. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:745)
  1090. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.startProxy(ConsoleProxyManagerImpl.java:555)
  1091. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.allocCapacity(ConsoleProxyManagerImpl.java:941)
  1092. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:1666)
  1093. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:157)
  1094. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:118)
  1095. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:35)
  1096. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:88)
  1097. at com.cloud.vm.SystemVmLoadScanner$1.runInContext(SystemVmLoadScanner.java:79)
  1098. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  1099. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  1100. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  1101. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  1102. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  1103. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  1104. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
  1105. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
  1106. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
  1107. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  1108. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  1109. at java.lang.Thread.run(Thread.java:744)
  1110. 2014-11-26 23:58:39,247 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-9a467cf9) Zone 1 is ready to launch console proxy
  1111. 2014-11-26 23:58:39,247 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-9a467cf9) Expand console proxy standby capacity for zone CGG-Zone1
  1112. 2014-11-26 23:58:39,260 INFO [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-9a467cf9) Found a stopped console proxy, bring it up to running pool. proxy vm id : 1
  1113. 2014-11-26 23:58:39,299 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
  1114. 2014-11-26 23:58:39,299 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9a467cf9) Successfully transitioned to start state for VM[ConsoleProxy|v-1-VM] reservation id = ee5c186f-0673-4daa-ac94-90daf20040ff
  1115. 2014-11-26 23:58:39,305 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9a467cf9) Trying to deploy VM, vm has dcId: 1 and podId: 1
  1116. 2014-11-26 23:58:39,305 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9a467cf9) Deploy avoids pods: null, clusters: null, hosts: null
  1117. 2014-11-26 23:58:39,317 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Deploy avoids pods: null, clusters: null, hosts: null
  1118. 2014-11-26 23:58:39,320 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@1ca8cb54
  1119. 2014-11-26 23:58:39,320 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Trying to allocate a host and storage pools from dc:1, pod:1,cluster:null, requested cpu: 500, requested ram: 1073741824
  1120. 2014-11-26 23:58:39,320 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Is ROOT volume READY (pool already allocated)?: No
  1121. 2014-11-26 23:58:39,320 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-9a467cf9) Searching resources only under specified Pod: 1
  1122. 2014-11-26 23:58:39,320 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-9a467cf9) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Pod: 1
  1123. 2014-11-26 23:58:39,343 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Checking resources in Cluster: 1 under Pod: 1
  1124. 2014-11-26 23:58:39,343 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Looking for hosts in dc: 1 pod:1 cluster:1
  1125. 2014-11-26 23:58:39,351 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) FirstFitAllocator has 5 hosts to check for allocation: [Host[-2-Routing], Host[-5-Routing], Host[-4-Routing], Host[-3-Routing], Host[-1-Routing]]
  1126. 2014-11-26 23:58:39,358 DEBUG [c.c.s.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-b4dab2a3) Zone 1 is ready to launch secondary storage VM
  1127. 2014-11-26 23:58:39,369 INFO [c.c.s.PremiumSecondaryStorageManagerImpl] (secstorage-1:ctx-b4dab2a3) No running secondary storage vms found in datacenter id=1, starting one
  1128. 2014-11-26 23:58:39,369 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Found 5 hosts for allocation after prioritization: [Host[-2-Routing], Host[-5-Routing], Host[-4-Routing], Host[-3-Routing], Host[-1-Routing]]
  1129. 2014-11-26 23:58:39,369 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=1024
  1130. 2014-11-26 23:58:39,379 INFO [c.c.s.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-b4dab2a3) No stopped secondary storage vm is available, need to allocate a new secondary storage vm
  1131. 2014-11-26 23:58:39,384 DEBUG [c.c.s.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-b4dab2a3) Assign secondary storage vm from a newly started instance for request from data center : 1
  1132. 2014-11-26 23:58:39,385 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host: 2 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  1133. 2014-11-26 23:58:39,385 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Checking if host: 2 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  1134. 2014-11-26 23:58:39,392 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  1135. 2014-11-26 23:58:39,392 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  1136. 2014-11-26 23:58:39,392 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Free RAM: 132226129920 , Requested RAM: 1073741824
  1137. 2014-11-26 23:58:39,392 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host has enough CPU and RAM available
  1138. 2014-11-26 23:58:39,392 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 2, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1139. 2014-11-26 23:58:39,392 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 2, used: 0, reserved: 0, total: 132226129920; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1140. 2014-11-26 23:58:39,392 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Found a suitable host, adding to list: 2
  1141. 2014-11-26 23:58:39,409 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host: 5 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  1142. 2014-11-26 23:58:39,409 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Checking if host: 5 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  1143. 2014-11-26 23:58:39,410 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-b4dab2a3) Found existing network configuration for offering [Network Offering [1-Public-System-Public-Network]: Ntwk[200|Public|1]
  1144. 2014-11-26 23:58:39,410 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-b4dab2a3) Releasing lock for Acct[c6a1e0a2-758b-11e4-aa51-ba311310a163-system]
  1145. 2014-11-26 23:58:39,416 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  1146. 2014-11-26 23:58:39,416 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  1147. 2014-11-26 23:58:39,416 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Free RAM: 132226129920 , Requested RAM: 1073741824
  1148. 2014-11-26 23:58:39,416 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host has enough CPU and RAM available
  1149. 2014-11-26 23:58:39,416 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 5, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1150. 2014-11-26 23:58:39,416 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 5, used: 0, reserved: 0, total: 132226129920; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1151. 2014-11-26 23:58:39,416 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Found a suitable host, adding to list: 5
  1152. 2014-11-26 23:58:39,418 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-b4dab2a3) Found existing network configuration for offering [Network Offering [3-Control-System-Control-Network]: Ntwk[202|Control|3]
  1153. 2014-11-26 23:58:39,418 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-b4dab2a3) Releasing lock for Acct[c6a1e0a2-758b-11e4-aa51-ba311310a163-system]
  1154. 2014-11-26 23:58:39,426 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-b4dab2a3) Found existing network configuration for offering [Network Offering [2-Management-System-Management-Network]: Ntwk[201|Management|2]
  1155. 2014-11-26 23:58:39,426 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-b4dab2a3) Releasing lock for Acct[c6a1e0a2-758b-11e4-aa51-ba311310a163-system]
  1156. 2014-11-26 23:58:39,433 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-b4dab2a3) Found existing network configuration for offering [Network Offering [4-Storage-System-Storage-Network]: Ntwk[203|Storage|4]
  1157. 2014-11-26 23:58:39,433 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-b4dab2a3) Releasing lock for Acct[c6a1e0a2-758b-11e4-aa51-ba311310a163-system]
  1158. 2014-11-26 23:58:39,435 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host: 4 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  1159. 2014-11-26 23:58:39,435 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Checking if host: 4 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  1160. 2014-11-26 23:58:39,442 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  1161. 2014-11-26 23:58:39,442 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  1162. 2014-11-26 23:58:39,442 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Free RAM: 132226129920 , Requested RAM: 1073741824
  1163. 2014-11-26 23:58:39,442 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host has enough CPU and RAM available
  1164. 2014-11-26 23:58:39,442 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 4, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1165. 2014-11-26 23:58:39,442 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 4, used: 0, reserved: 0, total: 132226129920; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1166. 2014-11-26 23:58:39,442 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Found a suitable host, adding to list: 4
  1167. 2014-11-26 23:58:39,457 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host: 3 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  1168. 2014-11-26 23:58:39,457 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Checking if host: 3 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  1169. 2014-11-26 23:58:39,462 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  1170. 2014-11-26 23:58:39,462 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  1171. 2014-11-26 23:58:39,462 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Free RAM: 132226129920 , Requested RAM: 1073741824
  1172. 2014-11-26 23:58:39,462 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host has enough CPU and RAM available
  1173. 2014-11-26 23:58:39,462 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 3, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1174. 2014-11-26 23:58:39,462 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 3, used: 0, reserved: 0, total: 132226129920; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1175. 2014-11-26 23:58:39,462 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Found a suitable host, adding to list: 3
  1176. 2014-11-26 23:58:39,477 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host: 1 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  1177. 2014-11-26 23:58:39,477 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  1178. 2014-11-26 23:58:39,482 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  1179. 2014-11-26 23:58:39,482 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  1180. 2014-11-26 23:58:39,482 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Free RAM: 130926600192 , Requested RAM: 1073741824
  1181. 2014-11-26 23:58:39,482 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host has enough CPU and RAM available
  1182. 2014-11-26 23:58:39,482 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 1, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1183. 2014-11-26 23:58:39,482 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 1, used: 0, reserved: 0, total: 130926600192; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1184. 2014-11-26 23:58:39,482 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Found a suitable host, adding to list: 1
  1185. 2014-11-26 23:58:39,482 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host Allocator returning 5 suitable hosts
  1186. 2014-11-26 23:58:39,485 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Checking suitable pools for volume (Id, Type): (1,ROOT)
  1187. 2014-11-26 23:58:39,485 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) We need to allocate new storagepool for this volume
  1188. 2014-11-26 23:58:39,485 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Calling StoragePoolAllocators to find suitable pools
  1189. 2014-11-26 23:58:39,487 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (consoleproxy-1:ctx-9a467cf9) LocalStoragePoolAllocator trying to find storage pool to fit the vm
  1190. 2014-11-26 23:58:39,488 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9a467cf9) ClusterScopeStoragePoolAllocator looking for storage pool
  1191. 2014-11-26 23:58:39,488 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9a467cf9) Looking for pools in dc: 1 pod:1 cluster:1
  1192. 2014-11-26 23:58:39,490 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9a467cf9) Found pools matching tags: [Pool[2|PreSetup]]
  1193. 2014-11-26 23:58:39,492 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9a467cf9) Removing pool Pool[2|PreSetup] from avoid set, must have been inserted when searching for another disk's tag
  1194. 2014-11-26 23:58:39,494 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-b4dab2a3) Allocating entries for VM: VM[SecondaryStorageVm|s-135-VM]
  1195. 2014-11-26 23:58:39,495 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] (consoleproxy-1:ctx-9a467cf9) Checking if storage pool is suitable, name: null ,poolId: 2
  1196. 2014-11-26 23:58:39,504 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-b4dab2a3) Allocating nics for VM[SecondaryStorageVm|s-135-VM]
  1197. 2014-11-26 23:58:39,506 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-b4dab2a3) Allocating nic for vm VM[SecondaryStorageVm|s-135-VM] in network Ntwk[200|Public|1] with requested profile NicProfile[0-0-null-null-null
  1198. 2014-11-26 23:58:39,506 DEBUG [c.c.s.StorageManagerImpl] (consoleproxy-1:ctx-9a467cf9) Checking pool 2 for storage, totalSize: 1649254858752, usedBytes: 297795584, usedPct: 1.8056371483140182E-4, disable threshold: 0.85
  1199. 2014-11-26 23:58:39,513 DEBUG [c.c.s.StorageManagerImpl] (consoleproxy-1:ctx-9a467cf9) Checking pool: 2 for volume allocation [Vol[1|vm=1|ROOT]], maxSize : 1649254858752, totalAllocatedSize : 0, askingSize : 0, allocated disable threshold: 0.85
  1200. 2014-11-26 23:58:39,513 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9a467cf9) ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
  1201. 2014-11-26 23:58:39,514 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Trying to find a potenial host and associated storage pools from the suitable host/pool lists for this VM
  1202. 2014-11-26 23:58:39,514 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Checking if host: 2 can access any suitable storage pool for volume: ROOT
  1203. 2014-11-26 23:58:39,515 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Host: 2 can access pool: 2
  1204. 2014-11-26 23:58:39,522 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Found a potential host id: 2 name: cloud-host10.cgg.gov.in and associated storage pools for this VM
  1205. 2014-11-26 23:58:39,525 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Returning Deployment Destination: Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(2)-Storage(Volume(1|ROOT-->Pool(2))]
  1206. 2014-11-26 23:58:39,525 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9a467cf9) Deployment found - P0=VM[ConsoleProxy|v-1-VM], P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(2)-Storage(Volume(1|ROOT-->Pool(2))]
  1207. 2014-11-26 23:58:39,538 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-b4dab2a3) Allocating nic for vm VM[SecondaryStorageVm|s-135-VM] in network Ntwk[202|Control|3] with requested profile null
  1208. 2014-11-26 23:58:39,550 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) VM state transitted from :Starting to Starting with event: OperationRetryvm's original host id: null new host id: 2 host id before state transition: null
  1209. 2014-11-26 23:58:39,555 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-b4dab2a3) Allocating nic for vm VM[SecondaryStorageVm|s-135-VM] in network Ntwk[201|Management|2] with requested profile null
  1210. 2014-11-26 23:58:39,567 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  1211. 2014-11-26 23:58:39,567 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) We are allocating VM, increasing the used capacity of this host:2
  1212. 2014-11-26 23:58:39,567 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) Current Used CPU: 0 , Free CPU:88000 ,Requested CPU: 500
  1213. 2014-11-26 23:58:39,567 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) Current Used RAM: 0 , Free RAM:132226129920 ,Requested RAM: 1073741824
  1214. 2014-11-26 23:58:39,567 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) CPU STATS after allocation: for host: 2, old used: 0, old reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used:500, reserved:0; requested cpu:500,alloc_from_last:false
  1215. 2014-11-26 23:58:39,567 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) RAM STATS after allocation: for host: 2, old used: 0, old reserved: 0, total: 132226129920; new used: 1073741824, reserved: 0; requested mem: 1073741824,alloc_from_last:false
  1216. 2014-11-26 23:58:39,573 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9a467cf9) VM is being created in podId: 1
  1217. 2014-11-26 23:58:39,577 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-b4dab2a3) Allocating nic for vm VM[SecondaryStorageVm|s-135-VM] in network Ntwk[203|Storage|4] with requested profile null
  1218. 2014-11-26 23:58:39,582 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-9a467cf9) Network id=200 is already implemented
  1219. 2014-11-26 23:58:39,596 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-b4dab2a3) Allocating disks for VM[SecondaryStorageVm|s-135-VM]
  1220. 2014-11-26 23:58:39,604 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-b4dab2a3) Allocation completed for VM: VM[SecondaryStorageVm|s-135-VM]
  1221. 2014-11-26 23:58:39,619 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-b4dab2a3) received secondary storage vm alert
  1222. 2014-11-26 23:58:39,619 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-b4dab2a3) New secondary storage vm created, zone: CGG-Zone1, secStorageVm: s-135-VM, public IP: null, private IP: null
  1223. 2014-11-26 23:58:39,624 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-9a467cf9) Network id=202 is already implemented
  1224. 2014-11-26 23:58:39,649 DEBUG [c.c.s.StatsCollector] (StatsCollector-3:ctx-7b00bf53) StorageCollector is running...
  1225. 2014-11-26 23:58:39,655 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
  1226. 2014-11-26 23:58:39,655 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-b4dab2a3) Successfully transitioned to start state for VM[SecondaryStorageVm|s-135-VM] reservation id = c8b34105-e8ee-4fc3-9817-4e891ccf38ef
  1227. 2014-11-26 23:58:39,657 DEBUG [c.c.s.StatsCollector] (StatsCollector-3:ctx-7b00bf53) There is no secondary storage VM for secondary storage host Zone1-secStore1
  1228. 2014-11-26 23:58:39,661 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-b4dab2a3) Trying to deploy VM, vm has dcId: 1 and podId: null
  1229. 2014-11-26 23:58:39,661 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-b4dab2a3) Deploy avoids pods: null, clusters: null, hosts: null
  1230. 2014-11-26 23:58:39,663 DEBUG [c.c.a.m.ClusteredAgentAttache] (StatsCollector-3:ctx-7b00bf53) Seq 5-1497235806: Forwarding null to 68995168937102
  1231. 2014-11-26 23:58:39,672 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-b4dab2a3) Deploy avoids pods: null, clusters: null, hosts: null
  1232. 2014-11-26 23:58:39,674 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-b4dab2a3) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@1ca8cb54
  1233. 2014-11-26 23:58:39,674 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-b4dab2a3) Trying to allocate a host and storage pools from dc:1, pod:null,cluster:null, requested cpu: 500, requested ram: 536870912
  1234. 2014-11-26 23:58:39,674 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-b4dab2a3) Is ROOT volume READY (pool already allocated)?: No
  1235. 2014-11-26 23:58:39,675 DEBUG [c.c.d.FirstFitPlanner] (secstorage-1:ctx-b4dab2a3) Searching all possible resources under this Zone: 1
  1236. 2014-11-26 23:58:39,677 DEBUG [c.c.d.FirstFitPlanner] (secstorage-1:ctx-b4dab2a3) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
  1237. 2014-11-26 23:58:39,683 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-9a467cf9) Network id=201 is already implemented
  1238. 2014-11-26 23:58:39,699 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-b4dab2a3) Checking resources in Cluster: 1 under Pod: 1
  1239. 2014-11-26 23:58:39,699 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) Looking for hosts in dc: 1 pod:1 cluster:1
  1240. 2014-11-26 23:58:39,707 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) FirstFitAllocator has 5 hosts to check for allocation: [Host[-1-Routing], Host[-5-Routing], Host[-3-Routing], Host[-2-Routing], Host[-4-Routing]]
  1241. 2014-11-26 23:58:39,725 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) Found 5 hosts for allocation after prioritization: [Host[-1-Routing], Host[-5-Routing], Host[-3-Routing], Host[-2-Routing], Host[-4-Routing]]
  1242. 2014-11-26 23:58:39,725 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=512
  1243. 2014-11-26 23:58:39,734 DEBUG [c.c.n.g.PodBasedNetworkGuru] (consoleproxy-1:ctx-9a467cf9) Allocated a nic NicProfile[3-1-ee5c186f-0673-4daa-ac94-90daf20040ff-10.3.4.121-null for VM[ConsoleProxy|v-1-VM]
  1244. 2014-11-26 23:58:39,741 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) Host: 1 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  1245. 2014-11-26 23:58:39,741 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 536870912 , cpuOverprovisioningFactor: 1.0
  1246. 2014-11-26 23:58:39,746 DEBUG [o.a.c.e.o.VolumeOrchestrator] (consoleproxy-1:ctx-9a467cf9) Checking if we need to prepare 1 volumes for VM[ConsoleProxy|v-1-VM]
  1247. 2014-11-26 23:58:39,748 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  1248. 2014-11-26 23:58:39,748 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  1249. 2014-11-26 23:58:39,748 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) Free RAM: 130926600192 , Requested RAM: 536870912
  1250. 2014-11-26 23:58:39,748 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) Host has enough CPU and RAM available
  1251. 2014-11-26 23:58:39,748 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 1, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1252. 2014-11-26 23:58:39,748 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 1, used: 0, reserved: 0, total: 130926600192; requested mem: 536870912,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1253. 2014-11-26 23:58:39,748 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) Found a suitable host, adding to list: 1
  1254. 2014-11-26 23:58:39,764 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) Host: 5 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  1255. 2014-11-26 23:58:39,764 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) Checking if host: 5 has enough capacity for requested CPU: 500 and requested RAM: 536870912 , cpuOverprovisioningFactor: 1.0
  1256. 2014-11-26 23:58:39,769 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  1257. 2014-11-26 23:58:39,769 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  1258. 2014-11-26 23:58:39,769 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) Free RAM: 132226129920 , Requested RAM: 536870912
  1259. 2014-11-26 23:58:39,769 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) Host has enough CPU and RAM available
  1260. 2014-11-26 23:58:39,770 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 5, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1261. 2014-11-26 23:58:39,770 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 5, used: 0, reserved: 0, total: 132226129920; requested mem: 536870912,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1262. 2014-11-26 23:58:39,770 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) Found a suitable host, adding to list: 5
  1263. 2014-11-26 23:58:39,774 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (consoleproxy-1:ctx-9a467cf9) template 1 is already in store:1, type:Image
  1264. 2014-11-26 23:58:39,788 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) Host: 3 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  1265. 2014-11-26 23:58:39,788 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) Checking if host: 3 has enough capacity for requested CPU: 500 and requested RAM: 536870912 , cpuOverprovisioningFactor: 1.0
  1266. 2014-11-26 23:58:39,794 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  1267. 2014-11-26 23:58:39,794 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  1268. 2014-11-26 23:58:39,794 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) Free RAM: 132226129920 , Requested RAM: 536870912
  1269. 2014-11-26 23:58:39,794 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) Host has enough CPU and RAM available
  1270. 2014-11-26 23:58:39,794 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 3, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1271. 2014-11-26 23:58:39,794 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 3, used: 0, reserved: 0, total: 132226129920; requested mem: 536870912,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1272. 2014-11-26 23:58:39,794 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) Found a suitable host, adding to list: 3
  1273. 2014-11-26 23:58:39,799 DEBUG [o.a.c.s.d.PrimaryDataStoreImpl] (consoleproxy-1:ctx-9a467cf9) Not found (templateId:1poolId:2) in template_spool_ref, persisting it
  1274. 2014-11-26 23:58:39,810 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) Host: 2 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  1275. 2014-11-26 23:58:39,810 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) Checking if host: 2 has enough capacity for requested CPU: 500 and requested RAM: 536870912 , cpuOverprovisioningFactor: 1.0
  1276. 2014-11-26 23:58:39,812 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (consoleproxy-1:ctx-9a467cf9) template 1 is already in store:2, type:Primary
  1277. 2014-11-26 23:58:39,814 DEBUG [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-9a467cf9) Found template routing-1 in storage pool 2 with VMTemplateStoragePool id: 666
  1278. 2014-11-26 23:58:39,818 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  1279. 2014-11-26 23:58:39,818 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) Free CPU: 87500 , Requested CPU: 500
  1280. 2014-11-26 23:58:39,818 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) Free RAM: 131152388096 , Requested RAM: 536870912
  1281. 2014-11-26 23:58:39,818 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) Host has enough CPU and RAM available
  1282. 2014-11-26 23:58:39,818 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 2, used: 500, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1283. 2014-11-26 23:58:39,818 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 2, used: 1073741824, reserved: 0, total: 132226129920; requested mem: 536870912,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1284. 2014-11-26 23:58:39,818 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) Found a suitable host, adding to list: 2
  1285. 2014-11-26 23:58:39,821 DEBUG [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-9a467cf9) Acquire lock on VMTemplateStoragePool 666 with timeout 3600 seconds
  1286. 2014-11-26 23:58:39,824 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-9a467cf9) lock is acquired for VMTemplateStoragePool 666
  1287. 2014-11-26 23:58:39,831 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) Host: 4 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  1288. 2014-11-26 23:58:39,831 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) Checking if host: 4 has enough capacity for requested CPU: 500 and requested RAM: 536870912 , cpuOverprovisioningFactor: 1.0
  1289. 2014-11-26 23:58:39,836 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  1290. 2014-11-26 23:58:39,836 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  1291. 2014-11-26 23:58:39,836 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) Free RAM: 132226129920 , Requested RAM: 536870912
  1292. 2014-11-26 23:58:39,836 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) Host has enough CPU and RAM available
  1293. 2014-11-26 23:58:39,836 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 4, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1294. 2014-11-26 23:58:39,836 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 4, used: 0, reserved: 0, total: 132226129920; requested mem: 536870912,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1295. 2014-11-26 23:58:39,836 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) Found a suitable host, adding to list: 4
  1296. 2014-11-26 23:58:39,836 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-b4dab2a3 FirstFitRoutingAllocator) Host Allocator returning 5 suitable hosts
  1297. 2014-11-26 23:58:39,838 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-b4dab2a3) Checking suitable pools for volume (Id, Type): (135,ROOT)
  1298. 2014-11-26 23:58:39,838 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-b4dab2a3) We need to allocate new storagepool for this volume
  1299. 2014-11-26 23:58:39,838 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-b4dab2a3) Calling StoragePoolAllocators to find suitable pools
  1300. 2014-11-26 23:58:39,841 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (secstorage-1:ctx-b4dab2a3) LocalStoragePoolAllocator trying to find storage pool to fit the vm
  1301. 2014-11-26 23:58:39,841 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (secstorage-1:ctx-b4dab2a3) ClusterScopeStoragePoolAllocator looking for storage pool
  1302. 2014-11-26 23:58:39,841 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (secstorage-1:ctx-b4dab2a3) Looking for pools in dc: 1 pod:1 cluster:1
  1303. 2014-11-26 23:58:39,843 DEBUG [o.a.c.s.m.AncientDataMotionStrategy] (consoleproxy-1:ctx-9a467cf9) copyAsync inspecting src type TEMPLATE copyAsync inspecting dest type TEMPLATE
  1304. 2014-11-26 23:58:39,844 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (secstorage-1:ctx-b4dab2a3) Found pools matching tags: [Pool[2|PreSetup]]
  1305. 2014-11-26 23:58:39,846 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (secstorage-1:ctx-b4dab2a3) Removing pool Pool[2|PreSetup] from avoid set, must have been inserted when searching for another disk's tag
  1306. 2014-11-26 23:58:39,850 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] (secstorage-1:ctx-b4dab2a3) Checking if storage pool is suitable, name: null ,poolId: 2
  1307. 2014-11-26 23:58:39,858 DEBUG [c.c.s.StorageManagerImpl] (secstorage-1:ctx-b4dab2a3) Checking pool 2 for storage, totalSize: 1649254858752, usedBytes: 297795584, usedPct: 1.8056371483140182E-4, disable threshold: 0.85
  1308. 2014-11-26 23:58:39,866 DEBUG [c.c.a.m.ClusteredAgentAttache] (consoleproxy-1:ctx-9a467cf9) Seq 4-853737854: Forwarding Seq 4-853737854: { Cmd , MgmtId: 226850023912365, via: 4(cloud-host9.cgg.gov.in), Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/1/","origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"9cd0b1ae-758b-11e4-aa51-ba311310a163","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.3.4.40/ibm/share1","_role":"Image"}},"name":"routing-1","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"9cd0b1ae-758b-11e4-aa51-ba311310a163","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"CloudStore-2","id":2,"poolType":"PreSetup","host":"localhost","path":"/CloudStore-2","port":0,"url":"PreSetup://localhost//CloudStore-2/?ROLE=Primary&STOREUUID=CloudStore-2"}},"name":"routing-1","hypervisorType":"XenServer"}},"executeInSequence":false,"options":{},"wait":10800}}] } to 68995168937102
  1309. 2014-11-26 23:58:39,866 DEBUG [c.c.s.StorageManagerImpl] (secstorage-1:ctx-b4dab2a3) Checking pool: 2 for volume allocation [Vol[135|vm=135|ROOT]], maxSize : 1649254858752, totalAllocatedSize : 0, askingSize : 0, allocated disable threshold: 0.85
  1310. 2014-11-26 23:58:39,866 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (secstorage-1:ctx-b4dab2a3) ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
  1311. 2014-11-26 23:58:39,866 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-b4dab2a3) Trying to find a potenial host and associated storage pools from the suitable host/pool lists for this VM
  1312. 2014-11-26 23:58:39,866 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-b4dab2a3) Checking if host: 1 can access any suitable storage pool for volume: ROOT
  1313. 2014-11-26 23:58:39,867 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-b4dab2a3) Host: 1 can access pool: 2
  1314. 2014-11-26 23:58:39,875 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-b4dab2a3) Found a potential host id: 1 name: cloud-host6.cgg.gov.in and associated storage pools for this VM
  1315. 2014-11-26 23:58:39,878 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-b4dab2a3) Returning Deployment Destination: Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(1)-Storage(Volume(135|ROOT-->Pool(2))]
  1316. 2014-11-26 23:58:39,878 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-b4dab2a3) Deployment found - P0=VM[SecondaryStorageVm|s-135-VM], P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(1)-Storage(Volume(135|ROOT-->Pool(2))]
  1317. 2014-11-26 23:58:39,906 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3) VM state transitted from :Starting to Starting with event: OperationRetryvm's original host id: null new host id: 1 host id before state transition: null
  1318. 2014-11-26 23:58:39,924 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  1319. 2014-11-26 23:58:39,924 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3) We are allocating VM, increasing the used capacity of this host:1
  1320. 2014-11-26 23:58:39,924 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3) Current Used CPU: 0 , Free CPU:88000 ,Requested CPU: 500
  1321. 2014-11-26 23:58:39,924 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3) Current Used RAM: 0 , Free RAM:130926600192 ,Requested RAM: 536870912
  1322. 2014-11-26 23:58:39,924 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3) CPU STATS after allocation: for host: 1, old used: 0, old reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used:500, reserved:0; requested cpu:500,alloc_from_last:false
  1323. 2014-11-26 23:58:39,924 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3) RAM STATS after allocation: for host: 1, old used: 0, old reserved: 0, total: 130926600192; new used: 536870912, reserved: 0; requested mem: 536870912,alloc_from_last:false
  1324. 2014-11-26 23:58:39,931 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-b4dab2a3) VM is being created in podId: 1
  1325. 2014-11-26 23:58:39,940 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-b4dab2a3) Network id=200 is already implemented
  1326. 2014-11-26 23:58:39,992 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-b4dab2a3) Network id=202 is already implemented
  1327. 2014-11-26 23:58:40,063 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-b4dab2a3) Network id=201 is already implemented
  1328. 2014-11-26 23:58:40,114 DEBUG [c.c.n.g.PodBasedNetworkGuru] (secstorage-1:ctx-b4dab2a3) Allocated a nic NicProfile[538-135-c8b34105-e8ee-4fc3-9817-4e891ccf38ef-10.3.4.120-null for VM[SecondaryStorageVm|s-135-VM]
  1329. 2014-11-26 23:58:40,132 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-b4dab2a3) Network id=203 is already implemented
  1330. 2014-11-26 23:58:40,151 DEBUG [c.c.a.t.Request] (StatsCollector-3:ctx-7b00bf53) Seq 5-1497235806: Received: { Ans: , MgmtId: 226850023912365, via: 5, Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
  1331. 2014-11-26 23:58:40,187 DEBUG [c.c.n.g.PodBasedNetworkGuru] (secstorage-1:ctx-b4dab2a3) Allocated a nic NicProfile[539-135-c8b34105-e8ee-4fc3-9817-4e891ccf38ef-10.3.4.175-null for VM[SecondaryStorageVm|s-135-VM]
  1332. 2014-11-26 23:58:40,201 DEBUG [o.a.c.e.o.VolumeOrchestrator] (secstorage-1:ctx-b4dab2a3) Checking if we need to prepare 1 volumes for VM[SecondaryStorageVm|s-135-VM]
  1333. 2014-11-26 23:58:40,229 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (secstorage-1:ctx-b4dab2a3) template 1 is already in store:1, type:Image
  1334. 2014-11-26 23:58:40,242 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (secstorage-1:ctx-b4dab2a3) template 1 is already in store:2, type:Primary
  1335. 2014-11-26 23:58:40,245 DEBUG [o.a.c.s.v.VolumeServiceImpl] (secstorage-1:ctx-b4dab2a3) Found template routing-1 in storage pool 2 with VMTemplateStoragePool id: 666
  1336. 2014-11-26 23:58:40,257 DEBUG [o.a.c.s.v.VolumeServiceImpl] (secstorage-1:ctx-b4dab2a3) Acquire lock on VMTemplateStoragePool 666 with timeout 3600 seconds
  1337. 2014-11-26 23:58:42,052 DEBUG [c.c.a.t.Request] (AgentManager-Handler-3:null) Seq 4-853737854: Processing: { Ans: , MgmtId: 226850023912365, via: 4, Ver: v1, Flags: 10, [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 3e1f2113-438a-05e7-1b46-4c9b14d56144","wait":0}}] }
  1338. 2014-11-26 23:58:42,053 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-9a467cf9) Seq 4-853737854: Received: { Ans: , MgmtId: 226850023912365, via: 4, Ver: v1, Flags: 10, { CopyCmdAnswer } }
  1339. 2014-11-26 23:58:42,075 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-9a467cf9) releasing lock for VMTemplateStoragePool 666
  1340. 2014-11-26 23:58:42,076 WARN [c.c.u.d.Merovingian2] (consoleproxy-1:ctx-9a467cf9) Was unable to find lock for the key template_spool_ref666 and thread id 1994469474
  1341. 2014-11-26 23:58:42,076 DEBUG [o.a.c.e.o.VolumeOrchestrator] (consoleproxy-1:ctx-9a467cf9) Unable to create Vol[1|vm=1|ROOT]:Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 3e1f2113-438a-05e7-1b46-4c9b14d56144
  1342. 2014-11-26 23:58:42,076 INFO [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9a467cf9) Unable to contact resource.
  1343. com.cloud.exception.StorageUnavailableException: Resource [StoragePool:2] is unreachable: Unable to create Vol[1|vm=1|ROOT]:Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 3e1f2113-438a-05e7-1b46-4c9b14d56144
  1344. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.recreateVolume(VolumeOrchestrator.java:1202)
  1345. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.prepare(VolumeOrchestrator.java:1254)
  1346. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:962)
  1347. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761)
  1348. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:745)
  1349. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.startProxy(ConsoleProxyManagerImpl.java:555)
  1350. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.allocCapacity(ConsoleProxyManagerImpl.java:941)
  1351. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:1666)
  1352. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:157)
  1353. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:118)
  1354. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:35)
  1355. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:88)
  1356. at com.cloud.vm.SystemVmLoadScanner$1.runInContext(SystemVmLoadScanner.java:79)
  1357. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  1358. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  1359. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  1360. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  1361. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  1362. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  1363. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
  1364. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
  1365. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
  1366. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  1367. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  1368. at java.lang.Thread.run(Thread.java:744)
  1369. 2014-11-26 23:58:42,084 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9a467cf9) Cleaning up resources for the vm VM[ConsoleProxy|v-1-VM] in Starting state
  1370. 2014-11-26 23:58:42,093 DEBUG [c.c.a.m.ClusteredAgentAttache] (consoleproxy-1:ctx-9a467cf9) Seq 2-2114716031: Forwarding Seq 2-2114716031: { Cmd , MgmtId: 226850023912365, via: 2(cloud-host10.cgg.gov.in), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"v-1-VM","wait":0}}] } to 68995168937102
  1371. 2014-11-26 23:58:42,198 DEBUG [c.c.a.t.Request] (AgentManager-Handler-4:null) Seq 2-2114716031: Processing: { Ans: , MgmtId: 226850023912365, via: 2, Ver: v1, Flags: 10, [{"com.cloud.agent.api.StopAnswer":{"result":true,"details":"VM does not exist","wait":0}}] }
  1372. 2014-11-26 23:58:42,198 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-9a467cf9) Seq 2-2114716031: Received: { Ans: , MgmtId: 226850023912365, via: 2, Ver: v1, Flags: 10, { StopAnswer } }
  1373. 2014-11-26 23:58:42,222 DEBUG [c.c.n.g.ControlNetworkGuru] (consoleproxy-1:ctx-9a467cf9) Released nic: NicProfile[2-1-null-null-null
  1374. 2014-11-26 23:58:42,242 DEBUG [c.c.d.d.DataCenterIpAddressDaoImpl] (consoleproxy-1:ctx-9a467cf9) Releasing ip address for reservationId=ee5c186f-0673-4daa-ac94-90daf20040ff, instance=3
  1375. 2014-11-26 23:58:42,243 DEBUG [c.c.n.g.PodBasedNetworkGuru] (consoleproxy-1:ctx-9a467cf9) Released nic: NicProfile[3-1-null-null-null
  1376. 2014-11-26 23:58:42,252 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9a467cf9) Successfully released network resources for the vm VM[ConsoleProxy|v-1-VM]
  1377. 2014-11-26 23:58:42,252 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9a467cf9) Successfully cleanued up resources for the vm VM[ConsoleProxy|v-1-VM] in Starting state
  1378. 2014-11-26 23:58:42,260 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Deploy avoids pods: null, clusters: null, hosts: [2]
  1379. 2014-11-26 23:58:42,262 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@1ca8cb54
  1380. 2014-11-26 23:58:42,262 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Trying to allocate a host and storage pools from dc:1, pod:1,cluster:null, requested cpu: 500, requested ram: 1073741824
  1381. 2014-11-26 23:58:42,262 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Is ROOT volume READY (pool already allocated)?: No
  1382. 2014-11-26 23:58:42,262 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-9a467cf9) Searching resources only under specified Pod: 1
  1383. 2014-11-26 23:58:42,263 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-9a467cf9) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Pod: 1
  1384. 2014-11-26 23:58:42,282 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Checking resources in Cluster: 1 under Pod: 1
  1385. 2014-11-26 23:58:42,282 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Looking for hosts in dc: 1 pod:1 cluster:1
  1386. 2014-11-26 23:58:42,290 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) FirstFitAllocator has 5 hosts to check for allocation: [Host[-5-Routing], Host[-4-Routing], Host[-1-Routing], Host[-2-Routing], Host[-3-Routing]]
  1387. 2014-11-26 23:58:42,308 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Found 5 hosts for allocation after prioritization: [Host[-5-Routing], Host[-4-Routing], Host[-1-Routing], Host[-2-Routing], Host[-3-Routing]]
  1388. 2014-11-26 23:58:42,308 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=1024
  1389. 2014-11-26 23:58:42,322 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host: 5 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  1390. 2014-11-26 23:58:42,322 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Checking if host: 5 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  1391. 2014-11-26 23:58:42,329 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  1392. 2014-11-26 23:58:42,329 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  1393. 2014-11-26 23:58:42,329 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Free RAM: 132226129920 , Requested RAM: 1073741824
  1394. 2014-11-26 23:58:42,329 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host has enough CPU and RAM available
  1395. 2014-11-26 23:58:42,329 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 5, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1396. 2014-11-26 23:58:42,329 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 5, used: 0, reserved: 0, total: 132226129920; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1397. 2014-11-26 23:58:42,329 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Found a suitable host, adding to list: 5
  1398. 2014-11-26 23:58:42,344 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host: 4 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  1399. 2014-11-26 23:58:42,345 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Checking if host: 4 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  1400. 2014-11-26 23:58:42,350 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  1401. 2014-11-26 23:58:42,350 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  1402. 2014-11-26 23:58:42,350 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Free RAM: 132226129920 , Requested RAM: 1073741824
  1403. 2014-11-26 23:58:42,350 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host has enough CPU and RAM available
  1404. 2014-11-26 23:58:42,350 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 4, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1405. 2014-11-26 23:58:42,350 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 4, used: 0, reserved: 0, total: 132226129920; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1406. 2014-11-26 23:58:42,350 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Found a suitable host, adding to list: 4
  1407. 2014-11-26 23:58:42,368 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host: 1 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  1408. 2014-11-26 23:58:42,369 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  1409. 2014-11-26 23:58:42,374 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  1410. 2014-11-26 23:58:42,374 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Free CPU: 87500 , Requested CPU: 500
  1411. 2014-11-26 23:58:42,374 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Free RAM: 130389729280 , Requested RAM: 1073741824
  1412. 2014-11-26 23:58:42,374 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host has enough CPU and RAM available
  1413. 2014-11-26 23:58:42,374 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 1, used: 500, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1414. 2014-11-26 23:58:42,374 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 1, used: 536870912, reserved: 0, total: 130926600192; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1415. 2014-11-26 23:58:42,374 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Found a suitable host, adding to list: 1
  1416. 2014-11-26 23:58:42,374 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host name: cloud-host10.cgg.gov.in, hostId: 2 is in avoid set, skipping this and trying other available hosts
  1417. 2014-11-26 23:58:42,391 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host: 3 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  1418. 2014-11-26 23:58:42,391 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Checking if host: 3 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  1419. 2014-11-26 23:58:42,397 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  1420. 2014-11-26 23:58:42,397 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  1421. 2014-11-26 23:58:42,397 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Free RAM: 132226129920 , Requested RAM: 1073741824
  1422. 2014-11-26 23:58:42,397 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host has enough CPU and RAM available
  1423. 2014-11-26 23:58:42,397 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 3, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1424. 2014-11-26 23:58:42,397 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 3, used: 0, reserved: 0, total: 132226129920; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1425. 2014-11-26 23:58:42,397 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Found a suitable host, adding to list: 3
  1426. 2014-11-26 23:58:42,397 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host Allocator returning 4 suitable hosts
  1427. 2014-11-26 23:58:42,400 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Checking suitable pools for volume (Id, Type): (1,ROOT)
  1428. 2014-11-26 23:58:42,400 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) We need to allocate new storagepool for this volume
  1429. 2014-11-26 23:58:42,400 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Calling StoragePoolAllocators to find suitable pools
  1430. 2014-11-26 23:58:42,402 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (consoleproxy-1:ctx-9a467cf9) LocalStoragePoolAllocator trying to find storage pool to fit the vm
  1431. 2014-11-26 23:58:42,403 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9a467cf9) ClusterScopeStoragePoolAllocator looking for storage pool
  1432. 2014-11-26 23:58:42,403 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9a467cf9) Looking for pools in dc: 1 pod:1 cluster:1
  1433. 2014-11-26 23:58:42,406 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9a467cf9) Found pools matching tags: [Pool[2|PreSetup]]
  1434. 2014-11-26 23:58:42,409 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9a467cf9) Removing pool Pool[2|PreSetup] from avoid set, must have been inserted when searching for another disk's tag
  1435. 2014-11-26 23:58:42,412 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] (consoleproxy-1:ctx-9a467cf9) Checking if storage pool is suitable, name: null ,poolId: 2
  1436. 2014-11-26 23:58:42,421 DEBUG [c.c.s.StorageManagerImpl] (consoleproxy-1:ctx-9a467cf9) Checking pool 2 for storage, totalSize: 1649254858752, usedBytes: 297795584, usedPct: 1.8056371483140182E-4, disable threshold: 0.85
  1437. 2014-11-26 23:58:42,430 DEBUG [c.c.s.StorageManagerImpl] (consoleproxy-1:ctx-9a467cf9) Checking pool: 2 for volume allocation [Vol[1|vm=1|ROOT]], maxSize : 1649254858752, totalAllocatedSize : 0, askingSize : 0, allocated disable threshold: 0.85
  1438. 2014-11-26 23:58:42,430 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9a467cf9) ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
  1439. 2014-11-26 23:58:42,430 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Trying to find a potenial host and associated storage pools from the suitable host/pool lists for this VM
  1440. 2014-11-26 23:58:42,430 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Checking if host: 5 can access any suitable storage pool for volume: ROOT
  1441. 2014-11-26 23:58:42,431 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Host: 5 can access pool: 2
  1442. 2014-11-26 23:58:42,440 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Found a potential host id: 5 name: cloud-host7.cgg.gov.in and associated storage pools for this VM
  1443. 2014-11-26 23:58:42,444 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Returning Deployment Destination: Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(5)-Storage(Volume(1|ROOT-->Pool(2))]
  1444. 2014-11-26 23:58:42,444 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9a467cf9) Deployment found - P0=VM[ConsoleProxy|v-1-VM], P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(5)-Storage(Volume(1|ROOT-->Pool(2))]
  1445. 2014-11-26 23:58:42,472 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) VM state transitted from :Starting to Starting with event: OperationRetryvm's original host id: null new host id: 5 host id before state transition: 2
  1446. 2014-11-26 23:58:42,487 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  1447. 2014-11-26 23:58:42,487 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) Hosts's actual total RAM: 132226133760 and RAM after applying overprovisioning: 132226129920
  1448. 2014-11-26 23:58:42,488 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) release cpu from host: 2, old used: 500,reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  1449. 2014-11-26 23:58:42,488 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) release mem from host: 2, old used: 1073741824,reserved: 0, total: 132226129920; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  1450. 2014-11-26 23:58:42,511 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  1451. 2014-11-26 23:58:42,511 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) We are allocating VM, increasing the used capacity of this host:5
  1452. 2014-11-26 23:58:42,511 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) Current Used CPU: 0 , Free CPU:88000 ,Requested CPU: 500
  1453. 2014-11-26 23:58:42,511 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) Current Used RAM: 0 , Free RAM:132226129920 ,Requested RAM: 1073741824
  1454. 2014-11-26 23:58:42,511 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) CPU STATS after allocation: for host: 5, old used: 0, old reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used:500, reserved:0; requested cpu:500,alloc_from_last:false
  1455. 2014-11-26 23:58:42,511 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) RAM STATS after allocation: for host: 5, old used: 0, old reserved: 0, total: 132226129920; new used: 1073741824, reserved: 0; requested mem: 1073741824,alloc_from_last:false
  1456. 2014-11-26 23:58:42,518 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9a467cf9) VM is being created in podId: 1
  1457. 2014-11-26 23:58:42,528 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-9a467cf9) Network id=200 is already implemented
  1458. 2014-11-26 23:58:42,580 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-9a467cf9) Network id=202 is already implemented
  1459. 2014-11-26 23:58:42,641 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-9a467cf9) Network id=201 is already implemented
  1460. 2014-11-26 23:58:42,694 DEBUG [c.c.n.g.PodBasedNetworkGuru] (consoleproxy-1:ctx-9a467cf9) Allocated a nic NicProfile[3-1-ee5c186f-0673-4daa-ac94-90daf20040ff-10.3.4.117-null for VM[ConsoleProxy|v-1-VM]
  1461. 2014-11-26 23:58:42,709 DEBUG [o.a.c.e.o.VolumeOrchestrator] (consoleproxy-1:ctx-9a467cf9) Checking if we need to prepare 1 volumes for VM[ConsoleProxy|v-1-VM]
  1462. 2014-11-26 23:58:42,738 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (consoleproxy-1:ctx-9a467cf9) template 1 is already in store:1, type:Image
  1463. 2014-11-26 23:58:42,749 DEBUG [o.a.c.s.d.PrimaryDataStoreImpl] (consoleproxy-1:ctx-9a467cf9) Not found (templateId:1poolId:2) in template_spool_ref, persisting it
  1464. 2014-11-26 23:58:42,763 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (consoleproxy-1:ctx-9a467cf9) template 1 is already in store:2, type:Primary
  1465. 2014-11-26 23:58:42,767 DEBUG [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-9a467cf9) Found template routing-1 in storage pool 2 with VMTemplateStoragePool id: 667
  1466. 2014-11-26 23:58:42,778 DEBUG [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-9a467cf9) Acquire lock on VMTemplateStoragePool 667 with timeout 3600 seconds
  1467. 2014-11-26 23:58:42,783 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-9a467cf9) lock is acquired for VMTemplateStoragePool 667
  1468. 2014-11-26 23:58:42,796 DEBUG [o.a.c.s.m.AncientDataMotionStrategy] (consoleproxy-1:ctx-9a467cf9) copyAsync inspecting src type TEMPLATE copyAsync inspecting dest type TEMPLATE
  1469. 2014-11-26 23:58:42,821 DEBUG [c.c.a.m.ClusteredAgentAttache] (consoleproxy-1:ctx-9a467cf9) Seq 2-2114716032: Forwarding Seq 2-2114716032: { Cmd , MgmtId: 226850023912365, via: 2(cloud-host10.cgg.gov.in), Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/1/","origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"9cd0b1ae-758b-11e4-aa51-ba311310a163","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.3.4.40/ibm/share1","_role":"Image"}},"name":"routing-1","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"9cd0b1ae-758b-11e4-aa51-ba311310a163","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"CloudStore-2","id":2,"poolType":"PreSetup","host":"localhost","path":"/CloudStore-2","port":0,"url":"PreSetup://localhost//CloudStore-2/?ROLE=Primary&STOREUUID=CloudStore-2"}},"name":"routing-1","hypervisorType":"XenServer"}},"executeInSequence":false,"options":{},"wait":10800}}] } to 68995168937102
  1470. 2014-11-26 23:58:44,989 DEBUG [c.c.a.t.Request] (AgentManager-Handler-5:null) Seq 2-2114716032: Processing: { Ans: , MgmtId: 226850023912365, via: 2, Ver: v1, Flags: 10, [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 3e1f2113-438a-05e7-1b46-4c9b14d56144","wait":0}}] }
  1471. 2014-11-26 23:58:44,989 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-9a467cf9) Seq 2-2114716032: Received: { Ans: , MgmtId: 226850023912365, via: 2, Ver: v1, Flags: 10, { CopyCmdAnswer } }
  1472. 2014-11-26 23:58:45,016 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-9a467cf9) releasing lock for VMTemplateStoragePool 667
  1473. 2014-11-26 23:58:45,017 WARN [c.c.u.d.Merovingian2] (consoleproxy-1:ctx-9a467cf9) Was unable to find lock for the key template_spool_ref667 and thread id 1994469474
  1474. 2014-11-26 23:58:45,017 DEBUG [o.a.c.e.o.VolumeOrchestrator] (consoleproxy-1:ctx-9a467cf9) Unable to create Vol[1|vm=1|ROOT]:Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 3e1f2113-438a-05e7-1b46-4c9b14d56144
  1475. 2014-11-26 23:58:45,017 INFO [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9a467cf9) Unable to contact resource.
  1476. com.cloud.exception.StorageUnavailableException: Resource [StoragePool:2] is unreachable: Unable to create Vol[1|vm=1|ROOT]:Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 3e1f2113-438a-05e7-1b46-4c9b14d56144
  1477. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.recreateVolume(VolumeOrchestrator.java:1202)
  1478. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.prepare(VolumeOrchestrator.java:1254)
  1479. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:962)
  1480. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761)
  1481. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:745)
  1482. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.startProxy(ConsoleProxyManagerImpl.java:555)
  1483. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.allocCapacity(ConsoleProxyManagerImpl.java:941)
  1484. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:1666)
  1485. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:157)
  1486. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:118)
  1487. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:35)
  1488. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:88)
  1489. at com.cloud.vm.SystemVmLoadScanner$1.runInContext(SystemVmLoadScanner.java:79)
  1490. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  1491. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  1492. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  1493. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  1494. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  1495. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  1496. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
  1497. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
  1498. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
  1499. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  1500. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  1501. at java.lang.Thread.run(Thread.java:744)
  1502. 2014-11-26 23:58:45,025 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9a467cf9) Cleaning up resources for the vm VM[ConsoleProxy|v-1-VM] in Starting state
  1503. 2014-11-26 23:58:45,034 DEBUG [c.c.a.m.ClusteredAgentAttache] (consoleproxy-1:ctx-9a467cf9) Seq 5-1497235807: Forwarding Seq 5-1497235807: { Cmd , MgmtId: 226850023912365, via: 5(cloud-host7.cgg.gov.in), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"v-1-VM","wait":0}}] } to 68995168937102
  1504. 2014-11-26 23:58:45,138 DEBUG [c.c.a.t.Request] (AgentManager-Handler-6:null) Seq 5-1497235807: Processing: { Ans: , MgmtId: 226850023912365, via: 5, Ver: v1, Flags: 10, [{"com.cloud.agent.api.StopAnswer":{"result":true,"details":"VM does not exist","wait":0}}] }
  1505. 2014-11-26 23:58:45,139 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-9a467cf9) Seq 5-1497235807: Received: { Ans: , MgmtId: 226850023912365, via: 5, Ver: v1, Flags: 10, { StopAnswer } }
  1506. 2014-11-26 23:58:45,163 DEBUG [c.c.n.g.ControlNetworkGuru] (consoleproxy-1:ctx-9a467cf9) Released nic: NicProfile[2-1-null-null-null
  1507. 2014-11-26 23:58:45,182 DEBUG [c.c.d.d.DataCenterIpAddressDaoImpl] (consoleproxy-1:ctx-9a467cf9) Releasing ip address for reservationId=ee5c186f-0673-4daa-ac94-90daf20040ff, instance=3
  1508. 2014-11-26 23:58:45,183 DEBUG [c.c.n.g.PodBasedNetworkGuru] (consoleproxy-1:ctx-9a467cf9) Released nic: NicProfile[3-1-null-null-null
  1509. 2014-11-26 23:58:45,192 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9a467cf9) Successfully released network resources for the vm VM[ConsoleProxy|v-1-VM]
  1510. 2014-11-26 23:58:45,192 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9a467cf9) Successfully cleanued up resources for the vm VM[ConsoleProxy|v-1-VM] in Starting state
  1511. 2014-11-26 23:58:45,201 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Deploy avoids pods: null, clusters: null, hosts: [2, 5]
  1512. 2014-11-26 23:58:45,203 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@1ca8cb54
  1513. 2014-11-26 23:58:45,203 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Trying to allocate a host and storage pools from dc:1, pod:1,cluster:null, requested cpu: 500, requested ram: 1073741824
  1514. 2014-11-26 23:58:45,203 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Is ROOT volume READY (pool already allocated)?: No
  1515. 2014-11-26 23:58:45,204 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-9a467cf9) Searching resources only under specified Pod: 1
  1516. 2014-11-26 23:58:45,204 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-9a467cf9) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Pod: 1
  1517. 2014-11-26 23:58:45,224 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Checking resources in Cluster: 1 under Pod: 1
  1518. 2014-11-26 23:58:45,224 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Looking for hosts in dc: 1 pod:1 cluster:1
  1519. 2014-11-26 23:58:45,232 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) FirstFitAllocator has 5 hosts to check for allocation: [Host[-4-Routing], Host[-1-Routing], Host[-5-Routing], Host[-3-Routing], Host[-2-Routing]]
  1520. 2014-11-26 23:58:45,248 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Found 5 hosts for allocation after prioritization: [Host[-4-Routing], Host[-1-Routing], Host[-5-Routing], Host[-3-Routing], Host[-2-Routing]]
  1521. 2014-11-26 23:58:45,248 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=1024
  1522. 2014-11-26 23:58:45,263 INFO [o.a.c.s.v.VolumeServiceImpl] (secstorage-1:ctx-b4dab2a3) Unable to acquire lock on VMTemplateStoragePool 666
  1523. 2014-11-26 23:58:45,263 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host: 4 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  1524. 2014-11-26 23:58:45,263 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Checking if host: 4 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  1525. 2014-11-26 23:58:45,265 ERROR [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-b4dab2a3) Failed to start instance VM[SecondaryStorageVm|s-135-VM]
  1526. java.lang.NullPointerException
  1527. at org.apache.cloudstack.storage.volume.VolumeServiceImpl.createBaseImageAsync(VolumeServiceImpl.java:454)
  1528. at org.apache.cloudstack.storage.volume.VolumeServiceImpl.createVolumeFromTemplateAsync(VolumeServiceImpl.java:603)
  1529. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.recreateVolume(VolumeOrchestrator.java:1190)
  1530. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.prepare(VolumeOrchestrator.java:1254)
  1531. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:962)
  1532. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761)
  1533. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:745)
  1534. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.startSecStorageVm(SecondaryStorageManagerImpl.java:261)
  1535. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.allocCapacity(SecondaryStorageManagerImpl.java:694)
  1536. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.expandPool(SecondaryStorageManagerImpl.java:1278)
  1537. at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:123)
  1538. at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:50)
  1539. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:111)
  1540. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:35)
  1541. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:88)
  1542. at com.cloud.vm.SystemVmLoadScanner$1.runInContext(SystemVmLoadScanner.java:79)
  1543. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  1544. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  1545. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  1546. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  1547. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  1548. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  1549. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
  1550. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
  1551. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
  1552. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  1553. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  1554. at java.lang.Thread.run(Thread.java:744)
  1555. 2014-11-26 23:58:45,270 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  1556. 2014-11-26 23:58:45,270 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  1557. 2014-11-26 23:58:45,270 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Free RAM: 132226129920 , Requested RAM: 1073741824
  1558. 2014-11-26 23:58:45,270 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host has enough CPU and RAM available
  1559. 2014-11-26 23:58:45,270 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 4, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1560. 2014-11-26 23:58:45,270 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 4, used: 0, reserved: 0, total: 132226129920; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1561. 2014-11-26 23:58:45,270 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Found a suitable host, adding to list: 4
  1562. 2014-11-26 23:58:45,273 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-b4dab2a3) Cleaning up resources for the vm VM[SecondaryStorageVm|s-135-VM] in Starting state
  1563. 2014-11-26 23:58:45,281 DEBUG [c.c.a.m.ClusteredAgentAttache] (secstorage-1:ctx-b4dab2a3) Seq 1-619512186: Forwarding Seq 1-619512186: { Cmd , MgmtId: 226850023912365, via: 1(cloud-host6.cgg.gov.in), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"s-135-VM","wait":0}}] } to 68995168937102
  1564. 2014-11-26 23:58:45,286 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host: 1 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  1565. 2014-11-26 23:58:45,286 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  1566. 2014-11-26 23:58:45,291 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  1567. 2014-11-26 23:58:45,291 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Free CPU: 87500 , Requested CPU: 500
  1568. 2014-11-26 23:58:45,291 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Free RAM: 130389729280 , Requested RAM: 1073741824
  1569. 2014-11-26 23:58:45,291 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host has enough CPU and RAM available
  1570. 2014-11-26 23:58:45,291 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 1, used: 500, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1571. 2014-11-26 23:58:45,291 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 1, used: 536870912, reserved: 0, total: 130926600192; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1572. 2014-11-26 23:58:45,291 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Found a suitable host, adding to list: 1
  1573. 2014-11-26 23:58:45,291 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host name: cloud-host7.cgg.gov.in, hostId: 5 is in avoid set, skipping this and trying other available hosts
  1574. 2014-11-26 23:58:45,307 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host: 3 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  1575. 2014-11-26 23:58:45,307 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Checking if host: 3 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  1576. 2014-11-26 23:58:45,312 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  1577. 2014-11-26 23:58:45,312 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  1578. 2014-11-26 23:58:45,312 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Free RAM: 132226129920 , Requested RAM: 1073741824
  1579. 2014-11-26 23:58:45,312 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host has enough CPU and RAM available
  1580. 2014-11-26 23:58:45,312 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 3, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1581. 2014-11-26 23:58:45,312 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 3, used: 0, reserved: 0, total: 132226129920; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1582. 2014-11-26 23:58:45,312 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Found a suitable host, adding to list: 3
  1583. 2014-11-26 23:58:45,312 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host name: cloud-host10.cgg.gov.in, hostId: 2 is in avoid set, skipping this and trying other available hosts
  1584. 2014-11-26 23:58:45,312 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host Allocator returning 3 suitable hosts
  1585. 2014-11-26 23:58:45,315 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Checking suitable pools for volume (Id, Type): (1,ROOT)
  1586. 2014-11-26 23:58:45,315 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) We need to allocate new storagepool for this volume
  1587. 2014-11-26 23:58:45,315 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Calling StoragePoolAllocators to find suitable pools
  1588. 2014-11-26 23:58:45,318 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (consoleproxy-1:ctx-9a467cf9) LocalStoragePoolAllocator trying to find storage pool to fit the vm
  1589. 2014-11-26 23:58:45,318 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9a467cf9) ClusterScopeStoragePoolAllocator looking for storage pool
  1590. 2014-11-26 23:58:45,318 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9a467cf9) Looking for pools in dc: 1 pod:1 cluster:1
  1591. 2014-11-26 23:58:45,321 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9a467cf9) Found pools matching tags: [Pool[2|PreSetup]]
  1592. 2014-11-26 23:58:45,324 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9a467cf9) Removing pool Pool[2|PreSetup] from avoid set, must have been inserted when searching for another disk's tag
  1593. 2014-11-26 23:58:45,327 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] (consoleproxy-1:ctx-9a467cf9) Checking if storage pool is suitable, name: null ,poolId: 2
  1594. 2014-11-26 23:58:45,336 DEBUG [c.c.s.StorageManagerImpl] (consoleproxy-1:ctx-9a467cf9) Checking pool 2 for storage, totalSize: 1649254858752, usedBytes: 297795584, usedPct: 1.8056371483140182E-4, disable threshold: 0.85
  1595. 2014-11-26 23:58:45,344 DEBUG [c.c.s.StorageManagerImpl] (consoleproxy-1:ctx-9a467cf9) Checking pool: 2 for volume allocation [Vol[1|vm=1|ROOT]], maxSize : 1649254858752, totalAllocatedSize : 0, askingSize : 0, allocated disable threshold: 0.85
  1596. 2014-11-26 23:58:45,344 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9a467cf9) ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
  1597. 2014-11-26 23:58:45,344 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Trying to find a potenial host and associated storage pools from the suitable host/pool lists for this VM
  1598. 2014-11-26 23:58:45,344 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Checking if host: 4 can access any suitable storage pool for volume: ROOT
  1599. 2014-11-26 23:58:45,346 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Host: 4 can access pool: 2
  1600. 2014-11-26 23:58:45,354 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Found a potential host id: 4 name: cloud-host9.cgg.gov.in and associated storage pools for this VM
  1601. 2014-11-26 23:58:45,358 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Returning Deployment Destination: Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(4)-Storage(Volume(1|ROOT-->Pool(2))]
  1602. 2014-11-26 23:58:45,358 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9a467cf9) Deployment found - P0=VM[ConsoleProxy|v-1-VM], P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(4)-Storage(Volume(1|ROOT-->Pool(2))]
  1603. 2014-11-26 23:58:45,387 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) VM state transitted from :Starting to Starting with event: OperationRetryvm's original host id: null new host id: 4 host id before state transition: 5
  1604. 2014-11-26 23:58:45,392 DEBUG [c.c.a.t.Request] (AgentManager-Handler-7:null) Seq 1-619512186: Processing: { Ans: , MgmtId: 226850023912365, via: 1, Ver: v1, Flags: 10, [{"com.cloud.agent.api.StopAnswer":{"result":true,"details":"VM does not exist","wait":0}}] }
  1605. 2014-11-26 23:58:45,393 DEBUG [c.c.a.t.Request] (secstorage-1:ctx-b4dab2a3) Seq 1-619512186: Received: { Ans: , MgmtId: 226850023912365, via: 1, Ver: v1, Flags: 10, { StopAnswer } }
  1606. 2014-11-26 23:58:45,409 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  1607. 2014-11-26 23:58:45,409 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) Hosts's actual total RAM: 132226133760 and RAM after applying overprovisioning: 132226129920
  1608. 2014-11-26 23:58:45,409 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) release cpu from host: 5, old used: 500,reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  1609. 2014-11-26 23:58:45,409 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) release mem from host: 5, old used: 1073741824,reserved: 0, total: 132226129920; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  1610. 2014-11-26 23:58:45,416 DEBUG [c.c.n.g.ControlNetworkGuru] (secstorage-1:ctx-b4dab2a3) Released nic: NicProfile[537-135-null-null-null
  1611. 2014-11-26 23:58:45,437 DEBUG [c.c.d.d.DataCenterIpAddressDaoImpl] (secstorage-1:ctx-b4dab2a3) Releasing ip address for reservationId=c8b34105-e8ee-4fc3-9817-4e891ccf38ef, instance=538
  1612. 2014-11-26 23:58:45,438 DEBUG [c.c.n.g.PodBasedNetworkGuru] (secstorage-1:ctx-b4dab2a3) Released nic: NicProfile[538-135-null-null-null
  1613. 2014-11-26 23:58:45,443 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  1614. 2014-11-26 23:58:45,443 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) We are allocating VM, increasing the used capacity of this host:4
  1615. 2014-11-26 23:58:45,443 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) Current Used CPU: 0 , Free CPU:88000 ,Requested CPU: 500
  1616. 2014-11-26 23:58:45,443 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) Current Used RAM: 0 , Free RAM:132226129920 ,Requested RAM: 1073741824
  1617. 2014-11-26 23:58:45,443 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) CPU STATS after allocation: for host: 4, old used: 0, old reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used:500, reserved:0; requested cpu:500,alloc_from_last:false
  1618. 2014-11-26 23:58:45,443 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) RAM STATS after allocation: for host: 4, old used: 0, old reserved: 0, total: 132226129920; new used: 1073741824, reserved: 0; requested mem: 1073741824,alloc_from_last:false
  1619. 2014-11-26 23:58:45,450 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9a467cf9) VM is being created in podId: 1
  1620. 2014-11-26 23:58:45,456 DEBUG [c.c.d.d.DataCenterIpAddressDaoImpl] (secstorage-1:ctx-b4dab2a3) Releasing ip address for reservationId=c8b34105-e8ee-4fc3-9817-4e891ccf38ef, instance=539
  1621. 2014-11-26 23:58:45,457 DEBUG [c.c.n.g.PodBasedNetworkGuru] (secstorage-1:ctx-b4dab2a3) Released nic: NicProfile[539-135-null-null-null
  1622. 2014-11-26 23:58:45,459 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-9a467cf9) Network id=200 is already implemented
  1623. 2014-11-26 23:58:45,496 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-b4dab2a3) Successfully released network resources for the vm VM[SecondaryStorageVm|s-135-VM]
  1624. 2014-11-26 23:58:45,496 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-b4dab2a3) Successfully cleanued up resources for the vm VM[SecondaryStorageVm|s-135-VM] in Starting state
  1625. 2014-11-26 23:58:45,513 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: 1
  1626. 2014-11-26 23:58:45,524 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  1627. 2014-11-26 23:58:45,524 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3) Hosts's actual total RAM: 130926604032 and RAM after applying overprovisioning: 130926600192
  1628. 2014-11-26 23:58:45,524 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3) release cpu from host: 1, old used: 500,reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  1629. 2014-11-26 23:58:45,524 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-b4dab2a3) release mem from host: 1, old used: 536870912,reserved: 0, total: 130926600192; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  1630. 2014-11-26 23:58:45,529 WARN [c.c.s.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-b4dab2a3) Exception while trying to start secondary storage vm
  1631. com.cloud.exception.AgentUnavailableException: Resource [Host:1] is unreachable: Host 1: Unable to start instance due to null
  1632. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1072)
  1633. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761)
  1634. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:745)
  1635. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.startSecStorageVm(SecondaryStorageManagerImpl.java:261)
  1636. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.allocCapacity(SecondaryStorageManagerImpl.java:694)
  1637. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.expandPool(SecondaryStorageManagerImpl.java:1278)
  1638. at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:123)
  1639. at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:50)
  1640. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:111)
  1641. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:35)
  1642. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:88)
  1643. at com.cloud.vm.SystemVmLoadScanner$1.runInContext(SystemVmLoadScanner.java:79)
  1644. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  1645. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  1646. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  1647. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  1648. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  1649. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  1650. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
  1651. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
  1652. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
  1653. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  1654. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  1655. at java.lang.Thread.run(Thread.java:744)
  1656. Caused by: java.lang.NullPointerException
  1657. at org.apache.cloudstack.storage.volume.VolumeServiceImpl.createBaseImageAsync(VolumeServiceImpl.java:454)
  1658. at org.apache.cloudstack.storage.volume.VolumeServiceImpl.createVolumeFromTemplateAsync(VolumeServiceImpl.java:603)
  1659. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.recreateVolume(VolumeOrchestrator.java:1190)
  1660. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.prepare(VolumeOrchestrator.java:1254)
  1661. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:962)
  1662. ... 23 more
  1663. 2014-11-26 23:58:45,532 INFO [c.c.s.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-b4dab2a3) Unable to start secondary storage vm for standby capacity, secStorageVm vm Id : 135, will recycle it and start a new one
  1664. 2014-11-26 23:58:45,532 INFO [c.c.s.PremiumSecondaryStorageManagerImpl] (secstorage-1:ctx-b4dab2a3) Primary secondary storage is not even started, wait until next turn
  1665. 2014-11-26 23:58:45,534 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-9a467cf9) Network id=202 is already implemented
  1666. 2014-11-26 23:58:45,598 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-9a467cf9) Network id=201 is already implemented
  1667. 2014-11-26 23:58:45,651 DEBUG [c.c.n.g.PodBasedNetworkGuru] (consoleproxy-1:ctx-9a467cf9) Allocated a nic NicProfile[3-1-ee5c186f-0673-4daa-ac94-90daf20040ff-10.3.4.119-null for VM[ConsoleProxy|v-1-VM]
  1668. 2014-11-26 23:58:45,664 DEBUG [o.a.c.e.o.VolumeOrchestrator] (consoleproxy-1:ctx-9a467cf9) Checking if we need to prepare 1 volumes for VM[ConsoleProxy|v-1-VM]
  1669. 2014-11-26 23:58:45,692 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (consoleproxy-1:ctx-9a467cf9) template 1 is already in store:1, type:Image
  1670. 2014-11-26 23:58:45,702 DEBUG [o.a.c.s.d.PrimaryDataStoreImpl] (consoleproxy-1:ctx-9a467cf9) Not found (templateId:1poolId:2) in template_spool_ref, persisting it
  1671. 2014-11-26 23:58:45,721 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (consoleproxy-1:ctx-9a467cf9) template 1 is already in store:2, type:Primary
  1672. 2014-11-26 23:58:45,724 DEBUG [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-9a467cf9) Found template routing-1 in storage pool 2 with VMTemplateStoragePool id: 668
  1673. 2014-11-26 23:58:45,737 DEBUG [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-9a467cf9) Acquire lock on VMTemplateStoragePool 668 with timeout 3600 seconds
  1674. 2014-11-26 23:58:45,742 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-9a467cf9) lock is acquired for VMTemplateStoragePool 668
  1675. 2014-11-26 23:58:45,755 DEBUG [o.a.c.s.m.AncientDataMotionStrategy] (consoleproxy-1:ctx-9a467cf9) copyAsync inspecting src type TEMPLATE copyAsync inspecting dest type TEMPLATE
  1676. 2014-11-26 23:58:45,780 DEBUG [c.c.a.m.ClusteredAgentAttache] (consoleproxy-1:ctx-9a467cf9) Seq 4-853737855: Forwarding Seq 4-853737855: { Cmd , MgmtId: 226850023912365, via: 4(cloud-host9.cgg.gov.in), Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/1/","origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"9cd0b1ae-758b-11e4-aa51-ba311310a163","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.3.4.40/ibm/share1","_role":"Image"}},"name":"routing-1","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"9cd0b1ae-758b-11e4-aa51-ba311310a163","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"CloudStore-2","id":2,"poolType":"PreSetup","host":"localhost","path":"/CloudStore-2","port":0,"url":"PreSetup://localhost//CloudStore-2/?ROLE=Primary&STOREUUID=CloudStore-2"}},"name":"routing-1","hypervisorType":"XenServer"}},"executeInSequence":false,"options":{},"wait":10800}}] } to 68995168937102
  1677. 2014-11-26 23:58:47,946 DEBUG [c.c.a.t.Request] (AgentManager-Handler-8:null) Seq 4-853737855: Processing: { Ans: , MgmtId: 226850023912365, via: 4, Ver: v1, Flags: 10, [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 3e1f2113-438a-05e7-1b46-4c9b14d56144","wait":0}}] }
  1678. 2014-11-26 23:58:47,947 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-9a467cf9) Seq 4-853737855: Received: { Ans: , MgmtId: 226850023912365, via: 4, Ver: v1, Flags: 10, { CopyCmdAnswer } }
  1679. 2014-11-26 23:58:47,972 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-9a467cf9) releasing lock for VMTemplateStoragePool 668
  1680. 2014-11-26 23:58:47,972 WARN [c.c.u.d.Merovingian2] (consoleproxy-1:ctx-9a467cf9) Was unable to find lock for the key template_spool_ref668 and thread id 1994469474
  1681. 2014-11-26 23:58:47,973 DEBUG [o.a.c.e.o.VolumeOrchestrator] (consoleproxy-1:ctx-9a467cf9) Unable to create Vol[1|vm=1|ROOT]:Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 3e1f2113-438a-05e7-1b46-4c9b14d56144
  1682. 2014-11-26 23:58:47,973 INFO [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9a467cf9) Unable to contact resource.
  1683. com.cloud.exception.StorageUnavailableException: Resource [StoragePool:2] is unreachable: Unable to create Vol[1|vm=1|ROOT]:Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 3e1f2113-438a-05e7-1b46-4c9b14d56144
  1684. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.recreateVolume(VolumeOrchestrator.java:1202)
  1685. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.prepare(VolumeOrchestrator.java:1254)
  1686. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:962)
  1687. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761)
  1688. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:745)
  1689. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.startProxy(ConsoleProxyManagerImpl.java:555)
  1690. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.allocCapacity(ConsoleProxyManagerImpl.java:941)
  1691. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:1666)
  1692. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:157)
  1693. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:118)
  1694. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:35)
  1695. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:88)
  1696. at com.cloud.vm.SystemVmLoadScanner$1.runInContext(SystemVmLoadScanner.java:79)
  1697. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  1698. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  1699. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  1700. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  1701. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  1702. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  1703. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
  1704. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
  1705. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
  1706. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  1707. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  1708. at java.lang.Thread.run(Thread.java:744)
  1709. 2014-11-26 23:58:47,982 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9a467cf9) Cleaning up resources for the vm VM[ConsoleProxy|v-1-VM] in Starting state
  1710. 2014-11-26 23:58:47,991 DEBUG [c.c.a.m.ClusteredAgentAttache] (consoleproxy-1:ctx-9a467cf9) Seq 4-853737856: Forwarding Seq 4-853737856: { Cmd , MgmtId: 226850023912365, via: 4(cloud-host9.cgg.gov.in), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"v-1-VM","wait":0}}] } to 68995168937102
  1711. 2014-11-26 23:58:48,102 DEBUG [c.c.a.t.Request] (AgentManager-Handler-9:null) Seq 4-853737856: Processing: { Ans: , MgmtId: 226850023912365, via: 4, Ver: v1, Flags: 10, [{"com.cloud.agent.api.StopAnswer":{"result":true,"details":"VM does not exist","wait":0}}] }
  1712. 2014-11-26 23:58:48,102 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-9a467cf9) Seq 4-853737856: Received: { Ans: , MgmtId: 226850023912365, via: 4, Ver: v1, Flags: 10, { StopAnswer } }
  1713. 2014-11-26 23:58:48,128 DEBUG [c.c.n.g.ControlNetworkGuru] (consoleproxy-1:ctx-9a467cf9) Released nic: NicProfile[2-1-null-null-null
  1714. 2014-11-26 23:58:48,152 DEBUG [c.c.d.d.DataCenterIpAddressDaoImpl] (consoleproxy-1:ctx-9a467cf9) Releasing ip address for reservationId=ee5c186f-0673-4daa-ac94-90daf20040ff, instance=3
  1715. 2014-11-26 23:58:48,153 DEBUG [c.c.n.g.PodBasedNetworkGuru] (consoleproxy-1:ctx-9a467cf9) Released nic: NicProfile[3-1-null-null-null
  1716. 2014-11-26 23:58:48,165 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9a467cf9) Successfully released network resources for the vm VM[ConsoleProxy|v-1-VM]
  1717. 2014-11-26 23:58:48,165 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9a467cf9) Successfully cleanued up resources for the vm VM[ConsoleProxy|v-1-VM] in Starting state
  1718. 2014-11-26 23:58:48,174 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Deploy avoids pods: null, clusters: null, hosts: [2, 4, 5]
  1719. 2014-11-26 23:58:48,177 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@1ca8cb54
  1720. 2014-11-26 23:58:48,177 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Trying to allocate a host and storage pools from dc:1, pod:1,cluster:null, requested cpu: 500, requested ram: 1073741824
  1721. 2014-11-26 23:58:48,178 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Is ROOT volume READY (pool already allocated)?: No
  1722. 2014-11-26 23:58:48,178 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-9a467cf9) Searching resources only under specified Pod: 1
  1723. 2014-11-26 23:58:48,178 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-9a467cf9) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Pod: 1
  1724. 2014-11-26 23:58:48,199 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Checking resources in Cluster: 1 under Pod: 1
  1725. 2014-11-26 23:58:48,199 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Looking for hosts in dc: 1 pod:1 cluster:1
  1726. 2014-11-26 23:58:48,208 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) FirstFitAllocator has 5 hosts to check for allocation: [Host[-5-Routing], Host[-4-Routing], Host[-2-Routing], Host[-3-Routing], Host[-1-Routing]]
  1727. 2014-11-26 23:58:48,226 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Found 5 hosts for allocation after prioritization: [Host[-5-Routing], Host[-4-Routing], Host[-2-Routing], Host[-3-Routing], Host[-1-Routing]]
  1728. 2014-11-26 23:58:48,226 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=1024
  1729. 2014-11-26 23:58:48,226 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host name: cloud-host7.cgg.gov.in, hostId: 5 is in avoid set, skipping this and trying other available hosts
  1730. 2014-11-26 23:58:48,226 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host name: cloud-host9.cgg.gov.in, hostId: 4 is in avoid set, skipping this and trying other available hosts
  1731. 2014-11-26 23:58:48,226 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host name: cloud-host10.cgg.gov.in, hostId: 2 is in avoid set, skipping this and trying other available hosts
  1732. 2014-11-26 23:58:48,244 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host: 3 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  1733. 2014-11-26 23:58:48,244 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Checking if host: 3 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  1734. 2014-11-26 23:58:48,250 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  1735. 2014-11-26 23:58:48,250 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  1736. 2014-11-26 23:58:48,250 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Free RAM: 132226129920 , Requested RAM: 1073741824
  1737. 2014-11-26 23:58:48,250 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host has enough CPU and RAM available
  1738. 2014-11-26 23:58:48,250 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 3, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1739. 2014-11-26 23:58:48,250 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 3, used: 0, reserved: 0, total: 132226129920; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1740. 2014-11-26 23:58:48,250 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Found a suitable host, adding to list: 3
  1741. 2014-11-26 23:58:48,267 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host: 1 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  1742. 2014-11-26 23:58:48,267 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  1743. 2014-11-26 23:58:48,272 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  1744. 2014-11-26 23:58:48,272 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  1745. 2014-11-26 23:58:48,272 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Free RAM: 130926600192 , Requested RAM: 1073741824
  1746. 2014-11-26 23:58:48,272 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host has enough CPU and RAM available
  1747. 2014-11-26 23:58:48,272 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 1, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1748. 2014-11-26 23:58:48,272 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 1, used: 0, reserved: 0, total: 130926600192; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1749. 2014-11-26 23:58:48,273 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Found a suitable host, adding to list: 1
  1750. 2014-11-26 23:58:48,273 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host Allocator returning 2 suitable hosts
  1751. 2014-11-26 23:58:48,276 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Checking suitable pools for volume (Id, Type): (1,ROOT)
  1752. 2014-11-26 23:58:48,276 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) We need to allocate new storagepool for this volume
  1753. 2014-11-26 23:58:48,276 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Calling StoragePoolAllocators to find suitable pools
  1754. 2014-11-26 23:58:48,279 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (consoleproxy-1:ctx-9a467cf9) LocalStoragePoolAllocator trying to find storage pool to fit the vm
  1755. 2014-11-26 23:58:48,279 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9a467cf9) ClusterScopeStoragePoolAllocator looking for storage pool
  1756. 2014-11-26 23:58:48,279 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9a467cf9) Looking for pools in dc: 1 pod:1 cluster:1
  1757. 2014-11-26 23:58:48,282 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9a467cf9) Found pools matching tags: [Pool[2|PreSetup]]
  1758. 2014-11-26 23:58:48,285 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9a467cf9) Removing pool Pool[2|PreSetup] from avoid set, must have been inserted when searching for another disk's tag
  1759. 2014-11-26 23:58:48,289 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] (consoleproxy-1:ctx-9a467cf9) Checking if storage pool is suitable, name: null ,poolId: 2
  1760. 2014-11-26 23:58:48,299 DEBUG [c.c.s.StorageManagerImpl] (consoleproxy-1:ctx-9a467cf9) Checking pool 2 for storage, totalSize: 1649254858752, usedBytes: 297795584, usedPct: 1.8056371483140182E-4, disable threshold: 0.85
  1761. 2014-11-26 23:58:48,309 DEBUG [c.c.s.StorageManagerImpl] (consoleproxy-1:ctx-9a467cf9) Checking pool: 2 for volume allocation [Vol[1|vm=1|ROOT]], maxSize : 1649254858752, totalAllocatedSize : 0, askingSize : 0, allocated disable threshold: 0.85
  1762. 2014-11-26 23:58:48,309 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9a467cf9) ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
  1763. 2014-11-26 23:58:48,309 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Trying to find a potenial host and associated storage pools from the suitable host/pool lists for this VM
  1764. 2014-11-26 23:58:48,309 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Checking if host: 3 can access any suitable storage pool for volume: ROOT
  1765. 2014-11-26 23:58:48,310 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Host: 3 can access pool: 2
  1766. 2014-11-26 23:58:48,321 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Found a potential host id: 3 name: cloud-host8.cgg.gov.in and associated storage pools for this VM
  1767. 2014-11-26 23:58:48,325 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Returning Deployment Destination: Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(3)-Storage(Volume(1|ROOT-->Pool(2))]
  1768. 2014-11-26 23:58:48,325 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9a467cf9) Deployment found - P0=VM[ConsoleProxy|v-1-VM], P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(3)-Storage(Volume(1|ROOT-->Pool(2))]
  1769. 2014-11-26 23:58:48,356 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) VM state transitted from :Starting to Starting with event: OperationRetryvm's original host id: null new host id: 3 host id before state transition: 4
  1770. 2014-11-26 23:58:48,371 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  1771. 2014-11-26 23:58:48,371 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) Hosts's actual total RAM: 132226133760 and RAM after applying overprovisioning: 132226129920
  1772. 2014-11-26 23:58:48,371 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) release cpu from host: 4, old used: 500,reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  1773. 2014-11-26 23:58:48,371 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) release mem from host: 4, old used: 1073741824,reserved: 0, total: 132226129920; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  1774. 2014-11-26 23:58:48,399 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  1775. 2014-11-26 23:58:48,399 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) We are allocating VM, increasing the used capacity of this host:3
  1776. 2014-11-26 23:58:48,399 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) Current Used CPU: 0 , Free CPU:88000 ,Requested CPU: 500
  1777. 2014-11-26 23:58:48,399 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) Current Used RAM: 0 , Free RAM:132226129920 ,Requested RAM: 1073741824
  1778. 2014-11-26 23:58:48,399 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) CPU STATS after allocation: for host: 3, old used: 0, old reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used:500, reserved:0; requested cpu:500,alloc_from_last:false
  1779. 2014-11-26 23:58:48,399 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) RAM STATS after allocation: for host: 3, old used: 0, old reserved: 0, total: 132226129920; new used: 1073741824, reserved: 0; requested mem: 1073741824,alloc_from_last:false
  1780. 2014-11-26 23:58:48,405 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9a467cf9) VM is being created in podId: 1
  1781. 2014-11-26 23:58:48,417 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-9a467cf9) Network id=200 is already implemented
  1782. 2014-11-26 23:58:48,472 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-9a467cf9) Network id=202 is already implemented
  1783. 2014-11-26 23:58:48,540 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-9a467cf9) Network id=201 is already implemented
  1784. 2014-11-26 23:58:48,593 DEBUG [c.c.n.g.PodBasedNetworkGuru] (consoleproxy-1:ctx-9a467cf9) Allocated a nic NicProfile[3-1-ee5c186f-0673-4daa-ac94-90daf20040ff-10.3.4.180-null for VM[ConsoleProxy|v-1-VM]
  1785. 2014-11-26 23:58:48,609 DEBUG [o.a.c.e.o.VolumeOrchestrator] (consoleproxy-1:ctx-9a467cf9) Checking if we need to prepare 1 volumes for VM[ConsoleProxy|v-1-VM]
  1786. 2014-11-26 23:58:48,640 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (consoleproxy-1:ctx-9a467cf9) template 1 is already in store:1, type:Image
  1787. 2014-11-26 23:58:48,651 DEBUG [o.a.c.s.d.PrimaryDataStoreImpl] (consoleproxy-1:ctx-9a467cf9) Not found (templateId:1poolId:2) in template_spool_ref, persisting it
  1788. 2014-11-26 23:58:48,666 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (consoleproxy-1:ctx-9a467cf9) template 1 is already in store:2, type:Primary
  1789. 2014-11-26 23:58:48,669 DEBUG [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-9a467cf9) Found template routing-1 in storage pool 2 with VMTemplateStoragePool id: 669
  1790. 2014-11-26 23:58:48,681 DEBUG [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-9a467cf9) Acquire lock on VMTemplateStoragePool 669 with timeout 3600 seconds
  1791. 2014-11-26 23:58:48,686 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-9a467cf9) lock is acquired for VMTemplateStoragePool 669
  1792. 2014-11-26 23:58:48,701 DEBUG [o.a.c.s.m.AncientDataMotionStrategy] (consoleproxy-1:ctx-9a467cf9) copyAsync inspecting src type TEMPLATE copyAsync inspecting dest type TEMPLATE
  1793. 2014-11-26 23:58:48,725 DEBUG [c.c.a.m.ClusteredAgentAttache] (consoleproxy-1:ctx-9a467cf9) Seq 1-619512187: Forwarding Seq 1-619512187: { Cmd , MgmtId: 226850023912365, via: 1(cloud-host6.cgg.gov.in), Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/1/","origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"9cd0b1ae-758b-11e4-aa51-ba311310a163","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.3.4.40/ibm/share1","_role":"Image"}},"name":"routing-1","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"9cd0b1ae-758b-11e4-aa51-ba311310a163","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"CloudStore-2","id":2,"poolType":"PreSetup","host":"localhost","path":"/CloudStore-2","port":0,"url":"PreSetup://localhost//CloudStore-2/?ROLE=Primary&STOREUUID=CloudStore-2"}},"name":"routing-1","hypervisorType":"XenServer"}},"executeInSequence":false,"options":{},"wait":10800}}] } to 68995168937102
  1794. 2014-11-26 23:58:49,157 DEBUG [c.c.a.ApiServlet] (catalina-exec-13:ctx-8e3c87c7) ===START=== 10.3.4.7 -- GET apiKey=BJ3Ma7AbVQYFU3zZASKULq8JQd9SaGGKIqiA01_ryevqnyaVkNoawmRORwqHBCBs-O4rDMd03BNKcGZd7lj7jg&command=listConfigurations&name=default.page.size&response=json&signature=xMOA0z46ZSJhwIOZ/GLVd1IlyjE%3D
  1795. 2014-11-26 23:58:49,157 DEBUG [c.c.a.ApiServlet] (catalina-exec-5:ctx-d5da44df) ===START=== 10.3.4.7 -- GET apiKey=BJ3Ma7AbVQYFU3zZASKULq8JQd9SaGGKIqiA01_ryevqnyaVkNoawmRORwqHBCBs-O4rDMd03BNKcGZd7lj7jg&command=listConfigurations&name=default.page.size&response=json&signature=xMOA0z46ZSJhwIOZ/GLVd1IlyjE%3D
  1796. 2014-11-26 23:58:49,161 DEBUG [c.c.a.ApiServer] (catalina-exec-13:ctx-8e3c87c7 ctx-da405cce) apiKey does not map to a valid user -- ignoring request, apiKey: BJ3Ma7AbVQYFU3zZASKULq8JQd9SaGGKIqiA01_ryevqnyaVkNoawmRORwqHBCBs-O4rDMd03BNKcGZd7lj7jg
  1797. 2014-11-26 23:58:49,162 DEBUG [c.c.a.ApiServer] (catalina-exec-5:ctx-d5da44df ctx-5c32d80c) apiKey does not map to a valid user -- ignoring request, apiKey: BJ3Ma7AbVQYFU3zZASKULq8JQd9SaGGKIqiA01_ryevqnyaVkNoawmRORwqHBCBs-O4rDMd03BNKcGZd7lj7jg
  1798. 2014-11-26 23:58:49,162 DEBUG [c.c.a.ApiServlet] (catalina-exec-13:ctx-8e3c87c7 ctx-da405cce) ===END=== 10.3.4.7 -- GET apiKey=BJ3Ma7AbVQYFU3zZASKULq8JQd9SaGGKIqiA01_ryevqnyaVkNoawmRORwqHBCBs-O4rDMd03BNKcGZd7lj7jg&command=listConfigurations&name=default.page.size&response=json&signature=xMOA0z46ZSJhwIOZ/GLVd1IlyjE%3D
  1799. 2014-11-26 23:58:49,162 DEBUG [c.c.a.ApiServlet] (catalina-exec-5:ctx-d5da44df ctx-5c32d80c) ===END=== 10.3.4.7 -- GET apiKey=BJ3Ma7AbVQYFU3zZASKULq8JQd9SaGGKIqiA01_ryevqnyaVkNoawmRORwqHBCBs-O4rDMd03BNKcGZd7lj7jg&command=listConfigurations&name=default.page.size&response=json&signature=xMOA0z46ZSJhwIOZ/GLVd1IlyjE%3D
  1800. 2014-11-26 23:58:50,892 DEBUG [c.c.a.t.Request] (AgentManager-Handler-10:null) Seq 1-619512187: Processing: { Ans: , MgmtId: 226850023912365, via: 1, Ver: v1, Flags: 10, [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 3e1f2113-438a-05e7-1b46-4c9b14d56144","wait":0}}] }
  1801. 2014-11-26 23:58:50,892 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-9a467cf9) Seq 1-619512187: Received: { Ans: , MgmtId: 226850023912365, via: 1, Ver: v1, Flags: 10, { CopyCmdAnswer } }
  1802. 2014-11-26 23:58:50,916 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-9a467cf9) releasing lock for VMTemplateStoragePool 669
  1803. 2014-11-26 23:58:50,917 WARN [c.c.u.d.Merovingian2] (consoleproxy-1:ctx-9a467cf9) Was unable to find lock for the key template_spool_ref669 and thread id 1994469474
  1804. 2014-11-26 23:58:50,917 DEBUG [o.a.c.e.o.VolumeOrchestrator] (consoleproxy-1:ctx-9a467cf9) Unable to create Vol[1|vm=1|ROOT]:Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 3e1f2113-438a-05e7-1b46-4c9b14d56144
  1805. 2014-11-26 23:58:50,917 INFO [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9a467cf9) Unable to contact resource.
  1806. com.cloud.exception.StorageUnavailableException: Resource [StoragePool:2] is unreachable: Unable to create Vol[1|vm=1|ROOT]:Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 3e1f2113-438a-05e7-1b46-4c9b14d56144
  1807. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.recreateVolume(VolumeOrchestrator.java:1202)
  1808. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.prepare(VolumeOrchestrator.java:1254)
  1809. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:962)
  1810. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761)
  1811. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:745)
  1812. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.startProxy(ConsoleProxyManagerImpl.java:555)
  1813. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.allocCapacity(ConsoleProxyManagerImpl.java:941)
  1814. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:1666)
  1815. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:157)
  1816. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:118)
  1817. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:35)
  1818. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:88)
  1819. at com.cloud.vm.SystemVmLoadScanner$1.runInContext(SystemVmLoadScanner.java:79)
  1820. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  1821. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  1822. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  1823. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  1824. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  1825. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  1826. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
  1827. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
  1828. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
  1829. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  1830. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  1831. at java.lang.Thread.run(Thread.java:744)
  1832. 2014-11-26 23:58:50,928 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9a467cf9) Cleaning up resources for the vm VM[ConsoleProxy|v-1-VM] in Starting state
  1833. 2014-11-26 23:58:50,938 DEBUG [c.c.a.m.ClusteredAgentAttache] (consoleproxy-1:ctx-9a467cf9) Seq 3-1990132099: Forwarding Seq 3-1990132099: { Cmd , MgmtId: 226850023912365, via: 3(cloud-host8.cgg.gov.in), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"v-1-VM","wait":0}}] } to 68995168937102
  1834. 2014-11-26 23:58:51,021 DEBUG [c.c.a.t.Request] (AgentManager-Handler-11:null) Seq 3-1990132099: Processing: { Ans: , MgmtId: 226850023912365, via: 3, Ver: v1, Flags: 10, [{"com.cloud.agent.api.StopAnswer":{"result":true,"details":"VM does not exist","wait":0}}] }
  1835. 2014-11-26 23:58:51,022 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-9a467cf9) Seq 3-1990132099: Received: { Ans: , MgmtId: 226850023912365, via: 3, Ver: v1, Flags: 10, { StopAnswer } }
  1836. 2014-11-26 23:58:51,047 DEBUG [c.c.n.g.ControlNetworkGuru] (consoleproxy-1:ctx-9a467cf9) Released nic: NicProfile[2-1-null-null-null
  1837. 2014-11-26 23:58:51,070 DEBUG [c.c.d.d.DataCenterIpAddressDaoImpl] (consoleproxy-1:ctx-9a467cf9) Releasing ip address for reservationId=ee5c186f-0673-4daa-ac94-90daf20040ff, instance=3
  1838. 2014-11-26 23:58:51,072 DEBUG [c.c.n.g.PodBasedNetworkGuru] (consoleproxy-1:ctx-9a467cf9) Released nic: NicProfile[3-1-null-null-null
  1839. 2014-11-26 23:58:51,082 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9a467cf9) Successfully released network resources for the vm VM[ConsoleProxy|v-1-VM]
  1840. 2014-11-26 23:58:51,082 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9a467cf9) Successfully cleanued up resources for the vm VM[ConsoleProxy|v-1-VM] in Starting state
  1841. 2014-11-26 23:58:51,090 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Deploy avoids pods: null, clusters: null, hosts: [2, 3, 4, 5]
  1842. 2014-11-26 23:58:51,093 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@1ca8cb54
  1843. 2014-11-26 23:58:51,093 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Trying to allocate a host and storage pools from dc:1, pod:1,cluster:null, requested cpu: 500, requested ram: 1073741824
  1844. 2014-11-26 23:58:51,093 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Is ROOT volume READY (pool already allocated)?: No
  1845. 2014-11-26 23:58:51,093 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-9a467cf9) Searching resources only under specified Pod: 1
  1846. 2014-11-26 23:58:51,094 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-9a467cf9) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Pod: 1
  1847. 2014-11-26 23:58:51,115 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Checking resources in Cluster: 1 under Pod: 1
  1848. 2014-11-26 23:58:51,115 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Looking for hosts in dc: 1 pod:1 cluster:1
  1849. 2014-11-26 23:58:51,123 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) FirstFitAllocator has 5 hosts to check for allocation: [Host[-2-Routing], Host[-4-Routing], Host[-1-Routing], Host[-3-Routing], Host[-5-Routing]]
  1850. 2014-11-26 23:58:51,143 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Found 5 hosts for allocation after prioritization: [Host[-2-Routing], Host[-4-Routing], Host[-1-Routing], Host[-3-Routing], Host[-5-Routing]]
  1851. 2014-11-26 23:58:51,144 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=1024
  1852. 2014-11-26 23:58:51,144 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host name: cloud-host10.cgg.gov.in, hostId: 2 is in avoid set, skipping this and trying other available hosts
  1853. 2014-11-26 23:58:51,144 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host name: cloud-host9.cgg.gov.in, hostId: 4 is in avoid set, skipping this and trying other available hosts
  1854. 2014-11-26 23:58:51,161 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host: 1 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  1855. 2014-11-26 23:58:51,161 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  1856. 2014-11-26 23:58:51,168 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  1857. 2014-11-26 23:58:51,168 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Free CPU: 87500 , Requested CPU: 500
  1858. 2014-11-26 23:58:51,168 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Free RAM: 130389729280 , Requested RAM: 1073741824
  1859. 2014-11-26 23:58:51,168 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host has enough CPU and RAM available
  1860. 2014-11-26 23:58:51,168 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 1, used: 500, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1861. 2014-11-26 23:58:51,168 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 1, used: 536870912, reserved: 0, total: 130926600192; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1862. 2014-11-26 23:58:51,168 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Found a suitable host, adding to list: 1
  1863. 2014-11-26 23:58:51,168 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host name: cloud-host8.cgg.gov.in, hostId: 3 is in avoid set, skipping this and trying other available hosts
  1864. 2014-11-26 23:58:51,168 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host name: cloud-host7.cgg.gov.in, hostId: 5 is in avoid set, skipping this and trying other available hosts
  1865. 2014-11-26 23:58:51,168 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host Allocator returning 1 suitable hosts
  1866. 2014-11-26 23:58:51,172 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Checking suitable pools for volume (Id, Type): (1,ROOT)
  1867. 2014-11-26 23:58:51,172 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) We need to allocate new storagepool for this volume
  1868. 2014-11-26 23:58:51,172 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Calling StoragePoolAllocators to find suitable pools
  1869. 2014-11-26 23:58:51,175 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (consoleproxy-1:ctx-9a467cf9) LocalStoragePoolAllocator trying to find storage pool to fit the vm
  1870. 2014-11-26 23:58:51,175 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9a467cf9) ClusterScopeStoragePoolAllocator looking for storage pool
  1871. 2014-11-26 23:58:51,175 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9a467cf9) Looking for pools in dc: 1 pod:1 cluster:1
  1872. 2014-11-26 23:58:51,178 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9a467cf9) Found pools matching tags: [Pool[2|PreSetup]]
  1873. 2014-11-26 23:58:51,181 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9a467cf9) Removing pool Pool[2|PreSetup] from avoid set, must have been inserted when searching for another disk's tag
  1874. 2014-11-26 23:58:51,184 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] (consoleproxy-1:ctx-9a467cf9) Checking if storage pool is suitable, name: null ,poolId: 2
  1875. 2014-11-26 23:58:51,192 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-fbbc9cca) Found 0 routers to update status.
  1876. 2014-11-26 23:58:51,195 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-fbbc9cca) Found 0 networks to update RvR status.
  1877. 2014-11-26 23:58:51,196 DEBUG [c.c.s.StorageManagerImpl] (consoleproxy-1:ctx-9a467cf9) Checking pool 2 for storage, totalSize: 1649254858752, usedBytes: 297795584, usedPct: 1.8056371483140182E-4, disable threshold: 0.85
  1878. 2014-11-26 23:58:51,204 DEBUG [c.c.s.StorageManagerImpl] (consoleproxy-1:ctx-9a467cf9) Checking pool: 2 for volume allocation [Vol[1|vm=1|ROOT]], maxSize : 1649254858752, totalAllocatedSize : 0, askingSize : 0, allocated disable threshold: 0.85
  1879. 2014-11-26 23:58:51,204 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-9a467cf9) ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
  1880. 2014-11-26 23:58:51,204 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Trying to find a potenial host and associated storage pools from the suitable host/pool lists for this VM
  1881. 2014-11-26 23:58:51,204 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Checking if host: 1 can access any suitable storage pool for volume: ROOT
  1882. 2014-11-26 23:58:51,205 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Host: 1 can access pool: 2
  1883. 2014-11-26 23:58:51,207 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Found a potential host id: 1 name: cloud-host6.cgg.gov.in and associated storage pools for this VM
  1884. 2014-11-26 23:58:51,208 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Returning Deployment Destination: Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(1)-Storage(Volume(1|ROOT-->Pool(2))]
  1885. 2014-11-26 23:58:51,208 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9a467cf9) Deployment found - P0=VM[ConsoleProxy|v-1-VM], P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(1)-Storage(Volume(1|ROOT-->Pool(2))]
  1886. 2014-11-26 23:58:51,235 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) VM state transitted from :Starting to Starting with event: OperationRetryvm's original host id: null new host id: 1 host id before state transition: 3
  1887. 2014-11-26 23:58:51,252 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  1888. 2014-11-26 23:58:51,252 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) Hosts's actual total RAM: 132226133760 and RAM after applying overprovisioning: 132226129920
  1889. 2014-11-26 23:58:51,253 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) release cpu from host: 3, old used: 500,reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  1890. 2014-11-26 23:58:51,253 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) release mem from host: 3, old used: 1073741824,reserved: 0, total: 132226129920; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  1891. 2014-11-26 23:58:51,312 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  1892. 2014-11-26 23:58:51,312 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) We are allocating VM, increasing the used capacity of this host:1
  1893. 2014-11-26 23:58:51,312 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) Current Used CPU: 500 , Free CPU:87500 ,Requested CPU: 500
  1894. 2014-11-26 23:58:51,312 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) Current Used RAM: 536870912 , Free RAM:130389729280 ,Requested RAM: 1073741824
  1895. 2014-11-26 23:58:51,312 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) CPU STATS after allocation: for host: 1, old used: 500, old reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used:1000, reserved:0; requested cpu:500,alloc_from_last:false
  1896. 2014-11-26 23:58:51,312 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) RAM STATS after allocation: for host: 1, old used: 536870912, old reserved: 0, total: 130926600192; new used: 1610612736, reserved: 0; requested mem: 1073741824,alloc_from_last:false
  1897. 2014-11-26 23:58:51,320 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9a467cf9) VM is being created in podId: 1
  1898. 2014-11-26 23:58:51,331 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-9a467cf9) Network id=200 is already implemented
  1899. 2014-11-26 23:58:51,387 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-9a467cf9) Network id=202 is already implemented
  1900. 2014-11-26 23:58:51,448 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-9a467cf9) Network id=201 is already implemented
  1901. 2014-11-26 23:58:51,503 DEBUG [c.c.n.g.PodBasedNetworkGuru] (consoleproxy-1:ctx-9a467cf9) Allocated a nic NicProfile[3-1-ee5c186f-0673-4daa-ac94-90daf20040ff-10.3.4.149-null for VM[ConsoleProxy|v-1-VM]
  1902. 2014-11-26 23:58:51,521 DEBUG [o.a.c.e.o.VolumeOrchestrator] (consoleproxy-1:ctx-9a467cf9) Checking if we need to prepare 1 volumes for VM[ConsoleProxy|v-1-VM]
  1903. 2014-11-26 23:58:51,550 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (consoleproxy-1:ctx-9a467cf9) template 1 is already in store:1, type:Image
  1904. 2014-11-26 23:58:51,561 DEBUG [o.a.c.s.d.PrimaryDataStoreImpl] (consoleproxy-1:ctx-9a467cf9) Not found (templateId:1poolId:2) in template_spool_ref, persisting it
  1905. 2014-11-26 23:58:51,600 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (consoleproxy-1:ctx-9a467cf9) template 1 is already in store:2, type:Primary
  1906. 2014-11-26 23:58:51,604 DEBUG [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-9a467cf9) Found template routing-1 in storage pool 2 with VMTemplateStoragePool id: 670
  1907. 2014-11-26 23:58:51,617 DEBUG [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-9a467cf9) Acquire lock on VMTemplateStoragePool 670 with timeout 3600 seconds
  1908. 2014-11-26 23:58:51,622 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-9a467cf9) lock is acquired for VMTemplateStoragePool 670
  1909. 2014-11-26 23:58:51,637 DEBUG [o.a.c.s.m.AncientDataMotionStrategy] (consoleproxy-1:ctx-9a467cf9) copyAsync inspecting src type TEMPLATE copyAsync inspecting dest type TEMPLATE
  1910. 2014-11-26 23:58:51,663 DEBUG [c.c.a.m.ClusteredAgentAttache] (consoleproxy-1:ctx-9a467cf9) Seq 3-1990132100: Forwarding Seq 3-1990132100: { Cmd , MgmtId: 226850023912365, via: 3(cloud-host8.cgg.gov.in), Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/1/","origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"9cd0b1ae-758b-11e4-aa51-ba311310a163","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.3.4.40/ibm/share1","_role":"Image"}},"name":"routing-1","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"9cd0b1ae-758b-11e4-aa51-ba311310a163","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"CloudStore-2","id":2,"poolType":"PreSetup","host":"localhost","path":"/CloudStore-2","port":0,"url":"PreSetup://localhost//CloudStore-2/?ROLE=Primary&STOREUUID=CloudStore-2"}},"name":"routing-1","hypervisorType":"XenServer"}},"executeInSequence":false,"options":{},"wait":10800}}] } to 68995168937102
  1911. 2014-11-26 23:58:53,796 DEBUG [c.c.a.t.Request] (AgentManager-Handler-12:null) Seq 3-1990132100: Processing: { Ans: , MgmtId: 226850023912365, via: 3, Ver: v1, Flags: 10, [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 3e1f2113-438a-05e7-1b46-4c9b14d56144","wait":0}}] }
  1912. 2014-11-26 23:58:53,797 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-9a467cf9) Seq 3-1990132100: Received: { Ans: , MgmtId: 226850023912365, via: 3, Ver: v1, Flags: 10, { CopyCmdAnswer } }
  1913. 2014-11-26 23:58:53,823 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-9a467cf9) releasing lock for VMTemplateStoragePool 670
  1914. 2014-11-26 23:58:53,824 WARN [c.c.u.d.Merovingian2] (consoleproxy-1:ctx-9a467cf9) Was unable to find lock for the key template_spool_ref670 and thread id 1994469474
  1915. 2014-11-26 23:58:53,824 DEBUG [o.a.c.e.o.VolumeOrchestrator] (consoleproxy-1:ctx-9a467cf9) Unable to create Vol[1|vm=1|ROOT]:Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 3e1f2113-438a-05e7-1b46-4c9b14d56144
  1916. 2014-11-26 23:58:53,824 INFO [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9a467cf9) Unable to contact resource.
  1917. com.cloud.exception.StorageUnavailableException: Resource [StoragePool:2] is unreachable: Unable to create Vol[1|vm=1|ROOT]:Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 3e1f2113-438a-05e7-1b46-4c9b14d56144
  1918. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.recreateVolume(VolumeOrchestrator.java:1202)
  1919. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.prepare(VolumeOrchestrator.java:1254)
  1920. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:962)
  1921. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761)
  1922. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:745)
  1923. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.startProxy(ConsoleProxyManagerImpl.java:555)
  1924. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.allocCapacity(ConsoleProxyManagerImpl.java:941)
  1925. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:1666)
  1926. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:157)
  1927. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:118)
  1928. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:35)
  1929. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:88)
  1930. at com.cloud.vm.SystemVmLoadScanner$1.runInContext(SystemVmLoadScanner.java:79)
  1931. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  1932. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  1933. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  1934. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  1935. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  1936. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  1937. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
  1938. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
  1939. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
  1940. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  1941. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  1942. at java.lang.Thread.run(Thread.java:744)
  1943. 2014-11-26 23:58:53,833 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9a467cf9) Cleaning up resources for the vm VM[ConsoleProxy|v-1-VM] in Starting state
  1944. 2014-11-26 23:58:53,842 DEBUG [c.c.a.m.ClusteredAgentAttache] (consoleproxy-1:ctx-9a467cf9) Seq 1-619512188: Forwarding Seq 1-619512188: { Cmd , MgmtId: 226850023912365, via: 1(cloud-host6.cgg.gov.in), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"v-1-VM","wait":0}}] } to 68995168937102
  1945. 2014-11-26 23:58:53,953 DEBUG [c.c.a.t.Request] (AgentManager-Handler-13:null) Seq 1-619512188: Processing: { Ans: , MgmtId: 226850023912365, via: 1, Ver: v1, Flags: 10, [{"com.cloud.agent.api.StopAnswer":{"result":true,"details":"VM does not exist","wait":0}}] }
  1946. 2014-11-26 23:58:53,953 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-9a467cf9) Seq 1-619512188: Received: { Ans: , MgmtId: 226850023912365, via: 1, Ver: v1, Flags: 10, { StopAnswer } }
  1947. 2014-11-26 23:58:53,981 DEBUG [c.c.n.g.ControlNetworkGuru] (consoleproxy-1:ctx-9a467cf9) Released nic: NicProfile[2-1-null-null-null
  1948. 2014-11-26 23:58:54,003 DEBUG [c.c.d.d.DataCenterIpAddressDaoImpl] (consoleproxy-1:ctx-9a467cf9) Releasing ip address for reservationId=ee5c186f-0673-4daa-ac94-90daf20040ff, instance=3
  1949. 2014-11-26 23:58:54,005 DEBUG [c.c.n.g.PodBasedNetworkGuru] (consoleproxy-1:ctx-9a467cf9) Released nic: NicProfile[3-1-null-null-null
  1950. 2014-11-26 23:58:54,017 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9a467cf9) Successfully released network resources for the vm VM[ConsoleProxy|v-1-VM]
  1951. 2014-11-26 23:58:54,017 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9a467cf9) Successfully cleanued up resources for the vm VM[ConsoleProxy|v-1-VM] in Starting state
  1952. 2014-11-26 23:58:54,025 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Deploy avoids pods: null, clusters: null, hosts: [1, 2, 3, 4, 5]
  1953. 2014-11-26 23:58:54,028 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@1ca8cb54
  1954. 2014-11-26 23:58:54,028 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Trying to allocate a host and storage pools from dc:1, pod:1,cluster:null, requested cpu: 500, requested ram: 1073741824
  1955. 2014-11-26 23:58:54,028 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Is ROOT volume READY (pool already allocated)?: No
  1956. 2014-11-26 23:58:54,028 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-9a467cf9) Searching resources only under specified Pod: 1
  1957. 2014-11-26 23:58:54,028 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-9a467cf9) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Pod: 1
  1958. 2014-11-26 23:58:54,051 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Checking resources in Cluster: 1 under Pod: 1
  1959. 2014-11-26 23:58:54,051 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Looking for hosts in dc: 1 pod:1 cluster:1
  1960. 2014-11-26 23:58:54,060 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) FirstFitAllocator has 5 hosts to check for allocation: [Host[-3-Routing], Host[-5-Routing], Host[-4-Routing], Host[-2-Routing], Host[-1-Routing]]
  1961. 2014-11-26 23:58:54,077 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Found 5 hosts for allocation after prioritization: [Host[-3-Routing], Host[-5-Routing], Host[-4-Routing], Host[-2-Routing], Host[-1-Routing]]
  1962. 2014-11-26 23:58:54,077 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=1024
  1963. 2014-11-26 23:58:54,077 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host name: cloud-host8.cgg.gov.in, hostId: 3 is in avoid set, skipping this and trying other available hosts
  1964. 2014-11-26 23:58:54,077 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host name: cloud-host7.cgg.gov.in, hostId: 5 is in avoid set, skipping this and trying other available hosts
  1965. 2014-11-26 23:58:54,077 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host name: cloud-host9.cgg.gov.in, hostId: 4 is in avoid set, skipping this and trying other available hosts
  1966. 2014-11-26 23:58:54,077 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host name: cloud-host10.cgg.gov.in, hostId: 2 is in avoid set, skipping this and trying other available hosts
  1967. 2014-11-26 23:58:54,077 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host name: cloud-host6.cgg.gov.in, hostId: 1 is in avoid set, skipping this and trying other available hosts
  1968. 2014-11-26 23:58:54,077 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-9a467cf9 FirstFitRoutingAllocator) Host Allocator returning 0 suitable hosts
  1969. 2014-11-26 23:58:54,077 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) No suitable hosts found
  1970. 2014-11-26 23:58:54,077 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) No suitable hosts found under this Cluster: 1
  1971. 2014-11-26 23:58:54,081 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-9a467cf9) Could not find suitable Deployment Destination for this VM under any clusters, returning.
  1972. 2014-11-26 23:58:54,081 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-9a467cf9) Searching resources only under specified Pod: 1
  1973. 2014-11-26 23:58:54,082 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-9a467cf9) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Pod: 1
  1974. 2014-11-26 23:58:54,091 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-9a467cf9) Removing from the clusterId list these clusters from avoid set: [1]
  1975. 2014-11-26 23:58:54,091 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-9a467cf9) No clusters found after removing disabled clusters and clusters in avoid list, returning.
  1976. 2014-11-26 23:58:54,116 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: 1
  1977. 2014-11-26 23:58:54,131 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  1978. 2014-11-26 23:58:54,131 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) Hosts's actual total RAM: 130926604032 and RAM after applying overprovisioning: 130926600192
  1979. 2014-11-26 23:58:54,131 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) release cpu from host: 1, old used: 1000,reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used: 500,reserved:0; movedfromreserved: false,moveToReserveredfalse
  1980. 2014-11-26 23:58:54,131 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-9a467cf9) release mem from host: 1, old used: 1610612736,reserved: 0, total: 130926600192; new used: 536870912,reserved:0; movedfromreserved: false,moveToReserveredfalse
  1981. 2014-11-26 23:58:54,139 WARN [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-9a467cf9) Exception while trying to start console proxy
  1982. com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-1-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  1983. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:921)
  1984. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761)
  1985. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:745)
  1986. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.startProxy(ConsoleProxyManagerImpl.java:555)
  1987. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.allocCapacity(ConsoleProxyManagerImpl.java:941)
  1988. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:1666)
  1989. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:157)
  1990. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:118)
  1991. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:35)
  1992. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:88)
  1993. at com.cloud.vm.SystemVmLoadScanner$1.runInContext(SystemVmLoadScanner.java:79)
  1994. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  1995. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  1996. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  1997. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  1998. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  1999. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  2000. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
  2001. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
  2002. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
  2003. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  2004. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  2005. at java.lang.Thread.run(Thread.java:744)
  2006. 2014-11-26 23:58:56,022 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-254e88d9) Resetting hosts suitable for reconnect
  2007. 2014-11-26 23:58:56,026 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-254e88d9) Completed resetting hosts suitable for reconnect
  2008. 2014-11-26 23:58:56,026 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-254e88d9) Acquiring hosts for clusters already owned by this management server
  2009. 2014-11-26 23:58:56,027 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-254e88d9) Completed acquiring hosts for clusters already owned by this management server
  2010. 2014-11-26 23:58:56,027 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-254e88d9) Acquiring hosts for clusters not owned by any management server
  2011. 2014-11-26 23:58:56,028 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-254e88d9) Completed acquiring hosts for clusters not owned by any management server
  2012. 2014-11-26 23:58:56,150 DEBUG [c.c.s.StatsCollector] (StatsCollector-1:ctx-92bec5a9) HostStatsCollector is running...
  2013. 2014-11-26 23:58:56,179 DEBUG [c.c.a.m.ClusteredAgentAttache] (StatsCollector-1:ctx-92bec5a9) Seq 1-619512189: Forwarding null to 68995168937102
  2014. 2014-11-26 23:58:56,488 DEBUG [c.c.a.t.Request] (StatsCollector-1:ctx-92bec5a9) Seq 1-619512189: Received: { Ans: , MgmtId: 226850023912365, via: 1, Ver: v1, Flags: 10, { GetHostStatsAnswer } }
  2015. 2014-11-26 23:58:56,511 DEBUG [c.c.a.m.ClusteredAgentAttache] (StatsCollector-1:ctx-92bec5a9) Seq 2-2114716033: Forwarding null to 68995168937102
  2016. 2014-11-26 23:58:56,811 DEBUG [c.c.a.t.Request] (StatsCollector-1:ctx-92bec5a9) Seq 2-2114716033: Received: { Ans: , MgmtId: 226850023912365, via: 2, Ver: v1, Flags: 10, { GetHostStatsAnswer } }
  2017. 2014-11-26 23:58:56,835 DEBUG [c.c.a.m.ClusteredAgentAttache] (StatsCollector-1:ctx-92bec5a9) Seq 3-1990132101: Forwarding null to 68995168937102
  2018. 2014-11-26 23:58:57,045 DEBUG [c.c.a.t.Request] (StatsCollector-1:ctx-92bec5a9) Seq 3-1990132101: Received: { Ans: , MgmtId: 226850023912365, via: 3, Ver: v1, Flags: 10, { GetHostStatsAnswer } }
  2019. 2014-11-26 23:58:57,067 DEBUG [c.c.a.m.ClusteredAgentAttache] (StatsCollector-1:ctx-92bec5a9) Seq 4-853737857: Forwarding null to 68995168937102
  2020. 2014-11-26 23:58:57,419 DEBUG [c.c.a.t.Request] (StatsCollector-1:ctx-92bec5a9) Seq 4-853737857: Received: { Ans: , MgmtId: 226850023912365, via: 4, Ver: v1, Flags: 10, { GetHostStatsAnswer } }
  2021. 2014-11-26 23:58:57,442 DEBUG [c.c.a.m.ClusteredAgentAttache] (StatsCollector-1:ctx-92bec5a9) Seq 5-1497235808: Forwarding null to 68995168937102
  2022. 2014-11-26 23:58:57,744 DEBUG [c.c.a.t.Request] (StatsCollector-1:ctx-92bec5a9) Seq 5-1497235808: Received: { Ans: , MgmtId: 226850023912365, via: 5, Ver: v1, Flags: 10, { GetHostStatsAnswer } }
  2023. 2014-11-26 23:59:08,076 DEBUG [c.c.s.StatsCollector] (StatsCollector-2:ctx-24bff7b3) VmStatsCollector is running...
  2024. 2014-11-26 23:59:09,239 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-50b6abde) Zone 1 is ready to launch console proxy
  2025. 2014-11-26 23:59:09,239 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-50b6abde) Expand console proxy standby capacity for zone CGG-Zone1
  2026. 2014-11-26 23:59:09,252 INFO [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-50b6abde) Found a stopped console proxy, bring it up to running pool. proxy vm id : 1
  2027. 2014-11-26 23:59:09,292 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-50b6abde) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
  2028. 2014-11-26 23:59:09,292 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-50b6abde) Successfully transitioned to start state for VM[ConsoleProxy|v-1-VM] reservation id = c0c50813-a05d-4e8c-883a-ffc1d62bf973
  2029. 2014-11-26 23:59:09,297 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-50b6abde) Trying to deploy VM, vm has dcId: 1 and podId: 1
  2030. 2014-11-26 23:59:09,297 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-50b6abde) Deploy avoids pods: null, clusters: null, hosts: null
  2031. 2014-11-26 23:59:09,308 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-50b6abde) Deploy avoids pods: null, clusters: null, hosts: null
  2032. 2014-11-26 23:59:09,310 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-50b6abde) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@1ca8cb54
  2033. 2014-11-26 23:59:09,310 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-50b6abde) Trying to allocate a host and storage pools from dc:1, pod:1,cluster:null, requested cpu: 500, requested ram: 1073741824
  2034. 2014-11-26 23:59:09,310 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-50b6abde) Is ROOT volume READY (pool already allocated)?: No
  2035. 2014-11-26 23:59:09,311 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-50b6abde) Searching resources only under specified Pod: 1
  2036. 2014-11-26 23:59:09,311 DEBUG [c.c.d.FirstFitPlanner] (consoleproxy-1:ctx-50b6abde) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Pod: 1
  2037. 2014-11-26 23:59:09,331 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-50b6abde) Checking resources in Cluster: 1 under Pod: 1
  2038. 2014-11-26 23:59:09,332 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) Looking for hosts in dc: 1 pod:1 cluster:1
  2039. 2014-11-26 23:59:09,342 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) FirstFitAllocator has 5 hosts to check for allocation: [Host[-5-Routing], Host[-4-Routing], Host[-1-Routing], Host[-3-Routing], Host[-2-Routing]]
  2040. 2014-11-26 23:59:09,357 DEBUG [c.c.s.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-22fd78cd) Zone 1 is ready to launch secondary storage VM
  2041. 2014-11-26 23:59:09,359 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) Found 5 hosts for allocation after prioritization: [Host[-5-Routing], Host[-4-Routing], Host[-1-Routing], Host[-3-Routing], Host[-2-Routing]]
  2042. 2014-11-26 23:59:09,359 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=1024
  2043. 2014-11-26 23:59:09,368 INFO [c.c.s.PremiumSecondaryStorageManagerImpl] (secstorage-1:ctx-22fd78cd) No running secondary storage vms found in datacenter id=1, starting one
  2044. 2014-11-26 23:59:09,373 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) Host: 5 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  2045. 2014-11-26 23:59:09,373 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) Checking if host: 5 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  2046. 2014-11-26 23:59:09,382 INFO [c.c.s.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-22fd78cd) No stopped secondary storage vm is available, need to allocate a new secondary storage vm
  2047. 2014-11-26 23:59:09,383 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  2048. 2014-11-26 23:59:09,383 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  2049. 2014-11-26 23:59:09,383 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) Free RAM: 132226129920 , Requested RAM: 1073741824
  2050. 2014-11-26 23:59:09,383 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) Host has enough CPU and RAM available
  2051. 2014-11-26 23:59:09,383 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 5, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  2052. 2014-11-26 23:59:09,383 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 5, used: 0, reserved: 0, total: 132226129920; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  2053. 2014-11-26 23:59:09,383 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) Found a suitable host, adding to list: 5
  2054. 2014-11-26 23:59:09,389 DEBUG [c.c.s.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-22fd78cd) Assign secondary storage vm from a newly started instance for request from data center : 1
  2055. 2014-11-26 23:59:09,401 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) Host: 4 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  2056. 2014-11-26 23:59:09,401 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) Checking if host: 4 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  2057. 2014-11-26 23:59:09,407 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  2058. 2014-11-26 23:59:09,407 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  2059. 2014-11-26 23:59:09,407 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) Free RAM: 132226129920 , Requested RAM: 1073741824
  2060. 2014-11-26 23:59:09,407 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) Host has enough CPU and RAM available
  2061. 2014-11-26 23:59:09,407 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 4, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  2062. 2014-11-26 23:59:09,407 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 4, used: 0, reserved: 0, total: 132226129920; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  2063. 2014-11-26 23:59:09,407 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) Found a suitable host, adding to list: 4
  2064. 2014-11-26 23:59:09,410 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-22fd78cd) Found existing network configuration for offering [Network Offering [1-Public-System-Public-Network]: Ntwk[200|Public|1]
  2065. 2014-11-26 23:59:09,410 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-22fd78cd) Releasing lock for Acct[c6a1e0a2-758b-11e4-aa51-ba311310a163-system]
  2066. 2014-11-26 23:59:09,416 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-22fd78cd) Found existing network configuration for offering [Network Offering [3-Control-System-Control-Network]: Ntwk[202|Control|3]
  2067. 2014-11-26 23:59:09,416 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-22fd78cd) Releasing lock for Acct[c6a1e0a2-758b-11e4-aa51-ba311310a163-system]
  2068. 2014-11-26 23:59:09,421 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) Host: 1 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  2069. 2014-11-26 23:59:09,422 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  2070. 2014-11-26 23:59:09,422 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-22fd78cd) Found existing network configuration for offering [Network Offering [2-Management-System-Management-Network]: Ntwk[201|Management|2]
  2071. 2014-11-26 23:59:09,422 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-22fd78cd) Releasing lock for Acct[c6a1e0a2-758b-11e4-aa51-ba311310a163-system]
  2072. 2014-11-26 23:59:09,426 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  2073. 2014-11-26 23:59:09,426 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  2074. 2014-11-26 23:59:09,426 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) Free RAM: 130926600192 , Requested RAM: 1073741824
  2075. 2014-11-26 23:59:09,426 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) Host has enough CPU and RAM available
  2076. 2014-11-26 23:59:09,426 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 1, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  2077. 2014-11-26 23:59:09,426 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 1, used: 0, reserved: 0, total: 130926600192; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  2078. 2014-11-26 23:59:09,426 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) Found a suitable host, adding to list: 1
  2079. 2014-11-26 23:59:09,429 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-22fd78cd) Found existing network configuration for offering [Network Offering [4-Storage-System-Storage-Network]: Ntwk[203|Storage|4]
  2080. 2014-11-26 23:59:09,429 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-22fd78cd) Releasing lock for Acct[c6a1e0a2-758b-11e4-aa51-ba311310a163-system]
  2081. 2014-11-26 23:59:09,445 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) Host: 3 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  2082. 2014-11-26 23:59:09,445 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) Checking if host: 3 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  2083. 2014-11-26 23:59:09,449 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  2084. 2014-11-26 23:59:09,450 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  2085. 2014-11-26 23:59:09,450 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) Free RAM: 132226129920 , Requested RAM: 1073741824
  2086. 2014-11-26 23:59:09,450 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) Host has enough CPU and RAM available
  2087. 2014-11-26 23:59:09,450 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 3, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  2088. 2014-11-26 23:59:09,450 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 3, used: 0, reserved: 0, total: 132226129920; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  2089. 2014-11-26 23:59:09,450 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) Found a suitable host, adding to list: 3
  2090. 2014-11-26 23:59:09,462 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-22fd78cd) Allocating entries for VM: VM[SecondaryStorageVm|s-136-VM]
  2091. 2014-11-26 23:59:09,468 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) Host: 2 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  2092. 2014-11-26 23:59:09,468 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) Checking if host: 2 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  2093. 2014-11-26 23:59:09,468 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-22fd78cd) Allocating nics for VM[SecondaryStorageVm|s-136-VM]
  2094. 2014-11-26 23:59:09,471 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-22fd78cd) Allocating nic for vm VM[SecondaryStorageVm|s-136-VM] in network Ntwk[200|Public|1] with requested profile NicProfile[0-0-null-null-null
  2095. 2014-11-26 23:59:09,473 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  2096. 2014-11-26 23:59:09,473 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  2097. 2014-11-26 23:59:09,473 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) Free RAM: 132226129920 , Requested RAM: 1073741824
  2098. 2014-11-26 23:59:09,473 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) Host has enough CPU and RAM available
  2099. 2014-11-26 23:59:09,473 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 2, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  2100. 2014-11-26 23:59:09,473 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 2, used: 0, reserved: 0, total: 132226129920; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  2101. 2014-11-26 23:59:09,473 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) Found a suitable host, adding to list: 2
  2102. 2014-11-26 23:59:09,473 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (consoleproxy-1:ctx-50b6abde FirstFitRoutingAllocator) Host Allocator returning 5 suitable hosts
  2103. 2014-11-26 23:59:09,476 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-50b6abde) Checking suitable pools for volume (Id, Type): (1,ROOT)
  2104. 2014-11-26 23:59:09,476 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-50b6abde) We need to allocate new storagepool for this volume
  2105. 2014-11-26 23:59:09,476 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-50b6abde) Calling StoragePoolAllocators to find suitable pools
  2106. 2014-11-26 23:59:09,479 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (consoleproxy-1:ctx-50b6abde) LocalStoragePoolAllocator trying to find storage pool to fit the vm
  2107. 2014-11-26 23:59:09,479 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-50b6abde) ClusterScopeStoragePoolAllocator looking for storage pool
  2108. 2014-11-26 23:59:09,479 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-50b6abde) Looking for pools in dc: 1 pod:1 cluster:1
  2109. 2014-11-26 23:59:09,482 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-50b6abde) Found pools matching tags: [Pool[2|PreSetup]]
  2110. 2014-11-26 23:59:09,484 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-50b6abde) Removing pool Pool[2|PreSetup] from avoid set, must have been inserted when searching for another disk's tag
  2111. 2014-11-26 23:59:09,486 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] (consoleproxy-1:ctx-50b6abde) Checking if storage pool is suitable, name: null ,poolId: 2
  2112. 2014-11-26 23:59:09,495 DEBUG [c.c.s.StorageManagerImpl] (consoleproxy-1:ctx-50b6abde) Checking pool 2 for storage, totalSize: 1649254858752, usedBytes: 297795584, usedPct: 1.8056371483140182E-4, disable threshold: 0.85
  2113. 2014-11-26 23:59:09,498 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-22fd78cd) Allocating nic for vm VM[SecondaryStorageVm|s-136-VM] in network Ntwk[202|Control|3] with requested profile null
  2114. 2014-11-26 23:59:09,501 DEBUG [c.c.s.StorageManagerImpl] (consoleproxy-1:ctx-50b6abde) Checking pool: 2 for volume allocation [Vol[1|vm=1|ROOT]], maxSize : 1649254858752, totalAllocatedSize : 0, askingSize : 0, allocated disable threshold: 0.85
  2115. 2014-11-26 23:59:09,501 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (consoleproxy-1:ctx-50b6abde) ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
  2116. 2014-11-26 23:59:09,501 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-50b6abde) Trying to find a potenial host and associated storage pools from the suitable host/pool lists for this VM
  2117. 2014-11-26 23:59:09,501 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-50b6abde) Checking if host: 5 can access any suitable storage pool for volume: ROOT
  2118. 2014-11-26 23:59:09,502 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-50b6abde) Host: 5 can access pool: 2
  2119. 2014-11-26 23:59:09,503 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-50b6abde) Found a potential host id: 5 name: cloud-host7.cgg.gov.in and associated storage pools for this VM
  2120. 2014-11-26 23:59:09,504 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (consoleproxy-1:ctx-50b6abde) Returning Deployment Destination: Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(5)-Storage(Volume(1|ROOT-->Pool(2))]
  2121. 2014-11-26 23:59:09,504 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-50b6abde) Deployment found - P0=VM[ConsoleProxy|v-1-VM], P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(5)-Storage(Volume(1|ROOT-->Pool(2))]
  2122. 2014-11-26 23:59:09,510 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-22fd78cd) Allocating nic for vm VM[SecondaryStorageVm|s-136-VM] in network Ntwk[201|Management|2] with requested profile null
  2123. 2014-11-26 23:59:09,521 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-50b6abde) VM state transitted from :Starting to Starting with event: OperationRetryvm's original host id: null new host id: 5 host id before state transition: null
  2124. 2014-11-26 23:59:09,526 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-22fd78cd) Allocating nic for vm VM[SecondaryStorageVm|s-136-VM] in network Ntwk[203|Storage|4] with requested profile null
  2125. 2014-11-26 23:59:09,535 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-50b6abde) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  2126. 2014-11-26 23:59:09,535 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-50b6abde) We are allocating VM, increasing the used capacity of this host:5
  2127. 2014-11-26 23:59:09,535 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-50b6abde) Current Used CPU: 0 , Free CPU:88000 ,Requested CPU: 500
  2128. 2014-11-26 23:59:09,536 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-50b6abde) Current Used RAM: 0 , Free RAM:132226129920 ,Requested RAM: 1073741824
  2129. 2014-11-26 23:59:09,536 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-50b6abde) CPU STATS after allocation: for host: 5, old used: 0, old reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used:500, reserved:0; requested cpu:500,alloc_from_last:false
  2130. 2014-11-26 23:59:09,536 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-50b6abde) RAM STATS after allocation: for host: 5, old used: 0, old reserved: 0, total: 132226129920; new used: 1073741824, reserved: 0; requested mem: 1073741824,alloc_from_last:false
  2131. 2014-11-26 23:59:09,542 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-50b6abde) VM is being created in podId: 1
  2132. 2014-11-26 23:59:09,545 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-22fd78cd) Allocating disks for VM[SecondaryStorageVm|s-136-VM]
  2133. 2014-11-26 23:59:09,550 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-50b6abde) Network id=200 is already implemented
  2134. 2014-11-26 23:59:09,554 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-22fd78cd) Allocation completed for VM: VM[SecondaryStorageVm|s-136-VM]
  2135. 2014-11-26 23:59:09,570 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-22fd78cd) received secondary storage vm alert
  2136. 2014-11-26 23:59:09,570 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-22fd78cd) New secondary storage vm created, zone: CGG-Zone1, secStorageVm: s-136-VM, public IP: null, private IP: null
  2137. 2014-11-26 23:59:09,595 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-50b6abde) Network id=202 is already implemented
  2138. 2014-11-26 23:59:09,602 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-22fd78cd) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
  2139. 2014-11-26 23:59:09,602 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-22fd78cd) Successfully transitioned to start state for VM[SecondaryStorageVm|s-136-VM] reservation id = d04f75db-756a-43e3-9a9e-d6643d399efc
  2140. 2014-11-26 23:59:09,606 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-22fd78cd) Trying to deploy VM, vm has dcId: 1 and podId: null
  2141. 2014-11-26 23:59:09,606 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-22fd78cd) Deploy avoids pods: null, clusters: null, hosts: null
  2142. 2014-11-26 23:59:09,615 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-22fd78cd) Deploy avoids pods: null, clusters: null, hosts: null
  2143. 2014-11-26 23:59:09,617 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-22fd78cd) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@1ca8cb54
  2144. 2014-11-26 23:59:09,617 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-22fd78cd) Trying to allocate a host and storage pools from dc:1, pod:null,cluster:null, requested cpu: 500, requested ram: 536870912
  2145. 2014-11-26 23:59:09,617 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-22fd78cd) Is ROOT volume READY (pool already allocated)?: No
  2146. 2014-11-26 23:59:09,617 DEBUG [c.c.d.FirstFitPlanner] (secstorage-1:ctx-22fd78cd) Searching all possible resources under this Zone: 1
  2147. 2014-11-26 23:59:09,619 DEBUG [c.c.d.FirstFitPlanner] (secstorage-1:ctx-22fd78cd) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
  2148. 2014-11-26 23:59:09,635 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-22fd78cd) Checking resources in Cluster: 1 under Pod: 1
  2149. 2014-11-26 23:59:09,635 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) Looking for hosts in dc: 1 pod:1 cluster:1
  2150. 2014-11-26 23:59:09,642 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) FirstFitAllocator has 5 hosts to check for allocation: [Host[-5-Routing], Host[-4-Routing], Host[-1-Routing], Host[-3-Routing], Host[-2-Routing]]
  2151. 2014-11-26 23:59:09,650 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-50b6abde) Network id=201 is already implemented
  2152. 2014-11-26 23:59:09,662 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) Found 5 hosts for allocation after prioritization: [Host[-5-Routing], Host[-4-Routing], Host[-1-Routing], Host[-3-Routing], Host[-2-Routing]]
  2153. 2014-11-26 23:59:09,662 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=512
  2154. 2014-11-26 23:59:09,677 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) Host: 5 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  2155. 2014-11-26 23:59:09,677 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) Checking if host: 5 has enough capacity for requested CPU: 500 and requested RAM: 536870912 , cpuOverprovisioningFactor: 1.0
  2156. 2014-11-26 23:59:09,683 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  2157. 2014-11-26 23:59:09,683 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) Free CPU: 87500 , Requested CPU: 500
  2158. 2014-11-26 23:59:09,683 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) Free RAM: 131152388096 , Requested RAM: 536870912
  2159. 2014-11-26 23:59:09,683 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) Host has enough CPU and RAM available
  2160. 2014-11-26 23:59:09,683 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 5, used: 500, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  2161. 2014-11-26 23:59:09,683 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 5, used: 1073741824, reserved: 0, total: 132226129920; requested mem: 536870912,alloc_from_last_host?:false ,considerReservedCapacity?: true
  2162. 2014-11-26 23:59:09,683 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) Found a suitable host, adding to list: 5
  2163. 2014-11-26 23:59:09,698 DEBUG [c.c.n.g.PodBasedNetworkGuru] (consoleproxy-1:ctx-50b6abde) Allocated a nic NicProfile[3-1-c0c50813-a05d-4e8c-883a-ffc1d62bf973-10.3.4.183-null for VM[ConsoleProxy|v-1-VM]
  2164. 2014-11-26 23:59:09,698 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) Host: 4 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  2165. 2014-11-26 23:59:09,698 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) Checking if host: 4 has enough capacity for requested CPU: 500 and requested RAM: 536870912 , cpuOverprovisioningFactor: 1.0
  2166. 2014-11-26 23:59:09,704 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  2167. 2014-11-26 23:59:09,704 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  2168. 2014-11-26 23:59:09,704 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) Free RAM: 132226129920 , Requested RAM: 536870912
  2169. 2014-11-26 23:59:09,704 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) Host has enough CPU and RAM available
  2170. 2014-11-26 23:59:09,704 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 4, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  2171. 2014-11-26 23:59:09,704 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 4, used: 0, reserved: 0, total: 132226129920; requested mem: 536870912,alloc_from_last_host?:false ,considerReservedCapacity?: true
  2172. 2014-11-26 23:59:09,704 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) Found a suitable host, adding to list: 4
  2173. 2014-11-26 23:59:09,710 DEBUG [o.a.c.e.o.VolumeOrchestrator] (consoleproxy-1:ctx-50b6abde) Checking if we need to prepare 1 volumes for VM[ConsoleProxy|v-1-VM]
  2174. 2014-11-26 23:59:09,718 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) Host: 1 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  2175. 2014-11-26 23:59:09,718 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 536870912 , cpuOverprovisioningFactor: 1.0
  2176. 2014-11-26 23:59:09,723 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  2177. 2014-11-26 23:59:09,723 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  2178. 2014-11-26 23:59:09,723 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) Free RAM: 130926600192 , Requested RAM: 536870912
  2179. 2014-11-26 23:59:09,723 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) Host has enough CPU and RAM available
  2180. 2014-11-26 23:59:09,723 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 1, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  2181. 2014-11-26 23:59:09,723 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 1, used: 0, reserved: 0, total: 130926600192; requested mem: 536870912,alloc_from_last_host?:false ,considerReservedCapacity?: true
  2182. 2014-11-26 23:59:09,723 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) Found a suitable host, adding to list: 1
  2183. 2014-11-26 23:59:09,733 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (consoleproxy-1:ctx-50b6abde) template 1 is already in store:1, type:Image
  2184. 2014-11-26 23:59:09,738 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) Host: 3 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  2185. 2014-11-26 23:59:09,738 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) Checking if host: 3 has enough capacity for requested CPU: 500 and requested RAM: 536870912 , cpuOverprovisioningFactor: 1.0
  2186. 2014-11-26 23:59:09,744 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  2187. 2014-11-26 23:59:09,744 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  2188. 2014-11-26 23:59:09,744 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) Free RAM: 132226129920 , Requested RAM: 536870912
  2189. 2014-11-26 23:59:09,744 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) Host has enough CPU and RAM available
  2190. 2014-11-26 23:59:09,744 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 3, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  2191. 2014-11-26 23:59:09,744 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 3, used: 0, reserved: 0, total: 132226129920; requested mem: 536870912,alloc_from_last_host?:false ,considerReservedCapacity?: true
  2192. 2014-11-26 23:59:09,744 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) Found a suitable host, adding to list: 3
  2193. 2014-11-26 23:59:09,744 DEBUG [o.a.c.s.d.PrimaryDataStoreImpl] (consoleproxy-1:ctx-50b6abde) Not found (templateId:1poolId:2) in template_spool_ref, persisting it
  2194. 2014-11-26 23:59:09,756 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (consoleproxy-1:ctx-50b6abde) template 1 is already in store:2, type:Primary
  2195. 2014-11-26 23:59:09,758 DEBUG [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-50b6abde) Found template routing-1 in storage pool 2 with VMTemplateStoragePool id: 671
  2196. 2014-11-26 23:59:09,766 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) Host: 2 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  2197. 2014-11-26 23:59:09,766 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) Checking if host: 2 has enough capacity for requested CPU: 500 and requested RAM: 536870912 , cpuOverprovisioningFactor: 1.0
  2198. 2014-11-26 23:59:09,771 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  2199. 2014-11-26 23:59:09,771 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  2200. 2014-11-26 23:59:09,771 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) Free RAM: 132226129920 , Requested RAM: 536870912
  2201. 2014-11-26 23:59:09,771 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) Host has enough CPU and RAM available
  2202. 2014-11-26 23:59:09,771 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 2, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  2203. 2014-11-26 23:59:09,771 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 2, used: 0, reserved: 0, total: 132226129920; requested mem: 536870912,alloc_from_last_host?:false ,considerReservedCapacity?: true
  2204. 2014-11-26 23:59:09,771 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) Found a suitable host, adding to list: 2
  2205. 2014-11-26 23:59:09,771 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-22fd78cd FirstFitRoutingAllocator) Host Allocator returning 5 suitable hosts
  2206. 2014-11-26 23:59:09,771 DEBUG [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-50b6abde) Acquire lock on VMTemplateStoragePool 671 with timeout 3600 seconds
  2207. 2014-11-26 23:59:09,774 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-22fd78cd) Checking suitable pools for volume (Id, Type): (136,ROOT)
  2208. 2014-11-26 23:59:09,774 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-22fd78cd) We need to allocate new storagepool for this volume
  2209. 2014-11-26 23:59:09,774 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-22fd78cd) Calling StoragePoolAllocators to find suitable pools
  2210. 2014-11-26 23:59:09,774 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-50b6abde) lock is acquired for VMTemplateStoragePool 671
  2211. 2014-11-26 23:59:09,776 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (secstorage-1:ctx-22fd78cd) LocalStoragePoolAllocator trying to find storage pool to fit the vm
  2212. 2014-11-26 23:59:09,776 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (secstorage-1:ctx-22fd78cd) ClusterScopeStoragePoolAllocator looking for storage pool
  2213. 2014-11-26 23:59:09,776 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (secstorage-1:ctx-22fd78cd) Looking for pools in dc: 1 pod:1 cluster:1
  2214. 2014-11-26 23:59:09,779 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (secstorage-1:ctx-22fd78cd) Found pools matching tags: [Pool[2|PreSetup]]
  2215. 2014-11-26 23:59:09,781 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (secstorage-1:ctx-22fd78cd) Removing pool Pool[2|PreSetup] from avoid set, must have been inserted when searching for another disk's tag
  2216. 2014-11-26 23:59:09,783 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] (secstorage-1:ctx-22fd78cd) Checking if storage pool is suitable, name: null ,poolId: 2
  2217. 2014-11-26 23:59:09,785 DEBUG [o.a.c.s.m.AncientDataMotionStrategy] (consoleproxy-1:ctx-50b6abde) copyAsync inspecting src type TEMPLATE copyAsync inspecting dest type TEMPLATE
  2218. 2014-11-26 23:59:09,791 DEBUG [c.c.s.StorageManagerImpl] (secstorage-1:ctx-22fd78cd) Checking pool 2 for storage, totalSize: 1649254858752, usedBytes: 297795584, usedPct: 1.8056371483140182E-4, disable threshold: 0.85
  2219. 2014-11-26 23:59:09,800 DEBUG [c.c.s.StorageManagerImpl] (secstorage-1:ctx-22fd78cd) Checking pool: 2 for volume allocation [Vol[136|vm=136|ROOT]], maxSize : 1649254858752, totalAllocatedSize : 0, askingSize : 0, allocated disable threshold: 0.85
  2220. 2014-11-26 23:59:09,800 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (secstorage-1:ctx-22fd78cd) ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
  2221. 2014-11-26 23:59:09,800 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-22fd78cd) Trying to find a potenial host and associated storage pools from the suitable host/pool lists for this VM
  2222. 2014-11-26 23:59:09,800 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-22fd78cd) Checking if host: 5 can access any suitable storage pool for volume: ROOT
  2223. 2014-11-26 23:59:09,801 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-22fd78cd) Host: 5 can access pool: 2
  2224. 2014-11-26 23:59:09,802 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-22fd78cd) Found a potential host id: 5 name: cloud-host7.cgg.gov.in and associated storage pools for this VM
  2225. 2014-11-26 23:59:09,803 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-22fd78cd) Returning Deployment Destination: Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(5)-Storage(Volume(136|ROOT-->Pool(2))]
  2226. 2014-11-26 23:59:09,803 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-22fd78cd) Deployment found - P0=VM[SecondaryStorageVm|s-136-VM], P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(5)-Storage(Volume(136|ROOT-->Pool(2))]
  2227. 2014-11-26 23:59:09,807 DEBUG [c.c.a.m.ClusteredAgentAttache] (consoleproxy-1:ctx-50b6abde) Seq 4-853737858: Forwarding Seq 4-853737858: { Cmd , MgmtId: 226850023912365, via: 4(cloud-host9.cgg.gov.in), Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/1/","origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"9cd0b1ae-758b-11e4-aa51-ba311310a163","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.3.4.40/ibm/share1","_role":"Image"}},"name":"routing-1","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"9cd0b1ae-758b-11e4-aa51-ba311310a163","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"CloudStore-2","id":2,"poolType":"PreSetup","host":"localhost","path":"/CloudStore-2","port":0,"url":"PreSetup://localhost//CloudStore-2/?ROLE=Primary&STOREUUID=CloudStore-2"}},"name":"routing-1","hypervisorType":"XenServer"}},"executeInSequence":false,"options":{},"wait":10800}}] } to 68995168937102
  2228. 2014-11-26 23:59:09,823 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-22fd78cd) VM state transitted from :Starting to Starting with event: OperationRetryvm's original host id: null new host id: 5 host id before state transition: null
  2229. 2014-11-26 23:59:09,840 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-22fd78cd) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  2230. 2014-11-26 23:59:09,840 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-22fd78cd) We are allocating VM, increasing the used capacity of this host:5
  2231. 2014-11-26 23:59:09,840 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-22fd78cd) Current Used CPU: 500 , Free CPU:87500 ,Requested CPU: 500
  2232. 2014-11-26 23:59:09,840 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-22fd78cd) Current Used RAM: 1073741824 , Free RAM:131152388096 ,Requested RAM: 536870912
  2233. 2014-11-26 23:59:09,840 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-22fd78cd) CPU STATS after allocation: for host: 5, old used: 500, old reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used:1000, reserved:0; requested cpu:500,alloc_from_last:false
  2234. 2014-11-26 23:59:09,840 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-22fd78cd) RAM STATS after allocation: for host: 5, old used: 1073741824, old reserved: 0, total: 132226129920; new used: 1610612736, reserved: 0; requested mem: 536870912,alloc_from_last:false
  2235. 2014-11-26 23:59:09,847 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-22fd78cd) VM is being created in podId: 1
  2236. 2014-11-26 23:59:09,857 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-22fd78cd) Network id=200 is already implemented
  2237. 2014-11-26 23:59:09,905 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-22fd78cd) Network id=202 is already implemented
  2238. 2014-11-26 23:59:09,964 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-22fd78cd) Network id=201 is already implemented
  2239. 2014-11-26 23:59:10,035 DEBUG [c.c.n.g.PodBasedNetworkGuru] (secstorage-1:ctx-22fd78cd) Allocated a nic NicProfile[542-136-d04f75db-756a-43e3-9a9e-d6643d399efc-10.3.4.199-null for VM[SecondaryStorageVm|s-136-VM]
  2240. 2014-11-26 23:59:10,062 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-22fd78cd) Network id=203 is already implemented
  2241. 2014-11-26 23:59:10,112 DEBUG [c.c.n.g.PodBasedNetworkGuru] (secstorage-1:ctx-22fd78cd) Allocated a nic NicProfile[543-136-d04f75db-756a-43e3-9a9e-d6643d399efc-10.3.4.176-null for VM[SecondaryStorageVm|s-136-VM]
  2242. 2014-11-26 23:59:10,125 DEBUG [o.a.c.e.o.VolumeOrchestrator] (secstorage-1:ctx-22fd78cd) Checking if we need to prepare 1 volumes for VM[SecondaryStorageVm|s-136-VM]
  2243. 2014-11-26 23:59:10,154 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (secstorage-1:ctx-22fd78cd) template 1 is already in store:1, type:Image
  2244. 2014-11-26 23:59:10,167 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (secstorage-1:ctx-22fd78cd) template 1 is already in store:2, type:Primary
  2245. 2014-11-26 23:59:10,169 DEBUG [o.a.c.s.v.VolumeServiceImpl] (secstorage-1:ctx-22fd78cd) Found template routing-1 in storage pool 2 with VMTemplateStoragePool id: 671
  2246. 2014-11-26 23:59:10,179 DEBUG [o.a.c.s.v.VolumeServiceImpl] (secstorage-1:ctx-22fd78cd) Acquire lock on VMTemplateStoragePool 671 with timeout 3600 seconds
  2247. 2014-11-26 23:59:11,969 DEBUG [c.c.a.t.Request] (AgentManager-Handler-4:null) Seq 4-853737858: Processing: { Ans: , MgmtId: 226850023912365, via: 4, Ver: v1, Flags: 10, [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 3e1f2113-438a-05e7-1b46-4c9b14d56144","wait":0}}] }
  2248. 2014-11-26 23:59:11,969 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-50b6abde) Seq 4-853737858: Received: { Ans: , MgmtId: 226850023912365, via: 4, Ver: v1, Flags: 10, { CopyCmdAnswer } }
  2249. 2014-11-26 23:59:11,992 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-50b6abde) releasing lock for VMTemplateStoragePool 671
  2250. 2014-11-26 23:59:11,993 WARN [c.c.u.d.Merovingian2] (consoleproxy-1:ctx-50b6abde) Was unable to find lock for the key template_spool_ref671 and thread id 1994469474
  2251. 2014-11-26 23:59:11,993 DEBUG [o.a.c.e.o.VolumeOrchestrator] (consoleproxy-1:ctx-50b6abde) Unable to create Vol[1|vm=1|ROOT]:Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 3e1f2113-438a-05e7-1b46-4c9b14d56144
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement