API tools faq
paste
Guest User

Untitled

a guest
Mar 24th, 2014
145
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 71.94 KB | None | 0 0
raw download clone embed print report
  1. 2014-03-24 12:16:48,453 INFO [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Trying to connect to 10.208.66.23
  2. 2014-03-24 12:16:48,453 INFO [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Management node 1 is detected inactive by timestamp but is pingable
  3. 2014-03-24 12:16:49,954 DEBUG [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Detected management node left, id:1, nodeIP:10.208.66.23
  4. 2014-03-24 12:16:49,954 INFO [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Trying to connect to 10.208.66.23
  5. 2014-03-24 12:16:49,954 INFO [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Management node 1 is detected inactive by timestamp but is pingable
  6. 2014-03-24 12:16:51,295 DEBUG [cloud.server.StatsCollector] (StatsCollector-2:null) HostStatsCollector is running...
  7. 2014-03-24 12:16:51,447 DEBUG [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Detected management node left, id:1, nodeIP:10.208.66.23
  8. 2014-03-24 12:16:51,447 INFO [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Trying to connect to 10.208.66.23
  9. 2014-03-24 12:16:51,447 INFO [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Management node 1 is detected inactive by timestamp but is pingable
  10. 2014-03-24 12:16:51,875 DEBUG [agent.transport.Request] (StatsCollector-2:null) Seq 1-1197735952: Received: { Ans: , MgmtId: 279278805451338, via: 1, Ver: v1, Flags: 10, { GetHostStatsAnswer } }
  11. 2014-03-24 12:16:52,465 DEBUG [agent.transport.Request] (StatsCollector-2:null) Seq 4-184614929: Received: { Ans: , MgmtId: 279278805451338, via: 4, Ver: v1, Flags: 10, { GetHostStatsAnswer } }
  12. 2014-03-24 12:16:52,939 DEBUG [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Detected management node left, id:1, nodeIP:10.208.66.23
  13. 2014-03-24 12:16:52,939 INFO [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Trying to connect to 10.208.66.23
  14. 2014-03-24 12:16:52,939 INFO [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Management node 1 is detected inactive by timestamp but is pingable
  15. 2014-03-24 12:16:53,204 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-11:null) SeqA 2-108: Processing Seq 2-108: { Cmd , MgmtId: -1, via: 2, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":2,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
  16. 2014-03-24 12:16:53,289 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-11:null) SeqA 2-108: Sending Seq 2-108: { Ans: , MgmtId: 279278805451338, via: 2, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
  17. 2014-03-24 12:16:54,448 DEBUG [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Detected management node left, id:1, nodeIP:10.208.66.23
  18. 2014-03-24 12:16:54,448 INFO [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Trying to connect to 10.208.66.23
  19. 2014-03-24 12:16:54,449 INFO [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Management node 1 is detected inactive by timestamp but is pingable
  20. 2014-03-24 12:16:55,802 DEBUG [cloud.api.ApiServlet] (catalina-exec-1:null) ===START=== 10.208.66.72 -- GET command=startRouter&id=7eb4dea3-7634-44ab-a17c-eb08ae1342f5&response=json&sessionkey=F2OERSvErCXMEdsZHiKAP%2Bz6%2Bbs%3D&_=1395643615864
  21. 2014-03-24 12:16:56,024 DEBUG [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Detected management node left, id:1, nodeIP:10.208.66.23
  22. 2014-03-24 12:16:56,024 INFO [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Trying to connect to 10.208.66.23
  23. 2014-03-24 12:16:56,024 INFO [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Management node 1 is detected inactive by timestamp but is pingable
  24. 2014-03-24 12:16:56,065 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-1:null) submit async job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ], details: AsyncJobVO {id:52, userId: 2, accountId: 2, sessionKey: null, instanceType: DomainRouter, instanceId: 15, cmd: org.apache.cloudstack.api.command.admin.router.StartRouterCmd, cmdOriginator: null, cmdInfo: {"id":"7eb4dea3-7634-44ab-a17c-eb08ae1342f5","response":"json","sessionkey":"F2OERSvErCXMEdsZHiKAP+z6+bs\u003d","cmdEventType":"ROUTER.START","ctxUserId":"2","httpmethod":"GET","_":"1395643615864","ctxAccountId":"2","ctxStartEventId":"425"}, cmdVersion: 0, callbackType: 0, callbackAddress: null, status: 0, processStatus: 0, resultCode: 0, result: null, initMsid: 279278805451338, completeMsid: null, lastUpdated: null, lastPolled: null, created: null}
  25. 2014-03-24 12:16:56,066 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ]) Executing org.apache.cloudstack.api.command.admin.router.StartRouterCmd for job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ]
  26. 2014-03-24 12:16:56,067 DEBUG [cloud.api.ApiServlet] (catalina-exec-1:null) ===END=== 10.208.66.72 -- GET command=startRouter&id=7eb4dea3-7634-44ab-a17c-eb08ae1342f5&response=json&sessionkey=F2OERSvErCXMEdsZHiKAP%2Bz6%2Bbs%3D&_=1395643615864
  27. 2014-03-24 12:16:56,170 DEBUG [cloud.network.NetworkManagerImpl] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ]) Starting network Ntwk[204|Guest|6]...
  28. 2014-03-24 12:16:56,175 DEBUG [cloud.network.NetworkManagerImpl] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ]) Network id=204 is already implemented
  29. 2014-03-24 12:16:56,175 DEBUG [cloud.network.NetworkManagerImpl] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ]) Starting network Ntwk[202|Control|3]...
  30. 2014-03-24 12:16:56,177 DEBUG [cloud.network.NetworkManagerImpl] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ]) Network id=202 is already implemented
  31. 2014-03-24 12:16:56,179 DEBUG [network.router.VirtualNetworkApplianceManagerImpl] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ]) Starting router VM[DomainRouter|r-15-VM]
  32. 2014-03-24 12:16:56,182 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ]) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
  33. 2014-03-24 12:16:56,182 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ]) Successfully transitioned to start state for VM[DomainRouter|r-15-VM] reservation id = 535e5696-11dc-4c52-8316-8e05dfc343ef
  34. 2014-03-24 12:16:56,266 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ]) Trying to deploy VM, vm has dcId: 1 and podId: 1
  35. 2014-03-24 12:16:56,266 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ]) Deploy avoids pods: null, clusters: null, hosts: null
  36. 2014-03-24 12:16:56,267 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ]) Deploy avoids pods: null, clusters: null, hosts: null
  37. 2014-03-24 12:16:56,268 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ]) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner_EnhancerByCloudStack_21958b2b@70ae18dd
  38. 2014-03-24 12:16:56,268 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ]) Trying to allocate a host and storage pools from dc:1, pod:1,cluster:null, requested cpu: 500, requested ram: 134217728
  39. 2014-03-24 12:16:56,268 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ]) Is ROOT volume READY (pool already allocated)?: No
  40. 2014-03-24 12:16:56,268 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ]) Searching resources only under specified Pod: 1
  41. 2014-03-24 12:16:56,268 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ]) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Pod: 1
  42. 2014-03-24 12:16:56,271 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ]) Checking resources in Cluster: 1 under Pod: 1
  43. 2014-03-24 12:16:56,271 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ] FirstFitRoutingAllocator) Looking for hosts in dc: 1 pod:1 cluster:1
  44. 2014-03-24 12:16:56,274 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ] FirstFitRoutingAllocator) FirstFitAllocator has 2 hosts to check for allocation: [Host[-1-Routing], Host[-4-Routing]]
  45. 2014-03-24 12:16:56,277 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ] FirstFitRoutingAllocator) Found 2 hosts for allocation after prioritization: [Host[-1-Routing], Host[-4-Routing]]
  46. 2014-03-24 12:16:56,277 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ] FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=128
  47. 2014-03-24 12:16:56,281 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ] FirstFitRoutingAllocator) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 134217728 , cpuOverprovisioningFactor: 1.0
  48. 2014-03-24 12:16:56,282 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ] FirstFitRoutingAllocator) Hosts's actual total CPU: 11968 and CPU after applying overprovisioning: 11968
  49. 2014-03-24 12:16:56,282 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ] FirstFitRoutingAllocator) Free CPU: 10968 , Requested CPU: 500
  50. 2014-03-24 12:16:56,282 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ] FirstFitRoutingAllocator) Free RAM: 6860107776 , Requested RAM: 134217728
  51. 2014-03-24 12:16:56,282 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ] FirstFitRoutingAllocator) Host has enough CPU and RAM available
  52. 2014-03-24 12:16:56,283 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ] FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 1, used: 1000, reserved: 0, actual total: 11968, total with overprovisioning: 11968; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  53. 2014-03-24 12:16:56,283 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ] FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 1, used: 1342177280, reserved: 0, total: 8202285056; requested mem: 134217728,alloc_from_last_host?:false ,considerReservedCapacity?: true
  54. 2014-03-24 12:16:56,283 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ] FirstFitRoutingAllocator) Found a suitable host, adding to list: 1
  55. 2014-03-24 12:16:56,286 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ] FirstFitRoutingAllocator) Checking if host: 4 has enough capacity for requested CPU: 500 and requested RAM: 134217728 , cpuOverprovisioningFactor: 1.0
  56. 2014-03-24 12:16:56,288 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ] FirstFitRoutingAllocator) Hosts's actual total CPU: 12000 and CPU after applying overprovisioning: 12000
  57. 2014-03-24 12:16:56,288 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ] FirstFitRoutingAllocator) Free CPU: 12000 , Requested CPU: 500
  58. 2014-03-24 12:16:56,288 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ] FirstFitRoutingAllocator) Free RAM: 8202280960 , Requested RAM: 134217728
  59. 2014-03-24 12:16:56,288 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ] FirstFitRoutingAllocator) Host has enough CPU and RAM available
  60. 2014-03-24 12:16:56,288 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ] FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 4, used: 0, reserved: 0, actual total: 12000, total with overprovisioning: 12000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  61. 2014-03-24 12:16:56,288 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ] FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 4, used: 0, reserved: 0, total: 8202280960; requested mem: 134217728,alloc_from_last_host?:false ,considerReservedCapacity?: true
  62. 2014-03-24 12:16:56,288 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ] FirstFitRoutingAllocator) Found a suitable host, adding to list: 4
  63. 2014-03-24 12:16:56,288 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ] FirstFitRoutingAllocator) Host Allocator returning 2 suitable hosts
  64. 2014-03-24 12:16:56,289 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ]) Checking suitable pools for volume (Id, Type): (16,ROOT)
  65. 2014-03-24 12:16:56,289 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ]) We need to allocate new storagepool for this volume
  66. 2014-03-24 12:16:56,289 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ]) Calling StoragePoolAllocators to find suitable pools
  67. 2014-03-24 12:16:56,290 DEBUG [storage.allocator.LocalStoragePoolAllocator] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ]) LocalStoragePoolAllocator trying to find storage pool to fit the vm
  68. 2014-03-24 12:16:56,291 DEBUG [storage.allocator.LocalStoragePoolAllocator] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ]) LocalStoragePoolAllocator returning 0 suitable storage pools
  69. 2014-03-24 12:16:56,291 DEBUG [storage.allocator.ClusterScopeStoragePoolAllocator] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ]) ClusterScopeStoragePoolAllocator looking for storage pool
  70. 2014-03-24 12:16:56,291 DEBUG [storage.allocator.ZoneWideStoragePoolAllocator] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ]) ZoneWideStoragePoolAllocator to find storage pool
  71. 2014-03-24 12:16:56,291 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ]) No suitable pools found for volume: Vol[16|vm=15|ROOT] under cluster: 1
  72. 2014-03-24 12:16:56,291 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ]) No suitable pools found
  73. 2014-03-24 12:16:56,292 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ]) No suitable storagePools found under this Cluster: 1
  74. 2014-03-24 12:16:56,293 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ]) Could not find suitable Deployment Destination for this VM under any clusters, returning.
  75. 2014-03-24 12:16:56,293 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ]) Searching resources only under specified Pod: 1
  76. 2014-03-24 12:16:56,293 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ]) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Pod: 1
  77. 2014-03-24 12:16:56,295 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ]) Removing from the clusterId list these clusters from avoid set: [1]
  78. 2014-03-24 12:16:56,295 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ]) No clusters found after removing disabled clusters and clusters in avoid list, returning.
  79. 2014-03-24 12:16:56,458 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ]) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
  80. 2014-03-24 12:16:56,543 ERROR [cloud.async.AsyncJobManagerImpl] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ]) Unexpected exception while executing org.apache.cloudstack.api.command.admin.router.StartRouterCmd
  81. com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[DomainRouter|r-15-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  82. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:841)
  83. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:577)
  84. at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.start(VirtualNetworkApplianceManagerImpl.java:2765)
  85. at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.startVirtualRouter(VirtualNetworkApplianceManagerImpl.java:1897)
  86. at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.startRouter(VirtualNetworkApplianceManagerImpl.java:3164)
  87. at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.startRouter(VirtualNetworkApplianceManagerImpl.java:3114)
  88. at com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
  89. at org.apache.cloudstack.api.command.admin.router.StartRouterCmd.execute(StartRouterCmd.java:110)
  90. at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:158)
  91. at com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:531)
  92. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  93. at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
  94. at java.util.concurrent.FutureTask.run(FutureTask.java:166)
  95. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
  96. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  97. at java.lang.Thread.run(Thread.java:701)
  98. 2014-03-24 12:16:56,544 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-3:job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ]) Complete async job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ], jobStatus: 2, resultCode: 530, result: Error Code: 530 Error text: Unable to create a deployment for VM[DomainRouter|r-15-VM]
  99. 2014-03-24 12:16:57,460 DEBUG [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Detected management node left, id:1, nodeIP:10.208.66.23
  100. 2014-03-24 12:16:57,460 INFO [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Trying to connect to 10.208.66.23
  101. 2014-03-24 12:16:57,460 INFO [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Management node 1 is detected inactive by timestamp but is pingable
  102. 2014-03-24 12:16:58,207 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-12:null) SeqA 2-109: Processing Seq 2-109: { Cmd , MgmtId: -1, via: 2, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":2,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
  103. 2014-03-24 12:16:58,319 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-12:null) SeqA 2-109: Sending Seq 2-109: { Ans: , MgmtId: 279278805451338, via: 2, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
  104. 2014-03-24 12:16:58,961 DEBUG [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Detected management node left, id:1, nodeIP:10.208.66.23
  105. 2014-03-24 12:16:58,961 INFO [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Trying to connect to 10.208.66.23
  106. 2014-03-24 12:16:58,961 INFO [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Management node 1 is detected inactive by timestamp but is pingable
  107. 2014-03-24 12:16:59,079 DEBUG [cloud.api.ApiServlet] (catalina-exec-17:null) ===START=== 10.208.66.72 -- GET command=queryAsyncJobResult&jobId=25b4e705-bb13-4932-a163-589f90789bd2&response=json&sessionkey=F2OERSvErCXMEdsZHiKAP%2Bz6%2Bbs%3D&_=1395643619156
  108. 2014-03-24 12:16:59,087 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-17:null) Async job-52 = [ 25b4e705-bb13-4932-a163-589f90789bd2 ] completed
  109. 2014-03-24 12:16:59,090 DEBUG [cloud.api.ApiServlet] (catalina-exec-17:null) ===END=== 10.208.66.72 -- GET command=queryAsyncJobResult&jobId=25b4e705-bb13-4932-a163-589f90789bd2&response=json&sessionkey=F2OERSvErCXMEdsZHiKAP%2Bz6%2Bbs%3D&_=1395643619156
  110. 2014-03-24 12:16:59,696 DEBUG [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Zone 1 is ready to launch secondary storage VM
  111. 2014-03-24 12:16:59,770 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl] (consoleproxy-1:null) Zone 1 is ready to launch console proxy
  112. 2014-03-24 12:17:00,411 DEBUG [network.router.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:null) Found 0 routers to update status.
  113. 2014-03-24 12:17:00,412 DEBUG [network.router.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:null) Found 0 networks to update RvR status.
  114. 2014-03-24 12:17:00,445 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (HostReservationReleaseChecker:null) Checking if any host reservation can be released ...
  115. 2014-03-24 12:17:00,446 DEBUG [cloud.alert.AlertManagerImpl] (CapacityChecker:null) Running Capacity Checker ...
  116. 2014-03-24 12:17:00,446 DEBUG [cloud.alert.AlertManagerImpl] (CapacityChecker:null) recalculating system capacity
  117. 2014-03-24 12:17:00,446 DEBUG [cloud.alert.AlertManagerImpl] (CapacityChecker:null) Executing cpu/ram capacity update
  118. 2014-03-24 12:17:00,453 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (HostReservationReleaseChecker:null) Cannot release reservation, Found 2 VMs Running on host 1
  119. 2014-03-24 12:17:00,453 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (HostReservationReleaseChecker:null) Done running HostReservationReleaseChecker ...
  120. 2014-03-24 12:17:00,456 DEBUG [cloud.capacity.CapacityManagerImpl] (CapacityChecker:null) Found 2 VMs on host 1
  121. 2014-03-24 12:17:00,462 DEBUG [cloud.capacity.CapacityManagerImpl] (CapacityChecker:null) Found 1 VM, not running on host 1
  122. 2014-03-24 12:17:00,466 DEBUG [cloud.capacity.CapacityManagerImpl] (CapacityChecker:null) Calibrate reserved cpu for host: 1 old reservedCpu:0 new reservedCpu:500
  123. 2014-03-24 12:17:00,466 DEBUG [cloud.capacity.CapacityManagerImpl] (CapacityChecker:null) Calibrate reserved memory for host: 1 old reservedMem:0 new reservedMem:536870912
  124. 2014-03-24 12:17:00,487 DEBUG [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Detected management node left, id:1, nodeIP:10.208.66.23
  125. 2014-03-24 12:17:00,487 INFO [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Trying to connect to 10.208.66.23
  126. 2014-03-24 12:17:00,487 INFO [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Management node 1 is detected inactive by timestamp but is pingable
  127. 2014-03-24 12:17:00,691 DEBUG [cloud.capacity.CapacityManagerImpl] (CapacityChecker:null) Found 0 VMs on host 4
  128. 2014-03-24 12:17:00,694 DEBUG [cloud.capacity.CapacityManagerImpl] (CapacityChecker:null) Found 0 VM, not running on host 4
  129. 2014-03-24 12:17:00,695 DEBUG [cloud.capacity.CapacityManagerImpl] (CapacityChecker:null) No need to calibrate cpu capacity, host:4 usedCpu: 0 reservedCpu: 0
  130. 2014-03-24 12:17:00,695 DEBUG [cloud.capacity.CapacityManagerImpl] (CapacityChecker:null) No need to calibrate memory capacity, host:4 usedMem: 0 reservedMem: 0
  131. 2014-03-24 12:17:00,788 DEBUG [cloud.alert.AlertManagerImpl] (CapacityChecker:null) Done executing cpu/ram capacity update
  132. 2014-03-24 12:17:00,788 DEBUG [cloud.alert.AlertManagerImpl] (CapacityChecker:null) Executing storage capacity update
  133. 2014-03-24 12:17:00,972 DEBUG [cloud.storage.StorageManagerImpl] (CapacityChecker:null) Successfully set Capacity - 299236327424 for capacity type - 3 , DataCenterId - 1, HostOrPoolId - 1, PodId 1
  134. 2014-03-24 12:17:00,972 DEBUG [cloud.alert.AlertManagerImpl] (CapacityChecker:null) Done executing storage capacity update
  135. 2014-03-24 12:17:00,972 DEBUG [cloud.alert.AlertManagerImpl] (CapacityChecker:null) Executing capacity updates for public ip and Vlans
  136. 2014-03-24 12:17:00,978 DEBUG [cloud.alert.AlertManagerImpl] (CapacityChecker:null) Done capacity updates for public ip and Vlans
  137. 2014-03-24 12:17:00,978 DEBUG [cloud.alert.AlertManagerImpl] (CapacityChecker:null) Executing capacity updates for private ip
  138. 2014-03-24 12:17:00,982 DEBUG [cloud.alert.AlertManagerImpl] (CapacityChecker:null) Done executing capacity updates for private ip
  139. 2014-03-24 12:17:00,982 DEBUG [cloud.alert.AlertManagerImpl] (CapacityChecker:null) Done recalculating system capacity
  140. 2014-03-24 12:17:01,002 DEBUG [cloud.alert.AlertManagerImpl] (CapacityChecker:null) Done running Capacity Checker ...
  141. 2014-03-24 12:17:01,951 DEBUG [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Detected management node left, id:1, nodeIP:10.208.66.23
  142. 2014-03-24 12:17:01,951 INFO [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Trying to connect to 10.208.66.23
  143. 2014-03-24 12:17:01,951 INFO [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Management node 1 is detected inactive by timestamp but is pingable
  144. 2014-03-24 12:17:03,005 DEBUG [cloud.api.ApiServlet] (catalina-exec-13:null) ===START=== 10.208.66.72 -- GET command=listVirtualMachines&response=json&sessionkey=F2OERSvErCXMEdsZHiKAP%2Bz6%2Bbs%3D&listAll=true&page=1&pagesize=20&_=1395643623073
  145. 2014-03-24 12:17:03,018 DEBUG [cloud.api.ApiServlet] (catalina-exec-13:null) ===END=== 10.208.66.72 -- GET command=listVirtualMachines&response=json&sessionkey=F2OERSvErCXMEdsZHiKAP%2Bz6%2Bbs%3D&listAll=true&page=1&pagesize=20&_=1395643623073
  146. 2014-03-24 12:17:03,459 DEBUG [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Detected management node left, id:1, nodeIP:10.208.66.23
  147. 2014-03-24 12:17:03,460 INFO [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Trying to connect to 10.208.66.23
  148. 2014-03-24 12:17:03,460 INFO [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Management node 1 is detected inactive by timestamp but is pingable
  149. 2014-03-24 12:17:04,494 DEBUG [cloud.api.ApiServlet] (catalina-exec-20:null) ===START=== 10.208.66.72 -- GET command=listZones&id=0de30641-c510-4076-859e-823e1576bf2c&response=json&sessionkey=F2OERSvErCXMEdsZHiKAP%2Bz6%2Bbs%3D&_=1395643624565
  150. 2014-03-24 12:17:04,500 DEBUG [cloud.api.ApiServlet] (catalina-exec-20:null) ===END=== 10.208.66.72 -- GET command=listZones&id=0de30641-c510-4076-859e-823e1576bf2c&response=json&sessionkey=F2OERSvErCXMEdsZHiKAP%2Bz6%2Bbs%3D&_=1395643624565
  151. 2014-03-24 12:17:04,504 DEBUG [cloud.api.ApiServlet] (catalina-exec-19:null) ===START=== 10.208.66.72 -- GET command=listNetworks&id=bbd9dc2c-f5bb-4a3b-b5bf-2bc52ba3547a&response=json&sessionkey=F2OERSvErCXMEdsZHiKAP%2Bz6%2Bbs%3D&_=1395643624583
  152. 2014-03-24 12:17:04,523 DEBUG [cloud.api.ApiServlet] (catalina-exec-19:null) ===END=== 10.208.66.72 -- GET command=listNetworks&id=bbd9dc2c-f5bb-4a3b-b5bf-2bc52ba3547a&response=json&sessionkey=F2OERSvErCXMEdsZHiKAP%2Bz6%2Bbs%3D&_=1395643624583
  153. 2014-03-24 12:17:04,547 DEBUG [cloud.api.ApiServlet] (catalina-exec-2:null) ===START=== 10.208.66.72 -- GET command=listVirtualMachines&id=672e0884-2f7c-4523-917f-06a85ab7b652&response=json&sessionkey=F2OERSvErCXMEdsZHiKAP%2Bz6%2Bbs%3D&_=1395643624618
  154. 2014-03-24 12:17:04,560 DEBUG [cloud.api.ApiServlet] (catalina-exec-2:null) ===END=== 10.208.66.72 -- GET command=listVirtualMachines&id=672e0884-2f7c-4523-917f-06a85ab7b652&response=json&sessionkey=F2OERSvErCXMEdsZHiKAP%2Bz6%2Bbs%3D&_=1395643624618
  155. 2014-03-24 12:17:04,617 DEBUG [cloud.api.ApiServlet] (catalina-exec-25:null) ===START=== 10.208.66.72 -- GET command=listOsTypes&response=json&sessionkey=F2OERSvErCXMEdsZHiKAP%2Bz6%2Bbs%3D&_=1395643624652
  156. 2014-03-24 12:17:04,628 DEBUG [cloud.api.ApiServlet] (catalina-exec-24:null) ===START=== 10.208.66.72 -- GET command=listTags&response=json&sessionkey=F2OERSvErCXMEdsZHiKAP%2Bz6%2Bbs%3D&resourceId=672e0884-2f7c-4523-917f-06a85ab7b652&resourceType=UserVm&listAll=true&_=1395643624672
  157. 2014-03-24 12:17:04,634 DEBUG [cloud.api.ApiServlet] (catalina-exec-24:null) ===END=== 10.208.66.72 -- GET command=listTags&response=json&sessionkey=F2OERSvErCXMEdsZHiKAP%2Bz6%2Bbs%3D&resourceId=672e0884-2f7c-4523-917f-06a85ab7b652&resourceType=UserVm&listAll=true&_=1395643624672
  158. 2014-03-24 12:17:04,754 DEBUG [cloud.api.ApiServlet] (catalina-exec-25:null) ===END=== 10.208.66.72 -- GET command=listOsTypes&response=json&sessionkey=F2OERSvErCXMEdsZHiKAP%2Bz6%2Bbs%3D&_=1395643624652
  159. 2014-03-24 12:17:04,960 DEBUG [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Detected management node left, id:1, nodeIP:10.208.66.23
  160. 2014-03-24 12:17:04,960 INFO [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Trying to connect to 10.208.66.23
  161. 2014-03-24 12:17:04,960 INFO [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Management node 1 is detected inactive by timestamp but is pingable
  162. 2014-03-24 12:17:06,452 DEBUG [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Detected management node left, id:1, nodeIP:10.208.66.23
  163. 2014-03-24 12:17:06,452 INFO [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Trying to connect to 10.208.66.23
  164. 2014-03-24 12:17:06,452 INFO [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Management node 1 is detected inactive by timestamp but is pingable
  165. 2014-03-24 12:17:07,015 DEBUG [cloud.api.ApiServlet] (catalina-exec-22:null) ===START=== 10.208.66.72 -- GET command=startVirtualMachine&id=672e0884-2f7c-4523-917f-06a85ab7b652&response=json&sessionkey=F2OERSvErCXMEdsZHiKAP%2Bz6%2Bbs%3D&_=1395643627080
  166. 2014-03-24 12:17:07,227 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-22:null) submit async job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ], details: AsyncJobVO {id:53, userId: 2, accountId: 2, sessionKey: null, instanceType: VirtualMachine, instanceId: 12, cmd: org.apache.cloudstack.api.command.user.vm.StartVMCmd, cmdOriginator: null, cmdInfo: {"id":"672e0884-2f7c-4523-917f-06a85ab7b652","response":"json","sessionkey":"F2OERSvErCXMEdsZHiKAP+z6+bs\u003d","cmdEventType":"VM.START","ctxUserId":"2","httpmethod":"GET","_":"1395643627080","ctxAccountId":"2","ctxStartEventId":"428"}, cmdVersion: 0, callbackType: 0, callbackAddress: null, status: 0, processStatus: 0, resultCode: 0, result: null, initMsid: 279278805451338, completeMsid: null, lastUpdated: null, lastPolled: null, created: null}
  167. 2014-03-24 12:17:07,228 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Executing org.apache.cloudstack.api.command.user.vm.StartVMCmd for job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]
  168. 2014-03-24 12:17:07,229 DEBUG [cloud.api.ApiServlet] (catalina-exec-22:null) ===END=== 10.208.66.72 -- GET command=startVirtualMachine&id=672e0884-2f7c-4523-917f-06a85ab7b652&response=json&sessionkey=F2OERSvErCXMEdsZHiKAP%2Bz6%2Bbs%3D&_=1395643627080
  169. 2014-03-24 12:17:07,350 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Deploy avoids pods: [], clusters: [], hosts: []
  170. 2014-03-24 12:17:07,352 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner_EnhancerByCloudStack_21958b2b@70ae18dd
  171. 2014-03-24 12:17:07,352 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Trying to allocate a host and storage pools from dc:1, pod:1,cluster:1, requested cpu: 500, requested ram: 536870912
  172. 2014-03-24 12:17:07,352 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Is ROOT volume READY (pool already allocated)?: Yes
  173. 2014-03-24 12:17:07,352 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) This VM has last host_id specified, trying to choose the same host: 1
  174. 2014-03-24 12:17:07,356 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 536870912 , cpuOverprovisioningFactor: 1.0
  175. 2014-03-24 12:17:07,358 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Hosts's actual total CPU: 11968 and CPU after applying overprovisioning: 11968
  176. 2014-03-24 12:17:07,358 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) We need to allocate to the last host again, so checking if there is enough reserved capacity
  177. 2014-03-24 12:17:07,358 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Reserved CPU: 500 , Requested CPU: 500
  178. 2014-03-24 12:17:07,358 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Reserved RAM: 536870912 , Requested RAM: 536870912
  179. 2014-03-24 12:17:07,358 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Host has enough CPU and RAM available
  180. 2014-03-24 12:17:07,358 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) STATS: Can alloc CPU from host: 1, used: 1000, reserved: 500, actual total: 11968, total with overprovisioning: 11968; requested cpu:500,alloc_from_last_host?:true ,considerReservedCapacity?: true
  181. 2014-03-24 12:17:07,358 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) STATS: Can alloc MEM from host: 1, used: 1342177280, reserved: 536870912, total: 8202285056; requested mem: 536870912,alloc_from_last_host?:true ,considerReservedCapacity?: true
  182. 2014-03-24 12:17:07,358 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) The last host of this VM is UP and has enough capacity
  183. 2014-03-24 12:17:07,358 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Now checking for suitable pools under zone: 1, pod: 1, cluster: 1
  184. 2014-03-24 12:17:07,359 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Checking suitable pools for volume (Id, Type): (13,ROOT)
  185. 2014-03-24 12:17:07,359 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Volume has pool already allocated, checking if pool can be reused, poolId: 1
  186. 2014-03-24 12:17:07,360 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Planner need not allocate a pool for this volume since its READY
  187. 2014-03-24 12:17:07,360 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Trying to find a potenial host and associated storage pools from the suitable host/pool lists for this VM
  188. 2014-03-24 12:17:07,360 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Checking if host: 1 can access any suitable storage pool for volume: ROOT
  189. 2014-03-24 12:17:07,361 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Host: 1 can access pool: 1
  190. 2014-03-24 12:17:07,362 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Found a potential host id: 1 name: server2 and associated storage pools for this VM
  191. 2014-03-24 12:17:07,362 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Returning Deployment Destination: Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(1)-Storage()]
  192. 2014-03-24 12:17:07,451 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: 1 new host id: null host id before state transition: null
  193. 2014-03-24 12:17:07,451 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Successfully transitioned to start state for VM[User|ubuntu-mysql] reservation id = 91080adb-83e9-4637-8d04-5eea87861f2b
  194. 2014-03-24 12:17:07,536 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Trying to deploy VM, vm has dcId: 1 and podId: 1
  195. 2014-03-24 12:17:07,536 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) advanceStart: DeploymentPlan is provided, using dcId:1, podId: 1, clusterId: 1, hostId: 1, poolId: null
  196. 2014-03-24 12:17:07,536 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Deploy avoids pods: null, clusters: null, hosts: null
  197. 2014-03-24 12:17:07,538 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Root volume is ready, need to place VM in volume's cluster
  198. 2014-03-24 12:17:07,543 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Deploy avoids pods: [], clusters: [], hosts: []
  199. 2014-03-24 12:17:07,543 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner_EnhancerByCloudStack_21958b2b@70ae18dd
  200. 2014-03-24 12:17:07,543 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Trying to allocate a host and storage pools from dc:1, pod:1,cluster:1, requested cpu: 500, requested ram: 536870912
  201. 2014-03-24 12:17:07,543 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Is ROOT volume READY (pool already allocated)?: Yes
  202. 2014-03-24 12:17:07,543 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) DeploymentPlan has host_id specified, choosing this host and making no checks on this host: 1
  203. 2014-03-24 12:17:07,544 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Looking for suitable pools for this host under zone: 1, pod: 1, cluster: 1
  204. 2014-03-24 12:17:07,545 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Checking suitable pools for volume (Id, Type): (13,ROOT)
  205. 2014-03-24 12:17:07,545 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Volume has pool already allocated, checking if pool can be reused, poolId: 1
  206. 2014-03-24 12:17:07,546 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Planner need not allocate a pool for this volume since its READY
  207. 2014-03-24 12:17:07,546 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Trying to find a potenial host and associated storage pools from the suitable host/pool lists for this VM
  208. 2014-03-24 12:17:07,546 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Checking if host: 1 can access any suitable storage pool for volume: ROOT
  209. 2014-03-24 12:17:07,547 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Host: 1 can access pool: 1
  210. 2014-03-24 12:17:07,548 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Found a potential host id: 1 name: server2 and associated storage pools for this VM
  211. 2014-03-24 12:17:07,548 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Returning Deployment Destination: Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(1)-Storage()]
  212. 2014-03-24 12:17:07,549 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Deployment found - P0=VM[User|ubuntu-mysql], P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(1)-Storage()]
  213. 2014-03-24 12:17:07,678 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) VM state transitted from :Starting to Starting with event: OperationRetryvm's original host id: 1 new host id: 1 host id before state transition: null
  214. 2014-03-24 12:17:07,680 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) VM starting again on the last host it was stopped on
  215. 2014-03-24 12:17:07,685 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Hosts's actual total CPU: 11968 and CPU after applying overprovisioning: 11968
  216. 2014-03-24 12:17:07,685 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) We are allocating VM, increasing the used capacity of this host:1
  217. 2014-03-24 12:17:07,685 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Current Used CPU: 1000 , Free CPU:10468 ,Requested CPU: 500
  218. 2014-03-24 12:17:07,685 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Current Used RAM: 1342177280 , Free RAM:6323236864 ,Requested RAM: 536870912
  219. 2014-03-24 12:17:07,685 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) We are allocating VM to the last host again, so adjusting the reserved capacity if it is not less than required
  220. 2014-03-24 12:17:07,685 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Reserved CPU: 500 , Requested CPU: 500
  221. 2014-03-24 12:17:07,685 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Reserved RAM: 536870912 , Requested RAM: 536870912
  222. 2014-03-24 12:17:07,685 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) CPU STATS after allocation: for host: 1, old used: 1000, old reserved: 500, actual total: 11968, total with overprovisioning: 11968; new used:1500, reserved:0; requested cpu:500,alloc_from_last:true
  223. 2014-03-24 12:17:07,685 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) RAM STATS after allocation: for host: 1, old used: 1342177280, old reserved: 536870912, total: 8202285056; new used: 1879048192, reserved: 0; requested mem: 536870912,alloc_from_last:true
  224. 2014-03-24 12:17:07,770 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) VM is being created in podId: 1
  225. 2014-03-24 12:17:07,775 DEBUG [cloud.network.NetworkManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Network id=204 is already implemented
  226. 2014-03-24 12:17:07,870 DEBUG [cloud.network.NetworkManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Changing active number of nics for network id=204 on 1
  227. 2014-03-24 12:17:07,990 DEBUG [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Detected management node left, id:1, nodeIP:10.208.66.23
  228. 2014-03-24 12:17:07,990 INFO [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Trying to connect to 10.208.66.23
  229. 2014-03-24 12:17:07,990 INFO [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Management node 1 is detected inactive by timestamp but is pingable
  230. 2014-03-24 12:17:08,033 DEBUG [cloud.network.NetworkManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Asking VirtualRouter to prepare for Nic[20-12-91080adb-83e9-4637-8d04-5eea87861f2b-10.208.67.223]
  231. 2014-03-24 12:17:08,040 DEBUG [network.router.VirtualNetworkApplianceManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Lock is acquired for network id 204 as a part of router startup in Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(1)-Storage()]
  232. 2014-03-24 12:17:08,042 DEBUG [network.router.VirtualNetworkApplianceManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Lock is released for network id 204 as a part of router startup in Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(1)-Storage()]
  233. 2014-03-24 12:17:08,042 DEBUG [network.router.VirtualNetworkApplianceManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Starting router VM[DomainRouter|r-15-VM]
  234. 2014-03-24 12:17:08,045 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
  235. 2014-03-24 12:17:08,045 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Successfully transitioned to start state for VM[DomainRouter|r-15-VM] reservation id = 2f6541da-5b66-4f60-9ff0-037eb6e2ab38
  236. 2014-03-24 12:17:08,140 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Trying to deploy VM, vm has dcId: 1 and podId: 1
  237. 2014-03-24 12:17:08,140 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Deploy avoids pods: null, clusters: null, hosts: null
  238. 2014-03-24 12:17:08,141 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Deploy avoids pods: null, clusters: null, hosts: null
  239. 2014-03-24 12:17:08,142 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner_EnhancerByCloudStack_21958b2b@70ae18dd
  240. 2014-03-24 12:17:08,142 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Trying to allocate a host and storage pools from dc:1, pod:1,cluster:null, requested cpu: 500, requested ram: 134217728
  241. 2014-03-24 12:17:08,142 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Is ROOT volume READY (pool already allocated)?: No
  242. 2014-03-24 12:17:08,142 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Searching resources only under specified Pod: 1
  243. 2014-03-24 12:17:08,142 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Pod: 1
  244. 2014-03-24 12:17:08,147 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Checking resources in Cluster: 1 under Pod: 1
  245. 2014-03-24 12:17:08,147 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ] FirstFitRoutingAllocator) Looking for hosts in dc: 1 pod:1 cluster:1
  246. 2014-03-24 12:17:08,150 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ] FirstFitRoutingAllocator) FirstFitAllocator has 2 hosts to check for allocation: [Host[-1-Routing], Host[-4-Routing]]
  247. 2014-03-24 12:17:08,152 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ] FirstFitRoutingAllocator) Found 2 hosts for allocation after prioritization: [Host[-1-Routing], Host[-4-Routing]]
  248. 2014-03-24 12:17:08,152 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ] FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=128
  249. 2014-03-24 12:17:08,156 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ] FirstFitRoutingAllocator) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 134217728 , cpuOverprovisioningFactor: 1.0
  250. 2014-03-24 12:17:08,158 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ] FirstFitRoutingAllocator) Hosts's actual total CPU: 11968 and CPU after applying overprovisioning: 11968
  251. 2014-03-24 12:17:08,158 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ] FirstFitRoutingAllocator) Free CPU: 10468 , Requested CPU: 500
  252. 2014-03-24 12:17:08,158 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ] FirstFitRoutingAllocator) Free RAM: 6323236864 , Requested RAM: 134217728
  253. 2014-03-24 12:17:08,158 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ] FirstFitRoutingAllocator) Host has enough CPU and RAM available
  254. 2014-03-24 12:17:08,158 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ] FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 1, used: 1500, reserved: 0, actual total: 11968, total with overprovisioning: 11968; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  255. 2014-03-24 12:17:08,158 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ] FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 1, used: 1879048192, reserved: 0, total: 8202285056; requested mem: 134217728,alloc_from_last_host?:false ,considerReservedCapacity?: true
  256. 2014-03-24 12:17:08,158 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ] FirstFitRoutingAllocator) Found a suitable host, adding to list: 1
  257. 2014-03-24 12:17:08,162 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ] FirstFitRoutingAllocator) Checking if host: 4 has enough capacity for requested CPU: 500 and requested RAM: 134217728 , cpuOverprovisioningFactor: 1.0
  258. 2014-03-24 12:17:08,163 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ] FirstFitRoutingAllocator) Hosts's actual total CPU: 12000 and CPU after applying overprovisioning: 12000
  259. 2014-03-24 12:17:08,163 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ] FirstFitRoutingAllocator) Free CPU: 12000 , Requested CPU: 500
  260. 2014-03-24 12:17:08,164 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ] FirstFitRoutingAllocator) Free RAM: 8202280960 , Requested RAM: 134217728
  261. 2014-03-24 12:17:08,164 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ] FirstFitRoutingAllocator) Host has enough CPU and RAM available
  262. 2014-03-24 12:17:08,164 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ] FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 4, used: 0, reserved: 0, actual total: 12000, total with overprovisioning: 12000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  263. 2014-03-24 12:17:08,164 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ] FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 4, used: 0, reserved: 0, total: 8202280960; requested mem: 134217728,alloc_from_last_host?:false ,considerReservedCapacity?: true
  264. 2014-03-24 12:17:08,164 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ] FirstFitRoutingAllocator) Found a suitable host, adding to list: 4
  265. 2014-03-24 12:17:08,164 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ] FirstFitRoutingAllocator) Host Allocator returning 2 suitable hosts
  266. 2014-03-24 12:17:08,165 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Checking suitable pools for volume (Id, Type): (16,ROOT)
  267. 2014-03-24 12:17:08,165 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) We need to allocate new storagepool for this volume
  268. 2014-03-24 12:17:08,165 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Calling StoragePoolAllocators to find suitable pools
  269. 2014-03-24 12:17:08,165 DEBUG [storage.allocator.LocalStoragePoolAllocator] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) LocalStoragePoolAllocator trying to find storage pool to fit the vm
  270. 2014-03-24 12:17:08,166 DEBUG [storage.allocator.LocalStoragePoolAllocator] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) LocalStoragePoolAllocator returning 0 suitable storage pools
  271. 2014-03-24 12:17:08,167 DEBUG [storage.allocator.ClusterScopeStoragePoolAllocator] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) ClusterScopeStoragePoolAllocator looking for storage pool
  272. 2014-03-24 12:17:08,167 DEBUG [storage.allocator.ZoneWideStoragePoolAllocator] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) ZoneWideStoragePoolAllocator to find storage pool
  273. 2014-03-24 12:17:08,167 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) No suitable pools found for volume: Vol[16|vm=15|ROOT] under cluster: 1
  274. 2014-03-24 12:17:08,167 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) No suitable pools found
  275. 2014-03-24 12:17:08,167 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) No suitable storagePools found under this Cluster: 1
  276. 2014-03-24 12:17:08,168 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Could not find suitable Deployment Destination for this VM under any clusters, returning.
  277. 2014-03-24 12:17:08,168 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Searching resources only under specified Pod: 1
  278. 2014-03-24 12:17:08,168 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Pod: 1
  279. 2014-03-24 12:17:08,170 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Removing from the clusterId list these clusters from avoid set: [1]
  280. 2014-03-24 12:17:08,170 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) No clusters found after removing disabled clusters and clusters in avoid list, returning.
  281. 2014-03-24 12:17:08,206 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-13:null) SeqA 2-110: Processing Seq 2-110: { Cmd , MgmtId: -1, via: 2, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":2,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
  282. 2014-03-24 12:17:08,341 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-13:null) SeqA 2-110: Sending Seq 2-110: { Ans: , MgmtId: 279278805451338, via: 2, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
  283. 2014-03-24 12:17:08,424 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
  284. 2014-03-24 12:17:08,426 INFO [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Insufficient capacity
  285. com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[DomainRouter|r-15-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  286. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:841)
  287. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:577)
  288. at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.start(VirtualNetworkApplianceManagerImpl.java:2765)
  289. at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.startVirtualRouter(VirtualNetworkApplianceManagerImpl.java:1897)
  290. at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.startRouters(VirtualNetworkApplianceManagerImpl.java:1997)
  291. at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.deployVirtualRouterInGuestNetwork(VirtualNetworkApplianceManagerImpl.java:1975)
  292. at com.cloud.network.element.VirtualRouterElement.prepare(VirtualRouterElement.java:222)
  293. at com.cloud.network.NetworkManagerImpl.prepareElement(NetworkManagerImpl.java:2066)
  294. at com.cloud.network.NetworkManagerImpl.prepareNic(NetworkManagerImpl.java:2200)
  295. at com.cloud.network.NetworkManagerImpl.prepare(NetworkManagerImpl.java:2136)
  296. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:886)
  297. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:577)
  298. at org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:227)
  299. at org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:209)
  300. at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3440)
  301. at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:1959)
  302. at com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
  303. at org.apache.cloudstack.api.command.user.vm.StartVMCmd.execute(StartVMCmd.java:120)
  304. at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:158)
  305. at com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:531)
  306. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  307. at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
  308. at java.util.concurrent.FutureTask.run(FutureTask.java:166)
  309. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
  310. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  311. at java.lang.Thread.run(Thread.java:701)
  312. 2014-03-24 12:17:08,516 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Cleaning up resources for the vm VM[User|ubuntu-mysql] in Starting state
  313. 2014-03-24 12:17:08,518 DEBUG [agent.transport.Request] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Seq 1-1197735953: Sending { Cmd , MgmtId: 279278805451338, via: 1, Ver: v1, Flags: 100111, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":true,"vmName":"i-2-12-VM","wait":0}}] }
  314. 2014-03-24 12:17:08,626 DEBUG [agent.transport.Request] (AgentManager-Handler-14:null) Seq 1-1197735953: Processing: { Ans: , MgmtId: 279278805451338, via: 1, Ver: v1, Flags: 110, [{"com.cloud.agent.api.StopAnswer":{"result":true,"wait":0}}] }
  315. 2014-03-24 12:17:08,626 DEBUG [agent.manager.AgentAttache] (AgentManager-Handler-14:null) Seq 1-1197735953: No more commands found
  316. 2014-03-24 12:17:08,626 DEBUG [agent.transport.Request] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Seq 1-1197735953: Received: { Ans: , MgmtId: 279278805451338, via: 1, Ver: v1, Flags: 110, { StopAnswer } }
  317. 2014-03-24 12:17:08,635 DEBUG [cloud.network.NetworkManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Changing active number of nics for network id=204 on -1
  318. 2014-03-24 12:17:08,728 DEBUG [cloud.network.NetworkManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Asking VirtualRouter to release Nic[20-12-91080adb-83e9-4637-8d04-5eea87861f2b-10.208.67.223]
  319. 2014-03-24 12:17:08,729 DEBUG [cloud.network.NetworkManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Asking SecurityGroupProvider to release Nic[20-12-91080adb-83e9-4637-8d04-5eea87861f2b-10.208.67.223]
  320. 2014-03-24 12:17:08,729 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Successfully released network resources for the vm VM[User|ubuntu-mysql]
  321. 2014-03-24 12:17:08,729 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Successfully cleanued up resources for the vm VM[User|ubuntu-mysql] in Starting state
  322. 2014-03-24 12:17:08,731 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Root volume is ready, need to place VM in volume's cluster
  323. 2014-03-24 12:17:08,736 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Deploy avoids pods: [], clusters: [], hosts: [1]
  324. 2014-03-24 12:17:08,736 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) DataCenter id = '1' provided is in avoid set, DeploymentPlanner cannot allocate the VM, returning.
  325. 2014-03-24 12:17:08,901 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: 1 new host id: null host id before state transition: 1
  326. 2014-03-24 12:17:08,906 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Hosts's actual total CPU: 11968 and CPU after applying overprovisioning: 11968
  327. 2014-03-24 12:17:08,906 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Hosts's actual total RAM: 8202285056 and RAM after applying overprovisioning: 8202285056
  328. 2014-03-24 12:17:08,906 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) release cpu from host: 1, old used: 1500,reserved: 0, actual total: 11968, total with overprovisioning: 11968; new used: 1000,reserved:0; movedfromreserved: false,moveToReserveredfalse
  329. 2014-03-24 12:17:08,906 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) release mem from host: 1, old used: 1879048192,reserved: 0, total: 8202285056; new used: 1342177280,reserved:0; movedfromreserved: false,moveToReserveredfalse
  330. 2014-03-24 12:17:09,181 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: 1 new host id: null host id before state transition: null
  331. 2014-03-24 12:17:09,181 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Successfully transitioned to start state for VM[User|ubuntu-mysql] reservation id = 8ece6013-080e-4db0-8abc-3f0a77193bc6
  332. 2014-03-24 12:17:09,269 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Trying to deploy VM, vm has dcId: 1 and podId: 1
  333. 2014-03-24 12:17:09,269 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Deploy avoids pods: [], clusters: [], hosts: [1]
  334. 2014-03-24 12:17:09,271 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Root volume is ready, need to place VM in volume's cluster
  335. 2014-03-24 12:17:09,271 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Vol[13|vm=12|ROOT] is READY, changing deployment plan to use this pool's dcId: 1 , podId: 1 , and clusterId: 1
  336. 2014-03-24 12:17:09,276 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Deploy avoids pods: [], clusters: [], hosts: [1]
  337. 2014-03-24 12:17:09,276 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) DataCenter id = '1' provided is in avoid set, DeploymentPlanner cannot allocate the VM, returning.
  338. 2014-03-24 12:17:09,280 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Deploy avoids pods: [], clusters: [], hosts: [1]
  339. 2014-03-24 12:17:09,280 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) DataCenter id = '1' provided is in avoid set, DeploymentPlanner cannot allocate the VM, returning.
  340. 2014-03-24 12:17:09,487 DEBUG [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Detected management node left, id:1, nodeIP:10.208.66.23
  341. 2014-03-24 12:17:09,487 INFO [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Trying to connect to 10.208.66.23
  342. 2014-03-24 12:17:09,488 INFO [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Management node 1 is detected inactive by timestamp but is pingable
  343. 2014-03-24 12:17:09,528 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: 1 new host id: null host id before state transition: null
  344. 2014-03-24 12:17:09,705 INFO [user.vm.StartVMCmd] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[User|ubuntu-mysql]Scope=interface com.cloud.dc.DataCenter; id=1
  345. 2014-03-24 12:17:09,705 INFO [user.vm.StartVMCmd] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Unable to create a deployment for VM[User|ubuntu-mysql]
  346. com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[User|ubuntu-mysql]Scope=interface com.cloud.dc.DataCenter; id=1
  347. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:841)
  348. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:577)
  349. at org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:237)
  350. at org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:209)
  351. at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3440)
  352. at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:1959)
  353. at com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
  354. at org.apache.cloudstack.api.command.user.vm.StartVMCmd.execute(StartVMCmd.java:120)
  355. at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:158)
  356. at com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:531)
  357. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  358. at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
  359. at java.util.concurrent.FutureTask.run(FutureTask.java:166)
  360. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
  361. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  362. at java.lang.Thread.run(Thread.java:701)
  363. 2014-03-24 12:17:09,706 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-4:job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ]) Complete async job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ], jobStatus: 2, resultCode: 530, result: Error Code: 533 Error text: Unable to create a deployment for VM[User|ubuntu-mysql]
  364. 2014-03-24 12:17:10,234 DEBUG [cloud.api.ApiServlet] (catalina-exec-21:null) ===START=== 10.208.66.72 -- GET command=queryAsyncJobResult&jobId=913f83d0-b9b6-4b57-9b0d-a97692f62dcb&response=json&sessionkey=F2OERSvErCXMEdsZHiKAP%2Bz6%2Bbs%3D&_=1395643630313
  365. 2014-03-24 12:17:10,242 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-21:null) Async job-53 = [ 913f83d0-b9b6-4b57-9b0d-a97692f62dcb ] completed
  366. 2014-03-24 12:17:10,246 DEBUG [cloud.api.ApiServlet] (catalina-exec-21:null) ===END=== 10.208.66.72 -- GET command=queryAsyncJobResult&jobId=913f83d0-b9b6-4b57-9b0d-a97692f62dcb&response=json&sessionkey=F2OERSvErCXMEdsZHiKAP%2Bz6%2Bbs%3D&_=1395643630313
  367. 2014-03-24 12:17:10,955 DEBUG [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Detected management node left, id:1, nodeIP:10.208.66.23
  368. 2014-03-24 12:17:10,955 INFO [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Trying to connect to 10.208.66.23
  369. 2014-03-24 12:17:10,956 INFO [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Management node 1 is detected inactive by timestamp but is pingable
  370. 2014-03-24 12:17:12,441 DEBUG [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Detected management node left, id:1, nodeIP:10.208.66.23
  371. 2014-03-24 12:17:12,441 INFO [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Trying to connect to 10.208.66.23
  372. 2014-03-24 12:17:12,443 INFO [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Management node 1 is detected inactive by timestamp but is pingable
  373. 2014-03-24 12:17:13,207 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-15:null) SeqA 2-111: Processing Seq 2-111: { Cmd , MgmtId: -1, via: 2, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":2,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
  374. 2014-03-24 12:17:13,291 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-15:null) SeqA 2-111: Sending Seq 2-111: { Ans: , MgmtId: 279278805451338, via: 2, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
  375. 2014-03-24 12:17:13,942 DEBUG [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Detected management node left, id:1, nodeIP:10.208.66.23
  376. 2014-03-24 12:17:13,942 INFO [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Trying to connect to 10.208.66.23
  377. 2014-03-24 12:17:13,942 INFO [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Management node 1 is detected inactive by timestamp but is pingable
  378. 2014-03-24 12:17:15,442 DEBUG [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Detected management node left, id:1, nodeIP:10.208.66.23
  379. 2014-03-24 12:17:15,442 INFO [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Trying to connect to 10.208.66.23
  380. 2014-03-24 12:17:15,442 INFO [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Management node 1 is detected inactive by timestamp but is pingable
  381. 2014-03-24 12:17:16,942 DEBUG [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Detected management node left, id:1, nodeIP:10.208.66.23
  382. 2014-03-24 12:17:16,942 INFO [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Trying to connect to 10.208.66.23
  383. 2014-03-24 12:17:16,943 INFO [cloud.cluster.ClusterManagerImpl] (Cluster-Heartbeat-1:null) Management node 1 is detected inactive by timestamp but is pingable
Advertisement
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!