dicksonlam

Create Secondary Storage Problem

Dec 1st, 2017
258
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 488.25 KB | None | 0 0
  1. 2017-12-01 00:00:00,238 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) Zone 1 is ready to launch console proxy
  2. 2017-12-01 00:00:00,239 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) Expand console proxy standby capacity for zone Zone-Orion
  3. 2017-12-01 00:00:00,240 INFO [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) No stopped console proxy is available, need to allocate a new console proxy
  4. 2017-12-01 00:00:00,241 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) Assign console proxy from a newly started instance for request from data center : 1
  5. 2017-12-01 00:00:00,249 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) Found existing network configuration for offering [Network Offering [1-Public-System-Public-Network]: Ntwk[200|Public|1]
  6. 2017-12-01 00:00:00,249 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
  7. 2017-12-01 00:00:00,255 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) Found existing network configuration for offering [Network Offering [3-Control-System-Control-Network]: Ntwk[202|Control|3]
  8. 2017-12-01 00:00:00,255 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
  9. 2017-12-01 00:00:00,260 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) Found existing network configuration for offering [Network Offering [2-Management-System-Management-Network]: Ntwk[201|Management|2]
  10. 2017-12-01 00:00:00,260 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
  11. 2017-12-01 00:00:00,270 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) Allocating entries for VM: VM[ConsoleProxy|v-24521-VM]
  12. 2017-12-01 00:00:00,271 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) Allocating nics for VM[ConsoleProxy|v-24521-VM]
  13. 2017-12-01 00:00:00,272 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) Allocating nic for vm VM[ConsoleProxy|v-24521-VM] in network Ntwk[200|Public|1] with requested profile NicProfile[0-0-null-null-null
  14. 2017-12-01 00:00:00,283 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) Allocating nic for vm VM[ConsoleProxy|v-24521-VM] in network Ntwk[202|Control|3] with requested profile null
  15. 2017-12-01 00:00:00,290 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) Allocating nic for vm VM[ConsoleProxy|v-24521-VM] in network Ntwk[201|Management|2] with requested profile null
  16. 2017-12-01 00:00:00,294 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) Allocating disks for VM[ConsoleProxy|v-24521-VM]
  17. 2017-12-01 00:00:00,297 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) Allocation completed for VM: VM[ConsoleProxy|v-24521-VM]
  18. 2017-12-01 00:00:00,300 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) received console proxy alert
  19. 2017-12-01 00:00:00,300 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) New console proxy created, zone: Zone-Orion, proxy: v-24521-VM, public IP: null, private IP: null
  20. 2017-12-01 00:00:00,308 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) Sync job-73580 execution on object VmWorkJobQueue.24521
  21. 2017-12-01 00:00:00,356 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) Zone 1 is ready to launch secondary storage VM
  22. 2017-12-01 00:00:00,360 INFO [o.a.c.s.PremiumSecondaryStorageManagerImpl] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) No running secondary storage vms found in datacenter id=1, starting one
  23. 2017-12-01 00:00:00,363 INFO [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) No stopped secondary storage vm is available, need to allocate a new secondary storage vm
  24. 2017-12-01 00:00:00,364 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) Assign secondary storage vm from a newly started instance for request from data center : 1
  25. 2017-12-01 00:00:00,371 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) Found existing network configuration for offering [Network Offering [1-Public-System-Public-Network]: Ntwk[200|Public|1]
  26. 2017-12-01 00:00:00,371 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
  27. 2017-12-01 00:00:00,375 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) Found existing network configuration for offering [Network Offering [3-Control-System-Control-Network]: Ntwk[202|Control|3]
  28. 2017-12-01 00:00:00,375 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
  29. 2017-12-01 00:00:00,380 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) Found existing network configuration for offering [Network Offering [2-Management-System-Management-Network]: Ntwk[201|Management|2]
  30. 2017-12-01 00:00:00,380 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
  31. 2017-12-01 00:00:00,385 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) Found existing network configuration for offering [Network Offering [4-Storage-System-Storage-Network]: Ntwk[203|Storage|4]
  32. 2017-12-01 00:00:00,385 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
  33. 2017-12-01 00:00:00,395 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) Allocating entries for VM: VM[SecondaryStorageVm|s-24522-VM]
  34. 2017-12-01 00:00:00,396 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) Allocating nics for VM[SecondaryStorageVm|s-24522-VM]
  35. 2017-12-01 00:00:00,397 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) Allocating nic for vm VM[SecondaryStorageVm|s-24522-VM] in network Ntwk[200|Public|1] with requested profile NicProfile[0-0-null-null-null
  36. 2017-12-01 00:00:00,407 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) Allocating nic for vm VM[SecondaryStorageVm|s-24522-VM] in network Ntwk[202|Control|3] with requested profile null
  37. 2017-12-01 00:00:00,413 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) Allocating nic for vm VM[SecondaryStorageVm|s-24522-VM] in network Ntwk[201|Management|2] with requested profile null
  38. 2017-12-01 00:00:00,417 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) Allocating nic for vm VM[SecondaryStorageVm|s-24522-VM] in network Ntwk[203|Storage|4] with requested profile null
  39. 2017-12-01 00:00:00,421 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) Allocating disks for VM[SecondaryStorageVm|s-24522-VM]
  40. 2017-12-01 00:00:00,425 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) Allocation completed for VM: VM[SecondaryStorageVm|s-24522-VM]
  41. 2017-12-01 00:00:00,427 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) received secondary storage vm alert
  42. 2017-12-01 00:00:00,427 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) New secondary storage vm created, zone: Zone-Orion, secStorageVm: s-24522-VM, public IP: null, private IP: null
  43. 2017-12-01 00:00:00,436 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) Sync job-73581 execution on object VmWorkJobQueue.24522
  44. 2017-12-01 00:00:02,108 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-8bbf6d34) (logid:deea96a0) Execute sync-queue item: SyncQueueItemVO {id:73562, queueId: 73562, contentType: AsyncJob, contentId: 73580, lastProcessMsid: 345052167237, lastprocessNumber: 1, lastProcessTime: Fri Dec 01 00:00:02 CST 2017, created: Fri Dec 01 00:00:00 CST 2017}
  45. 2017-12-01 00:00:03,246 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-8bbf6d34) (logid:deea96a0) Schedule queued job-73580
  46. 2017-12-01 00:00:03,249 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-8bbf6d34) (logid:deea96a0) Execute sync-queue item: SyncQueueItemVO {id:73563, queueId: 73563, contentType: AsyncJob, contentId: 73581, lastProcessMsid: 345052167237, lastprocessNumber: 1, lastProcessTime: Fri Dec 01 00:00:02 CST 2017, created: Fri Dec 01 00:00:00 CST 2017}
  47. 2017-12-01 00:00:03,250 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580) (logid:53540c6c) Add job-73580 into job monitoring
  48. 2017-12-01 00:00:03,250 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-8bbf6d34) (logid:deea96a0) Schedule queued job-73581
  49. 2017-12-01 00:00:03,257 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581) (logid:25fbf3ac) Add job-73581 into job monitoring
  50. 2017-12-01 00:00:03,257 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580) (logid:a98dfed6) Executing AsyncJobVO {id:73580, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfyXQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:00:00 CST 2017}
  51. 2017-12-01 00:00:03,257 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580) (logid:a98dfed6) Run VM work job: com.cloud.vm.VmWorkStart for VM 24521, job origin: 1
  52. 2017-12-01 00:00:03,259 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) Execute VM work job: com.cloud.vm.VmWorkStart{"dcId":0,"userId":1,"accountId":1,"vmId":24521,"handlerName":"VirtualMachineManagerImpl"}
  53. 2017-12-01 00:00:03,265 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
  54. 2017-12-01 00:00:03,265 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) Successfully transitioned to start state for VM[ConsoleProxy|v-24521-VM] reservation id = 0387e37c-6477-491b-9b67-8a4a231c4162
  55. 2017-12-01 00:00:03,266 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581) (logid:32b654cc) Executing AsyncJobVO {id:73581, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfynQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:00:00 CST 2017}
  56. 2017-12-01 00:00:03,266 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581) (logid:32b654cc) Run VM work job: com.cloud.vm.VmWorkStart for VM 24522, job origin: 2
  57. 2017-12-01 00:00:03,266 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) Trying to deploy VM, vm has dcId: 1 and podId: null
  58. 2017-12-01 00:00:03,266 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) Deploy avoids pods: null, clusters: null, hosts: null
  59. 2017-12-01 00:00:03,267 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) Execute VM work job: com.cloud.vm.VmWorkStart{"dcId":0,"userId":1,"accountId":1,"vmId":24522,"handlerName":"VirtualMachineManagerImpl"}
  60. 2017-12-01 00:00:03,269 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) Deploy avoids pods: null, clusters: null, hosts: null
  61. 2017-12-01 00:00:03,270 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@eecdd04
  62. 2017-12-01 00:00:03,270 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) Trying to allocate a host and storage pools from dc:1, pod:null,cluster:null, requested cpu: 500, requested ram: 1073741824
  63. 2017-12-01 00:00:03,270 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) Is ROOT volume READY (pool already allocated)?: No
  64. 2017-12-01 00:00:03,270 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) Searching all possible resources under this Zone: 1
  65. 2017-12-01 00:00:03,270 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
  66. 2017-12-01 00:00:03,274 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
  67. 2017-12-01 00:00:03,274 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) Successfully transitioned to start state for VM[SecondaryStorageVm|s-24522-VM] reservation id = d412c8ca-d116-4f7d-94a2-be9def25229f
  68. 2017-12-01 00:00:03,275 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) Trying to deploy VM, vm has dcId: 1 and podId: null
  69. 2017-12-01 00:00:03,275 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) Deploy avoids pods: null, clusters: null, hosts: null
  70. 2017-12-01 00:00:03,278 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) Deploy avoids pods: null, clusters: null, hosts: null
  71. 2017-12-01 00:00:03,279 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@eecdd04
  72. 2017-12-01 00:00:03,279 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) Trying to allocate a host and storage pools from dc:1, pod:null,cluster:null, requested cpu: 500, requested ram: 536870912
  73. 2017-12-01 00:00:03,279 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) Is ROOT volume READY (pool already allocated)?: No
  74. 2017-12-01 00:00:03,279 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) Searching all possible resources under this Zone: 1
  75. 2017-12-01 00:00:03,280 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
  76. 2017-12-01 00:00:03,280 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) Checking resources in Cluster: 1 under Pod: 1
  77. 2017-12-01 00:00:03,280 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c FirstFitRoutingAllocator) (logid:a98dfed6) Looking for hosts in dc: 1 pod:1 cluster:1
  78. 2017-12-01 00:00:03,283 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c FirstFitRoutingAllocator) (logid:a98dfed6) FirstFitAllocator has 1 hosts to check for allocation: [Host[-1-Routing]]
  79. 2017-12-01 00:00:03,287 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c FirstFitRoutingAllocator) (logid:a98dfed6) Found 1 hosts for allocation after prioritization: [Host[-1-Routing]]
  80. 2017-12-01 00:00:03,287 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c FirstFitRoutingAllocator) (logid:a98dfed6) Looking for speed=500Mhz, Ram=1024
  81. 2017-12-01 00:00:03,288 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) Checking resources in Cluster: 1 under Pod: 1
  82. 2017-12-01 00:00:03,288 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c FirstFitRoutingAllocator) (logid:32b654cc) Looking for hosts in dc: 1 pod:1 cluster:1
  83. 2017-12-01 00:00:03,290 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c FirstFitRoutingAllocator) (logid:32b654cc) FirstFitAllocator has 1 hosts to check for allocation: [Host[-1-Routing]]
  84. 2017-12-01 00:00:03,293 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c FirstFitRoutingAllocator) (logid:32b654cc) Found 1 hosts for allocation after prioritization: [Host[-1-Routing]]
  85. 2017-12-01 00:00:03,293 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c FirstFitRoutingAllocator) (logid:32b654cc) Looking for speed=500Mhz, Ram=512
  86. 2017-12-01 00:00:03,294 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c FirstFitRoutingAllocator) (logid:a98dfed6) Host: 1 has cpu capability (cpu:16, speed:2533) to support requested CPU: 1 and requested speed: 500
  87. 2017-12-01 00:00:03,294 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c FirstFitRoutingAllocator) (logid:a98dfed6) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  88. 2017-12-01 00:00:03,296 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c FirstFitRoutingAllocator) (logid:a98dfed6) Hosts's actual total CPU: 40528 and CPU after applying overprovisioning: 40528
  89. 2017-12-01 00:00:03,296 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c FirstFitRoutingAllocator) (logid:a98dfed6) Free CPU: 40528 , Requested CPU: 500
  90. 2017-12-01 00:00:03,296 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c FirstFitRoutingAllocator) (logid:a98dfed6) Free RAM: 42880884736 , Requested RAM: 1073741824
  91. 2017-12-01 00:00:03,296 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c FirstFitRoutingAllocator) (logid:a98dfed6) Host has enough CPU and RAM available
  92. 2017-12-01 00:00:03,296 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c FirstFitRoutingAllocator) (logid:a98dfed6) STATS: Can alloc CPU from host: 1, used: 0, reserved: 0, actual total: 40528, total with overprovisioning: 40528; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  93. 2017-12-01 00:00:03,296 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c FirstFitRoutingAllocator) (logid:a98dfed6) STATS: Can alloc MEM from host: 1, used: 0, reserved: 0, total: 42880884736; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  94. 2017-12-01 00:00:03,297 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c FirstFitRoutingAllocator) (logid:a98dfed6) Found a suitable host, adding to list: 1
  95. 2017-12-01 00:00:03,297 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c FirstFitRoutingAllocator) (logid:a98dfed6) Host Allocator returning 1 suitable hosts
  96. 2017-12-01 00:00:03,298 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c FirstFitRoutingAllocator) (logid:32b654cc) Host: 1 has cpu capability (cpu:16, speed:2533) to support requested CPU: 1 and requested speed: 500
  97. 2017-12-01 00:00:03,298 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c FirstFitRoutingAllocator) (logid:32b654cc) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 536870912 , cpuOverprovisioningFactor: 1.0
  98. 2017-12-01 00:00:03,299 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) Checking suitable pools for volume (Id, Type): (24521,ROOT)
  99. 2017-12-01 00:00:03,299 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) We need to allocate new storagepool for this volume
  100. 2017-12-01 00:00:03,300 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) Calling StoragePoolAllocators to find suitable pools
  101. 2017-12-01 00:00:03,300 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c FirstFitRoutingAllocator) (logid:32b654cc) Hosts's actual total CPU: 40528 and CPU after applying overprovisioning: 40528
  102. 2017-12-01 00:00:03,300 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c FirstFitRoutingAllocator) (logid:32b654cc) Free CPU: 40528 , Requested CPU: 500
  103. 2017-12-01 00:00:03,300 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c FirstFitRoutingAllocator) (logid:32b654cc) Free RAM: 42880884736 , Requested RAM: 536870912
  104. 2017-12-01 00:00:03,300 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c FirstFitRoutingAllocator) (logid:32b654cc) Host has enough CPU and RAM available
  105. 2017-12-01 00:00:03,300 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c FirstFitRoutingAllocator) (logid:32b654cc) STATS: Can alloc CPU from host: 1, used: 0, reserved: 0, actual total: 40528, total with overprovisioning: 40528; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  106. 2017-12-01 00:00:03,300 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c FirstFitRoutingAllocator) (logid:32b654cc) STATS: Can alloc MEM from host: 1, used: 0, reserved: 0, total: 42880884736; requested mem: 536870912,alloc_from_last_host?:false ,considerReservedCapacity?: true
  107. 2017-12-01 00:00:03,300 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c FirstFitRoutingAllocator) (logid:32b654cc) Found a suitable host, adding to list: 1
  108. 2017-12-01 00:00:03,300 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c FirstFitRoutingAllocator) (logid:32b654cc) Host Allocator returning 1 suitable hosts
  109. 2017-12-01 00:00:03,301 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) System VMs will use shared storage for zone id=1
  110. 2017-12-01 00:00:03,301 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) LocalStoragePoolAllocator trying to find storage pool to fit the vm
  111. 2017-12-01 00:00:03,301 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) ClusterScopeStoragePoolAllocator looking for storage pool
  112. 2017-12-01 00:00:03,301 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) Looking for pools in dc: 1 pod:1 cluster:1. Disabled pools will be ignored.
  113. 2017-12-01 00:00:03,301 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) Found pools matching tags: []
  114. 2017-12-01 00:00:03,302 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) Checking suitable pools for volume (Id, Type): (24522,ROOT)
  115. 2017-12-01 00:00:03,302 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) We need to allocate new storagepool for this volume
  116. 2017-12-01 00:00:03,302 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) No storage pools available for shared volume allocation, returning
  117. 2017-12-01 00:00:03,302 DEBUG [o.a.c.s.a.ZoneWideStoragePoolAllocator] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) ZoneWideStoragePoolAllocator to find storage pool
  118. 2017-12-01 00:00:03,303 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) Calling StoragePoolAllocators to find suitable pools
  119. 2017-12-01 00:00:03,303 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) System VMs will use shared storage for zone id=1
  120. 2017-12-01 00:00:03,303 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) LocalStoragePoolAllocator trying to find storage pool to fit the vm
  121. 2017-12-01 00:00:03,303 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) ClusterScopeStoragePoolAllocator looking for storage pool
  122. 2017-12-01 00:00:03,303 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) Looking for pools in dc: 1 pod:1 cluster:1. Disabled pools will be ignored.
  123. 2017-12-01 00:00:03,303 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) No suitable pools found for volume: Vol[24521|vm=24521|ROOT] under cluster: 1
  124. 2017-12-01 00:00:03,303 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) No suitable pools found
  125. 2017-12-01 00:00:03,303 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) No suitable storagePools found under this Cluster: 1
  126. 2017-12-01 00:00:03,304 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) Found pools matching tags: []
  127. 2017-12-01 00:00:03,304 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) Could not find suitable Deployment Destination for this VM under any clusters, returning.
  128. 2017-12-01 00:00:03,304 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) No storage pools available for shared volume allocation, returning
  129. 2017-12-01 00:00:03,304 DEBUG [o.a.c.s.a.ZoneWideStoragePoolAllocator] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) ZoneWideStoragePoolAllocator to find storage pool
  130. 2017-12-01 00:00:03,304 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) Searching all possible resources under this Zone: 1
  131. 2017-12-01 00:00:03,305 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
  132. 2017-12-01 00:00:03,305 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) No suitable pools found for volume: Vol[24522|vm=24522|ROOT] under cluster: 1
  133. 2017-12-01 00:00:03,305 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) No suitable pools found
  134. 2017-12-01 00:00:03,305 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) No suitable storagePools found under this Cluster: 1
  135. 2017-12-01 00:00:03,306 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) Could not find suitable Deployment Destination for this VM under any clusters, returning.
  136. 2017-12-01 00:00:03,306 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) Searching all possible resources under this Zone: 1
  137. 2017-12-01 00:00:03,306 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
  138. 2017-12-01 00:00:03,306 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) Removing from the clusterId list these clusters from avoid set: [1]
  139. 2017-12-01 00:00:03,307 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) No clusters found after removing disabled clusters and clusters in avoid list, returning.
  140. 2017-12-01 00:00:03,307 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) Removing from the clusterId list these clusters from avoid set: [1]
  141. 2017-12-01 00:00:03,307 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) No clusters found after removing disabled clusters and clusters in avoid list, returning.
  142. 2017-12-01 00:00:03,318 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
  143. 2017-12-01 00:00:03,318 ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) Invocation exception, caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24522-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  144. 2017-12-01 00:00:03,318 INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) Rethrow exception com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24522-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  145. 2017-12-01 00:00:03,318 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581) (logid:32b654cc) Done with run of VM work job: com.cloud.vm.VmWorkStart for VM 24522, job origin: 2
  146. 2017-12-01 00:00:03,318 ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581) (logid:32b654cc) Unable to complete AsyncJobVO {id:73581, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfynQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:00:00 CST 2017}, job origin:2
  147. com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24522-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  148. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
  149. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
  150. at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
  151. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  152. at java.lang.reflect.Method.invoke(Method.java:498)
  153. at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
  154. at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
  155. at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
  156. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
  157. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  158. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  159. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  160. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  161. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  162. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
  163. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  164. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  165. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  166. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  167. at java.lang.Thread.run(Thread.java:748)
  168. 2017-12-01 00:00:03,319 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581) (logid:32b654cc) Complete async job-73581, jobStatus: FAILED, resultCode: 0, result: rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdABDVW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW1NlY29uZGFyeVN0b3JhZ2VWbXxzLTI0NTIyLVZNXXVyAB5bTGphdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudDsCRio8PP0iOQIAAHhwAAAAFHNyABtqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnRhCcWaJjbdhQIABEkACmxpbmVOdW1iZXJMAA5kZWNsYXJpbmdDbGFzc3EAfgAKTAAIZmlsZU5hbWVxAH4ACkwACm1ldGhvZE5hbWVxAH4ACnhwAAADwHQAJmNvbS5jbG91ZC52bS5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsdAAeVmlydHVhbE1hY2hpbmVNYW5hZ2VySW1wbC5qYXZhdAAQb3JjaGVzdHJhdGVTdGFydHNxAH4AEQAAEgtxAH4AE3EAfgAUcQB-ABVzcQB-ABH_____dAAmc3VuLnJlZmxlY3QuR2VuZXJhdGVkTWV0aG9kQWNjZXNzb3IxOTlwdAAGaW52b2tlc3EAfgARAAAAK3QAKHN1bi5yZWZsZWN0LkRlbGVnYXRpbmdNZXRob2RBY2Nlc3NvckltcGx0ACFEZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsLmphdmFxAH4AGXNxAH4AEQAAAfJ0ABhqYXZhLmxhbmcucmVmbGVjdC5NZXRob2R0AAtNZXRob2QuamF2YXEAfgAZc3EAfgARAAAAa3QAImNvbS5jbG91ZC52bS5WbVdvcmtKb2JIYW5kbGVyUHJveHl0ABpWbVdvcmtKb2JIYW5kbGVyUHJveHkuamF2YXQAD2hhbmRsZVZtV29ya0pvYnNxAH4AEQAAEqxxAH4AE3EAfgAUcQB-ACNzcQB-ABEAAABmdAAgY29tLmNsb3VkLnZtLlZtV29ya0pvYkRpc3BhdGNoZXJ0ABhWbVdvcmtKb2JEaXNwYXRjaGVyLmphdmF0AAZydW5Kb2JzcQB-ABEAAAIqdAA_b3JnLmFwYWNoZS5jbG91ZHN0YWNrLmZyYW1ld29yay5qb2JzLmltcGwuQXN5bmNKb2JNYW5hZ2VySW1wbCQ1dAAYQXN5bmNKb2JNYW5hZ2VySW1wbC5qYXZhdAAMcnVuSW5Db250ZXh0c3EAfgARAAAAMXQAPm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZSQxdAAbTWFuYWdlZENvbnRleHRSdW5uYWJsZS5qYXZhdAADcnVuc3EAfgARAAAAOHQAQm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5EZWZhdWx0TWFuYWdlZENvbnRleHQkMXQAGkRlZmF1bHRNYW5hZ2VkQ29udGV4dC5qYXZhdAAEY2FsbHNxAH4AEQAAAGd0AEBvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0cQB-ADN0AA9jYWxsV2l0aENvbnRleHRzcQB-ABEAAAA1cQB-ADZxAH4AM3QADnJ1bldpdGhDb250ZXh0c3EAfgARAAAALnQAPG9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZXEAfgAvcQB-ADBzcQB-ABEAAAH2cQB-ACpxAH4AK3EAfgAwc3EAfgARAAAB_3QALmphdmEudXRpbC5jb25jdXJyZW50LkV4ZWN1dG9ycyRSdW5uYWJsZUFkYXB0ZXJ0AA5FeGVjdXRvcnMuamF2YXEAfgA0c3EAfgARAAABCnQAH2phdmEudXRpbC5jb25jdXJyZW50LkZ1dHVyZVRhc2t0AA9GdXR1cmVUYXNrLmphdmFxAH4AMHNxAH4AEQAABH10ACdqYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3J0ABdUaHJlYWRQb29sRXhlY3V0b3IuamF2YXQACXJ1bldvcmtlcnNxAH4AEQAAAnB0AC5qYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3IkV29ya2VycQB-AEVxAH4AMHNxAH4AEQAAAux0ABBqYXZhLmxhbmcuVGhyZWFkdAALVGhyZWFkLmphdmFxAH4AMHNyACZqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlTGlzdPwPJTG17I4QAgABTAAEbGlzdHEAfgAMeHIALGphdmEudXRpbC5Db2xsZWN0aW9ucyRVbm1vZGlmaWFibGVDb2xsZWN0aW9uGUIAgMte9x4CAAFMAAFjdAAWTGphdmEvdXRpbC9Db2xsZWN0aW9uO3hwc3IAE2phdmEudXRpbC5BcnJheUxpc3R4gdIdmcdhnQMAAUkABHNpemV4cAAAAAB3BAAAAAB4cQB-AFF4c3IAEWphdmEubGFuZy5JbnRlZ2VyEuKgpPeBhzgCAAFJAAV2YWx1ZXhyABBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAAB4cAAAEO9zcQB-AFAAAAAAdwQAAAAAeHNyAA5qYXZhLmxhbmcuTG9uZzuL5JDMjyPfAgABSgAFdmFsdWV4cQB-AFMAAAAAAAAAAXZyABdjb20uY2xvdWQuZGMuRGF0YUNlbnRlcrLxCuun53i-AgAAeHAA
  169. 2017-12-01 00:00:03,319 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
  170. 2017-12-01 00:00:03,320 ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) Invocation exception, caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24521-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  171. 2017-12-01 00:00:03,320 INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) Rethrow exception com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24521-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  172. 2017-12-01 00:00:03,320 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580) (logid:a98dfed6) Done with run of VM work job: com.cloud.vm.VmWorkStart for VM 24521, job origin: 1
  173. 2017-12-01 00:00:03,320 ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580) (logid:a98dfed6) Unable to complete AsyncJobVO {id:73580, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfyXQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:00:00 CST 2017}, job origin:1
  174. com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24521-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  175. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
  176. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
  177. at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
  178. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  179. at java.lang.reflect.Method.invoke(Method.java:498)
  180. at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
  181. at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
  182. at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
  183. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
  184. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  185. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  186. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  187. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  188. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  189. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
  190. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  191. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  192. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  193. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  194. at java.lang.Thread.run(Thread.java:748)
  195. 2017-12-01 00:00:03,320 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580) (logid:a98dfed6) Complete async job-73580, jobStatus: FAILED, resultCode: 0, result: rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdAA9VW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW0NvbnNvbGVQcm94eXx2LTI0NTIxLVZNXXVyAB5bTGphdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudDsCRio8PP0iOQIAAHhwAAAAFHNyABtqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnRhCcWaJjbdhQIABEkACmxpbmVOdW1iZXJMAA5kZWNsYXJpbmdDbGFzc3EAfgAKTAAIZmlsZU5hbWVxAH4ACkwACm1ldGhvZE5hbWVxAH4ACnhwAAADwHQAJmNvbS5jbG91ZC52bS5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsdAAeVmlydHVhbE1hY2hpbmVNYW5hZ2VySW1wbC5qYXZhdAAQb3JjaGVzdHJhdGVTdGFydHNxAH4AEQAAEgtxAH4AE3EAfgAUcQB-ABVzcQB-ABH_____dAAmc3VuLnJlZmxlY3QuR2VuZXJhdGVkTWV0aG9kQWNjZXNzb3IxOTlwdAAGaW52b2tlc3EAfgARAAAAK3QAKHN1bi5yZWZsZWN0LkRlbGVnYXRpbmdNZXRob2RBY2Nlc3NvckltcGx0ACFEZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsLmphdmFxAH4AGXNxAH4AEQAAAfJ0ABhqYXZhLmxhbmcucmVmbGVjdC5NZXRob2R0AAtNZXRob2QuamF2YXEAfgAZc3EAfgARAAAAa3QAImNvbS5jbG91ZC52bS5WbVdvcmtKb2JIYW5kbGVyUHJveHl0ABpWbVdvcmtKb2JIYW5kbGVyUHJveHkuamF2YXQAD2hhbmRsZVZtV29ya0pvYnNxAH4AEQAAEqxxAH4AE3EAfgAUcQB-ACNzcQB-ABEAAABmdAAgY29tLmNsb3VkLnZtLlZtV29ya0pvYkRpc3BhdGNoZXJ0ABhWbVdvcmtKb2JEaXNwYXRjaGVyLmphdmF0AAZydW5Kb2JzcQB-ABEAAAIqdAA_b3JnLmFwYWNoZS5jbG91ZHN0YWNrLmZyYW1ld29yay5qb2JzLmltcGwuQXN5bmNKb2JNYW5hZ2VySW1wbCQ1dAAYQXN5bmNKb2JNYW5hZ2VySW1wbC5qYXZhdAAMcnVuSW5Db250ZXh0c3EAfgARAAAAMXQAPm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZSQxdAAbTWFuYWdlZENvbnRleHRSdW5uYWJsZS5qYXZhdAADcnVuc3EAfgARAAAAOHQAQm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5EZWZhdWx0TWFuYWdlZENvbnRleHQkMXQAGkRlZmF1bHRNYW5hZ2VkQ29udGV4dC5qYXZhdAAEY2FsbHNxAH4AEQAAAGd0AEBvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0cQB-ADN0AA9jYWxsV2l0aENvbnRleHRzcQB-ABEAAAA1cQB-ADZxAH4AM3QADnJ1bldpdGhDb250ZXh0c3EAfgARAAAALnQAPG9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZXEAfgAvcQB-ADBzcQB-ABEAAAH2cQB-ACpxAH4AK3EAfgAwc3EAfgARAAAB_3QALmphdmEudXRpbC5jb25jdXJyZW50LkV4ZWN1dG9ycyRSdW5uYWJsZUFkYXB0ZXJ0AA5FeGVjdXRvcnMuamF2YXEAfgA0c3EAfgARAAABCnQAH2phdmEudXRpbC5jb25jdXJyZW50LkZ1dHVyZVRhc2t0AA9GdXR1cmVUYXNrLmphdmFxAH4AMHNxAH4AEQAABH10ACdqYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3J0ABdUaHJlYWRQb29sRXhlY3V0b3IuamF2YXQACXJ1bldvcmtlcnNxAH4AEQAAAnB0AC5qYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3IkV29ya2VycQB-AEVxAH4AMHNxAH4AEQAAAux0ABBqYXZhLmxhbmcuVGhyZWFkdAALVGhyZWFkLmphdmFxAH4AMHNyACZqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlTGlzdPwPJTG17I4QAgABTAAEbGlzdHEAfgAMeHIALGphdmEudXRpbC5Db2xsZWN0aW9ucyRVbm1vZGlmaWFibGVDb2xsZWN0aW9uGUIAgMte9x4CAAFMAAFjdAAWTGphdmEvdXRpbC9Db2xsZWN0aW9uO3hwc3IAE2phdmEudXRpbC5BcnJheUxpc3R4gdIdmcdhnQMAAUkABHNpemV4cAAAAAB3BAAAAAB4cQB-AFF4c3IAEWphdmEubGFuZy5JbnRlZ2VyEuKgpPeBhzgCAAFJAAV2YWx1ZXhyABBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAAB4cAAAEO9zcQB-AFAAAAAAdwQAAAAAeHNyAA5qYXZhLmxhbmcuTG9uZzuL5JDMjyPfAgABSgAFdmFsdWV4cQB-AFMAAAAAAAAAAXZyABdjb20uY2xvdWQuZGMuRGF0YUNlbnRlcrLxCuun53i-AgAAeHAA
  196. 2017-12-01 00:00:03,321 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581) (logid:32b654cc) Publish async job-73581 complete on message bus
  197. 2017-12-01 00:00:03,321 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581) (logid:32b654cc) Wake up jobs related to job-73581
  198. 2017-12-01 00:00:03,321 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581) (logid:32b654cc) Update db status for job-73581
  199. 2017-12-01 00:00:03,323 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581) (logid:32b654cc) Wake up jobs joined with job-73581 and disjoin all subjobs created from job- 73581
  200. 2017-12-01 00:00:03,324 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580) (logid:a98dfed6) Publish async job-73580 complete on message bus
  201. 2017-12-01 00:00:03,324 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580) (logid:a98dfed6) Wake up jobs related to job-73580
  202. 2017-12-01 00:00:03,324 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580) (logid:a98dfed6) Update db status for job-73580
  203. 2017-12-01 00:00:03,327 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580) (logid:a98dfed6) Wake up jobs joined with job-73580 and disjoin all subjobs created from job- 73580
  204. 2017-12-01 00:00:03,333 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581) (logid:32b654cc) Done executing com.cloud.vm.VmWorkStart for job-73581
  205. 2017-12-01 00:00:03,339 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581) (logid:32b654cc) Remove job-73581 from job monitoring
  206. 2017-12-01 00:00:03,340 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580) (logid:a98dfed6) Done executing com.cloud.vm.VmWorkStart for job-73580
  207. 2017-12-01 00:00:03,340 WARN [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) Exception while trying to start secondary storage vm
  208. com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24522-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  209. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
  210. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
  211. at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
  212. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  213. at java.lang.reflect.Method.invoke(Method.java:498)
  214. at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
  215. at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
  216. at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
  217. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
  218. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  219. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  220. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  221. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  222. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  223. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
  224. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  225. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  226. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  227. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  228. at java.lang.Thread.run(Thread.java:748)
  229. 2017-12-01 00:00:03,343 INFO [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) Unable to start secondary storage vm for standby capacity, vm id : 24522, will recycle it and start a new one
  230. 2017-12-01 00:00:03,343 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) received secondary storage vm alert
  231. 2017-12-01 00:00:03,343 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) Secondary Storage Vm creation failure, zone: Zone-Orion
  232. 2017-12-01 00:00:03,344 WARN [o.a.c.alerts] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) alertType:: 19 // dataCenterId:: 1 // podId:: null // clusterId:: null // message:: Secondary Storage Vm creation failure. zone: Zone-Orion, error details: null
  233. 2017-12-01 00:00:03,345 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580) (logid:a98dfed6) Remove job-73580 from job monitoring
  234. 2017-12-01 00:00:03,347 INFO [o.a.c.s.PremiumSecondaryStorageManagerImpl] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) Primary secondary storage is not even started, wait until next turn
  235. 2017-12-01 00:00:03,354 WARN [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) Exception while trying to start console proxy
  236. com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24521-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  237. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
  238. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
  239. at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
  240. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  241. at java.lang.reflect.Method.invoke(Method.java:498)
  242. at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
  243. at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
  244. at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
  245. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
  246. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  247. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  248. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  249. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  250. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  251. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
  252. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  253. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  254. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  255. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  256. at java.lang.Thread.run(Thread.java:748)
  257. 2017-12-01 00:00:03,371 INFO [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) Unable to start console proxy vm for standby capacity, vm id : 24521, will recycle it and start a new one
  258. 2017-12-01 00:00:03,371 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) received console proxy alert
  259. 2017-12-01 00:00:03,371 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) Console proxy creation failure, zone: Zone-Orion
  260. 2017-12-01 00:00:03,400 WARN [o.a.c.alerts] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) alertType:: 10 // dataCenterId:: 1 // podId:: null // clusterId:: null // message:: Console proxy creation failure. zone: Zone-Orion, error details: null
  261. 2017-12-01 00:00:04,104 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-c115b699) (logid:3f3769fb) Begin cleanup expired async-jobs
  262. 2017-12-01 00:00:04,108 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-c115b699) (logid:3f3769fb) End cleanup expired async-jobs
  263. 2017-12-01 00:00:14,104 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-abd72b19) (logid:4865eda5) Begin cleanup expired async-jobs
  264. 2017-12-01 00:00:14,108 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-abd72b19) (logid:4865eda5) End cleanup expired async-jobs
  265. 2017-12-01 00:00:15,413 DEBUG [c.c.s.StatsCollector] (StatsCollector-2:ctx-5d3dff9a) (logid:b538c45b) HostStatsCollector is running...
  266. 2017-12-01 00:00:15,419 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-331:ctx-99472dbd) (logid:66f3977e) Seq 1-3458483038843866934: Executing request
  267. 2017-12-01 00:00:15,526 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-331:ctx-99472dbd) (logid:b538c45b) Seq 1-3458483038843866934: Response Received:
  268. 2017-12-01 00:00:15,527 DEBUG [c.c.a.t.Request] (StatsCollector-2:ctx-5d3dff9a) (logid:b538c45b) Seq 1-3458483038843866934: Received: { Ans: , MgmtId: 345052167237, via: 1(r6-l06-esx01.cisco.com), Ver: v1, Flags: 10, { GetHostStatsAnswer } }
  269. 2017-12-01 00:00:24,105 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-feea2201) (logid:cb61d772) Begin cleanup expired async-jobs
  270. 2017-12-01 00:00:24,109 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-feea2201) (logid:cb61d772) End cleanup expired async-jobs
  271. 2017-12-01 00:00:24,338 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-ce4c12a1) (logid:bcff034e) Found 0 routers to update status.
  272. 2017-12-01 00:00:24,339 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-ce4c12a1) (logid:bcff034e) Found 0 VPC networks to update Redundant State.
  273. 2017-12-01 00:00:24,340 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-ce4c12a1) (logid:bcff034e) Found 0 networks to update RvR status.
  274. 2017-12-01 00:00:30,238 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) Zone 1 is ready to launch console proxy
  275. 2017-12-01 00:00:30,238 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) Expand console proxy standby capacity for zone Zone-Orion
  276. 2017-12-01 00:00:30,239 INFO [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) Found a stopped console proxy, starting it. Vm id : 24521
  277. 2017-12-01 00:00:30,246 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) Sync job-73582 execution on object VmWorkJobQueue.24521
  278. 2017-12-01 00:00:30,438 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Zone 1 is ready to launch secondary storage VM
  279. 2017-12-01 00:00:30,464 INFO [o.a.c.s.PremiumSecondaryStorageManagerImpl] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) No running secondary storage vms found in datacenter id=1, starting one
  280. 2017-12-01 00:00:30,473 INFO [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Found a stopped secondary storage vm, starting it. Vm id : 24522
  281. 2017-12-01 00:00:30,481 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Sync job-73583 execution on object VmWorkJobQueue.24522
  282. 2017-12-01 00:00:31,133 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-29a39fc2) (logid:efa776ba) Resetting hosts suitable for reconnect
  283. 2017-12-01 00:00:31,134 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-29a39fc2) (logid:efa776ba) Completed resetting hosts suitable for reconnect
  284. 2017-12-01 00:00:31,134 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-29a39fc2) (logid:efa776ba) Acquiring hosts for clusters already owned by this management server
  285. 2017-12-01 00:00:31,135 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-29a39fc2) (logid:efa776ba) Completed acquiring hosts for clusters already owned by this management server
  286. 2017-12-01 00:00:31,135 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-29a39fc2) (logid:efa776ba) Acquiring hosts for clusters not owned by any management server
  287. 2017-12-01 00:00:31,135 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-29a39fc2) (logid:efa776ba) Completed acquiring hosts for clusters not owned by any management server
  288. 2017-12-01 00:00:32,107 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-c73d22f3) (logid:a3d8f7d4) Execute sync-queue item: SyncQueueItemVO {id:73564, queueId: 73562, contentType: AsyncJob, contentId: 73582, lastProcessMsid: 345052167237, lastprocessNumber: 2, lastProcessTime: Fri Dec 01 00:00:32 CST 2017, created: Fri Dec 01 00:00:30 CST 2017}
  289. 2017-12-01 00:00:32,108 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-c73d22f3) (logid:a3d8f7d4) Schedule queued job-73582
  290. 2017-12-01 00:00:32,110 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-c73d22f3) (logid:a3d8f7d4) Execute sync-queue item: SyncQueueItemVO {id:73565, queueId: 73563, contentType: AsyncJob, contentId: 73583, lastProcessMsid: 345052167237, lastprocessNumber: 2, lastProcessTime: Fri Dec 01 00:00:32 CST 2017, created: Fri Dec 01 00:00:30 CST 2017}
  291. 2017-12-01 00:00:32,111 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582) (logid:0291080b) Add job-73582 into job monitoring
  292. 2017-12-01 00:00:32,113 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-c73d22f3) (logid:a3d8f7d4) Schedule queued job-73583
  293. 2017-12-01 00:00:32,117 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583) (logid:d0161622) Add job-73583 into job monitoring
  294. 2017-12-01 00:00:32,118 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582) (logid:a98dfed6) Executing AsyncJobVO {id:73582, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfyXQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:00:30 CST 2017}
  295. 2017-12-01 00:00:32,118 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582) (logid:a98dfed6) Run VM work job: com.cloud.vm.VmWorkStart for VM 24521, job origin: 1
  296. 2017-12-01 00:00:32,119 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) Execute VM work job: com.cloud.vm.VmWorkStart{"dcId":0,"userId":1,"accountId":1,"vmId":24521,"handlerName":"VirtualMachineManagerImpl"}
  297. 2017-12-01 00:00:32,124 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583) (logid:32b654cc) Executing AsyncJobVO {id:73583, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfynQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:00:30 CST 2017}
  298. 2017-12-01 00:00:32,124 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583) (logid:32b654cc) Run VM work job: com.cloud.vm.VmWorkStart for VM 24522, job origin: 2
  299. 2017-12-01 00:00:32,125 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
  300. 2017-12-01 00:00:32,125 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) Successfully transitioned to start state for VM[ConsoleProxy|v-24521-VM] reservation id = df78decd-2755-437b-8b73-eb46549fa008
  301. 2017-12-01 00:00:32,125 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) Execute VM work job: com.cloud.vm.VmWorkStart{"dcId":0,"userId":1,"accountId":1,"vmId":24522,"handlerName":"VirtualMachineManagerImpl"}
  302. 2017-12-01 00:00:32,126 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) Trying to deploy VM, vm has dcId: 1 and podId: null
  303. 2017-12-01 00:00:32,126 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) Deploy avoids pods: null, clusters: null, hosts: null
  304. 2017-12-01 00:00:32,129 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) Deploy avoids pods: null, clusters: null, hosts: null
  305. 2017-12-01 00:00:32,130 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@eecdd04
  306. 2017-12-01 00:00:32,130 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) Trying to allocate a host and storage pools from dc:1, pod:null,cluster:null, requested cpu: 500, requested ram: 1073741824
  307. 2017-12-01 00:00:32,130 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) Is ROOT volume READY (pool already allocated)?: No
  308. 2017-12-01 00:00:32,130 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) Searching all possible resources under this Zone: 1
  309. 2017-12-01 00:00:32,130 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
  310. 2017-12-01 00:00:32,131 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
  311. 2017-12-01 00:00:32,131 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) Successfully transitioned to start state for VM[SecondaryStorageVm|s-24522-VM] reservation id = 5bd64a66-f3b6-4814-b05b-3c27c3e405b4
  312. 2017-12-01 00:00:32,132 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) Trying to deploy VM, vm has dcId: 1 and podId: null
  313. 2017-12-01 00:00:32,132 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) Deploy avoids pods: null, clusters: null, hosts: null
  314. 2017-12-01 00:00:32,135 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) Deploy avoids pods: null, clusters: null, hosts: null
  315. 2017-12-01 00:00:32,135 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@eecdd04
  316. 2017-12-01 00:00:32,135 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) Trying to allocate a host and storage pools from dc:1, pod:null,cluster:null, requested cpu: 500, requested ram: 536870912
  317. 2017-12-01 00:00:32,135 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) Is ROOT volume READY (pool already allocated)?: No
  318. 2017-12-01 00:00:32,135 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) Searching all possible resources under this Zone: 1
  319. 2017-12-01 00:00:32,136 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
  320. 2017-12-01 00:00:32,139 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) Checking resources in Cluster: 1 under Pod: 1
  321. 2017-12-01 00:00:32,139 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019 FirstFitRoutingAllocator) (logid:a98dfed6) Looking for hosts in dc: 1 pod:1 cluster:1
  322. 2017-12-01 00:00:32,141 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019 FirstFitRoutingAllocator) (logid:a98dfed6) FirstFitAllocator has 1 hosts to check for allocation: [Host[-1-Routing]]
  323. 2017-12-01 00:00:32,145 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019 FirstFitRoutingAllocator) (logid:a98dfed6) Found 1 hosts for allocation after prioritization: [Host[-1-Routing]]
  324. 2017-12-01 00:00:32,145 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019 FirstFitRoutingAllocator) (logid:a98dfed6) Looking for speed=500Mhz, Ram=1024
  325. 2017-12-01 00:00:32,146 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) Checking resources in Cluster: 1 under Pod: 1
  326. 2017-12-01 00:00:32,146 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e FirstFitRoutingAllocator) (logid:32b654cc) Looking for hosts in dc: 1 pod:1 cluster:1
  327. 2017-12-01 00:00:32,148 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e FirstFitRoutingAllocator) (logid:32b654cc) FirstFitAllocator has 1 hosts to check for allocation: [Host[-1-Routing]]
  328. 2017-12-01 00:00:32,150 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019 FirstFitRoutingAllocator) (logid:a98dfed6) Host: 1 has cpu capability (cpu:16, speed:2533) to support requested CPU: 1 and requested speed: 500
  329. 2017-12-01 00:00:32,150 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019 FirstFitRoutingAllocator) (logid:a98dfed6) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  330. 2017-12-01 00:00:32,151 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e FirstFitRoutingAllocator) (logid:32b654cc) Found 1 hosts for allocation after prioritization: [Host[-1-Routing]]
  331. 2017-12-01 00:00:32,151 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e FirstFitRoutingAllocator) (logid:32b654cc) Looking for speed=500Mhz, Ram=512
  332. 2017-12-01 00:00:32,151 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019 FirstFitRoutingAllocator) (logid:a98dfed6) Hosts's actual total CPU: 40528 and CPU after applying overprovisioning: 40528
  333. 2017-12-01 00:00:32,151 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019 FirstFitRoutingAllocator) (logid:a98dfed6) Free CPU: 40528 , Requested CPU: 500
  334. 2017-12-01 00:00:32,151 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019 FirstFitRoutingAllocator) (logid:a98dfed6) Free RAM: 42880884736 , Requested RAM: 1073741824
  335. 2017-12-01 00:00:32,151 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019 FirstFitRoutingAllocator) (logid:a98dfed6) Host has enough CPU and RAM available
  336. 2017-12-01 00:00:32,151 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019 FirstFitRoutingAllocator) (logid:a98dfed6) STATS: Can alloc CPU from host: 1, used: 0, reserved: 0, actual total: 40528, total with overprovisioning: 40528; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  337. 2017-12-01 00:00:32,152 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019 FirstFitRoutingAllocator) (logid:a98dfed6) STATS: Can alloc MEM from host: 1, used: 0, reserved: 0, total: 42880884736; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  338. 2017-12-01 00:00:32,152 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019 FirstFitRoutingAllocator) (logid:a98dfed6) Found a suitable host, adding to list: 1
  339. 2017-12-01 00:00:32,152 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019 FirstFitRoutingAllocator) (logid:a98dfed6) Host Allocator returning 1 suitable hosts
  340. 2017-12-01 00:00:32,153 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) Checking suitable pools for volume (Id, Type): (24521,ROOT)
  341. 2017-12-01 00:00:32,153 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) We need to allocate new storagepool for this volume
  342. 2017-12-01 00:00:32,154 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) Calling StoragePoolAllocators to find suitable pools
  343. 2017-12-01 00:00:32,155 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) System VMs will use shared storage for zone id=1
  344. 2017-12-01 00:00:32,155 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) LocalStoragePoolAllocator trying to find storage pool to fit the vm
  345. 2017-12-01 00:00:32,155 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) ClusterScopeStoragePoolAllocator looking for storage pool
  346. 2017-12-01 00:00:32,155 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) Looking for pools in dc: 1 pod:1 cluster:1. Disabled pools will be ignored.
  347. 2017-12-01 00:00:32,155 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) Found pools matching tags: []
  348. 2017-12-01 00:00:32,156 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) No storage pools available for shared volume allocation, returning
  349. 2017-12-01 00:00:32,156 DEBUG [o.a.c.s.a.ZoneWideStoragePoolAllocator] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) ZoneWideStoragePoolAllocator to find storage pool
  350. 2017-12-01 00:00:32,157 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e FirstFitRoutingAllocator) (logid:32b654cc) Host: 1 has cpu capability (cpu:16, speed:2533) to support requested CPU: 1 and requested speed: 500
  351. 2017-12-01 00:00:32,157 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e FirstFitRoutingAllocator) (logid:32b654cc) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 536870912 , cpuOverprovisioningFactor: 1.0
  352. 2017-12-01 00:00:32,157 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) No suitable pools found for volume: Vol[24521|vm=24521|ROOT] under cluster: 1
  353. 2017-12-01 00:00:32,157 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) No suitable pools found
  354. 2017-12-01 00:00:32,157 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) No suitable storagePools found under this Cluster: 1
  355. 2017-12-01 00:00:32,157 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) Could not find suitable Deployment Destination for this VM under any clusters, returning.
  356. 2017-12-01 00:00:32,157 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) Searching all possible resources under this Zone: 1
  357. 2017-12-01 00:00:32,158 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
  358. 2017-12-01 00:00:32,158 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e FirstFitRoutingAllocator) (logid:32b654cc) Hosts's actual total CPU: 40528 and CPU after applying overprovisioning: 40528
  359. 2017-12-01 00:00:32,158 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e FirstFitRoutingAllocator) (logid:32b654cc) Free CPU: 40528 , Requested CPU: 500
  360. 2017-12-01 00:00:32,158 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e FirstFitRoutingAllocator) (logid:32b654cc) Free RAM: 42880884736 , Requested RAM: 536870912
  361. 2017-12-01 00:00:32,158 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e FirstFitRoutingAllocator) (logid:32b654cc) Host has enough CPU and RAM available
  362. 2017-12-01 00:00:32,158 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e FirstFitRoutingAllocator) (logid:32b654cc) STATS: Can alloc CPU from host: 1, used: 0, reserved: 0, actual total: 40528, total with overprovisioning: 40528; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  363. 2017-12-01 00:00:32,158 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e FirstFitRoutingAllocator) (logid:32b654cc) STATS: Can alloc MEM from host: 1, used: 0, reserved: 0, total: 42880884736; requested mem: 536870912,alloc_from_last_host?:false ,considerReservedCapacity?: true
  364. 2017-12-01 00:00:32,158 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e FirstFitRoutingAllocator) (logid:32b654cc) Found a suitable host, adding to list: 1
  365. 2017-12-01 00:00:32,158 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e FirstFitRoutingAllocator) (logid:32b654cc) Host Allocator returning 1 suitable hosts
  366. 2017-12-01 00:00:32,159 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) Removing from the clusterId list these clusters from avoid set: [1]
  367. 2017-12-01 00:00:32,159 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) No clusters found after removing disabled clusters and clusters in avoid list, returning.
  368. 2017-12-01 00:00:32,160 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) Checking suitable pools for volume (Id, Type): (24522,ROOT)
  369. 2017-12-01 00:00:32,160 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) We need to allocate new storagepool for this volume
  370. 2017-12-01 00:00:32,161 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) Calling StoragePoolAllocators to find suitable pools
  371. 2017-12-01 00:00:32,161 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) System VMs will use shared storage for zone id=1
  372. 2017-12-01 00:00:32,161 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) LocalStoragePoolAllocator trying to find storage pool to fit the vm
  373. 2017-12-01 00:00:32,161 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) ClusterScopeStoragePoolAllocator looking for storage pool
  374. 2017-12-01 00:00:32,161 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) Looking for pools in dc: 1 pod:1 cluster:1. Disabled pools will be ignored.
  375. 2017-12-01 00:00:32,162 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) Found pools matching tags: []
  376. 2017-12-01 00:00:32,162 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) No storage pools available for shared volume allocation, returning
  377. 2017-12-01 00:00:32,162 DEBUG [o.a.c.s.a.ZoneWideStoragePoolAllocator] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) ZoneWideStoragePoolAllocator to find storage pool
  378. 2017-12-01 00:00:32,163 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) No suitable pools found for volume: Vol[24522|vm=24522|ROOT] under cluster: 1
  379. 2017-12-01 00:00:32,163 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) No suitable pools found
  380. 2017-12-01 00:00:32,163 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) No suitable storagePools found under this Cluster: 1
  381. 2017-12-01 00:00:32,164 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) Could not find suitable Deployment Destination for this VM under any clusters, returning.
  382. 2017-12-01 00:00:32,164 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) Searching all possible resources under this Zone: 1
  383. 2017-12-01 00:00:32,164 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
  384. 2017-12-01 00:00:32,165 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) Removing from the clusterId list these clusters from avoid set: [1]
  385. 2017-12-01 00:00:32,166 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) No clusters found after removing disabled clusters and clusters in avoid list, returning.
  386. 2017-12-01 00:00:32,166 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
  387. 2017-12-01 00:00:32,166 ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) Invocation exception, caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24521-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  388. 2017-12-01 00:00:32,166 INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) Rethrow exception com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24521-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  389. 2017-12-01 00:00:32,166 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582) (logid:a98dfed6) Done with run of VM work job: com.cloud.vm.VmWorkStart for VM 24521, job origin: 1
  390. 2017-12-01 00:00:32,166 ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582) (logid:a98dfed6) Unable to complete AsyncJobVO {id:73582, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfyXQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:00:30 CST 2017}, job origin:1
  391. com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24521-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  392. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
  393. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
  394. at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
  395. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  396. at java.lang.reflect.Method.invoke(Method.java:498)
  397. at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
  398. at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
  399. at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
  400. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
  401. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  402. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  403. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  404. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  405. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  406. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
  407. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  408. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  409. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  410. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  411. at java.lang.Thread.run(Thread.java:748)
  412. 2017-12-01 00:00:32,167 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582) (logid:a98dfed6) Complete async job-73582, jobStatus: FAILED, resultCode: 0, result: rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdAA9VW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW0NvbnNvbGVQcm94eXx2LTI0NTIxLVZNXXVyAB5bTGphdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudDsCRio8PP0iOQIAAHhwAAAAFHNyABtqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnRhCcWaJjbdhQIABEkACmxpbmVOdW1iZXJMAA5kZWNsYXJpbmdDbGFzc3EAfgAKTAAIZmlsZU5hbWVxAH4ACkwACm1ldGhvZE5hbWVxAH4ACnhwAAADwHQAJmNvbS5jbG91ZC52bS5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsdAAeVmlydHVhbE1hY2hpbmVNYW5hZ2VySW1wbC5qYXZhdAAQb3JjaGVzdHJhdGVTdGFydHNxAH4AEQAAEgtxAH4AE3EAfgAUcQB-ABVzcQB-ABH_____dAAmc3VuLnJlZmxlY3QuR2VuZXJhdGVkTWV0aG9kQWNjZXNzb3IxOTlwdAAGaW52b2tlc3EAfgARAAAAK3QAKHN1bi5yZWZsZWN0LkRlbGVnYXRpbmdNZXRob2RBY2Nlc3NvckltcGx0ACFEZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsLmphdmFxAH4AGXNxAH4AEQAAAfJ0ABhqYXZhLmxhbmcucmVmbGVjdC5NZXRob2R0AAtNZXRob2QuamF2YXEAfgAZc3EAfgARAAAAa3QAImNvbS5jbG91ZC52bS5WbVdvcmtKb2JIYW5kbGVyUHJveHl0ABpWbVdvcmtKb2JIYW5kbGVyUHJveHkuamF2YXQAD2hhbmRsZVZtV29ya0pvYnNxAH4AEQAAEqxxAH4AE3EAfgAUcQB-ACNzcQB-ABEAAABmdAAgY29tLmNsb3VkLnZtLlZtV29ya0pvYkRpc3BhdGNoZXJ0ABhWbVdvcmtKb2JEaXNwYXRjaGVyLmphdmF0AAZydW5Kb2JzcQB-ABEAAAIqdAA_b3JnLmFwYWNoZS5jbG91ZHN0YWNrLmZyYW1ld29yay5qb2JzLmltcGwuQXN5bmNKb2JNYW5hZ2VySW1wbCQ1dAAYQXN5bmNKb2JNYW5hZ2VySW1wbC5qYXZhdAAMcnVuSW5Db250ZXh0c3EAfgARAAAAMXQAPm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZSQxdAAbTWFuYWdlZENvbnRleHRSdW5uYWJsZS5qYXZhdAADcnVuc3EAfgARAAAAOHQAQm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5EZWZhdWx0TWFuYWdlZENvbnRleHQkMXQAGkRlZmF1bHRNYW5hZ2VkQ29udGV4dC5qYXZhdAAEY2FsbHNxAH4AEQAAAGd0AEBvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0cQB-ADN0AA9jYWxsV2l0aENvbnRleHRzcQB-ABEAAAA1cQB-ADZxAH4AM3QADnJ1bldpdGhDb250ZXh0c3EAfgARAAAALnQAPG9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZXEAfgAvcQB-ADBzcQB-ABEAAAH2cQB-ACpxAH4AK3EAfgAwc3EAfgARAAAB_3QALmphdmEudXRpbC5jb25jdXJyZW50LkV4ZWN1dG9ycyRSdW5uYWJsZUFkYXB0ZXJ0AA5FeGVjdXRvcnMuamF2YXEAfgA0c3EAfgARAAABCnQAH2phdmEudXRpbC5jb25jdXJyZW50LkZ1dHVyZVRhc2t0AA9GdXR1cmVUYXNrLmphdmFxAH4AMHNxAH4AEQAABH10ACdqYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3J0ABdUaHJlYWRQb29sRXhlY3V0b3IuamF2YXQACXJ1bldvcmtlcnNxAH4AEQAAAnB0AC5qYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3IkV29ya2VycQB-AEVxAH4AMHNxAH4AEQAAAux0ABBqYXZhLmxhbmcuVGhyZWFkdAALVGhyZWFkLmphdmFxAH4AMHNyACZqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlTGlzdPwPJTG17I4QAgABTAAEbGlzdHEAfgAMeHIALGphdmEudXRpbC5Db2xsZWN0aW9ucyRVbm1vZGlmaWFibGVDb2xsZWN0aW9uGUIAgMte9x4CAAFMAAFjdAAWTGphdmEvdXRpbC9Db2xsZWN0aW9uO3hwc3IAE2phdmEudXRpbC5BcnJheUxpc3R4gdIdmcdhnQMAAUkABHNpemV4cAAAAAB3BAAAAAB4cQB-AFF4c3IAEWphdmEubGFuZy5JbnRlZ2VyEuKgpPeBhzgCAAFJAAV2YWx1ZXhyABBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAAB4cAAAEO9zcQB-AFAAAAAAdwQAAAAAeHNyAA5qYXZhLmxhbmcuTG9uZzuL5JDMjyPfAgABSgAFdmFsdWV4cQB-AFMAAAAAAAAAAXZyABdjb20uY2xvdWQuZGMuRGF0YUNlbnRlcrLxCuun53i-AgAAeHAA
  413. 2017-12-01 00:00:32,168 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582) (logid:a98dfed6) Publish async job-73582 complete on message bus
  414. 2017-12-01 00:00:32,168 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582) (logid:a98dfed6) Wake up jobs related to job-73582
  415. 2017-12-01 00:00:32,168 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582) (logid:a98dfed6) Update db status for job-73582
  416. 2017-12-01 00:00:32,173 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582) (logid:a98dfed6) Wake up jobs joined with job-73582 and disjoin all subjobs created from job- 73582
  417. 2017-12-01 00:00:32,178 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582) (logid:a98dfed6) Done executing com.cloud.vm.VmWorkStart for job-73582
  418. 2017-12-01 00:00:32,179 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582) (logid:a98dfed6) Remove job-73582 from job monitoring
  419. 2017-12-01 00:00:32,180 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
  420. 2017-12-01 00:00:32,180 ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) Invocation exception, caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24522-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  421. 2017-12-01 00:00:32,180 INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) Rethrow exception com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24522-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  422. 2017-12-01 00:00:32,180 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583) (logid:32b654cc) Done with run of VM work job: com.cloud.vm.VmWorkStart for VM 24522, job origin: 2
  423. 2017-12-01 00:00:32,180 ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583) (logid:32b654cc) Unable to complete AsyncJobVO {id:73583, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfynQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:00:30 CST 2017}, job origin:2
  424. com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24522-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  425. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
  426. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
  427. at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
  428. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  429. at java.lang.reflect.Method.invoke(Method.java:498)
  430. at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
  431. at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
  432. at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
  433. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
  434. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  435. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  436. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  437. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  438. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  439. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
  440. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  441. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  442. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  443. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  444. at java.lang.Thread.run(Thread.java:748)
  445. 2017-12-01 00:00:32,181 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583) (logid:32b654cc) Complete async job-73583, jobStatus: FAILED, resultCode: 0, result: rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdABDVW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW1NlY29uZGFyeVN0b3JhZ2VWbXxzLTI0NTIyLVZNXXVyAB5bTGphdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudDsCRio8PP0iOQIAAHhwAAAAFHNyABtqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnRhCcWaJjbdhQIABEkACmxpbmVOdW1iZXJMAA5kZWNsYXJpbmdDbGFzc3EAfgAKTAAIZmlsZU5hbWVxAH4ACkwACm1ldGhvZE5hbWVxAH4ACnhwAAADwHQAJmNvbS5jbG91ZC52bS5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsdAAeVmlydHVhbE1hY2hpbmVNYW5hZ2VySW1wbC5qYXZhdAAQb3JjaGVzdHJhdGVTdGFydHNxAH4AEQAAEgtxAH4AE3EAfgAUcQB-ABVzcQB-ABH_____dAAmc3VuLnJlZmxlY3QuR2VuZXJhdGVkTWV0aG9kQWNjZXNzb3IxOTlwdAAGaW52b2tlc3EAfgARAAAAK3QAKHN1bi5yZWZsZWN0LkRlbGVnYXRpbmdNZXRob2RBY2Nlc3NvckltcGx0ACFEZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsLmphdmFxAH4AGXNxAH4AEQAAAfJ0ABhqYXZhLmxhbmcucmVmbGVjdC5NZXRob2R0AAtNZXRob2QuamF2YXEAfgAZc3EAfgARAAAAa3QAImNvbS5jbG91ZC52bS5WbVdvcmtKb2JIYW5kbGVyUHJveHl0ABpWbVdvcmtKb2JIYW5kbGVyUHJveHkuamF2YXQAD2hhbmRsZVZtV29ya0pvYnNxAH4AEQAAEqxxAH4AE3EAfgAUcQB-ACNzcQB-ABEAAABmdAAgY29tLmNsb3VkLnZtLlZtV29ya0pvYkRpc3BhdGNoZXJ0ABhWbVdvcmtKb2JEaXNwYXRjaGVyLmphdmF0AAZydW5Kb2JzcQB-ABEAAAIqdAA_b3JnLmFwYWNoZS5jbG91ZHN0YWNrLmZyYW1ld29yay5qb2JzLmltcGwuQXN5bmNKb2JNYW5hZ2VySW1wbCQ1dAAYQXN5bmNKb2JNYW5hZ2VySW1wbC5qYXZhdAAMcnVuSW5Db250ZXh0c3EAfgARAAAAMXQAPm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZSQxdAAbTWFuYWdlZENvbnRleHRSdW5uYWJsZS5qYXZhdAADcnVuc3EAfgARAAAAOHQAQm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5EZWZhdWx0TWFuYWdlZENvbnRleHQkMXQAGkRlZmF1bHRNYW5hZ2VkQ29udGV4dC5qYXZhdAAEY2FsbHNxAH4AEQAAAGd0AEBvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0cQB-ADN0AA9jYWxsV2l0aENvbnRleHRzcQB-ABEAAAA1cQB-ADZxAH4AM3QADnJ1bldpdGhDb250ZXh0c3EAfgARAAAALnQAPG9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZXEAfgAvcQB-ADBzcQB-ABEAAAH2cQB-ACpxAH4AK3EAfgAwc3EAfgARAAAB_3QALmphdmEudXRpbC5jb25jdXJyZW50LkV4ZWN1dG9ycyRSdW5uYWJsZUFkYXB0ZXJ0AA5FeGVjdXRvcnMuamF2YXEAfgA0c3EAfgARAAABCnQAH2phdmEudXRpbC5jb25jdXJyZW50LkZ1dHVyZVRhc2t0AA9GdXR1cmVUYXNrLmphdmFxAH4AMHNxAH4AEQAABH10ACdqYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3J0ABdUaHJlYWRQb29sRXhlY3V0b3IuamF2YXQACXJ1bldvcmtlcnNxAH4AEQAAAnB0AC5qYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3IkV29ya2VycQB-AEVxAH4AMHNxAH4AEQAAAux0ABBqYXZhLmxhbmcuVGhyZWFkdAALVGhyZWFkLmphdmFxAH4AMHNyACZqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlTGlzdPwPJTG17I4QAgABTAAEbGlzdHEAfgAMeHIALGphdmEudXRpbC5Db2xsZWN0aW9ucyRVbm1vZGlmaWFibGVDb2xsZWN0aW9uGUIAgMte9x4CAAFMAAFjdAAWTGphdmEvdXRpbC9Db2xsZWN0aW9uO3hwc3IAE2phdmEudXRpbC5BcnJheUxpc3R4gdIdmcdhnQMAAUkABHNpemV4cAAAAAB3BAAAAAB4cQB-AFF4c3IAEWphdmEubGFuZy5JbnRlZ2VyEuKgpPeBhzgCAAFJAAV2YWx1ZXhyABBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAAB4cAAAEO9zcQB-AFAAAAAAdwQAAAAAeHNyAA5qYXZhLmxhbmcuTG9uZzuL5JDMjyPfAgABSgAFdmFsdWV4cQB-AFMAAAAAAAAAAXZyABdjb20uY2xvdWQuZGMuRGF0YUNlbnRlcrLxCuun53i-AgAAeHAA
  446. 2017-12-01 00:00:32,184 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583) (logid:32b654cc) Publish async job-73583 complete on message bus
  447. 2017-12-01 00:00:32,184 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583) (logid:32b654cc) Wake up jobs related to job-73583
  448. 2017-12-01 00:00:32,184 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583) (logid:32b654cc) Update db status for job-73583
  449. 2017-12-01 00:00:32,187 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583) (logid:32b654cc) Wake up jobs joined with job-73583 and disjoin all subjobs created from job- 73583
  450. 2017-12-01 00:00:32,189 WARN [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) Exception while trying to start console proxy
  451. com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24521-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  452. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
  453. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
  454. at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
  455. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  456. at java.lang.reflect.Method.invoke(Method.java:498)
  457. at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
  458. at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
  459. at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
  460. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
  461. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  462. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  463. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  464. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  465. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  466. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
  467. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  468. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  469. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  470. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  471. at java.lang.Thread.run(Thread.java:748)
  472. 2017-12-01 00:00:32,192 INFO [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) Unable to start console proxy vm for standby capacity, vm id : 24521, will recycle it and start a new one
  473. 2017-12-01 00:00:32,200 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583) (logid:32b654cc) Done executing com.cloud.vm.VmWorkStart for job-73583
  474. 2017-12-01 00:00:32,201 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583) (logid:32b654cc) Remove job-73583 from job monitoring
  475. 2017-12-01 00:00:32,202 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) Sync job-73584 execution on object VmWorkJobQueue.24521
  476. 2017-12-01 00:00:32,206 WARN [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Exception while trying to start secondary storage vm
  477. com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24522-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  478. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
  479. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
  480. at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
  481. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  482. at java.lang.reflect.Method.invoke(Method.java:498)
  483. at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
  484. at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
  485. at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
  486. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
  487. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  488. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  489. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  490. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  491. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  492. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
  493. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  494. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  495. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  496. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  497. at java.lang.Thread.run(Thread.java:748)
  498. 2017-12-01 00:00:32,209 INFO [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Unable to start secondary storage vm for standby capacity, vm id : 24522, will recycle it and start a new one
  499. 2017-12-01 00:00:32,219 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Sync job-73585 execution on object VmWorkJobQueue.24522
  500. 2017-12-01 00:00:33,497 INFO [c.c.h.v.r.VmwareResource] (DirectAgentCronJob-384:ctx-46595e4b) (logid:d5e16a92) Scan hung worker VM to recycle
  501. 2017-12-01 00:00:33,681 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgentCronJob-384:ctx-46595e4b) (logid:d5e16a92) Ping from 1(r6-l06-esx01.cisco.com)
  502. 2017-12-01 00:00:33,681 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-384:ctx-46595e4b) (logid:d5e16a92) Process host VM state report from ping process. host: 1
  503. 2017-12-01 00:00:33,681 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-384:ctx-46595e4b) (logid:d5e16a92) Process VM state report. host: 1, number of records in report: 0
  504. 2017-12-01 00:00:33,682 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-384:ctx-46595e4b) (logid:d5e16a92) Done with process of VM state report. host: 1
  505. 2017-12-01 00:00:34,106 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-541524a3) (logid:9cbc9040) Execute sync-queue item: SyncQueueItemVO {id:73566, queueId: 73562, contentType: AsyncJob, contentId: 73584, lastProcessMsid: 345052167237, lastprocessNumber: 3, lastProcessTime: Fri Dec 01 00:00:34 CST 2017, created: Fri Dec 01 00:00:32 CST 2017}
  506. 2017-12-01 00:00:34,107 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-541524a3) (logid:9cbc9040) Schedule queued job-73584
  507. 2017-12-01 00:00:34,109 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-541524a3) (logid:9cbc9040) Execute sync-queue item: SyncQueueItemVO {id:73567, queueId: 73563, contentType: AsyncJob, contentId: 73585, lastProcessMsid: 345052167237, lastprocessNumber: 3, lastProcessTime: Fri Dec 01 00:00:34 CST 2017, created: Fri Dec 01 00:00:32 CST 2017}
  508. 2017-12-01 00:00:34,109 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-541524a3) (logid:9cbc9040) Schedule queued job-73585
  509. 2017-12-01 00:00:34,109 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-28:ctx-0dd06b7a job-1/job-73584) (logid:4d31e5d8) Add job-73584 into job monitoring
  510. 2017-12-01 00:00:34,113 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-29:ctx-2a1c1ee0 job-2/job-73585) (logid:1f57254d) Add job-73585 into job monitoring
  511. 2017-12-01 00:00:34,114 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-28:ctx-0dd06b7a job-1/job-73584) (logid:a98dfed6) Executing AsyncJobVO {id:73584, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStop, cmdInfo: rO0ABXNyABdjb20uY2xvdWQudm0uVm1Xb3JrU3RvcALQ4GymiWjjAgABWgAHY2xlYW51cHhyABNjb20uY2xvdWQudm0uVm1Xb3Jrn5m2VvAlZ2sCAARKAAlhY2NvdW50SWRKAAZ1c2VySWRKAAR2bUlkTAALaGFuZGxlck5hbWV0ABJMamF2YS9sYW5nL1N0cmluZzt4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfyXQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:00:32 CST 2017}
  512. 2017-12-01 00:00:34,114 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-28:ctx-0dd06b7a job-1/job-73584) (logid:a98dfed6) Run VM work job: com.cloud.vm.VmWorkStop for VM 24521, job origin: 1
  513. 2017-12-01 00:00:34,115 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-28:ctx-0dd06b7a job-1/job-73584 ctx-57bc9b09) (logid:a98dfed6) Execute VM work job: com.cloud.vm.VmWorkStop{"cleanup":false,"userId":1,"accountId":1,"vmId":24521,"handlerName":"VirtualMachineManagerImpl"}
  514. 2017-12-01 00:00:34,117 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-28:ctx-0dd06b7a job-1/job-73584 ctx-57bc9b09) (logid:a98dfed6) VM is already stopped: VM[ConsoleProxy|v-24521-VM]
  515. 2017-12-01 00:00:34,117 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-28:ctx-0dd06b7a job-1/job-73584 ctx-57bc9b09) (logid:a98dfed6) Done executing VM work job: com.cloud.vm.VmWorkStop{"cleanup":false,"userId":1,"accountId":1,"vmId":24521,"handlerName":"VirtualMachineManagerImpl"}
  516. 2017-12-01 00:00:34,117 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-28:ctx-0dd06b7a job-1/job-73584 ctx-57bc9b09) (logid:a98dfed6) Complete async job-73584, jobStatus: SUCCEEDED, resultCode: 0, result: null
  517. 2017-12-01 00:00:34,117 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-29:ctx-2a1c1ee0 job-2/job-73585) (logid:32b654cc) Executing AsyncJobVO {id:73585, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStop, cmdInfo: rO0ABXNyABdjb20uY2xvdWQudm0uVm1Xb3JrU3RvcALQ4GymiWjjAgABWgAHY2xlYW51cHhyABNjb20uY2xvdWQudm0uVm1Xb3Jrn5m2VvAlZ2sCAARKAAlhY2NvdW50SWRKAAZ1c2VySWRKAAR2bUlkTAALaGFuZGxlck5hbWV0ABJMamF2YS9sYW5nL1N0cmluZzt4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfynQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:00:32 CST 2017}
  518. 2017-12-01 00:00:34,118 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-29:ctx-2a1c1ee0 job-2/job-73585) (logid:32b654cc) Run VM work job: com.cloud.vm.VmWorkStop for VM 24522, job origin: 2
  519. 2017-12-01 00:00:34,118 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-28:ctx-0dd06b7a job-1/job-73584 ctx-57bc9b09) (logid:a98dfed6) Publish async job-73584 complete on message bus
  520. 2017-12-01 00:00:34,118 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-28:ctx-0dd06b7a job-1/job-73584 ctx-57bc9b09) (logid:a98dfed6) Wake up jobs related to job-73584
  521. 2017-12-01 00:00:34,118 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-28:ctx-0dd06b7a job-1/job-73584 ctx-57bc9b09) (logid:a98dfed6) Update db status for job-73584
  522. 2017-12-01 00:00:34,118 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-29:ctx-2a1c1ee0 job-2/job-73585 ctx-c1f9d61f) (logid:32b654cc) Execute VM work job: com.cloud.vm.VmWorkStop{"cleanup":false,"userId":1,"accountId":1,"vmId":24522,"handlerName":"VirtualMachineManagerImpl"}
  523. 2017-12-01 00:00:34,119 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-28:ctx-0dd06b7a job-1/job-73584 ctx-57bc9b09) (logid:a98dfed6) Wake up jobs joined with job-73584 and disjoin all subjobs created from job- 73584
  524. 2017-12-01 00:00:34,122 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-29:ctx-2a1c1ee0 job-2/job-73585 ctx-c1f9d61f) (logid:32b654cc) VM is already stopped: VM[SecondaryStorageVm|s-24522-VM]
  525. 2017-12-01 00:00:34,122 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-29:ctx-2a1c1ee0 job-2/job-73585 ctx-c1f9d61f) (logid:32b654cc) Done executing VM work job: com.cloud.vm.VmWorkStop{"cleanup":false,"userId":1,"accountId":1,"vmId":24522,"handlerName":"VirtualMachineManagerImpl"}
  526. 2017-12-01 00:00:34,122 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-29:ctx-2a1c1ee0 job-2/job-73585 ctx-c1f9d61f) (logid:32b654cc) Complete async job-73585, jobStatus: SUCCEEDED, resultCode: 0, result: null
  527. 2017-12-01 00:00:34,123 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-8ada3a22) (logid:f458c67f) Begin cleanup expired async-jobs
  528. 2017-12-01 00:00:34,123 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-28:ctx-0dd06b7a job-1/job-73584) (logid:a98dfed6) Done with run of VM work job: com.cloud.vm.VmWorkStop for VM 24521, job origin: 1
  529. 2017-12-01 00:00:34,123 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-28:ctx-0dd06b7a job-1/job-73584) (logid:a98dfed6) Done executing com.cloud.vm.VmWorkStop for job-73584
  530. 2017-12-01 00:00:34,127 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-29:ctx-2a1c1ee0 job-2/job-73585 ctx-c1f9d61f) (logid:32b654cc) Publish async job-73585 complete on message bus
  531. 2017-12-01 00:00:34,127 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-29:ctx-2a1c1ee0 job-2/job-73585 ctx-c1f9d61f) (logid:32b654cc) Wake up jobs related to job-73585
  532. 2017-12-01 00:00:34,127 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-29:ctx-2a1c1ee0 job-2/job-73585 ctx-c1f9d61f) (logid:32b654cc) Update db status for job-73585
  533. 2017-12-01 00:00:34,129 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-8ada3a22) (logid:f458c67f) End cleanup expired async-jobs
  534. 2017-12-01 00:00:34,130 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-28:ctx-0dd06b7a job-1/job-73584) (logid:a98dfed6) Remove job-73584 from job monitoring
  535. 2017-12-01 00:00:34,131 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-29:ctx-2a1c1ee0 job-2/job-73585 ctx-c1f9d61f) (logid:32b654cc) Wake up jobs joined with job-73585 and disjoin all subjobs created from job- 73585
  536. 2017-12-01 00:00:34,136 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) VM state transitted from :Stopped to Expunging with event: ExpungeOperationvm's original host id: null new host id: null host id before state transition: null
  537. 2017-12-01 00:00:34,136 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) Destroying vm VM[ConsoleProxy|v-24521-VM]
  538. 2017-12-01 00:00:34,136 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) Cleaning up NICS
  539. 2017-12-01 00:00:34,137 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-29:ctx-2a1c1ee0 job-2/job-73585) (logid:32b654cc) Done with run of VM work job: com.cloud.vm.VmWorkStop for VM 24522, job origin: 2
  540. 2017-12-01 00:00:34,137 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-29:ctx-2a1c1ee0 job-2/job-73585) (logid:32b654cc) Done executing com.cloud.vm.VmWorkStop for job-73585
  541. 2017-12-01 00:00:34,139 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) Cleaning network for vm: 24521
  542. 2017-12-01 00:00:34,141 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-29:ctx-2a1c1ee0 job-2/job-73585) (logid:32b654cc) Remove job-73585 from job monitoring
  543. 2017-12-01 00:00:34,146 DEBUG [c.c.n.g.PublicNetworkGuru] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) public network deallocate network: networkId: 200, ip: 10.89.98.210
  544. 2017-12-01 00:00:34,148 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) VM state transitted from :Stopped to Expunging with event: ExpungeOperationvm's original host id: null new host id: null host id before state transition: null
  545. 2017-12-01 00:00:34,148 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Destroying vm VM[SecondaryStorageVm|s-24522-VM]
  546. 2017-12-01 00:00:34,148 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Cleaning up NICS
  547. 2017-12-01 00:00:34,150 DEBUG [c.c.n.g.PublicNetworkGuru] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) Deallocated nic: NicProfile[85821-24521-null-null-null
  548. 2017-12-01 00:00:34,152 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) Removed nic id=85821
  549. 2017-12-01 00:00:34,152 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Cleaning network for vm: 24522
  550. 2017-12-01 00:00:34,153 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) Revoving nic secondary ip entry ...
  551. 2017-12-01 00:00:34,159 DEBUG [c.c.n.g.PublicNetworkGuru] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) public network deallocate network: networkId: 200, ip: 10.89.98.211
  552. 2017-12-01 00:00:34,162 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) Removed nic id=85822
  553. 2017-12-01 00:00:34,162 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) Revoving nic secondary ip entry ...
  554. 2017-12-01 00:00:34,163 DEBUG [c.c.n.g.PublicNetworkGuru] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Deallocated nic: NicProfile[85824-24522-null-null-null
  555. 2017-12-01 00:00:34,166 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Removed nic id=85824
  556. 2017-12-01 00:00:34,166 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Revoving nic secondary ip entry ...
  557. 2017-12-01 00:00:34,170 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) Removed nic id=85823
  558. 2017-12-01 00:00:34,170 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) Revoving nic secondary ip entry ...
  559. 2017-12-01 00:00:34,171 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) Cleaning up hypervisor data structures (ex. SRs in XenServer) for managed storage
  560. 2017-12-01 00:00:34,172 DEBUG [o.a.c.e.o.VolumeOrchestrator] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) Cleaning storage for vm: 24521
  561. 2017-12-01 00:00:34,174 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Removed nic id=85825
  562. 2017-12-01 00:00:34,175 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Revoving nic secondary ip entry ...
  563. 2017-12-01 00:00:34,181 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Removed nic id=85826
  564. 2017-12-01 00:00:34,182 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) Expunge volume with no data store specified
  565. 2017-12-01 00:00:34,182 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Revoving nic secondary ip entry ...
  566. 2017-12-01 00:00:34,184 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) Volume 24521 is not referred anywhere, remove it from volumes table
  567. 2017-12-01 00:00:34,189 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Removed nic id=85827
  568. 2017-12-01 00:00:34,190 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) Expunged VM[ConsoleProxy|v-24521-VM]
  569. 2017-12-01 00:00:34,190 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Revoving nic secondary ip entry ...
  570. 2017-12-01 00:00:34,190 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Cleaning up hypervisor data structures (ex. SRs in XenServer) for managed storage
  571. 2017-12-01 00:00:34,192 DEBUG [o.a.c.e.o.VolumeOrchestrator] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Cleaning storage for vm: 24522
  572. 2017-12-01 00:00:34,194 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) received console proxy alert
  573. 2017-12-01 00:00:34,194 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) Console proxy creation failure, zone: Zone-Orion
  574. 2017-12-01 00:00:34,195 WARN [o.a.c.alerts] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) alertType:: 10 // dataCenterId:: 1 // podId:: null // clusterId:: null // message:: Console proxy creation failure. zone: Zone-Orion, error details: null
  575. 2017-12-01 00:00:34,202 INFO [o.a.c.s.v.VolumeServiceImpl] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Expunge volume with no data store specified
  576. 2017-12-01 00:00:34,203 INFO [o.a.c.s.v.VolumeServiceImpl] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Volume 24522 is not referred anywhere, remove it from volumes table
  577. 2017-12-01 00:00:34,209 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Expunged VM[SecondaryStorageVm|s-24522-VM]
  578. 2017-12-01 00:00:34,212 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) received secondary storage vm alert
  579. 2017-12-01 00:00:34,213 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Secondary Storage Vm creation failure, zone: Zone-Orion
  580. 2017-12-01 00:00:34,213 WARN [o.a.c.alerts] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) alertType:: 19 // dataCenterId:: 1 // podId:: null // clusterId:: null // message:: Secondary Storage Vm creation failure. zone: Zone-Orion, error details: null
  581. 2017-12-01 00:00:34,217 INFO [o.a.c.s.PremiumSecondaryStorageManagerImpl] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Primary secondary storage is not even started, wait until next turn
  582. 2017-12-01 00:00:38,371 DEBUG [c.c.s.StatsCollector] (StatsCollector-3:ctx-22924e55) (logid:d1b8dae9) AutoScaling Monitor is running...
  583. 2017-12-01 00:00:44,104 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-a53f8f0b) (logid:137e8b43) Begin cleanup expired async-jobs
  584. 2017-12-01 00:00:44,108 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-a53f8f0b) (logid:137e8b43) End cleanup expired async-jobs
  585. 2017-12-01 00:00:51,655 DEBUG [c.c.s.StatsCollector] (StatsCollector-6:ctx-5c0e8549) (logid:38e92e9b) StorageCollector is running...
  586. 2017-12-01 00:00:51,660 DEBUG [c.c.s.StatsCollector] (StatsCollector-6:ctx-5c0e8549) (logid:38e92e9b) There is no secondary storage VM for secondary storage host secondary
  587. 2017-12-01 00:00:51,661 DEBUG [c.c.h.o.r.Ovm3HypervisorGuru] (StatsCollector-6:ctx-5c0e8549) (logid:38e92e9b) getCommandHostDelegation: class com.cloud.agent.api.GetStorageStatsCommand
  588. 2017-12-01 00:00:51,661 DEBUG [c.c.h.XenServerGuru] (StatsCollector-6:ctx-5c0e8549) (logid:38e92e9b) getCommandHostDelegation: class com.cloud.agent.api.GetStorageStatsCommand
  589. 2017-12-01 00:00:51,662 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-166:ctx-a6b73c3d) (logid:f9f2dfeb) Seq 1-3458483038843866935: Executing request
  590. 2017-12-01 00:00:51,790 DEBUG [c.c.h.v.r.VmwareResource] (DirectAgent-166:ctx-a6b73c3d r6-l06-esx01.cisco.com, cmd: GetStorageStatsCommand) (logid:38e92e9b) Datastore summary info, storageId: 260fa543-e292-4f78-820c-dae49505e528, localPath: datastore-2475, poolType: VMFS, capacity: 1751809785856, free: 1750779035648, used: 1030750208
  591. 2017-12-01 00:00:51,790 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-166:ctx-a6b73c3d) (logid:38e92e9b) Seq 1-3458483038843866935: Response Received:
  592. 2017-12-01 00:00:51,790 DEBUG [c.c.a.t.Request] (StatsCollector-6:ctx-5c0e8549) (logid:38e92e9b) Seq 1-3458483038843866935: Received: { Ans: , MgmtId: 345052167237, via: 1(r6-l06-esx01.cisco.com), Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
  593. 2017-12-01 00:00:51,791 DEBUG [c.c.h.o.r.Ovm3HypervisorGuru] (StatsCollector-6:ctx-5c0e8549) (logid:38e92e9b) getCommandHostDelegation: class com.cloud.agent.api.GetStorageStatsCommand
  594. 2017-12-01 00:00:51,791 DEBUG [c.c.h.XenServerGuru] (StatsCollector-6:ctx-5c0e8549) (logid:38e92e9b) getCommandHostDelegation: class com.cloud.agent.api.GetStorageStatsCommand
  595. 2017-12-01 00:00:51,792 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-332:ctx-f71de193) (logid:78b71eb5) Seq 1-3458483038843866936: Executing request
  596. 2017-12-01 00:00:51,904 DEBUG [c.c.h.v.r.VmwareResource] (DirectAgent-332:ctx-f71de193 r6-l06-esx01.cisco.com, cmd: GetStorageStatsCommand) (logid:38e92e9b) Datastore summary info, storageId: 09198288-c7af-4569-9202-4616ec2b0b92, localPath: datastore-2476, poolType: VMFS, capacity: 137975824384, free: 47294971904, used: 90680852480
  597. 2017-12-01 00:00:51,904 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-332:ctx-f71de193) (logid:38e92e9b) Seq 1-3458483038843866936: Response Received:
  598. 2017-12-01 00:00:51,904 DEBUG [c.c.a.t.Request] (StatsCollector-6:ctx-5c0e8549) (logid:38e92e9b) Seq 1-3458483038843866936: Received: { Ans: , MgmtId: 345052167237, via: 1(r6-l06-esx01.cisco.com), Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
  599. 2017-12-01 00:00:54,104 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-bef716df) (logid:1a89d7b0) Begin cleanup expired async-jobs
  600. 2017-12-01 00:00:54,108 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-bef716df) (logid:1a89d7b0) End cleanup expired async-jobs
  601. 2017-12-01 00:00:54,338 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-d5199fe4) (logid:aea965a4) Found 0 routers to update status.
  602. 2017-12-01 00:00:54,339 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-d5199fe4) (logid:aea965a4) Found 0 VPC networks to update Redundant State.
  603. 2017-12-01 00:00:54,340 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-d5199fe4) (logid:aea965a4) Found 0 networks to update RvR status.
  604. 2017-12-01 00:00:59,353 DEBUG [o.a.c.f.j.d.VmWorkJobDaoImpl] (Vm-Operations-Cleanup-1:ctx-5723643e) (logid:90e900b9) Expunge completed work job-73220
  605. 2017-12-01 00:00:59,357 DEBUG [o.a.c.f.j.d.VmWorkJobDaoImpl] (Vm-Operations-Cleanup-1:ctx-5723643e) (logid:90e900b9) Expunge completed work job-73221
  606. 2017-12-01 00:00:59,360 DEBUG [o.a.c.f.j.d.VmWorkJobDaoImpl] (Vm-Operations-Cleanup-1:ctx-5723643e) (logid:90e900b9) Expunge completed work job-73222
  607. 2017-12-01 00:00:59,363 DEBUG [o.a.c.f.j.d.VmWorkJobDaoImpl] (Vm-Operations-Cleanup-1:ctx-5723643e) (logid:90e900b9) Expunge completed work job-73223
  608. 2017-12-01 00:00:59,366 DEBUG [o.a.c.f.j.d.VmWorkJobDaoImpl] (Vm-Operations-Cleanup-1:ctx-5723643e) (logid:90e900b9) Expunge completed work job-73224
  609. 2017-12-01 00:00:59,370 DEBUG [o.a.c.f.j.d.VmWorkJobDaoImpl] (Vm-Operations-Cleanup-1:ctx-5723643e) (logid:90e900b9) Expunge completed work job-73225
  610. 2017-12-01 00:01:00,238 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) Zone 1 is ready to launch console proxy
  611. 2017-12-01 00:01:00,238 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) Expand console proxy standby capacity for zone Zone-Orion
  612. 2017-12-01 00:01:00,239 INFO [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) No stopped console proxy is available, need to allocate a new console proxy
  613. 2017-12-01 00:01:00,240 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) Assign console proxy from a newly started instance for request from data center : 1
  614. 2017-12-01 00:01:00,248 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) Found existing network configuration for offering [Network Offering [1-Public-System-Public-Network]: Ntwk[200|Public|1]
  615. 2017-12-01 00:01:00,248 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
  616. 2017-12-01 00:01:00,254 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) Found existing network configuration for offering [Network Offering [3-Control-System-Control-Network]: Ntwk[202|Control|3]
  617. 2017-12-01 00:01:00,254 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
  618. 2017-12-01 00:01:00,259 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) Found existing network configuration for offering [Network Offering [2-Management-System-Management-Network]: Ntwk[201|Management|2]
  619. 2017-12-01 00:01:00,259 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
  620. 2017-12-01 00:01:00,268 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) Allocating entries for VM: VM[ConsoleProxy|v-24523-VM]
  621. 2017-12-01 00:01:00,269 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) Allocating nics for VM[ConsoleProxy|v-24523-VM]
  622. 2017-12-01 00:01:00,270 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) Allocating nic for vm VM[ConsoleProxy|v-24523-VM] in network Ntwk[200|Public|1] with requested profile NicProfile[0-0-null-null-null
  623. 2017-12-01 00:01:00,281 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) Allocating nic for vm VM[ConsoleProxy|v-24523-VM] in network Ntwk[202|Control|3] with requested profile null
  624. 2017-12-01 00:01:00,287 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) Allocating nic for vm VM[ConsoleProxy|v-24523-VM] in network Ntwk[201|Management|2] with requested profile null
  625. 2017-12-01 00:01:00,290 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) Allocating disks for VM[ConsoleProxy|v-24523-VM]
  626. 2017-12-01 00:01:00,294 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) Allocation completed for VM: VM[ConsoleProxy|v-24523-VM]
  627. 2017-12-01 00:01:00,296 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) received console proxy alert
  628. 2017-12-01 00:01:00,296 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) New console proxy created, zone: Zone-Orion, proxy: v-24523-VM, public IP: null, private IP: null
  629. 2017-12-01 00:01:00,304 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) Sync job-73586 execution on object VmWorkJobQueue.24523
  630. 2017-12-01 00:01:00,357 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-70516369) (logid:45c10c67) Zone 1 is ready to launch secondary storage VM
  631. 2017-12-01 00:01:00,359 INFO [o.a.c.s.PremiumSecondaryStorageManagerImpl] (secstorage-1:ctx-70516369) (logid:45c10c67) No running secondary storage vms found in datacenter id=1, starting one
  632. 2017-12-01 00:01:00,361 INFO [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-70516369) (logid:45c10c67) No stopped secondary storage vm is available, need to allocate a new secondary storage vm
  633. 2017-12-01 00:01:00,362 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-70516369) (logid:45c10c67) Assign secondary storage vm from a newly started instance for request from data center : 1
  634. 2017-12-01 00:01:00,369 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-70516369) (logid:45c10c67) Found existing network configuration for offering [Network Offering [1-Public-System-Public-Network]: Ntwk[200|Public|1]
  635. 2017-12-01 00:01:00,369 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-70516369) (logid:45c10c67) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
  636. 2017-12-01 00:01:00,374 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-70516369) (logid:45c10c67) Found existing network configuration for offering [Network Offering [3-Control-System-Control-Network]: Ntwk[202|Control|3]
  637. 2017-12-01 00:01:00,374 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-70516369) (logid:45c10c67) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
  638. 2017-12-01 00:01:00,379 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-70516369) (logid:45c10c67) Found existing network configuration for offering [Network Offering [2-Management-System-Management-Network]: Ntwk[201|Management|2]
  639. 2017-12-01 00:01:00,379 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-70516369) (logid:45c10c67) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
  640. 2017-12-01 00:01:00,384 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-70516369) (logid:45c10c67) Found existing network configuration for offering [Network Offering [4-Storage-System-Storage-Network]: Ntwk[203|Storage|4]
  641. 2017-12-01 00:01:00,384 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-70516369) (logid:45c10c67) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
  642. 2017-12-01 00:01:00,395 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-70516369) (logid:45c10c67) Allocating entries for VM: VM[SecondaryStorageVm|s-24524-VM]
  643. 2017-12-01 00:01:00,396 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-70516369) (logid:45c10c67) Allocating nics for VM[SecondaryStorageVm|s-24524-VM]
  644. 2017-12-01 00:01:00,397 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-70516369) (logid:45c10c67) Allocating nic for vm VM[SecondaryStorageVm|s-24524-VM] in network Ntwk[200|Public|1] with requested profile NicProfile[0-0-null-null-null
  645. 2017-12-01 00:01:00,406 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-70516369) (logid:45c10c67) Allocating nic for vm VM[SecondaryStorageVm|s-24524-VM] in network Ntwk[202|Control|3] with requested profile null
  646. 2017-12-01 00:01:00,413 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-70516369) (logid:45c10c67) Allocating nic for vm VM[SecondaryStorageVm|s-24524-VM] in network Ntwk[201|Management|2] with requested profile null
  647. 2017-12-01 00:01:00,417 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-70516369) (logid:45c10c67) Allocating nic for vm VM[SecondaryStorageVm|s-24524-VM] in network Ntwk[203|Storage|4] with requested profile null
  648. 2017-12-01 00:01:00,421 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-70516369) (logid:45c10c67) Allocating disks for VM[SecondaryStorageVm|s-24524-VM]
  649. 2017-12-01 00:01:00,424 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-70516369) (logid:45c10c67) Allocation completed for VM: VM[SecondaryStorageVm|s-24524-VM]
  650. 2017-12-01 00:01:00,426 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-70516369) (logid:45c10c67) received secondary storage vm alert
  651. 2017-12-01 00:01:00,426 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-70516369) (logid:45c10c67) New secondary storage vm created, zone: Zone-Orion, secStorageVm: s-24524-VM, public IP: null, private IP: null
  652. 2017-12-01 00:01:00,434 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (secstorage-1:ctx-70516369) (logid:45c10c67) Sync job-73587 execution on object VmWorkJobQueue.24524
  653. 2017-12-01 00:01:02,106 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-b874a04f) (logid:981f38fd) Execute sync-queue item: SyncQueueItemVO {id:73568, queueId: 73568, contentType: AsyncJob, contentId: 73586, lastProcessMsid: 345052167237, lastprocessNumber: 1, lastProcessTime: Fri Dec 01 00:01:02 CST 2017, created: Fri Dec 01 00:01:00 CST 2017}
  654. 2017-12-01 00:01:02,107 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-b874a04f) (logid:981f38fd) Schedule queued job-73586
  655. 2017-12-01 00:01:02,109 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-b874a04f) (logid:981f38fd) Execute sync-queue item: SyncQueueItemVO {id:73569, queueId: 73569, contentType: AsyncJob, contentId: 73587, lastProcessMsid: 345052167237, lastprocessNumber: 1, lastProcessTime: Fri Dec 01 00:01:02 CST 2017, created: Fri Dec 01 00:01:00 CST 2017}
  656. 2017-12-01 00:01:02,109 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-b874a04f) (logid:981f38fd) Schedule queued job-73587
  657. 2017-12-01 00:01:02,109 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586) (logid:99cd0059) Add job-73586 into job monitoring
  658. 2017-12-01 00:01:02,116 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586) (logid:a98dfed6) Executing AsyncJobVO {id:73586, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfy3QAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:01:00 CST 2017}
  659. 2017-12-01 00:01:02,116 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586) (logid:a98dfed6) Run VM work job: com.cloud.vm.VmWorkStart for VM 24523, job origin: 1
  660. 2017-12-01 00:01:02,117 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587) (logid:0e32ec51) Add job-73587 into job monitoring
  661. 2017-12-01 00:01:02,124 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587) (logid:32b654cc) Executing AsyncJobVO {id:73587, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfzHQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:01:00 CST 2017}
  662. 2017-12-01 00:01:02,124 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587) (logid:32b654cc) Run VM work job: com.cloud.vm.VmWorkStart for VM 24524, job origin: 2
  663. 2017-12-01 00:01:02,125 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) Execute VM work job: com.cloud.vm.VmWorkStart{"dcId":0,"userId":1,"accountId":1,"vmId":24523,"handlerName":"VirtualMachineManagerImpl"}
  664. 2017-12-01 00:01:02,125 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) Execute VM work job: com.cloud.vm.VmWorkStart{"dcId":0,"userId":1,"accountId":1,"vmId":24524,"handlerName":"VirtualMachineManagerImpl"}
  665. 2017-12-01 00:01:02,134 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
  666. 2017-12-01 00:01:02,134 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) Successfully transitioned to start state for VM[SecondaryStorageVm|s-24524-VM] reservation id = 6671327a-0e1b-4031-895b-b36d0686c96f
  667. 2017-12-01 00:01:02,134 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
  668. 2017-12-01 00:01:02,134 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) Successfully transitioned to start state for VM[ConsoleProxy|v-24523-VM] reservation id = a369db03-d4e8-411c-a5e5-28405e98a327
  669. 2017-12-01 00:01:02,135 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) Trying to deploy VM, vm has dcId: 1 and podId: null
  670. 2017-12-01 00:01:02,135 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) Deploy avoids pods: null, clusters: null, hosts: null
  671. 2017-12-01 00:01:02,136 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) Trying to deploy VM, vm has dcId: 1 and podId: null
  672. 2017-12-01 00:01:02,136 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) Deploy avoids pods: null, clusters: null, hosts: null
  673. 2017-12-01 00:01:02,138 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) Deploy avoids pods: null, clusters: null, hosts: null
  674. 2017-12-01 00:01:02,139 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@eecdd04
  675. 2017-12-01 00:01:02,139 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) Trying to allocate a host and storage pools from dc:1, pod:null,cluster:null, requested cpu: 500, requested ram: 536870912
  676. 2017-12-01 00:01:02,139 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) Is ROOT volume READY (pool already allocated)?: No
  677. 2017-12-01 00:01:02,139 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) Searching all possible resources under this Zone: 1
  678. 2017-12-01 00:01:02,139 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
  679. 2017-12-01 00:01:02,141 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) Deploy avoids pods: null, clusters: null, hosts: null
  680. 2017-12-01 00:01:02,142 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@eecdd04
  681. 2017-12-01 00:01:02,142 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) Trying to allocate a host and storage pools from dc:1, pod:null,cluster:null, requested cpu: 500, requested ram: 1073741824
  682. 2017-12-01 00:01:02,142 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) Is ROOT volume READY (pool already allocated)?: No
  683. 2017-12-01 00:01:02,142 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) Searching all possible resources under this Zone: 1
  684. 2017-12-01 00:01:02,144 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
  685. 2017-12-01 00:01:02,148 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) Checking resources in Cluster: 1 under Pod: 1
  686. 2017-12-01 00:01:02,148 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c FirstFitRoutingAllocator) (logid:32b654cc) Looking for hosts in dc: 1 pod:1 cluster:1
  687. 2017-12-01 00:01:02,150 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c FirstFitRoutingAllocator) (logid:32b654cc) FirstFitAllocator has 1 hosts to check for allocation: [Host[-1-Routing]]
  688. 2017-12-01 00:01:02,153 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c FirstFitRoutingAllocator) (logid:32b654cc) Found 1 hosts for allocation after prioritization: [Host[-1-Routing]]
  689. 2017-12-01 00:01:02,153 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c FirstFitRoutingAllocator) (logid:32b654cc) Looking for speed=500Mhz, Ram=512
  690. 2017-12-01 00:01:02,157 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) Checking resources in Cluster: 1 under Pod: 1
  691. 2017-12-01 00:01:02,157 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99 FirstFitRoutingAllocator) (logid:a98dfed6) Looking for hosts in dc: 1 pod:1 cluster:1
  692. 2017-12-01 00:01:02,158 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c FirstFitRoutingAllocator) (logid:32b654cc) Host: 1 has cpu capability (cpu:16, speed:2533) to support requested CPU: 1 and requested speed: 500
  693. 2017-12-01 00:01:02,158 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c FirstFitRoutingAllocator) (logid:32b654cc) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 536870912 , cpuOverprovisioningFactor: 1.0
  694. 2017-12-01 00:01:02,160 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c FirstFitRoutingAllocator) (logid:32b654cc) Hosts's actual total CPU: 40528 and CPU after applying overprovisioning: 40528
  695. 2017-12-01 00:01:02,160 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c FirstFitRoutingAllocator) (logid:32b654cc) Free CPU: 40528 , Requested CPU: 500
  696. 2017-12-01 00:01:02,160 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c FirstFitRoutingAllocator) (logid:32b654cc) Free RAM: 42880884736 , Requested RAM: 536870912
  697. 2017-12-01 00:01:02,160 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c FirstFitRoutingAllocator) (logid:32b654cc) Host has enough CPU and RAM available
  698. 2017-12-01 00:01:02,160 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c FirstFitRoutingAllocator) (logid:32b654cc) STATS: Can alloc CPU from host: 1, used: 0, reserved: 0, actual total: 40528, total with overprovisioning: 40528; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  699. 2017-12-01 00:01:02,160 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c FirstFitRoutingAllocator) (logid:32b654cc) STATS: Can alloc MEM from host: 1, used: 0, reserved: 0, total: 42880884736; requested mem: 536870912,alloc_from_last_host?:false ,considerReservedCapacity?: true
  700. 2017-12-01 00:01:02,160 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c FirstFitRoutingAllocator) (logid:32b654cc) Found a suitable host, adding to list: 1
  701. 2017-12-01 00:01:02,160 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c FirstFitRoutingAllocator) (logid:32b654cc) Host Allocator returning 1 suitable hosts
  702. 2017-12-01 00:01:02,161 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99 FirstFitRoutingAllocator) (logid:a98dfed6) FirstFitAllocator has 1 hosts to check for allocation: [Host[-1-Routing]]
  703. 2017-12-01 00:01:02,162 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) Checking suitable pools for volume (Id, Type): (24524,ROOT)
  704. 2017-12-01 00:01:02,162 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) We need to allocate new storagepool for this volume
  705. 2017-12-01 00:01:02,162 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) Calling StoragePoolAllocators to find suitable pools
  706. 2017-12-01 00:01:02,164 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) System VMs will use shared storage for zone id=1
  707. 2017-12-01 00:01:02,164 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) LocalStoragePoolAllocator trying to find storage pool to fit the vm
  708. 2017-12-01 00:01:02,164 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) ClusterScopeStoragePoolAllocator looking for storage pool
  709. 2017-12-01 00:01:02,164 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) Looking for pools in dc: 1 pod:1 cluster:1. Disabled pools will be ignored.
  710. 2017-12-01 00:01:02,164 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) Found pools matching tags: []
  711. 2017-12-01 00:01:02,165 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) No storage pools available for shared volume allocation, returning
  712. 2017-12-01 00:01:02,165 DEBUG [o.a.c.s.a.ZoneWideStoragePoolAllocator] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) ZoneWideStoragePoolAllocator to find storage pool
  713. 2017-12-01 00:01:02,166 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) No suitable pools found for volume: Vol[24524|vm=24524|ROOT] under cluster: 1
  714. 2017-12-01 00:01:02,166 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) No suitable pools found
  715. 2017-12-01 00:01:02,166 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) No suitable storagePools found under this Cluster: 1
  716. 2017-12-01 00:01:02,166 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) Could not find suitable Deployment Destination for this VM under any clusters, returning.
  717. 2017-12-01 00:01:02,166 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) Searching all possible resources under this Zone: 1
  718. 2017-12-01 00:01:02,167 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
  719. 2017-12-01 00:01:02,167 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99 FirstFitRoutingAllocator) (logid:a98dfed6) Found 1 hosts for allocation after prioritization: [Host[-1-Routing]]
  720. 2017-12-01 00:01:02,167 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99 FirstFitRoutingAllocator) (logid:a98dfed6) Looking for speed=500Mhz, Ram=1024
  721. 2017-12-01 00:01:02,168 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) Removing from the clusterId list these clusters from avoid set: [1]
  722. 2017-12-01 00:01:02,168 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) No clusters found after removing disabled clusters and clusters in avoid list, returning.
  723. 2017-12-01 00:01:02,175 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
  724. 2017-12-01 00:01:02,175 ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) Invocation exception, caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24524-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  725. 2017-12-01 00:01:02,175 INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) Rethrow exception com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24524-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  726. 2017-12-01 00:01:02,175 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587) (logid:32b654cc) Done with run of VM work job: com.cloud.vm.VmWorkStart for VM 24524, job origin: 2
  727. 2017-12-01 00:01:02,175 ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587) (logid:32b654cc) Unable to complete AsyncJobVO {id:73587, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfzHQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:01:00 CST 2017}, job origin:2
  728. com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24524-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  729. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
  730. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
  731. at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
  732. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  733. at java.lang.reflect.Method.invoke(Method.java:498)
  734. at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
  735. at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
  736. at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
  737. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
  738. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  739. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  740. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  741. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  742. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  743. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
  744. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  745. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  746. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  747. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  748. at java.lang.Thread.run(Thread.java:748)
  749. 2017-12-01 00:01:02,176 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587) (logid:32b654cc) Complete async job-73587, jobStatus: FAILED, resultCode: 0, result: rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdABDVW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW1NlY29uZGFyeVN0b3JhZ2VWbXxzLTI0NTI0LVZNXXVyAB5bTGphdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudDsCRio8PP0iOQIAAHhwAAAAFHNyABtqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnRhCcWaJjbdhQIABEkACmxpbmVOdW1iZXJMAA5kZWNsYXJpbmdDbGFzc3EAfgAKTAAIZmlsZU5hbWVxAH4ACkwACm1ldGhvZE5hbWVxAH4ACnhwAAADwHQAJmNvbS5jbG91ZC52bS5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsdAAeVmlydHVhbE1hY2hpbmVNYW5hZ2VySW1wbC5qYXZhdAAQb3JjaGVzdHJhdGVTdGFydHNxAH4AEQAAEgtxAH4AE3EAfgAUcQB-ABVzcQB-ABH_____dAAmc3VuLnJlZmxlY3QuR2VuZXJhdGVkTWV0aG9kQWNjZXNzb3IxOTlwdAAGaW52b2tlc3EAfgARAAAAK3QAKHN1bi5yZWZsZWN0LkRlbGVnYXRpbmdNZXRob2RBY2Nlc3NvckltcGx0ACFEZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsLmphdmFxAH4AGXNxAH4AEQAAAfJ0ABhqYXZhLmxhbmcucmVmbGVjdC5NZXRob2R0AAtNZXRob2QuamF2YXEAfgAZc3EAfgARAAAAa3QAImNvbS5jbG91ZC52bS5WbVdvcmtKb2JIYW5kbGVyUHJveHl0ABpWbVdvcmtKb2JIYW5kbGVyUHJveHkuamF2YXQAD2hhbmRsZVZtV29ya0pvYnNxAH4AEQAAEqxxAH4AE3EAfgAUcQB-ACNzcQB-ABEAAABmdAAgY29tLmNsb3VkLnZtLlZtV29ya0pvYkRpc3BhdGNoZXJ0ABhWbVdvcmtKb2JEaXNwYXRjaGVyLmphdmF0AAZydW5Kb2JzcQB-ABEAAAIqdAA_b3JnLmFwYWNoZS5jbG91ZHN0YWNrLmZyYW1ld29yay5qb2JzLmltcGwuQXN5bmNKb2JNYW5hZ2VySW1wbCQ1dAAYQXN5bmNKb2JNYW5hZ2VySW1wbC5qYXZhdAAMcnVuSW5Db250ZXh0c3EAfgARAAAAMXQAPm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZSQxdAAbTWFuYWdlZENvbnRleHRSdW5uYWJsZS5qYXZhdAADcnVuc3EAfgARAAAAOHQAQm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5EZWZhdWx0TWFuYWdlZENvbnRleHQkMXQAGkRlZmF1bHRNYW5hZ2VkQ29udGV4dC5qYXZhdAAEY2FsbHNxAH4AEQAAAGd0AEBvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0cQB-ADN0AA9jYWxsV2l0aENvbnRleHRzcQB-ABEAAAA1cQB-ADZxAH4AM3QADnJ1bldpdGhDb250ZXh0c3EAfgARAAAALnQAPG9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZXEAfgAvcQB-ADBzcQB-ABEAAAH2cQB-ACpxAH4AK3EAfgAwc3EAfgARAAAB_3QALmphdmEudXRpbC5jb25jdXJyZW50LkV4ZWN1dG9ycyRSdW5uYWJsZUFkYXB0ZXJ0AA5FeGVjdXRvcnMuamF2YXEAfgA0c3EAfgARAAABCnQAH2phdmEudXRpbC5jb25jdXJyZW50LkZ1dHVyZVRhc2t0AA9GdXR1cmVUYXNrLmphdmFxAH4AMHNxAH4AEQAABH10ACdqYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3J0ABdUaHJlYWRQb29sRXhlY3V0b3IuamF2YXQACXJ1bldvcmtlcnNxAH4AEQAAAnB0AC5qYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3IkV29ya2VycQB-AEVxAH4AMHNxAH4AEQAAAux0ABBqYXZhLmxhbmcuVGhyZWFkdAALVGhyZWFkLmphdmFxAH4AMHNyACZqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlTGlzdPwPJTG17I4QAgABTAAEbGlzdHEAfgAMeHIALGphdmEudXRpbC5Db2xsZWN0aW9ucyRVbm1vZGlmaWFibGVDb2xsZWN0aW9uGUIAgMte9x4CAAFMAAFjdAAWTGphdmEvdXRpbC9Db2xsZWN0aW9uO3hwc3IAE2phdmEudXRpbC5BcnJheUxpc3R4gdIdmcdhnQMAAUkABHNpemV4cAAAAAB3BAAAAAB4cQB-AFF4c3IAEWphdmEubGFuZy5JbnRlZ2VyEuKgpPeBhzgCAAFJAAV2YWx1ZXhyABBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAAB4cAAAEO9zcQB-AFAAAAAAdwQAAAAAeHNyAA5qYXZhLmxhbmcuTG9uZzuL5JDMjyPfAgABSgAFdmFsdWV4cQB-AFMAAAAAAAAAAXZyABdjb20uY2xvdWQuZGMuRGF0YUNlbnRlcrLxCuun53i-AgAAeHAA
  750. 2017-12-01 00:01:02,176 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99 FirstFitRoutingAllocator) (logid:a98dfed6) Host: 1 has cpu capability (cpu:16, speed:2533) to support requested CPU: 1 and requested speed: 500
  751. 2017-12-01 00:01:02,176 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99 FirstFitRoutingAllocator) (logid:a98dfed6) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  752. 2017-12-01 00:01:02,179 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99 FirstFitRoutingAllocator) (logid:a98dfed6) Hosts's actual total CPU: 40528 and CPU after applying overprovisioning: 40528
  753. 2017-12-01 00:01:02,179 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99 FirstFitRoutingAllocator) (logid:a98dfed6) Free CPU: 40528 , Requested CPU: 500
  754. 2017-12-01 00:01:02,179 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99 FirstFitRoutingAllocator) (logid:a98dfed6) Free RAM: 42880884736 , Requested RAM: 1073741824
  755. 2017-12-01 00:01:02,179 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99 FirstFitRoutingAllocator) (logid:a98dfed6) Host has enough CPU and RAM available
  756. 2017-12-01 00:01:02,179 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99 FirstFitRoutingAllocator) (logid:a98dfed6) STATS: Can alloc CPU from host: 1, used: 0, reserved: 0, actual total: 40528, total with overprovisioning: 40528; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  757. 2017-12-01 00:01:02,179 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99 FirstFitRoutingAllocator) (logid:a98dfed6) STATS: Can alloc MEM from host: 1, used: 0, reserved: 0, total: 42880884736; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  758. 2017-12-01 00:01:02,179 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99 FirstFitRoutingAllocator) (logid:a98dfed6) Found a suitable host, adding to list: 1
  759. 2017-12-01 00:01:02,179 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99 FirstFitRoutingAllocator) (logid:a98dfed6) Host Allocator returning 1 suitable hosts
  760. 2017-12-01 00:01:02,182 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) Checking suitable pools for volume (Id, Type): (24523,ROOT)
  761. 2017-12-01 00:01:02,182 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) We need to allocate new storagepool for this volume
  762. 2017-12-01 00:01:02,184 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) Calling StoragePoolAllocators to find suitable pools
  763. 2017-12-01 00:01:02,185 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) System VMs will use shared storage for zone id=1
  764. 2017-12-01 00:01:02,185 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) LocalStoragePoolAllocator trying to find storage pool to fit the vm
  765. 2017-12-01 00:01:02,185 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) ClusterScopeStoragePoolAllocator looking for storage pool
  766. 2017-12-01 00:01:02,185 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) Looking for pools in dc: 1 pod:1 cluster:1. Disabled pools will be ignored.
  767. 2017-12-01 00:01:02,185 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587) (logid:32b654cc) Publish async job-73587 complete on message bus
  768. 2017-12-01 00:01:02,185 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587) (logid:32b654cc) Wake up jobs related to job-73587
  769. 2017-12-01 00:01:02,185 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587) (logid:32b654cc) Update db status for job-73587
  770. 2017-12-01 00:01:02,186 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) Found pools matching tags: []
  771. 2017-12-01 00:01:02,186 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587) (logid:32b654cc) Wake up jobs joined with job-73587 and disjoin all subjobs created from job- 73587
  772. 2017-12-01 00:01:02,187 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) No storage pools available for shared volume allocation, returning
  773. 2017-12-01 00:01:02,187 DEBUG [o.a.c.s.a.ZoneWideStoragePoolAllocator] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) ZoneWideStoragePoolAllocator to find storage pool
  774. 2017-12-01 00:01:02,188 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) No suitable pools found for volume: Vol[24523|vm=24523|ROOT] under cluster: 1
  775. 2017-12-01 00:01:02,188 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) No suitable pools found
  776. 2017-12-01 00:01:02,188 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) No suitable storagePools found under this Cluster: 1
  777. 2017-12-01 00:01:02,189 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) Could not find suitable Deployment Destination for this VM under any clusters, returning.
  778. 2017-12-01 00:01:02,190 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) Searching all possible resources under this Zone: 1
  779. 2017-12-01 00:01:02,190 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587) (logid:32b654cc) Done executing com.cloud.vm.VmWorkStart for job-73587
  780. 2017-12-01 00:01:02,191 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
  781. 2017-12-01 00:01:02,194 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587) (logid:32b654cc) Remove job-73587 from job monitoring
  782. 2017-12-01 00:01:02,194 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) Removing from the clusterId list these clusters from avoid set: [1]
  783. 2017-12-01 00:01:02,194 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) No clusters found after removing disabled clusters and clusters in avoid list, returning.
  784. 2017-12-01 00:01:02,197 WARN [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-70516369) (logid:45c10c67) Exception while trying to start secondary storage vm
  785. com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24524-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  786. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
  787. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
  788. at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
  789. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  790. at java.lang.reflect.Method.invoke(Method.java:498)
  791. at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
  792. at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
  793. at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
  794. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
  795. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  796. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  797. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  798. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  799. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  800. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
  801. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  802. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  803. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  804. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  805. at java.lang.Thread.run(Thread.java:748)
  806. 2017-12-01 00:01:02,204 INFO [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-70516369) (logid:45c10c67) Unable to start secondary storage vm for standby capacity, vm id : 24524, will recycle it and start a new one
  807. 2017-12-01 00:01:02,204 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-70516369) (logid:45c10c67) received secondary storage vm alert
  808. 2017-12-01 00:01:02,204 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-70516369) (logid:45c10c67) Secondary Storage Vm creation failure, zone: Zone-Orion
  809. 2017-12-01 00:01:02,204 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
  810. 2017-12-01 00:01:02,204 ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) Invocation exception, caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24523-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  811. 2017-12-01 00:01:02,207 WARN [o.a.c.alerts] (secstorage-1:ctx-70516369) (logid:45c10c67) alertType:: 19 // dataCenterId:: 1 // podId:: null // clusterId:: null // message:: Secondary Storage Vm creation failure. zone: Zone-Orion, error details: null
  812. 2017-12-01 00:01:02,207 INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) Rethrow exception com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24523-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  813. 2017-12-01 00:01:02,207 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586) (logid:a98dfed6) Done with run of VM work job: com.cloud.vm.VmWorkStart for VM 24523, job origin: 1
  814. 2017-12-01 00:01:02,207 ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586) (logid:a98dfed6) Unable to complete AsyncJobVO {id:73586, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfy3QAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:01:00 CST 2017}, job origin:1
  815. com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24523-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  816. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
  817. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
  818. at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
  819. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  820. at java.lang.reflect.Method.invoke(Method.java:498)
  821. at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
  822. at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
  823. at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
  824. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
  825. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  826. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  827. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  828. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  829. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  830. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
  831. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  832. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  833. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  834. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  835. at java.lang.Thread.run(Thread.java:748)
  836. 2017-12-01 00:01:02,208 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586) (logid:a98dfed6) Complete async job-73586, jobStatus: FAILED, resultCode: 0, result: rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdAA9VW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW0NvbnNvbGVQcm94eXx2LTI0NTIzLVZNXXVyAB5bTGphdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudDsCRio8PP0iOQIAAHhwAAAAFHNyABtqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnRhCcWaJjbdhQIABEkACmxpbmVOdW1iZXJMAA5kZWNsYXJpbmdDbGFzc3EAfgAKTAAIZmlsZU5hbWVxAH4ACkwACm1ldGhvZE5hbWVxAH4ACnhwAAADwHQAJmNvbS5jbG91ZC52bS5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsdAAeVmlydHVhbE1hY2hpbmVNYW5hZ2VySW1wbC5qYXZhdAAQb3JjaGVzdHJhdGVTdGFydHNxAH4AEQAAEgtxAH4AE3EAfgAUcQB-ABVzcQB-ABH_____dAAmc3VuLnJlZmxlY3QuR2VuZXJhdGVkTWV0aG9kQWNjZXNzb3IxOTlwdAAGaW52b2tlc3EAfgARAAAAK3QAKHN1bi5yZWZsZWN0LkRlbGVnYXRpbmdNZXRob2RBY2Nlc3NvckltcGx0ACFEZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsLmphdmFxAH4AGXNxAH4AEQAAAfJ0ABhqYXZhLmxhbmcucmVmbGVjdC5NZXRob2R0AAtNZXRob2QuamF2YXEAfgAZc3EAfgARAAAAa3QAImNvbS5jbG91ZC52bS5WbVdvcmtKb2JIYW5kbGVyUHJveHl0ABpWbVdvcmtKb2JIYW5kbGVyUHJveHkuamF2YXQAD2hhbmRsZVZtV29ya0pvYnNxAH4AEQAAEqxxAH4AE3EAfgAUcQB-ACNzcQB-ABEAAABmdAAgY29tLmNsb3VkLnZtLlZtV29ya0pvYkRpc3BhdGNoZXJ0ABhWbVdvcmtKb2JEaXNwYXRjaGVyLmphdmF0AAZydW5Kb2JzcQB-ABEAAAIqdAA_b3JnLmFwYWNoZS5jbG91ZHN0YWNrLmZyYW1ld29yay5qb2JzLmltcGwuQXN5bmNKb2JNYW5hZ2VySW1wbCQ1dAAYQXN5bmNKb2JNYW5hZ2VySW1wbC5qYXZhdAAMcnVuSW5Db250ZXh0c3EAfgARAAAAMXQAPm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZSQxdAAbTWFuYWdlZENvbnRleHRSdW5uYWJsZS5qYXZhdAADcnVuc3EAfgARAAAAOHQAQm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5EZWZhdWx0TWFuYWdlZENvbnRleHQkMXQAGkRlZmF1bHRNYW5hZ2VkQ29udGV4dC5qYXZhdAAEY2FsbHNxAH4AEQAAAGd0AEBvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0cQB-ADN0AA9jYWxsV2l0aENvbnRleHRzcQB-ABEAAAA1cQB-ADZxAH4AM3QADnJ1bldpdGhDb250ZXh0c3EAfgARAAAALnQAPG9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZXEAfgAvcQB-ADBzcQB-ABEAAAH2cQB-ACpxAH4AK3EAfgAwc3EAfgARAAAB_3QALmphdmEudXRpbC5jb25jdXJyZW50LkV4ZWN1dG9ycyRSdW5uYWJsZUFkYXB0ZXJ0AA5FeGVjdXRvcnMuamF2YXEAfgA0c3EAfgARAAABCnQAH2phdmEudXRpbC5jb25jdXJyZW50LkZ1dHVyZVRhc2t0AA9GdXR1cmVUYXNrLmphdmFxAH4AMHNxAH4AEQAABH10ACdqYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3J0ABdUaHJlYWRQb29sRXhlY3V0b3IuamF2YXQACXJ1bldvcmtlcnNxAH4AEQAAAnB0AC5qYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3IkV29ya2VycQB-AEVxAH4AMHNxAH4AEQAAAux0ABBqYXZhLmxhbmcuVGhyZWFkdAALVGhyZWFkLmphdmFxAH4AMHNyACZqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlTGlzdPwPJTG17I4QAgABTAAEbGlzdHEAfgAMeHIALGphdmEudXRpbC5Db2xsZWN0aW9ucyRVbm1vZGlmaWFibGVDb2xsZWN0aW9uGUIAgMte9x4CAAFMAAFjdAAWTGphdmEvdXRpbC9Db2xsZWN0aW9uO3hwc3IAE2phdmEudXRpbC5BcnJheUxpc3R4gdIdmcdhnQMAAUkABHNpemV4cAAAAAB3BAAAAAB4cQB-AFF4c3IAEWphdmEubGFuZy5JbnRlZ2VyEuKgpPeBhzgCAAFJAAV2YWx1ZXhyABBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAAB4cAAAEO9zcQB-AFAAAAAAdwQAAAAAeHNyAA5qYXZhLmxhbmcuTG9uZzuL5JDMjyPfAgABSgAFdmFsdWV4cQB-AFMAAAAAAAAAAXZyABdjb20uY2xvdWQuZGMuRGF0YUNlbnRlcrLxCuun53i-AgAAeHAA
  837. 2017-12-01 00:01:02,210 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586) (logid:a98dfed6) Publish async job-73586 complete on message bus
  838. 2017-12-01 00:01:02,210 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586) (logid:a98dfed6) Wake up jobs related to job-73586
  839. 2017-12-01 00:01:02,210 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586) (logid:a98dfed6) Update db status for job-73586
  840. 2017-12-01 00:01:02,212 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586) (logid:a98dfed6) Wake up jobs joined with job-73586 and disjoin all subjobs created from job- 73586
  841. 2017-12-01 00:01:02,218 INFO [o.a.c.s.PremiumSecondaryStorageManagerImpl] (secstorage-1:ctx-70516369) (logid:45c10c67) Primary secondary storage is not even started, wait until next turn
  842. 2017-12-01 00:01:02,219 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586) (logid:a98dfed6) Done executing com.cloud.vm.VmWorkStart for job-73586
  843. 2017-12-01 00:01:02,220 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586) (logid:a98dfed6) Remove job-73586 from job monitoring
  844. 2017-12-01 00:01:02,224 WARN [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) Exception while trying to start console proxy
  845. com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24523-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  846. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
  847. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
  848. at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
  849. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  850. at java.lang.reflect.Method.invoke(Method.java:498)
  851. at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
  852. at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
  853. at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
  854. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
  855. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  856. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  857. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  858. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  859. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  860. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
  861. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  862. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  863. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  864. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  865. at java.lang.Thread.run(Thread.java:748)
  866. 2017-12-01 00:01:02,225 INFO [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) Unable to start console proxy vm for standby capacity, vm id : 24523, will recycle it and start a new one
  867. 2017-12-01 00:01:02,225 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) received console proxy alert
  868. 2017-12-01 00:01:02,225 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) Console proxy creation failure, zone: Zone-Orion
  869. 2017-12-01 00:01:02,226 WARN [o.a.c.alerts] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) alertType:: 10 // dataCenterId:: 1 // podId:: null // clusterId:: null // message:: Console proxy creation failure. zone: Zone-Orion, error details: null
  870. 2017-12-01 00:01:04,104 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-50d3140a) (logid:9d2a2c45) Begin cleanup expired async-jobs
  871. 2017-12-01 00:01:04,108 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-50d3140a) (logid:9d2a2c45) End cleanup expired async-jobs
  872. 2017-12-01 00:01:14,104 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-9ca97c54) (logid:75ba80b2) Begin cleanup expired async-jobs
  873. 2017-12-01 00:01:14,108 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-9ca97c54) (logid:75ba80b2) End cleanup expired async-jobs
  874. 2017-12-01 00:01:15,528 DEBUG [c.c.s.StatsCollector] (StatsCollector-4:ctx-7cd69cd4) (logid:232eb4d4) HostStatsCollector is running...
  875. 2017-12-01 00:01:15,534 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-42:ctx-e8e92b42) (logid:71254e27) Seq 1-3458483038843866937: Executing request
  876. 2017-12-01 00:01:15,644 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-42:ctx-e8e92b42) (logid:232eb4d4) Seq 1-3458483038843866937: Response Received:
  877. 2017-12-01 00:01:15,644 DEBUG [c.c.a.t.Request] (StatsCollector-4:ctx-7cd69cd4) (logid:232eb4d4) Seq 1-3458483038843866937: Received: { Ans: , MgmtId: 345052167237, via: 1(r6-l06-esx01.cisco.com), Ver: v1, Flags: 10, { GetHostStatsAnswer } }
  878. 2017-12-01 00:01:24,104 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-d31f4a2b) (logid:da9dae68) Begin cleanup expired async-jobs
  879. 2017-12-01 00:01:24,108 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-d31f4a2b) (logid:da9dae68) End cleanup expired async-jobs
  880. 2017-12-01 00:01:24,338 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-2d0fabab) (logid:ed9c2ba7) Found 0 routers to update status.
  881. 2017-12-01 00:01:24,339 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-2d0fabab) (logid:ed9c2ba7) Found 0 VPC networks to update Redundant State.
  882. 2017-12-01 00:01:24,339 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-2d0fabab) (logid:ed9c2ba7) Found 0 networks to update RvR status.
  883. 2017-12-01 00:01:30,238 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) Zone 1 is ready to launch console proxy
  884. 2017-12-01 00:01:30,238 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) Expand console proxy standby capacity for zone Zone-Orion
  885. 2017-12-01 00:01:30,239 INFO [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) Found a stopped console proxy, starting it. Vm id : 24523
  886. 2017-12-01 00:01:30,245 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) Sync job-73588 execution on object VmWorkJobQueue.24523
  887. 2017-12-01 00:01:30,355 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Zone 1 is ready to launch secondary storage VM
  888. 2017-12-01 00:01:30,357 INFO [o.a.c.s.PremiumSecondaryStorageManagerImpl] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) No running secondary storage vms found in datacenter id=1, starting one
  889. 2017-12-01 00:01:30,360 INFO [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Found a stopped secondary storage vm, starting it. Vm id : 24524
  890. 2017-12-01 00:01:30,366 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Sync job-73589 execution on object VmWorkJobQueue.24524
  891. 2017-12-01 00:01:32,107 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-bc5f8d7d) (logid:7cdbe2b3) Execute sync-queue item: SyncQueueItemVO {id:73570, queueId: 73568, contentType: AsyncJob, contentId: 73588, lastProcessMsid: 345052167237, lastprocessNumber: 2, lastProcessTime: Fri Dec 01 00:01:32 CST 2017, created: Fri Dec 01 00:01:30 CST 2017}
  892. 2017-12-01 00:01:32,108 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-bc5f8d7d) (logid:7cdbe2b3) Schedule queued job-73588
  893. 2017-12-01 00:01:32,110 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-bc5f8d7d) (logid:7cdbe2b3) Execute sync-queue item: SyncQueueItemVO {id:73571, queueId: 73569, contentType: AsyncJob, contentId: 73589, lastProcessMsid: 345052167237, lastprocessNumber: 2, lastProcessTime: Fri Dec 01 00:01:32 CST 2017, created: Fri Dec 01 00:01:30 CST 2017}
  894. 2017-12-01 00:01:32,111 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-bc5f8d7d) (logid:7cdbe2b3) Schedule queued job-73589
  895. 2017-12-01 00:01:32,111 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588) (logid:057f7845) Add job-73588 into job monitoring
  896. 2017-12-01 00:01:32,116 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589) (logid:7cff668e) Add job-73589 into job monitoring
  897. 2017-12-01 00:01:32,118 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588) (logid:a98dfed6) Executing AsyncJobVO {id:73588, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfy3QAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:01:30 CST 2017}
  898. 2017-12-01 00:01:32,118 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588) (logid:a98dfed6) Run VM work job: com.cloud.vm.VmWorkStart for VM 24523, job origin: 1
  899. 2017-12-01 00:01:32,119 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) Execute VM work job: com.cloud.vm.VmWorkStart{"dcId":0,"userId":1,"accountId":1,"vmId":24523,"handlerName":"VirtualMachineManagerImpl"}
  900. 2017-12-01 00:01:32,123 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589) (logid:32b654cc) Executing AsyncJobVO {id:73589, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfzHQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:01:30 CST 2017}
  901. 2017-12-01 00:01:32,123 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589) (logid:32b654cc) Run VM work job: com.cloud.vm.VmWorkStart for VM 24524, job origin: 2
  902. 2017-12-01 00:01:32,124 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) Execute VM work job: com.cloud.vm.VmWorkStart{"dcId":0,"userId":1,"accountId":1,"vmId":24524,"handlerName":"VirtualMachineManagerImpl"}
  903. 2017-12-01 00:01:32,125 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
  904. 2017-12-01 00:01:32,125 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) Successfully transitioned to start state for VM[ConsoleProxy|v-24523-VM] reservation id = 6f6846fc-071a-4775-8ab6-da96ff7ea524
  905. 2017-12-01 00:01:32,126 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) Trying to deploy VM, vm has dcId: 1 and podId: null
  906. 2017-12-01 00:01:32,126 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) Deploy avoids pods: null, clusters: null, hosts: null
  907. 2017-12-01 00:01:32,129 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) Deploy avoids pods: null, clusters: null, hosts: null
  908. 2017-12-01 00:01:32,129 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
  909. 2017-12-01 00:01:32,129 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) Successfully transitioned to start state for VM[SecondaryStorageVm|s-24524-VM] reservation id = cccb8799-5498-408e-9060-1d70f12124e8
  910. 2017-12-01 00:01:32,130 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@eecdd04
  911. 2017-12-01 00:01:32,130 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) Trying to allocate a host and storage pools from dc:1, pod:null,cluster:null, requested cpu: 500, requested ram: 1073741824
  912. 2017-12-01 00:01:32,130 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) Is ROOT volume READY (pool already allocated)?: No
  913. 2017-12-01 00:01:32,130 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) Searching all possible resources under this Zone: 1
  914. 2017-12-01 00:01:32,130 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
  915. 2017-12-01 00:01:32,130 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) Trying to deploy VM, vm has dcId: 1 and podId: null
  916. 2017-12-01 00:01:32,130 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) Deploy avoids pods: null, clusters: null, hosts: null
  917. 2017-12-01 00:01:32,133 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) Deploy avoids pods: null, clusters: null, hosts: null
  918. 2017-12-01 00:01:32,134 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@eecdd04
  919. 2017-12-01 00:01:32,134 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) Trying to allocate a host and storage pools from dc:1, pod:null,cluster:null, requested cpu: 500, requested ram: 536870912
  920. 2017-12-01 00:01:32,134 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) Is ROOT volume READY (pool already allocated)?: No
  921. 2017-12-01 00:01:32,134 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) Searching all possible resources under this Zone: 1
  922. 2017-12-01 00:01:32,135 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
  923. 2017-12-01 00:01:32,139 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) Checking resources in Cluster: 1 under Pod: 1
  924. 2017-12-01 00:01:32,139 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925 FirstFitRoutingAllocator) (logid:a98dfed6) Looking for hosts in dc: 1 pod:1 cluster:1
  925. 2017-12-01 00:01:32,141 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925 FirstFitRoutingAllocator) (logid:a98dfed6) FirstFitAllocator has 1 hosts to check for allocation: [Host[-1-Routing]]
  926. 2017-12-01 00:01:32,143 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) Checking resources in Cluster: 1 under Pod: 1
  927. 2017-12-01 00:01:32,143 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d FirstFitRoutingAllocator) (logid:32b654cc) Looking for hosts in dc: 1 pod:1 cluster:1
  928. 2017-12-01 00:01:32,144 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925 FirstFitRoutingAllocator) (logid:a98dfed6) Found 1 hosts for allocation after prioritization: [Host[-1-Routing]]
  929. 2017-12-01 00:01:32,144 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925 FirstFitRoutingAllocator) (logid:a98dfed6) Looking for speed=500Mhz, Ram=1024
  930. 2017-12-01 00:01:32,144 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d FirstFitRoutingAllocator) (logid:32b654cc) FirstFitAllocator has 1 hosts to check for allocation: [Host[-1-Routing]]
  931. 2017-12-01 00:01:32,148 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d FirstFitRoutingAllocator) (logid:32b654cc) Found 1 hosts for allocation after prioritization: [Host[-1-Routing]]
  932. 2017-12-01 00:01:32,148 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d FirstFitRoutingAllocator) (logid:32b654cc) Looking for speed=500Mhz, Ram=512
  933. 2017-12-01 00:01:32,149 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925 FirstFitRoutingAllocator) (logid:a98dfed6) Host: 1 has cpu capability (cpu:16, speed:2533) to support requested CPU: 1 and requested speed: 500
  934. 2017-12-01 00:01:32,149 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925 FirstFitRoutingAllocator) (logid:a98dfed6) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  935. 2017-12-01 00:01:32,150 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925 FirstFitRoutingAllocator) (logid:a98dfed6) Hosts's actual total CPU: 40528 and CPU after applying overprovisioning: 40528
  936. 2017-12-01 00:01:32,150 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925 FirstFitRoutingAllocator) (logid:a98dfed6) Free CPU: 40528 , Requested CPU: 500
  937. 2017-12-01 00:01:32,150 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925 FirstFitRoutingAllocator) (logid:a98dfed6) Free RAM: 42880884736 , Requested RAM: 1073741824
  938. 2017-12-01 00:01:32,150 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925 FirstFitRoutingAllocator) (logid:a98dfed6) Host has enough CPU and RAM available
  939. 2017-12-01 00:01:32,150 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925 FirstFitRoutingAllocator) (logid:a98dfed6) STATS: Can alloc CPU from host: 1, used: 0, reserved: 0, actual total: 40528, total with overprovisioning: 40528; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  940. 2017-12-01 00:01:32,150 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925 FirstFitRoutingAllocator) (logid:a98dfed6) STATS: Can alloc MEM from host: 1, used: 0, reserved: 0, total: 42880884736; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  941. 2017-12-01 00:01:32,150 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925 FirstFitRoutingAllocator) (logid:a98dfed6) Found a suitable host, adding to list: 1
  942. 2017-12-01 00:01:32,150 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925 FirstFitRoutingAllocator) (logid:a98dfed6) Host Allocator returning 1 suitable hosts
  943. 2017-12-01 00:01:32,152 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) Checking suitable pools for volume (Id, Type): (24523,ROOT)
  944. 2017-12-01 00:01:32,152 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) We need to allocate new storagepool for this volume
  945. 2017-12-01 00:01:32,153 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d FirstFitRoutingAllocator) (logid:32b654cc) Host: 1 has cpu capability (cpu:16, speed:2533) to support requested CPU: 1 and requested speed: 500
  946. 2017-12-01 00:01:32,153 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d FirstFitRoutingAllocator) (logid:32b654cc) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 536870912 , cpuOverprovisioningFactor: 1.0
  947. 2017-12-01 00:01:32,153 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) Calling StoragePoolAllocators to find suitable pools
  948. 2017-12-01 00:01:32,153 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) System VMs will use shared storage for zone id=1
  949. 2017-12-01 00:01:32,153 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) LocalStoragePoolAllocator trying to find storage pool to fit the vm
  950. 2017-12-01 00:01:32,153 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) ClusterScopeStoragePoolAllocator looking for storage pool
  951. 2017-12-01 00:01:32,154 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) Looking for pools in dc: 1 pod:1 cluster:1. Disabled pools will be ignored.
  952. 2017-12-01 00:01:32,154 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) Found pools matching tags: []
  953. 2017-12-01 00:01:32,154 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d FirstFitRoutingAllocator) (logid:32b654cc) Hosts's actual total CPU: 40528 and CPU after applying overprovisioning: 40528
  954. 2017-12-01 00:01:32,154 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d FirstFitRoutingAllocator) (logid:32b654cc) Free CPU: 40528 , Requested CPU: 500
  955. 2017-12-01 00:01:32,154 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d FirstFitRoutingAllocator) (logid:32b654cc) Free RAM: 42880884736 , Requested RAM: 536870912
  956. 2017-12-01 00:01:32,154 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d FirstFitRoutingAllocator) (logid:32b654cc) Host has enough CPU and RAM available
  957. 2017-12-01 00:01:32,154 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d FirstFitRoutingAllocator) (logid:32b654cc) STATS: Can alloc CPU from host: 1, used: 0, reserved: 0, actual total: 40528, total with overprovisioning: 40528; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  958. 2017-12-01 00:01:32,154 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d FirstFitRoutingAllocator) (logid:32b654cc) STATS: Can alloc MEM from host: 1, used: 0, reserved: 0, total: 42880884736; requested mem: 536870912,alloc_from_last_host?:false ,considerReservedCapacity?: true
  959. 2017-12-01 00:01:32,154 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d FirstFitRoutingAllocator) (logid:32b654cc) Found a suitable host, adding to list: 1
  960. 2017-12-01 00:01:32,154 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d FirstFitRoutingAllocator) (logid:32b654cc) Host Allocator returning 1 suitable hosts
  961. 2017-12-01 00:01:32,154 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) No storage pools available for shared volume allocation, returning
  962. 2017-12-01 00:01:32,154 DEBUG [o.a.c.s.a.ZoneWideStoragePoolAllocator] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) ZoneWideStoragePoolAllocator to find storage pool
  963. 2017-12-01 00:01:32,155 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) No suitable pools found for volume: Vol[24523|vm=24523|ROOT] under cluster: 1
  964. 2017-12-01 00:01:32,155 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) No suitable pools found
  965. 2017-12-01 00:01:32,155 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) No suitable storagePools found under this Cluster: 1
  966. 2017-12-01 00:01:32,156 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) Could not find suitable Deployment Destination for this VM under any clusters, returning.
  967. 2017-12-01 00:01:32,156 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) Searching all possible resources under this Zone: 1
  968. 2017-12-01 00:01:32,156 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) Checking suitable pools for volume (Id, Type): (24524,ROOT)
  969. 2017-12-01 00:01:32,156 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) We need to allocate new storagepool for this volume
  970. 2017-12-01 00:01:32,156 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
  971. 2017-12-01 00:01:32,157 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) Calling StoragePoolAllocators to find suitable pools
  972. 2017-12-01 00:01:32,157 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) Removing from the clusterId list these clusters from avoid set: [1]
  973. 2017-12-01 00:01:32,157 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) System VMs will use shared storage for zone id=1
  974. 2017-12-01 00:01:32,157 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) LocalStoragePoolAllocator trying to find storage pool to fit the vm
  975. 2017-12-01 00:01:32,157 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) ClusterScopeStoragePoolAllocator looking for storage pool
  976. 2017-12-01 00:01:32,157 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) Looking for pools in dc: 1 pod:1 cluster:1. Disabled pools will be ignored.
  977. 2017-12-01 00:01:32,158 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) No clusters found after removing disabled clusters and clusters in avoid list, returning.
  978. 2017-12-01 00:01:32,158 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) Found pools matching tags: []
  979. 2017-12-01 00:01:32,158 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) No storage pools available for shared volume allocation, returning
  980. 2017-12-01 00:01:32,158 DEBUG [o.a.c.s.a.ZoneWideStoragePoolAllocator] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) ZoneWideStoragePoolAllocator to find storage pool
  981. 2017-12-01 00:01:32,159 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) No suitable pools found for volume: Vol[24524|vm=24524|ROOT] under cluster: 1
  982. 2017-12-01 00:01:32,159 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) No suitable pools found
  983. 2017-12-01 00:01:32,159 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) No suitable storagePools found under this Cluster: 1
  984. 2017-12-01 00:01:32,160 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) Could not find suitable Deployment Destination for this VM under any clusters, returning.
  985. 2017-12-01 00:01:32,160 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) Searching all possible resources under this Zone: 1
  986. 2017-12-01 00:01:32,160 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
  987. 2017-12-01 00:01:32,161 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) Removing from the clusterId list these clusters from avoid set: [1]
  988. 2017-12-01 00:01:32,161 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) No clusters found after removing disabled clusters and clusters in avoid list, returning.
  989. 2017-12-01 00:01:32,165 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
  990. 2017-12-01 00:01:32,165 ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) Invocation exception, caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24523-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  991. 2017-12-01 00:01:32,167 INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) Rethrow exception com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24523-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  992. 2017-12-01 00:01:32,167 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588) (logid:a98dfed6) Done with run of VM work job: com.cloud.vm.VmWorkStart for VM 24523, job origin: 1
  993. 2017-12-01 00:01:32,167 ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588) (logid:a98dfed6) Unable to complete AsyncJobVO {id:73588, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfy3QAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:01:30 CST 2017}, job origin:1
  994. com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24523-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  995. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
  996. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
  997. at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
  998. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  999. at java.lang.reflect.Method.invoke(Method.java:498)
  1000. at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
  1001. at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
  1002. at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
  1003. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
  1004. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  1005. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  1006. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  1007. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  1008. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  1009. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
  1010. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  1011. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  1012. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  1013. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  1014. at java.lang.Thread.run(Thread.java:748)
  1015. 2017-12-01 00:01:32,168 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588) (logid:a98dfed6) Complete async job-73588, jobStatus: FAILED, resultCode: 0, result: rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdAA9VW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW0NvbnNvbGVQcm94eXx2LTI0NTIzLVZNXXVyAB5bTGphdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudDsCRio8PP0iOQIAAHhwAAAAFHNyABtqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnRhCcWaJjbdhQIABEkACmxpbmVOdW1iZXJMAA5kZWNsYXJpbmdDbGFzc3EAfgAKTAAIZmlsZU5hbWVxAH4ACkwACm1ldGhvZE5hbWVxAH4ACnhwAAADwHQAJmNvbS5jbG91ZC52bS5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsdAAeVmlydHVhbE1hY2hpbmVNYW5hZ2VySW1wbC5qYXZhdAAQb3JjaGVzdHJhdGVTdGFydHNxAH4AEQAAEgtxAH4AE3EAfgAUcQB-ABVzcQB-ABH_____dAAmc3VuLnJlZmxlY3QuR2VuZXJhdGVkTWV0aG9kQWNjZXNzb3IxOTlwdAAGaW52b2tlc3EAfgARAAAAK3QAKHN1bi5yZWZsZWN0LkRlbGVnYXRpbmdNZXRob2RBY2Nlc3NvckltcGx0ACFEZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsLmphdmFxAH4AGXNxAH4AEQAAAfJ0ABhqYXZhLmxhbmcucmVmbGVjdC5NZXRob2R0AAtNZXRob2QuamF2YXEAfgAZc3EAfgARAAAAa3QAImNvbS5jbG91ZC52bS5WbVdvcmtKb2JIYW5kbGVyUHJveHl0ABpWbVdvcmtKb2JIYW5kbGVyUHJveHkuamF2YXQAD2hhbmRsZVZtV29ya0pvYnNxAH4AEQAAEqxxAH4AE3EAfgAUcQB-ACNzcQB-ABEAAABmdAAgY29tLmNsb3VkLnZtLlZtV29ya0pvYkRpc3BhdGNoZXJ0ABhWbVdvcmtKb2JEaXNwYXRjaGVyLmphdmF0AAZydW5Kb2JzcQB-ABEAAAIqdAA_b3JnLmFwYWNoZS5jbG91ZHN0YWNrLmZyYW1ld29yay5qb2JzLmltcGwuQXN5bmNKb2JNYW5hZ2VySW1wbCQ1dAAYQXN5bmNKb2JNYW5hZ2VySW1wbC5qYXZhdAAMcnVuSW5Db250ZXh0c3EAfgARAAAAMXQAPm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZSQxdAAbTWFuYWdlZENvbnRleHRSdW5uYWJsZS5qYXZhdAADcnVuc3EAfgARAAAAOHQAQm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5EZWZhdWx0TWFuYWdlZENvbnRleHQkMXQAGkRlZmF1bHRNYW5hZ2VkQ29udGV4dC5qYXZhdAAEY2FsbHNxAH4AEQAAAGd0AEBvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0cQB-ADN0AA9jYWxsV2l0aENvbnRleHRzcQB-ABEAAAA1cQB-ADZxAH4AM3QADnJ1bldpdGhDb250ZXh0c3EAfgARAAAALnQAPG9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZXEAfgAvcQB-ADBzcQB-ABEAAAH2cQB-ACpxAH4AK3EAfgAwc3EAfgARAAAB_3QALmphdmEudXRpbC5jb25jdXJyZW50LkV4ZWN1dG9ycyRSdW5uYWJsZUFkYXB0ZXJ0AA5FeGVjdXRvcnMuamF2YXEAfgA0c3EAfgARAAABCnQAH2phdmEudXRpbC5jb25jdXJyZW50LkZ1dHVyZVRhc2t0AA9GdXR1cmVUYXNrLmphdmFxAH4AMHNxAH4AEQAABH10ACdqYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3J0ABdUaHJlYWRQb29sRXhlY3V0b3IuamF2YXQACXJ1bldvcmtlcnNxAH4AEQAAAnB0AC5qYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3IkV29ya2VycQB-AEVxAH4AMHNxAH4AEQAAAux0ABBqYXZhLmxhbmcuVGhyZWFkdAALVGhyZWFkLmphdmFxAH4AMHNyACZqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlTGlzdPwPJTG17I4QAgABTAAEbGlzdHEAfgAMeHIALGphdmEudXRpbC5Db2xsZWN0aW9ucyRVbm1vZGlmaWFibGVDb2xsZWN0aW9uGUIAgMte9x4CAAFMAAFjdAAWTGphdmEvdXRpbC9Db2xsZWN0aW9uO3hwc3IAE2phdmEudXRpbC5BcnJheUxpc3R4gdIdmcdhnQMAAUkABHNpemV4cAAAAAB3BAAAAAB4cQB-AFF4c3IAEWphdmEubGFuZy5JbnRlZ2VyEuKgpPeBhzgCAAFJAAV2YWx1ZXhyABBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAAB4cAAAEO9zcQB-AFAAAAAAdwQAAAAAeHNyAA5qYXZhLmxhbmcuTG9uZzuL5JDMjyPfAgABSgAFdmFsdWV4cQB-AFMAAAAAAAAAAXZyABdjb20uY2xvdWQuZGMuRGF0YUNlbnRlcrLxCuun53i-AgAAeHAA
  1016. 2017-12-01 00:01:32,169 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588) (logid:a98dfed6) Publish async job-73588 complete on message bus
  1017. 2017-12-01 00:01:32,169 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588) (logid:a98dfed6) Wake up jobs related to job-73588
  1018. 2017-12-01 00:01:32,169 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588) (logid:a98dfed6) Update db status for job-73588
  1019. 2017-12-01 00:01:32,174 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588) (logid:a98dfed6) Wake up jobs joined with job-73588 and disjoin all subjobs created from job- 73588
  1020. 2017-12-01 00:01:32,178 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
  1021. 2017-12-01 00:01:32,178 ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) Invocation exception, caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24524-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  1022. 2017-12-01 00:01:32,178 INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) Rethrow exception com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24524-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  1023. 2017-12-01 00:01:32,178 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589) (logid:32b654cc) Done with run of VM work job: com.cloud.vm.VmWorkStart for VM 24524, job origin: 2
  1024. 2017-12-01 00:01:32,178 ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589) (logid:32b654cc) Unable to complete AsyncJobVO {id:73589, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfzHQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:01:30 CST 2017}, job origin:2
  1025. com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24524-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  1026. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
  1027. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
  1028. at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
  1029. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  1030. at java.lang.reflect.Method.invoke(Method.java:498)
  1031. at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
  1032. at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
  1033. at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
  1034. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
  1035. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  1036. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  1037. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  1038. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  1039. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  1040. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
  1041. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  1042. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  1043. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  1044. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  1045. at java.lang.Thread.run(Thread.java:748)
  1046. 2017-12-01 00:01:32,178 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588) (logid:a98dfed6) Done executing com.cloud.vm.VmWorkStart for job-73588
  1047. 2017-12-01 00:01:32,178 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589) (logid:32b654cc) Complete async job-73589, jobStatus: FAILED, resultCode: 0, result: rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdABDVW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW1NlY29uZGFyeVN0b3JhZ2VWbXxzLTI0NTI0LVZNXXVyAB5bTGphdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudDsCRio8PP0iOQIAAHhwAAAAFHNyABtqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnRhCcWaJjbdhQIABEkACmxpbmVOdW1iZXJMAA5kZWNsYXJpbmdDbGFzc3EAfgAKTAAIZmlsZU5hbWVxAH4ACkwACm1ldGhvZE5hbWVxAH4ACnhwAAADwHQAJmNvbS5jbG91ZC52bS5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsdAAeVmlydHVhbE1hY2hpbmVNYW5hZ2VySW1wbC5qYXZhdAAQb3JjaGVzdHJhdGVTdGFydHNxAH4AEQAAEgtxAH4AE3EAfgAUcQB-ABVzcQB-ABH_____dAAmc3VuLnJlZmxlY3QuR2VuZXJhdGVkTWV0aG9kQWNjZXNzb3IxOTlwdAAGaW52b2tlc3EAfgARAAAAK3QAKHN1bi5yZWZsZWN0LkRlbGVnYXRpbmdNZXRob2RBY2Nlc3NvckltcGx0ACFEZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsLmphdmFxAH4AGXNxAH4AEQAAAfJ0ABhqYXZhLmxhbmcucmVmbGVjdC5NZXRob2R0AAtNZXRob2QuamF2YXEAfgAZc3EAfgARAAAAa3QAImNvbS5jbG91ZC52bS5WbVdvcmtKb2JIYW5kbGVyUHJveHl0ABpWbVdvcmtKb2JIYW5kbGVyUHJveHkuamF2YXQAD2hhbmRsZVZtV29ya0pvYnNxAH4AEQAAEqxxAH4AE3EAfgAUcQB-ACNzcQB-ABEAAABmdAAgY29tLmNsb3VkLnZtLlZtV29ya0pvYkRpc3BhdGNoZXJ0ABhWbVdvcmtKb2JEaXNwYXRjaGVyLmphdmF0AAZydW5Kb2JzcQB-ABEAAAIqdAA_b3JnLmFwYWNoZS5jbG91ZHN0YWNrLmZyYW1ld29yay5qb2JzLmltcGwuQXN5bmNKb2JNYW5hZ2VySW1wbCQ1dAAYQXN5bmNKb2JNYW5hZ2VySW1wbC5qYXZhdAAMcnVuSW5Db250ZXh0c3EAfgARAAAAMXQAPm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZSQxdAAbTWFuYWdlZENvbnRleHRSdW5uYWJsZS5qYXZhdAADcnVuc3EAfgARAAAAOHQAQm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5EZWZhdWx0TWFuYWdlZENvbnRleHQkMXQAGkRlZmF1bHRNYW5hZ2VkQ29udGV4dC5qYXZhdAAEY2FsbHNxAH4AEQAAAGd0AEBvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0cQB-ADN0AA9jYWxsV2l0aENvbnRleHRzcQB-ABEAAAA1cQB-ADZxAH4AM3QADnJ1bldpdGhDb250ZXh0c3EAfgARAAAALnQAPG9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZXEAfgAvcQB-ADBzcQB-ABEAAAH2cQB-ACpxAH4AK3EAfgAwc3EAfgARAAAB_3QALmphdmEudXRpbC5jb25jdXJyZW50LkV4ZWN1dG9ycyRSdW5uYWJsZUFkYXB0ZXJ0AA5FeGVjdXRvcnMuamF2YXEAfgA0c3EAfgARAAABCnQAH2phdmEudXRpbC5jb25jdXJyZW50LkZ1dHVyZVRhc2t0AA9GdXR1cmVUYXNrLmphdmFxAH4AMHNxAH4AEQAABH10ACdqYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3J0ABdUaHJlYWRQb29sRXhlY3V0b3IuamF2YXQACXJ1bldvcmtlcnNxAH4AEQAAAnB0AC5qYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3IkV29ya2VycQB-AEVxAH4AMHNxAH4AEQAAAux0ABBqYXZhLmxhbmcuVGhyZWFkdAALVGhyZWFkLmphdmFxAH4AMHNyACZqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlTGlzdPwPJTG17I4QAgABTAAEbGlzdHEAfgAMeHIALGphdmEudXRpbC5Db2xsZWN0aW9ucyRVbm1vZGlmaWFibGVDb2xsZWN0aW9uGUIAgMte9x4CAAFMAAFjdAAWTGphdmEvdXRpbC9Db2xsZWN0aW9uO3hwc3IAE2phdmEudXRpbC5BcnJheUxpc3R4gdIdmcdhnQMAAUkABHNpemV4cAAAAAB3BAAAAAB4cQB-AFF4c3IAEWphdmEubGFuZy5JbnRlZ2VyEuKgpPeBhzgCAAFJAAV2YWx1ZXhyABBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAAB4cAAAEO9zcQB-AFAAAAAAdwQAAAAAeHNyAA5qYXZhLmxhbmcuTG9uZzuL5JDMjyPfAgABSgAFdmFsdWV4cQB-AFMAAAAAAAAAAXZyABdjb20uY2xvdWQuZGMuRGF0YUNlbnRlcrLxCuun53i-AgAAeHAA
  1048. 2017-12-01 00:01:32,179 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588) (logid:a98dfed6) Remove job-73588 from job monitoring
  1049. 2017-12-01 00:01:32,181 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589) (logid:32b654cc) Publish async job-73589 complete on message bus
  1050. 2017-12-01 00:01:32,181 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589) (logid:32b654cc) Wake up jobs related to job-73589
  1051. 2017-12-01 00:01:32,182 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589) (logid:32b654cc) Update db status for job-73589
  1052. 2017-12-01 00:01:32,185 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589) (logid:32b654cc) Wake up jobs joined with job-73589 and disjoin all subjobs created from job- 73589
  1053. 2017-12-01 00:01:32,188 WARN [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) Exception while trying to start console proxy
  1054. com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24523-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  1055. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
  1056. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
  1057. at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
  1058. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  1059. at java.lang.reflect.Method.invoke(Method.java:498)
  1060. at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
  1061. at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
  1062. at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
  1063. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
  1064. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  1065. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  1066. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  1067. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  1068. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  1069. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
  1070. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  1071. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  1072. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  1073. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  1074. at java.lang.Thread.run(Thread.java:748)
  1075. 2017-12-01 00:01:32,191 INFO [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) Unable to start console proxy vm for standby capacity, vm id : 24523, will recycle it and start a new one
  1076. 2017-12-01 00:01:32,197 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589) (logid:32b654cc) Done executing com.cloud.vm.VmWorkStart for job-73589
  1077. 2017-12-01 00:01:32,198 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589) (logid:32b654cc) Remove job-73589 from job monitoring
  1078. 2017-12-01 00:01:32,201 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) Sync job-73590 execution on object VmWorkJobQueue.24523
  1079. 2017-12-01 00:01:32,203 WARN [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Exception while trying to start secondary storage vm
  1080. com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24524-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  1081. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
  1082. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
  1083. at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
  1084. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  1085. at java.lang.reflect.Method.invoke(Method.java:498)
  1086. at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
  1087. at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
  1088. at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
  1089. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
  1090. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  1091. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  1092. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  1093. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  1094. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  1095. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
  1096. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  1097. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  1098. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  1099. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  1100. at java.lang.Thread.run(Thread.java:748)
  1101. 2017-12-01 00:01:32,206 INFO [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Unable to start secondary storage vm for standby capacity, vm id : 24524, will recycle it and start a new one
  1102. 2017-12-01 00:01:32,217 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Sync job-73591 execution on object VmWorkJobQueue.24524
  1103. 2017-12-01 00:01:33,497 INFO [c.c.h.v.r.VmwareResource] (DirectAgentCronJob-384:ctx-cd1fae40) (logid:e256b48a) Scan hung worker VM to recycle
  1104. 2017-12-01 00:01:33,681 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgentCronJob-384:ctx-cd1fae40) (logid:e256b48a) Ping from 1(r6-l06-esx01.cisco.com)
  1105. 2017-12-01 00:01:33,681 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-384:ctx-cd1fae40) (logid:e256b48a) Process host VM state report from ping process. host: 1
  1106. 2017-12-01 00:01:33,681 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-384:ctx-cd1fae40) (logid:e256b48a) Process VM state report. host: 1, number of records in report: 0
  1107. 2017-12-01 00:01:33,682 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-384:ctx-cd1fae40) (logid:e256b48a) Done with process of VM state report. host: 1
  1108. 2017-12-01 00:01:34,106 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-ffaf0748) (logid:3d0a12cb) Execute sync-queue item: SyncQueueItemVO {id:73572, queueId: 73568, contentType: AsyncJob, contentId: 73590, lastProcessMsid: 345052167237, lastprocessNumber: 3, lastProcessTime: Fri Dec 01 00:01:34 CST 2017, created: Fri Dec 01 00:01:32 CST 2017}
  1109. 2017-12-01 00:01:34,106 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-ffaf0748) (logid:3d0a12cb) Schedule queued job-73590
  1110. 2017-12-01 00:01:34,109 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-ffaf0748) (logid:3d0a12cb) Execute sync-queue item: SyncQueueItemVO {id:73573, queueId: 73569, contentType: AsyncJob, contentId: 73591, lastProcessMsid: 345052167237, lastprocessNumber: 3, lastProcessTime: Fri Dec 01 00:01:34 CST 2017, created: Fri Dec 01 00:01:32 CST 2017}
  1111. 2017-12-01 00:01:34,109 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-ffaf0748) (logid:3d0a12cb) Schedule queued job-73591
  1112. 2017-12-01 00:01:34,109 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-34:ctx-875c2c36 job-1/job-73590) (logid:576b3030) Add job-73590 into job monitoring
  1113. 2017-12-01 00:01:34,114 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-7fa2bb87) (logid:78e4238f) Begin cleanup expired async-jobs
  1114. 2017-12-01 00:01:34,115 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-34:ctx-875c2c36 job-1/job-73590) (logid:a98dfed6) Executing AsyncJobVO {id:73590, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStop, cmdInfo: rO0ABXNyABdjb20uY2xvdWQudm0uVm1Xb3JrU3RvcALQ4GymiWjjAgABWgAHY2xlYW51cHhyABNjb20uY2xvdWQudm0uVm1Xb3Jrn5m2VvAlZ2sCAARKAAlhY2NvdW50SWRKAAZ1c2VySWRKAAR2bUlkTAALaGFuZGxlck5hbWV0ABJMamF2YS9sYW5nL1N0cmluZzt4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfy3QAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:01:32 CST 2017}
  1115. 2017-12-01 00:01:34,115 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-34:ctx-875c2c36 job-1/job-73590) (logid:a98dfed6) Run VM work job: com.cloud.vm.VmWorkStop for VM 24523, job origin: 1
  1116. 2017-12-01 00:01:34,116 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-35:ctx-e6dd3530 job-2/job-73591) (logid:c5bea677) Add job-73591 into job monitoring
  1117. 2017-12-01 00:01:34,119 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-7fa2bb87) (logid:78e4238f) End cleanup expired async-jobs
  1118. 2017-12-01 00:01:34,120 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-35:ctx-e6dd3530 job-2/job-73591) (logid:32b654cc) Executing AsyncJobVO {id:73591, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStop, cmdInfo: rO0ABXNyABdjb20uY2xvdWQudm0uVm1Xb3JrU3RvcALQ4GymiWjjAgABWgAHY2xlYW51cHhyABNjb20uY2xvdWQudm0uVm1Xb3Jrn5m2VvAlZ2sCAARKAAlhY2NvdW50SWRKAAZ1c2VySWRKAAR2bUlkTAALaGFuZGxlck5hbWV0ABJMamF2YS9sYW5nL1N0cmluZzt4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfzHQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:01:32 CST 2017}
  1119. 2017-12-01 00:01:34,120 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-35:ctx-e6dd3530 job-2/job-73591) (logid:32b654cc) Run VM work job: com.cloud.vm.VmWorkStop for VM 24524, job origin: 2
  1120. 2017-12-01 00:01:34,120 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-34:ctx-875c2c36 job-1/job-73590 ctx-2258a7d8) (logid:a98dfed6) Execute VM work job: com.cloud.vm.VmWorkStop{"cleanup":false,"userId":1,"accountId":1,"vmId":24523,"handlerName":"VirtualMachineManagerImpl"}
  1121. 2017-12-01 00:01:34,121 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-35:ctx-e6dd3530 job-2/job-73591 ctx-96461dbf) (logid:32b654cc) Execute VM work job: com.cloud.vm.VmWorkStop{"cleanup":false,"userId":1,"accountId":1,"vmId":24524,"handlerName":"VirtualMachineManagerImpl"}
  1122. 2017-12-01 00:01:34,124 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-34:ctx-875c2c36 job-1/job-73590 ctx-2258a7d8) (logid:a98dfed6) VM is already stopped: VM[ConsoleProxy|v-24523-VM]
  1123. 2017-12-01 00:01:34,124 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-34:ctx-875c2c36 job-1/job-73590 ctx-2258a7d8) (logid:a98dfed6) Done executing VM work job: com.cloud.vm.VmWorkStop{"cleanup":false,"userId":1,"accountId":1,"vmId":24523,"handlerName":"VirtualMachineManagerImpl"}
  1124. 2017-12-01 00:01:34,124 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-34:ctx-875c2c36 job-1/job-73590 ctx-2258a7d8) (logid:a98dfed6) Complete async job-73590, jobStatus: SUCCEEDED, resultCode: 0, result: null
  1125. 2017-12-01 00:01:34,125 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-34:ctx-875c2c36 job-1/job-73590 ctx-2258a7d8) (logid:a98dfed6) Publish async job-73590 complete on message bus
  1126. 2017-12-01 00:01:34,125 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-34:ctx-875c2c36 job-1/job-73590 ctx-2258a7d8) (logid:a98dfed6) Wake up jobs related to job-73590
  1127. 2017-12-01 00:01:34,125 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-34:ctx-875c2c36 job-1/job-73590 ctx-2258a7d8) (logid:a98dfed6) Update db status for job-73590
  1128. 2017-12-01 00:01:34,125 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-35:ctx-e6dd3530 job-2/job-73591 ctx-96461dbf) (logid:32b654cc) VM is already stopped: VM[SecondaryStorageVm|s-24524-VM]
  1129. 2017-12-01 00:01:34,125 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-35:ctx-e6dd3530 job-2/job-73591 ctx-96461dbf) (logid:32b654cc) Done executing VM work job: com.cloud.vm.VmWorkStop{"cleanup":false,"userId":1,"accountId":1,"vmId":24524,"handlerName":"VirtualMachineManagerImpl"}
  1130. 2017-12-01 00:01:34,125 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-35:ctx-e6dd3530 job-2/job-73591 ctx-96461dbf) (logid:32b654cc) Complete async job-73591, jobStatus: SUCCEEDED, resultCode: 0, result: null
  1131. 2017-12-01 00:01:34,126 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-34:ctx-875c2c36 job-1/job-73590 ctx-2258a7d8) (logid:a98dfed6) Wake up jobs joined with job-73590 and disjoin all subjobs created from job- 73590
  1132. 2017-12-01 00:01:34,126 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-35:ctx-e6dd3530 job-2/job-73591 ctx-96461dbf) (logid:32b654cc) Publish async job-73591 complete on message bus
  1133. 2017-12-01 00:01:34,126 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-35:ctx-e6dd3530 job-2/job-73591 ctx-96461dbf) (logid:32b654cc) Wake up jobs related to job-73591
  1134. 2017-12-01 00:01:34,126 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-35:ctx-e6dd3530 job-2/job-73591 ctx-96461dbf) (logid:32b654cc) Update db status for job-73591
  1135. 2017-12-01 00:01:34,128 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-35:ctx-e6dd3530 job-2/job-73591 ctx-96461dbf) (logid:32b654cc) Wake up jobs joined with job-73591 and disjoin all subjobs created from job- 73591
  1136. 2017-12-01 00:01:34,133 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-34:ctx-875c2c36 job-1/job-73590) (logid:a98dfed6) Done with run of VM work job: com.cloud.vm.VmWorkStop for VM 24523, job origin: 1
  1137. 2017-12-01 00:01:34,133 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-34:ctx-875c2c36 job-1/job-73590) (logid:a98dfed6) Done executing com.cloud.vm.VmWorkStop for job-73590
  1138. 2017-12-01 00:01:34,134 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-35:ctx-e6dd3530 job-2/job-73591) (logid:32b654cc) Done with run of VM work job: com.cloud.vm.VmWorkStop for VM 24524, job origin: 2
  1139. 2017-12-01 00:01:34,134 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-35:ctx-e6dd3530 job-2/job-73591) (logid:32b654cc) Done executing com.cloud.vm.VmWorkStop for job-73591
  1140. 2017-12-01 00:01:34,134 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-34:ctx-875c2c36 job-1/job-73590) (logid:a98dfed6) Remove job-73590 from job monitoring
  1141. 2017-12-01 00:01:34,136 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-35:ctx-e6dd3530 job-2/job-73591) (logid:32b654cc) Remove job-73591 from job monitoring
  1142. 2017-12-01 00:01:34,150 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) VM state transitted from :Stopped to Expunging with event: ExpungeOperationvm's original host id: null new host id: null host id before state transition: null
  1143. 2017-12-01 00:01:34,150 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Destroying vm VM[SecondaryStorageVm|s-24524-VM]
  1144. 2017-12-01 00:01:34,150 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Cleaning up NICS
  1145. 2017-12-01 00:01:34,150 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) VM state transitted from :Stopped to Expunging with event: ExpungeOperationvm's original host id: null new host id: null host id before state transition: null
  1146. 2017-12-01 00:01:34,150 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) Destroying vm VM[ConsoleProxy|v-24523-VM]
  1147. 2017-12-01 00:01:34,150 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) Cleaning up NICS
  1148. 2017-12-01 00:01:34,153 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) Cleaning network for vm: 24523
  1149. 2017-12-01 00:01:34,154 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Cleaning network for vm: 24524
  1150. 2017-12-01 00:01:34,159 DEBUG [c.c.n.g.PublicNetworkGuru] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) public network deallocate network: networkId: 200, ip: 10.89.98.210
  1151. 2017-12-01 00:01:34,160 DEBUG [c.c.n.g.PublicNetworkGuru] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) public network deallocate network: networkId: 200, ip: 10.89.98.211
  1152. 2017-12-01 00:01:34,163 DEBUG [c.c.n.g.PublicNetworkGuru] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) Deallocated nic: NicProfile[85828-24523-null-null-null
  1153. 2017-12-01 00:01:34,165 DEBUG [c.c.n.g.PublicNetworkGuru] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Deallocated nic: NicProfile[85831-24524-null-null-null
  1154. 2017-12-01 00:01:34,166 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) Removed nic id=85828
  1155. 2017-12-01 00:01:34,167 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) Revoving nic secondary ip entry ...
  1156. 2017-12-01 00:01:34,167 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Removed nic id=85831
  1157. 2017-12-01 00:01:34,168 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Revoving nic secondary ip entry ...
  1158. 2017-12-01 00:01:34,174 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) Removed nic id=85829
  1159. 2017-12-01 00:01:34,175 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) Revoving nic secondary ip entry ...
  1160. 2017-12-01 00:01:34,175 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Removed nic id=85832
  1161. 2017-12-01 00:01:34,176 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Revoving nic secondary ip entry ...
  1162. 2017-12-01 00:01:34,181 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) Removed nic id=85830
  1163. 2017-12-01 00:01:34,182 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) Revoving nic secondary ip entry ...
  1164. 2017-12-01 00:01:34,182 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) Cleaning up hypervisor data structures (ex. SRs in XenServer) for managed storage
  1165. 2017-12-01 00:01:34,183 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Removed nic id=85833
  1166. 2017-12-01 00:01:34,184 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Revoving nic secondary ip entry ...
  1167. 2017-12-01 00:01:34,184 DEBUG [o.a.c.e.o.VolumeOrchestrator] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) Cleaning storage for vm: 24523
  1168. 2017-12-01 00:01:34,191 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Removed nic id=85834
  1169. 2017-12-01 00:01:34,192 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Revoving nic secondary ip entry ...
  1170. 2017-12-01 00:01:34,192 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Cleaning up hypervisor data structures (ex. SRs in XenServer) for managed storage
  1171. 2017-12-01 00:01:34,193 DEBUG [o.a.c.e.o.VolumeOrchestrator] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Cleaning storage for vm: 24524
  1172. 2017-12-01 00:01:34,194 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) Expunge volume with no data store specified
  1173. 2017-12-01 00:01:34,195 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) Volume 24523 is not referred anywhere, remove it from volumes table
  1174. 2017-12-01 00:01:34,201 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) Expunged VM[ConsoleProxy|v-24523-VM]
  1175. 2017-12-01 00:01:34,204 INFO [o.a.c.s.v.VolumeServiceImpl] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Expunge volume with no data store specified
  1176. 2017-12-01 00:01:34,205 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) received console proxy alert
  1177. 2017-12-01 00:01:34,205 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) Console proxy creation failure, zone: Zone-Orion
  1178. 2017-12-01 00:01:34,206 WARN [o.a.c.alerts] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) alertType:: 10 // dataCenterId:: 1 // podId:: null // clusterId:: null // message:: Console proxy creation failure. zone: Zone-Orion, error details: null
  1179. 2017-12-01 00:01:34,207 INFO [o.a.c.s.v.VolumeServiceImpl] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Volume 24524 is not referred anywhere, remove it from volumes table
  1180. 2017-12-01 00:01:34,213 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Expunged VM[SecondaryStorageVm|s-24524-VM]
  1181. 2017-12-01 00:01:34,216 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) received secondary storage vm alert
  1182. 2017-12-01 00:01:34,216 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Secondary Storage Vm creation failure, zone: Zone-Orion
  1183. 2017-12-01 00:01:34,217 WARN [o.a.c.alerts] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) alertType:: 19 // dataCenterId:: 1 // podId:: null // clusterId:: null // message:: Secondary Storage Vm creation failure. zone: Zone-Orion, error details: null
  1184. 2017-12-01 00:01:34,220 INFO [o.a.c.s.PremiumSecondaryStorageManagerImpl] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Primary secondary storage is not even started, wait until next turn
  1185. 2017-12-01 00:01:38,372 DEBUG [c.c.s.StatsCollector] (StatsCollector-1:ctx-38742d98) (logid:05de0f83) AutoScaling Monitor is running...
  1186. 2017-12-01 00:01:44,104 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-22f4629a) (logid:52ebb2c0) Begin cleanup expired async-jobs
  1187. 2017-12-01 00:01:44,108 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-22f4629a) (logid:52ebb2c0) End cleanup expired async-jobs
  1188. 2017-12-01 00:01:51,904 DEBUG [c.c.s.StatsCollector] (StatsCollector-2:ctx-6b88cad3) (logid:64572461) StorageCollector is running...
  1189. 2017-12-01 00:01:51,909 DEBUG [c.c.s.StatsCollector] (StatsCollector-2:ctx-6b88cad3) (logid:64572461) There is no secondary storage VM for secondary storage host secondary
  1190. 2017-12-01 00:01:51,910 DEBUG [c.c.h.o.r.Ovm3HypervisorGuru] (StatsCollector-2:ctx-6b88cad3) (logid:64572461) getCommandHostDelegation: class com.cloud.agent.api.GetStorageStatsCommand
  1191. 2017-12-01 00:01:51,910 DEBUG [c.c.h.XenServerGuru] (StatsCollector-2:ctx-6b88cad3) (logid:64572461) getCommandHostDelegation: class com.cloud.agent.api.GetStorageStatsCommand
  1192. 2017-12-01 00:01:51,911 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-333:ctx-df9ea633) (logid:c2094c40) Seq 1-3458483038843866938: Executing request
  1193. 2017-12-01 00:01:51,982 DEBUG [c.c.h.v.r.VmwareResource] (DirectAgent-333:ctx-df9ea633 r6-l06-esx01.cisco.com, cmd: GetStorageStatsCommand) (logid:64572461) Datastore summary info, storageId: 260fa543-e292-4f78-820c-dae49505e528, localPath: datastore-2475, poolType: VMFS, capacity: 1751809785856, free: 1750779035648, used: 1030750208
  1194. 2017-12-01 00:01:51,982 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-333:ctx-df9ea633) (logid:64572461) Seq 1-3458483038843866938: Response Received:
  1195. 2017-12-01 00:01:51,982 DEBUG [c.c.a.t.Request] (StatsCollector-2:ctx-6b88cad3) (logid:64572461) Seq 1-3458483038843866938: Received: { Ans: , MgmtId: 345052167237, via: 1(r6-l06-esx01.cisco.com), Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
  1196. 2017-12-01 00:01:51,983 DEBUG [c.c.h.o.r.Ovm3HypervisorGuru] (StatsCollector-2:ctx-6b88cad3) (logid:64572461) getCommandHostDelegation: class com.cloud.agent.api.GetStorageStatsCommand
  1197. 2017-12-01 00:01:51,983 DEBUG [c.c.h.XenServerGuru] (StatsCollector-2:ctx-6b88cad3) (logid:64572461) getCommandHostDelegation: class com.cloud.agent.api.GetStorageStatsCommand
  1198. 2017-12-01 00:01:51,984 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-167:ctx-0ab5064f) (logid:466bdbd3) Seq 1-3458483038843866939: Executing request
  1199. 2017-12-01 00:01:52,036 DEBUG [c.c.h.v.r.VmwareResource] (DirectAgent-167:ctx-0ab5064f r6-l06-esx01.cisco.com, cmd: GetStorageStatsCommand) (logid:64572461) Datastore summary info, storageId: 09198288-c7af-4569-9202-4616ec2b0b92, localPath: datastore-2476, poolType: VMFS, capacity: 137975824384, free: 47294971904, used: 90680852480
  1200. 2017-12-01 00:01:52,036 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-167:ctx-0ab5064f) (logid:64572461) Seq 1-3458483038843866939: Response Received:
  1201. 2017-12-01 00:01:52,036 DEBUG [c.c.a.t.Request] (StatsCollector-2:ctx-6b88cad3) (logid:64572461) Seq 1-3458483038843866939: Received: { Ans: , MgmtId: 345052167237, via: 1(r6-l06-esx01.cisco.com), Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
  1202. 2017-12-01 00:01:54,104 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-d16ae790) (logid:3f785283) Begin cleanup expired async-jobs
  1203. 2017-12-01 00:01:54,109 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-d16ae790) (logid:3f785283) End cleanup expired async-jobs
  1204. 2017-12-01 00:01:54,338 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-3ad419ae) (logid:c20d52b4) Found 0 routers to update status.
  1205. 2017-12-01 00:01:54,339 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-3ad419ae) (logid:c20d52b4) Found 0 VPC networks to update Redundant State.
  1206. 2017-12-01 00:01:54,339 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-3ad419ae) (logid:c20d52b4) Found 0 networks to update RvR status.
  1207. 2017-12-01 00:01:59,353 DEBUG [o.a.c.f.j.d.VmWorkJobDaoImpl] (Vm-Operations-Cleanup-1:ctx-cdca090a) (logid:a06f8a27) Expunge completed work job-73226
  1208. 2017-12-01 00:01:59,357 DEBUG [o.a.c.f.j.d.VmWorkJobDaoImpl] (Vm-Operations-Cleanup-1:ctx-cdca090a) (logid:a06f8a27) Expunge completed work job-73227
  1209. 2017-12-01 00:01:59,359 DEBUG [o.a.c.f.j.d.VmWorkJobDaoImpl] (Vm-Operations-Cleanup-1:ctx-cdca090a) (logid:a06f8a27) Expunge completed work job-73228
  1210. 2017-12-01 00:01:59,362 DEBUG [o.a.c.f.j.d.VmWorkJobDaoImpl] (Vm-Operations-Cleanup-1:ctx-cdca090a) (logid:a06f8a27) Expunge completed work job-73229
  1211. 2017-12-01 00:01:59,365 DEBUG [o.a.c.f.j.d.VmWorkJobDaoImpl] (Vm-Operations-Cleanup-1:ctx-cdca090a) (logid:a06f8a27) Expunge completed work job-73230
  1212. 2017-12-01 00:01:59,369 DEBUG [o.a.c.f.j.d.VmWorkJobDaoImpl] (Vm-Operations-Cleanup-1:ctx-cdca090a) (logid:a06f8a27) Expunge completed work job-73231
  1213. 2017-12-01 00:02:00,237 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) Zone 1 is ready to launch console proxy
  1214. 2017-12-01 00:02:00,237 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) Expand console proxy standby capacity for zone Zone-Orion
  1215. 2017-12-01 00:02:00,238 INFO [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) No stopped console proxy is available, need to allocate a new console proxy
  1216. 2017-12-01 00:02:00,239 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) Assign console proxy from a newly started instance for request from data center : 1
  1217. 2017-12-01 00:02:00,247 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) Found existing network configuration for offering [Network Offering [1-Public-System-Public-Network]: Ntwk[200|Public|1]
  1218. 2017-12-01 00:02:00,247 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
  1219. 2017-12-01 00:02:00,253 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) Found existing network configuration for offering [Network Offering [3-Control-System-Control-Network]: Ntwk[202|Control|3]
  1220. 2017-12-01 00:02:00,253 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
  1221. 2017-12-01 00:02:00,257 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) Found existing network configuration for offering [Network Offering [2-Management-System-Management-Network]: Ntwk[201|Management|2]
  1222. 2017-12-01 00:02:00,257 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
  1223. 2017-12-01 00:02:00,266 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) Allocating entries for VM: VM[ConsoleProxy|v-24525-VM]
  1224. 2017-12-01 00:02:00,267 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) Allocating nics for VM[ConsoleProxy|v-24525-VM]
  1225. 2017-12-01 00:02:00,268 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) Allocating nic for vm VM[ConsoleProxy|v-24525-VM] in network Ntwk[200|Public|1] with requested profile NicProfile[0-0-null-null-null
  1226. 2017-12-01 00:02:00,278 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) Allocating nic for vm VM[ConsoleProxy|v-24525-VM] in network Ntwk[202|Control|3] with requested profile null
  1227. 2017-12-01 00:02:00,284 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) Allocating nic for vm VM[ConsoleProxy|v-24525-VM] in network Ntwk[201|Management|2] with requested profile null
  1228. 2017-12-01 00:02:00,287 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) Allocating disks for VM[ConsoleProxy|v-24525-VM]
  1229. 2017-12-01 00:02:00,291 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) Allocation completed for VM: VM[ConsoleProxy|v-24525-VM]
  1230. 2017-12-01 00:02:00,293 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) received console proxy alert
  1231. 2017-12-01 00:02:00,293 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) New console proxy created, zone: Zone-Orion, proxy: v-24525-VM, public IP: null, private IP: null
  1232. 2017-12-01 00:02:00,301 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) Sync job-73592 execution on object VmWorkJobQueue.24525
  1233. 2017-12-01 00:02:00,355 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) Zone 1 is ready to launch secondary storage VM
  1234. 2017-12-01 00:02:00,357 INFO [o.a.c.s.PremiumSecondaryStorageManagerImpl] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) No running secondary storage vms found in datacenter id=1, starting one
  1235. 2017-12-01 00:02:00,359 INFO [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) No stopped secondary storage vm is available, need to allocate a new secondary storage vm
  1236. 2017-12-01 00:02:00,360 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) Assign secondary storage vm from a newly started instance for request from data center : 1
  1237. 2017-12-01 00:02:00,367 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) Found existing network configuration for offering [Network Offering [1-Public-System-Public-Network]: Ntwk[200|Public|1]
  1238. 2017-12-01 00:02:00,367 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
  1239. 2017-12-01 00:02:00,371 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) Found existing network configuration for offering [Network Offering [3-Control-System-Control-Network]: Ntwk[202|Control|3]
  1240. 2017-12-01 00:02:00,371 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
  1241. 2017-12-01 00:02:00,376 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) Found existing network configuration for offering [Network Offering [2-Management-System-Management-Network]: Ntwk[201|Management|2]
  1242. 2017-12-01 00:02:00,376 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
  1243. 2017-12-01 00:02:00,380 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) Found existing network configuration for offering [Network Offering [4-Storage-System-Storage-Network]: Ntwk[203|Storage|4]
  1244. 2017-12-01 00:02:00,380 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
  1245. 2017-12-01 00:02:00,391 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) Allocating entries for VM: VM[SecondaryStorageVm|s-24526-VM]
  1246. 2017-12-01 00:02:00,392 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) Allocating nics for VM[SecondaryStorageVm|s-24526-VM]
  1247. 2017-12-01 00:02:00,393 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) Allocating nic for vm VM[SecondaryStorageVm|s-24526-VM] in network Ntwk[200|Public|1] with requested profile NicProfile[0-0-null-null-null
  1248. 2017-12-01 00:02:00,402 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) Allocating nic for vm VM[SecondaryStorageVm|s-24526-VM] in network Ntwk[202|Control|3] with requested profile null
  1249. 2017-12-01 00:02:00,409 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) Allocating nic for vm VM[SecondaryStorageVm|s-24526-VM] in network Ntwk[201|Management|2] with requested profile null
  1250. 2017-12-01 00:02:00,412 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) Allocating nic for vm VM[SecondaryStorageVm|s-24526-VM] in network Ntwk[203|Storage|4] with requested profile null
  1251. 2017-12-01 00:02:00,416 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) Allocating disks for VM[SecondaryStorageVm|s-24526-VM]
  1252. 2017-12-01 00:02:00,419 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) Allocation completed for VM: VM[SecondaryStorageVm|s-24526-VM]
  1253. 2017-12-01 00:02:00,422 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) received secondary storage vm alert
  1254. 2017-12-01 00:02:00,422 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) New secondary storage vm created, zone: Zone-Orion, secStorageVm: s-24526-VM, public IP: null, private IP: null
  1255. 2017-12-01 00:02:00,430 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) Sync job-73593 execution on object VmWorkJobQueue.24526
  1256. 2017-12-01 00:02:01,133 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-56604421) (logid:13b5eeab) Resetting hosts suitable for reconnect
  1257. 2017-12-01 00:02:01,134 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-56604421) (logid:13b5eeab) Completed resetting hosts suitable for reconnect
  1258. 2017-12-01 00:02:01,134 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-56604421) (logid:13b5eeab) Acquiring hosts for clusters already owned by this management server
  1259. 2017-12-01 00:02:01,134 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-56604421) (logid:13b5eeab) Completed acquiring hosts for clusters already owned by this management server
  1260. 2017-12-01 00:02:01,134 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-56604421) (logid:13b5eeab) Acquiring hosts for clusters not owned by any management server
  1261. 2017-12-01 00:02:01,135 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-56604421) (logid:13b5eeab) Completed acquiring hosts for clusters not owned by any management server
  1262. 2017-12-01 00:02:02,106 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-33a87a7f) (logid:ba438d84) Execute sync-queue item: SyncQueueItemVO {id:73574, queueId: 73574, contentType: AsyncJob, contentId: 73592, lastProcessMsid: 345052167237, lastprocessNumber: 1, lastProcessTime: Fri Dec 01 00:02:02 CST 2017, created: Fri Dec 01 00:02:00 CST 2017}
  1263. 2017-12-01 00:02:02,107 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-33a87a7f) (logid:ba438d84) Schedule queued job-73592
  1264. 2017-12-01 00:02:02,109 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-33a87a7f) (logid:ba438d84) Execute sync-queue item: SyncQueueItemVO {id:73575, queueId: 73575, contentType: AsyncJob, contentId: 73593, lastProcessMsid: 345052167237, lastprocessNumber: 1, lastProcessTime: Fri Dec 01 00:02:02 CST 2017, created: Fri Dec 01 00:02:00 CST 2017}
  1265. 2017-12-01 00:02:02,110 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592) (logid:1783fe70) Add job-73592 into job monitoring
  1266. 2017-12-01 00:02:02,111 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-33a87a7f) (logid:ba438d84) Schedule queued job-73593
  1267. 2017-12-01 00:02:02,114 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593) (logid:5741d1ca) Add job-73593 into job monitoring
  1268. 2017-12-01 00:02:02,116 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592) (logid:a98dfed6) Executing AsyncJobVO {id:73592, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfzXQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:02:00 CST 2017}
  1269. 2017-12-01 00:02:02,116 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592) (logid:a98dfed6) Run VM work job: com.cloud.vm.VmWorkStart for VM 24525, job origin: 1
  1270. 2017-12-01 00:02:02,117 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) Execute VM work job: com.cloud.vm.VmWorkStart{"dcId":0,"userId":1,"accountId":1,"vmId":24525,"handlerName":"VirtualMachineManagerImpl"}
  1271. 2017-12-01 00:02:02,121 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593) (logid:32b654cc) Executing AsyncJobVO {id:73593, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfznQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:02:00 CST 2017}
  1272. 2017-12-01 00:02:02,121 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593) (logid:32b654cc) Run VM work job: com.cloud.vm.VmWorkStart for VM 24526, job origin: 2
  1273. 2017-12-01 00:02:02,122 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
  1274. 2017-12-01 00:02:02,122 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) Successfully transitioned to start state for VM[ConsoleProxy|v-24525-VM] reservation id = 6375707f-ffd4-4922-9a8d-d92641f6b7d6
  1275. 2017-12-01 00:02:02,123 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) Execute VM work job: com.cloud.vm.VmWorkStart{"dcId":0,"userId":1,"accountId":1,"vmId":24526,"handlerName":"VirtualMachineManagerImpl"}
  1276. 2017-12-01 00:02:02,124 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) Trying to deploy VM, vm has dcId: 1 and podId: null
  1277. 2017-12-01 00:02:02,124 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) Deploy avoids pods: null, clusters: null, hosts: null
  1278. 2017-12-01 00:02:02,127 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) Deploy avoids pods: null, clusters: null, hosts: null
  1279. 2017-12-01 00:02:02,127 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@eecdd04
  1280. 2017-12-01 00:02:02,127 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) Trying to allocate a host and storage pools from dc:1, pod:null,cluster:null, requested cpu: 500, requested ram: 1073741824
  1281. 2017-12-01 00:02:02,127 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) Is ROOT volume READY (pool already allocated)?: No
  1282. 2017-12-01 00:02:02,127 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) Searching all possible resources under this Zone: 1
  1283. 2017-12-01 00:02:02,128 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
  1284. 2017-12-01 00:02:02,129 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
  1285. 2017-12-01 00:02:02,129 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) Successfully transitioned to start state for VM[SecondaryStorageVm|s-24526-VM] reservation id = 3ddc401d-d14d-49f7-baf2-33e6d1a96b24
  1286. 2017-12-01 00:02:02,130 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) Trying to deploy VM, vm has dcId: 1 and podId: null
  1287. 2017-12-01 00:02:02,130 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) Deploy avoids pods: null, clusters: null, hosts: null
  1288. 2017-12-01 00:02:02,133 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) Deploy avoids pods: null, clusters: null, hosts: null
  1289. 2017-12-01 00:02:02,134 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@eecdd04
  1290. 2017-12-01 00:02:02,134 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) Trying to allocate a host and storage pools from dc:1, pod:null,cluster:null, requested cpu: 500, requested ram: 536870912
  1291. 2017-12-01 00:02:02,134 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) Is ROOT volume READY (pool already allocated)?: No
  1292. 2017-12-01 00:02:02,134 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) Searching all possible resources under this Zone: 1
  1293. 2017-12-01 00:02:02,134 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
  1294. 2017-12-01 00:02:02,137 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) Checking resources in Cluster: 1 under Pod: 1
  1295. 2017-12-01 00:02:02,137 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e FirstFitRoutingAllocator) (logid:a98dfed6) Looking for hosts in dc: 1 pod:1 cluster:1
  1296. 2017-12-01 00:02:02,138 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e FirstFitRoutingAllocator) (logid:a98dfed6) FirstFitAllocator has 1 hosts to check for allocation: [Host[-1-Routing]]
  1297. 2017-12-01 00:02:02,142 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e FirstFitRoutingAllocator) (logid:a98dfed6) Found 1 hosts for allocation after prioritization: [Host[-1-Routing]]
  1298. 2017-12-01 00:02:02,142 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e FirstFitRoutingAllocator) (logid:a98dfed6) Looking for speed=500Mhz, Ram=1024
  1299. 2017-12-01 00:02:02,142 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) Checking resources in Cluster: 1 under Pod: 1
  1300. 2017-12-01 00:02:02,142 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb FirstFitRoutingAllocator) (logid:32b654cc) Looking for hosts in dc: 1 pod:1 cluster:1
  1301. 2017-12-01 00:02:02,144 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb FirstFitRoutingAllocator) (logid:32b654cc) FirstFitAllocator has 1 hosts to check for allocation: [Host[-1-Routing]]
  1302. 2017-12-01 00:02:02,147 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e FirstFitRoutingAllocator) (logid:a98dfed6) Host: 1 has cpu capability (cpu:16, speed:2533) to support requested CPU: 1 and requested speed: 500
  1303. 2017-12-01 00:02:02,147 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e FirstFitRoutingAllocator) (logid:a98dfed6) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  1304. 2017-12-01 00:02:02,149 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e FirstFitRoutingAllocator) (logid:a98dfed6) Hosts's actual total CPU: 40528 and CPU after applying overprovisioning: 40528
  1305. 2017-12-01 00:02:02,149 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e FirstFitRoutingAllocator) (logid:a98dfed6) Free CPU: 40528 , Requested CPU: 500
  1306. 2017-12-01 00:02:02,149 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e FirstFitRoutingAllocator) (logid:a98dfed6) Free RAM: 42880884736 , Requested RAM: 1073741824
  1307. 2017-12-01 00:02:02,149 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e FirstFitRoutingAllocator) (logid:a98dfed6) Host has enough CPU and RAM available
  1308. 2017-12-01 00:02:02,149 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e FirstFitRoutingAllocator) (logid:a98dfed6) STATS: Can alloc CPU from host: 1, used: 0, reserved: 0, actual total: 40528, total with overprovisioning: 40528; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1309. 2017-12-01 00:02:02,149 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e FirstFitRoutingAllocator) (logid:a98dfed6) STATS: Can alloc MEM from host: 1, used: 0, reserved: 0, total: 42880884736; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1310. 2017-12-01 00:02:02,149 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e FirstFitRoutingAllocator) (logid:a98dfed6) Found a suitable host, adding to list: 1
  1311. 2017-12-01 00:02:02,149 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e FirstFitRoutingAllocator) (logid:a98dfed6) Host Allocator returning 1 suitable hosts
  1312. 2017-12-01 00:02:02,150 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb FirstFitRoutingAllocator) (logid:32b654cc) Found 1 hosts for allocation after prioritization: [Host[-1-Routing]]
  1313. 2017-12-01 00:02:02,150 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb FirstFitRoutingAllocator) (logid:32b654cc) Looking for speed=500Mhz, Ram=512
  1314. 2017-12-01 00:02:02,150 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) Checking suitable pools for volume (Id, Type): (24525,ROOT)
  1315. 2017-12-01 00:02:02,150 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) We need to allocate new storagepool for this volume
  1316. 2017-12-01 00:02:02,151 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) Calling StoragePoolAllocators to find suitable pools
  1317. 2017-12-01 00:02:02,152 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) System VMs will use shared storage for zone id=1
  1318. 2017-12-01 00:02:02,152 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) LocalStoragePoolAllocator trying to find storage pool to fit the vm
  1319. 2017-12-01 00:02:02,152 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) ClusterScopeStoragePoolAllocator looking for storage pool
  1320. 2017-12-01 00:02:02,152 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) Looking for pools in dc: 1 pod:1 cluster:1. Disabled pools will be ignored.
  1321. 2017-12-01 00:02:02,152 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) Found pools matching tags: []
  1322. 2017-12-01 00:02:02,153 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) No storage pools available for shared volume allocation, returning
  1323. 2017-12-01 00:02:02,153 DEBUG [o.a.c.s.a.ZoneWideStoragePoolAllocator] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) ZoneWideStoragePoolAllocator to find storage pool
  1324. 2017-12-01 00:02:02,154 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) No suitable pools found for volume: Vol[24525|vm=24525|ROOT] under cluster: 1
  1325. 2017-12-01 00:02:02,154 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) No suitable pools found
  1326. 2017-12-01 00:02:02,154 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) No suitable storagePools found under this Cluster: 1
  1327. 2017-12-01 00:02:02,154 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) Could not find suitable Deployment Destination for this VM under any clusters, returning.
  1328. 2017-12-01 00:02:02,154 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) Searching all possible resources under this Zone: 1
  1329. 2017-12-01 00:02:02,155 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
  1330. 2017-12-01 00:02:02,155 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb FirstFitRoutingAllocator) (logid:32b654cc) Host: 1 has cpu capability (cpu:16, speed:2533) to support requested CPU: 1 and requested speed: 500
  1331. 2017-12-01 00:02:02,155 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb FirstFitRoutingAllocator) (logid:32b654cc) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 536870912 , cpuOverprovisioningFactor: 1.0
  1332. 2017-12-01 00:02:02,156 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) Removing from the clusterId list these clusters from avoid set: [1]
  1333. 2017-12-01 00:02:02,156 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) No clusters found after removing disabled clusters and clusters in avoid list, returning.
  1334. 2017-12-01 00:02:02,157 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb FirstFitRoutingAllocator) (logid:32b654cc) Hosts's actual total CPU: 40528 and CPU after applying overprovisioning: 40528
  1335. 2017-12-01 00:02:02,157 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb FirstFitRoutingAllocator) (logid:32b654cc) Free CPU: 40528 , Requested CPU: 500
  1336. 2017-12-01 00:02:02,157 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb FirstFitRoutingAllocator) (logid:32b654cc) Free RAM: 42880884736 , Requested RAM: 536870912
  1337. 2017-12-01 00:02:02,157 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb FirstFitRoutingAllocator) (logid:32b654cc) Host has enough CPU and RAM available
  1338. 2017-12-01 00:02:02,157 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb FirstFitRoutingAllocator) (logid:32b654cc) STATS: Can alloc CPU from host: 1, used: 0, reserved: 0, actual total: 40528, total with overprovisioning: 40528; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1339. 2017-12-01 00:02:02,157 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb FirstFitRoutingAllocator) (logid:32b654cc) STATS: Can alloc MEM from host: 1, used: 0, reserved: 0, total: 42880884736; requested mem: 536870912,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1340. 2017-12-01 00:02:02,157 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb FirstFitRoutingAllocator) (logid:32b654cc) Found a suitable host, adding to list: 1
  1341. 2017-12-01 00:02:02,157 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb FirstFitRoutingAllocator) (logid:32b654cc) Host Allocator returning 1 suitable hosts
  1342. 2017-12-01 00:02:02,159 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) Checking suitable pools for volume (Id, Type): (24526,ROOT)
  1343. 2017-12-01 00:02:02,159 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) We need to allocate new storagepool for this volume
  1344. 2017-12-01 00:02:02,160 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) Calling StoragePoolAllocators to find suitable pools
  1345. 2017-12-01 00:02:02,161 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) System VMs will use shared storage for zone id=1
  1346. 2017-12-01 00:02:02,161 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) LocalStoragePoolAllocator trying to find storage pool to fit the vm
  1347. 2017-12-01 00:02:02,161 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) ClusterScopeStoragePoolAllocator looking for storage pool
  1348. 2017-12-01 00:02:02,161 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) Looking for pools in dc: 1 pod:1 cluster:1. Disabled pools will be ignored.
  1349. 2017-12-01 00:02:02,161 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) Found pools matching tags: []
  1350. 2017-12-01 00:02:02,162 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) No storage pools available for shared volume allocation, returning
  1351. 2017-12-01 00:02:02,162 DEBUG [o.a.c.s.a.ZoneWideStoragePoolAllocator] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) ZoneWideStoragePoolAllocator to find storage pool
  1352. 2017-12-01 00:02:02,163 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) No suitable pools found for volume: Vol[24526|vm=24526|ROOT] under cluster: 1
  1353. 2017-12-01 00:02:02,163 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) No suitable pools found
  1354. 2017-12-01 00:02:02,163 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) No suitable storagePools found under this Cluster: 1
  1355. 2017-12-01 00:02:02,164 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) Could not find suitable Deployment Destination for this VM under any clusters, returning.
  1356. 2017-12-01 00:02:02,164 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) Searching all possible resources under this Zone: 1
  1357. 2017-12-01 00:02:02,164 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
  1358. 2017-12-01 00:02:02,164 ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) Invocation exception, caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24525-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  1359. 2017-12-01 00:02:02,164 INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) Rethrow exception com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24525-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  1360. 2017-12-01 00:02:02,164 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592) (logid:a98dfed6) Done with run of VM work job: com.cloud.vm.VmWorkStart for VM 24525, job origin: 1
  1361. 2017-12-01 00:02:02,165 ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592) (logid:a98dfed6) Unable to complete AsyncJobVO {id:73592, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfzXQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:02:00 CST 2017}, job origin:1
  1362. com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24525-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  1363. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
  1364. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
  1365. at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
  1366. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  1367. at java.lang.reflect.Method.invoke(Method.java:498)
  1368. at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
  1369. at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
  1370. at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
  1371. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
  1372. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  1373. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  1374. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  1375. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  1376. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  1377. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
  1378. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  1379. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  1380. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  1381. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  1382. at java.lang.Thread.run(Thread.java:748)
  1383. 2017-12-01 00:02:02,165 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592) (logid:a98dfed6) Complete async job-73592, jobStatus: FAILED, resultCode: 0, result: rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdAA9VW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW0NvbnNvbGVQcm94eXx2LTI0NTI1LVZNXXVyAB5bTGphdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudDsCRio8PP0iOQIAAHhwAAAAFHNyABtqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnRhCcWaJjbdhQIABEkACmxpbmVOdW1iZXJMAA5kZWNsYXJpbmdDbGFzc3EAfgAKTAAIZmlsZU5hbWVxAH4ACkwACm1ldGhvZE5hbWVxAH4ACnhwAAADwHQAJmNvbS5jbG91ZC52bS5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsdAAeVmlydHVhbE1hY2hpbmVNYW5hZ2VySW1wbC5qYXZhdAAQb3JjaGVzdHJhdGVTdGFydHNxAH4AEQAAEgtxAH4AE3EAfgAUcQB-ABVzcQB-ABH_____dAAmc3VuLnJlZmxlY3QuR2VuZXJhdGVkTWV0aG9kQWNjZXNzb3IxOTlwdAAGaW52b2tlc3EAfgARAAAAK3QAKHN1bi5yZWZsZWN0LkRlbGVnYXRpbmdNZXRob2RBY2Nlc3NvckltcGx0ACFEZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsLmphdmFxAH4AGXNxAH4AEQAAAfJ0ABhqYXZhLmxhbmcucmVmbGVjdC5NZXRob2R0AAtNZXRob2QuamF2YXEAfgAZc3EAfgARAAAAa3QAImNvbS5jbG91ZC52bS5WbVdvcmtKb2JIYW5kbGVyUHJveHl0ABpWbVdvcmtKb2JIYW5kbGVyUHJveHkuamF2YXQAD2hhbmRsZVZtV29ya0pvYnNxAH4AEQAAEqxxAH4AE3EAfgAUcQB-ACNzcQB-ABEAAABmdAAgY29tLmNsb3VkLnZtLlZtV29ya0pvYkRpc3BhdGNoZXJ0ABhWbVdvcmtKb2JEaXNwYXRjaGVyLmphdmF0AAZydW5Kb2JzcQB-ABEAAAIqdAA_b3JnLmFwYWNoZS5jbG91ZHN0YWNrLmZyYW1ld29yay5qb2JzLmltcGwuQXN5bmNKb2JNYW5hZ2VySW1wbCQ1dAAYQXN5bmNKb2JNYW5hZ2VySW1wbC5qYXZhdAAMcnVuSW5Db250ZXh0c3EAfgARAAAAMXQAPm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZSQxdAAbTWFuYWdlZENvbnRleHRSdW5uYWJsZS5qYXZhdAADcnVuc3EAfgARAAAAOHQAQm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5EZWZhdWx0TWFuYWdlZENvbnRleHQkMXQAGkRlZmF1bHRNYW5hZ2VkQ29udGV4dC5qYXZhdAAEY2FsbHNxAH4AEQAAAGd0AEBvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0cQB-ADN0AA9jYWxsV2l0aENvbnRleHRzcQB-ABEAAAA1cQB-ADZxAH4AM3QADnJ1bldpdGhDb250ZXh0c3EAfgARAAAALnQAPG9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZXEAfgAvcQB-ADBzcQB-ABEAAAH2cQB-ACpxAH4AK3EAfgAwc3EAfgARAAAB_3QALmphdmEudXRpbC5jb25jdXJyZW50LkV4ZWN1dG9ycyRSdW5uYWJsZUFkYXB0ZXJ0AA5FeGVjdXRvcnMuamF2YXEAfgA0c3EAfgARAAABCnQAH2phdmEudXRpbC5jb25jdXJyZW50LkZ1dHVyZVRhc2t0AA9GdXR1cmVUYXNrLmphdmFxAH4AMHNxAH4AEQAABH10ACdqYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3J0ABdUaHJlYWRQb29sRXhlY3V0b3IuamF2YXQACXJ1bldvcmtlcnNxAH4AEQAAAnB0AC5qYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3IkV29ya2VycQB-AEVxAH4AMHNxAH4AEQAAAux0ABBqYXZhLmxhbmcuVGhyZWFkdAALVGhyZWFkLmphdmFxAH4AMHNyACZqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlTGlzdPwPJTG17I4QAgABTAAEbGlzdHEAfgAMeHIALGphdmEudXRpbC5Db2xsZWN0aW9ucyRVbm1vZGlmaWFibGVDb2xsZWN0aW9uGUIAgMte9x4CAAFMAAFjdAAWTGphdmEvdXRpbC9Db2xsZWN0aW9uO3hwc3IAE2phdmEudXRpbC5BcnJheUxpc3R4gdIdmcdhnQMAAUkABHNpemV4cAAAAAB3BAAAAAB4cQB-AFF4c3IAEWphdmEubGFuZy5JbnRlZ2VyEuKgpPeBhzgCAAFJAAV2YWx1ZXhyABBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAAB4cAAAEO9zcQB-AFAAAAAAdwQAAAAAeHNyAA5qYXZhLmxhbmcuTG9uZzuL5JDMjyPfAgABSgAFdmFsdWV4cQB-AFMAAAAAAAAAAXZyABdjb20uY2xvdWQuZGMuRGF0YUNlbnRlcrLxCuun53i-AgAAeHAA
  1384. 2017-12-01 00:02:02,167 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592) (logid:a98dfed6) Publish async job-73592 complete on message bus
  1385. 2017-12-01 00:02:02,167 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592) (logid:a98dfed6) Wake up jobs related to job-73592
  1386. 2017-12-01 00:02:02,167 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592) (logid:a98dfed6) Update db status for job-73592
  1387. 2017-12-01 00:02:02,171 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
  1388. 2017-12-01 00:02:02,171 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592) (logid:a98dfed6) Wake up jobs joined with job-73592 and disjoin all subjobs created from job- 73592
  1389. 2017-12-01 00:02:02,172 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) Removing from the clusterId list these clusters from avoid set: [1]
  1390. 2017-12-01 00:02:02,172 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) No clusters found after removing disabled clusters and clusters in avoid list, returning.
  1391. 2017-12-01 00:02:02,176 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592) (logid:a98dfed6) Done executing com.cloud.vm.VmWorkStart for job-73592
  1392. 2017-12-01 00:02:02,177 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592) (logid:a98dfed6) Remove job-73592 from job monitoring
  1393. 2017-12-01 00:02:02,183 WARN [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) Exception while trying to start console proxy
  1394. com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24525-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  1395. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
  1396. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
  1397. at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
  1398. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  1399. at java.lang.reflect.Method.invoke(Method.java:498)
  1400. at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
  1401. at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
  1402. at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
  1403. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
  1404. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  1405. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  1406. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  1407. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  1408. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  1409. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
  1410. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  1411. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  1412. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  1413. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  1414. at java.lang.Thread.run(Thread.java:748)
  1415. 2017-12-01 00:02:02,183 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
  1416. 2017-12-01 00:02:02,183 ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) Invocation exception, caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24526-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  1417. 2017-12-01 00:02:02,186 INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) Rethrow exception com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24526-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  1418. 2017-12-01 00:02:02,186 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593) (logid:32b654cc) Done with run of VM work job: com.cloud.vm.VmWorkStart for VM 24526, job origin: 2
  1419. 2017-12-01 00:02:02,186 ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593) (logid:32b654cc) Unable to complete AsyncJobVO {id:73593, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfznQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:02:00 CST 2017}, job origin:2
  1420. com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24526-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  1421. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
  1422. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
  1423. at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
  1424. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  1425. at java.lang.reflect.Method.invoke(Method.java:498)
  1426. at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
  1427. at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
  1428. at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
  1429. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
  1430. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  1431. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  1432. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  1433. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  1434. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  1435. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
  1436. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  1437. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  1438. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  1439. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  1440. at java.lang.Thread.run(Thread.java:748)
  1441. 2017-12-01 00:02:02,186 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593) (logid:32b654cc) Complete async job-73593, jobStatus: FAILED, resultCode: 0, result: rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdABDVW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW1NlY29uZGFyeVN0b3JhZ2VWbXxzLTI0NTI2LVZNXXVyAB5bTGphdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudDsCRio8PP0iOQIAAHhwAAAAFHNyABtqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnRhCcWaJjbdhQIABEkACmxpbmVOdW1iZXJMAA5kZWNsYXJpbmdDbGFzc3EAfgAKTAAIZmlsZU5hbWVxAH4ACkwACm1ldGhvZE5hbWVxAH4ACnhwAAADwHQAJmNvbS5jbG91ZC52bS5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsdAAeVmlydHVhbE1hY2hpbmVNYW5hZ2VySW1wbC5qYXZhdAAQb3JjaGVzdHJhdGVTdGFydHNxAH4AEQAAEgtxAH4AE3EAfgAUcQB-ABVzcQB-ABH_____dAAmc3VuLnJlZmxlY3QuR2VuZXJhdGVkTWV0aG9kQWNjZXNzb3IxOTlwdAAGaW52b2tlc3EAfgARAAAAK3QAKHN1bi5yZWZsZWN0LkRlbGVnYXRpbmdNZXRob2RBY2Nlc3NvckltcGx0ACFEZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsLmphdmFxAH4AGXNxAH4AEQAAAfJ0ABhqYXZhLmxhbmcucmVmbGVjdC5NZXRob2R0AAtNZXRob2QuamF2YXEAfgAZc3EAfgARAAAAa3QAImNvbS5jbG91ZC52bS5WbVdvcmtKb2JIYW5kbGVyUHJveHl0ABpWbVdvcmtKb2JIYW5kbGVyUHJveHkuamF2YXQAD2hhbmRsZVZtV29ya0pvYnNxAH4AEQAAEqxxAH4AE3EAfgAUcQB-ACNzcQB-ABEAAABmdAAgY29tLmNsb3VkLnZtLlZtV29ya0pvYkRpc3BhdGNoZXJ0ABhWbVdvcmtKb2JEaXNwYXRjaGVyLmphdmF0AAZydW5Kb2JzcQB-ABEAAAIqdAA_b3JnLmFwYWNoZS5jbG91ZHN0YWNrLmZyYW1ld29yay5qb2JzLmltcGwuQXN5bmNKb2JNYW5hZ2VySW1wbCQ1dAAYQXN5bmNKb2JNYW5hZ2VySW1wbC5qYXZhdAAMcnVuSW5Db250ZXh0c3EAfgARAAAAMXQAPm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZSQxdAAbTWFuYWdlZENvbnRleHRSdW5uYWJsZS5qYXZhdAADcnVuc3EAfgARAAAAOHQAQm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5EZWZhdWx0TWFuYWdlZENvbnRleHQkMXQAGkRlZmF1bHRNYW5hZ2VkQ29udGV4dC5qYXZhdAAEY2FsbHNxAH4AEQAAAGd0AEBvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0cQB-ADN0AA9jYWxsV2l0aENvbnRleHRzcQB-ABEAAAA1cQB-ADZxAH4AM3QADnJ1bldpdGhDb250ZXh0c3EAfgARAAAALnQAPG9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZXEAfgAvcQB-ADBzcQB-ABEAAAH2cQB-ACpxAH4AK3EAfgAwc3EAfgARAAAB_3QALmphdmEudXRpbC5jb25jdXJyZW50LkV4ZWN1dG9ycyRSdW5uYWJsZUFkYXB0ZXJ0AA5FeGVjdXRvcnMuamF2YXEAfgA0c3EAfgARAAABCnQAH2phdmEudXRpbC5jb25jdXJyZW50LkZ1dHVyZVRhc2t0AA9GdXR1cmVUYXNrLmphdmFxAH4AMHNxAH4AEQAABH10ACdqYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3J0ABdUaHJlYWRQb29sRXhlY3V0b3IuamF2YXQACXJ1bldvcmtlcnNxAH4AEQAAAnB0AC5qYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3IkV29ya2VycQB-AEVxAH4AMHNxAH4AEQAAAux0ABBqYXZhLmxhbmcuVGhyZWFkdAALVGhyZWFkLmphdmFxAH4AMHNyACZqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlTGlzdPwPJTG17I4QAgABTAAEbGlzdHEAfgAMeHIALGphdmEudXRpbC5Db2xsZWN0aW9ucyRVbm1vZGlmaWFibGVDb2xsZWN0aW9uGUIAgMte9x4CAAFMAAFjdAAWTGphdmEvdXRpbC9Db2xsZWN0aW9uO3hwc3IAE2phdmEudXRpbC5BcnJheUxpc3R4gdIdmcdhnQMAAUkABHNpemV4cAAAAAB3BAAAAAB4cQB-AFF4c3IAEWphdmEubGFuZy5JbnRlZ2VyEuKgpPeBhzgCAAFJAAV2YWx1ZXhyABBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAAB4cAAAEO9zcQB-AFAAAAAAdwQAAAAAeHNyAA5qYXZhLmxhbmcuTG9uZzuL5JDMjyPfAgABSgAFdmFsdWV4cQB-AFMAAAAAAAAAAXZyABdjb20uY2xvdWQuZGMuRGF0YUNlbnRlcrLxCuun53i-AgAAeHAA
  1442. 2017-12-01 00:02:02,187 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593) (logid:32b654cc) Publish async job-73593 complete on message bus
  1443. 2017-12-01 00:02:02,187 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593) (logid:32b654cc) Wake up jobs related to job-73593
  1444. 2017-12-01 00:02:02,187 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593) (logid:32b654cc) Update db status for job-73593
  1445. 2017-12-01 00:02:02,188 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593) (logid:32b654cc) Wake up jobs joined with job-73593 and disjoin all subjobs created from job- 73593
  1446. 2017-12-01 00:02:02,193 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593) (logid:32b654cc) Done executing com.cloud.vm.VmWorkStart for job-73593
  1447. 2017-12-01 00:02:02,198 WARN [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) Exception while trying to start secondary storage vm
  1448. com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24526-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  1449. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
  1450. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
  1451. at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
  1452. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  1453. at java.lang.reflect.Method.invoke(Method.java:498)
  1454. at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
  1455. at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
  1456. at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
  1457. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
  1458. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  1459. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  1460. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  1461. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  1462. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  1463. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
  1464. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  1465. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  1466. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  1467. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  1468. at java.lang.Thread.run(Thread.java:748)
  1469. 2017-12-01 00:02:02,198 INFO [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) Unable to start secondary storage vm for standby capacity, vm id : 24526, will recycle it and start a new one
  1470. 2017-12-01 00:02:02,198 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) received secondary storage vm alert
  1471. 2017-12-01 00:02:02,198 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) Secondary Storage Vm creation failure, zone: Zone-Orion
  1472. 2017-12-01 00:02:02,183 INFO [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) Unable to start console proxy vm for standby capacity, vm id : 24525, will recycle it and start a new one
  1473. 2017-12-01 00:02:02,199 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) received console proxy alert
  1474. 2017-12-01 00:02:02,199 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) Console proxy creation failure, zone: Zone-Orion
  1475. 2017-12-01 00:02:02,199 WARN [o.a.c.alerts] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) alertType:: 19 // dataCenterId:: 1 // podId:: null // clusterId:: null // message:: Secondary Storage Vm creation failure. zone: Zone-Orion, error details: null
  1476. 2017-12-01 00:02:02,199 WARN [o.a.c.alerts] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) alertType:: 10 // dataCenterId:: 1 // podId:: null // clusterId:: null // message:: Console proxy creation failure. zone: Zone-Orion, error details: null
  1477. 2017-12-01 00:02:02,203 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593) (logid:32b654cc) Remove job-73593 from job monitoring
  1478. 2017-12-01 00:02:02,206 INFO [o.a.c.s.PremiumSecondaryStorageManagerImpl] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) Primary secondary storage is not even started, wait until next turn
  1479. 2017-12-01 00:02:04,104 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-03429a27) (logid:f8110cbb) Begin cleanup expired async-jobs
  1480. 2017-12-01 00:02:04,109 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-03429a27) (logid:f8110cbb) End cleanup expired async-jobs
  1481. 2017-12-01 00:02:14,104 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-1c3a6d58) (logid:34ad03f9) Begin cleanup expired async-jobs
  1482. 2017-12-01 00:02:14,108 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-1c3a6d58) (logid:34ad03f9) End cleanup expired async-jobs
  1483. 2017-12-01 00:02:15,645 DEBUG [c.c.s.StatsCollector] (StatsCollector-6:ctx-3acf58f2) (logid:f6ebd6ab) HostStatsCollector is running...
  1484. 2017-12-01 00:02:15,652 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-334:ctx-f115684c) (logid:844373e9) Seq 1-3458483038843866940: Executing request
  1485. 2017-12-01 00:02:15,765 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-334:ctx-f115684c) (logid:f6ebd6ab) Seq 1-3458483038843866940: Response Received:
  1486. 2017-12-01 00:02:15,765 DEBUG [c.c.a.t.Request] (StatsCollector-6:ctx-3acf58f2) (logid:f6ebd6ab) Seq 1-3458483038843866940: Received: { Ans: , MgmtId: 345052167237, via: 1(r6-l06-esx01.cisco.com), Ver: v1, Flags: 10, { GetHostStatsAnswer } }
  1487. 2017-12-01 00:02:24,104 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-594ac3cb) (logid:2492e1b1) Begin cleanup expired async-jobs
  1488. 2017-12-01 00:02:24,109 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-594ac3cb) (logid:2492e1b1) End cleanup expired async-jobs
  1489. 2017-12-01 00:02:24,338 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-c64af272) (logid:5a018070) Found 0 routers to update status.
  1490. 2017-12-01 00:02:24,339 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-c64af272) (logid:5a018070) Found 0 VPC networks to update Redundant State.
  1491. 2017-12-01 00:02:24,339 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-c64af272) (logid:5a018070) Found 0 networks to update RvR status.
  1492. 2017-12-01 00:02:30,238 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) Zone 1 is ready to launch console proxy
  1493. 2017-12-01 00:02:30,238 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) Expand console proxy standby capacity for zone Zone-Orion
  1494. 2017-12-01 00:02:30,239 INFO [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) Found a stopped console proxy, starting it. Vm id : 24525
  1495. 2017-12-01 00:02:30,248 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) Sync job-73594 execution on object VmWorkJobQueue.24525
  1496. 2017-12-01 00:02:30,355 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Zone 1 is ready to launch secondary storage VM
  1497. 2017-12-01 00:02:30,357 INFO [o.a.c.s.PremiumSecondaryStorageManagerImpl] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) No running secondary storage vms found in datacenter id=1, starting one
  1498. 2017-12-01 00:02:30,360 INFO [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Found a stopped secondary storage vm, starting it. Vm id : 24526
  1499. 2017-12-01 00:02:30,366 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Sync job-73595 execution on object VmWorkJobQueue.24526
  1500. 2017-12-01 00:02:32,106 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-98b3a9ac) (logid:6671f2c7) Execute sync-queue item: SyncQueueItemVO {id:73576, queueId: 73574, contentType: AsyncJob, contentId: 73594, lastProcessMsid: 345052167237, lastprocessNumber: 2, lastProcessTime: Fri Dec 01 00:02:32 CST 2017, created: Fri Dec 01 00:02:30 CST 2017}
  1501. 2017-12-01 00:02:32,107 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-98b3a9ac) (logid:6671f2c7) Schedule queued job-73594
  1502. 2017-12-01 00:02:32,109 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-98b3a9ac) (logid:6671f2c7) Execute sync-queue item: SyncQueueItemVO {id:73577, queueId: 73575, contentType: AsyncJob, contentId: 73595, lastProcessMsid: 345052167237, lastprocessNumber: 2, lastProcessTime: Fri Dec 01 00:02:32 CST 2017, created: Fri Dec 01 00:02:30 CST 2017}
  1503. 2017-12-01 00:02:32,109 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-98b3a9ac) (logid:6671f2c7) Schedule queued job-73595
  1504. 2017-12-01 00:02:32,110 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594) (logid:6a649155) Add job-73594 into job monitoring
  1505. 2017-12-01 00:02:32,112 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595) (logid:71655c09) Add job-73595 into job monitoring
  1506. 2017-12-01 00:02:32,116 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594) (logid:a98dfed6) Executing AsyncJobVO {id:73594, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfzXQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:02:30 CST 2017}
  1507. 2017-12-01 00:02:32,117 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594) (logid:a98dfed6) Run VM work job: com.cloud.vm.VmWorkStart for VM 24525, job origin: 1
  1508. 2017-12-01 00:02:32,118 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) Execute VM work job: com.cloud.vm.VmWorkStart{"dcId":0,"userId":1,"accountId":1,"vmId":24525,"handlerName":"VirtualMachineManagerImpl"}
  1509. 2017-12-01 00:02:32,118 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595) (logid:32b654cc) Executing AsyncJobVO {id:73595, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfznQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:02:30 CST 2017}
  1510. 2017-12-01 00:02:32,119 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595) (logid:32b654cc) Run VM work job: com.cloud.vm.VmWorkStart for VM 24526, job origin: 2
  1511. 2017-12-01 00:02:32,121 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) Execute VM work job: com.cloud.vm.VmWorkStart{"dcId":0,"userId":1,"accountId":1,"vmId":24526,"handlerName":"VirtualMachineManagerImpl"}
  1512. 2017-12-01 00:02:32,124 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
  1513. 2017-12-01 00:02:32,124 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) Successfully transitioned to start state for VM[ConsoleProxy|v-24525-VM] reservation id = eebf5298-b344-4d23-bb75-acf26107e9f6
  1514. 2017-12-01 00:02:32,125 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) Trying to deploy VM, vm has dcId: 1 and podId: null
  1515. 2017-12-01 00:02:32,125 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) Deploy avoids pods: null, clusters: null, hosts: null
  1516. 2017-12-01 00:02:32,127 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
  1517. 2017-12-01 00:02:32,127 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) Successfully transitioned to start state for VM[SecondaryStorageVm|s-24526-VM] reservation id = 6772c934-3782-4563-9b95-52a6b7561c91
  1518. 2017-12-01 00:02:32,128 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) Trying to deploy VM, vm has dcId: 1 and podId: null
  1519. 2017-12-01 00:02:32,128 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) Deploy avoids pods: null, clusters: null, hosts: null
  1520. 2017-12-01 00:02:32,128 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) Deploy avoids pods: null, clusters: null, hosts: null
  1521. 2017-12-01 00:02:32,129 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@eecdd04
  1522. 2017-12-01 00:02:32,129 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) Trying to allocate a host and storage pools from dc:1, pod:null,cluster:null, requested cpu: 500, requested ram: 1073741824
  1523. 2017-12-01 00:02:32,129 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) Is ROOT volume READY (pool already allocated)?: No
  1524. 2017-12-01 00:02:32,129 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) Searching all possible resources under this Zone: 1
  1525. 2017-12-01 00:02:32,130 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
  1526. 2017-12-01 00:02:32,134 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) Deploy avoids pods: null, clusters: null, hosts: null
  1527. 2017-12-01 00:02:32,136 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@eecdd04
  1528. 2017-12-01 00:02:32,136 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) Trying to allocate a host and storage pools from dc:1, pod:null,cluster:null, requested cpu: 500, requested ram: 536870912
  1529. 2017-12-01 00:02:32,136 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) Is ROOT volume READY (pool already allocated)?: No
  1530. 2017-12-01 00:02:32,136 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) Searching all possible resources under this Zone: 1
  1531. 2017-12-01 00:02:32,137 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
  1532. 2017-12-01 00:02:32,140 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) Checking resources in Cluster: 1 under Pod: 1
  1533. 2017-12-01 00:02:32,140 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33 FirstFitRoutingAllocator) (logid:a98dfed6) Looking for hosts in dc: 1 pod:1 cluster:1
  1534. 2017-12-01 00:02:32,142 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33 FirstFitRoutingAllocator) (logid:a98dfed6) FirstFitAllocator has 1 hosts to check for allocation: [Host[-1-Routing]]
  1535. 2017-12-01 00:02:32,145 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33 FirstFitRoutingAllocator) (logid:a98dfed6) Found 1 hosts for allocation after prioritization: [Host[-1-Routing]]
  1536. 2017-12-01 00:02:32,145 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33 FirstFitRoutingAllocator) (logid:a98dfed6) Looking for speed=500Mhz, Ram=1024
  1537. 2017-12-01 00:02:32,145 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) Checking resources in Cluster: 1 under Pod: 1
  1538. 2017-12-01 00:02:32,145 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133 FirstFitRoutingAllocator) (logid:32b654cc) Looking for hosts in dc: 1 pod:1 cluster:1
  1539. 2017-12-01 00:02:32,147 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133 FirstFitRoutingAllocator) (logid:32b654cc) FirstFitAllocator has 1 hosts to check for allocation: [Host[-1-Routing]]
  1540. 2017-12-01 00:02:32,150 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33 FirstFitRoutingAllocator) (logid:a98dfed6) Host: 1 has cpu capability (cpu:16, speed:2533) to support requested CPU: 1 and requested speed: 500
  1541. 2017-12-01 00:02:32,150 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33 FirstFitRoutingAllocator) (logid:a98dfed6) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  1542. 2017-12-01 00:02:32,150 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133 FirstFitRoutingAllocator) (logid:32b654cc) Found 1 hosts for allocation after prioritization: [Host[-1-Routing]]
  1543. 2017-12-01 00:02:32,150 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133 FirstFitRoutingAllocator) (logid:32b654cc) Looking for speed=500Mhz, Ram=512
  1544. 2017-12-01 00:02:32,152 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33 FirstFitRoutingAllocator) (logid:a98dfed6) Hosts's actual total CPU: 40528 and CPU after applying overprovisioning: 40528
  1545. 2017-12-01 00:02:32,152 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33 FirstFitRoutingAllocator) (logid:a98dfed6) Free CPU: 40528 , Requested CPU: 500
  1546. 2017-12-01 00:02:32,152 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33 FirstFitRoutingAllocator) (logid:a98dfed6) Free RAM: 42880884736 , Requested RAM: 1073741824
  1547. 2017-12-01 00:02:32,152 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33 FirstFitRoutingAllocator) (logid:a98dfed6) Host has enough CPU and RAM available
  1548. 2017-12-01 00:02:32,152 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33 FirstFitRoutingAllocator) (logid:a98dfed6) STATS: Can alloc CPU from host: 1, used: 0, reserved: 0, actual total: 40528, total with overprovisioning: 40528; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1549. 2017-12-01 00:02:32,152 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33 FirstFitRoutingAllocator) (logid:a98dfed6) STATS: Can alloc MEM from host: 1, used: 0, reserved: 0, total: 42880884736; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1550. 2017-12-01 00:02:32,152 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33 FirstFitRoutingAllocator) (logid:a98dfed6) Found a suitable host, adding to list: 1
  1551. 2017-12-01 00:02:32,152 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33 FirstFitRoutingAllocator) (logid:a98dfed6) Host Allocator returning 1 suitable hosts
  1552. 2017-12-01 00:02:32,154 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) Checking suitable pools for volume (Id, Type): (24525,ROOT)
  1553. 2017-12-01 00:02:32,154 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) We need to allocate new storagepool for this volume
  1554. 2017-12-01 00:02:32,154 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) Calling StoragePoolAllocators to find suitable pools
  1555. 2017-12-01 00:02:32,155 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) System VMs will use shared storage for zone id=1
  1556. 2017-12-01 00:02:32,155 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) LocalStoragePoolAllocator trying to find storage pool to fit the vm
  1557. 2017-12-01 00:02:32,155 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) ClusterScopeStoragePoolAllocator looking for storage pool
  1558. 2017-12-01 00:02:32,155 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) Looking for pools in dc: 1 pod:1 cluster:1. Disabled pools will be ignored.
  1559. 2017-12-01 00:02:32,155 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) Found pools matching tags: []
  1560. 2017-12-01 00:02:32,155 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133 FirstFitRoutingAllocator) (logid:32b654cc) Host: 1 has cpu capability (cpu:16, speed:2533) to support requested CPU: 1 and requested speed: 500
  1561. 2017-12-01 00:02:32,155 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133 FirstFitRoutingAllocator) (logid:32b654cc) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 536870912 , cpuOverprovisioningFactor: 1.0
  1562. 2017-12-01 00:02:32,156 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) No storage pools available for shared volume allocation, returning
  1563. 2017-12-01 00:02:32,156 DEBUG [o.a.c.s.a.ZoneWideStoragePoolAllocator] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) ZoneWideStoragePoolAllocator to find storage pool
  1564. 2017-12-01 00:02:32,157 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) No suitable pools found for volume: Vol[24525|vm=24525|ROOT] under cluster: 1
  1565. 2017-12-01 00:02:32,157 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) No suitable pools found
  1566. 2017-12-01 00:02:32,157 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) No suitable storagePools found under this Cluster: 1
  1567. 2017-12-01 00:02:32,157 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133 FirstFitRoutingAllocator) (logid:32b654cc) Hosts's actual total CPU: 40528 and CPU after applying overprovisioning: 40528
  1568. 2017-12-01 00:02:32,157 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133 FirstFitRoutingAllocator) (logid:32b654cc) Free CPU: 40528 , Requested CPU: 500
  1569. 2017-12-01 00:02:32,157 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133 FirstFitRoutingAllocator) (logid:32b654cc) Free RAM: 42880884736 , Requested RAM: 536870912
  1570. 2017-12-01 00:02:32,157 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133 FirstFitRoutingAllocator) (logid:32b654cc) Host has enough CPU and RAM available
  1571. 2017-12-01 00:02:32,157 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133 FirstFitRoutingAllocator) (logid:32b654cc) STATS: Can alloc CPU from host: 1, used: 0, reserved: 0, actual total: 40528, total with overprovisioning: 40528; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1572. 2017-12-01 00:02:32,157 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133 FirstFitRoutingAllocator) (logid:32b654cc) STATS: Can alloc MEM from host: 1, used: 0, reserved: 0, total: 42880884736; requested mem: 536870912,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1573. 2017-12-01 00:02:32,157 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133 FirstFitRoutingAllocator) (logid:32b654cc) Found a suitable host, adding to list: 1
  1574. 2017-12-01 00:02:32,157 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133 FirstFitRoutingAllocator) (logid:32b654cc) Host Allocator returning 1 suitable hosts
  1575. 2017-12-01 00:02:32,157 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) Could not find suitable Deployment Destination for this VM under any clusters, returning.
  1576. 2017-12-01 00:02:32,157 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) Searching all possible resources under this Zone: 1
  1577. 2017-12-01 00:02:32,158 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
  1578. 2017-12-01 00:02:32,159 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) Checking suitable pools for volume (Id, Type): (24526,ROOT)
  1579. 2017-12-01 00:02:32,159 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) We need to allocate new storagepool for this volume
  1580. 2017-12-01 00:02:32,159 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) Removing from the clusterId list these clusters from avoid set: [1]
  1581. 2017-12-01 00:02:32,159 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) No clusters found after removing disabled clusters and clusters in avoid list, returning.
  1582. 2017-12-01 00:02:32,160 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) Calling StoragePoolAllocators to find suitable pools
  1583. 2017-12-01 00:02:32,160 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) System VMs will use shared storage for zone id=1
  1584. 2017-12-01 00:02:32,160 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) LocalStoragePoolAllocator trying to find storage pool to fit the vm
  1585. 2017-12-01 00:02:32,160 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) ClusterScopeStoragePoolAllocator looking for storage pool
  1586. 2017-12-01 00:02:32,160 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) Looking for pools in dc: 1 pod:1 cluster:1. Disabled pools will be ignored.
  1587. 2017-12-01 00:02:32,161 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) Found pools matching tags: []
  1588. 2017-12-01 00:02:32,161 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) No storage pools available for shared volume allocation, returning
  1589. 2017-12-01 00:02:32,161 DEBUG [o.a.c.s.a.ZoneWideStoragePoolAllocator] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) ZoneWideStoragePoolAllocator to find storage pool
  1590. 2017-12-01 00:02:32,162 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) No suitable pools found for volume: Vol[24526|vm=24526|ROOT] under cluster: 1
  1591. 2017-12-01 00:02:32,162 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) No suitable pools found
  1592. 2017-12-01 00:02:32,162 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) No suitable storagePools found under this Cluster: 1
  1593. 2017-12-01 00:02:32,163 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) Could not find suitable Deployment Destination for this VM under any clusters, returning.
  1594. 2017-12-01 00:02:32,163 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) Searching all possible resources under this Zone: 1
  1595. 2017-12-01 00:02:32,163 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
  1596. 2017-12-01 00:02:32,164 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) Removing from the clusterId list these clusters from avoid set: [1]
  1597. 2017-12-01 00:02:32,165 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) No clusters found after removing disabled clusters and clusters in avoid list, returning.
  1598. 2017-12-01 00:02:32,166 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
  1599. 2017-12-01 00:02:32,166 ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) Invocation exception, caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24525-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  1600. 2017-12-01 00:02:32,166 INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) Rethrow exception com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24525-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  1601. 2017-12-01 00:02:32,166 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594) (logid:a98dfed6) Done with run of VM work job: com.cloud.vm.VmWorkStart for VM 24525, job origin: 1
  1602. 2017-12-01 00:02:32,166 ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594) (logid:a98dfed6) Unable to complete AsyncJobVO {id:73594, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfzXQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:02:30 CST 2017}, job origin:1
  1603. com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24525-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  1604. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
  1605. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
  1606. at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
  1607. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  1608. at java.lang.reflect.Method.invoke(Method.java:498)
  1609. at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
  1610. at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
  1611. at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
  1612. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
  1613. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  1614. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  1615. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  1616. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  1617. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  1618. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
  1619. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  1620. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  1621. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  1622. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  1623. at java.lang.Thread.run(Thread.java:748)
  1624. 2017-12-01 00:02:32,167 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594) (logid:a98dfed6) Complete async job-73594, jobStatus: FAILED, resultCode: 0, result: rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdAA9VW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW0NvbnNvbGVQcm94eXx2LTI0NTI1LVZNXXVyAB5bTGphdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudDsCRio8PP0iOQIAAHhwAAAAFHNyABtqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnRhCcWaJjbdhQIABEkACmxpbmVOdW1iZXJMAA5kZWNsYXJpbmdDbGFzc3EAfgAKTAAIZmlsZU5hbWVxAH4ACkwACm1ldGhvZE5hbWVxAH4ACnhwAAADwHQAJmNvbS5jbG91ZC52bS5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsdAAeVmlydHVhbE1hY2hpbmVNYW5hZ2VySW1wbC5qYXZhdAAQb3JjaGVzdHJhdGVTdGFydHNxAH4AEQAAEgtxAH4AE3EAfgAUcQB-ABVzcQB-ABH_____dAAmc3VuLnJlZmxlY3QuR2VuZXJhdGVkTWV0aG9kQWNjZXNzb3IxOTlwdAAGaW52b2tlc3EAfgARAAAAK3QAKHN1bi5yZWZsZWN0LkRlbGVnYXRpbmdNZXRob2RBY2Nlc3NvckltcGx0ACFEZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsLmphdmFxAH4AGXNxAH4AEQAAAfJ0ABhqYXZhLmxhbmcucmVmbGVjdC5NZXRob2R0AAtNZXRob2QuamF2YXEAfgAZc3EAfgARAAAAa3QAImNvbS5jbG91ZC52bS5WbVdvcmtKb2JIYW5kbGVyUHJveHl0ABpWbVdvcmtKb2JIYW5kbGVyUHJveHkuamF2YXQAD2hhbmRsZVZtV29ya0pvYnNxAH4AEQAAEqxxAH4AE3EAfgAUcQB-ACNzcQB-ABEAAABmdAAgY29tLmNsb3VkLnZtLlZtV29ya0pvYkRpc3BhdGNoZXJ0ABhWbVdvcmtKb2JEaXNwYXRjaGVyLmphdmF0AAZydW5Kb2JzcQB-ABEAAAIqdAA_b3JnLmFwYWNoZS5jbG91ZHN0YWNrLmZyYW1ld29yay5qb2JzLmltcGwuQXN5bmNKb2JNYW5hZ2VySW1wbCQ1dAAYQXN5bmNKb2JNYW5hZ2VySW1wbC5qYXZhdAAMcnVuSW5Db250ZXh0c3EAfgARAAAAMXQAPm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZSQxdAAbTWFuYWdlZENvbnRleHRSdW5uYWJsZS5qYXZhdAADcnVuc3EAfgARAAAAOHQAQm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5EZWZhdWx0TWFuYWdlZENvbnRleHQkMXQAGkRlZmF1bHRNYW5hZ2VkQ29udGV4dC5qYXZhdAAEY2FsbHNxAH4AEQAAAGd0AEBvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0cQB-ADN0AA9jYWxsV2l0aENvbnRleHRzcQB-ABEAAAA1cQB-ADZxAH4AM3QADnJ1bldpdGhDb250ZXh0c3EAfgARAAAALnQAPG9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZXEAfgAvcQB-ADBzcQB-ABEAAAH2cQB-ACpxAH4AK3EAfgAwc3EAfgARAAAB_3QALmphdmEudXRpbC5jb25jdXJyZW50LkV4ZWN1dG9ycyRSdW5uYWJsZUFkYXB0ZXJ0AA5FeGVjdXRvcnMuamF2YXEAfgA0c3EAfgARAAABCnQAH2phdmEudXRpbC5jb25jdXJyZW50LkZ1dHVyZVRhc2t0AA9GdXR1cmVUYXNrLmphdmFxAH4AMHNxAH4AEQAABH10ACdqYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3J0ABdUaHJlYWRQb29sRXhlY3V0b3IuamF2YXQACXJ1bldvcmtlcnNxAH4AEQAAAnB0AC5qYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3IkV29ya2VycQB-AEVxAH4AMHNxAH4AEQAAAux0ABBqYXZhLmxhbmcuVGhyZWFkdAALVGhyZWFkLmphdmFxAH4AMHNyACZqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlTGlzdPwPJTG17I4QAgABTAAEbGlzdHEAfgAMeHIALGphdmEudXRpbC5Db2xsZWN0aW9ucyRVbm1vZGlmaWFibGVDb2xsZWN0aW9uGUIAgMte9x4CAAFMAAFjdAAWTGphdmEvdXRpbC9Db2xsZWN0aW9uO3hwc3IAE2phdmEudXRpbC5BcnJheUxpc3R4gdIdmcdhnQMAAUkABHNpemV4cAAAAAB3BAAAAAB4cQB-AFF4c3IAEWphdmEubGFuZy5JbnRlZ2VyEuKgpPeBhzgCAAFJAAV2YWx1ZXhyABBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAAB4cAAAEO9zcQB-AFAAAAAAdwQAAAAAeHNyAA5qYXZhLmxhbmcuTG9uZzuL5JDMjyPfAgABSgAFdmFsdWV4cQB-AFMAAAAAAAAAAXZyABdjb20uY2xvdWQuZGMuRGF0YUNlbnRlcrLxCuun53i-AgAAeHAA
  1625. 2017-12-01 00:02:32,167 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594) (logid:a98dfed6) Publish async job-73594 complete on message bus
  1626. 2017-12-01 00:02:32,167 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594) (logid:a98dfed6) Wake up jobs related to job-73594
  1627. 2017-12-01 00:02:32,167 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594) (logid:a98dfed6) Update db status for job-73594
  1628. 2017-12-01 00:02:32,168 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594) (logid:a98dfed6) Wake up jobs joined with job-73594 and disjoin all subjobs created from job- 73594
  1629. 2017-12-01 00:02:32,173 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594) (logid:a98dfed6) Done executing com.cloud.vm.VmWorkStart for job-73594
  1630. 2017-12-01 00:02:32,174 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594) (logid:a98dfed6) Remove job-73594 from job monitoring
  1631. 2017-12-01 00:02:32,181 WARN [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) Exception while trying to start console proxy
  1632. com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24525-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  1633. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
  1634. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
  1635. at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
  1636. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  1637. at java.lang.reflect.Method.invoke(Method.java:498)
  1638. at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
  1639. at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
  1640. at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
  1641. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
  1642. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  1643. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  1644. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  1645. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  1646. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  1647. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
  1648. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  1649. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  1650. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  1651. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  1652. at java.lang.Thread.run(Thread.java:748)
  1653. 2017-12-01 00:02:32,181 INFO [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) Unable to start console proxy vm for standby capacity, vm id : 24525, will recycle it and start a new one
  1654. 2017-12-01 00:02:32,181 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
  1655. 2017-12-01 00:02:32,181 ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) Invocation exception, caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24526-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  1656. 2017-12-01 00:02:32,185 INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) Rethrow exception com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24526-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  1657. 2017-12-01 00:02:32,185 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595) (logid:32b654cc) Done with run of VM work job: com.cloud.vm.VmWorkStart for VM 24526, job origin: 2
  1658. 2017-12-01 00:02:32,185 ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595) (logid:32b654cc) Unable to complete AsyncJobVO {id:73595, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfznQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:02:30 CST 2017}, job origin:2
  1659. com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24526-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  1660. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
  1661. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
  1662. at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
  1663. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  1664. at java.lang.reflect.Method.invoke(Method.java:498)
  1665. at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
  1666. at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
  1667. at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
  1668. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
  1669. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  1670. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  1671. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  1672. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  1673. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  1674. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
  1675. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  1676. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  1677. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  1678. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  1679. at java.lang.Thread.run(Thread.java:748)
  1680. 2017-12-01 00:02:32,186 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595) (logid:32b654cc) Complete async job-73595, jobStatus: FAILED, resultCode: 0, result: rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdABDVW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW1NlY29uZGFyeVN0b3JhZ2VWbXxzLTI0NTI2LVZNXXVyAB5bTGphdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudDsCRio8PP0iOQIAAHhwAAAAFHNyABtqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnRhCcWaJjbdhQIABEkACmxpbmVOdW1iZXJMAA5kZWNsYXJpbmdDbGFzc3EAfgAKTAAIZmlsZU5hbWVxAH4ACkwACm1ldGhvZE5hbWVxAH4ACnhwAAADwHQAJmNvbS5jbG91ZC52bS5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsdAAeVmlydHVhbE1hY2hpbmVNYW5hZ2VySW1wbC5qYXZhdAAQb3JjaGVzdHJhdGVTdGFydHNxAH4AEQAAEgtxAH4AE3EAfgAUcQB-ABVzcQB-ABH_____dAAmc3VuLnJlZmxlY3QuR2VuZXJhdGVkTWV0aG9kQWNjZXNzb3IxOTlwdAAGaW52b2tlc3EAfgARAAAAK3QAKHN1bi5yZWZsZWN0LkRlbGVnYXRpbmdNZXRob2RBY2Nlc3NvckltcGx0ACFEZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsLmphdmFxAH4AGXNxAH4AEQAAAfJ0ABhqYXZhLmxhbmcucmVmbGVjdC5NZXRob2R0AAtNZXRob2QuamF2YXEAfgAZc3EAfgARAAAAa3QAImNvbS5jbG91ZC52bS5WbVdvcmtKb2JIYW5kbGVyUHJveHl0ABpWbVdvcmtKb2JIYW5kbGVyUHJveHkuamF2YXQAD2hhbmRsZVZtV29ya0pvYnNxAH4AEQAAEqxxAH4AE3EAfgAUcQB-ACNzcQB-ABEAAABmdAAgY29tLmNsb3VkLnZtLlZtV29ya0pvYkRpc3BhdGNoZXJ0ABhWbVdvcmtKb2JEaXNwYXRjaGVyLmphdmF0AAZydW5Kb2JzcQB-ABEAAAIqdAA_b3JnLmFwYWNoZS5jbG91ZHN0YWNrLmZyYW1ld29yay5qb2JzLmltcGwuQXN5bmNKb2JNYW5hZ2VySW1wbCQ1dAAYQXN5bmNKb2JNYW5hZ2VySW1wbC5qYXZhdAAMcnVuSW5Db250ZXh0c3EAfgARAAAAMXQAPm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZSQxdAAbTWFuYWdlZENvbnRleHRSdW5uYWJsZS5qYXZhdAADcnVuc3EAfgARAAAAOHQAQm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5EZWZhdWx0TWFuYWdlZENvbnRleHQkMXQAGkRlZmF1bHRNYW5hZ2VkQ29udGV4dC5qYXZhdAAEY2FsbHNxAH4AEQAAAGd0AEBvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0cQB-ADN0AA9jYWxsV2l0aENvbnRleHRzcQB-ABEAAAA1cQB-ADZxAH4AM3QADnJ1bldpdGhDb250ZXh0c3EAfgARAAAALnQAPG9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZXEAfgAvcQB-ADBzcQB-ABEAAAH2cQB-ACpxAH4AK3EAfgAwc3EAfgARAAAB_3QALmphdmEudXRpbC5jb25jdXJyZW50LkV4ZWN1dG9ycyRSdW5uYWJsZUFkYXB0ZXJ0AA5FeGVjdXRvcnMuamF2YXEAfgA0c3EAfgARAAABCnQAH2phdmEudXRpbC5jb25jdXJyZW50LkZ1dHVyZVRhc2t0AA9GdXR1cmVUYXNrLmphdmFxAH4AMHNxAH4AEQAABH10ACdqYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3J0ABdUaHJlYWRQb29sRXhlY3V0b3IuamF2YXQACXJ1bldvcmtlcnNxAH4AEQAAAnB0AC5qYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3IkV29ya2VycQB-AEVxAH4AMHNxAH4AEQAAAux0ABBqYXZhLmxhbmcuVGhyZWFkdAALVGhyZWFkLmphdmFxAH4AMHNyACZqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlTGlzdPwPJTG17I4QAgABTAAEbGlzdHEAfgAMeHIALGphdmEudXRpbC5Db2xsZWN0aW9ucyRVbm1vZGlmaWFibGVDb2xsZWN0aW9uGUIAgMte9x4CAAFMAAFjdAAWTGphdmEvdXRpbC9Db2xsZWN0aW9uO3hwc3IAE2phdmEudXRpbC5BcnJheUxpc3R4gdIdmcdhnQMAAUkABHNpemV4cAAAAAB3BAAAAAB4cQB-AFF4c3IAEWphdmEubGFuZy5JbnRlZ2VyEuKgpPeBhzgCAAFJAAV2YWx1ZXhyABBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAAB4cAAAEO9zcQB-AFAAAAAAdwQAAAAAeHNyAA5qYXZhLmxhbmcuTG9uZzuL5JDMjyPfAgABSgAFdmFsdWV4cQB-AFMAAAAAAAAAAXZyABdjb20uY2xvdWQuZGMuRGF0YUNlbnRlcrLxCuun53i-AgAAeHAA
  1681. 2017-12-01 00:02:32,188 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595) (logid:32b654cc) Publish async job-73595 complete on message bus
  1682. 2017-12-01 00:02:32,188 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595) (logid:32b654cc) Wake up jobs related to job-73595
  1683. 2017-12-01 00:02:32,188 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595) (logid:32b654cc) Update db status for job-73595
  1684. 2017-12-01 00:02:32,189 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595) (logid:32b654cc) Wake up jobs joined with job-73595 and disjoin all subjobs created from job- 73595
  1685. 2017-12-01 00:02:32,195 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595) (logid:32b654cc) Done executing com.cloud.vm.VmWorkStart for job-73595
  1686. 2017-12-01 00:02:32,196 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595) (logid:32b654cc) Remove job-73595 from job monitoring
  1687. 2017-12-01 00:02:32,203 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) Sync job-73596 execution on object VmWorkJobQueue.24525
  1688. 2017-12-01 00:02:32,206 WARN [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Exception while trying to start secondary storage vm
  1689. com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24526-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  1690. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
  1691. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
  1692. at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
  1693. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  1694. at java.lang.reflect.Method.invoke(Method.java:498)
  1695. at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
  1696. at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
  1697. at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
  1698. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
  1699. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  1700. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  1701. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  1702. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  1703. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  1704. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
  1705. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  1706. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  1707. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  1708. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  1709. at java.lang.Thread.run(Thread.java:748)
  1710. 2017-12-01 00:02:32,207 INFO [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Unable to start secondary storage vm for standby capacity, vm id : 24526, will recycle it and start a new one
  1711. 2017-12-01 00:02:32,232 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Sync job-73597 execution on object VmWorkJobQueue.24526
  1712. 2017-12-01 00:02:33,496 INFO [c.c.h.v.r.VmwareResource] (DirectAgentCronJob-384:ctx-1ad9b4f5) (logid:a81378fd) Scan hung worker VM to recycle
  1713. 2017-12-01 00:02:33,679 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgentCronJob-384:ctx-1ad9b4f5) (logid:a81378fd) Ping from 1(r6-l06-esx01.cisco.com)
  1714. 2017-12-01 00:02:33,679 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-384:ctx-1ad9b4f5) (logid:a81378fd) Process host VM state report from ping process. host: 1
  1715. 2017-12-01 00:02:33,679 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-384:ctx-1ad9b4f5) (logid:a81378fd) Process VM state report. host: 1, number of records in report: 0
  1716. 2017-12-01 00:02:33,681 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-384:ctx-1ad9b4f5) (logid:a81378fd) Done with process of VM state report. host: 1
  1717. 2017-12-01 00:02:34,106 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-ae06fe36) (logid:e400cce1) Execute sync-queue item: SyncQueueItemVO {id:73578, queueId: 73574, contentType: AsyncJob, contentId: 73596, lastProcessMsid: 345052167237, lastprocessNumber: 3, lastProcessTime: Fri Dec 01 00:02:34 CST 2017, created: Fri Dec 01 00:02:32 CST 2017}
  1718. 2017-12-01 00:02:34,107 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-ae06fe36) (logid:e400cce1) Schedule queued job-73596
  1719. 2017-12-01 00:02:34,109 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-ae06fe36) (logid:e400cce1) Execute sync-queue item: SyncQueueItemVO {id:73579, queueId: 73575, contentType: AsyncJob, contentId: 73597, lastProcessMsid: 345052167237, lastprocessNumber: 3, lastProcessTime: Fri Dec 01 00:02:34 CST 2017, created: Fri Dec 01 00:02:32 CST 2017}
  1720. 2017-12-01 00:02:34,110 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-ae06fe36) (logid:e400cce1) Schedule queued job-73597
  1721. 2017-12-01 00:02:34,110 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-41:ctx-261a669f job-1/job-73596) (logid:6131d308) Add job-73596 into job monitoring
  1722. 2017-12-01 00:02:34,114 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-c47f8708) (logid:73eda64c) Begin cleanup expired async-jobs
  1723. 2017-12-01 00:02:34,114 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-41:ctx-261a669f job-1/job-73596) (logid:a98dfed6) Executing AsyncJobVO {id:73596, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStop, cmdInfo: rO0ABXNyABdjb20uY2xvdWQudm0uVm1Xb3JrU3RvcALQ4GymiWjjAgABWgAHY2xlYW51cHhyABNjb20uY2xvdWQudm0uVm1Xb3Jrn5m2VvAlZ2sCAARKAAlhY2NvdW50SWRKAAZ1c2VySWRKAAR2bUlkTAALaGFuZGxlck5hbWV0ABJMamF2YS9sYW5nL1N0cmluZzt4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfzXQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:02:32 CST 2017}
  1724. 2017-12-01 00:02:34,115 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-41:ctx-261a669f job-1/job-73596) (logid:a98dfed6) Run VM work job: com.cloud.vm.VmWorkStop for VM 24525, job origin: 1
  1725. 2017-12-01 00:02:34,115 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-40:ctx-cfdbeef1 job-2/job-73597) (logid:17f979d4) Add job-73597 into job monitoring
  1726. 2017-12-01 00:02:34,119 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-c47f8708) (logid:73eda64c) End cleanup expired async-jobs
  1727. 2017-12-01 00:02:34,120 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-40:ctx-cfdbeef1 job-2/job-73597) (logid:32b654cc) Executing AsyncJobVO {id:73597, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStop, cmdInfo: rO0ABXNyABdjb20uY2xvdWQudm0uVm1Xb3JrU3RvcALQ4GymiWjjAgABWgAHY2xlYW51cHhyABNjb20uY2xvdWQudm0uVm1Xb3Jrn5m2VvAlZ2sCAARKAAlhY2NvdW50SWRKAAZ1c2VySWRKAAR2bUlkTAALaGFuZGxlck5hbWV0ABJMamF2YS9sYW5nL1N0cmluZzt4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfznQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:02:32 CST 2017}
  1728. 2017-12-01 00:02:34,120 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-40:ctx-cfdbeef1 job-2/job-73597) (logid:32b654cc) Run VM work job: com.cloud.vm.VmWorkStop for VM 24526, job origin: 2
  1729. 2017-12-01 00:02:34,120 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-41:ctx-261a669f job-1/job-73596 ctx-f13b619d) (logid:a98dfed6) Execute VM work job: com.cloud.vm.VmWorkStop{"cleanup":false,"userId":1,"accountId":1,"vmId":24525,"handlerName":"VirtualMachineManagerImpl"}
  1730. 2017-12-01 00:02:34,121 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-40:ctx-cfdbeef1 job-2/job-73597 ctx-19abb798) (logid:32b654cc) Execute VM work job: com.cloud.vm.VmWorkStop{"cleanup":false,"userId":1,"accountId":1,"vmId":24526,"handlerName":"VirtualMachineManagerImpl"}
  1731. 2017-12-01 00:02:34,122 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-41:ctx-261a669f job-1/job-73596 ctx-f13b619d) (logid:a98dfed6) VM is already stopped: VM[ConsoleProxy|v-24525-VM]
  1732. 2017-12-01 00:02:34,122 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-41:ctx-261a669f job-1/job-73596 ctx-f13b619d) (logid:a98dfed6) Done executing VM work job: com.cloud.vm.VmWorkStop{"cleanup":false,"userId":1,"accountId":1,"vmId":24525,"handlerName":"VirtualMachineManagerImpl"}
  1733. 2017-12-01 00:02:34,122 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-41:ctx-261a669f job-1/job-73596 ctx-f13b619d) (logid:a98dfed6) Complete async job-73596, jobStatus: SUCCEEDED, resultCode: 0, result: null
  1734. 2017-12-01 00:02:34,123 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-40:ctx-cfdbeef1 job-2/job-73597 ctx-19abb798) (logid:32b654cc) VM is already stopped: VM[SecondaryStorageVm|s-24526-VM]
  1735. 2017-12-01 00:02:34,123 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-40:ctx-cfdbeef1 job-2/job-73597 ctx-19abb798) (logid:32b654cc) Done executing VM work job: com.cloud.vm.VmWorkStop{"cleanup":false,"userId":1,"accountId":1,"vmId":24526,"handlerName":"VirtualMachineManagerImpl"}
  1736. 2017-12-01 00:02:34,123 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-40:ctx-cfdbeef1 job-2/job-73597 ctx-19abb798) (logid:32b654cc) Complete async job-73597, jobStatus: SUCCEEDED, resultCode: 0, result: null
  1737. 2017-12-01 00:02:34,123 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-41:ctx-261a669f job-1/job-73596 ctx-f13b619d) (logid:a98dfed6) Publish async job-73596 complete on message bus
  1738. 2017-12-01 00:02:34,123 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-41:ctx-261a669f job-1/job-73596 ctx-f13b619d) (logid:a98dfed6) Wake up jobs related to job-73596
  1739. 2017-12-01 00:02:34,123 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-41:ctx-261a669f job-1/job-73596 ctx-f13b619d) (logid:a98dfed6) Update db status for job-73596
  1740. 2017-12-01 00:02:34,124 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-40:ctx-cfdbeef1 job-2/job-73597 ctx-19abb798) (logid:32b654cc) Publish async job-73597 complete on message bus
  1741. 2017-12-01 00:02:34,124 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-40:ctx-cfdbeef1 job-2/job-73597 ctx-19abb798) (logid:32b654cc) Wake up jobs related to job-73597
  1742. 2017-12-01 00:02:34,124 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-40:ctx-cfdbeef1 job-2/job-73597 ctx-19abb798) (logid:32b654cc) Update db status for job-73597
  1743. 2017-12-01 00:02:34,124 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-41:ctx-261a669f job-1/job-73596 ctx-f13b619d) (logid:a98dfed6) Wake up jobs joined with job-73596 and disjoin all subjobs created from job- 73596
  1744. 2017-12-01 00:02:34,124 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-40:ctx-cfdbeef1 job-2/job-73597 ctx-19abb798) (logid:32b654cc) Wake up jobs joined with job-73597 and disjoin all subjobs created from job- 73597
  1745. 2017-12-01 00:02:34,128 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-41:ctx-261a669f job-1/job-73596) (logid:a98dfed6) Done with run of VM work job: com.cloud.vm.VmWorkStop for VM 24525, job origin: 1
  1746. 2017-12-01 00:02:34,128 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-41:ctx-261a669f job-1/job-73596) (logid:a98dfed6) Done executing com.cloud.vm.VmWorkStop for job-73596
  1747. 2017-12-01 00:02:34,130 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-40:ctx-cfdbeef1 job-2/job-73597) (logid:32b654cc) Done with run of VM work job: com.cloud.vm.VmWorkStop for VM 24526, job origin: 2
  1748. 2017-12-01 00:02:34,130 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-40:ctx-cfdbeef1 job-2/job-73597) (logid:32b654cc) Done executing com.cloud.vm.VmWorkStop for job-73597
  1749. 2017-12-01 00:02:34,136 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-41:ctx-261a669f job-1/job-73596) (logid:a98dfed6) Remove job-73596 from job monitoring
  1750. 2017-12-01 00:02:34,137 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-40:ctx-cfdbeef1 job-2/job-73597) (logid:32b654cc) Remove job-73597 from job monitoring
  1751. 2017-12-01 00:02:34,139 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) VM state transitted from :Stopped to Expunging with event: ExpungeOperationvm's original host id: null new host id: null host id before state transition: null
  1752. 2017-12-01 00:02:34,139 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) Destroying vm VM[ConsoleProxy|v-24525-VM]
  1753. 2017-12-01 00:02:34,139 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) Cleaning up NICS
  1754. 2017-12-01 00:02:34,141 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) VM state transitted from :Stopped to Expunging with event: ExpungeOperationvm's original host id: null new host id: null host id before state transition: null
  1755. 2017-12-01 00:02:34,141 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Destroying vm VM[SecondaryStorageVm|s-24526-VM]
  1756. 2017-12-01 00:02:34,141 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Cleaning up NICS
  1757. 2017-12-01 00:02:34,143 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) Cleaning network for vm: 24525
  1758. 2017-12-01 00:02:34,145 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Cleaning network for vm: 24526
  1759. 2017-12-01 00:02:34,149 DEBUG [c.c.n.g.PublicNetworkGuru] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) public network deallocate network: networkId: 200, ip: 10.89.98.210
  1760. 2017-12-01 00:02:34,151 DEBUG [c.c.n.g.PublicNetworkGuru] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) public network deallocate network: networkId: 200, ip: 10.89.98.211
  1761. 2017-12-01 00:02:34,153 DEBUG [c.c.n.g.PublicNetworkGuru] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) Deallocated nic: NicProfile[85835-24525-null-null-null
  1762. 2017-12-01 00:02:34,155 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) Removed nic id=85835
  1763. 2017-12-01 00:02:34,155 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) Revoving nic secondary ip entry ...
  1764. 2017-12-01 00:02:34,155 DEBUG [c.c.n.g.PublicNetworkGuru] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Deallocated nic: NicProfile[85838-24526-null-null-null
  1765. 2017-12-01 00:02:34,157 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Removed nic id=85838
  1766. 2017-12-01 00:02:34,158 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Revoving nic secondary ip entry ...
  1767. 2017-12-01 00:02:34,163 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) Removed nic id=85836
  1768. 2017-12-01 00:02:34,164 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) Revoving nic secondary ip entry ...
  1769. 2017-12-01 00:02:34,165 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Removed nic id=85839
  1770. 2017-12-01 00:02:34,166 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Revoving nic secondary ip entry ...
  1771. 2017-12-01 00:02:34,170 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) Removed nic id=85837
  1772. 2017-12-01 00:02:34,171 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) Revoving nic secondary ip entry ...
  1773. 2017-12-01 00:02:34,171 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) Cleaning up hypervisor data structures (ex. SRs in XenServer) for managed storage
  1774. 2017-12-01 00:02:34,172 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Removed nic id=85840
  1775. 2017-12-01 00:02:34,173 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Revoving nic secondary ip entry ...
  1776. 2017-12-01 00:02:34,173 DEBUG [o.a.c.e.o.VolumeOrchestrator] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) Cleaning storage for vm: 24525
  1777. 2017-12-01 00:02:34,180 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Removed nic id=85841
  1778. 2017-12-01 00:02:34,181 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Revoving nic secondary ip entry ...
  1779. 2017-12-01 00:02:34,181 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Cleaning up hypervisor data structures (ex. SRs in XenServer) for managed storage
  1780. 2017-12-01 00:02:34,183 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) Expunge volume with no data store specified
  1781. 2017-12-01 00:02:34,183 DEBUG [o.a.c.e.o.VolumeOrchestrator] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Cleaning storage for vm: 24526
  1782. 2017-12-01 00:02:34,185 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) Volume 24525 is not referred anywhere, remove it from volumes table
  1783. 2017-12-01 00:02:34,190 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) Expunged VM[ConsoleProxy|v-24525-VM]
  1784. 2017-12-01 00:02:34,193 INFO [o.a.c.s.v.VolumeServiceImpl] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Expunge volume with no data store specified
  1785. 2017-12-01 00:02:34,194 INFO [o.a.c.s.v.VolumeServiceImpl] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Volume 24526 is not referred anywhere, remove it from volumes table
  1786. 2017-12-01 00:02:34,195 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) received console proxy alert
  1787. 2017-12-01 00:02:34,195 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) Console proxy creation failure, zone: Zone-Orion
  1788. 2017-12-01 00:02:34,196 WARN [o.a.c.alerts] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) alertType:: 10 // dataCenterId:: 1 // podId:: null // clusterId:: null // message:: Console proxy creation failure. zone: Zone-Orion, error details: null
  1789. 2017-12-01 00:02:34,202 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Expunged VM[SecondaryStorageVm|s-24526-VM]
  1790. 2017-12-01 00:02:34,205 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) received secondary storage vm alert
  1791. 2017-12-01 00:02:34,205 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Secondary Storage Vm creation failure, zone: Zone-Orion
  1792. 2017-12-01 00:02:34,206 WARN [o.a.c.alerts] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) alertType:: 19 // dataCenterId:: 1 // podId:: null // clusterId:: null // message:: Secondary Storage Vm creation failure. zone: Zone-Orion, error details: null
  1793. 2017-12-01 00:02:34,209 INFO [o.a.c.s.PremiumSecondaryStorageManagerImpl] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Primary secondary storage is not even started, wait until next turn
  1794. 2017-12-01 00:02:38,374 DEBUG [c.c.s.StatsCollector] (StatsCollector-5:ctx-5a8d12e7) (logid:1a825310) AutoScaling Monitor is running...
  1795. 2017-12-01 00:02:44,104 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-65902106) (logid:34358bde) Begin cleanup expired async-jobs
  1796. 2017-12-01 00:02:44,108 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-65902106) (logid:34358bde) End cleanup expired async-jobs
  1797. 2017-12-01 00:02:52,036 DEBUG [c.c.s.StatsCollector] (StatsCollector-4:ctx-84ec1561) (logid:2bd3dea3) StorageCollector is running...
  1798. 2017-12-01 00:02:52,041 DEBUG [c.c.s.StatsCollector] (StatsCollector-4:ctx-84ec1561) (logid:2bd3dea3) There is no secondary storage VM for secondary storage host secondary
  1799. 2017-12-01 00:02:52,042 DEBUG [c.c.h.o.r.Ovm3HypervisorGuru] (StatsCollector-4:ctx-84ec1561) (logid:2bd3dea3) getCommandHostDelegation: class com.cloud.agent.api.GetStorageStatsCommand
  1800. 2017-12-01 00:02:52,042 DEBUG [c.c.h.XenServerGuru] (StatsCollector-4:ctx-84ec1561) (logid:2bd3dea3) getCommandHostDelegation: class com.cloud.agent.api.GetStorageStatsCommand
  1801. 2017-12-01 00:02:52,043 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-84:ctx-0000b415) (logid:bc7f5bb2) Seq 1-3458483038843866941: Executing request
  1802. 2017-12-01 00:02:52,170 DEBUG [c.c.h.v.r.VmwareResource] (DirectAgent-84:ctx-0000b415 r6-l06-esx01.cisco.com, cmd: GetStorageStatsCommand) (logid:2bd3dea3) Datastore summary info, storageId: 260fa543-e292-4f78-820c-dae49505e528, localPath: datastore-2475, poolType: VMFS, capacity: 1751809785856, free: 1750779035648, used: 1030750208
  1803. 2017-12-01 00:02:52,170 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-84:ctx-0000b415) (logid:2bd3dea3) Seq 1-3458483038843866941: Response Received:
  1804. 2017-12-01 00:02:52,170 DEBUG [c.c.a.t.Request] (StatsCollector-4:ctx-84ec1561) (logid:2bd3dea3) Seq 1-3458483038843866941: Received: { Ans: , MgmtId: 345052167237, via: 1(r6-l06-esx01.cisco.com), Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
  1805. 2017-12-01 00:02:52,171 DEBUG [c.c.h.o.r.Ovm3HypervisorGuru] (StatsCollector-4:ctx-84ec1561) (logid:2bd3dea3) getCommandHostDelegation: class com.cloud.agent.api.GetStorageStatsCommand
  1806. 2017-12-01 00:02:52,171 DEBUG [c.c.h.XenServerGuru] (StatsCollector-4:ctx-84ec1561) (logid:2bd3dea3) getCommandHostDelegation: class com.cloud.agent.api.GetStorageStatsCommand
  1807. 2017-12-01 00:02:52,172 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-335:ctx-84f09b2f) (logid:acae3053) Seq 1-3458483038843866942: Executing request
  1808. 2017-12-01 00:02:52,285 DEBUG [c.c.h.v.r.VmwareResource] (DirectAgent-335:ctx-84f09b2f r6-l06-esx01.cisco.com, cmd: GetStorageStatsCommand) (logid:2bd3dea3) Datastore summary info, storageId: 09198288-c7af-4569-9202-4616ec2b0b92, localPath: datastore-2476, poolType: VMFS, capacity: 137975824384, free: 47294971904, used: 90680852480
  1809. 2017-12-01 00:02:52,285 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-335:ctx-84f09b2f) (logid:2bd3dea3) Seq 1-3458483038843866942: Response Received:
  1810. 2017-12-01 00:02:52,285 DEBUG [c.c.a.t.Request] (StatsCollector-4:ctx-84ec1561) (logid:2bd3dea3) Seq 1-3458483038843866942: Received: { Ans: , MgmtId: 345052167237, via: 1(r6-l06-esx01.cisco.com), Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
  1811. 2017-12-01 00:02:54,104 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-273ca88c) (logid:1892daf0) Begin cleanup expired async-jobs
  1812. 2017-12-01 00:02:54,108 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-273ca88c) (logid:1892daf0) End cleanup expired async-jobs
  1813. 2017-12-01 00:02:54,338 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-c0e92a4a) (logid:7c07399f) Found 0 routers to update status.
  1814. 2017-12-01 00:02:54,339 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-c0e92a4a) (logid:7c07399f) Found 0 VPC networks to update Redundant State.
  1815. 2017-12-01 00:02:54,340 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-c0e92a4a) (logid:7c07399f) Found 0 networks to update RvR status.
  1816. 2017-12-01 00:02:59,354 DEBUG [o.a.c.f.j.d.VmWorkJobDaoImpl] (Vm-Operations-Cleanup-1:ctx-07692899) (logid:d17f6b6d) Expunge completed work job-73232
  1817. 2017-12-01 00:02:59,357 DEBUG [o.a.c.f.j.d.VmWorkJobDaoImpl] (Vm-Operations-Cleanup-1:ctx-07692899) (logid:d17f6b6d) Expunge completed work job-73233
  1818. 2017-12-01 00:02:59,360 DEBUG [o.a.c.f.j.d.VmWorkJobDaoImpl] (Vm-Operations-Cleanup-1:ctx-07692899) (logid:d17f6b6d) Expunge completed work job-73234
  1819. 2017-12-01 00:02:59,363 DEBUG [o.a.c.f.j.d.VmWorkJobDaoImpl] (Vm-Operations-Cleanup-1:ctx-07692899) (logid:d17f6b6d) Expunge completed work job-73235
  1820. 2017-12-01 00:02:59,366 DEBUG [o.a.c.f.j.d.VmWorkJobDaoImpl] (Vm-Operations-Cleanup-1:ctx-07692899) (logid:d17f6b6d) Expunge completed work job-73236
  1821. 2017-12-01 00:02:59,370 DEBUG [o.a.c.f.j.d.VmWorkJobDaoImpl] (Vm-Operations-Cleanup-1:ctx-07692899) (logid:d17f6b6d) Expunge completed work job-73237
  1822. 2017-12-01 00:03:00,238 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) Zone 1 is ready to launch console proxy
  1823. 2017-12-01 00:03:00,238 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) Expand console proxy standby capacity for zone Zone-Orion
  1824. 2017-12-01 00:03:00,238 INFO [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) No stopped console proxy is available, need to allocate a new console proxy
  1825. 2017-12-01 00:03:00,239 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) Assign console proxy from a newly started instance for request from data center : 1
  1826. 2017-12-01 00:03:00,248 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) Found existing network configuration for offering [Network Offering [1-Public-System-Public-Network]: Ntwk[200|Public|1]
  1827. 2017-12-01 00:03:00,248 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
  1828. 2017-12-01 00:03:00,252 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) Found existing network configuration for offering [Network Offering [3-Control-System-Control-Network]: Ntwk[202|Control|3]
  1829. 2017-12-01 00:03:00,252 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
  1830. 2017-12-01 00:03:00,257 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) Found existing network configuration for offering [Network Offering [2-Management-System-Management-Network]: Ntwk[201|Management|2]
  1831. 2017-12-01 00:03:00,257 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
  1832. 2017-12-01 00:03:00,266 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) Allocating entries for VM: VM[ConsoleProxy|v-24527-VM]
  1833. 2017-12-01 00:03:00,267 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) Allocating nics for VM[ConsoleProxy|v-24527-VM]
  1834. 2017-12-01 00:03:00,268 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) Allocating nic for vm VM[ConsoleProxy|v-24527-VM] in network Ntwk[200|Public|1] with requested profile NicProfile[0-0-null-null-null
  1835. 2017-12-01 00:03:00,278 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) Allocating nic for vm VM[ConsoleProxy|v-24527-VM] in network Ntwk[202|Control|3] with requested profile null
  1836. 2017-12-01 00:03:00,284 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) Allocating nic for vm VM[ConsoleProxy|v-24527-VM] in network Ntwk[201|Management|2] with requested profile null
  1837. 2017-12-01 00:03:00,288 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) Allocating disks for VM[ConsoleProxy|v-24527-VM]
  1838. 2017-12-01 00:03:00,291 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) Allocation completed for VM: VM[ConsoleProxy|v-24527-VM]
  1839. 2017-12-01 00:03:00,293 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) received console proxy alert
  1840. 2017-12-01 00:03:00,293 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) New console proxy created, zone: Zone-Orion, proxy: v-24527-VM, public IP: null, private IP: null
  1841. 2017-12-01 00:03:00,301 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) Sync job-73598 execution on object VmWorkJobQueue.24527
  1842. 2017-12-01 00:03:00,356 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-63eab848) (logid:5a929269) Zone 1 is ready to launch secondary storage VM
  1843. 2017-12-01 00:03:00,357 INFO [o.a.c.s.PremiumSecondaryStorageManagerImpl] (secstorage-1:ctx-63eab848) (logid:5a929269) No running secondary storage vms found in datacenter id=1, starting one
  1844. 2017-12-01 00:03:00,359 INFO [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-63eab848) (logid:5a929269) No stopped secondary storage vm is available, need to allocate a new secondary storage vm
  1845. 2017-12-01 00:03:00,360 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-63eab848) (logid:5a929269) Assign secondary storage vm from a newly started instance for request from data center : 1
  1846. 2017-12-01 00:03:00,367 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-63eab848) (logid:5a929269) Found existing network configuration for offering [Network Offering [1-Public-System-Public-Network]: Ntwk[200|Public|1]
  1847. 2017-12-01 00:03:00,367 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-63eab848) (logid:5a929269) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
  1848. 2017-12-01 00:03:00,372 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-63eab848) (logid:5a929269) Found existing network configuration for offering [Network Offering [3-Control-System-Control-Network]: Ntwk[202|Control|3]
  1849. 2017-12-01 00:03:00,372 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-63eab848) (logid:5a929269) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
  1850. 2017-12-01 00:03:00,377 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-63eab848) (logid:5a929269) Found existing network configuration for offering [Network Offering [2-Management-System-Management-Network]: Ntwk[201|Management|2]
  1851. 2017-12-01 00:03:00,377 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-63eab848) (logid:5a929269) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
  1852. 2017-12-01 00:03:00,382 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-63eab848) (logid:5a929269) Found existing network configuration for offering [Network Offering [4-Storage-System-Storage-Network]: Ntwk[203|Storage|4]
  1853. 2017-12-01 00:03:00,382 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-63eab848) (logid:5a929269) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
  1854. 2017-12-01 00:03:00,393 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-63eab848) (logid:5a929269) Allocating entries for VM: VM[SecondaryStorageVm|s-24528-VM]
  1855. 2017-12-01 00:03:00,394 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-63eab848) (logid:5a929269) Allocating nics for VM[SecondaryStorageVm|s-24528-VM]
  1856. 2017-12-01 00:03:00,395 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-63eab848) (logid:5a929269) Allocating nic for vm VM[SecondaryStorageVm|s-24528-VM] in network Ntwk[200|Public|1] with requested profile NicProfile[0-0-null-null-null
  1857. 2017-12-01 00:03:00,404 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-63eab848) (logid:5a929269) Allocating nic for vm VM[SecondaryStorageVm|s-24528-VM] in network Ntwk[202|Control|3] with requested profile null
  1858. 2017-12-01 00:03:00,410 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-63eab848) (logid:5a929269) Allocating nic for vm VM[SecondaryStorageVm|s-24528-VM] in network Ntwk[201|Management|2] with requested profile null
  1859. 2017-12-01 00:03:00,414 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-63eab848) (logid:5a929269) Allocating nic for vm VM[SecondaryStorageVm|s-24528-VM] in network Ntwk[203|Storage|4] with requested profile null
  1860. 2017-12-01 00:03:00,417 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-63eab848) (logid:5a929269) Allocating disks for VM[SecondaryStorageVm|s-24528-VM]
  1861. 2017-12-01 00:03:00,421 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-63eab848) (logid:5a929269) Allocation completed for VM: VM[SecondaryStorageVm|s-24528-VM]
  1862. 2017-12-01 00:03:00,423 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-63eab848) (logid:5a929269) received secondary storage vm alert
  1863. 2017-12-01 00:03:00,423 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-63eab848) (logid:5a929269) New secondary storage vm created, zone: Zone-Orion, secStorageVm: s-24528-VM, public IP: null, private IP: null
  1864. 2017-12-01 00:03:00,431 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (secstorage-1:ctx-63eab848) (logid:5a929269) Sync job-73599 execution on object VmWorkJobQueue.24528
  1865. 2017-12-01 00:03:02,106 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-10d7a5fb) (logid:58301089) Execute sync-queue item: SyncQueueItemVO {id:73580, queueId: 73580, contentType: AsyncJob, contentId: 73598, lastProcessMsid: 345052167237, lastprocessNumber: 1, lastProcessTime: Fri Dec 01 00:03:02 CST 2017, created: Fri Dec 01 00:03:00 CST 2017}
  1866. 2017-12-01 00:03:02,107 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-10d7a5fb) (logid:58301089) Schedule queued job-73598
  1867. 2017-12-01 00:03:02,109 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-10d7a5fb) (logid:58301089) Execute sync-queue item: SyncQueueItemVO {id:73581, queueId: 73581, contentType: AsyncJob, contentId: 73599, lastProcessMsid: 345052167237, lastprocessNumber: 1, lastProcessTime: Fri Dec 01 00:03:02 CST 2017, created: Fri Dec 01 00:03:00 CST 2017}
  1868. 2017-12-01 00:03:02,110 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-10d7a5fb) (logid:58301089) Schedule queued job-73599
  1869. 2017-12-01 00:03:02,110 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598) (logid:d0217a89) Add job-73598 into job monitoring
  1870. 2017-12-01 00:03:02,113 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599) (logid:b1e233db) Add job-73599 into job monitoring
  1871. 2017-12-01 00:03:02,117 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598) (logid:a98dfed6) Executing AsyncJobVO {id:73598, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfz3QAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:03:00 CST 2017}
  1872. 2017-12-01 00:03:02,117 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598) (logid:a98dfed6) Run VM work job: com.cloud.vm.VmWorkStart for VM 24527, job origin: 1
  1873. 2017-12-01 00:03:02,118 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) Execute VM work job: com.cloud.vm.VmWorkStart{"dcId":0,"userId":1,"accountId":1,"vmId":24527,"handlerName":"VirtualMachineManagerImpl"}
  1874. 2017-12-01 00:03:02,119 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599) (logid:32b654cc) Executing AsyncJobVO {id:73599, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABf0HQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:03:00 CST 2017}
  1875. 2017-12-01 00:03:02,119 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599) (logid:32b654cc) Run VM work job: com.cloud.vm.VmWorkStart for VM 24528, job origin: 2
  1876. 2017-12-01 00:03:02,122 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) Execute VM work job: com.cloud.vm.VmWorkStart{"dcId":0,"userId":1,"accountId":1,"vmId":24528,"handlerName":"VirtualMachineManagerImpl"}
  1877. 2017-12-01 00:03:02,124 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
  1878. 2017-12-01 00:03:02,124 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) Successfully transitioned to start state for VM[ConsoleProxy|v-24527-VM] reservation id = 96c52f47-3a97-48d9-b0b4-9e12a04f930e
  1879. 2017-12-01 00:03:02,125 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) Trying to deploy VM, vm has dcId: 1 and podId: null
  1880. 2017-12-01 00:03:02,125 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) Deploy avoids pods: null, clusters: null, hosts: null
  1881. 2017-12-01 00:03:02,128 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
  1882. 2017-12-01 00:03:02,128 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) Successfully transitioned to start state for VM[SecondaryStorageVm|s-24528-VM] reservation id = 31208475-b540-46fc-adcc-478e7c960b87
  1883. 2017-12-01 00:03:02,128 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) Deploy avoids pods: null, clusters: null, hosts: null
  1884. 2017-12-01 00:03:02,129 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@eecdd04
  1885. 2017-12-01 00:03:02,129 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) Trying to allocate a host and storage pools from dc:1, pod:null,cluster:null, requested cpu: 500, requested ram: 1073741824
  1886. 2017-12-01 00:03:02,129 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) Is ROOT volume READY (pool already allocated)?: No
  1887. 2017-12-01 00:03:02,129 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) Searching all possible resources under this Zone: 1
  1888. 2017-12-01 00:03:02,129 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) Trying to deploy VM, vm has dcId: 1 and podId: null
  1889. 2017-12-01 00:03:02,129 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) Deploy avoids pods: null, clusters: null, hosts: null
  1890. 2017-12-01 00:03:02,129 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
  1891. 2017-12-01 00:03:02,132 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) Deploy avoids pods: null, clusters: null, hosts: null
  1892. 2017-12-01 00:03:02,133 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@eecdd04
  1893. 2017-12-01 00:03:02,133 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) Trying to allocate a host and storage pools from dc:1, pod:null,cluster:null, requested cpu: 500, requested ram: 536870912
  1894. 2017-12-01 00:03:02,133 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) Is ROOT volume READY (pool already allocated)?: No
  1895. 2017-12-01 00:03:02,133 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) Searching all possible resources under this Zone: 1
  1896. 2017-12-01 00:03:02,133 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
  1897. 2017-12-01 00:03:02,138 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) Checking resources in Cluster: 1 under Pod: 1
  1898. 2017-12-01 00:03:02,138 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9 FirstFitRoutingAllocator) (logid:a98dfed6) Looking for hosts in dc: 1 pod:1 cluster:1
  1899. 2017-12-01 00:03:02,140 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9 FirstFitRoutingAllocator) (logid:a98dfed6) FirstFitAllocator has 1 hosts to check for allocation: [Host[-1-Routing]]
  1900. 2017-12-01 00:03:02,142 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) Checking resources in Cluster: 1 under Pod: 1
  1901. 2017-12-01 00:03:02,142 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252 FirstFitRoutingAllocator) (logid:32b654cc) Looking for hosts in dc: 1 pod:1 cluster:1
  1902. 2017-12-01 00:03:02,143 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9 FirstFitRoutingAllocator) (logid:a98dfed6) Found 1 hosts for allocation after prioritization: [Host[-1-Routing]]
  1903. 2017-12-01 00:03:02,143 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252 FirstFitRoutingAllocator) (logid:32b654cc) FirstFitAllocator has 1 hosts to check for allocation: [Host[-1-Routing]]
  1904. 2017-12-01 00:03:02,143 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9 FirstFitRoutingAllocator) (logid:a98dfed6) Looking for speed=500Mhz, Ram=1024
  1905. 2017-12-01 00:03:02,147 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252 FirstFitRoutingAllocator) (logid:32b654cc) Found 1 hosts for allocation after prioritization: [Host[-1-Routing]]
  1906. 2017-12-01 00:03:02,147 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252 FirstFitRoutingAllocator) (logid:32b654cc) Looking for speed=500Mhz, Ram=512
  1907. 2017-12-01 00:03:02,149 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9 FirstFitRoutingAllocator) (logid:a98dfed6) Host: 1 has cpu capability (cpu:16, speed:2533) to support requested CPU: 1 and requested speed: 500
  1908. 2017-12-01 00:03:02,149 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9 FirstFitRoutingAllocator) (logid:a98dfed6) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  1909. 2017-12-01 00:03:02,150 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9 FirstFitRoutingAllocator) (logid:a98dfed6) Hosts's actual total CPU: 40528 and CPU after applying overprovisioning: 40528
  1910. 2017-12-01 00:03:02,150 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9 FirstFitRoutingAllocator) (logid:a98dfed6) Free CPU: 40528 , Requested CPU: 500
  1911. 2017-12-01 00:03:02,150 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9 FirstFitRoutingAllocator) (logid:a98dfed6) Free RAM: 42880884736 , Requested RAM: 1073741824
  1912. 2017-12-01 00:03:02,150 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9 FirstFitRoutingAllocator) (logid:a98dfed6) Host has enough CPU and RAM available
  1913. 2017-12-01 00:03:02,150 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9 FirstFitRoutingAllocator) (logid:a98dfed6) STATS: Can alloc CPU from host: 1, used: 0, reserved: 0, actual total: 40528, total with overprovisioning: 40528; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1914. 2017-12-01 00:03:02,150 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9 FirstFitRoutingAllocator) (logid:a98dfed6) STATS: Can alloc MEM from host: 1, used: 0, reserved: 0, total: 42880884736; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1915. 2017-12-01 00:03:02,150 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9 FirstFitRoutingAllocator) (logid:a98dfed6) Found a suitable host, adding to list: 1
  1916. 2017-12-01 00:03:02,150 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9 FirstFitRoutingAllocator) (logid:a98dfed6) Host Allocator returning 1 suitable hosts
  1917. 2017-12-01 00:03:02,152 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252 FirstFitRoutingAllocator) (logid:32b654cc) Host: 1 has cpu capability (cpu:16, speed:2533) to support requested CPU: 1 and requested speed: 500
  1918. 2017-12-01 00:03:02,152 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252 FirstFitRoutingAllocator) (logid:32b654cc) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 536870912 , cpuOverprovisioningFactor: 1.0
  1919. 2017-12-01 00:03:02,152 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) Checking suitable pools for volume (Id, Type): (24527,ROOT)
  1920. 2017-12-01 00:03:02,152 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) We need to allocate new storagepool for this volume
  1921. 2017-12-01 00:03:02,153 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) Calling StoragePoolAllocators to find suitable pools
  1922. 2017-12-01 00:03:02,153 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252 FirstFitRoutingAllocator) (logid:32b654cc) Hosts's actual total CPU: 40528 and CPU after applying overprovisioning: 40528
  1923. 2017-12-01 00:03:02,153 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252 FirstFitRoutingAllocator) (logid:32b654cc) Free CPU: 40528 , Requested CPU: 500
  1924. 2017-12-01 00:03:02,153 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252 FirstFitRoutingAllocator) (logid:32b654cc) Free RAM: 42880884736 , Requested RAM: 536870912
  1925. 2017-12-01 00:03:02,153 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252 FirstFitRoutingAllocator) (logid:32b654cc) Host has enough CPU and RAM available
  1926. 2017-12-01 00:03:02,153 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252 FirstFitRoutingAllocator) (logid:32b654cc) STATS: Can alloc CPU from host: 1, used: 0, reserved: 0, actual total: 40528, total with overprovisioning: 40528; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1927. 2017-12-01 00:03:02,153 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252 FirstFitRoutingAllocator) (logid:32b654cc) STATS: Can alloc MEM from host: 1, used: 0, reserved: 0, total: 42880884736; requested mem: 536870912,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1928. 2017-12-01 00:03:02,153 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252 FirstFitRoutingAllocator) (logid:32b654cc) Found a suitable host, adding to list: 1
  1929. 2017-12-01 00:03:02,153 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252 FirstFitRoutingAllocator) (logid:32b654cc) Host Allocator returning 1 suitable hosts
  1930. 2017-12-01 00:03:02,154 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) System VMs will use shared storage for zone id=1
  1931. 2017-12-01 00:03:02,154 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) LocalStoragePoolAllocator trying to find storage pool to fit the vm
  1932. 2017-12-01 00:03:02,154 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) ClusterScopeStoragePoolAllocator looking for storage pool
  1933. 2017-12-01 00:03:02,154 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) Looking for pools in dc: 1 pod:1 cluster:1. Disabled pools will be ignored.
  1934. 2017-12-01 00:03:02,154 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) Found pools matching tags: []
  1935. 2017-12-01 00:03:02,154 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) No storage pools available for shared volume allocation, returning
  1936. 2017-12-01 00:03:02,154 DEBUG [o.a.c.s.a.ZoneWideStoragePoolAllocator] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) ZoneWideStoragePoolAllocator to find storage pool
  1937. 2017-12-01 00:03:02,155 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) Checking suitable pools for volume (Id, Type): (24528,ROOT)
  1938. 2017-12-01 00:03:02,155 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) We need to allocate new storagepool for this volume
  1939. 2017-12-01 00:03:02,155 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) No suitable pools found for volume: Vol[24527|vm=24527|ROOT] under cluster: 1
  1940. 2017-12-01 00:03:02,155 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) No suitable pools found
  1941. 2017-12-01 00:03:02,155 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) No suitable storagePools found under this Cluster: 1
  1942. 2017-12-01 00:03:02,156 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) Calling StoragePoolAllocators to find suitable pools
  1943. 2017-12-01 00:03:02,156 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) Could not find suitable Deployment Destination for this VM under any clusters, returning.
  1944. 2017-12-01 00:03:02,156 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) Searching all possible resources under this Zone: 1
  1945. 2017-12-01 00:03:02,156 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
  1946. 2017-12-01 00:03:02,157 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) System VMs will use shared storage for zone id=1
  1947. 2017-12-01 00:03:02,157 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) LocalStoragePoolAllocator trying to find storage pool to fit the vm
  1948. 2017-12-01 00:03:02,157 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) ClusterScopeStoragePoolAllocator looking for storage pool
  1949. 2017-12-01 00:03:02,157 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) Looking for pools in dc: 1 pod:1 cluster:1. Disabled pools will be ignored.
  1950. 2017-12-01 00:03:02,157 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) Found pools matching tags: []
  1951. 2017-12-01 00:03:02,157 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) No storage pools available for shared volume allocation, returning
  1952. 2017-12-01 00:03:02,157 DEBUG [o.a.c.s.a.ZoneWideStoragePoolAllocator] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) ZoneWideStoragePoolAllocator to find storage pool
  1953. 2017-12-01 00:03:02,157 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) Removing from the clusterId list these clusters from avoid set: [1]
  1954. 2017-12-01 00:03:02,158 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) No clusters found after removing disabled clusters and clusters in avoid list, returning.
  1955. 2017-12-01 00:03:02,158 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) No suitable pools found for volume: Vol[24528|vm=24528|ROOT] under cluster: 1
  1956. 2017-12-01 00:03:02,158 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) No suitable pools found
  1957. 2017-12-01 00:03:02,158 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) No suitable storagePools found under this Cluster: 1
  1958. 2017-12-01 00:03:02,159 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) Could not find suitable Deployment Destination for this VM under any clusters, returning.
  1959. 2017-12-01 00:03:02,159 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) Searching all possible resources under this Zone: 1
  1960. 2017-12-01 00:03:02,159 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
  1961. 2017-12-01 00:03:02,160 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) Removing from the clusterId list these clusters from avoid set: [1]
  1962. 2017-12-01 00:03:02,161 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) No clusters found after removing disabled clusters and clusters in avoid list, returning.
  1963. 2017-12-01 00:03:02,165 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
  1964. 2017-12-01 00:03:02,165 ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) Invocation exception, caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24527-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  1965. 2017-12-01 00:03:02,165 INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) Rethrow exception com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24527-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  1966. 2017-12-01 00:03:02,165 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598) (logid:a98dfed6) Done with run of VM work job: com.cloud.vm.VmWorkStart for VM 24527, job origin: 1
  1967. 2017-12-01 00:03:02,165 ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598) (logid:a98dfed6) Unable to complete AsyncJobVO {id:73598, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfz3QAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:03:00 CST 2017}, job origin:1
  1968. com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24527-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  1969. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
  1970. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
  1971. at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
  1972. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  1973. at java.lang.reflect.Method.invoke(Method.java:498)
  1974. at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
  1975. at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
  1976. at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
  1977. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
  1978. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  1979. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  1980. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  1981. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  1982. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  1983. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
  1984. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  1985. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  1986. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  1987. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  1988. at java.lang.Thread.run(Thread.java:748)
  1989. 2017-12-01 00:03:02,166 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598) (logid:a98dfed6) Complete async job-73598, jobStatus: FAILED, resultCode: 0, result: rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdAA9VW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW0NvbnNvbGVQcm94eXx2LTI0NTI3LVZNXXVyAB5bTGphdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudDsCRio8PP0iOQIAAHhwAAAAFHNyABtqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnRhCcWaJjbdhQIABEkACmxpbmVOdW1iZXJMAA5kZWNsYXJpbmdDbGFzc3EAfgAKTAAIZmlsZU5hbWVxAH4ACkwACm1ldGhvZE5hbWVxAH4ACnhwAAADwHQAJmNvbS5jbG91ZC52bS5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsdAAeVmlydHVhbE1hY2hpbmVNYW5hZ2VySW1wbC5qYXZhdAAQb3JjaGVzdHJhdGVTdGFydHNxAH4AEQAAEgtxAH4AE3EAfgAUcQB-ABVzcQB-ABH_____dAAmc3VuLnJlZmxlY3QuR2VuZXJhdGVkTWV0aG9kQWNjZXNzb3IxOTlwdAAGaW52b2tlc3EAfgARAAAAK3QAKHN1bi5yZWZsZWN0LkRlbGVnYXRpbmdNZXRob2RBY2Nlc3NvckltcGx0ACFEZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsLmphdmFxAH4AGXNxAH4AEQAAAfJ0ABhqYXZhLmxhbmcucmVmbGVjdC5NZXRob2R0AAtNZXRob2QuamF2YXEAfgAZc3EAfgARAAAAa3QAImNvbS5jbG91ZC52bS5WbVdvcmtKb2JIYW5kbGVyUHJveHl0ABpWbVdvcmtKb2JIYW5kbGVyUHJveHkuamF2YXQAD2hhbmRsZVZtV29ya0pvYnNxAH4AEQAAEqxxAH4AE3EAfgAUcQB-ACNzcQB-ABEAAABmdAAgY29tLmNsb3VkLnZtLlZtV29ya0pvYkRpc3BhdGNoZXJ0ABhWbVdvcmtKb2JEaXNwYXRjaGVyLmphdmF0AAZydW5Kb2JzcQB-ABEAAAIqdAA_b3JnLmFwYWNoZS5jbG91ZHN0YWNrLmZyYW1ld29yay5qb2JzLmltcGwuQXN5bmNKb2JNYW5hZ2VySW1wbCQ1dAAYQXN5bmNKb2JNYW5hZ2VySW1wbC5qYXZhdAAMcnVuSW5Db250ZXh0c3EAfgARAAAAMXQAPm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZSQxdAAbTWFuYWdlZENvbnRleHRSdW5uYWJsZS5qYXZhdAADcnVuc3EAfgARAAAAOHQAQm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5EZWZhdWx0TWFuYWdlZENvbnRleHQkMXQAGkRlZmF1bHRNYW5hZ2VkQ29udGV4dC5qYXZhdAAEY2FsbHNxAH4AEQAAAGd0AEBvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0cQB-ADN0AA9jYWxsV2l0aENvbnRleHRzcQB-ABEAAAA1cQB-ADZxAH4AM3QADnJ1bldpdGhDb250ZXh0c3EAfgARAAAALnQAPG9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZXEAfgAvcQB-ADBzcQB-ABEAAAH2cQB-ACpxAH4AK3EAfgAwc3EAfgARAAAB_3QALmphdmEudXRpbC5jb25jdXJyZW50LkV4ZWN1dG9ycyRSdW5uYWJsZUFkYXB0ZXJ0AA5FeGVjdXRvcnMuamF2YXEAfgA0c3EAfgARAAABCnQAH2phdmEudXRpbC5jb25jdXJyZW50LkZ1dHVyZVRhc2t0AA9GdXR1cmVUYXNrLmphdmFxAH4AMHNxAH4AEQAABH10ACdqYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3J0ABdUaHJlYWRQb29sRXhlY3V0b3IuamF2YXQACXJ1bldvcmtlcnNxAH4AEQAAAnB0AC5qYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3IkV29ya2VycQB-AEVxAH4AMHNxAH4AEQAAAux0ABBqYXZhLmxhbmcuVGhyZWFkdAALVGhyZWFkLmphdmFxAH4AMHNyACZqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlTGlzdPwPJTG17I4QAgABTAAEbGlzdHEAfgAMeHIALGphdmEudXRpbC5Db2xsZWN0aW9ucyRVbm1vZGlmaWFibGVDb2xsZWN0aW9uGUIAgMte9x4CAAFMAAFjdAAWTGphdmEvdXRpbC9Db2xsZWN0aW9uO3hwc3IAE2phdmEudXRpbC5BcnJheUxpc3R4gdIdmcdhnQMAAUkABHNpemV4cAAAAAB3BAAAAAB4cQB-AFF4c3IAEWphdmEubGFuZy5JbnRlZ2VyEuKgpPeBhzgCAAFJAAV2YWx1ZXhyABBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAAB4cAAAEO9zcQB-AFAAAAAAdwQAAAAAeHNyAA5qYXZhLmxhbmcuTG9uZzuL5JDMjyPfAgABSgAFdmFsdWV4cQB-AFMAAAAAAAAAAXZyABdjb20uY2xvdWQuZGMuRGF0YUNlbnRlcrLxCuun53i-AgAAeHAA
  1990. 2017-12-01 00:03:02,166 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598) (logid:a98dfed6) Publish async job-73598 complete on message bus
  1991. 2017-12-01 00:03:02,166 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598) (logid:a98dfed6) Wake up jobs related to job-73598
  1992. 2017-12-01 00:03:02,166 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598) (logid:a98dfed6) Update db status for job-73598
  1993. 2017-12-01 00:03:02,167 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598) (logid:a98dfed6) Wake up jobs joined with job-73598 and disjoin all subjobs created from job- 73598
  1994. 2017-12-01 00:03:02,176 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598) (logid:a98dfed6) Done executing com.cloud.vm.VmWorkStart for job-73598
  1995. 2017-12-01 00:03:02,176 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
  1996. 2017-12-01 00:03:02,176 ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) Invocation exception, caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24528-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  1997. 2017-12-01 00:03:02,176 INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) Rethrow exception com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24528-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  1998. 2017-12-01 00:03:02,176 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599) (logid:32b654cc) Done with run of VM work job: com.cloud.vm.VmWorkStart for VM 24528, job origin: 2
  1999. 2017-12-01 00:03:02,176 ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599) (logid:32b654cc) Unable to complete AsyncJobVO {id:73599, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABf0HQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:03:00 CST 2017}, job origin:2
  2000. com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24528-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  2001. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
  2002. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
  2003. at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
  2004. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  2005. at java.lang.reflect.Method.invoke(Method.java:498)
  2006. at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
  2007. at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
  2008. at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
  2009. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
  2010. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  2011. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  2012. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  2013. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  2014. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  2015. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
  2016. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  2017. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  2018. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  2019. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  2020. at java.lang.Thread.run(Thread.java:748)
  2021. 2017-12-01 00:03:02,177 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599) (logid:32b654cc) Complete async job-73599, jobStatus: FAILED, resultCode: 0, result: rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdABDVW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW1NlY29uZGFyeVN0b3JhZ2VWbXxzLTI0NTI4LVZNXXVyAB5bTGphdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudDsCRio8PP0iOQIAAHhwAAAAFHNyABtqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnRhCcWaJjbdhQIABEkACmxpbmVOdW1iZXJMAA5kZWNsYXJpbmdDbGFzc3EAfgAKTAAIZmlsZU5hbWVxAH4ACkwACm1ldGhvZE5hbWVxAH4ACnhwAAADwHQAJmNvbS5jbG91ZC52bS5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsdAAeVmlydHVhbE1hY2hpbmVNYW5hZ2VySW1wbC5qYXZhdAAQb3JjaGVzdHJhdGVTdGFydHNxAH4AEQAAEgtxAH4AE3EAfgAUcQB-ABVzcQB-ABH_____dAAmc3VuLnJlZmxlY3QuR2VuZXJhdGVkTWV0aG9kQWNjZXNzb3IxOTlwdAAGaW52b2tlc3EAfgARAAAAK3QAKHN1bi5yZWZsZWN0LkRlbGVnYXRpbmdNZXRob2RBY2Nlc3NvckltcGx0ACFEZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsLmphdmFxAH4AGXNxAH4AEQAAAfJ0ABhqYXZhLmxhbmcucmVmbGVjdC5NZXRob2R0AAtNZXRob2QuamF2YXEAfgAZc3EAfgARAAAAa3QAImNvbS5jbG91ZC52bS5WbVdvcmtKb2JIYW5kbGVyUHJveHl0ABpWbVdvcmtKb2JIYW5kbGVyUHJveHkuamF2YXQAD2hhbmRsZVZtV29ya0pvYnNxAH4AEQAAEqxxAH4AE3EAfgAUcQB-ACNzcQB-ABEAAABmdAAgY29tLmNsb3VkLnZtLlZtV29ya0pvYkRpc3BhdGNoZXJ0ABhWbVdvcmtKb2JEaXNwYXRjaGVyLmphdmF0AAZydW5Kb2JzcQB-ABEAAAIqdAA_b3JnLmFwYWNoZS5jbG91ZHN0YWNrLmZyYW1ld29yay5qb2JzLmltcGwuQXN5bmNKb2JNYW5hZ2VySW1wbCQ1dAAYQXN5bmNKb2JNYW5hZ2VySW1wbC5qYXZhdAAMcnVuSW5Db250ZXh0c3EAfgARAAAAMXQAPm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZSQxdAAbTWFuYWdlZENvbnRleHRSdW5uYWJsZS5qYXZhdAADcnVuc3EAfgARAAAAOHQAQm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5EZWZhdWx0TWFuYWdlZENvbnRleHQkMXQAGkRlZmF1bHRNYW5hZ2VkQ29udGV4dC5qYXZhdAAEY2FsbHNxAH4AEQAAAGd0AEBvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0cQB-ADN0AA9jYWxsV2l0aENvbnRleHRzcQB-ABEAAAA1cQB-ADZxAH4AM3QADnJ1bldpdGhDb250ZXh0c3EAfgARAAAALnQAPG9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZXEAfgAvcQB-ADBzcQB-ABEAAAH2cQB-ACpxAH4AK3EAfgAwc3EAfgARAAAB_3QALmphdmEudXRpbC5jb25jdXJyZW50LkV4ZWN1dG9ycyRSdW5uYWJsZUFkYXB0ZXJ0AA5FeGVjdXRvcnMuamF2YXEAfgA0c3EAfgARAAABCnQAH2phdmEudXRpbC5jb25jdXJyZW50LkZ1dHVyZVRhc2t0AA9GdXR1cmVUYXNrLmphdmFxAH4AMHNxAH4AEQAABH10ACdqYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3J0ABdUaHJlYWRQb29sRXhlY3V0b3IuamF2YXQACXJ1bldvcmtlcnNxAH4AEQAAAnB0AC5qYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3IkV29ya2VycQB-AEVxAH4AMHNxAH4AEQAAAux0ABBqYXZhLmxhbmcuVGhyZWFkdAALVGhyZWFkLmphdmFxAH4AMHNyACZqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlTGlzdPwPJTG17I4QAgABTAAEbGlzdHEAfgAMeHIALGphdmEudXRpbC5Db2xsZWN0aW9ucyRVbm1vZGlmaWFibGVDb2xsZWN0aW9uGUIAgMte9x4CAAFMAAFjdAAWTGphdmEvdXRpbC9Db2xsZWN0aW9uO3hwc3IAE2phdmEudXRpbC5BcnJheUxpc3R4gdIdmcdhnQMAAUkABHNpemV4cAAAAAB3BAAAAAB4cQB-AFF4c3IAEWphdmEubGFuZy5JbnRlZ2VyEuKgpPeBhzgCAAFJAAV2YWx1ZXhyABBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAAB4cAAAEO9zcQB-AFAAAAAAdwQAAAAAeHNyAA5qYXZhLmxhbmcuTG9uZzuL5JDMjyPfAgABSgAFdmFsdWV4cQB-AFMAAAAAAAAAAXZyABdjb20uY2xvdWQuZGMuRGF0YUNlbnRlcrLxCuun53i-AgAAeHAA
  2022. 2017-12-01 00:03:02,183 WARN [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) Exception while trying to start console proxy
  2023. com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24527-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  2024. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
  2025. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
  2026. at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
  2027. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  2028. at java.lang.reflect.Method.invoke(Method.java:498)
  2029. at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
  2030. at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
  2031. at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
  2032. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
  2033. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  2034. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  2035. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  2036. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  2037. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  2038. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
  2039. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  2040. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  2041. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  2042. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  2043. at java.lang.Thread.run(Thread.java:748)
  2044. 2017-12-01 00:03:02,186 INFO [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) Unable to start console proxy vm for standby capacity, vm id : 24527, will recycle it and start a new one
  2045. 2017-12-01 00:03:02,186 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) received console proxy alert
  2046. 2017-12-01 00:03:02,186 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) Console proxy creation failure, zone: Zone-Orion
  2047. 2017-12-01 00:03:02,186 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599) (logid:32b654cc) Publish async job-73599 complete on message bus
  2048. 2017-12-01 00:03:02,186 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599) (logid:32b654cc) Wake up jobs related to job-73599
  2049. 2017-12-01 00:03:02,186 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599) (logid:32b654cc) Update db status for job-73599
  2050. 2017-12-01 00:03:02,186 WARN [o.a.c.alerts] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) alertType:: 10 // dataCenterId:: 1 // podId:: null // clusterId:: null // message:: Console proxy creation failure. zone: Zone-Orion, error details: null
  2051. 2017-12-01 00:03:02,187 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599) (logid:32b654cc) Wake up jobs joined with job-73599 and disjoin all subjobs created from job- 73599
  2052. 2017-12-01 00:03:02,188 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598) (logid:a98dfed6) Remove job-73598 from job monitoring
  2053. 2017-12-01 00:03:02,195 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599) (logid:32b654cc) Done executing com.cloud.vm.VmWorkStart for job-73599
  2054. 2017-12-01 00:03:02,196 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599) (logid:32b654cc) Remove job-73599 from job monitoring
  2055. 2017-12-01 00:03:02,201 WARN [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-63eab848) (logid:5a929269) Exception while trying to start secondary storage vm
  2056. com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24528-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  2057. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
  2058. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
  2059. at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
  2060. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  2061. at java.lang.reflect.Method.invoke(Method.java:498)
  2062. at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
  2063. at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
  2064. at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
  2065. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
  2066. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  2067. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  2068. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  2069. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  2070. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  2071. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
  2072. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  2073. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  2074. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  2075. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  2076. at java.lang.Thread.run(Thread.java:748)
  2077. 2017-12-01 00:03:02,203 INFO [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-63eab848) (logid:5a929269) Unable to start secondary storage vm for standby capacity, vm id : 24528, will recycle it and start a new one
  2078. 2017-12-01 00:03:02,203 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-63eab848) (logid:5a929269) received secondary storage vm alert
  2079. 2017-12-01 00:03:02,203 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-63eab848) (logid:5a929269) Secondary Storage Vm creation failure, zone: Zone-Orion
  2080. 2017-12-01 00:03:02,204 WARN [o.a.c.alerts] (secstorage-1:ctx-63eab848) (logid:5a929269) alertType:: 19 // dataCenterId:: 1 // podId:: null // clusterId:: null // message:: Secondary Storage Vm creation failure. zone: Zone-Orion, error details: null
  2081. 2017-12-01 00:03:02,209 INFO [o.a.c.s.PremiumSecondaryStorageManagerImpl] (secstorage-1:ctx-63eab848) (logid:5a929269) Primary secondary storage is not even started, wait until next turn
  2082. 2017-12-01 00:03:04,104 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-469b6761) (logid:85962c36) Begin cleanup expired async-jobs
  2083. 2017-12-01 00:03:04,108 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-469b6761) (logid:85962c36) End cleanup expired async-jobs
  2084. 2017-12-01 00:03:14,104 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-2ae0cdd0) (logid:65fa0435) Begin cleanup expired async-jobs
  2085. 2017-12-01 00:03:14,108 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-2ae0cdd0) (logid:65fa0435) End cleanup expired async-jobs
  2086. 2017-12-01 00:03:15,766 DEBUG [c.c.s.StatsCollector] (StatsCollector-2:ctx-e7b2657e) (logid:17ac8a41) HostStatsCollector is running...
  2087. 2017-12-01 00:03:15,772 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-168:ctx-6f9bd7da) (logid:c92362ee) Seq 1-3458483038843866943: Executing request
  2088. 2017-12-01 00:03:15,902 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-168:ctx-6f9bd7da) (logid:17ac8a41) Seq 1-3458483038843866943: Response Received:
  2089. 2017-12-01 00:03:15,902 DEBUG [c.c.a.t.Request] (StatsCollector-2:ctx-e7b2657e) (logid:17ac8a41) Seq 1-3458483038843866943: Received: { Ans: , MgmtId: 345052167237, via: 1(r6-l06-esx01.cisco.com), Ver: v1, Flags: 10, { GetHostStatsAnswer } }
  2090. 2017-12-01 00:03:24,104 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-5f8d89aa) (logid:ea14d3c2) Begin cleanup expired async-jobs
  2091. 2017-12-01 00:03:24,108 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-5f8d89aa) (logid:ea14d3c2) End cleanup expired async-jobs
  2092. 2017-12-01 00:03:24,338 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-e407e1d1) (logid:46daa6e6) Found 0 routers to update status.
  2093. 2017-12-01 00:03:24,339 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-e407e1d1) (logid:46daa6e6) Found 0 VPC networks to update Redundant State.
  2094. 2017-12-01 00:03:24,339 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-e407e1d1) (logid:46daa6e6) Found 0 networks to update RvR status.
  2095. 2017-12-01 00:03:30,238 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-c3994110) (logid:d0865f01) Zone 1 is ready to launch console proxy
  2096. 2017-12-01 00:03:30,238 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-c3994110) (logid:d0865f01) Expand console proxy standby capacity for zone Zone-Orion
  2097. 2017-12-01 00:03:30,239 INFO [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-c3994110) (logid:d0865f01) Found a stopped console proxy, starting it. Vm id : 24527
  2098. 2017-12-01 00:03:30,245 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (consoleproxy-1:ctx-c3994110) (logid:d0865f01) Sync job-73600 execution on object VmWorkJobQueue.24527
  2099. 2017-12-01 00:03:30,355 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-11936d05) (logid:5925c756) Zone 1 is ready to launch secondary storage VM
  2100. 2017-12-01 00:03:30,357 INFO [o.a.c.s.PremiumSecondaryStorageManagerImpl] (secstorage-1:ctx-11936d05) (logid:5925c756) No running secondary storage vms found in datacenter id=1, starting one
  2101. 2017-12-01 00:03:30,359 INFO [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-11936d05) (logid:5925c756) Found a stopped secondary storage vm, starting it. Vm id : 24528
  2102. 2017-12-01 00:03:30,365 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (secstorage-1:ctx-11936d05) (logid:5925c756) Sync job-73601 execution on object VmWorkJobQueue.24528
  2103. 2017-12-01 00:03:31,133 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-728b60b5) (logid:2f37a48f) Resetting hosts suitable for reconnect
  2104. 2017-12-01 00:03:31,134 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-728b60b5) (logid:2f37a48f) Completed resetting hosts suitable for reconnect
  2105. 2017-12-01 00:03:31,134 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-728b60b5) (logid:2f37a48f) Acquiring hosts for clusters already owned by this management server
  2106. 2017-12-01 00:03:31,135 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-728b60b5) (logid:2f37a48f) Completed acquiring hosts for clusters already owned by this management server
  2107. 2017-12-01 00:03:31,135 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-728b60b5) (logid:2f37a48f) Acquiring hosts for clusters not owned by any management server
  2108. 2017-12-01 00:03:31,135 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-728b60b5) (logid:2f37a48f) Completed acquiring hosts for clusters not owned by any management server
  2109. 2017-12-01 00:03:32,106 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-b4a725e7) (logid:d6fc7ed1) Execute sync-queue item: SyncQueueItemVO {id:73582, queueId: 73580, contentType: AsyncJob, contentId: 73600, lastProcessMsid: 345052167237, lastprocessNumber: 2, lastProcessTime: Fri Dec 01 00:03:32 CST 2017, created: Fri Dec 01 00:03:30 CST 2017}
  2110. 2017-12-01 00:03:32,107 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-b4a725e7) (logid:d6fc7ed1) Schedule queued job-73600
  2111. 2017-12-01 00:03:32,109 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-b4a725e7) (logid:d6fc7ed1) Execute sync-queue item: SyncQueueItemVO {id:73583, queueId: 73581, contentType: AsyncJob, contentId: 73601, lastProcessMsid: 345052167237, lastprocessNumber: 2, lastProcessTime: Fri Dec 01 00:03:32 CST 2017, created: Fri Dec 01 00:03:30 CST 2017}
  2112. 2017-12-01 00:03:32,109 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-b4a725e7) (logid:d6fc7ed1) Schedule queued job-73601
  2113. 2017-12-01 00:03:32,110 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600) (logid:69311199) Add job-73600 into job monitoring
  2114. 2017-12-01 00:03:32,113 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601) (logid:b8bd8b2e) Add job-73601 into job monitoring
  2115. 2017-12-01 00:03:32,117 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600) (logid:a98dfed6) Executing AsyncJobVO {id:73600, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfz3QAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:03:30 CST 2017}
  2116. 2017-12-01 00:03:32,117 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600) (logid:a98dfed6) Run VM work job: com.cloud.vm.VmWorkStart for VM 24527, job origin: 1
  2117. 2017-12-01 00:03:32,118 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) Execute VM work job: com.cloud.vm.VmWorkStart{"dcId":0,"userId":1,"accountId":1,"vmId":24527,"handlerName":"VirtualMachineManagerImpl"}
  2118. 2017-12-01 00:03:32,119 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601) (logid:32b654cc) Executing AsyncJobVO {id:73601, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABf0HQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:03:30 CST 2017}
  2119. 2017-12-01 00:03:32,119 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601) (logid:32b654cc) Run VM work job: com.cloud.vm.VmWorkStart for VM 24528, job origin: 2
  2120. 2017-12-01 00:03:32,122 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) Execute VM work job: com.cloud.vm.VmWorkStart{"dcId":0,"userId":1,"accountId":1,"vmId":24528,"handlerName":"VirtualMachineManagerImpl"}
  2121. 2017-12-01 00:03:32,124 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
  2122. 2017-12-01 00:03:32,124 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) Successfully transitioned to start state for VM[ConsoleProxy|v-24527-VM] reservation id = 3f8dbd95-f02b-4f03-81fd-aa1b7bc062fa
  2123. 2017-12-01 00:03:32,126 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) Trying to deploy VM, vm has dcId: 1 and podId: null
  2124. 2017-12-01 00:03:32,126 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) Deploy avoids pods: null, clusters: null, hosts: null
  2125. 2017-12-01 00:03:32,127 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
  2126. 2017-12-01 00:03:32,127 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) Successfully transitioned to start state for VM[SecondaryStorageVm|s-24528-VM] reservation id = a6523cff-e5b6-4bfc-b5ca-ff16b6cc91b8
  2127. 2017-12-01 00:03:32,129 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) Trying to deploy VM, vm has dcId: 1 and podId: null
  2128. 2017-12-01 00:03:32,129 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) Deploy avoids pods: null, clusters: null, hosts: null
  2129. 2017-12-01 00:03:32,129 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) Deploy avoids pods: null, clusters: null, hosts: null
  2130. 2017-12-01 00:03:32,130 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@eecdd04
  2131. 2017-12-01 00:03:32,130 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) Trying to allocate a host and storage pools from dc:1, pod:null,cluster:null, requested cpu: 500, requested ram: 1073741824
  2132. 2017-12-01 00:03:32,130 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) Is ROOT volume READY (pool already allocated)?: No
  2133. 2017-12-01 00:03:32,130 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) Searching all possible resources under this Zone: 1
  2134. 2017-12-01 00:03:32,130 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
  2135. 2017-12-01 00:03:32,132 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) Deploy avoids pods: null, clusters: null, hosts: null
  2136. 2017-12-01 00:03:32,132 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@eecdd04
  2137. 2017-12-01 00:03:32,132 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) Trying to allocate a host and storage pools from dc:1, pod:null,cluster:null, requested cpu: 500, requested ram: 536870912
  2138. 2017-12-01 00:03:32,132 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) Is ROOT volume READY (pool already allocated)?: No
  2139. 2017-12-01 00:03:32,132 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) Searching all possible resources under this Zone: 1
  2140. 2017-12-01 00:03:32,133 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
  2141. 2017-12-01 00:03:32,139 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) Checking resources in Cluster: 1 under Pod: 1
  2142. 2017-12-01 00:03:32,139 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b FirstFitRoutingAllocator) (logid:a98dfed6) Looking for hosts in dc: 1 pod:1 cluster:1
  2143. 2017-12-01 00:03:32,141 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b FirstFitRoutingAllocator) (logid:a98dfed6) FirstFitAllocator has 1 hosts to check for allocation: [Host[-1-Routing]]
  2144. 2017-12-01 00:03:32,141 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) Checking resources in Cluster: 1 under Pod: 1
  2145. 2017-12-01 00:03:32,141 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae FirstFitRoutingAllocator) (logid:32b654cc) Looking for hosts in dc: 1 pod:1 cluster:1
  2146. 2017-12-01 00:03:32,143 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae FirstFitRoutingAllocator) (logid:32b654cc) FirstFitAllocator has 1 hosts to check for allocation: [Host[-1-Routing]]
  2147. 2017-12-01 00:03:32,145 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b FirstFitRoutingAllocator) (logid:a98dfed6) Found 1 hosts for allocation after prioritization: [Host[-1-Routing]]
  2148. 2017-12-01 00:03:32,145 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b FirstFitRoutingAllocator) (logid:a98dfed6) Looking for speed=500Mhz, Ram=1024
  2149. 2017-12-01 00:03:32,147 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae FirstFitRoutingAllocator) (logid:32b654cc) Found 1 hosts for allocation after prioritization: [Host[-1-Routing]]
  2150. 2017-12-01 00:03:32,147 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae FirstFitRoutingAllocator) (logid:32b654cc) Looking for speed=500Mhz, Ram=512
  2151. 2017-12-01 00:03:32,150 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b FirstFitRoutingAllocator) (logid:a98dfed6) Host: 1 has cpu capability (cpu:16, speed:2533) to support requested CPU: 1 and requested speed: 500
  2152. 2017-12-01 00:03:32,150 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b FirstFitRoutingAllocator) (logid:a98dfed6) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  2153. 2017-12-01 00:03:32,151 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b FirstFitRoutingAllocator) (logid:a98dfed6) Hosts's actual total CPU: 40528 and CPU after applying overprovisioning: 40528
  2154. 2017-12-01 00:03:32,151 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b FirstFitRoutingAllocator) (logid:a98dfed6) Free CPU: 40528 , Requested CPU: 500
  2155. 2017-12-01 00:03:32,151 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b FirstFitRoutingAllocator) (logid:a98dfed6) Free RAM: 42880884736 , Requested RAM: 1073741824
  2156. 2017-12-01 00:03:32,151 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b FirstFitRoutingAllocator) (logid:a98dfed6) Host has enough CPU and RAM available
  2157. 2017-12-01 00:03:32,151 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b FirstFitRoutingAllocator) (logid:a98dfed6) STATS: Can alloc CPU from host: 1, used: 0, reserved: 0, actual total: 40528, total with overprovisioning: 40528; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  2158. 2017-12-01 00:03:32,151 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b FirstFitRoutingAllocator) (logid:a98dfed6) STATS: Can alloc MEM from host: 1, used: 0, reserved: 0, total: 42880884736; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  2159. 2017-12-01 00:03:32,151 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b FirstFitRoutingAllocator) (logid:a98dfed6) Found a suitable host, adding to list: 1
  2160. 2017-12-01 00:03:32,151 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b FirstFitRoutingAllocator) (logid:a98dfed6) Host Allocator returning 1 suitable hosts
  2161. 2017-12-01 00:03:32,152 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae FirstFitRoutingAllocator) (logid:32b654cc) Host: 1 has cpu capability (cpu:16, speed:2533) to support requested CPU: 1 and requested speed: 500
  2162. 2017-12-01 00:03:32,152 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae FirstFitRoutingAllocator) (logid:32b654cc) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 536870912 , cpuOverprovisioningFactor: 1.0
  2163. 2017-12-01 00:03:32,153 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) Checking suitable pools for volume (Id, Type): (24527,ROOT)
  2164. 2017-12-01 00:03:32,153 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) We need to allocate new storagepool for this volume
  2165. 2017-12-01 00:03:32,153 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae FirstFitRoutingAllocator) (logid:32b654cc) Hosts's actual total CPU: 40528 and CPU after applying overprovisioning: 40528
  2166. 2017-12-01 00:03:32,153 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae FirstFitRoutingAllocator) (logid:32b654cc) Free CPU: 40528 , Requested CPU: 500
  2167. 2017-12-01 00:03:32,153 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae FirstFitRoutingAllocator) (logid:32b654cc) Free RAM: 42880884736 , Requested RAM: 536870912
  2168. 2017-12-01 00:03:32,153 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae FirstFitRoutingAllocator) (logid:32b654cc) Host has enough CPU and RAM available
  2169. 2017-12-01 00:03:32,153 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae FirstFitRoutingAllocator) (logid:32b654cc) STATS: Can alloc CPU from host: 1, used: 0, reserved: 0, actual total: 40528, total with overprovisioning: 40528; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  2170. 2017-12-01 00:03:32,153 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae FirstFitRoutingAllocator) (logid:32b654cc) STATS: Can alloc MEM from host: 1, used: 0, reserved: 0, total: 42880884736; requested mem: 536870912,alloc_from_last_host?:false ,considerReservedCapacity?: true
  2171. 2017-12-01 00:03:32,153 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae FirstFitRoutingAllocator) (logid:32b654cc) Found a suitable host, adding to list: 1
  2172. 2017-12-01 00:03:32,153 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae FirstFitRoutingAllocator) (logid:32b654cc) Host Allocator returning 1 suitable hosts
  2173. 2017-12-01 00:03:32,154 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) Calling StoragePoolAllocators to find suitable pools
  2174. 2017-12-01 00:03:32,155 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) System VMs will use shared storage for zone id=1
  2175. 2017-12-01 00:03:32,155 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) LocalStoragePoolAllocator trying to find storage pool to fit the vm
  2176. 2017-12-01 00:03:32,155 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) ClusterScopeStoragePoolAllocator looking for storage pool
  2177. 2017-12-01 00:03:32,155 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) Looking for pools in dc: 1 pod:1 cluster:1. Disabled pools will be ignored.
  2178. 2017-12-01 00:03:32,155 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) Found pools matching tags: []
  2179. 2017-12-01 00:03:32,155 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) Checking suitable pools for volume (Id, Type): (24528,ROOT)
  2180. 2017-12-01 00:03:32,155 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) We need to allocate new storagepool for this volume
  2181. 2017-12-01 00:03:32,155 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) No storage pools available for shared volume allocation, returning
  2182. 2017-12-01 00:03:32,155 DEBUG [o.a.c.s.a.ZoneWideStoragePoolAllocator] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) ZoneWideStoragePoolAllocator to find storage pool
  2183. 2017-12-01 00:03:32,156 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) Calling StoragePoolAllocators to find suitable pools
  2184. 2017-12-01 00:03:32,156 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) No suitable pools found for volume: Vol[24527|vm=24527|ROOT] under cluster: 1
  2185. 2017-12-01 00:03:32,156 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) No suitable pools found
  2186. 2017-12-01 00:03:32,156 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) No suitable storagePools found under this Cluster: 1
  2187. 2017-12-01 00:03:32,156 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) System VMs will use shared storage for zone id=1
  2188. 2017-12-01 00:03:32,156 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) LocalStoragePoolAllocator trying to find storage pool to fit the vm
  2189. 2017-12-01 00:03:32,156 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) ClusterScopeStoragePoolAllocator looking for storage pool
  2190. 2017-12-01 00:03:32,156 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) Looking for pools in dc: 1 pod:1 cluster:1. Disabled pools will be ignored.
  2191. 2017-12-01 00:03:32,157 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) Found pools matching tags: []
  2192. 2017-12-01 00:03:32,157 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) Could not find suitable Deployment Destination for this VM under any clusters, returning.
  2193. 2017-12-01 00:03:32,157 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) Searching all possible resources under this Zone: 1
  2194. 2017-12-01 00:03:32,157 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) No storage pools available for shared volume allocation, returning
  2195. 2017-12-01 00:03:32,157 DEBUG [o.a.c.s.a.ZoneWideStoragePoolAllocator] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) ZoneWideStoragePoolAllocator to find storage pool
  2196. 2017-12-01 00:03:32,157 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
  2197. 2017-12-01 00:03:32,158 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) No suitable pools found for volume: Vol[24528|vm=24528|ROOT] under cluster: 1
  2198. 2017-12-01 00:03:32,158 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) No suitable pools found
  2199. 2017-12-01 00:03:32,158 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) No suitable storagePools found under this Cluster: 1
  2200. 2017-12-01 00:03:32,158 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) Removing from the clusterId list these clusters from avoid set: [1]
  2201. 2017-12-01 00:03:32,159 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) No clusters found after removing disabled clusters and clusters in avoid list, returning.
  2202. 2017-12-01 00:03:32,159 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) Could not find suitable Deployment Destination for this VM under any clusters, returning.
  2203. 2017-12-01 00:03:32,159 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) Searching all possible resources under this Zone: 1
  2204. 2017-12-01 00:03:32,159 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
  2205. 2017-12-01 00:03:32,160 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) Removing from the clusterId list these clusters from avoid set: [1]
  2206. 2017-12-01 00:03:32,161 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) No clusters found after removing disabled clusters and clusters in avoid list, returning.
  2207. 2017-12-01 00:03:32,166 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
  2208. 2017-12-01 00:03:32,166 ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) Invocation exception, caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24527-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  2209. 2017-12-01 00:03:32,166 INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) Rethrow exception com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24527-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  2210. 2017-12-01 00:03:32,166 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600) (logid:a98dfed6) Done with run of VM work job: com.cloud.vm.VmWorkStart for VM 24527, job origin: 1
  2211. 2017-12-01 00:03:32,166 ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600) (logid:a98dfed6) Unable to complete AsyncJobVO {id:73600, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfz3QAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:03:30 CST 2017}, job origin:1
  2212. com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24527-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  2213. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
  2214. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
  2215. at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
  2216. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  2217. at java.lang.reflect.Method.invoke(Method.java:498)
  2218. at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
  2219. at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
  2220. at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
  2221. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
  2222. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  2223. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  2224. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  2225. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  2226. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  2227. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
  2228. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  2229. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  2230. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  2231. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  2232. at java.lang.Thread.run(Thread.java:748)
  2233. 2017-12-01 00:03:32,167 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600) (logid:a98dfed6) Complete async job-73600, jobStatus: FAILED, resultCode: 0, result: rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdAA9VW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW0NvbnNvbGVQcm94eXx2LTI0NTI3LVZNXXVyAB5bTGphdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudDsCRio8PP0iOQIAAHhwAAAAFHNyABtqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnRhCcWaJjbdhQIABEkACmxpbmVOdW1iZXJMAA5kZWNsYXJpbmdDbGFzc3EAfgAKTAAIZmlsZU5hbWVxAH4ACkwACm1ldGhvZE5hbWVxAH4ACnhwAAADwHQAJmNvbS5jbG91ZC52bS5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsdAAeVmlydHVhbE1hY2hpbmVNYW5hZ2VySW1wbC5qYXZhdAAQb3JjaGVzdHJhdGVTdGFydHNxAH4AEQAAEgtxAH4AE3EAfgAUcQB-ABVzcQB-ABH_____dAAmc3VuLnJlZmxlY3QuR2VuZXJhdGVkTWV0aG9kQWNjZXNzb3IxOTlwdAAGaW52b2tlc3EAfgARAAAAK3QAKHN1bi5yZWZsZWN0LkRlbGVnYXRpbmdNZXRob2RBY2Nlc3NvckltcGx0ACFEZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsLmphdmFxAH4AGXNxAH4AEQAAAfJ0ABhqYXZhLmxhbmcucmVmbGVjdC5NZXRob2R0AAtNZXRob2QuamF2YXEAfgAZc3EAfgARAAAAa3QAImNvbS5jbG91ZC52bS5WbVdvcmtKb2JIYW5kbGVyUHJveHl0ABpWbVdvcmtKb2JIYW5kbGVyUHJveHkuamF2YXQAD2hhbmRsZVZtV29ya0pvYnNxAH4AEQAAEqxxAH4AE3EAfgAUcQB-ACNzcQB-ABEAAABmdAAgY29tLmNsb3VkLnZtLlZtV29ya0pvYkRpc3BhdGNoZXJ0ABhWbVdvcmtKb2JEaXNwYXRjaGVyLmphdmF0AAZydW5Kb2JzcQB-ABEAAAIqdAA_b3JnLmFwYWNoZS5jbG91ZHN0YWNrLmZyYW1ld29yay5qb2JzLmltcGwuQXN5bmNKb2JNYW5hZ2VySW1wbCQ1dAAYQXN5bmNKb2JNYW5hZ2VySW1wbC5qYXZhdAAMcnVuSW5Db250ZXh0c3EAfgARAAAAMXQAPm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZSQxdAAbTWFuYWdlZENvbnRleHRSdW5uYWJsZS5qYXZhdAADcnVuc3EAfgARAAAAOHQAQm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5EZWZhdWx0TWFuYWdlZENvbnRleHQkMXQAGkRlZmF1bHRNYW5hZ2VkQ29udGV4dC5qYXZhdAAEY2FsbHNxAH4AEQAAAGd0AEBvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0cQB-ADN0AA9jYWxsV2l0aENvbnRleHRzcQB-ABEAAAA1cQB-ADZxAH4AM3QADnJ1bldpdGhDb250ZXh0c3EAfgARAAAALnQAPG9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZXEAfgAvcQB-ADBzcQB-ABEAAAH2cQB-ACpxAH4AK3EAfgAwc3EAfgARAAAB_3QALmphdmEudXRpbC5jb25jdXJyZW50LkV4ZWN1dG9ycyRSdW5uYWJsZUFkYXB0ZXJ0AA5FeGVjdXRvcnMuamF2YXEAfgA0c3EAfgARAAABCnQAH2phdmEudXRpbC5jb25jdXJyZW50LkZ1dHVyZVRhc2t0AA9GdXR1cmVUYXNrLmphdmFxAH4AMHNxAH4AEQAABH10ACdqYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3J0ABdUaHJlYWRQb29sRXhlY3V0b3IuamF2YXQACXJ1bldvcmtlcnNxAH4AEQAAAnB0AC5qYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3IkV29ya2VycQB-AEVxAH4AMHNxAH4AEQAAAux0ABBqYXZhLmxhbmcuVGhyZWFkdAALVGhyZWFkLmphdmFxAH4AMHNyACZqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlTGlzdPwPJTG17I4QAgABTAAEbGlzdHEAfgAMeHIALGphdmEudXRpbC5Db2xsZWN0aW9ucyRVbm1vZGlmaWFibGVDb2xsZWN0aW9uGUIAgMte9x4CAAFMAAFjdAAWTGphdmEvdXRpbC9Db2xsZWN0aW9uO3hwc3IAE2phdmEudXRpbC5BcnJheUxpc3R4gdIdmcdhnQMAAUkABHNpemV4cAAAAAB3BAAAAAB4cQB-AFF4c3IAEWphdmEubGFuZy5JbnRlZ2VyEuKgpPeBhzgCAAFJAAV2YWx1ZXhyABBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAAB4cAAAEO9zcQB-AFAAAAAAdwQAAAAAeHNyAA5qYXZhLmxhbmcuTG9uZzuL5JDMjyPfAgABSgAFdmFsdWV4cQB-AFMAAAAAAAAAAXZyABdjb20uY2xvdWQuZGMuRGF0YUNlbnRlcrLxCuun53i-AgAAeHAA
  2234. 2017-12-01 00:03:32,167 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
  2235. 2017-12-01 00:03:32,167 ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) Invocation exception, caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24528-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  2236. 2017-12-01 00:03:32,168 INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) Rethrow exception com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24528-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  2237. 2017-12-01 00:03:32,168 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601) (logid:32b654cc) Done with run of VM work job: com.cloud.vm.VmWorkStart for VM 24528, job origin: 2
  2238. 2017-12-01 00:03:32,168 ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601) (logid:32b654cc) Unable to complete AsyncJobVO {id:73601, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABf0HQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:03:30 CST 2017}, job origin:2
  2239. com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24528-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  2240. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
  2241. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
  2242. at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
  2243. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  2244. at java.lang.reflect.Method.invoke(Method.java:498)
  2245. at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
  2246. at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
  2247. at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
  2248. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
  2249. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  2250. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  2251. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  2252. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  2253. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  2254. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
  2255. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  2256. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  2257. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  2258. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  2259. at java.lang.Thread.run(Thread.java:748)
  2260. 2017-12-01 00:03:32,168 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601) (logid:32b654cc) Complete async job-73601, jobStatus: FAILED, resultCode: 0, result: rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdABDVW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW1NlY29uZGFyeVN0b3JhZ2VWbXxzLTI0NTI4LVZNXXVyAB5bTGphdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudDsCRio8PP0iOQIAAHhwAAAAFHNyABtqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnRhCcWaJjbdhQIABEkACmxpbmVOdW1iZXJMAA5kZWNsYXJpbmdDbGFzc3EAfgAKTAAIZmlsZU5hbWVxAH4ACkwACm1ldGhvZE5hbWVxAH4ACnhwAAADwHQAJmNvbS5jbG91ZC52bS5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsdAAeVmlydHVhbE1hY2hpbmVNYW5hZ2VySW1wbC5qYXZhdAAQb3JjaGVzdHJhdGVTdGFydHNxAH4AEQAAEgtxAH4AE3EAfgAUcQB-ABVzcQB-ABH_____dAAmc3VuLnJlZmxlY3QuR2VuZXJhdGVkTWV0aG9kQWNjZXNzb3IxOTlwdAAGaW52b2tlc3EAfgARAAAAK3QAKHN1bi5yZWZsZWN0LkRlbGVnYXRpbmdNZXRob2RBY2Nlc3NvckltcGx0ACFEZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsLmphdmFxAH4AGXNxAH4AEQAAAfJ0ABhqYXZhLmxhbmcucmVmbGVjdC5NZXRob2R0AAtNZXRob2QuamF2YXEAfgAZc3EAfgARAAAAa3QAImNvbS5jbG91ZC52bS5WbVdvcmtKb2JIYW5kbGVyUHJveHl0ABpWbVdvcmtKb2JIYW5kbGVyUHJveHkuamF2YXQAD2hhbmRsZVZtV29ya0pvYnNxAH4AEQAAEqxxAH4AE3EAfgAUcQB-ACNzcQB-ABEAAABmdAAgY29tLmNsb3VkLnZtLlZtV29ya0pvYkRpc3BhdGNoZXJ0ABhWbVdvcmtKb2JEaXNwYXRjaGVyLmphdmF0AAZydW5Kb2JzcQB-ABEAAAIqdAA_b3JnLmFwYWNoZS5jbG91ZHN0YWNrLmZyYW1ld29yay5qb2JzLmltcGwuQXN5bmNKb2JNYW5hZ2VySW1wbCQ1dAAYQXN5bmNKb2JNYW5hZ2VySW1wbC5qYXZhdAAMcnVuSW5Db250ZXh0c3EAfgARAAAAMXQAPm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZSQxdAAbTWFuYWdlZENvbnRleHRSdW5uYWJsZS5qYXZhdAADcnVuc3EAfgARAAAAOHQAQm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5EZWZhdWx0TWFuYWdlZENvbnRleHQkMXQAGkRlZmF1bHRNYW5hZ2VkQ29udGV4dC5qYXZhdAAEY2FsbHNxAH4AEQAAAGd0AEBvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0cQB-ADN0AA9jYWxsV2l0aENvbnRleHRzcQB-ABEAAAA1cQB-ADZxAH4AM3QADnJ1bldpdGhDb250ZXh0c3EAfgARAAAALnQAPG9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZXEAfgAvcQB-ADBzcQB-ABEAAAH2cQB-ACpxAH4AK3EAfgAwc3EAfgARAAAB_3QALmphdmEudXRpbC5jb25jdXJyZW50LkV4ZWN1dG9ycyRSdW5uYWJsZUFkYXB0ZXJ0AA5FeGVjdXRvcnMuamF2YXEAfgA0c3EAfgARAAABCnQAH2phdmEudXRpbC5jb25jdXJyZW50LkZ1dHVyZVRhc2t0AA9GdXR1cmVUYXNrLmphdmFxAH4AMHNxAH4AEQAABH10ACdqYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3J0ABdUaHJlYWRQb29sRXhlY3V0b3IuamF2YXQACXJ1bldvcmtlcnNxAH4AEQAAAnB0AC5qYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3IkV29ya2VycQB-AEVxAH4AMHNxAH4AEQAAAux0ABBqYXZhLmxhbmcuVGhyZWFkdAALVGhyZWFkLmphdmFxAH4AMHNyACZqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlTGlzdPwPJTG17I4QAgABTAAEbGlzdHEAfgAMeHIALGphdmEudXRpbC5Db2xsZWN0aW9ucyRVbm1vZGlmaWFibGVDb2xsZWN0aW9uGUIAgMte9x4CAAFMAAFjdAAWTGphdmEvdXRpbC9Db2xsZWN0aW9uO3hwc3IAE2phdmEudXRpbC5BcnJheUxpc3R4gdIdmcdhnQMAAUkABHNpemV4cAAAAAB3BAAAAAB4cQB-AFF4c3IAEWphdmEubGFuZy5JbnRlZ2VyEuKgpPeBhzgCAAFJAAV2YWx1ZXhyABBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAAB4cAAAEO9zcQB-AFAAAAAAdwQAAAAAeHNyAA5qYXZhLmxhbmcuTG9uZzuL5JDMjyPfAgABSgAFdmFsdWV4cQB-AFMAAAAAAAAAAXZyABdjb20uY2xvdWQuZGMuRGF0YUNlbnRlcrLxCuun53i-AgAAeHAA
  2261. 2017-12-01 00:03:32,169 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601) (logid:32b654cc) Publish async job-73601 complete on message bus
  2262. 2017-12-01 00:03:32,169 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601) (logid:32b654cc) Wake up jobs related to job-73601
  2263. 2017-12-01 00:03:32,169 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601) (logid:32b654cc) Update db status for job-73601
  2264. 2017-12-01 00:03:32,170 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601) (logid:32b654cc) Wake up jobs joined with job-73601 and disjoin all subjobs created from job- 73601
  2265. 2017-12-01 00:03:32,174 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601) (logid:32b654cc) Done executing com.cloud.vm.VmWorkStart for job-73601
  2266. 2017-12-01 00:03:32,181 WARN [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-11936d05) (logid:5925c756) Exception while trying to start secondary storage vm
  2267. com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24528-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  2268. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
  2269. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
  2270. at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
  2271. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  2272. at java.lang.reflect.Method.invoke(Method.java:498)
  2273. at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
  2274. at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
  2275. at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
  2276. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
  2277. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  2278. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  2279. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  2280. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  2281. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  2282. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
  2283. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  2284. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  2285. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  2286. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  2287. at java.lang.Thread.run(Thread.java:748)
  2288. 2017-12-01 00:03:32,185 INFO [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-11936d05) (logid:5925c756) Unable to start secondary storage vm for standby capacity, vm id : 24528, will recycle it and start a new one
  2289. 2017-12-01 00:03:32,185 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600) (logid:a98dfed6) Publish async job-73600 complete on message bus
  2290. 2017-12-01 00:03:32,185 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600) (logid:a98dfed6) Wake up jobs related to job-73600
  2291. 2017-12-01 00:03:32,185 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600) (logid:a98dfed6) Update db status for job-73600
  2292. 2017-12-01 00:03:32,186 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600) (logid:a98dfed6) Wake up jobs joined with job-73600 and disjoin all subjobs created from job- 73600
  2293. 2017-12-01 00:03:32,181 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601) (logid:32b654cc) Remove job-73601 from job monitoring
  2294. 2017-12-01 00:03:32,196 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (secstorage-1:ctx-11936d05) (logid:5925c756) Sync job-73602 execution on object VmWorkJobQueue.24528
  2295. 2017-12-01 00:03:32,197 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600) (logid:a98dfed6) Done executing com.cloud.vm.VmWorkStart for job-73600
  2296. 2017-12-01 00:03:32,198 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600) (logid:a98dfed6) Remove job-73600 from job monitoring
  2297. 2017-12-01 00:03:32,204 WARN [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-c3994110) (logid:d0865f01) Exception while trying to start console proxy
  2298. com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24527-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  2299. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
  2300. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
  2301. at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
  2302. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  2303. at java.lang.reflect.Method.invoke(Method.java:498)
  2304. at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
  2305. at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
  2306. at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
  2307. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
  2308. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  2309. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  2310. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  2311. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  2312. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  2313. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
  2314. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  2315. at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  2316. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  2317. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  2318. at java.lang.Thread.run(Thread.java:748)
  2319. 2017-12-01 00:03:32,215 INFO [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-c3994110) (logid:d0865f01) Unable to start console proxy vm for standby capacity, vm id : 24527, will recycle it and start a new one
  2320. 2017-12-01 00:03:32,226 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (consoleproxy-1:ctx-c3994110) (logid:d0865f01) Sync job-73603 execution on object VmWorkJobQueue.24527
  2321. 2017-12-01 00:03:33,499 INFO [c.c.h.v.r.VmwareResource] (DirectAgentCronJob-384:ctx-e2f917ca) (logid:f7d9e7a5) Scan hung worker VM to recycle
  2322. 2017-12-01 00:03:33,681 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgentCronJob-384:ctx-e2f917ca) (logid:f7d9e7a5) Ping from 1(r6-l06-esx01.cisco.com)
  2323. 2017-12-01 00:03:33,681 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-384:ctx-e2f917ca) (logid:f7d9e7a5) Process host VM state report from ping process. host: 1
  2324. 2017-12-01 00:03:33,681 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-384:ctx-e2f917ca) (logid:f7d9e7a5) Process VM state report. host: 1, number of records in report: 0
  2325. 2017-12-01 00:03:33,683 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-384:ctx-e2f917ca) (logid:f7d9e7a5) Done with process of VM state report. host: 1
  2326. 2017-12-01 00:03:34,106 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-7d229549) (logid:a7887a0e) Execute sync-queue item: SyncQueueItemVO {id:73584, queueId: 73581, contentType: AsyncJob, contentId: 73602, lastProcessMsid: 345052167237, lastprocessNumber: 3, lastProcessTime: Fri Dec 01 00:03:34 CST 2017, created: Fri Dec 01 00:03:32 CST 2017}
  2327. 2017-12-01 00:03:34,107 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-7d229549) (logid:a7887a0e) Schedule queued job-73602
  2328. 2017-12-01 00:03:34,109 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-7d229549) (logid:a7887a0e) Execute sync-queue item: SyncQueueItemVO {id:73585, queueId: 73580, contentType: AsyncJob, contentId: 73603, lastProcessMsid: 345052167237, lastprocessNumber: 3, lastProcessTime: Fri Dec 01 00:03:34 CST 2017, created: Fri Dec 01 00:03:32 CST 2017}
  2329. 2017-12-01 00:03:34,109 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-7d229549) (logid:a7887a0e) Schedule queued job-73603
  2330. 2017-12-01 00:03:34,109 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-47:ctx-efc94df6 job-2/job-73602) (logid:1d064cfe) Add job-73602 into job monitoring
  2331. 2017-12-01 00:03:34,112 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-46:ctx-cc7e43c1 job-1/job-73603) (logid:d1c55486) Add job-73603 into job monitoring
  2332. 2017-12-01 00:03:34,114 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-47:ctx-efc94df6 job-2/job-73602) (logid:32b654cc) Executing AsyncJobVO {id:73602, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStop, cmdInfo: rO0ABXNyABdjb20uY2xvdWQudm0uVm1Xb3JrU3RvcALQ4GymiWjjAgABWgAHY2xlYW51cHhyABNjb20uY2xvdWQudm0uVm1Xb3Jrn5m2VvAlZ2sCAARKAAlhY2NvdW50SWRKAAZ1c2VySWRKAAR2bUlkTAALaGFuZGxlck5hbWV0ABJMamF2YS9sYW5nL1N0cmluZzt4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABf0HQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:03:32 CST 2017}
  2333. 2017-12-01 00:03:34,114 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-47:ctx-efc94df6 job-2/job-73602) (logid:32b654cc) Run VM work job: com.cloud.vm.VmWorkStop for VM 24528, job origin: 2
  2334. 2017-12-01 00:03:34,115 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-47:ctx-efc94df6 job-2/job-73602 ctx-c1c78d53) (logid:32b654cc) Execute VM work job: com.cloud.vm.VmWorkStop{"cleanup":false,"userId":1,"accountId":1,"vmId":24528,"handlerName":"VirtualMachineManagerImpl"}
  2335. 2017-12-01 00:03:34,116 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-46:ctx-cc7e43c1 job-1/job-73603) (logid:a98dfed6) Executing AsyncJobVO {id:73603, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStop, cmdInfo: rO0ABXNyABdjb20uY2xvdWQudm0uVm1Xb3JrU3RvcALQ4GymiWjjAgABWgAHY2xlYW51cHhyABNjb20uY2xvdWQudm0uVm1Xb3Jrn5m2VvAlZ2sCAARKAAlhY2NvdW50SWRKAAZ1c2VySWRKAAR2bUlkTAALaGFuZGxlck5hbWV0ABJMamF2YS9sYW5nL1N0cmluZzt4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfz3QAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:03:32 CST 2017}
Add Comment
Please, Sign In to add comment