Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- 2017-12-01 00:00:00,238 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) Zone 1 is ready to launch console proxy
- 2017-12-01 00:00:00,239 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) Expand console proxy standby capacity for zone Zone-Orion
- 2017-12-01 00:00:00,240 INFO [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) No stopped console proxy is available, need to allocate a new console proxy
- 2017-12-01 00:00:00,241 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) Assign console proxy from a newly started instance for request from data center : 1
- 2017-12-01 00:00:00,249 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) Found existing network configuration for offering [Network Offering [1-Public-System-Public-Network]: Ntwk[200|Public|1]
- 2017-12-01 00:00:00,249 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
- 2017-12-01 00:00:00,255 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) Found existing network configuration for offering [Network Offering [3-Control-System-Control-Network]: Ntwk[202|Control|3]
- 2017-12-01 00:00:00,255 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
- 2017-12-01 00:00:00,260 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) Found existing network configuration for offering [Network Offering [2-Management-System-Management-Network]: Ntwk[201|Management|2]
- 2017-12-01 00:00:00,260 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
- 2017-12-01 00:00:00,270 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) Allocating entries for VM: VM[ConsoleProxy|v-24521-VM]
- 2017-12-01 00:00:00,271 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) Allocating nics for VM[ConsoleProxy|v-24521-VM]
- 2017-12-01 00:00:00,272 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) Allocating nic for vm VM[ConsoleProxy|v-24521-VM] in network Ntwk[200|Public|1] with requested profile NicProfile[0-0-null-null-null
- 2017-12-01 00:00:00,283 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) Allocating nic for vm VM[ConsoleProxy|v-24521-VM] in network Ntwk[202|Control|3] with requested profile null
- 2017-12-01 00:00:00,290 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) Allocating nic for vm VM[ConsoleProxy|v-24521-VM] in network Ntwk[201|Management|2] with requested profile null
- 2017-12-01 00:00:00,294 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) Allocating disks for VM[ConsoleProxy|v-24521-VM]
- 2017-12-01 00:00:00,297 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) Allocation completed for VM: VM[ConsoleProxy|v-24521-VM]
- 2017-12-01 00:00:00,300 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) received console proxy alert
- 2017-12-01 00:00:00,300 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) New console proxy created, zone: Zone-Orion, proxy: v-24521-VM, public IP: null, private IP: null
- 2017-12-01 00:00:00,308 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) Sync job-73580 execution on object VmWorkJobQueue.24521
- 2017-12-01 00:00:00,356 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) Zone 1 is ready to launch secondary storage VM
- 2017-12-01 00:00:00,360 INFO [o.a.c.s.PremiumSecondaryStorageManagerImpl] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) No running secondary storage vms found in datacenter id=1, starting one
- 2017-12-01 00:00:00,363 INFO [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) No stopped secondary storage vm is available, need to allocate a new secondary storage vm
- 2017-12-01 00:00:00,364 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) Assign secondary storage vm from a newly started instance for request from data center : 1
- 2017-12-01 00:00:00,371 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) Found existing network configuration for offering [Network Offering [1-Public-System-Public-Network]: Ntwk[200|Public|1]
- 2017-12-01 00:00:00,371 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
- 2017-12-01 00:00:00,375 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) Found existing network configuration for offering [Network Offering [3-Control-System-Control-Network]: Ntwk[202|Control|3]
- 2017-12-01 00:00:00,375 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
- 2017-12-01 00:00:00,380 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) Found existing network configuration for offering [Network Offering [2-Management-System-Management-Network]: Ntwk[201|Management|2]
- 2017-12-01 00:00:00,380 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
- 2017-12-01 00:00:00,385 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) Found existing network configuration for offering [Network Offering [4-Storage-System-Storage-Network]: Ntwk[203|Storage|4]
- 2017-12-01 00:00:00,385 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
- 2017-12-01 00:00:00,395 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) Allocating entries for VM: VM[SecondaryStorageVm|s-24522-VM]
- 2017-12-01 00:00:00,396 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) Allocating nics for VM[SecondaryStorageVm|s-24522-VM]
- 2017-12-01 00:00:00,397 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) Allocating nic for vm VM[SecondaryStorageVm|s-24522-VM] in network Ntwk[200|Public|1] with requested profile NicProfile[0-0-null-null-null
- 2017-12-01 00:00:00,407 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) Allocating nic for vm VM[SecondaryStorageVm|s-24522-VM] in network Ntwk[202|Control|3] with requested profile null
- 2017-12-01 00:00:00,413 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) Allocating nic for vm VM[SecondaryStorageVm|s-24522-VM] in network Ntwk[201|Management|2] with requested profile null
- 2017-12-01 00:00:00,417 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) Allocating nic for vm VM[SecondaryStorageVm|s-24522-VM] in network Ntwk[203|Storage|4] with requested profile null
- 2017-12-01 00:00:00,421 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) Allocating disks for VM[SecondaryStorageVm|s-24522-VM]
- 2017-12-01 00:00:00,425 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) Allocation completed for VM: VM[SecondaryStorageVm|s-24522-VM]
- 2017-12-01 00:00:00,427 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) received secondary storage vm alert
- 2017-12-01 00:00:00,427 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) New secondary storage vm created, zone: Zone-Orion, secStorageVm: s-24522-VM, public IP: null, private IP: null
- 2017-12-01 00:00:00,436 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) Sync job-73581 execution on object VmWorkJobQueue.24522
- 2017-12-01 00:00:02,108 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-8bbf6d34) (logid:deea96a0) Execute sync-queue item: SyncQueueItemVO {id:73562, queueId: 73562, contentType: AsyncJob, contentId: 73580, lastProcessMsid: 345052167237, lastprocessNumber: 1, lastProcessTime: Fri Dec 01 00:00:02 CST 2017, created: Fri Dec 01 00:00:00 CST 2017}
- 2017-12-01 00:00:03,246 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-8bbf6d34) (logid:deea96a0) Schedule queued job-73580
- 2017-12-01 00:00:03,249 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-8bbf6d34) (logid:deea96a0) Execute sync-queue item: SyncQueueItemVO {id:73563, queueId: 73563, contentType: AsyncJob, contentId: 73581, lastProcessMsid: 345052167237, lastprocessNumber: 1, lastProcessTime: Fri Dec 01 00:00:02 CST 2017, created: Fri Dec 01 00:00:00 CST 2017}
- 2017-12-01 00:00:03,250 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580) (logid:53540c6c) Add job-73580 into job monitoring
- 2017-12-01 00:00:03,250 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-8bbf6d34) (logid:deea96a0) Schedule queued job-73581
- 2017-12-01 00:00:03,257 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581) (logid:25fbf3ac) Add job-73581 into job monitoring
- 2017-12-01 00:00:03,257 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580) (logid:a98dfed6) Executing AsyncJobVO {id:73580, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfyXQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:00:00 CST 2017}
- 2017-12-01 00:00:03,257 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580) (logid:a98dfed6) Run VM work job: com.cloud.vm.VmWorkStart for VM 24521, job origin: 1
- 2017-12-01 00:00:03,259 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) Execute VM work job: com.cloud.vm.VmWorkStart{"dcId":0,"userId":1,"accountId":1,"vmId":24521,"handlerName":"VirtualMachineManagerImpl"}
- 2017-12-01 00:00:03,265 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
- 2017-12-01 00:00:03,265 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) Successfully transitioned to start state for VM[ConsoleProxy|v-24521-VM] reservation id = 0387e37c-6477-491b-9b67-8a4a231c4162
- 2017-12-01 00:00:03,266 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581) (logid:32b654cc) Executing AsyncJobVO {id:73581, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfynQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:00:00 CST 2017}
- 2017-12-01 00:00:03,266 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581) (logid:32b654cc) Run VM work job: com.cloud.vm.VmWorkStart for VM 24522, job origin: 2
- 2017-12-01 00:00:03,266 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) Trying to deploy VM, vm has dcId: 1 and podId: null
- 2017-12-01 00:00:03,266 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) Deploy avoids pods: null, clusters: null, hosts: null
- 2017-12-01 00:00:03,267 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) Execute VM work job: com.cloud.vm.VmWorkStart{"dcId":0,"userId":1,"accountId":1,"vmId":24522,"handlerName":"VirtualMachineManagerImpl"}
- 2017-12-01 00:00:03,269 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) Deploy avoids pods: null, clusters: null, hosts: null
- 2017-12-01 00:00:03,270 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@eecdd04
- 2017-12-01 00:00:03,270 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) Trying to allocate a host and storage pools from dc:1, pod:null,cluster:null, requested cpu: 500, requested ram: 1073741824
- 2017-12-01 00:00:03,270 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) Is ROOT volume READY (pool already allocated)?: No
- 2017-12-01 00:00:03,270 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) Searching all possible resources under this Zone: 1
- 2017-12-01 00:00:03,270 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
- 2017-12-01 00:00:03,274 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
- 2017-12-01 00:00:03,274 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) Successfully transitioned to start state for VM[SecondaryStorageVm|s-24522-VM] reservation id = d412c8ca-d116-4f7d-94a2-be9def25229f
- 2017-12-01 00:00:03,275 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) Trying to deploy VM, vm has dcId: 1 and podId: null
- 2017-12-01 00:00:03,275 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) Deploy avoids pods: null, clusters: null, hosts: null
- 2017-12-01 00:00:03,278 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) Deploy avoids pods: null, clusters: null, hosts: null
- 2017-12-01 00:00:03,279 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@eecdd04
- 2017-12-01 00:00:03,279 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) Trying to allocate a host and storage pools from dc:1, pod:null,cluster:null, requested cpu: 500, requested ram: 536870912
- 2017-12-01 00:00:03,279 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) Is ROOT volume READY (pool already allocated)?: No
- 2017-12-01 00:00:03,279 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) Searching all possible resources under this Zone: 1
- 2017-12-01 00:00:03,280 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
- 2017-12-01 00:00:03,280 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) Checking resources in Cluster: 1 under Pod: 1
- 2017-12-01 00:00:03,280 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c FirstFitRoutingAllocator) (logid:a98dfed6) Looking for hosts in dc: 1 pod:1 cluster:1
- 2017-12-01 00:00:03,283 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c FirstFitRoutingAllocator) (logid:a98dfed6) FirstFitAllocator has 1 hosts to check for allocation: [Host[-1-Routing]]
- 2017-12-01 00:00:03,287 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c FirstFitRoutingAllocator) (logid:a98dfed6) Found 1 hosts for allocation after prioritization: [Host[-1-Routing]]
- 2017-12-01 00:00:03,287 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c FirstFitRoutingAllocator) (logid:a98dfed6) Looking for speed=500Mhz, Ram=1024
- 2017-12-01 00:00:03,288 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) Checking resources in Cluster: 1 under Pod: 1
- 2017-12-01 00:00:03,288 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c FirstFitRoutingAllocator) (logid:32b654cc) Looking for hosts in dc: 1 pod:1 cluster:1
- 2017-12-01 00:00:03,290 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c FirstFitRoutingAllocator) (logid:32b654cc) FirstFitAllocator has 1 hosts to check for allocation: [Host[-1-Routing]]
- 2017-12-01 00:00:03,293 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c FirstFitRoutingAllocator) (logid:32b654cc) Found 1 hosts for allocation after prioritization: [Host[-1-Routing]]
- 2017-12-01 00:00:03,293 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c FirstFitRoutingAllocator) (logid:32b654cc) Looking for speed=500Mhz, Ram=512
- 2017-12-01 00:00:03,294 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c FirstFitRoutingAllocator) (logid:a98dfed6) Host: 1 has cpu capability (cpu:16, speed:2533) to support requested CPU: 1 and requested speed: 500
- 2017-12-01 00:00:03,294 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c FirstFitRoutingAllocator) (logid:a98dfed6) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
- 2017-12-01 00:00:03,296 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c FirstFitRoutingAllocator) (logid:a98dfed6) Hosts's actual total CPU: 40528 and CPU after applying overprovisioning: 40528
- 2017-12-01 00:00:03,296 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c FirstFitRoutingAllocator) (logid:a98dfed6) Free CPU: 40528 , Requested CPU: 500
- 2017-12-01 00:00:03,296 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c FirstFitRoutingAllocator) (logid:a98dfed6) Free RAM: 42880884736 , Requested RAM: 1073741824
- 2017-12-01 00:00:03,296 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c FirstFitRoutingAllocator) (logid:a98dfed6) Host has enough CPU and RAM available
- 2017-12-01 00:00:03,296 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c FirstFitRoutingAllocator) (logid:a98dfed6) STATS: Can alloc CPU from host: 1, used: 0, reserved: 0, actual total: 40528, total with overprovisioning: 40528; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
- 2017-12-01 00:00:03,296 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c FirstFitRoutingAllocator) (logid:a98dfed6) STATS: Can alloc MEM from host: 1, used: 0, reserved: 0, total: 42880884736; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
- 2017-12-01 00:00:03,297 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c FirstFitRoutingAllocator) (logid:a98dfed6) Found a suitable host, adding to list: 1
- 2017-12-01 00:00:03,297 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c FirstFitRoutingAllocator) (logid:a98dfed6) Host Allocator returning 1 suitable hosts
- 2017-12-01 00:00:03,298 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c FirstFitRoutingAllocator) (logid:32b654cc) Host: 1 has cpu capability (cpu:16, speed:2533) to support requested CPU: 1 and requested speed: 500
- 2017-12-01 00:00:03,298 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c FirstFitRoutingAllocator) (logid:32b654cc) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 536870912 , cpuOverprovisioningFactor: 1.0
- 2017-12-01 00:00:03,299 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) Checking suitable pools for volume (Id, Type): (24521,ROOT)
- 2017-12-01 00:00:03,299 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) We need to allocate new storagepool for this volume
- 2017-12-01 00:00:03,300 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) Calling StoragePoolAllocators to find suitable pools
- 2017-12-01 00:00:03,300 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c FirstFitRoutingAllocator) (logid:32b654cc) Hosts's actual total CPU: 40528 and CPU after applying overprovisioning: 40528
- 2017-12-01 00:00:03,300 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c FirstFitRoutingAllocator) (logid:32b654cc) Free CPU: 40528 , Requested CPU: 500
- 2017-12-01 00:00:03,300 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c FirstFitRoutingAllocator) (logid:32b654cc) Free RAM: 42880884736 , Requested RAM: 536870912
- 2017-12-01 00:00:03,300 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c FirstFitRoutingAllocator) (logid:32b654cc) Host has enough CPU and RAM available
- 2017-12-01 00:00:03,300 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c FirstFitRoutingAllocator) (logid:32b654cc) STATS: Can alloc CPU from host: 1, used: 0, reserved: 0, actual total: 40528, total with overprovisioning: 40528; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
- 2017-12-01 00:00:03,300 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c FirstFitRoutingAllocator) (logid:32b654cc) STATS: Can alloc MEM from host: 1, used: 0, reserved: 0, total: 42880884736; requested mem: 536870912,alloc_from_last_host?:false ,considerReservedCapacity?: true
- 2017-12-01 00:00:03,300 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c FirstFitRoutingAllocator) (logid:32b654cc) Found a suitable host, adding to list: 1
- 2017-12-01 00:00:03,300 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c FirstFitRoutingAllocator) (logid:32b654cc) Host Allocator returning 1 suitable hosts
- 2017-12-01 00:00:03,301 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) System VMs will use shared storage for zone id=1
- 2017-12-01 00:00:03,301 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) LocalStoragePoolAllocator trying to find storage pool to fit the vm
- 2017-12-01 00:00:03,301 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) ClusterScopeStoragePoolAllocator looking for storage pool
- 2017-12-01 00:00:03,301 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) Looking for pools in dc: 1 pod:1 cluster:1. Disabled pools will be ignored.
- 2017-12-01 00:00:03,301 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) Found pools matching tags: []
- 2017-12-01 00:00:03,302 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) Checking suitable pools for volume (Id, Type): (24522,ROOT)
- 2017-12-01 00:00:03,302 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) We need to allocate new storagepool for this volume
- 2017-12-01 00:00:03,302 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) No storage pools available for shared volume allocation, returning
- 2017-12-01 00:00:03,302 DEBUG [o.a.c.s.a.ZoneWideStoragePoolAllocator] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) ZoneWideStoragePoolAllocator to find storage pool
- 2017-12-01 00:00:03,303 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) Calling StoragePoolAllocators to find suitable pools
- 2017-12-01 00:00:03,303 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) System VMs will use shared storage for zone id=1
- 2017-12-01 00:00:03,303 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) LocalStoragePoolAllocator trying to find storage pool to fit the vm
- 2017-12-01 00:00:03,303 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) ClusterScopeStoragePoolAllocator looking for storage pool
- 2017-12-01 00:00:03,303 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) Looking for pools in dc: 1 pod:1 cluster:1. Disabled pools will be ignored.
- 2017-12-01 00:00:03,303 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) No suitable pools found for volume: Vol[24521|vm=24521|ROOT] under cluster: 1
- 2017-12-01 00:00:03,303 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) No suitable pools found
- 2017-12-01 00:00:03,303 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) No suitable storagePools found under this Cluster: 1
- 2017-12-01 00:00:03,304 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) Found pools matching tags: []
- 2017-12-01 00:00:03,304 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) Could not find suitable Deployment Destination for this VM under any clusters, returning.
- 2017-12-01 00:00:03,304 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) No storage pools available for shared volume allocation, returning
- 2017-12-01 00:00:03,304 DEBUG [o.a.c.s.a.ZoneWideStoragePoolAllocator] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) ZoneWideStoragePoolAllocator to find storage pool
- 2017-12-01 00:00:03,304 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) Searching all possible resources under this Zone: 1
- 2017-12-01 00:00:03,305 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
- 2017-12-01 00:00:03,305 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) No suitable pools found for volume: Vol[24522|vm=24522|ROOT] under cluster: 1
- 2017-12-01 00:00:03,305 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) No suitable pools found
- 2017-12-01 00:00:03,305 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) No suitable storagePools found under this Cluster: 1
- 2017-12-01 00:00:03,306 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) Could not find suitable Deployment Destination for this VM under any clusters, returning.
- 2017-12-01 00:00:03,306 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) Searching all possible resources under this Zone: 1
- 2017-12-01 00:00:03,306 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
- 2017-12-01 00:00:03,306 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) Removing from the clusterId list these clusters from avoid set: [1]
- 2017-12-01 00:00:03,307 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) No clusters found after removing disabled clusters and clusters in avoid list, returning.
- 2017-12-01 00:00:03,307 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) Removing from the clusterId list these clusters from avoid set: [1]
- 2017-12-01 00:00:03,307 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) No clusters found after removing disabled clusters and clusters in avoid list, returning.
- 2017-12-01 00:00:03,318 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
- 2017-12-01 00:00:03,318 ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) Invocation exception, caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24522-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- 2017-12-01 00:00:03,318 INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581 ctx-4a6aa41c) (logid:32b654cc) Rethrow exception com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24522-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- 2017-12-01 00:00:03,318 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581) (logid:32b654cc) Done with run of VM work job: com.cloud.vm.VmWorkStart for VM 24522, job origin: 2
- 2017-12-01 00:00:03,318 ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581) (logid:32b654cc) Unable to complete AsyncJobVO {id:73581, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfynQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:00:00 CST 2017}, job origin:2
- com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24522-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
- at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
- at java.lang.reflect.Method.invoke(Method.java:498)
- at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
- at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
- at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
- at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
- at java.util.concurrent.FutureTask.run(FutureTask.java:266)
- at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
- at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
- at java.lang.Thread.run(Thread.java:748)
- 2017-12-01 00:00:03,319 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581) (logid:32b654cc) Complete async job-73581, jobStatus: FAILED, resultCode: 0, result: rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdABDVW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW1NlY29uZGFyeVN0b3JhZ2VWbXxzLTI0NTIyLVZNXXVyAB5bTGphdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudDsCRio8PP0iOQIAAHhwAAAAFHNyABtqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnRhCcWaJjbdhQIABEkACmxpbmVOdW1iZXJMAA5kZWNsYXJpbmdDbGFzc3EAfgAKTAAIZmlsZU5hbWVxAH4ACkwACm1ldGhvZE5hbWVxAH4ACnhwAAADwHQAJmNvbS5jbG91ZC52bS5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsdAAeVmlydHVhbE1hY2hpbmVNYW5hZ2VySW1wbC5qYXZhdAAQb3JjaGVzdHJhdGVTdGFydHNxAH4AEQAAEgtxAH4AE3EAfgAUcQB-ABVzcQB-ABH_____dAAmc3VuLnJlZmxlY3QuR2VuZXJhdGVkTWV0aG9kQWNjZXNzb3IxOTlwdAAGaW52b2tlc3EAfgARAAAAK3QAKHN1bi5yZWZsZWN0LkRlbGVnYXRpbmdNZXRob2RBY2Nlc3NvckltcGx0ACFEZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsLmphdmFxAH4AGXNxAH4AEQAAAfJ0ABhqYXZhLmxhbmcucmVmbGVjdC5NZXRob2R0AAtNZXRob2QuamF2YXEAfgAZc3EAfgARAAAAa3QAImNvbS5jbG91ZC52bS5WbVdvcmtKb2JIYW5kbGVyUHJveHl0ABpWbVdvcmtKb2JIYW5kbGVyUHJveHkuamF2YXQAD2hhbmRsZVZtV29ya0pvYnNxAH4AEQAAEqxxAH4AE3EAfgAUcQB-ACNzcQB-ABEAAABmdAAgY29tLmNsb3VkLnZtLlZtV29ya0pvYkRpc3BhdGNoZXJ0ABhWbVdvcmtKb2JEaXNwYXRjaGVyLmphdmF0AAZydW5Kb2JzcQB-ABEAAAIqdAA_b3JnLmFwYWNoZS5jbG91ZHN0YWNrLmZyYW1ld29yay5qb2JzLmltcGwuQXN5bmNKb2JNYW5hZ2VySW1wbCQ1dAAYQXN5bmNKb2JNYW5hZ2VySW1wbC5qYXZhdAAMcnVuSW5Db250ZXh0c3EAfgARAAAAMXQAPm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZSQxdAAbTWFuYWdlZENvbnRleHRSdW5uYWJsZS5qYXZhdAADcnVuc3EAfgARAAAAOHQAQm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5EZWZhdWx0TWFuYWdlZENvbnRleHQkMXQAGkRlZmF1bHRNYW5hZ2VkQ29udGV4dC5qYXZhdAAEY2FsbHNxAH4AEQAAAGd0AEBvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0cQB-ADN0AA9jYWxsV2l0aENvbnRleHRzcQB-ABEAAAA1cQB-ADZxAH4AM3QADnJ1bldpdGhDb250ZXh0c3EAfgARAAAALnQAPG9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZXEAfgAvcQB-ADBzcQB-ABEAAAH2cQB-ACpxAH4AK3EAfgAwc3EAfgARAAAB_3QALmphdmEudXRpbC5jb25jdXJyZW50LkV4ZWN1dG9ycyRSdW5uYWJsZUFkYXB0ZXJ0AA5FeGVjdXRvcnMuamF2YXEAfgA0c3EAfgARAAABCnQAH2phdmEudXRpbC5jb25jdXJyZW50LkZ1dHVyZVRhc2t0AA9GdXR1cmVUYXNrLmphdmFxAH4AMHNxAH4AEQAABH10ACdqYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3J0ABdUaHJlYWRQb29sRXhlY3V0b3IuamF2YXQACXJ1bldvcmtlcnNxAH4AEQAAAnB0AC5qYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3IkV29ya2VycQB-AEVxAH4AMHNxAH4AEQAAAux0ABBqYXZhLmxhbmcuVGhyZWFkdAALVGhyZWFkLmphdmFxAH4AMHNyACZqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlTGlzdPwPJTG17I4QAgABTAAEbGlzdHEAfgAMeHIALGphdmEudXRpbC5Db2xsZWN0aW9ucyRVbm1vZGlmaWFibGVDb2xsZWN0aW9uGUIAgMte9x4CAAFMAAFjdAAWTGphdmEvdXRpbC9Db2xsZWN0aW9uO3hwc3IAE2phdmEudXRpbC5BcnJheUxpc3R4gdIdmcdhnQMAAUkABHNpemV4cAAAAAB3BAAAAAB4cQB-AFF4c3IAEWphdmEubGFuZy5JbnRlZ2VyEuKgpPeBhzgCAAFJAAV2YWx1ZXhyABBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAAB4cAAAEO9zcQB-AFAAAAAAdwQAAAAAeHNyAA5qYXZhLmxhbmcuTG9uZzuL5JDMjyPfAgABSgAFdmFsdWV4cQB-AFMAAAAAAAAAAXZyABdjb20uY2xvdWQuZGMuRGF0YUNlbnRlcrLxCuun53i-AgAAeHAA
- 2017-12-01 00:00:03,319 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
- 2017-12-01 00:00:03,320 ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) Invocation exception, caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24521-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- 2017-12-01 00:00:03,320 INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580 ctx-e5938f8c) (logid:a98dfed6) Rethrow exception com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24521-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- 2017-12-01 00:00:03,320 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580) (logid:a98dfed6) Done with run of VM work job: com.cloud.vm.VmWorkStart for VM 24521, job origin: 1
- 2017-12-01 00:00:03,320 ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580) (logid:a98dfed6) Unable to complete AsyncJobVO {id:73580, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfyXQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:00:00 CST 2017}, job origin:1
- com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24521-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
- at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
- at java.lang.reflect.Method.invoke(Method.java:498)
- at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
- at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
- at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
- at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
- at java.util.concurrent.FutureTask.run(FutureTask.java:266)
- at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
- at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
- at java.lang.Thread.run(Thread.java:748)
- 2017-12-01 00:00:03,320 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580) (logid:a98dfed6) Complete async job-73580, jobStatus: FAILED, resultCode: 0, result: rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdAA9VW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW0NvbnNvbGVQcm94eXx2LTI0NTIxLVZNXXVyAB5bTGphdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudDsCRio8PP0iOQIAAHhwAAAAFHNyABtqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnRhCcWaJjbdhQIABEkACmxpbmVOdW1iZXJMAA5kZWNsYXJpbmdDbGFzc3EAfgAKTAAIZmlsZU5hbWVxAH4ACkwACm1ldGhvZE5hbWVxAH4ACnhwAAADwHQAJmNvbS5jbG91ZC52bS5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsdAAeVmlydHVhbE1hY2hpbmVNYW5hZ2VySW1wbC5qYXZhdAAQb3JjaGVzdHJhdGVTdGFydHNxAH4AEQAAEgtxAH4AE3EAfgAUcQB-ABVzcQB-ABH_____dAAmc3VuLnJlZmxlY3QuR2VuZXJhdGVkTWV0aG9kQWNjZXNzb3IxOTlwdAAGaW52b2tlc3EAfgARAAAAK3QAKHN1bi5yZWZsZWN0LkRlbGVnYXRpbmdNZXRob2RBY2Nlc3NvckltcGx0ACFEZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsLmphdmFxAH4AGXNxAH4AEQAAAfJ0ABhqYXZhLmxhbmcucmVmbGVjdC5NZXRob2R0AAtNZXRob2QuamF2YXEAfgAZc3EAfgARAAAAa3QAImNvbS5jbG91ZC52bS5WbVdvcmtKb2JIYW5kbGVyUHJveHl0ABpWbVdvcmtKb2JIYW5kbGVyUHJveHkuamF2YXQAD2hhbmRsZVZtV29ya0pvYnNxAH4AEQAAEqxxAH4AE3EAfgAUcQB-ACNzcQB-ABEAAABmdAAgY29tLmNsb3VkLnZtLlZtV29ya0pvYkRpc3BhdGNoZXJ0ABhWbVdvcmtKb2JEaXNwYXRjaGVyLmphdmF0AAZydW5Kb2JzcQB-ABEAAAIqdAA_b3JnLmFwYWNoZS5jbG91ZHN0YWNrLmZyYW1ld29yay5qb2JzLmltcGwuQXN5bmNKb2JNYW5hZ2VySW1wbCQ1dAAYQXN5bmNKb2JNYW5hZ2VySW1wbC5qYXZhdAAMcnVuSW5Db250ZXh0c3EAfgARAAAAMXQAPm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZSQxdAAbTWFuYWdlZENvbnRleHRSdW5uYWJsZS5qYXZhdAADcnVuc3EAfgARAAAAOHQAQm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5EZWZhdWx0TWFuYWdlZENvbnRleHQkMXQAGkRlZmF1bHRNYW5hZ2VkQ29udGV4dC5qYXZhdAAEY2FsbHNxAH4AEQAAAGd0AEBvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0cQB-ADN0AA9jYWxsV2l0aENvbnRleHRzcQB-ABEAAAA1cQB-ADZxAH4AM3QADnJ1bldpdGhDb250ZXh0c3EAfgARAAAALnQAPG9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZXEAfgAvcQB-ADBzcQB-ABEAAAH2cQB-ACpxAH4AK3EAfgAwc3EAfgARAAAB_3QALmphdmEudXRpbC5jb25jdXJyZW50LkV4ZWN1dG9ycyRSdW5uYWJsZUFkYXB0ZXJ0AA5FeGVjdXRvcnMuamF2YXEAfgA0c3EAfgARAAABCnQAH2phdmEudXRpbC5jb25jdXJyZW50LkZ1dHVyZVRhc2t0AA9GdXR1cmVUYXNrLmphdmFxAH4AMHNxAH4AEQAABH10ACdqYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3J0ABdUaHJlYWRQb29sRXhlY3V0b3IuamF2YXQACXJ1bldvcmtlcnNxAH4AEQAAAnB0AC5qYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3IkV29ya2VycQB-AEVxAH4AMHNxAH4AEQAAAux0ABBqYXZhLmxhbmcuVGhyZWFkdAALVGhyZWFkLmphdmFxAH4AMHNyACZqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlTGlzdPwPJTG17I4QAgABTAAEbGlzdHEAfgAMeHIALGphdmEudXRpbC5Db2xsZWN0aW9ucyRVbm1vZGlmaWFibGVDb2xsZWN0aW9uGUIAgMte9x4CAAFMAAFjdAAWTGphdmEvdXRpbC9Db2xsZWN0aW9uO3hwc3IAE2phdmEudXRpbC5BcnJheUxpc3R4gdIdmcdhnQMAAUkABHNpemV4cAAAAAB3BAAAAAB4cQB-AFF4c3IAEWphdmEubGFuZy5JbnRlZ2VyEuKgpPeBhzgCAAFJAAV2YWx1ZXhyABBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAAB4cAAAEO9zcQB-AFAAAAAAdwQAAAAAeHNyAA5qYXZhLmxhbmcuTG9uZzuL5JDMjyPfAgABSgAFdmFsdWV4cQB-AFMAAAAAAAAAAXZyABdjb20uY2xvdWQuZGMuRGF0YUNlbnRlcrLxCuun53i-AgAAeHAA
- 2017-12-01 00:00:03,321 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581) (logid:32b654cc) Publish async job-73581 complete on message bus
- 2017-12-01 00:00:03,321 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581) (logid:32b654cc) Wake up jobs related to job-73581
- 2017-12-01 00:00:03,321 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581) (logid:32b654cc) Update db status for job-73581
- 2017-12-01 00:00:03,323 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581) (logid:32b654cc) Wake up jobs joined with job-73581 and disjoin all subjobs created from job- 73581
- 2017-12-01 00:00:03,324 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580) (logid:a98dfed6) Publish async job-73580 complete on message bus
- 2017-12-01 00:00:03,324 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580) (logid:a98dfed6) Wake up jobs related to job-73580
- 2017-12-01 00:00:03,324 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580) (logid:a98dfed6) Update db status for job-73580
- 2017-12-01 00:00:03,327 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580) (logid:a98dfed6) Wake up jobs joined with job-73580 and disjoin all subjobs created from job- 73580
- 2017-12-01 00:00:03,333 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581) (logid:32b654cc) Done executing com.cloud.vm.VmWorkStart for job-73581
- 2017-12-01 00:00:03,339 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-25:ctx-4e59666f job-2/job-73581) (logid:32b654cc) Remove job-73581 from job monitoring
- 2017-12-01 00:00:03,340 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580) (logid:a98dfed6) Done executing com.cloud.vm.VmWorkStart for job-73580
- 2017-12-01 00:00:03,340 WARN [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) Exception while trying to start secondary storage vm
- com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24522-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
- at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
- at java.lang.reflect.Method.invoke(Method.java:498)
- at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
- at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
- at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
- at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
- at java.util.concurrent.FutureTask.run(FutureTask.java:266)
- at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
- at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
- at java.lang.Thread.run(Thread.java:748)
- 2017-12-01 00:00:03,343 INFO [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) Unable to start secondary storage vm for standby capacity, vm id : 24522, will recycle it and start a new one
- 2017-12-01 00:00:03,343 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) received secondary storage vm alert
- 2017-12-01 00:00:03,343 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) Secondary Storage Vm creation failure, zone: Zone-Orion
- 2017-12-01 00:00:03,344 WARN [o.a.c.alerts] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) alertType:: 19 // dataCenterId:: 1 // podId:: null // clusterId:: null // message:: Secondary Storage Vm creation failure. zone: Zone-Orion, error details: null
- 2017-12-01 00:00:03,345 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-24:ctx-fc67a998 job-1/job-73580) (logid:a98dfed6) Remove job-73580 from job monitoring
- 2017-12-01 00:00:03,347 INFO [o.a.c.s.PremiumSecondaryStorageManagerImpl] (secstorage-1:ctx-91037a0b) (logid:2a3536b4) Primary secondary storage is not even started, wait until next turn
- 2017-12-01 00:00:03,354 WARN [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) Exception while trying to start console proxy
- com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24521-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
- at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
- at java.lang.reflect.Method.invoke(Method.java:498)
- at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
- at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
- at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
- at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
- at java.util.concurrent.FutureTask.run(FutureTask.java:266)
- at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
- at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
- at java.lang.Thread.run(Thread.java:748)
- 2017-12-01 00:00:03,371 INFO [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) Unable to start console proxy vm for standby capacity, vm id : 24521, will recycle it and start a new one
- 2017-12-01 00:00:03,371 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) received console proxy alert
- 2017-12-01 00:00:03,371 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) Console proxy creation failure, zone: Zone-Orion
- 2017-12-01 00:00:03,400 WARN [o.a.c.alerts] (consoleproxy-1:ctx-b08e2572) (logid:a0f88442) alertType:: 10 // dataCenterId:: 1 // podId:: null // clusterId:: null // message:: Console proxy creation failure. zone: Zone-Orion, error details: null
- 2017-12-01 00:00:04,104 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-c115b699) (logid:3f3769fb) Begin cleanup expired async-jobs
- 2017-12-01 00:00:04,108 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-c115b699) (logid:3f3769fb) End cleanup expired async-jobs
- 2017-12-01 00:00:14,104 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-abd72b19) (logid:4865eda5) Begin cleanup expired async-jobs
- 2017-12-01 00:00:14,108 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-abd72b19) (logid:4865eda5) End cleanup expired async-jobs
- 2017-12-01 00:00:15,413 DEBUG [c.c.s.StatsCollector] (StatsCollector-2:ctx-5d3dff9a) (logid:b538c45b) HostStatsCollector is running...
- 2017-12-01 00:00:15,419 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-331:ctx-99472dbd) (logid:66f3977e) Seq 1-3458483038843866934: Executing request
- 2017-12-01 00:00:15,526 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-331:ctx-99472dbd) (logid:b538c45b) Seq 1-3458483038843866934: Response Received:
- 2017-12-01 00:00:15,527 DEBUG [c.c.a.t.Request] (StatsCollector-2:ctx-5d3dff9a) (logid:b538c45b) Seq 1-3458483038843866934: Received: { Ans: , MgmtId: 345052167237, via: 1(r6-l06-esx01.cisco.com), Ver: v1, Flags: 10, { GetHostStatsAnswer } }
- 2017-12-01 00:00:24,105 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-feea2201) (logid:cb61d772) Begin cleanup expired async-jobs
- 2017-12-01 00:00:24,109 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-feea2201) (logid:cb61d772) End cleanup expired async-jobs
- 2017-12-01 00:00:24,338 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-ce4c12a1) (logid:bcff034e) Found 0 routers to update status.
- 2017-12-01 00:00:24,339 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-ce4c12a1) (logid:bcff034e) Found 0 VPC networks to update Redundant State.
- 2017-12-01 00:00:24,340 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-ce4c12a1) (logid:bcff034e) Found 0 networks to update RvR status.
- 2017-12-01 00:00:30,238 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) Zone 1 is ready to launch console proxy
- 2017-12-01 00:00:30,238 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) Expand console proxy standby capacity for zone Zone-Orion
- 2017-12-01 00:00:30,239 INFO [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) Found a stopped console proxy, starting it. Vm id : 24521
- 2017-12-01 00:00:30,246 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) Sync job-73582 execution on object VmWorkJobQueue.24521
- 2017-12-01 00:00:30,438 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Zone 1 is ready to launch secondary storage VM
- 2017-12-01 00:00:30,464 INFO [o.a.c.s.PremiumSecondaryStorageManagerImpl] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) No running secondary storage vms found in datacenter id=1, starting one
- 2017-12-01 00:00:30,473 INFO [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Found a stopped secondary storage vm, starting it. Vm id : 24522
- 2017-12-01 00:00:30,481 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Sync job-73583 execution on object VmWorkJobQueue.24522
- 2017-12-01 00:00:31,133 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-29a39fc2) (logid:efa776ba) Resetting hosts suitable for reconnect
- 2017-12-01 00:00:31,134 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-29a39fc2) (logid:efa776ba) Completed resetting hosts suitable for reconnect
- 2017-12-01 00:00:31,134 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-29a39fc2) (logid:efa776ba) Acquiring hosts for clusters already owned by this management server
- 2017-12-01 00:00:31,135 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-29a39fc2) (logid:efa776ba) Completed acquiring hosts for clusters already owned by this management server
- 2017-12-01 00:00:31,135 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-29a39fc2) (logid:efa776ba) Acquiring hosts for clusters not owned by any management server
- 2017-12-01 00:00:31,135 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-29a39fc2) (logid:efa776ba) Completed acquiring hosts for clusters not owned by any management server
- 2017-12-01 00:00:32,107 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-c73d22f3) (logid:a3d8f7d4) Execute sync-queue item: SyncQueueItemVO {id:73564, queueId: 73562, contentType: AsyncJob, contentId: 73582, lastProcessMsid: 345052167237, lastprocessNumber: 2, lastProcessTime: Fri Dec 01 00:00:32 CST 2017, created: Fri Dec 01 00:00:30 CST 2017}
- 2017-12-01 00:00:32,108 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-c73d22f3) (logid:a3d8f7d4) Schedule queued job-73582
- 2017-12-01 00:00:32,110 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-c73d22f3) (logid:a3d8f7d4) Execute sync-queue item: SyncQueueItemVO {id:73565, queueId: 73563, contentType: AsyncJob, contentId: 73583, lastProcessMsid: 345052167237, lastprocessNumber: 2, lastProcessTime: Fri Dec 01 00:00:32 CST 2017, created: Fri Dec 01 00:00:30 CST 2017}
- 2017-12-01 00:00:32,111 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582) (logid:0291080b) Add job-73582 into job monitoring
- 2017-12-01 00:00:32,113 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-c73d22f3) (logid:a3d8f7d4) Schedule queued job-73583
- 2017-12-01 00:00:32,117 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583) (logid:d0161622) Add job-73583 into job monitoring
- 2017-12-01 00:00:32,118 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582) (logid:a98dfed6) Executing AsyncJobVO {id:73582, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfyXQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:00:30 CST 2017}
- 2017-12-01 00:00:32,118 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582) (logid:a98dfed6) Run VM work job: com.cloud.vm.VmWorkStart for VM 24521, job origin: 1
- 2017-12-01 00:00:32,119 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) Execute VM work job: com.cloud.vm.VmWorkStart{"dcId":0,"userId":1,"accountId":1,"vmId":24521,"handlerName":"VirtualMachineManagerImpl"}
- 2017-12-01 00:00:32,124 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583) (logid:32b654cc) Executing AsyncJobVO {id:73583, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfynQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:00:30 CST 2017}
- 2017-12-01 00:00:32,124 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583) (logid:32b654cc) Run VM work job: com.cloud.vm.VmWorkStart for VM 24522, job origin: 2
- 2017-12-01 00:00:32,125 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
- 2017-12-01 00:00:32,125 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) Successfully transitioned to start state for VM[ConsoleProxy|v-24521-VM] reservation id = df78decd-2755-437b-8b73-eb46549fa008
- 2017-12-01 00:00:32,125 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) Execute VM work job: com.cloud.vm.VmWorkStart{"dcId":0,"userId":1,"accountId":1,"vmId":24522,"handlerName":"VirtualMachineManagerImpl"}
- 2017-12-01 00:00:32,126 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) Trying to deploy VM, vm has dcId: 1 and podId: null
- 2017-12-01 00:00:32,126 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) Deploy avoids pods: null, clusters: null, hosts: null
- 2017-12-01 00:00:32,129 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) Deploy avoids pods: null, clusters: null, hosts: null
- 2017-12-01 00:00:32,130 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@eecdd04
- 2017-12-01 00:00:32,130 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) Trying to allocate a host and storage pools from dc:1, pod:null,cluster:null, requested cpu: 500, requested ram: 1073741824
- 2017-12-01 00:00:32,130 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) Is ROOT volume READY (pool already allocated)?: No
- 2017-12-01 00:00:32,130 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) Searching all possible resources under this Zone: 1
- 2017-12-01 00:00:32,130 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
- 2017-12-01 00:00:32,131 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
- 2017-12-01 00:00:32,131 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) Successfully transitioned to start state for VM[SecondaryStorageVm|s-24522-VM] reservation id = 5bd64a66-f3b6-4814-b05b-3c27c3e405b4
- 2017-12-01 00:00:32,132 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) Trying to deploy VM, vm has dcId: 1 and podId: null
- 2017-12-01 00:00:32,132 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) Deploy avoids pods: null, clusters: null, hosts: null
- 2017-12-01 00:00:32,135 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) Deploy avoids pods: null, clusters: null, hosts: null
- 2017-12-01 00:00:32,135 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@eecdd04
- 2017-12-01 00:00:32,135 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) Trying to allocate a host and storage pools from dc:1, pod:null,cluster:null, requested cpu: 500, requested ram: 536870912
- 2017-12-01 00:00:32,135 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) Is ROOT volume READY (pool already allocated)?: No
- 2017-12-01 00:00:32,135 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) Searching all possible resources under this Zone: 1
- 2017-12-01 00:00:32,136 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
- 2017-12-01 00:00:32,139 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) Checking resources in Cluster: 1 under Pod: 1
- 2017-12-01 00:00:32,139 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019 FirstFitRoutingAllocator) (logid:a98dfed6) Looking for hosts in dc: 1 pod:1 cluster:1
- 2017-12-01 00:00:32,141 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019 FirstFitRoutingAllocator) (logid:a98dfed6) FirstFitAllocator has 1 hosts to check for allocation: [Host[-1-Routing]]
- 2017-12-01 00:00:32,145 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019 FirstFitRoutingAllocator) (logid:a98dfed6) Found 1 hosts for allocation after prioritization: [Host[-1-Routing]]
- 2017-12-01 00:00:32,145 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019 FirstFitRoutingAllocator) (logid:a98dfed6) Looking for speed=500Mhz, Ram=1024
- 2017-12-01 00:00:32,146 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) Checking resources in Cluster: 1 under Pod: 1
- 2017-12-01 00:00:32,146 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e FirstFitRoutingAllocator) (logid:32b654cc) Looking for hosts in dc: 1 pod:1 cluster:1
- 2017-12-01 00:00:32,148 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e FirstFitRoutingAllocator) (logid:32b654cc) FirstFitAllocator has 1 hosts to check for allocation: [Host[-1-Routing]]
- 2017-12-01 00:00:32,150 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019 FirstFitRoutingAllocator) (logid:a98dfed6) Host: 1 has cpu capability (cpu:16, speed:2533) to support requested CPU: 1 and requested speed: 500
- 2017-12-01 00:00:32,150 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019 FirstFitRoutingAllocator) (logid:a98dfed6) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
- 2017-12-01 00:00:32,151 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e FirstFitRoutingAllocator) (logid:32b654cc) Found 1 hosts for allocation after prioritization: [Host[-1-Routing]]
- 2017-12-01 00:00:32,151 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e FirstFitRoutingAllocator) (logid:32b654cc) Looking for speed=500Mhz, Ram=512
- 2017-12-01 00:00:32,151 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019 FirstFitRoutingAllocator) (logid:a98dfed6) Hosts's actual total CPU: 40528 and CPU after applying overprovisioning: 40528
- 2017-12-01 00:00:32,151 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019 FirstFitRoutingAllocator) (logid:a98dfed6) Free CPU: 40528 , Requested CPU: 500
- 2017-12-01 00:00:32,151 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019 FirstFitRoutingAllocator) (logid:a98dfed6) Free RAM: 42880884736 , Requested RAM: 1073741824
- 2017-12-01 00:00:32,151 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019 FirstFitRoutingAllocator) (logid:a98dfed6) Host has enough CPU and RAM available
- 2017-12-01 00:00:32,151 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019 FirstFitRoutingAllocator) (logid:a98dfed6) STATS: Can alloc CPU from host: 1, used: 0, reserved: 0, actual total: 40528, total with overprovisioning: 40528; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
- 2017-12-01 00:00:32,152 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019 FirstFitRoutingAllocator) (logid:a98dfed6) STATS: Can alloc MEM from host: 1, used: 0, reserved: 0, total: 42880884736; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
- 2017-12-01 00:00:32,152 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019 FirstFitRoutingAllocator) (logid:a98dfed6) Found a suitable host, adding to list: 1
- 2017-12-01 00:00:32,152 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019 FirstFitRoutingAllocator) (logid:a98dfed6) Host Allocator returning 1 suitable hosts
- 2017-12-01 00:00:32,153 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) Checking suitable pools for volume (Id, Type): (24521,ROOT)
- 2017-12-01 00:00:32,153 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) We need to allocate new storagepool for this volume
- 2017-12-01 00:00:32,154 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) Calling StoragePoolAllocators to find suitable pools
- 2017-12-01 00:00:32,155 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) System VMs will use shared storage for zone id=1
- 2017-12-01 00:00:32,155 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) LocalStoragePoolAllocator trying to find storage pool to fit the vm
- 2017-12-01 00:00:32,155 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) ClusterScopeStoragePoolAllocator looking for storage pool
- 2017-12-01 00:00:32,155 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) Looking for pools in dc: 1 pod:1 cluster:1. Disabled pools will be ignored.
- 2017-12-01 00:00:32,155 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) Found pools matching tags: []
- 2017-12-01 00:00:32,156 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) No storage pools available for shared volume allocation, returning
- 2017-12-01 00:00:32,156 DEBUG [o.a.c.s.a.ZoneWideStoragePoolAllocator] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) ZoneWideStoragePoolAllocator to find storage pool
- 2017-12-01 00:00:32,157 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e FirstFitRoutingAllocator) (logid:32b654cc) Host: 1 has cpu capability (cpu:16, speed:2533) to support requested CPU: 1 and requested speed: 500
- 2017-12-01 00:00:32,157 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e FirstFitRoutingAllocator) (logid:32b654cc) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 536870912 , cpuOverprovisioningFactor: 1.0
- 2017-12-01 00:00:32,157 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) No suitable pools found for volume: Vol[24521|vm=24521|ROOT] under cluster: 1
- 2017-12-01 00:00:32,157 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) No suitable pools found
- 2017-12-01 00:00:32,157 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) No suitable storagePools found under this Cluster: 1
- 2017-12-01 00:00:32,157 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) Could not find suitable Deployment Destination for this VM under any clusters, returning.
- 2017-12-01 00:00:32,157 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) Searching all possible resources under this Zone: 1
- 2017-12-01 00:00:32,158 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
- 2017-12-01 00:00:32,158 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e FirstFitRoutingAllocator) (logid:32b654cc) Hosts's actual total CPU: 40528 and CPU after applying overprovisioning: 40528
- 2017-12-01 00:00:32,158 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e FirstFitRoutingAllocator) (logid:32b654cc) Free CPU: 40528 , Requested CPU: 500
- 2017-12-01 00:00:32,158 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e FirstFitRoutingAllocator) (logid:32b654cc) Free RAM: 42880884736 , Requested RAM: 536870912
- 2017-12-01 00:00:32,158 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e FirstFitRoutingAllocator) (logid:32b654cc) Host has enough CPU and RAM available
- 2017-12-01 00:00:32,158 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e FirstFitRoutingAllocator) (logid:32b654cc) STATS: Can alloc CPU from host: 1, used: 0, reserved: 0, actual total: 40528, total with overprovisioning: 40528; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
- 2017-12-01 00:00:32,158 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e FirstFitRoutingAllocator) (logid:32b654cc) STATS: Can alloc MEM from host: 1, used: 0, reserved: 0, total: 42880884736; requested mem: 536870912,alloc_from_last_host?:false ,considerReservedCapacity?: true
- 2017-12-01 00:00:32,158 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e FirstFitRoutingAllocator) (logid:32b654cc) Found a suitable host, adding to list: 1
- 2017-12-01 00:00:32,158 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e FirstFitRoutingAllocator) (logid:32b654cc) Host Allocator returning 1 suitable hosts
- 2017-12-01 00:00:32,159 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) Removing from the clusterId list these clusters from avoid set: [1]
- 2017-12-01 00:00:32,159 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) No clusters found after removing disabled clusters and clusters in avoid list, returning.
- 2017-12-01 00:00:32,160 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) Checking suitable pools for volume (Id, Type): (24522,ROOT)
- 2017-12-01 00:00:32,160 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) We need to allocate new storagepool for this volume
- 2017-12-01 00:00:32,161 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) Calling StoragePoolAllocators to find suitable pools
- 2017-12-01 00:00:32,161 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) System VMs will use shared storage for zone id=1
- 2017-12-01 00:00:32,161 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) LocalStoragePoolAllocator trying to find storage pool to fit the vm
- 2017-12-01 00:00:32,161 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) ClusterScopeStoragePoolAllocator looking for storage pool
- 2017-12-01 00:00:32,161 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) Looking for pools in dc: 1 pod:1 cluster:1. Disabled pools will be ignored.
- 2017-12-01 00:00:32,162 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) Found pools matching tags: []
- 2017-12-01 00:00:32,162 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) No storage pools available for shared volume allocation, returning
- 2017-12-01 00:00:32,162 DEBUG [o.a.c.s.a.ZoneWideStoragePoolAllocator] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) ZoneWideStoragePoolAllocator to find storage pool
- 2017-12-01 00:00:32,163 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) No suitable pools found for volume: Vol[24522|vm=24522|ROOT] under cluster: 1
- 2017-12-01 00:00:32,163 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) No suitable pools found
- 2017-12-01 00:00:32,163 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) No suitable storagePools found under this Cluster: 1
- 2017-12-01 00:00:32,164 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) Could not find suitable Deployment Destination for this VM under any clusters, returning.
- 2017-12-01 00:00:32,164 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) Searching all possible resources under this Zone: 1
- 2017-12-01 00:00:32,164 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
- 2017-12-01 00:00:32,165 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) Removing from the clusterId list these clusters from avoid set: [1]
- 2017-12-01 00:00:32,166 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) No clusters found after removing disabled clusters and clusters in avoid list, returning.
- 2017-12-01 00:00:32,166 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
- 2017-12-01 00:00:32,166 ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) Invocation exception, caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24521-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- 2017-12-01 00:00:32,166 INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582 ctx-86a1c019) (logid:a98dfed6) Rethrow exception com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24521-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- 2017-12-01 00:00:32,166 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582) (logid:a98dfed6) Done with run of VM work job: com.cloud.vm.VmWorkStart for VM 24521, job origin: 1
- 2017-12-01 00:00:32,166 ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582) (logid:a98dfed6) Unable to complete AsyncJobVO {id:73582, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfyXQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:00:30 CST 2017}, job origin:1
- com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24521-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
- at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
- at java.lang.reflect.Method.invoke(Method.java:498)
- at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
- at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
- at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
- at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
- at java.util.concurrent.FutureTask.run(FutureTask.java:266)
- at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
- at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
- at java.lang.Thread.run(Thread.java:748)
- 2017-12-01 00:00:32,167 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582) (logid:a98dfed6) Complete async job-73582, jobStatus: FAILED, resultCode: 0, result: rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdAA9VW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW0NvbnNvbGVQcm94eXx2LTI0NTIxLVZNXXVyAB5bTGphdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudDsCRio8PP0iOQIAAHhwAAAAFHNyABtqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnRhCcWaJjbdhQIABEkACmxpbmVOdW1iZXJMAA5kZWNsYXJpbmdDbGFzc3EAfgAKTAAIZmlsZU5hbWVxAH4ACkwACm1ldGhvZE5hbWVxAH4ACnhwAAADwHQAJmNvbS5jbG91ZC52bS5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsdAAeVmlydHVhbE1hY2hpbmVNYW5hZ2VySW1wbC5qYXZhdAAQb3JjaGVzdHJhdGVTdGFydHNxAH4AEQAAEgtxAH4AE3EAfgAUcQB-ABVzcQB-ABH_____dAAmc3VuLnJlZmxlY3QuR2VuZXJhdGVkTWV0aG9kQWNjZXNzb3IxOTlwdAAGaW52b2tlc3EAfgARAAAAK3QAKHN1bi5yZWZsZWN0LkRlbGVnYXRpbmdNZXRob2RBY2Nlc3NvckltcGx0ACFEZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsLmphdmFxAH4AGXNxAH4AEQAAAfJ0ABhqYXZhLmxhbmcucmVmbGVjdC5NZXRob2R0AAtNZXRob2QuamF2YXEAfgAZc3EAfgARAAAAa3QAImNvbS5jbG91ZC52bS5WbVdvcmtKb2JIYW5kbGVyUHJveHl0ABpWbVdvcmtKb2JIYW5kbGVyUHJveHkuamF2YXQAD2hhbmRsZVZtV29ya0pvYnNxAH4AEQAAEqxxAH4AE3EAfgAUcQB-ACNzcQB-ABEAAABmdAAgY29tLmNsb3VkLnZtLlZtV29ya0pvYkRpc3BhdGNoZXJ0ABhWbVdvcmtKb2JEaXNwYXRjaGVyLmphdmF0AAZydW5Kb2JzcQB-ABEAAAIqdAA_b3JnLmFwYWNoZS5jbG91ZHN0YWNrLmZyYW1ld29yay5qb2JzLmltcGwuQXN5bmNKb2JNYW5hZ2VySW1wbCQ1dAAYQXN5bmNKb2JNYW5hZ2VySW1wbC5qYXZhdAAMcnVuSW5Db250ZXh0c3EAfgARAAAAMXQAPm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZSQxdAAbTWFuYWdlZENvbnRleHRSdW5uYWJsZS5qYXZhdAADcnVuc3EAfgARAAAAOHQAQm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5EZWZhdWx0TWFuYWdlZENvbnRleHQkMXQAGkRlZmF1bHRNYW5hZ2VkQ29udGV4dC5qYXZhdAAEY2FsbHNxAH4AEQAAAGd0AEBvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0cQB-ADN0AA9jYWxsV2l0aENvbnRleHRzcQB-ABEAAAA1cQB-ADZxAH4AM3QADnJ1bldpdGhDb250ZXh0c3EAfgARAAAALnQAPG9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZXEAfgAvcQB-ADBzcQB-ABEAAAH2cQB-ACpxAH4AK3EAfgAwc3EAfgARAAAB_3QALmphdmEudXRpbC5jb25jdXJyZW50LkV4ZWN1dG9ycyRSdW5uYWJsZUFkYXB0ZXJ0AA5FeGVjdXRvcnMuamF2YXEAfgA0c3EAfgARAAABCnQAH2phdmEudXRpbC5jb25jdXJyZW50LkZ1dHVyZVRhc2t0AA9GdXR1cmVUYXNrLmphdmFxAH4AMHNxAH4AEQAABH10ACdqYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3J0ABdUaHJlYWRQb29sRXhlY3V0b3IuamF2YXQACXJ1bldvcmtlcnNxAH4AEQAAAnB0AC5qYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3IkV29ya2VycQB-AEVxAH4AMHNxAH4AEQAAAux0ABBqYXZhLmxhbmcuVGhyZWFkdAALVGhyZWFkLmphdmFxAH4AMHNyACZqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlTGlzdPwPJTG17I4QAgABTAAEbGlzdHEAfgAMeHIALGphdmEudXRpbC5Db2xsZWN0aW9ucyRVbm1vZGlmaWFibGVDb2xsZWN0aW9uGUIAgMte9x4CAAFMAAFjdAAWTGphdmEvdXRpbC9Db2xsZWN0aW9uO3hwc3IAE2phdmEudXRpbC5BcnJheUxpc3R4gdIdmcdhnQMAAUkABHNpemV4cAAAAAB3BAAAAAB4cQB-AFF4c3IAEWphdmEubGFuZy5JbnRlZ2VyEuKgpPeBhzgCAAFJAAV2YWx1ZXhyABBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAAB4cAAAEO9zcQB-AFAAAAAAdwQAAAAAeHNyAA5qYXZhLmxhbmcuTG9uZzuL5JDMjyPfAgABSgAFdmFsdWV4cQB-AFMAAAAAAAAAAXZyABdjb20uY2xvdWQuZGMuRGF0YUNlbnRlcrLxCuun53i-AgAAeHAA
- 2017-12-01 00:00:32,168 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582) (logid:a98dfed6) Publish async job-73582 complete on message bus
- 2017-12-01 00:00:32,168 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582) (logid:a98dfed6) Wake up jobs related to job-73582
- 2017-12-01 00:00:32,168 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582) (logid:a98dfed6) Update db status for job-73582
- 2017-12-01 00:00:32,173 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582) (logid:a98dfed6) Wake up jobs joined with job-73582 and disjoin all subjobs created from job- 73582
- 2017-12-01 00:00:32,178 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582) (logid:a98dfed6) Done executing com.cloud.vm.VmWorkStart for job-73582
- 2017-12-01 00:00:32,179 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-26:ctx-3c03b23c job-1/job-73582) (logid:a98dfed6) Remove job-73582 from job monitoring
- 2017-12-01 00:00:32,180 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
- 2017-12-01 00:00:32,180 ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) Invocation exception, caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24522-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- 2017-12-01 00:00:32,180 INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583 ctx-ecb3c13e) (logid:32b654cc) Rethrow exception com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24522-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- 2017-12-01 00:00:32,180 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583) (logid:32b654cc) Done with run of VM work job: com.cloud.vm.VmWorkStart for VM 24522, job origin: 2
- 2017-12-01 00:00:32,180 ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583) (logid:32b654cc) Unable to complete AsyncJobVO {id:73583, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfynQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:00:30 CST 2017}, job origin:2
- com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24522-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
- at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
- at java.lang.reflect.Method.invoke(Method.java:498)
- at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
- at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
- at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
- at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
- at java.util.concurrent.FutureTask.run(FutureTask.java:266)
- at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
- at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
- at java.lang.Thread.run(Thread.java:748)
- 2017-12-01 00:00:32,181 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583) (logid:32b654cc) Complete async job-73583, jobStatus: FAILED, resultCode: 0, result: rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdABDVW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW1NlY29uZGFyeVN0b3JhZ2VWbXxzLTI0NTIyLVZNXXVyAB5bTGphdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudDsCRio8PP0iOQIAAHhwAAAAFHNyABtqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnRhCcWaJjbdhQIABEkACmxpbmVOdW1iZXJMAA5kZWNsYXJpbmdDbGFzc3EAfgAKTAAIZmlsZU5hbWVxAH4ACkwACm1ldGhvZE5hbWVxAH4ACnhwAAADwHQAJmNvbS5jbG91ZC52bS5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsdAAeVmlydHVhbE1hY2hpbmVNYW5hZ2VySW1wbC5qYXZhdAAQb3JjaGVzdHJhdGVTdGFydHNxAH4AEQAAEgtxAH4AE3EAfgAUcQB-ABVzcQB-ABH_____dAAmc3VuLnJlZmxlY3QuR2VuZXJhdGVkTWV0aG9kQWNjZXNzb3IxOTlwdAAGaW52b2tlc3EAfgARAAAAK3QAKHN1bi5yZWZsZWN0LkRlbGVnYXRpbmdNZXRob2RBY2Nlc3NvckltcGx0ACFEZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsLmphdmFxAH4AGXNxAH4AEQAAAfJ0ABhqYXZhLmxhbmcucmVmbGVjdC5NZXRob2R0AAtNZXRob2QuamF2YXEAfgAZc3EAfgARAAAAa3QAImNvbS5jbG91ZC52bS5WbVdvcmtKb2JIYW5kbGVyUHJveHl0ABpWbVdvcmtKb2JIYW5kbGVyUHJveHkuamF2YXQAD2hhbmRsZVZtV29ya0pvYnNxAH4AEQAAEqxxAH4AE3EAfgAUcQB-ACNzcQB-ABEAAABmdAAgY29tLmNsb3VkLnZtLlZtV29ya0pvYkRpc3BhdGNoZXJ0ABhWbVdvcmtKb2JEaXNwYXRjaGVyLmphdmF0AAZydW5Kb2JzcQB-ABEAAAIqdAA_b3JnLmFwYWNoZS5jbG91ZHN0YWNrLmZyYW1ld29yay5qb2JzLmltcGwuQXN5bmNKb2JNYW5hZ2VySW1wbCQ1dAAYQXN5bmNKb2JNYW5hZ2VySW1wbC5qYXZhdAAMcnVuSW5Db250ZXh0c3EAfgARAAAAMXQAPm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZSQxdAAbTWFuYWdlZENvbnRleHRSdW5uYWJsZS5qYXZhdAADcnVuc3EAfgARAAAAOHQAQm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5EZWZhdWx0TWFuYWdlZENvbnRleHQkMXQAGkRlZmF1bHRNYW5hZ2VkQ29udGV4dC5qYXZhdAAEY2FsbHNxAH4AEQAAAGd0AEBvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0cQB-ADN0AA9jYWxsV2l0aENvbnRleHRzcQB-ABEAAAA1cQB-ADZxAH4AM3QADnJ1bldpdGhDb250ZXh0c3EAfgARAAAALnQAPG9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZXEAfgAvcQB-ADBzcQB-ABEAAAH2cQB-ACpxAH4AK3EAfgAwc3EAfgARAAAB_3QALmphdmEudXRpbC5jb25jdXJyZW50LkV4ZWN1dG9ycyRSdW5uYWJsZUFkYXB0ZXJ0AA5FeGVjdXRvcnMuamF2YXEAfgA0c3EAfgARAAABCnQAH2phdmEudXRpbC5jb25jdXJyZW50LkZ1dHVyZVRhc2t0AA9GdXR1cmVUYXNrLmphdmFxAH4AMHNxAH4AEQAABH10ACdqYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3J0ABdUaHJlYWRQb29sRXhlY3V0b3IuamF2YXQACXJ1bldvcmtlcnNxAH4AEQAAAnB0AC5qYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3IkV29ya2VycQB-AEVxAH4AMHNxAH4AEQAAAux0ABBqYXZhLmxhbmcuVGhyZWFkdAALVGhyZWFkLmphdmFxAH4AMHNyACZqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlTGlzdPwPJTG17I4QAgABTAAEbGlzdHEAfgAMeHIALGphdmEudXRpbC5Db2xsZWN0aW9ucyRVbm1vZGlmaWFibGVDb2xsZWN0aW9uGUIAgMte9x4CAAFMAAFjdAAWTGphdmEvdXRpbC9Db2xsZWN0aW9uO3hwc3IAE2phdmEudXRpbC5BcnJheUxpc3R4gdIdmcdhnQMAAUkABHNpemV4cAAAAAB3BAAAAAB4cQB-AFF4c3IAEWphdmEubGFuZy5JbnRlZ2VyEuKgpPeBhzgCAAFJAAV2YWx1ZXhyABBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAAB4cAAAEO9zcQB-AFAAAAAAdwQAAAAAeHNyAA5qYXZhLmxhbmcuTG9uZzuL5JDMjyPfAgABSgAFdmFsdWV4cQB-AFMAAAAAAAAAAXZyABdjb20uY2xvdWQuZGMuRGF0YUNlbnRlcrLxCuun53i-AgAAeHAA
- 2017-12-01 00:00:32,184 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583) (logid:32b654cc) Publish async job-73583 complete on message bus
- 2017-12-01 00:00:32,184 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583) (logid:32b654cc) Wake up jobs related to job-73583
- 2017-12-01 00:00:32,184 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583) (logid:32b654cc) Update db status for job-73583
- 2017-12-01 00:00:32,187 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583) (logid:32b654cc) Wake up jobs joined with job-73583 and disjoin all subjobs created from job- 73583
- 2017-12-01 00:00:32,189 WARN [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) Exception while trying to start console proxy
- com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24521-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
- at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
- at java.lang.reflect.Method.invoke(Method.java:498)
- at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
- at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
- at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
- at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
- at java.util.concurrent.FutureTask.run(FutureTask.java:266)
- at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
- at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
- at java.lang.Thread.run(Thread.java:748)
- 2017-12-01 00:00:32,192 INFO [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) Unable to start console proxy vm for standby capacity, vm id : 24521, will recycle it and start a new one
- 2017-12-01 00:00:32,200 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583) (logid:32b654cc) Done executing com.cloud.vm.VmWorkStart for job-73583
- 2017-12-01 00:00:32,201 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-27:ctx-e591510d job-2/job-73583) (logid:32b654cc) Remove job-73583 from job monitoring
- 2017-12-01 00:00:32,202 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) Sync job-73584 execution on object VmWorkJobQueue.24521
- 2017-12-01 00:00:32,206 WARN [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Exception while trying to start secondary storage vm
- com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24522-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
- at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
- at java.lang.reflect.Method.invoke(Method.java:498)
- at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
- at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
- at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
- at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
- at java.util.concurrent.FutureTask.run(FutureTask.java:266)
- at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
- at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
- at java.lang.Thread.run(Thread.java:748)
- 2017-12-01 00:00:32,209 INFO [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Unable to start secondary storage vm for standby capacity, vm id : 24522, will recycle it and start a new one
- 2017-12-01 00:00:32,219 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Sync job-73585 execution on object VmWorkJobQueue.24522
- 2017-12-01 00:00:33,497 INFO [c.c.h.v.r.VmwareResource] (DirectAgentCronJob-384:ctx-46595e4b) (logid:d5e16a92) Scan hung worker VM to recycle
- 2017-12-01 00:00:33,681 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgentCronJob-384:ctx-46595e4b) (logid:d5e16a92) Ping from 1(r6-l06-esx01.cisco.com)
- 2017-12-01 00:00:33,681 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-384:ctx-46595e4b) (logid:d5e16a92) Process host VM state report from ping process. host: 1
- 2017-12-01 00:00:33,681 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-384:ctx-46595e4b) (logid:d5e16a92) Process VM state report. host: 1, number of records in report: 0
- 2017-12-01 00:00:33,682 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-384:ctx-46595e4b) (logid:d5e16a92) Done with process of VM state report. host: 1
- 2017-12-01 00:00:34,106 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-541524a3) (logid:9cbc9040) Execute sync-queue item: SyncQueueItemVO {id:73566, queueId: 73562, contentType: AsyncJob, contentId: 73584, lastProcessMsid: 345052167237, lastprocessNumber: 3, lastProcessTime: Fri Dec 01 00:00:34 CST 2017, created: Fri Dec 01 00:00:32 CST 2017}
- 2017-12-01 00:00:34,107 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-541524a3) (logid:9cbc9040) Schedule queued job-73584
- 2017-12-01 00:00:34,109 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-541524a3) (logid:9cbc9040) Execute sync-queue item: SyncQueueItemVO {id:73567, queueId: 73563, contentType: AsyncJob, contentId: 73585, lastProcessMsid: 345052167237, lastprocessNumber: 3, lastProcessTime: Fri Dec 01 00:00:34 CST 2017, created: Fri Dec 01 00:00:32 CST 2017}
- 2017-12-01 00:00:34,109 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-541524a3) (logid:9cbc9040) Schedule queued job-73585
- 2017-12-01 00:00:34,109 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-28:ctx-0dd06b7a job-1/job-73584) (logid:4d31e5d8) Add job-73584 into job monitoring
- 2017-12-01 00:00:34,113 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-29:ctx-2a1c1ee0 job-2/job-73585) (logid:1f57254d) Add job-73585 into job monitoring
- 2017-12-01 00:00:34,114 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-28:ctx-0dd06b7a job-1/job-73584) (logid:a98dfed6) Executing AsyncJobVO {id:73584, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStop, cmdInfo: rO0ABXNyABdjb20uY2xvdWQudm0uVm1Xb3JrU3RvcALQ4GymiWjjAgABWgAHY2xlYW51cHhyABNjb20uY2xvdWQudm0uVm1Xb3Jrn5m2VvAlZ2sCAARKAAlhY2NvdW50SWRKAAZ1c2VySWRKAAR2bUlkTAALaGFuZGxlck5hbWV0ABJMamF2YS9sYW5nL1N0cmluZzt4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfyXQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:00:32 CST 2017}
- 2017-12-01 00:00:34,114 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-28:ctx-0dd06b7a job-1/job-73584) (logid:a98dfed6) Run VM work job: com.cloud.vm.VmWorkStop for VM 24521, job origin: 1
- 2017-12-01 00:00:34,115 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-28:ctx-0dd06b7a job-1/job-73584 ctx-57bc9b09) (logid:a98dfed6) Execute VM work job: com.cloud.vm.VmWorkStop{"cleanup":false,"userId":1,"accountId":1,"vmId":24521,"handlerName":"VirtualMachineManagerImpl"}
- 2017-12-01 00:00:34,117 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-28:ctx-0dd06b7a job-1/job-73584 ctx-57bc9b09) (logid:a98dfed6) VM is already stopped: VM[ConsoleProxy|v-24521-VM]
- 2017-12-01 00:00:34,117 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-28:ctx-0dd06b7a job-1/job-73584 ctx-57bc9b09) (logid:a98dfed6) Done executing VM work job: com.cloud.vm.VmWorkStop{"cleanup":false,"userId":1,"accountId":1,"vmId":24521,"handlerName":"VirtualMachineManagerImpl"}
- 2017-12-01 00:00:34,117 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-28:ctx-0dd06b7a job-1/job-73584 ctx-57bc9b09) (logid:a98dfed6) Complete async job-73584, jobStatus: SUCCEEDED, resultCode: 0, result: null
- 2017-12-01 00:00:34,117 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-29:ctx-2a1c1ee0 job-2/job-73585) (logid:32b654cc) Executing AsyncJobVO {id:73585, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStop, cmdInfo: rO0ABXNyABdjb20uY2xvdWQudm0uVm1Xb3JrU3RvcALQ4GymiWjjAgABWgAHY2xlYW51cHhyABNjb20uY2xvdWQudm0uVm1Xb3Jrn5m2VvAlZ2sCAARKAAlhY2NvdW50SWRKAAZ1c2VySWRKAAR2bUlkTAALaGFuZGxlck5hbWV0ABJMamF2YS9sYW5nL1N0cmluZzt4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfynQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:00:32 CST 2017}
- 2017-12-01 00:00:34,118 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-29:ctx-2a1c1ee0 job-2/job-73585) (logid:32b654cc) Run VM work job: com.cloud.vm.VmWorkStop for VM 24522, job origin: 2
- 2017-12-01 00:00:34,118 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-28:ctx-0dd06b7a job-1/job-73584 ctx-57bc9b09) (logid:a98dfed6) Publish async job-73584 complete on message bus
- 2017-12-01 00:00:34,118 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-28:ctx-0dd06b7a job-1/job-73584 ctx-57bc9b09) (logid:a98dfed6) Wake up jobs related to job-73584
- 2017-12-01 00:00:34,118 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-28:ctx-0dd06b7a job-1/job-73584 ctx-57bc9b09) (logid:a98dfed6) Update db status for job-73584
- 2017-12-01 00:00:34,118 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-29:ctx-2a1c1ee0 job-2/job-73585 ctx-c1f9d61f) (logid:32b654cc) Execute VM work job: com.cloud.vm.VmWorkStop{"cleanup":false,"userId":1,"accountId":1,"vmId":24522,"handlerName":"VirtualMachineManagerImpl"}
- 2017-12-01 00:00:34,119 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-28:ctx-0dd06b7a job-1/job-73584 ctx-57bc9b09) (logid:a98dfed6) Wake up jobs joined with job-73584 and disjoin all subjobs created from job- 73584
- 2017-12-01 00:00:34,122 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-29:ctx-2a1c1ee0 job-2/job-73585 ctx-c1f9d61f) (logid:32b654cc) VM is already stopped: VM[SecondaryStorageVm|s-24522-VM]
- 2017-12-01 00:00:34,122 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-29:ctx-2a1c1ee0 job-2/job-73585 ctx-c1f9d61f) (logid:32b654cc) Done executing VM work job: com.cloud.vm.VmWorkStop{"cleanup":false,"userId":1,"accountId":1,"vmId":24522,"handlerName":"VirtualMachineManagerImpl"}
- 2017-12-01 00:00:34,122 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-29:ctx-2a1c1ee0 job-2/job-73585 ctx-c1f9d61f) (logid:32b654cc) Complete async job-73585, jobStatus: SUCCEEDED, resultCode: 0, result: null
- 2017-12-01 00:00:34,123 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-8ada3a22) (logid:f458c67f) Begin cleanup expired async-jobs
- 2017-12-01 00:00:34,123 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-28:ctx-0dd06b7a job-1/job-73584) (logid:a98dfed6) Done with run of VM work job: com.cloud.vm.VmWorkStop for VM 24521, job origin: 1
- 2017-12-01 00:00:34,123 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-28:ctx-0dd06b7a job-1/job-73584) (logid:a98dfed6) Done executing com.cloud.vm.VmWorkStop for job-73584
- 2017-12-01 00:00:34,127 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-29:ctx-2a1c1ee0 job-2/job-73585 ctx-c1f9d61f) (logid:32b654cc) Publish async job-73585 complete on message bus
- 2017-12-01 00:00:34,127 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-29:ctx-2a1c1ee0 job-2/job-73585 ctx-c1f9d61f) (logid:32b654cc) Wake up jobs related to job-73585
- 2017-12-01 00:00:34,127 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-29:ctx-2a1c1ee0 job-2/job-73585 ctx-c1f9d61f) (logid:32b654cc) Update db status for job-73585
- 2017-12-01 00:00:34,129 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-8ada3a22) (logid:f458c67f) End cleanup expired async-jobs
- 2017-12-01 00:00:34,130 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-28:ctx-0dd06b7a job-1/job-73584) (logid:a98dfed6) Remove job-73584 from job monitoring
- 2017-12-01 00:00:34,131 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-29:ctx-2a1c1ee0 job-2/job-73585 ctx-c1f9d61f) (logid:32b654cc) Wake up jobs joined with job-73585 and disjoin all subjobs created from job- 73585
- 2017-12-01 00:00:34,136 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) VM state transitted from :Stopped to Expunging with event: ExpungeOperationvm's original host id: null new host id: null host id before state transition: null
- 2017-12-01 00:00:34,136 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) Destroying vm VM[ConsoleProxy|v-24521-VM]
- 2017-12-01 00:00:34,136 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) Cleaning up NICS
- 2017-12-01 00:00:34,137 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-29:ctx-2a1c1ee0 job-2/job-73585) (logid:32b654cc) Done with run of VM work job: com.cloud.vm.VmWorkStop for VM 24522, job origin: 2
- 2017-12-01 00:00:34,137 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-29:ctx-2a1c1ee0 job-2/job-73585) (logid:32b654cc) Done executing com.cloud.vm.VmWorkStop for job-73585
- 2017-12-01 00:00:34,139 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) Cleaning network for vm: 24521
- 2017-12-01 00:00:34,141 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-29:ctx-2a1c1ee0 job-2/job-73585) (logid:32b654cc) Remove job-73585 from job monitoring
- 2017-12-01 00:00:34,146 DEBUG [c.c.n.g.PublicNetworkGuru] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) public network deallocate network: networkId: 200, ip: 10.89.98.210
- 2017-12-01 00:00:34,148 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) VM state transitted from :Stopped to Expunging with event: ExpungeOperationvm's original host id: null new host id: null host id before state transition: null
- 2017-12-01 00:00:34,148 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Destroying vm VM[SecondaryStorageVm|s-24522-VM]
- 2017-12-01 00:00:34,148 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Cleaning up NICS
- 2017-12-01 00:00:34,150 DEBUG [c.c.n.g.PublicNetworkGuru] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) Deallocated nic: NicProfile[85821-24521-null-null-null
- 2017-12-01 00:00:34,152 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) Removed nic id=85821
- 2017-12-01 00:00:34,152 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Cleaning network for vm: 24522
- 2017-12-01 00:00:34,153 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) Revoving nic secondary ip entry ...
- 2017-12-01 00:00:34,159 DEBUG [c.c.n.g.PublicNetworkGuru] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) public network deallocate network: networkId: 200, ip: 10.89.98.211
- 2017-12-01 00:00:34,162 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) Removed nic id=85822
- 2017-12-01 00:00:34,162 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) Revoving nic secondary ip entry ...
- 2017-12-01 00:00:34,163 DEBUG [c.c.n.g.PublicNetworkGuru] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Deallocated nic: NicProfile[85824-24522-null-null-null
- 2017-12-01 00:00:34,166 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Removed nic id=85824
- 2017-12-01 00:00:34,166 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Revoving nic secondary ip entry ...
- 2017-12-01 00:00:34,170 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) Removed nic id=85823
- 2017-12-01 00:00:34,170 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) Revoving nic secondary ip entry ...
- 2017-12-01 00:00:34,171 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) Cleaning up hypervisor data structures (ex. SRs in XenServer) for managed storage
- 2017-12-01 00:00:34,172 DEBUG [o.a.c.e.o.VolumeOrchestrator] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) Cleaning storage for vm: 24521
- 2017-12-01 00:00:34,174 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Removed nic id=85825
- 2017-12-01 00:00:34,175 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Revoving nic secondary ip entry ...
- 2017-12-01 00:00:34,181 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Removed nic id=85826
- 2017-12-01 00:00:34,182 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) Expunge volume with no data store specified
- 2017-12-01 00:00:34,182 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Revoving nic secondary ip entry ...
- 2017-12-01 00:00:34,184 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) Volume 24521 is not referred anywhere, remove it from volumes table
- 2017-12-01 00:00:34,189 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Removed nic id=85827
- 2017-12-01 00:00:34,190 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) Expunged VM[ConsoleProxy|v-24521-VM]
- 2017-12-01 00:00:34,190 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Revoving nic secondary ip entry ...
- 2017-12-01 00:00:34,190 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Cleaning up hypervisor data structures (ex. SRs in XenServer) for managed storage
- 2017-12-01 00:00:34,192 DEBUG [o.a.c.e.o.VolumeOrchestrator] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Cleaning storage for vm: 24522
- 2017-12-01 00:00:34,194 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) received console proxy alert
- 2017-12-01 00:00:34,194 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) Console proxy creation failure, zone: Zone-Orion
- 2017-12-01 00:00:34,195 WARN [o.a.c.alerts] (consoleproxy-1:ctx-ddd71b74) (logid:edd51251) alertType:: 10 // dataCenterId:: 1 // podId:: null // clusterId:: null // message:: Console proxy creation failure. zone: Zone-Orion, error details: null
- 2017-12-01 00:00:34,202 INFO [o.a.c.s.v.VolumeServiceImpl] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Expunge volume with no data store specified
- 2017-12-01 00:00:34,203 INFO [o.a.c.s.v.VolumeServiceImpl] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Volume 24522 is not referred anywhere, remove it from volumes table
- 2017-12-01 00:00:34,209 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Expunged VM[SecondaryStorageVm|s-24522-VM]
- 2017-12-01 00:00:34,212 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) received secondary storage vm alert
- 2017-12-01 00:00:34,213 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Secondary Storage Vm creation failure, zone: Zone-Orion
- 2017-12-01 00:00:34,213 WARN [o.a.c.alerts] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) alertType:: 19 // dataCenterId:: 1 // podId:: null // clusterId:: null // message:: Secondary Storage Vm creation failure. zone: Zone-Orion, error details: null
- 2017-12-01 00:00:34,217 INFO [o.a.c.s.PremiumSecondaryStorageManagerImpl] (secstorage-1:ctx-78d137ef) (logid:9171e9bf) Primary secondary storage is not even started, wait until next turn
- 2017-12-01 00:00:38,371 DEBUG [c.c.s.StatsCollector] (StatsCollector-3:ctx-22924e55) (logid:d1b8dae9) AutoScaling Monitor is running...
- 2017-12-01 00:00:44,104 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-a53f8f0b) (logid:137e8b43) Begin cleanup expired async-jobs
- 2017-12-01 00:00:44,108 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-a53f8f0b) (logid:137e8b43) End cleanup expired async-jobs
- 2017-12-01 00:00:51,655 DEBUG [c.c.s.StatsCollector] (StatsCollector-6:ctx-5c0e8549) (logid:38e92e9b) StorageCollector is running...
- 2017-12-01 00:00:51,660 DEBUG [c.c.s.StatsCollector] (StatsCollector-6:ctx-5c0e8549) (logid:38e92e9b) There is no secondary storage VM for secondary storage host secondary
- 2017-12-01 00:00:51,661 DEBUG [c.c.h.o.r.Ovm3HypervisorGuru] (StatsCollector-6:ctx-5c0e8549) (logid:38e92e9b) getCommandHostDelegation: class com.cloud.agent.api.GetStorageStatsCommand
- 2017-12-01 00:00:51,661 DEBUG [c.c.h.XenServerGuru] (StatsCollector-6:ctx-5c0e8549) (logid:38e92e9b) getCommandHostDelegation: class com.cloud.agent.api.GetStorageStatsCommand
- 2017-12-01 00:00:51,662 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-166:ctx-a6b73c3d) (logid:f9f2dfeb) Seq 1-3458483038843866935: Executing request
- 2017-12-01 00:00:51,790 DEBUG [c.c.h.v.r.VmwareResource] (DirectAgent-166:ctx-a6b73c3d r6-l06-esx01.cisco.com, cmd: GetStorageStatsCommand) (logid:38e92e9b) Datastore summary info, storageId: 260fa543-e292-4f78-820c-dae49505e528, localPath: datastore-2475, poolType: VMFS, capacity: 1751809785856, free: 1750779035648, used: 1030750208
- 2017-12-01 00:00:51,790 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-166:ctx-a6b73c3d) (logid:38e92e9b) Seq 1-3458483038843866935: Response Received:
- 2017-12-01 00:00:51,790 DEBUG [c.c.a.t.Request] (StatsCollector-6:ctx-5c0e8549) (logid:38e92e9b) Seq 1-3458483038843866935: Received: { Ans: , MgmtId: 345052167237, via: 1(r6-l06-esx01.cisco.com), Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
- 2017-12-01 00:00:51,791 DEBUG [c.c.h.o.r.Ovm3HypervisorGuru] (StatsCollector-6:ctx-5c0e8549) (logid:38e92e9b) getCommandHostDelegation: class com.cloud.agent.api.GetStorageStatsCommand
- 2017-12-01 00:00:51,791 DEBUG [c.c.h.XenServerGuru] (StatsCollector-6:ctx-5c0e8549) (logid:38e92e9b) getCommandHostDelegation: class com.cloud.agent.api.GetStorageStatsCommand
- 2017-12-01 00:00:51,792 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-332:ctx-f71de193) (logid:78b71eb5) Seq 1-3458483038843866936: Executing request
- 2017-12-01 00:00:51,904 DEBUG [c.c.h.v.r.VmwareResource] (DirectAgent-332:ctx-f71de193 r6-l06-esx01.cisco.com, cmd: GetStorageStatsCommand) (logid:38e92e9b) Datastore summary info, storageId: 09198288-c7af-4569-9202-4616ec2b0b92, localPath: datastore-2476, poolType: VMFS, capacity: 137975824384, free: 47294971904, used: 90680852480
- 2017-12-01 00:00:51,904 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-332:ctx-f71de193) (logid:38e92e9b) Seq 1-3458483038843866936: Response Received:
- 2017-12-01 00:00:51,904 DEBUG [c.c.a.t.Request] (StatsCollector-6:ctx-5c0e8549) (logid:38e92e9b) Seq 1-3458483038843866936: Received: { Ans: , MgmtId: 345052167237, via: 1(r6-l06-esx01.cisco.com), Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
- 2017-12-01 00:00:54,104 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-bef716df) (logid:1a89d7b0) Begin cleanup expired async-jobs
- 2017-12-01 00:00:54,108 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-bef716df) (logid:1a89d7b0) End cleanup expired async-jobs
- 2017-12-01 00:00:54,338 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-d5199fe4) (logid:aea965a4) Found 0 routers to update status.
- 2017-12-01 00:00:54,339 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-d5199fe4) (logid:aea965a4) Found 0 VPC networks to update Redundant State.
- 2017-12-01 00:00:54,340 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-d5199fe4) (logid:aea965a4) Found 0 networks to update RvR status.
- 2017-12-01 00:00:59,353 DEBUG [o.a.c.f.j.d.VmWorkJobDaoImpl] (Vm-Operations-Cleanup-1:ctx-5723643e) (logid:90e900b9) Expunge completed work job-73220
- 2017-12-01 00:00:59,357 DEBUG [o.a.c.f.j.d.VmWorkJobDaoImpl] (Vm-Operations-Cleanup-1:ctx-5723643e) (logid:90e900b9) Expunge completed work job-73221
- 2017-12-01 00:00:59,360 DEBUG [o.a.c.f.j.d.VmWorkJobDaoImpl] (Vm-Operations-Cleanup-1:ctx-5723643e) (logid:90e900b9) Expunge completed work job-73222
- 2017-12-01 00:00:59,363 DEBUG [o.a.c.f.j.d.VmWorkJobDaoImpl] (Vm-Operations-Cleanup-1:ctx-5723643e) (logid:90e900b9) Expunge completed work job-73223
- 2017-12-01 00:00:59,366 DEBUG [o.a.c.f.j.d.VmWorkJobDaoImpl] (Vm-Operations-Cleanup-1:ctx-5723643e) (logid:90e900b9) Expunge completed work job-73224
- 2017-12-01 00:00:59,370 DEBUG [o.a.c.f.j.d.VmWorkJobDaoImpl] (Vm-Operations-Cleanup-1:ctx-5723643e) (logid:90e900b9) Expunge completed work job-73225
- 2017-12-01 00:01:00,238 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) Zone 1 is ready to launch console proxy
- 2017-12-01 00:01:00,238 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) Expand console proxy standby capacity for zone Zone-Orion
- 2017-12-01 00:01:00,239 INFO [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) No stopped console proxy is available, need to allocate a new console proxy
- 2017-12-01 00:01:00,240 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) Assign console proxy from a newly started instance for request from data center : 1
- 2017-12-01 00:01:00,248 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) Found existing network configuration for offering [Network Offering [1-Public-System-Public-Network]: Ntwk[200|Public|1]
- 2017-12-01 00:01:00,248 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
- 2017-12-01 00:01:00,254 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) Found existing network configuration for offering [Network Offering [3-Control-System-Control-Network]: Ntwk[202|Control|3]
- 2017-12-01 00:01:00,254 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
- 2017-12-01 00:01:00,259 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) Found existing network configuration for offering [Network Offering [2-Management-System-Management-Network]: Ntwk[201|Management|2]
- 2017-12-01 00:01:00,259 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
- 2017-12-01 00:01:00,268 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) Allocating entries for VM: VM[ConsoleProxy|v-24523-VM]
- 2017-12-01 00:01:00,269 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) Allocating nics for VM[ConsoleProxy|v-24523-VM]
- 2017-12-01 00:01:00,270 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) Allocating nic for vm VM[ConsoleProxy|v-24523-VM] in network Ntwk[200|Public|1] with requested profile NicProfile[0-0-null-null-null
- 2017-12-01 00:01:00,281 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) Allocating nic for vm VM[ConsoleProxy|v-24523-VM] in network Ntwk[202|Control|3] with requested profile null
- 2017-12-01 00:01:00,287 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) Allocating nic for vm VM[ConsoleProxy|v-24523-VM] in network Ntwk[201|Management|2] with requested profile null
- 2017-12-01 00:01:00,290 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) Allocating disks for VM[ConsoleProxy|v-24523-VM]
- 2017-12-01 00:01:00,294 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) Allocation completed for VM: VM[ConsoleProxy|v-24523-VM]
- 2017-12-01 00:01:00,296 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) received console proxy alert
- 2017-12-01 00:01:00,296 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) New console proxy created, zone: Zone-Orion, proxy: v-24523-VM, public IP: null, private IP: null
- 2017-12-01 00:01:00,304 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) Sync job-73586 execution on object VmWorkJobQueue.24523
- 2017-12-01 00:01:00,357 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-70516369) (logid:45c10c67) Zone 1 is ready to launch secondary storage VM
- 2017-12-01 00:01:00,359 INFO [o.a.c.s.PremiumSecondaryStorageManagerImpl] (secstorage-1:ctx-70516369) (logid:45c10c67) No running secondary storage vms found in datacenter id=1, starting one
- 2017-12-01 00:01:00,361 INFO [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-70516369) (logid:45c10c67) No stopped secondary storage vm is available, need to allocate a new secondary storage vm
- 2017-12-01 00:01:00,362 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-70516369) (logid:45c10c67) Assign secondary storage vm from a newly started instance for request from data center : 1
- 2017-12-01 00:01:00,369 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-70516369) (logid:45c10c67) Found existing network configuration for offering [Network Offering [1-Public-System-Public-Network]: Ntwk[200|Public|1]
- 2017-12-01 00:01:00,369 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-70516369) (logid:45c10c67) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
- 2017-12-01 00:01:00,374 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-70516369) (logid:45c10c67) Found existing network configuration for offering [Network Offering [3-Control-System-Control-Network]: Ntwk[202|Control|3]
- 2017-12-01 00:01:00,374 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-70516369) (logid:45c10c67) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
- 2017-12-01 00:01:00,379 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-70516369) (logid:45c10c67) Found existing network configuration for offering [Network Offering [2-Management-System-Management-Network]: Ntwk[201|Management|2]
- 2017-12-01 00:01:00,379 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-70516369) (logid:45c10c67) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
- 2017-12-01 00:01:00,384 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-70516369) (logid:45c10c67) Found existing network configuration for offering [Network Offering [4-Storage-System-Storage-Network]: Ntwk[203|Storage|4]
- 2017-12-01 00:01:00,384 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-70516369) (logid:45c10c67) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
- 2017-12-01 00:01:00,395 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-70516369) (logid:45c10c67) Allocating entries for VM: VM[SecondaryStorageVm|s-24524-VM]
- 2017-12-01 00:01:00,396 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-70516369) (logid:45c10c67) Allocating nics for VM[SecondaryStorageVm|s-24524-VM]
- 2017-12-01 00:01:00,397 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-70516369) (logid:45c10c67) Allocating nic for vm VM[SecondaryStorageVm|s-24524-VM] in network Ntwk[200|Public|1] with requested profile NicProfile[0-0-null-null-null
- 2017-12-01 00:01:00,406 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-70516369) (logid:45c10c67) Allocating nic for vm VM[SecondaryStorageVm|s-24524-VM] in network Ntwk[202|Control|3] with requested profile null
- 2017-12-01 00:01:00,413 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-70516369) (logid:45c10c67) Allocating nic for vm VM[SecondaryStorageVm|s-24524-VM] in network Ntwk[201|Management|2] with requested profile null
- 2017-12-01 00:01:00,417 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-70516369) (logid:45c10c67) Allocating nic for vm VM[SecondaryStorageVm|s-24524-VM] in network Ntwk[203|Storage|4] with requested profile null
- 2017-12-01 00:01:00,421 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-70516369) (logid:45c10c67) Allocating disks for VM[SecondaryStorageVm|s-24524-VM]
- 2017-12-01 00:01:00,424 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-70516369) (logid:45c10c67) Allocation completed for VM: VM[SecondaryStorageVm|s-24524-VM]
- 2017-12-01 00:01:00,426 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-70516369) (logid:45c10c67) received secondary storage vm alert
- 2017-12-01 00:01:00,426 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-70516369) (logid:45c10c67) New secondary storage vm created, zone: Zone-Orion, secStorageVm: s-24524-VM, public IP: null, private IP: null
- 2017-12-01 00:01:00,434 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (secstorage-1:ctx-70516369) (logid:45c10c67) Sync job-73587 execution on object VmWorkJobQueue.24524
- 2017-12-01 00:01:02,106 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-b874a04f) (logid:981f38fd) Execute sync-queue item: SyncQueueItemVO {id:73568, queueId: 73568, contentType: AsyncJob, contentId: 73586, lastProcessMsid: 345052167237, lastprocessNumber: 1, lastProcessTime: Fri Dec 01 00:01:02 CST 2017, created: Fri Dec 01 00:01:00 CST 2017}
- 2017-12-01 00:01:02,107 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-b874a04f) (logid:981f38fd) Schedule queued job-73586
- 2017-12-01 00:01:02,109 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-b874a04f) (logid:981f38fd) Execute sync-queue item: SyncQueueItemVO {id:73569, queueId: 73569, contentType: AsyncJob, contentId: 73587, lastProcessMsid: 345052167237, lastprocessNumber: 1, lastProcessTime: Fri Dec 01 00:01:02 CST 2017, created: Fri Dec 01 00:01:00 CST 2017}
- 2017-12-01 00:01:02,109 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-b874a04f) (logid:981f38fd) Schedule queued job-73587
- 2017-12-01 00:01:02,109 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586) (logid:99cd0059) Add job-73586 into job monitoring
- 2017-12-01 00:01:02,116 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586) (logid:a98dfed6) Executing AsyncJobVO {id:73586, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfy3QAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:01:00 CST 2017}
- 2017-12-01 00:01:02,116 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586) (logid:a98dfed6) Run VM work job: com.cloud.vm.VmWorkStart for VM 24523, job origin: 1
- 2017-12-01 00:01:02,117 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587) (logid:0e32ec51) Add job-73587 into job monitoring
- 2017-12-01 00:01:02,124 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587) (logid:32b654cc) Executing AsyncJobVO {id:73587, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfzHQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:01:00 CST 2017}
- 2017-12-01 00:01:02,124 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587) (logid:32b654cc) Run VM work job: com.cloud.vm.VmWorkStart for VM 24524, job origin: 2
- 2017-12-01 00:01:02,125 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) Execute VM work job: com.cloud.vm.VmWorkStart{"dcId":0,"userId":1,"accountId":1,"vmId":24523,"handlerName":"VirtualMachineManagerImpl"}
- 2017-12-01 00:01:02,125 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) Execute VM work job: com.cloud.vm.VmWorkStart{"dcId":0,"userId":1,"accountId":1,"vmId":24524,"handlerName":"VirtualMachineManagerImpl"}
- 2017-12-01 00:01:02,134 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
- 2017-12-01 00:01:02,134 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) Successfully transitioned to start state for VM[SecondaryStorageVm|s-24524-VM] reservation id = 6671327a-0e1b-4031-895b-b36d0686c96f
- 2017-12-01 00:01:02,134 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
- 2017-12-01 00:01:02,134 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) Successfully transitioned to start state for VM[ConsoleProxy|v-24523-VM] reservation id = a369db03-d4e8-411c-a5e5-28405e98a327
- 2017-12-01 00:01:02,135 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) Trying to deploy VM, vm has dcId: 1 and podId: null
- 2017-12-01 00:01:02,135 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) Deploy avoids pods: null, clusters: null, hosts: null
- 2017-12-01 00:01:02,136 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) Trying to deploy VM, vm has dcId: 1 and podId: null
- 2017-12-01 00:01:02,136 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) Deploy avoids pods: null, clusters: null, hosts: null
- 2017-12-01 00:01:02,138 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) Deploy avoids pods: null, clusters: null, hosts: null
- 2017-12-01 00:01:02,139 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@eecdd04
- 2017-12-01 00:01:02,139 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) Trying to allocate a host and storage pools from dc:1, pod:null,cluster:null, requested cpu: 500, requested ram: 536870912
- 2017-12-01 00:01:02,139 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) Is ROOT volume READY (pool already allocated)?: No
- 2017-12-01 00:01:02,139 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) Searching all possible resources under this Zone: 1
- 2017-12-01 00:01:02,139 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
- 2017-12-01 00:01:02,141 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) Deploy avoids pods: null, clusters: null, hosts: null
- 2017-12-01 00:01:02,142 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@eecdd04
- 2017-12-01 00:01:02,142 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) Trying to allocate a host and storage pools from dc:1, pod:null,cluster:null, requested cpu: 500, requested ram: 1073741824
- 2017-12-01 00:01:02,142 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) Is ROOT volume READY (pool already allocated)?: No
- 2017-12-01 00:01:02,142 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) Searching all possible resources under this Zone: 1
- 2017-12-01 00:01:02,144 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
- 2017-12-01 00:01:02,148 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) Checking resources in Cluster: 1 under Pod: 1
- 2017-12-01 00:01:02,148 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c FirstFitRoutingAllocator) (logid:32b654cc) Looking for hosts in dc: 1 pod:1 cluster:1
- 2017-12-01 00:01:02,150 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c FirstFitRoutingAllocator) (logid:32b654cc) FirstFitAllocator has 1 hosts to check for allocation: [Host[-1-Routing]]
- 2017-12-01 00:01:02,153 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c FirstFitRoutingAllocator) (logid:32b654cc) Found 1 hosts for allocation after prioritization: [Host[-1-Routing]]
- 2017-12-01 00:01:02,153 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c FirstFitRoutingAllocator) (logid:32b654cc) Looking for speed=500Mhz, Ram=512
- 2017-12-01 00:01:02,157 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) Checking resources in Cluster: 1 under Pod: 1
- 2017-12-01 00:01:02,157 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99 FirstFitRoutingAllocator) (logid:a98dfed6) Looking for hosts in dc: 1 pod:1 cluster:1
- 2017-12-01 00:01:02,158 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c FirstFitRoutingAllocator) (logid:32b654cc) Host: 1 has cpu capability (cpu:16, speed:2533) to support requested CPU: 1 and requested speed: 500
- 2017-12-01 00:01:02,158 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c FirstFitRoutingAllocator) (logid:32b654cc) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 536870912 , cpuOverprovisioningFactor: 1.0
- 2017-12-01 00:01:02,160 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c FirstFitRoutingAllocator) (logid:32b654cc) Hosts's actual total CPU: 40528 and CPU after applying overprovisioning: 40528
- 2017-12-01 00:01:02,160 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c FirstFitRoutingAllocator) (logid:32b654cc) Free CPU: 40528 , Requested CPU: 500
- 2017-12-01 00:01:02,160 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c FirstFitRoutingAllocator) (logid:32b654cc) Free RAM: 42880884736 , Requested RAM: 536870912
- 2017-12-01 00:01:02,160 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c FirstFitRoutingAllocator) (logid:32b654cc) Host has enough CPU and RAM available
- 2017-12-01 00:01:02,160 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c FirstFitRoutingAllocator) (logid:32b654cc) STATS: Can alloc CPU from host: 1, used: 0, reserved: 0, actual total: 40528, total with overprovisioning: 40528; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
- 2017-12-01 00:01:02,160 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c FirstFitRoutingAllocator) (logid:32b654cc) STATS: Can alloc MEM from host: 1, used: 0, reserved: 0, total: 42880884736; requested mem: 536870912,alloc_from_last_host?:false ,considerReservedCapacity?: true
- 2017-12-01 00:01:02,160 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c FirstFitRoutingAllocator) (logid:32b654cc) Found a suitable host, adding to list: 1
- 2017-12-01 00:01:02,160 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c FirstFitRoutingAllocator) (logid:32b654cc) Host Allocator returning 1 suitable hosts
- 2017-12-01 00:01:02,161 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99 FirstFitRoutingAllocator) (logid:a98dfed6) FirstFitAllocator has 1 hosts to check for allocation: [Host[-1-Routing]]
- 2017-12-01 00:01:02,162 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) Checking suitable pools for volume (Id, Type): (24524,ROOT)
- 2017-12-01 00:01:02,162 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) We need to allocate new storagepool for this volume
- 2017-12-01 00:01:02,162 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) Calling StoragePoolAllocators to find suitable pools
- 2017-12-01 00:01:02,164 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) System VMs will use shared storage for zone id=1
- 2017-12-01 00:01:02,164 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) LocalStoragePoolAllocator trying to find storage pool to fit the vm
- 2017-12-01 00:01:02,164 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) ClusterScopeStoragePoolAllocator looking for storage pool
- 2017-12-01 00:01:02,164 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) Looking for pools in dc: 1 pod:1 cluster:1. Disabled pools will be ignored.
- 2017-12-01 00:01:02,164 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) Found pools matching tags: []
- 2017-12-01 00:01:02,165 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) No storage pools available for shared volume allocation, returning
- 2017-12-01 00:01:02,165 DEBUG [o.a.c.s.a.ZoneWideStoragePoolAllocator] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) ZoneWideStoragePoolAllocator to find storage pool
- 2017-12-01 00:01:02,166 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) No suitable pools found for volume: Vol[24524|vm=24524|ROOT] under cluster: 1
- 2017-12-01 00:01:02,166 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) No suitable pools found
- 2017-12-01 00:01:02,166 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) No suitable storagePools found under this Cluster: 1
- 2017-12-01 00:01:02,166 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) Could not find suitable Deployment Destination for this VM under any clusters, returning.
- 2017-12-01 00:01:02,166 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) Searching all possible resources under this Zone: 1
- 2017-12-01 00:01:02,167 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
- 2017-12-01 00:01:02,167 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99 FirstFitRoutingAllocator) (logid:a98dfed6) Found 1 hosts for allocation after prioritization: [Host[-1-Routing]]
- 2017-12-01 00:01:02,167 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99 FirstFitRoutingAllocator) (logid:a98dfed6) Looking for speed=500Mhz, Ram=1024
- 2017-12-01 00:01:02,168 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) Removing from the clusterId list these clusters from avoid set: [1]
- 2017-12-01 00:01:02,168 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) No clusters found after removing disabled clusters and clusters in avoid list, returning.
- 2017-12-01 00:01:02,175 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
- 2017-12-01 00:01:02,175 ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) Invocation exception, caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24524-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- 2017-12-01 00:01:02,175 INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587 ctx-0bb87a8c) (logid:32b654cc) Rethrow exception com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24524-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- 2017-12-01 00:01:02,175 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587) (logid:32b654cc) Done with run of VM work job: com.cloud.vm.VmWorkStart for VM 24524, job origin: 2
- 2017-12-01 00:01:02,175 ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587) (logid:32b654cc) Unable to complete AsyncJobVO {id:73587, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfzHQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:01:00 CST 2017}, job origin:2
- com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24524-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
- at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
- at java.lang.reflect.Method.invoke(Method.java:498)
- at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
- at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
- at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
- at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
- at java.util.concurrent.FutureTask.run(FutureTask.java:266)
- at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
- at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
- at java.lang.Thread.run(Thread.java:748)
- 2017-12-01 00:01:02,176 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587) (logid:32b654cc) Complete async job-73587, jobStatus: FAILED, resultCode: 0, result: rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdABDVW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW1NlY29uZGFyeVN0b3JhZ2VWbXxzLTI0NTI0LVZNXXVyAB5bTGphdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudDsCRio8PP0iOQIAAHhwAAAAFHNyABtqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnRhCcWaJjbdhQIABEkACmxpbmVOdW1iZXJMAA5kZWNsYXJpbmdDbGFzc3EAfgAKTAAIZmlsZU5hbWVxAH4ACkwACm1ldGhvZE5hbWVxAH4ACnhwAAADwHQAJmNvbS5jbG91ZC52bS5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsdAAeVmlydHVhbE1hY2hpbmVNYW5hZ2VySW1wbC5qYXZhdAAQb3JjaGVzdHJhdGVTdGFydHNxAH4AEQAAEgtxAH4AE3EAfgAUcQB-ABVzcQB-ABH_____dAAmc3VuLnJlZmxlY3QuR2VuZXJhdGVkTWV0aG9kQWNjZXNzb3IxOTlwdAAGaW52b2tlc3EAfgARAAAAK3QAKHN1bi5yZWZsZWN0LkRlbGVnYXRpbmdNZXRob2RBY2Nlc3NvckltcGx0ACFEZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsLmphdmFxAH4AGXNxAH4AEQAAAfJ0ABhqYXZhLmxhbmcucmVmbGVjdC5NZXRob2R0AAtNZXRob2QuamF2YXEAfgAZc3EAfgARAAAAa3QAImNvbS5jbG91ZC52bS5WbVdvcmtKb2JIYW5kbGVyUHJveHl0ABpWbVdvcmtKb2JIYW5kbGVyUHJveHkuamF2YXQAD2hhbmRsZVZtV29ya0pvYnNxAH4AEQAAEqxxAH4AE3EAfgAUcQB-ACNzcQB-ABEAAABmdAAgY29tLmNsb3VkLnZtLlZtV29ya0pvYkRpc3BhdGNoZXJ0ABhWbVdvcmtKb2JEaXNwYXRjaGVyLmphdmF0AAZydW5Kb2JzcQB-ABEAAAIqdAA_b3JnLmFwYWNoZS5jbG91ZHN0YWNrLmZyYW1ld29yay5qb2JzLmltcGwuQXN5bmNKb2JNYW5hZ2VySW1wbCQ1dAAYQXN5bmNKb2JNYW5hZ2VySW1wbC5qYXZhdAAMcnVuSW5Db250ZXh0c3EAfgARAAAAMXQAPm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZSQxdAAbTWFuYWdlZENvbnRleHRSdW5uYWJsZS5qYXZhdAADcnVuc3EAfgARAAAAOHQAQm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5EZWZhdWx0TWFuYWdlZENvbnRleHQkMXQAGkRlZmF1bHRNYW5hZ2VkQ29udGV4dC5qYXZhdAAEY2FsbHNxAH4AEQAAAGd0AEBvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0cQB-ADN0AA9jYWxsV2l0aENvbnRleHRzcQB-ABEAAAA1cQB-ADZxAH4AM3QADnJ1bldpdGhDb250ZXh0c3EAfgARAAAALnQAPG9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZXEAfgAvcQB-ADBzcQB-ABEAAAH2cQB-ACpxAH4AK3EAfgAwc3EAfgARAAAB_3QALmphdmEudXRpbC5jb25jdXJyZW50LkV4ZWN1dG9ycyRSdW5uYWJsZUFkYXB0ZXJ0AA5FeGVjdXRvcnMuamF2YXEAfgA0c3EAfgARAAABCnQAH2phdmEudXRpbC5jb25jdXJyZW50LkZ1dHVyZVRhc2t0AA9GdXR1cmVUYXNrLmphdmFxAH4AMHNxAH4AEQAABH10ACdqYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3J0ABdUaHJlYWRQb29sRXhlY3V0b3IuamF2YXQACXJ1bldvcmtlcnNxAH4AEQAAAnB0AC5qYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3IkV29ya2VycQB-AEVxAH4AMHNxAH4AEQAAAux0ABBqYXZhLmxhbmcuVGhyZWFkdAALVGhyZWFkLmphdmFxAH4AMHNyACZqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlTGlzdPwPJTG17I4QAgABTAAEbGlzdHEAfgAMeHIALGphdmEudXRpbC5Db2xsZWN0aW9ucyRVbm1vZGlmaWFibGVDb2xsZWN0aW9uGUIAgMte9x4CAAFMAAFjdAAWTGphdmEvdXRpbC9Db2xsZWN0aW9uO3hwc3IAE2phdmEudXRpbC5BcnJheUxpc3R4gdIdmcdhnQMAAUkABHNpemV4cAAAAAB3BAAAAAB4cQB-AFF4c3IAEWphdmEubGFuZy5JbnRlZ2VyEuKgpPeBhzgCAAFJAAV2YWx1ZXhyABBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAAB4cAAAEO9zcQB-AFAAAAAAdwQAAAAAeHNyAA5qYXZhLmxhbmcuTG9uZzuL5JDMjyPfAgABSgAFdmFsdWV4cQB-AFMAAAAAAAAAAXZyABdjb20uY2xvdWQuZGMuRGF0YUNlbnRlcrLxCuun53i-AgAAeHAA
- 2017-12-01 00:01:02,176 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99 FirstFitRoutingAllocator) (logid:a98dfed6) Host: 1 has cpu capability (cpu:16, speed:2533) to support requested CPU: 1 and requested speed: 500
- 2017-12-01 00:01:02,176 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99 FirstFitRoutingAllocator) (logid:a98dfed6) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
- 2017-12-01 00:01:02,179 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99 FirstFitRoutingAllocator) (logid:a98dfed6) Hosts's actual total CPU: 40528 and CPU after applying overprovisioning: 40528
- 2017-12-01 00:01:02,179 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99 FirstFitRoutingAllocator) (logid:a98dfed6) Free CPU: 40528 , Requested CPU: 500
- 2017-12-01 00:01:02,179 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99 FirstFitRoutingAllocator) (logid:a98dfed6) Free RAM: 42880884736 , Requested RAM: 1073741824
- 2017-12-01 00:01:02,179 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99 FirstFitRoutingAllocator) (logid:a98dfed6) Host has enough CPU and RAM available
- 2017-12-01 00:01:02,179 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99 FirstFitRoutingAllocator) (logid:a98dfed6) STATS: Can alloc CPU from host: 1, used: 0, reserved: 0, actual total: 40528, total with overprovisioning: 40528; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
- 2017-12-01 00:01:02,179 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99 FirstFitRoutingAllocator) (logid:a98dfed6) STATS: Can alloc MEM from host: 1, used: 0, reserved: 0, total: 42880884736; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
- 2017-12-01 00:01:02,179 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99 FirstFitRoutingAllocator) (logid:a98dfed6) Found a suitable host, adding to list: 1
- 2017-12-01 00:01:02,179 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99 FirstFitRoutingAllocator) (logid:a98dfed6) Host Allocator returning 1 suitable hosts
- 2017-12-01 00:01:02,182 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) Checking suitable pools for volume (Id, Type): (24523,ROOT)
- 2017-12-01 00:01:02,182 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) We need to allocate new storagepool for this volume
- 2017-12-01 00:01:02,184 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) Calling StoragePoolAllocators to find suitable pools
- 2017-12-01 00:01:02,185 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) System VMs will use shared storage for zone id=1
- 2017-12-01 00:01:02,185 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) LocalStoragePoolAllocator trying to find storage pool to fit the vm
- 2017-12-01 00:01:02,185 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) ClusterScopeStoragePoolAllocator looking for storage pool
- 2017-12-01 00:01:02,185 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) Looking for pools in dc: 1 pod:1 cluster:1. Disabled pools will be ignored.
- 2017-12-01 00:01:02,185 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587) (logid:32b654cc) Publish async job-73587 complete on message bus
- 2017-12-01 00:01:02,185 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587) (logid:32b654cc) Wake up jobs related to job-73587
- 2017-12-01 00:01:02,185 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587) (logid:32b654cc) Update db status for job-73587
- 2017-12-01 00:01:02,186 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) Found pools matching tags: []
- 2017-12-01 00:01:02,186 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587) (logid:32b654cc) Wake up jobs joined with job-73587 and disjoin all subjobs created from job- 73587
- 2017-12-01 00:01:02,187 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) No storage pools available for shared volume allocation, returning
- 2017-12-01 00:01:02,187 DEBUG [o.a.c.s.a.ZoneWideStoragePoolAllocator] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) ZoneWideStoragePoolAllocator to find storage pool
- 2017-12-01 00:01:02,188 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) No suitable pools found for volume: Vol[24523|vm=24523|ROOT] under cluster: 1
- 2017-12-01 00:01:02,188 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) No suitable pools found
- 2017-12-01 00:01:02,188 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) No suitable storagePools found under this Cluster: 1
- 2017-12-01 00:01:02,189 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) Could not find suitable Deployment Destination for this VM under any clusters, returning.
- 2017-12-01 00:01:02,190 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) Searching all possible resources under this Zone: 1
- 2017-12-01 00:01:02,190 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587) (logid:32b654cc) Done executing com.cloud.vm.VmWorkStart for job-73587
- 2017-12-01 00:01:02,191 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
- 2017-12-01 00:01:02,194 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-31:ctx-25d31245 job-2/job-73587) (logid:32b654cc) Remove job-73587 from job monitoring
- 2017-12-01 00:01:02,194 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) Removing from the clusterId list these clusters from avoid set: [1]
- 2017-12-01 00:01:02,194 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) No clusters found after removing disabled clusters and clusters in avoid list, returning.
- 2017-12-01 00:01:02,197 WARN [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-70516369) (logid:45c10c67) Exception while trying to start secondary storage vm
- com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24524-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
- at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
- at java.lang.reflect.Method.invoke(Method.java:498)
- at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
- at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
- at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
- at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
- at java.util.concurrent.FutureTask.run(FutureTask.java:266)
- at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
- at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
- at java.lang.Thread.run(Thread.java:748)
- 2017-12-01 00:01:02,204 INFO [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-70516369) (logid:45c10c67) Unable to start secondary storage vm for standby capacity, vm id : 24524, will recycle it and start a new one
- 2017-12-01 00:01:02,204 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-70516369) (logid:45c10c67) received secondary storage vm alert
- 2017-12-01 00:01:02,204 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-70516369) (logid:45c10c67) Secondary Storage Vm creation failure, zone: Zone-Orion
- 2017-12-01 00:01:02,204 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
- 2017-12-01 00:01:02,204 ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) Invocation exception, caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24523-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- 2017-12-01 00:01:02,207 WARN [o.a.c.alerts] (secstorage-1:ctx-70516369) (logid:45c10c67) alertType:: 19 // dataCenterId:: 1 // podId:: null // clusterId:: null // message:: Secondary Storage Vm creation failure. zone: Zone-Orion, error details: null
- 2017-12-01 00:01:02,207 INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586 ctx-3a8d0e99) (logid:a98dfed6) Rethrow exception com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24523-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- 2017-12-01 00:01:02,207 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586) (logid:a98dfed6) Done with run of VM work job: com.cloud.vm.VmWorkStart for VM 24523, job origin: 1
- 2017-12-01 00:01:02,207 ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586) (logid:a98dfed6) Unable to complete AsyncJobVO {id:73586, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfy3QAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:01:00 CST 2017}, job origin:1
- com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24523-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
- at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
- at java.lang.reflect.Method.invoke(Method.java:498)
- at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
- at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
- at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
- at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
- at java.util.concurrent.FutureTask.run(FutureTask.java:266)
- at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
- at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
- at java.lang.Thread.run(Thread.java:748)
- 2017-12-01 00:01:02,208 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586) (logid:a98dfed6) Complete async job-73586, jobStatus: FAILED, resultCode: 0, result: rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdAA9VW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW0NvbnNvbGVQcm94eXx2LTI0NTIzLVZNXXVyAB5bTGphdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudDsCRio8PP0iOQIAAHhwAAAAFHNyABtqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnRhCcWaJjbdhQIABEkACmxpbmVOdW1iZXJMAA5kZWNsYXJpbmdDbGFzc3EAfgAKTAAIZmlsZU5hbWVxAH4ACkwACm1ldGhvZE5hbWVxAH4ACnhwAAADwHQAJmNvbS5jbG91ZC52bS5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsdAAeVmlydHVhbE1hY2hpbmVNYW5hZ2VySW1wbC5qYXZhdAAQb3JjaGVzdHJhdGVTdGFydHNxAH4AEQAAEgtxAH4AE3EAfgAUcQB-ABVzcQB-ABH_____dAAmc3VuLnJlZmxlY3QuR2VuZXJhdGVkTWV0aG9kQWNjZXNzb3IxOTlwdAAGaW52b2tlc3EAfgARAAAAK3QAKHN1bi5yZWZsZWN0LkRlbGVnYXRpbmdNZXRob2RBY2Nlc3NvckltcGx0ACFEZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsLmphdmFxAH4AGXNxAH4AEQAAAfJ0ABhqYXZhLmxhbmcucmVmbGVjdC5NZXRob2R0AAtNZXRob2QuamF2YXEAfgAZc3EAfgARAAAAa3QAImNvbS5jbG91ZC52bS5WbVdvcmtKb2JIYW5kbGVyUHJveHl0ABpWbVdvcmtKb2JIYW5kbGVyUHJveHkuamF2YXQAD2hhbmRsZVZtV29ya0pvYnNxAH4AEQAAEqxxAH4AE3EAfgAUcQB-ACNzcQB-ABEAAABmdAAgY29tLmNsb3VkLnZtLlZtV29ya0pvYkRpc3BhdGNoZXJ0ABhWbVdvcmtKb2JEaXNwYXRjaGVyLmphdmF0AAZydW5Kb2JzcQB-ABEAAAIqdAA_b3JnLmFwYWNoZS5jbG91ZHN0YWNrLmZyYW1ld29yay5qb2JzLmltcGwuQXN5bmNKb2JNYW5hZ2VySW1wbCQ1dAAYQXN5bmNKb2JNYW5hZ2VySW1wbC5qYXZhdAAMcnVuSW5Db250ZXh0c3EAfgARAAAAMXQAPm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZSQxdAAbTWFuYWdlZENvbnRleHRSdW5uYWJsZS5qYXZhdAADcnVuc3EAfgARAAAAOHQAQm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5EZWZhdWx0TWFuYWdlZENvbnRleHQkMXQAGkRlZmF1bHRNYW5hZ2VkQ29udGV4dC5qYXZhdAAEY2FsbHNxAH4AEQAAAGd0AEBvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0cQB-ADN0AA9jYWxsV2l0aENvbnRleHRzcQB-ABEAAAA1cQB-ADZxAH4AM3QADnJ1bldpdGhDb250ZXh0c3EAfgARAAAALnQAPG9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZXEAfgAvcQB-ADBzcQB-ABEAAAH2cQB-ACpxAH4AK3EAfgAwc3EAfgARAAAB_3QALmphdmEudXRpbC5jb25jdXJyZW50LkV4ZWN1dG9ycyRSdW5uYWJsZUFkYXB0ZXJ0AA5FeGVjdXRvcnMuamF2YXEAfgA0c3EAfgARAAABCnQAH2phdmEudXRpbC5jb25jdXJyZW50LkZ1dHVyZVRhc2t0AA9GdXR1cmVUYXNrLmphdmFxAH4AMHNxAH4AEQAABH10ACdqYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3J0ABdUaHJlYWRQb29sRXhlY3V0b3IuamF2YXQACXJ1bldvcmtlcnNxAH4AEQAAAnB0AC5qYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3IkV29ya2VycQB-AEVxAH4AMHNxAH4AEQAAAux0ABBqYXZhLmxhbmcuVGhyZWFkdAALVGhyZWFkLmphdmFxAH4AMHNyACZqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlTGlzdPwPJTG17I4QAgABTAAEbGlzdHEAfgAMeHIALGphdmEudXRpbC5Db2xsZWN0aW9ucyRVbm1vZGlmaWFibGVDb2xsZWN0aW9uGUIAgMte9x4CAAFMAAFjdAAWTGphdmEvdXRpbC9Db2xsZWN0aW9uO3hwc3IAE2phdmEudXRpbC5BcnJheUxpc3R4gdIdmcdhnQMAAUkABHNpemV4cAAAAAB3BAAAAAB4cQB-AFF4c3IAEWphdmEubGFuZy5JbnRlZ2VyEuKgpPeBhzgCAAFJAAV2YWx1ZXhyABBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAAB4cAAAEO9zcQB-AFAAAAAAdwQAAAAAeHNyAA5qYXZhLmxhbmcuTG9uZzuL5JDMjyPfAgABSgAFdmFsdWV4cQB-AFMAAAAAAAAAAXZyABdjb20uY2xvdWQuZGMuRGF0YUNlbnRlcrLxCuun53i-AgAAeHAA
- 2017-12-01 00:01:02,210 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586) (logid:a98dfed6) Publish async job-73586 complete on message bus
- 2017-12-01 00:01:02,210 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586) (logid:a98dfed6) Wake up jobs related to job-73586
- 2017-12-01 00:01:02,210 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586) (logid:a98dfed6) Update db status for job-73586
- 2017-12-01 00:01:02,212 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586) (logid:a98dfed6) Wake up jobs joined with job-73586 and disjoin all subjobs created from job- 73586
- 2017-12-01 00:01:02,218 INFO [o.a.c.s.PremiumSecondaryStorageManagerImpl] (secstorage-1:ctx-70516369) (logid:45c10c67) Primary secondary storage is not even started, wait until next turn
- 2017-12-01 00:01:02,219 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586) (logid:a98dfed6) Done executing com.cloud.vm.VmWorkStart for job-73586
- 2017-12-01 00:01:02,220 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-30:ctx-5bf9b4de job-1/job-73586) (logid:a98dfed6) Remove job-73586 from job monitoring
- 2017-12-01 00:01:02,224 WARN [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) Exception while trying to start console proxy
- com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24523-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
- at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
- at java.lang.reflect.Method.invoke(Method.java:498)
- at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
- at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
- at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
- at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
- at java.util.concurrent.FutureTask.run(FutureTask.java:266)
- at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
- at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
- at java.lang.Thread.run(Thread.java:748)
- 2017-12-01 00:01:02,225 INFO [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) Unable to start console proxy vm for standby capacity, vm id : 24523, will recycle it and start a new one
- 2017-12-01 00:01:02,225 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) received console proxy alert
- 2017-12-01 00:01:02,225 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) Console proxy creation failure, zone: Zone-Orion
- 2017-12-01 00:01:02,226 WARN [o.a.c.alerts] (consoleproxy-1:ctx-f3bc6cc2) (logid:fa670fdb) alertType:: 10 // dataCenterId:: 1 // podId:: null // clusterId:: null // message:: Console proxy creation failure. zone: Zone-Orion, error details: null
- 2017-12-01 00:01:04,104 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-50d3140a) (logid:9d2a2c45) Begin cleanup expired async-jobs
- 2017-12-01 00:01:04,108 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-50d3140a) (logid:9d2a2c45) End cleanup expired async-jobs
- 2017-12-01 00:01:14,104 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-9ca97c54) (logid:75ba80b2) Begin cleanup expired async-jobs
- 2017-12-01 00:01:14,108 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-9ca97c54) (logid:75ba80b2) End cleanup expired async-jobs
- 2017-12-01 00:01:15,528 DEBUG [c.c.s.StatsCollector] (StatsCollector-4:ctx-7cd69cd4) (logid:232eb4d4) HostStatsCollector is running...
- 2017-12-01 00:01:15,534 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-42:ctx-e8e92b42) (logid:71254e27) Seq 1-3458483038843866937: Executing request
- 2017-12-01 00:01:15,644 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-42:ctx-e8e92b42) (logid:232eb4d4) Seq 1-3458483038843866937: Response Received:
- 2017-12-01 00:01:15,644 DEBUG [c.c.a.t.Request] (StatsCollector-4:ctx-7cd69cd4) (logid:232eb4d4) Seq 1-3458483038843866937: Received: { Ans: , MgmtId: 345052167237, via: 1(r6-l06-esx01.cisco.com), Ver: v1, Flags: 10, { GetHostStatsAnswer } }
- 2017-12-01 00:01:24,104 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-d31f4a2b) (logid:da9dae68) Begin cleanup expired async-jobs
- 2017-12-01 00:01:24,108 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-d31f4a2b) (logid:da9dae68) End cleanup expired async-jobs
- 2017-12-01 00:01:24,338 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-2d0fabab) (logid:ed9c2ba7) Found 0 routers to update status.
- 2017-12-01 00:01:24,339 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-2d0fabab) (logid:ed9c2ba7) Found 0 VPC networks to update Redundant State.
- 2017-12-01 00:01:24,339 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-2d0fabab) (logid:ed9c2ba7) Found 0 networks to update RvR status.
- 2017-12-01 00:01:30,238 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) Zone 1 is ready to launch console proxy
- 2017-12-01 00:01:30,238 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) Expand console proxy standby capacity for zone Zone-Orion
- 2017-12-01 00:01:30,239 INFO [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) Found a stopped console proxy, starting it. Vm id : 24523
- 2017-12-01 00:01:30,245 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) Sync job-73588 execution on object VmWorkJobQueue.24523
- 2017-12-01 00:01:30,355 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Zone 1 is ready to launch secondary storage VM
- 2017-12-01 00:01:30,357 INFO [o.a.c.s.PremiumSecondaryStorageManagerImpl] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) No running secondary storage vms found in datacenter id=1, starting one
- 2017-12-01 00:01:30,360 INFO [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Found a stopped secondary storage vm, starting it. Vm id : 24524
- 2017-12-01 00:01:30,366 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Sync job-73589 execution on object VmWorkJobQueue.24524
- 2017-12-01 00:01:32,107 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-bc5f8d7d) (logid:7cdbe2b3) Execute sync-queue item: SyncQueueItemVO {id:73570, queueId: 73568, contentType: AsyncJob, contentId: 73588, lastProcessMsid: 345052167237, lastprocessNumber: 2, lastProcessTime: Fri Dec 01 00:01:32 CST 2017, created: Fri Dec 01 00:01:30 CST 2017}
- 2017-12-01 00:01:32,108 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-bc5f8d7d) (logid:7cdbe2b3) Schedule queued job-73588
- 2017-12-01 00:01:32,110 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-bc5f8d7d) (logid:7cdbe2b3) Execute sync-queue item: SyncQueueItemVO {id:73571, queueId: 73569, contentType: AsyncJob, contentId: 73589, lastProcessMsid: 345052167237, lastprocessNumber: 2, lastProcessTime: Fri Dec 01 00:01:32 CST 2017, created: Fri Dec 01 00:01:30 CST 2017}
- 2017-12-01 00:01:32,111 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-bc5f8d7d) (logid:7cdbe2b3) Schedule queued job-73589
- 2017-12-01 00:01:32,111 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588) (logid:057f7845) Add job-73588 into job monitoring
- 2017-12-01 00:01:32,116 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589) (logid:7cff668e) Add job-73589 into job monitoring
- 2017-12-01 00:01:32,118 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588) (logid:a98dfed6) Executing AsyncJobVO {id:73588, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfy3QAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:01:30 CST 2017}
- 2017-12-01 00:01:32,118 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588) (logid:a98dfed6) Run VM work job: com.cloud.vm.VmWorkStart for VM 24523, job origin: 1
- 2017-12-01 00:01:32,119 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) Execute VM work job: com.cloud.vm.VmWorkStart{"dcId":0,"userId":1,"accountId":1,"vmId":24523,"handlerName":"VirtualMachineManagerImpl"}
- 2017-12-01 00:01:32,123 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589) (logid:32b654cc) Executing AsyncJobVO {id:73589, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfzHQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:01:30 CST 2017}
- 2017-12-01 00:01:32,123 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589) (logid:32b654cc) Run VM work job: com.cloud.vm.VmWorkStart for VM 24524, job origin: 2
- 2017-12-01 00:01:32,124 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) Execute VM work job: com.cloud.vm.VmWorkStart{"dcId":0,"userId":1,"accountId":1,"vmId":24524,"handlerName":"VirtualMachineManagerImpl"}
- 2017-12-01 00:01:32,125 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
- 2017-12-01 00:01:32,125 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) Successfully transitioned to start state for VM[ConsoleProxy|v-24523-VM] reservation id = 6f6846fc-071a-4775-8ab6-da96ff7ea524
- 2017-12-01 00:01:32,126 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) Trying to deploy VM, vm has dcId: 1 and podId: null
- 2017-12-01 00:01:32,126 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) Deploy avoids pods: null, clusters: null, hosts: null
- 2017-12-01 00:01:32,129 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) Deploy avoids pods: null, clusters: null, hosts: null
- 2017-12-01 00:01:32,129 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
- 2017-12-01 00:01:32,129 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) Successfully transitioned to start state for VM[SecondaryStorageVm|s-24524-VM] reservation id = cccb8799-5498-408e-9060-1d70f12124e8
- 2017-12-01 00:01:32,130 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@eecdd04
- 2017-12-01 00:01:32,130 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) Trying to allocate a host and storage pools from dc:1, pod:null,cluster:null, requested cpu: 500, requested ram: 1073741824
- 2017-12-01 00:01:32,130 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) Is ROOT volume READY (pool already allocated)?: No
- 2017-12-01 00:01:32,130 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) Searching all possible resources under this Zone: 1
- 2017-12-01 00:01:32,130 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
- 2017-12-01 00:01:32,130 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) Trying to deploy VM, vm has dcId: 1 and podId: null
- 2017-12-01 00:01:32,130 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) Deploy avoids pods: null, clusters: null, hosts: null
- 2017-12-01 00:01:32,133 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) Deploy avoids pods: null, clusters: null, hosts: null
- 2017-12-01 00:01:32,134 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@eecdd04
- 2017-12-01 00:01:32,134 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) Trying to allocate a host and storage pools from dc:1, pod:null,cluster:null, requested cpu: 500, requested ram: 536870912
- 2017-12-01 00:01:32,134 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) Is ROOT volume READY (pool already allocated)?: No
- 2017-12-01 00:01:32,134 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) Searching all possible resources under this Zone: 1
- 2017-12-01 00:01:32,135 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
- 2017-12-01 00:01:32,139 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) Checking resources in Cluster: 1 under Pod: 1
- 2017-12-01 00:01:32,139 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925 FirstFitRoutingAllocator) (logid:a98dfed6) Looking for hosts in dc: 1 pod:1 cluster:1
- 2017-12-01 00:01:32,141 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925 FirstFitRoutingAllocator) (logid:a98dfed6) FirstFitAllocator has 1 hosts to check for allocation: [Host[-1-Routing]]
- 2017-12-01 00:01:32,143 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) Checking resources in Cluster: 1 under Pod: 1
- 2017-12-01 00:01:32,143 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d FirstFitRoutingAllocator) (logid:32b654cc) Looking for hosts in dc: 1 pod:1 cluster:1
- 2017-12-01 00:01:32,144 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925 FirstFitRoutingAllocator) (logid:a98dfed6) Found 1 hosts for allocation after prioritization: [Host[-1-Routing]]
- 2017-12-01 00:01:32,144 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925 FirstFitRoutingAllocator) (logid:a98dfed6) Looking for speed=500Mhz, Ram=1024
- 2017-12-01 00:01:32,144 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d FirstFitRoutingAllocator) (logid:32b654cc) FirstFitAllocator has 1 hosts to check for allocation: [Host[-1-Routing]]
- 2017-12-01 00:01:32,148 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d FirstFitRoutingAllocator) (logid:32b654cc) Found 1 hosts for allocation after prioritization: [Host[-1-Routing]]
- 2017-12-01 00:01:32,148 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d FirstFitRoutingAllocator) (logid:32b654cc) Looking for speed=500Mhz, Ram=512
- 2017-12-01 00:01:32,149 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925 FirstFitRoutingAllocator) (logid:a98dfed6) Host: 1 has cpu capability (cpu:16, speed:2533) to support requested CPU: 1 and requested speed: 500
- 2017-12-01 00:01:32,149 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925 FirstFitRoutingAllocator) (logid:a98dfed6) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
- 2017-12-01 00:01:32,150 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925 FirstFitRoutingAllocator) (logid:a98dfed6) Hosts's actual total CPU: 40528 and CPU after applying overprovisioning: 40528
- 2017-12-01 00:01:32,150 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925 FirstFitRoutingAllocator) (logid:a98dfed6) Free CPU: 40528 , Requested CPU: 500
- 2017-12-01 00:01:32,150 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925 FirstFitRoutingAllocator) (logid:a98dfed6) Free RAM: 42880884736 , Requested RAM: 1073741824
- 2017-12-01 00:01:32,150 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925 FirstFitRoutingAllocator) (logid:a98dfed6) Host has enough CPU and RAM available
- 2017-12-01 00:01:32,150 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925 FirstFitRoutingAllocator) (logid:a98dfed6) STATS: Can alloc CPU from host: 1, used: 0, reserved: 0, actual total: 40528, total with overprovisioning: 40528; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
- 2017-12-01 00:01:32,150 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925 FirstFitRoutingAllocator) (logid:a98dfed6) STATS: Can alloc MEM from host: 1, used: 0, reserved: 0, total: 42880884736; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
- 2017-12-01 00:01:32,150 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925 FirstFitRoutingAllocator) (logid:a98dfed6) Found a suitable host, adding to list: 1
- 2017-12-01 00:01:32,150 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925 FirstFitRoutingAllocator) (logid:a98dfed6) Host Allocator returning 1 suitable hosts
- 2017-12-01 00:01:32,152 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) Checking suitable pools for volume (Id, Type): (24523,ROOT)
- 2017-12-01 00:01:32,152 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) We need to allocate new storagepool for this volume
- 2017-12-01 00:01:32,153 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d FirstFitRoutingAllocator) (logid:32b654cc) Host: 1 has cpu capability (cpu:16, speed:2533) to support requested CPU: 1 and requested speed: 500
- 2017-12-01 00:01:32,153 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d FirstFitRoutingAllocator) (logid:32b654cc) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 536870912 , cpuOverprovisioningFactor: 1.0
- 2017-12-01 00:01:32,153 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) Calling StoragePoolAllocators to find suitable pools
- 2017-12-01 00:01:32,153 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) System VMs will use shared storage for zone id=1
- 2017-12-01 00:01:32,153 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) LocalStoragePoolAllocator trying to find storage pool to fit the vm
- 2017-12-01 00:01:32,153 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) ClusterScopeStoragePoolAllocator looking for storage pool
- 2017-12-01 00:01:32,154 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) Looking for pools in dc: 1 pod:1 cluster:1. Disabled pools will be ignored.
- 2017-12-01 00:01:32,154 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) Found pools matching tags: []
- 2017-12-01 00:01:32,154 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d FirstFitRoutingAllocator) (logid:32b654cc) Hosts's actual total CPU: 40528 and CPU after applying overprovisioning: 40528
- 2017-12-01 00:01:32,154 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d FirstFitRoutingAllocator) (logid:32b654cc) Free CPU: 40528 , Requested CPU: 500
- 2017-12-01 00:01:32,154 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d FirstFitRoutingAllocator) (logid:32b654cc) Free RAM: 42880884736 , Requested RAM: 536870912
- 2017-12-01 00:01:32,154 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d FirstFitRoutingAllocator) (logid:32b654cc) Host has enough CPU and RAM available
- 2017-12-01 00:01:32,154 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d FirstFitRoutingAllocator) (logid:32b654cc) STATS: Can alloc CPU from host: 1, used: 0, reserved: 0, actual total: 40528, total with overprovisioning: 40528; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
- 2017-12-01 00:01:32,154 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d FirstFitRoutingAllocator) (logid:32b654cc) STATS: Can alloc MEM from host: 1, used: 0, reserved: 0, total: 42880884736; requested mem: 536870912,alloc_from_last_host?:false ,considerReservedCapacity?: true
- 2017-12-01 00:01:32,154 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d FirstFitRoutingAllocator) (logid:32b654cc) Found a suitable host, adding to list: 1
- 2017-12-01 00:01:32,154 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d FirstFitRoutingAllocator) (logid:32b654cc) Host Allocator returning 1 suitable hosts
- 2017-12-01 00:01:32,154 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) No storage pools available for shared volume allocation, returning
- 2017-12-01 00:01:32,154 DEBUG [o.a.c.s.a.ZoneWideStoragePoolAllocator] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) ZoneWideStoragePoolAllocator to find storage pool
- 2017-12-01 00:01:32,155 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) No suitable pools found for volume: Vol[24523|vm=24523|ROOT] under cluster: 1
- 2017-12-01 00:01:32,155 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) No suitable pools found
- 2017-12-01 00:01:32,155 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) No suitable storagePools found under this Cluster: 1
- 2017-12-01 00:01:32,156 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) Could not find suitable Deployment Destination for this VM under any clusters, returning.
- 2017-12-01 00:01:32,156 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) Searching all possible resources under this Zone: 1
- 2017-12-01 00:01:32,156 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) Checking suitable pools for volume (Id, Type): (24524,ROOT)
- 2017-12-01 00:01:32,156 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) We need to allocate new storagepool for this volume
- 2017-12-01 00:01:32,156 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
- 2017-12-01 00:01:32,157 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) Calling StoragePoolAllocators to find suitable pools
- 2017-12-01 00:01:32,157 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) Removing from the clusterId list these clusters from avoid set: [1]
- 2017-12-01 00:01:32,157 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) System VMs will use shared storage for zone id=1
- 2017-12-01 00:01:32,157 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) LocalStoragePoolAllocator trying to find storage pool to fit the vm
- 2017-12-01 00:01:32,157 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) ClusterScopeStoragePoolAllocator looking for storage pool
- 2017-12-01 00:01:32,157 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) Looking for pools in dc: 1 pod:1 cluster:1. Disabled pools will be ignored.
- 2017-12-01 00:01:32,158 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) No clusters found after removing disabled clusters and clusters in avoid list, returning.
- 2017-12-01 00:01:32,158 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) Found pools matching tags: []
- 2017-12-01 00:01:32,158 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) No storage pools available for shared volume allocation, returning
- 2017-12-01 00:01:32,158 DEBUG [o.a.c.s.a.ZoneWideStoragePoolAllocator] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) ZoneWideStoragePoolAllocator to find storage pool
- 2017-12-01 00:01:32,159 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) No suitable pools found for volume: Vol[24524|vm=24524|ROOT] under cluster: 1
- 2017-12-01 00:01:32,159 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) No suitable pools found
- 2017-12-01 00:01:32,159 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) No suitable storagePools found under this Cluster: 1
- 2017-12-01 00:01:32,160 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) Could not find suitable Deployment Destination for this VM under any clusters, returning.
- 2017-12-01 00:01:32,160 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) Searching all possible resources under this Zone: 1
- 2017-12-01 00:01:32,160 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
- 2017-12-01 00:01:32,161 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) Removing from the clusterId list these clusters from avoid set: [1]
- 2017-12-01 00:01:32,161 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) No clusters found after removing disabled clusters and clusters in avoid list, returning.
- 2017-12-01 00:01:32,165 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
- 2017-12-01 00:01:32,165 ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) Invocation exception, caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24523-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- 2017-12-01 00:01:32,167 INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588 ctx-01266925) (logid:a98dfed6) Rethrow exception com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24523-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- 2017-12-01 00:01:32,167 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588) (logid:a98dfed6) Done with run of VM work job: com.cloud.vm.VmWorkStart for VM 24523, job origin: 1
- 2017-12-01 00:01:32,167 ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588) (logid:a98dfed6) Unable to complete AsyncJobVO {id:73588, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfy3QAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:01:30 CST 2017}, job origin:1
- com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24523-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
- at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
- at java.lang.reflect.Method.invoke(Method.java:498)
- at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
- at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
- at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
- at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
- at java.util.concurrent.FutureTask.run(FutureTask.java:266)
- at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
- at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
- at java.lang.Thread.run(Thread.java:748)
- 2017-12-01 00:01:32,168 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588) (logid:a98dfed6) Complete async job-73588, jobStatus: FAILED, resultCode: 0, result: rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdAA9VW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW0NvbnNvbGVQcm94eXx2LTI0NTIzLVZNXXVyAB5bTGphdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudDsCRio8PP0iOQIAAHhwAAAAFHNyABtqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnRhCcWaJjbdhQIABEkACmxpbmVOdW1iZXJMAA5kZWNsYXJpbmdDbGFzc3EAfgAKTAAIZmlsZU5hbWVxAH4ACkwACm1ldGhvZE5hbWVxAH4ACnhwAAADwHQAJmNvbS5jbG91ZC52bS5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsdAAeVmlydHVhbE1hY2hpbmVNYW5hZ2VySW1wbC5qYXZhdAAQb3JjaGVzdHJhdGVTdGFydHNxAH4AEQAAEgtxAH4AE3EAfgAUcQB-ABVzcQB-ABH_____dAAmc3VuLnJlZmxlY3QuR2VuZXJhdGVkTWV0aG9kQWNjZXNzb3IxOTlwdAAGaW52b2tlc3EAfgARAAAAK3QAKHN1bi5yZWZsZWN0LkRlbGVnYXRpbmdNZXRob2RBY2Nlc3NvckltcGx0ACFEZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsLmphdmFxAH4AGXNxAH4AEQAAAfJ0ABhqYXZhLmxhbmcucmVmbGVjdC5NZXRob2R0AAtNZXRob2QuamF2YXEAfgAZc3EAfgARAAAAa3QAImNvbS5jbG91ZC52bS5WbVdvcmtKb2JIYW5kbGVyUHJveHl0ABpWbVdvcmtKb2JIYW5kbGVyUHJveHkuamF2YXQAD2hhbmRsZVZtV29ya0pvYnNxAH4AEQAAEqxxAH4AE3EAfgAUcQB-ACNzcQB-ABEAAABmdAAgY29tLmNsb3VkLnZtLlZtV29ya0pvYkRpc3BhdGNoZXJ0ABhWbVdvcmtKb2JEaXNwYXRjaGVyLmphdmF0AAZydW5Kb2JzcQB-ABEAAAIqdAA_b3JnLmFwYWNoZS5jbG91ZHN0YWNrLmZyYW1ld29yay5qb2JzLmltcGwuQXN5bmNKb2JNYW5hZ2VySW1wbCQ1dAAYQXN5bmNKb2JNYW5hZ2VySW1wbC5qYXZhdAAMcnVuSW5Db250ZXh0c3EAfgARAAAAMXQAPm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZSQxdAAbTWFuYWdlZENvbnRleHRSdW5uYWJsZS5qYXZhdAADcnVuc3EAfgARAAAAOHQAQm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5EZWZhdWx0TWFuYWdlZENvbnRleHQkMXQAGkRlZmF1bHRNYW5hZ2VkQ29udGV4dC5qYXZhdAAEY2FsbHNxAH4AEQAAAGd0AEBvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0cQB-ADN0AA9jYWxsV2l0aENvbnRleHRzcQB-ABEAAAA1cQB-ADZxAH4AM3QADnJ1bldpdGhDb250ZXh0c3EAfgARAAAALnQAPG9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZXEAfgAvcQB-ADBzcQB-ABEAAAH2cQB-ACpxAH4AK3EAfgAwc3EAfgARAAAB_3QALmphdmEudXRpbC5jb25jdXJyZW50LkV4ZWN1dG9ycyRSdW5uYWJsZUFkYXB0ZXJ0AA5FeGVjdXRvcnMuamF2YXEAfgA0c3EAfgARAAABCnQAH2phdmEudXRpbC5jb25jdXJyZW50LkZ1dHVyZVRhc2t0AA9GdXR1cmVUYXNrLmphdmFxAH4AMHNxAH4AEQAABH10ACdqYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3J0ABdUaHJlYWRQb29sRXhlY3V0b3IuamF2YXQACXJ1bldvcmtlcnNxAH4AEQAAAnB0AC5qYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3IkV29ya2VycQB-AEVxAH4AMHNxAH4AEQAAAux0ABBqYXZhLmxhbmcuVGhyZWFkdAALVGhyZWFkLmphdmFxAH4AMHNyACZqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlTGlzdPwPJTG17I4QAgABTAAEbGlzdHEAfgAMeHIALGphdmEudXRpbC5Db2xsZWN0aW9ucyRVbm1vZGlmaWFibGVDb2xsZWN0aW9uGUIAgMte9x4CAAFMAAFjdAAWTGphdmEvdXRpbC9Db2xsZWN0aW9uO3hwc3IAE2phdmEudXRpbC5BcnJheUxpc3R4gdIdmcdhnQMAAUkABHNpemV4cAAAAAB3BAAAAAB4cQB-AFF4c3IAEWphdmEubGFuZy5JbnRlZ2VyEuKgpPeBhzgCAAFJAAV2YWx1ZXhyABBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAAB4cAAAEO9zcQB-AFAAAAAAdwQAAAAAeHNyAA5qYXZhLmxhbmcuTG9uZzuL5JDMjyPfAgABSgAFdmFsdWV4cQB-AFMAAAAAAAAAAXZyABdjb20uY2xvdWQuZGMuRGF0YUNlbnRlcrLxCuun53i-AgAAeHAA
- 2017-12-01 00:01:32,169 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588) (logid:a98dfed6) Publish async job-73588 complete on message bus
- 2017-12-01 00:01:32,169 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588) (logid:a98dfed6) Wake up jobs related to job-73588
- 2017-12-01 00:01:32,169 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588) (logid:a98dfed6) Update db status for job-73588
- 2017-12-01 00:01:32,174 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588) (logid:a98dfed6) Wake up jobs joined with job-73588 and disjoin all subjobs created from job- 73588
- 2017-12-01 00:01:32,178 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
- 2017-12-01 00:01:32,178 ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) Invocation exception, caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24524-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- 2017-12-01 00:01:32,178 INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589 ctx-c362c19d) (logid:32b654cc) Rethrow exception com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24524-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- 2017-12-01 00:01:32,178 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589) (logid:32b654cc) Done with run of VM work job: com.cloud.vm.VmWorkStart for VM 24524, job origin: 2
- 2017-12-01 00:01:32,178 ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589) (logid:32b654cc) Unable to complete AsyncJobVO {id:73589, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfzHQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:01:30 CST 2017}, job origin:2
- com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24524-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
- at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
- at java.lang.reflect.Method.invoke(Method.java:498)
- at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
- at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
- at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
- at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
- at java.util.concurrent.FutureTask.run(FutureTask.java:266)
- at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
- at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
- at java.lang.Thread.run(Thread.java:748)
- 2017-12-01 00:01:32,178 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588) (logid:a98dfed6) Done executing com.cloud.vm.VmWorkStart for job-73588
- 2017-12-01 00:01:32,178 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589) (logid:32b654cc) Complete async job-73589, jobStatus: FAILED, resultCode: 0, result: rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdABDVW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW1NlY29uZGFyeVN0b3JhZ2VWbXxzLTI0NTI0LVZNXXVyAB5bTGphdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudDsCRio8PP0iOQIAAHhwAAAAFHNyABtqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnRhCcWaJjbdhQIABEkACmxpbmVOdW1iZXJMAA5kZWNsYXJpbmdDbGFzc3EAfgAKTAAIZmlsZU5hbWVxAH4ACkwACm1ldGhvZE5hbWVxAH4ACnhwAAADwHQAJmNvbS5jbG91ZC52bS5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsdAAeVmlydHVhbE1hY2hpbmVNYW5hZ2VySW1wbC5qYXZhdAAQb3JjaGVzdHJhdGVTdGFydHNxAH4AEQAAEgtxAH4AE3EAfgAUcQB-ABVzcQB-ABH_____dAAmc3VuLnJlZmxlY3QuR2VuZXJhdGVkTWV0aG9kQWNjZXNzb3IxOTlwdAAGaW52b2tlc3EAfgARAAAAK3QAKHN1bi5yZWZsZWN0LkRlbGVnYXRpbmdNZXRob2RBY2Nlc3NvckltcGx0ACFEZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsLmphdmFxAH4AGXNxAH4AEQAAAfJ0ABhqYXZhLmxhbmcucmVmbGVjdC5NZXRob2R0AAtNZXRob2QuamF2YXEAfgAZc3EAfgARAAAAa3QAImNvbS5jbG91ZC52bS5WbVdvcmtKb2JIYW5kbGVyUHJveHl0ABpWbVdvcmtKb2JIYW5kbGVyUHJveHkuamF2YXQAD2hhbmRsZVZtV29ya0pvYnNxAH4AEQAAEqxxAH4AE3EAfgAUcQB-ACNzcQB-ABEAAABmdAAgY29tLmNsb3VkLnZtLlZtV29ya0pvYkRpc3BhdGNoZXJ0ABhWbVdvcmtKb2JEaXNwYXRjaGVyLmphdmF0AAZydW5Kb2JzcQB-ABEAAAIqdAA_b3JnLmFwYWNoZS5jbG91ZHN0YWNrLmZyYW1ld29yay5qb2JzLmltcGwuQXN5bmNKb2JNYW5hZ2VySW1wbCQ1dAAYQXN5bmNKb2JNYW5hZ2VySW1wbC5qYXZhdAAMcnVuSW5Db250ZXh0c3EAfgARAAAAMXQAPm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZSQxdAAbTWFuYWdlZENvbnRleHRSdW5uYWJsZS5qYXZhdAADcnVuc3EAfgARAAAAOHQAQm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5EZWZhdWx0TWFuYWdlZENvbnRleHQkMXQAGkRlZmF1bHRNYW5hZ2VkQ29udGV4dC5qYXZhdAAEY2FsbHNxAH4AEQAAAGd0AEBvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0cQB-ADN0AA9jYWxsV2l0aENvbnRleHRzcQB-ABEAAAA1cQB-ADZxAH4AM3QADnJ1bldpdGhDb250ZXh0c3EAfgARAAAALnQAPG9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZXEAfgAvcQB-ADBzcQB-ABEAAAH2cQB-ACpxAH4AK3EAfgAwc3EAfgARAAAB_3QALmphdmEudXRpbC5jb25jdXJyZW50LkV4ZWN1dG9ycyRSdW5uYWJsZUFkYXB0ZXJ0AA5FeGVjdXRvcnMuamF2YXEAfgA0c3EAfgARAAABCnQAH2phdmEudXRpbC5jb25jdXJyZW50LkZ1dHVyZVRhc2t0AA9GdXR1cmVUYXNrLmphdmFxAH4AMHNxAH4AEQAABH10ACdqYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3J0ABdUaHJlYWRQb29sRXhlY3V0b3IuamF2YXQACXJ1bldvcmtlcnNxAH4AEQAAAnB0AC5qYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3IkV29ya2VycQB-AEVxAH4AMHNxAH4AEQAAAux0ABBqYXZhLmxhbmcuVGhyZWFkdAALVGhyZWFkLmphdmFxAH4AMHNyACZqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlTGlzdPwPJTG17I4QAgABTAAEbGlzdHEAfgAMeHIALGphdmEudXRpbC5Db2xsZWN0aW9ucyRVbm1vZGlmaWFibGVDb2xsZWN0aW9uGUIAgMte9x4CAAFMAAFjdAAWTGphdmEvdXRpbC9Db2xsZWN0aW9uO3hwc3IAE2phdmEudXRpbC5BcnJheUxpc3R4gdIdmcdhnQMAAUkABHNpemV4cAAAAAB3BAAAAAB4cQB-AFF4c3IAEWphdmEubGFuZy5JbnRlZ2VyEuKgpPeBhzgCAAFJAAV2YWx1ZXhyABBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAAB4cAAAEO9zcQB-AFAAAAAAdwQAAAAAeHNyAA5qYXZhLmxhbmcuTG9uZzuL5JDMjyPfAgABSgAFdmFsdWV4cQB-AFMAAAAAAAAAAXZyABdjb20uY2xvdWQuZGMuRGF0YUNlbnRlcrLxCuun53i-AgAAeHAA
- 2017-12-01 00:01:32,179 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-33:ctx-9e5f093b job-1/job-73588) (logid:a98dfed6) Remove job-73588 from job monitoring
- 2017-12-01 00:01:32,181 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589) (logid:32b654cc) Publish async job-73589 complete on message bus
- 2017-12-01 00:01:32,181 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589) (logid:32b654cc) Wake up jobs related to job-73589
- 2017-12-01 00:01:32,182 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589) (logid:32b654cc) Update db status for job-73589
- 2017-12-01 00:01:32,185 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589) (logid:32b654cc) Wake up jobs joined with job-73589 and disjoin all subjobs created from job- 73589
- 2017-12-01 00:01:32,188 WARN [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) Exception while trying to start console proxy
- com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24523-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
- at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
- at java.lang.reflect.Method.invoke(Method.java:498)
- at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
- at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
- at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
- at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
- at java.util.concurrent.FutureTask.run(FutureTask.java:266)
- at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
- at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
- at java.lang.Thread.run(Thread.java:748)
- 2017-12-01 00:01:32,191 INFO [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) Unable to start console proxy vm for standby capacity, vm id : 24523, will recycle it and start a new one
- 2017-12-01 00:01:32,197 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589) (logid:32b654cc) Done executing com.cloud.vm.VmWorkStart for job-73589
- 2017-12-01 00:01:32,198 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-32:ctx-dd04f4a4 job-2/job-73589) (logid:32b654cc) Remove job-73589 from job monitoring
- 2017-12-01 00:01:32,201 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) Sync job-73590 execution on object VmWorkJobQueue.24523
- 2017-12-01 00:01:32,203 WARN [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Exception while trying to start secondary storage vm
- com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24524-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
- at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
- at java.lang.reflect.Method.invoke(Method.java:498)
- at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
- at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
- at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
- at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
- at java.util.concurrent.FutureTask.run(FutureTask.java:266)
- at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
- at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
- at java.lang.Thread.run(Thread.java:748)
- 2017-12-01 00:01:32,206 INFO [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Unable to start secondary storage vm for standby capacity, vm id : 24524, will recycle it and start a new one
- 2017-12-01 00:01:32,217 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Sync job-73591 execution on object VmWorkJobQueue.24524
- 2017-12-01 00:01:33,497 INFO [c.c.h.v.r.VmwareResource] (DirectAgentCronJob-384:ctx-cd1fae40) (logid:e256b48a) Scan hung worker VM to recycle
- 2017-12-01 00:01:33,681 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgentCronJob-384:ctx-cd1fae40) (logid:e256b48a) Ping from 1(r6-l06-esx01.cisco.com)
- 2017-12-01 00:01:33,681 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-384:ctx-cd1fae40) (logid:e256b48a) Process host VM state report from ping process. host: 1
- 2017-12-01 00:01:33,681 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-384:ctx-cd1fae40) (logid:e256b48a) Process VM state report. host: 1, number of records in report: 0
- 2017-12-01 00:01:33,682 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-384:ctx-cd1fae40) (logid:e256b48a) Done with process of VM state report. host: 1
- 2017-12-01 00:01:34,106 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-ffaf0748) (logid:3d0a12cb) Execute sync-queue item: SyncQueueItemVO {id:73572, queueId: 73568, contentType: AsyncJob, contentId: 73590, lastProcessMsid: 345052167237, lastprocessNumber: 3, lastProcessTime: Fri Dec 01 00:01:34 CST 2017, created: Fri Dec 01 00:01:32 CST 2017}
- 2017-12-01 00:01:34,106 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-ffaf0748) (logid:3d0a12cb) Schedule queued job-73590
- 2017-12-01 00:01:34,109 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-ffaf0748) (logid:3d0a12cb) Execute sync-queue item: SyncQueueItemVO {id:73573, queueId: 73569, contentType: AsyncJob, contentId: 73591, lastProcessMsid: 345052167237, lastprocessNumber: 3, lastProcessTime: Fri Dec 01 00:01:34 CST 2017, created: Fri Dec 01 00:01:32 CST 2017}
- 2017-12-01 00:01:34,109 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-ffaf0748) (logid:3d0a12cb) Schedule queued job-73591
- 2017-12-01 00:01:34,109 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-34:ctx-875c2c36 job-1/job-73590) (logid:576b3030) Add job-73590 into job monitoring
- 2017-12-01 00:01:34,114 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-7fa2bb87) (logid:78e4238f) Begin cleanup expired async-jobs
- 2017-12-01 00:01:34,115 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-34:ctx-875c2c36 job-1/job-73590) (logid:a98dfed6) Executing AsyncJobVO {id:73590, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStop, cmdInfo: rO0ABXNyABdjb20uY2xvdWQudm0uVm1Xb3JrU3RvcALQ4GymiWjjAgABWgAHY2xlYW51cHhyABNjb20uY2xvdWQudm0uVm1Xb3Jrn5m2VvAlZ2sCAARKAAlhY2NvdW50SWRKAAZ1c2VySWRKAAR2bUlkTAALaGFuZGxlck5hbWV0ABJMamF2YS9sYW5nL1N0cmluZzt4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfy3QAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:01:32 CST 2017}
- 2017-12-01 00:01:34,115 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-34:ctx-875c2c36 job-1/job-73590) (logid:a98dfed6) Run VM work job: com.cloud.vm.VmWorkStop for VM 24523, job origin: 1
- 2017-12-01 00:01:34,116 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-35:ctx-e6dd3530 job-2/job-73591) (logid:c5bea677) Add job-73591 into job monitoring
- 2017-12-01 00:01:34,119 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-7fa2bb87) (logid:78e4238f) End cleanup expired async-jobs
- 2017-12-01 00:01:34,120 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-35:ctx-e6dd3530 job-2/job-73591) (logid:32b654cc) Executing AsyncJobVO {id:73591, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStop, cmdInfo: rO0ABXNyABdjb20uY2xvdWQudm0uVm1Xb3JrU3RvcALQ4GymiWjjAgABWgAHY2xlYW51cHhyABNjb20uY2xvdWQudm0uVm1Xb3Jrn5m2VvAlZ2sCAARKAAlhY2NvdW50SWRKAAZ1c2VySWRKAAR2bUlkTAALaGFuZGxlck5hbWV0ABJMamF2YS9sYW5nL1N0cmluZzt4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfzHQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:01:32 CST 2017}
- 2017-12-01 00:01:34,120 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-35:ctx-e6dd3530 job-2/job-73591) (logid:32b654cc) Run VM work job: com.cloud.vm.VmWorkStop for VM 24524, job origin: 2
- 2017-12-01 00:01:34,120 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-34:ctx-875c2c36 job-1/job-73590 ctx-2258a7d8) (logid:a98dfed6) Execute VM work job: com.cloud.vm.VmWorkStop{"cleanup":false,"userId":1,"accountId":1,"vmId":24523,"handlerName":"VirtualMachineManagerImpl"}
- 2017-12-01 00:01:34,121 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-35:ctx-e6dd3530 job-2/job-73591 ctx-96461dbf) (logid:32b654cc) Execute VM work job: com.cloud.vm.VmWorkStop{"cleanup":false,"userId":1,"accountId":1,"vmId":24524,"handlerName":"VirtualMachineManagerImpl"}
- 2017-12-01 00:01:34,124 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-34:ctx-875c2c36 job-1/job-73590 ctx-2258a7d8) (logid:a98dfed6) VM is already stopped: VM[ConsoleProxy|v-24523-VM]
- 2017-12-01 00:01:34,124 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-34:ctx-875c2c36 job-1/job-73590 ctx-2258a7d8) (logid:a98dfed6) Done executing VM work job: com.cloud.vm.VmWorkStop{"cleanup":false,"userId":1,"accountId":1,"vmId":24523,"handlerName":"VirtualMachineManagerImpl"}
- 2017-12-01 00:01:34,124 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-34:ctx-875c2c36 job-1/job-73590 ctx-2258a7d8) (logid:a98dfed6) Complete async job-73590, jobStatus: SUCCEEDED, resultCode: 0, result: null
- 2017-12-01 00:01:34,125 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-34:ctx-875c2c36 job-1/job-73590 ctx-2258a7d8) (logid:a98dfed6) Publish async job-73590 complete on message bus
- 2017-12-01 00:01:34,125 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-34:ctx-875c2c36 job-1/job-73590 ctx-2258a7d8) (logid:a98dfed6) Wake up jobs related to job-73590
- 2017-12-01 00:01:34,125 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-34:ctx-875c2c36 job-1/job-73590 ctx-2258a7d8) (logid:a98dfed6) Update db status for job-73590
- 2017-12-01 00:01:34,125 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-35:ctx-e6dd3530 job-2/job-73591 ctx-96461dbf) (logid:32b654cc) VM is already stopped: VM[SecondaryStorageVm|s-24524-VM]
- 2017-12-01 00:01:34,125 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-35:ctx-e6dd3530 job-2/job-73591 ctx-96461dbf) (logid:32b654cc) Done executing VM work job: com.cloud.vm.VmWorkStop{"cleanup":false,"userId":1,"accountId":1,"vmId":24524,"handlerName":"VirtualMachineManagerImpl"}
- 2017-12-01 00:01:34,125 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-35:ctx-e6dd3530 job-2/job-73591 ctx-96461dbf) (logid:32b654cc) Complete async job-73591, jobStatus: SUCCEEDED, resultCode: 0, result: null
- 2017-12-01 00:01:34,126 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-34:ctx-875c2c36 job-1/job-73590 ctx-2258a7d8) (logid:a98dfed6) Wake up jobs joined with job-73590 and disjoin all subjobs created from job- 73590
- 2017-12-01 00:01:34,126 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-35:ctx-e6dd3530 job-2/job-73591 ctx-96461dbf) (logid:32b654cc) Publish async job-73591 complete on message bus
- 2017-12-01 00:01:34,126 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-35:ctx-e6dd3530 job-2/job-73591 ctx-96461dbf) (logid:32b654cc) Wake up jobs related to job-73591
- 2017-12-01 00:01:34,126 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-35:ctx-e6dd3530 job-2/job-73591 ctx-96461dbf) (logid:32b654cc) Update db status for job-73591
- 2017-12-01 00:01:34,128 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-35:ctx-e6dd3530 job-2/job-73591 ctx-96461dbf) (logid:32b654cc) Wake up jobs joined with job-73591 and disjoin all subjobs created from job- 73591
- 2017-12-01 00:01:34,133 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-34:ctx-875c2c36 job-1/job-73590) (logid:a98dfed6) Done with run of VM work job: com.cloud.vm.VmWorkStop for VM 24523, job origin: 1
- 2017-12-01 00:01:34,133 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-34:ctx-875c2c36 job-1/job-73590) (logid:a98dfed6) Done executing com.cloud.vm.VmWorkStop for job-73590
- 2017-12-01 00:01:34,134 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-35:ctx-e6dd3530 job-2/job-73591) (logid:32b654cc) Done with run of VM work job: com.cloud.vm.VmWorkStop for VM 24524, job origin: 2
- 2017-12-01 00:01:34,134 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-35:ctx-e6dd3530 job-2/job-73591) (logid:32b654cc) Done executing com.cloud.vm.VmWorkStop for job-73591
- 2017-12-01 00:01:34,134 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-34:ctx-875c2c36 job-1/job-73590) (logid:a98dfed6) Remove job-73590 from job monitoring
- 2017-12-01 00:01:34,136 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-35:ctx-e6dd3530 job-2/job-73591) (logid:32b654cc) Remove job-73591 from job monitoring
- 2017-12-01 00:01:34,150 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) VM state transitted from :Stopped to Expunging with event: ExpungeOperationvm's original host id: null new host id: null host id before state transition: null
- 2017-12-01 00:01:34,150 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Destroying vm VM[SecondaryStorageVm|s-24524-VM]
- 2017-12-01 00:01:34,150 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Cleaning up NICS
- 2017-12-01 00:01:34,150 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) VM state transitted from :Stopped to Expunging with event: ExpungeOperationvm's original host id: null new host id: null host id before state transition: null
- 2017-12-01 00:01:34,150 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) Destroying vm VM[ConsoleProxy|v-24523-VM]
- 2017-12-01 00:01:34,150 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) Cleaning up NICS
- 2017-12-01 00:01:34,153 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) Cleaning network for vm: 24523
- 2017-12-01 00:01:34,154 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Cleaning network for vm: 24524
- 2017-12-01 00:01:34,159 DEBUG [c.c.n.g.PublicNetworkGuru] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) public network deallocate network: networkId: 200, ip: 10.89.98.210
- 2017-12-01 00:01:34,160 DEBUG [c.c.n.g.PublicNetworkGuru] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) public network deallocate network: networkId: 200, ip: 10.89.98.211
- 2017-12-01 00:01:34,163 DEBUG [c.c.n.g.PublicNetworkGuru] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) Deallocated nic: NicProfile[85828-24523-null-null-null
- 2017-12-01 00:01:34,165 DEBUG [c.c.n.g.PublicNetworkGuru] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Deallocated nic: NicProfile[85831-24524-null-null-null
- 2017-12-01 00:01:34,166 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) Removed nic id=85828
- 2017-12-01 00:01:34,167 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) Revoving nic secondary ip entry ...
- 2017-12-01 00:01:34,167 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Removed nic id=85831
- 2017-12-01 00:01:34,168 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Revoving nic secondary ip entry ...
- 2017-12-01 00:01:34,174 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) Removed nic id=85829
- 2017-12-01 00:01:34,175 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) Revoving nic secondary ip entry ...
- 2017-12-01 00:01:34,175 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Removed nic id=85832
- 2017-12-01 00:01:34,176 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Revoving nic secondary ip entry ...
- 2017-12-01 00:01:34,181 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) Removed nic id=85830
- 2017-12-01 00:01:34,182 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) Revoving nic secondary ip entry ...
- 2017-12-01 00:01:34,182 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) Cleaning up hypervisor data structures (ex. SRs in XenServer) for managed storage
- 2017-12-01 00:01:34,183 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Removed nic id=85833
- 2017-12-01 00:01:34,184 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Revoving nic secondary ip entry ...
- 2017-12-01 00:01:34,184 DEBUG [o.a.c.e.o.VolumeOrchestrator] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) Cleaning storage for vm: 24523
- 2017-12-01 00:01:34,191 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Removed nic id=85834
- 2017-12-01 00:01:34,192 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Revoving nic secondary ip entry ...
- 2017-12-01 00:01:34,192 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Cleaning up hypervisor data structures (ex. SRs in XenServer) for managed storage
- 2017-12-01 00:01:34,193 DEBUG [o.a.c.e.o.VolumeOrchestrator] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Cleaning storage for vm: 24524
- 2017-12-01 00:01:34,194 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) Expunge volume with no data store specified
- 2017-12-01 00:01:34,195 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) Volume 24523 is not referred anywhere, remove it from volumes table
- 2017-12-01 00:01:34,201 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) Expunged VM[ConsoleProxy|v-24523-VM]
- 2017-12-01 00:01:34,204 INFO [o.a.c.s.v.VolumeServiceImpl] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Expunge volume with no data store specified
- 2017-12-01 00:01:34,205 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) received console proxy alert
- 2017-12-01 00:01:34,205 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) Console proxy creation failure, zone: Zone-Orion
- 2017-12-01 00:01:34,206 WARN [o.a.c.alerts] (consoleproxy-1:ctx-5d69e952) (logid:b7acdfdb) alertType:: 10 // dataCenterId:: 1 // podId:: null // clusterId:: null // message:: Console proxy creation failure. zone: Zone-Orion, error details: null
- 2017-12-01 00:01:34,207 INFO [o.a.c.s.v.VolumeServiceImpl] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Volume 24524 is not referred anywhere, remove it from volumes table
- 2017-12-01 00:01:34,213 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Expunged VM[SecondaryStorageVm|s-24524-VM]
- 2017-12-01 00:01:34,216 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) received secondary storage vm alert
- 2017-12-01 00:01:34,216 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Secondary Storage Vm creation failure, zone: Zone-Orion
- 2017-12-01 00:01:34,217 WARN [o.a.c.alerts] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) alertType:: 19 // dataCenterId:: 1 // podId:: null // clusterId:: null // message:: Secondary Storage Vm creation failure. zone: Zone-Orion, error details: null
- 2017-12-01 00:01:34,220 INFO [o.a.c.s.PremiumSecondaryStorageManagerImpl] (secstorage-1:ctx-1d7b9913) (logid:4dc6a2c4) Primary secondary storage is not even started, wait until next turn
- 2017-12-01 00:01:38,372 DEBUG [c.c.s.StatsCollector] (StatsCollector-1:ctx-38742d98) (logid:05de0f83) AutoScaling Monitor is running...
- 2017-12-01 00:01:44,104 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-22f4629a) (logid:52ebb2c0) Begin cleanup expired async-jobs
- 2017-12-01 00:01:44,108 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-22f4629a) (logid:52ebb2c0) End cleanup expired async-jobs
- 2017-12-01 00:01:51,904 DEBUG [c.c.s.StatsCollector] (StatsCollector-2:ctx-6b88cad3) (logid:64572461) StorageCollector is running...
- 2017-12-01 00:01:51,909 DEBUG [c.c.s.StatsCollector] (StatsCollector-2:ctx-6b88cad3) (logid:64572461) There is no secondary storage VM for secondary storage host secondary
- 2017-12-01 00:01:51,910 DEBUG [c.c.h.o.r.Ovm3HypervisorGuru] (StatsCollector-2:ctx-6b88cad3) (logid:64572461) getCommandHostDelegation: class com.cloud.agent.api.GetStorageStatsCommand
- 2017-12-01 00:01:51,910 DEBUG [c.c.h.XenServerGuru] (StatsCollector-2:ctx-6b88cad3) (logid:64572461) getCommandHostDelegation: class com.cloud.agent.api.GetStorageStatsCommand
- 2017-12-01 00:01:51,911 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-333:ctx-df9ea633) (logid:c2094c40) Seq 1-3458483038843866938: Executing request
- 2017-12-01 00:01:51,982 DEBUG [c.c.h.v.r.VmwareResource] (DirectAgent-333:ctx-df9ea633 r6-l06-esx01.cisco.com, cmd: GetStorageStatsCommand) (logid:64572461) Datastore summary info, storageId: 260fa543-e292-4f78-820c-dae49505e528, localPath: datastore-2475, poolType: VMFS, capacity: 1751809785856, free: 1750779035648, used: 1030750208
- 2017-12-01 00:01:51,982 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-333:ctx-df9ea633) (logid:64572461) Seq 1-3458483038843866938: Response Received:
- 2017-12-01 00:01:51,982 DEBUG [c.c.a.t.Request] (StatsCollector-2:ctx-6b88cad3) (logid:64572461) Seq 1-3458483038843866938: Received: { Ans: , MgmtId: 345052167237, via: 1(r6-l06-esx01.cisco.com), Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
- 2017-12-01 00:01:51,983 DEBUG [c.c.h.o.r.Ovm3HypervisorGuru] (StatsCollector-2:ctx-6b88cad3) (logid:64572461) getCommandHostDelegation: class com.cloud.agent.api.GetStorageStatsCommand
- 2017-12-01 00:01:51,983 DEBUG [c.c.h.XenServerGuru] (StatsCollector-2:ctx-6b88cad3) (logid:64572461) getCommandHostDelegation: class com.cloud.agent.api.GetStorageStatsCommand
- 2017-12-01 00:01:51,984 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-167:ctx-0ab5064f) (logid:466bdbd3) Seq 1-3458483038843866939: Executing request
- 2017-12-01 00:01:52,036 DEBUG [c.c.h.v.r.VmwareResource] (DirectAgent-167:ctx-0ab5064f r6-l06-esx01.cisco.com, cmd: GetStorageStatsCommand) (logid:64572461) Datastore summary info, storageId: 09198288-c7af-4569-9202-4616ec2b0b92, localPath: datastore-2476, poolType: VMFS, capacity: 137975824384, free: 47294971904, used: 90680852480
- 2017-12-01 00:01:52,036 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-167:ctx-0ab5064f) (logid:64572461) Seq 1-3458483038843866939: Response Received:
- 2017-12-01 00:01:52,036 DEBUG [c.c.a.t.Request] (StatsCollector-2:ctx-6b88cad3) (logid:64572461) Seq 1-3458483038843866939: Received: { Ans: , MgmtId: 345052167237, via: 1(r6-l06-esx01.cisco.com), Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
- 2017-12-01 00:01:54,104 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-d16ae790) (logid:3f785283) Begin cleanup expired async-jobs
- 2017-12-01 00:01:54,109 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-d16ae790) (logid:3f785283) End cleanup expired async-jobs
- 2017-12-01 00:01:54,338 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-3ad419ae) (logid:c20d52b4) Found 0 routers to update status.
- 2017-12-01 00:01:54,339 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-3ad419ae) (logid:c20d52b4) Found 0 VPC networks to update Redundant State.
- 2017-12-01 00:01:54,339 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-3ad419ae) (logid:c20d52b4) Found 0 networks to update RvR status.
- 2017-12-01 00:01:59,353 DEBUG [o.a.c.f.j.d.VmWorkJobDaoImpl] (Vm-Operations-Cleanup-1:ctx-cdca090a) (logid:a06f8a27) Expunge completed work job-73226
- 2017-12-01 00:01:59,357 DEBUG [o.a.c.f.j.d.VmWorkJobDaoImpl] (Vm-Operations-Cleanup-1:ctx-cdca090a) (logid:a06f8a27) Expunge completed work job-73227
- 2017-12-01 00:01:59,359 DEBUG [o.a.c.f.j.d.VmWorkJobDaoImpl] (Vm-Operations-Cleanup-1:ctx-cdca090a) (logid:a06f8a27) Expunge completed work job-73228
- 2017-12-01 00:01:59,362 DEBUG [o.a.c.f.j.d.VmWorkJobDaoImpl] (Vm-Operations-Cleanup-1:ctx-cdca090a) (logid:a06f8a27) Expunge completed work job-73229
- 2017-12-01 00:01:59,365 DEBUG [o.a.c.f.j.d.VmWorkJobDaoImpl] (Vm-Operations-Cleanup-1:ctx-cdca090a) (logid:a06f8a27) Expunge completed work job-73230
- 2017-12-01 00:01:59,369 DEBUG [o.a.c.f.j.d.VmWorkJobDaoImpl] (Vm-Operations-Cleanup-1:ctx-cdca090a) (logid:a06f8a27) Expunge completed work job-73231
- 2017-12-01 00:02:00,237 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) Zone 1 is ready to launch console proxy
- 2017-12-01 00:02:00,237 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) Expand console proxy standby capacity for zone Zone-Orion
- 2017-12-01 00:02:00,238 INFO [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) No stopped console proxy is available, need to allocate a new console proxy
- 2017-12-01 00:02:00,239 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) Assign console proxy from a newly started instance for request from data center : 1
- 2017-12-01 00:02:00,247 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) Found existing network configuration for offering [Network Offering [1-Public-System-Public-Network]: Ntwk[200|Public|1]
- 2017-12-01 00:02:00,247 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
- 2017-12-01 00:02:00,253 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) Found existing network configuration for offering [Network Offering [3-Control-System-Control-Network]: Ntwk[202|Control|3]
- 2017-12-01 00:02:00,253 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
- 2017-12-01 00:02:00,257 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) Found existing network configuration for offering [Network Offering [2-Management-System-Management-Network]: Ntwk[201|Management|2]
- 2017-12-01 00:02:00,257 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
- 2017-12-01 00:02:00,266 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) Allocating entries for VM: VM[ConsoleProxy|v-24525-VM]
- 2017-12-01 00:02:00,267 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) Allocating nics for VM[ConsoleProxy|v-24525-VM]
- 2017-12-01 00:02:00,268 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) Allocating nic for vm VM[ConsoleProxy|v-24525-VM] in network Ntwk[200|Public|1] with requested profile NicProfile[0-0-null-null-null
- 2017-12-01 00:02:00,278 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) Allocating nic for vm VM[ConsoleProxy|v-24525-VM] in network Ntwk[202|Control|3] with requested profile null
- 2017-12-01 00:02:00,284 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) Allocating nic for vm VM[ConsoleProxy|v-24525-VM] in network Ntwk[201|Management|2] with requested profile null
- 2017-12-01 00:02:00,287 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) Allocating disks for VM[ConsoleProxy|v-24525-VM]
- 2017-12-01 00:02:00,291 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) Allocation completed for VM: VM[ConsoleProxy|v-24525-VM]
- 2017-12-01 00:02:00,293 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) received console proxy alert
- 2017-12-01 00:02:00,293 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) New console proxy created, zone: Zone-Orion, proxy: v-24525-VM, public IP: null, private IP: null
- 2017-12-01 00:02:00,301 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) Sync job-73592 execution on object VmWorkJobQueue.24525
- 2017-12-01 00:02:00,355 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) Zone 1 is ready to launch secondary storage VM
- 2017-12-01 00:02:00,357 INFO [o.a.c.s.PremiumSecondaryStorageManagerImpl] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) No running secondary storage vms found in datacenter id=1, starting one
- 2017-12-01 00:02:00,359 INFO [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) No stopped secondary storage vm is available, need to allocate a new secondary storage vm
- 2017-12-01 00:02:00,360 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) Assign secondary storage vm from a newly started instance for request from data center : 1
- 2017-12-01 00:02:00,367 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) Found existing network configuration for offering [Network Offering [1-Public-System-Public-Network]: Ntwk[200|Public|1]
- 2017-12-01 00:02:00,367 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
- 2017-12-01 00:02:00,371 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) Found existing network configuration for offering [Network Offering [3-Control-System-Control-Network]: Ntwk[202|Control|3]
- 2017-12-01 00:02:00,371 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
- 2017-12-01 00:02:00,376 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) Found existing network configuration for offering [Network Offering [2-Management-System-Management-Network]: Ntwk[201|Management|2]
- 2017-12-01 00:02:00,376 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
- 2017-12-01 00:02:00,380 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) Found existing network configuration for offering [Network Offering [4-Storage-System-Storage-Network]: Ntwk[203|Storage|4]
- 2017-12-01 00:02:00,380 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
- 2017-12-01 00:02:00,391 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) Allocating entries for VM: VM[SecondaryStorageVm|s-24526-VM]
- 2017-12-01 00:02:00,392 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) Allocating nics for VM[SecondaryStorageVm|s-24526-VM]
- 2017-12-01 00:02:00,393 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) Allocating nic for vm VM[SecondaryStorageVm|s-24526-VM] in network Ntwk[200|Public|1] with requested profile NicProfile[0-0-null-null-null
- 2017-12-01 00:02:00,402 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) Allocating nic for vm VM[SecondaryStorageVm|s-24526-VM] in network Ntwk[202|Control|3] with requested profile null
- 2017-12-01 00:02:00,409 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) Allocating nic for vm VM[SecondaryStorageVm|s-24526-VM] in network Ntwk[201|Management|2] with requested profile null
- 2017-12-01 00:02:00,412 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) Allocating nic for vm VM[SecondaryStorageVm|s-24526-VM] in network Ntwk[203|Storage|4] with requested profile null
- 2017-12-01 00:02:00,416 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) Allocating disks for VM[SecondaryStorageVm|s-24526-VM]
- 2017-12-01 00:02:00,419 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) Allocation completed for VM: VM[SecondaryStorageVm|s-24526-VM]
- 2017-12-01 00:02:00,422 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) received secondary storage vm alert
- 2017-12-01 00:02:00,422 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) New secondary storage vm created, zone: Zone-Orion, secStorageVm: s-24526-VM, public IP: null, private IP: null
- 2017-12-01 00:02:00,430 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) Sync job-73593 execution on object VmWorkJobQueue.24526
- 2017-12-01 00:02:01,133 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-56604421) (logid:13b5eeab) Resetting hosts suitable for reconnect
- 2017-12-01 00:02:01,134 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-56604421) (logid:13b5eeab) Completed resetting hosts suitable for reconnect
- 2017-12-01 00:02:01,134 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-56604421) (logid:13b5eeab) Acquiring hosts for clusters already owned by this management server
- 2017-12-01 00:02:01,134 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-56604421) (logid:13b5eeab) Completed acquiring hosts for clusters already owned by this management server
- 2017-12-01 00:02:01,134 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-56604421) (logid:13b5eeab) Acquiring hosts for clusters not owned by any management server
- 2017-12-01 00:02:01,135 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-56604421) (logid:13b5eeab) Completed acquiring hosts for clusters not owned by any management server
- 2017-12-01 00:02:02,106 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-33a87a7f) (logid:ba438d84) Execute sync-queue item: SyncQueueItemVO {id:73574, queueId: 73574, contentType: AsyncJob, contentId: 73592, lastProcessMsid: 345052167237, lastprocessNumber: 1, lastProcessTime: Fri Dec 01 00:02:02 CST 2017, created: Fri Dec 01 00:02:00 CST 2017}
- 2017-12-01 00:02:02,107 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-33a87a7f) (logid:ba438d84) Schedule queued job-73592
- 2017-12-01 00:02:02,109 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-33a87a7f) (logid:ba438d84) Execute sync-queue item: SyncQueueItemVO {id:73575, queueId: 73575, contentType: AsyncJob, contentId: 73593, lastProcessMsid: 345052167237, lastprocessNumber: 1, lastProcessTime: Fri Dec 01 00:02:02 CST 2017, created: Fri Dec 01 00:02:00 CST 2017}
- 2017-12-01 00:02:02,110 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592) (logid:1783fe70) Add job-73592 into job monitoring
- 2017-12-01 00:02:02,111 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-33a87a7f) (logid:ba438d84) Schedule queued job-73593
- 2017-12-01 00:02:02,114 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593) (logid:5741d1ca) Add job-73593 into job monitoring
- 2017-12-01 00:02:02,116 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592) (logid:a98dfed6) Executing AsyncJobVO {id:73592, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfzXQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:02:00 CST 2017}
- 2017-12-01 00:02:02,116 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592) (logid:a98dfed6) Run VM work job: com.cloud.vm.VmWorkStart for VM 24525, job origin: 1
- 2017-12-01 00:02:02,117 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) Execute VM work job: com.cloud.vm.VmWorkStart{"dcId":0,"userId":1,"accountId":1,"vmId":24525,"handlerName":"VirtualMachineManagerImpl"}
- 2017-12-01 00:02:02,121 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593) (logid:32b654cc) Executing AsyncJobVO {id:73593, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfznQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:02:00 CST 2017}
- 2017-12-01 00:02:02,121 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593) (logid:32b654cc) Run VM work job: com.cloud.vm.VmWorkStart for VM 24526, job origin: 2
- 2017-12-01 00:02:02,122 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
- 2017-12-01 00:02:02,122 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) Successfully transitioned to start state for VM[ConsoleProxy|v-24525-VM] reservation id = 6375707f-ffd4-4922-9a8d-d92641f6b7d6
- 2017-12-01 00:02:02,123 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) Execute VM work job: com.cloud.vm.VmWorkStart{"dcId":0,"userId":1,"accountId":1,"vmId":24526,"handlerName":"VirtualMachineManagerImpl"}
- 2017-12-01 00:02:02,124 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) Trying to deploy VM, vm has dcId: 1 and podId: null
- 2017-12-01 00:02:02,124 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) Deploy avoids pods: null, clusters: null, hosts: null
- 2017-12-01 00:02:02,127 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) Deploy avoids pods: null, clusters: null, hosts: null
- 2017-12-01 00:02:02,127 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@eecdd04
- 2017-12-01 00:02:02,127 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) Trying to allocate a host and storage pools from dc:1, pod:null,cluster:null, requested cpu: 500, requested ram: 1073741824
- 2017-12-01 00:02:02,127 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) Is ROOT volume READY (pool already allocated)?: No
- 2017-12-01 00:02:02,127 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) Searching all possible resources under this Zone: 1
- 2017-12-01 00:02:02,128 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
- 2017-12-01 00:02:02,129 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
- 2017-12-01 00:02:02,129 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) Successfully transitioned to start state for VM[SecondaryStorageVm|s-24526-VM] reservation id = 3ddc401d-d14d-49f7-baf2-33e6d1a96b24
- 2017-12-01 00:02:02,130 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) Trying to deploy VM, vm has dcId: 1 and podId: null
- 2017-12-01 00:02:02,130 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) Deploy avoids pods: null, clusters: null, hosts: null
- 2017-12-01 00:02:02,133 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) Deploy avoids pods: null, clusters: null, hosts: null
- 2017-12-01 00:02:02,134 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@eecdd04
- 2017-12-01 00:02:02,134 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) Trying to allocate a host and storage pools from dc:1, pod:null,cluster:null, requested cpu: 500, requested ram: 536870912
- 2017-12-01 00:02:02,134 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) Is ROOT volume READY (pool already allocated)?: No
- 2017-12-01 00:02:02,134 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) Searching all possible resources under this Zone: 1
- 2017-12-01 00:02:02,134 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
- 2017-12-01 00:02:02,137 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) Checking resources in Cluster: 1 under Pod: 1
- 2017-12-01 00:02:02,137 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e FirstFitRoutingAllocator) (logid:a98dfed6) Looking for hosts in dc: 1 pod:1 cluster:1
- 2017-12-01 00:02:02,138 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e FirstFitRoutingAllocator) (logid:a98dfed6) FirstFitAllocator has 1 hosts to check for allocation: [Host[-1-Routing]]
- 2017-12-01 00:02:02,142 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e FirstFitRoutingAllocator) (logid:a98dfed6) Found 1 hosts for allocation after prioritization: [Host[-1-Routing]]
- 2017-12-01 00:02:02,142 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e FirstFitRoutingAllocator) (logid:a98dfed6) Looking for speed=500Mhz, Ram=1024
- 2017-12-01 00:02:02,142 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) Checking resources in Cluster: 1 under Pod: 1
- 2017-12-01 00:02:02,142 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb FirstFitRoutingAllocator) (logid:32b654cc) Looking for hosts in dc: 1 pod:1 cluster:1
- 2017-12-01 00:02:02,144 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb FirstFitRoutingAllocator) (logid:32b654cc) FirstFitAllocator has 1 hosts to check for allocation: [Host[-1-Routing]]
- 2017-12-01 00:02:02,147 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e FirstFitRoutingAllocator) (logid:a98dfed6) Host: 1 has cpu capability (cpu:16, speed:2533) to support requested CPU: 1 and requested speed: 500
- 2017-12-01 00:02:02,147 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e FirstFitRoutingAllocator) (logid:a98dfed6) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
- 2017-12-01 00:02:02,149 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e FirstFitRoutingAllocator) (logid:a98dfed6) Hosts's actual total CPU: 40528 and CPU after applying overprovisioning: 40528
- 2017-12-01 00:02:02,149 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e FirstFitRoutingAllocator) (logid:a98dfed6) Free CPU: 40528 , Requested CPU: 500
- 2017-12-01 00:02:02,149 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e FirstFitRoutingAllocator) (logid:a98dfed6) Free RAM: 42880884736 , Requested RAM: 1073741824
- 2017-12-01 00:02:02,149 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e FirstFitRoutingAllocator) (logid:a98dfed6) Host has enough CPU and RAM available
- 2017-12-01 00:02:02,149 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e FirstFitRoutingAllocator) (logid:a98dfed6) STATS: Can alloc CPU from host: 1, used: 0, reserved: 0, actual total: 40528, total with overprovisioning: 40528; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
- 2017-12-01 00:02:02,149 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e FirstFitRoutingAllocator) (logid:a98dfed6) STATS: Can alloc MEM from host: 1, used: 0, reserved: 0, total: 42880884736; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
- 2017-12-01 00:02:02,149 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e FirstFitRoutingAllocator) (logid:a98dfed6) Found a suitable host, adding to list: 1
- 2017-12-01 00:02:02,149 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e FirstFitRoutingAllocator) (logid:a98dfed6) Host Allocator returning 1 suitable hosts
- 2017-12-01 00:02:02,150 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb FirstFitRoutingAllocator) (logid:32b654cc) Found 1 hosts for allocation after prioritization: [Host[-1-Routing]]
- 2017-12-01 00:02:02,150 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb FirstFitRoutingAllocator) (logid:32b654cc) Looking for speed=500Mhz, Ram=512
- 2017-12-01 00:02:02,150 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) Checking suitable pools for volume (Id, Type): (24525,ROOT)
- 2017-12-01 00:02:02,150 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) We need to allocate new storagepool for this volume
- 2017-12-01 00:02:02,151 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) Calling StoragePoolAllocators to find suitable pools
- 2017-12-01 00:02:02,152 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) System VMs will use shared storage for zone id=1
- 2017-12-01 00:02:02,152 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) LocalStoragePoolAllocator trying to find storage pool to fit the vm
- 2017-12-01 00:02:02,152 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) ClusterScopeStoragePoolAllocator looking for storage pool
- 2017-12-01 00:02:02,152 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) Looking for pools in dc: 1 pod:1 cluster:1. Disabled pools will be ignored.
- 2017-12-01 00:02:02,152 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) Found pools matching tags: []
- 2017-12-01 00:02:02,153 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) No storage pools available for shared volume allocation, returning
- 2017-12-01 00:02:02,153 DEBUG [o.a.c.s.a.ZoneWideStoragePoolAllocator] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) ZoneWideStoragePoolAllocator to find storage pool
- 2017-12-01 00:02:02,154 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) No suitable pools found for volume: Vol[24525|vm=24525|ROOT] under cluster: 1
- 2017-12-01 00:02:02,154 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) No suitable pools found
- 2017-12-01 00:02:02,154 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) No suitable storagePools found under this Cluster: 1
- 2017-12-01 00:02:02,154 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) Could not find suitable Deployment Destination for this VM under any clusters, returning.
- 2017-12-01 00:02:02,154 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) Searching all possible resources under this Zone: 1
- 2017-12-01 00:02:02,155 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
- 2017-12-01 00:02:02,155 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb FirstFitRoutingAllocator) (logid:32b654cc) Host: 1 has cpu capability (cpu:16, speed:2533) to support requested CPU: 1 and requested speed: 500
- 2017-12-01 00:02:02,155 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb FirstFitRoutingAllocator) (logid:32b654cc) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 536870912 , cpuOverprovisioningFactor: 1.0
- 2017-12-01 00:02:02,156 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) Removing from the clusterId list these clusters from avoid set: [1]
- 2017-12-01 00:02:02,156 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) No clusters found after removing disabled clusters and clusters in avoid list, returning.
- 2017-12-01 00:02:02,157 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb FirstFitRoutingAllocator) (logid:32b654cc) Hosts's actual total CPU: 40528 and CPU after applying overprovisioning: 40528
- 2017-12-01 00:02:02,157 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb FirstFitRoutingAllocator) (logid:32b654cc) Free CPU: 40528 , Requested CPU: 500
- 2017-12-01 00:02:02,157 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb FirstFitRoutingAllocator) (logid:32b654cc) Free RAM: 42880884736 , Requested RAM: 536870912
- 2017-12-01 00:02:02,157 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb FirstFitRoutingAllocator) (logid:32b654cc) Host has enough CPU and RAM available
- 2017-12-01 00:02:02,157 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb FirstFitRoutingAllocator) (logid:32b654cc) STATS: Can alloc CPU from host: 1, used: 0, reserved: 0, actual total: 40528, total with overprovisioning: 40528; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
- 2017-12-01 00:02:02,157 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb FirstFitRoutingAllocator) (logid:32b654cc) STATS: Can alloc MEM from host: 1, used: 0, reserved: 0, total: 42880884736; requested mem: 536870912,alloc_from_last_host?:false ,considerReservedCapacity?: true
- 2017-12-01 00:02:02,157 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb FirstFitRoutingAllocator) (logid:32b654cc) Found a suitable host, adding to list: 1
- 2017-12-01 00:02:02,157 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb FirstFitRoutingAllocator) (logid:32b654cc) Host Allocator returning 1 suitable hosts
- 2017-12-01 00:02:02,159 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) Checking suitable pools for volume (Id, Type): (24526,ROOT)
- 2017-12-01 00:02:02,159 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) We need to allocate new storagepool for this volume
- 2017-12-01 00:02:02,160 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) Calling StoragePoolAllocators to find suitable pools
- 2017-12-01 00:02:02,161 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) System VMs will use shared storage for zone id=1
- 2017-12-01 00:02:02,161 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) LocalStoragePoolAllocator trying to find storage pool to fit the vm
- 2017-12-01 00:02:02,161 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) ClusterScopeStoragePoolAllocator looking for storage pool
- 2017-12-01 00:02:02,161 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) Looking for pools in dc: 1 pod:1 cluster:1. Disabled pools will be ignored.
- 2017-12-01 00:02:02,161 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) Found pools matching tags: []
- 2017-12-01 00:02:02,162 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) No storage pools available for shared volume allocation, returning
- 2017-12-01 00:02:02,162 DEBUG [o.a.c.s.a.ZoneWideStoragePoolAllocator] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) ZoneWideStoragePoolAllocator to find storage pool
- 2017-12-01 00:02:02,163 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) No suitable pools found for volume: Vol[24526|vm=24526|ROOT] under cluster: 1
- 2017-12-01 00:02:02,163 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) No suitable pools found
- 2017-12-01 00:02:02,163 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) No suitable storagePools found under this Cluster: 1
- 2017-12-01 00:02:02,164 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) Could not find suitable Deployment Destination for this VM under any clusters, returning.
- 2017-12-01 00:02:02,164 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) Searching all possible resources under this Zone: 1
- 2017-12-01 00:02:02,164 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
- 2017-12-01 00:02:02,164 ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) Invocation exception, caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24525-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- 2017-12-01 00:02:02,164 INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592 ctx-e531420e) (logid:a98dfed6) Rethrow exception com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24525-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- 2017-12-01 00:02:02,164 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592) (logid:a98dfed6) Done with run of VM work job: com.cloud.vm.VmWorkStart for VM 24525, job origin: 1
- 2017-12-01 00:02:02,165 ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592) (logid:a98dfed6) Unable to complete AsyncJobVO {id:73592, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfzXQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:02:00 CST 2017}, job origin:1
- com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24525-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
- at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
- at java.lang.reflect.Method.invoke(Method.java:498)
- at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
- at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
- at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
- at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
- at java.util.concurrent.FutureTask.run(FutureTask.java:266)
- at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
- at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
- at java.lang.Thread.run(Thread.java:748)
- 2017-12-01 00:02:02,165 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592) (logid:a98dfed6) Complete async job-73592, jobStatus: FAILED, resultCode: 0, result: rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdAA9VW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW0NvbnNvbGVQcm94eXx2LTI0NTI1LVZNXXVyAB5bTGphdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudDsCRio8PP0iOQIAAHhwAAAAFHNyABtqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnRhCcWaJjbdhQIABEkACmxpbmVOdW1iZXJMAA5kZWNsYXJpbmdDbGFzc3EAfgAKTAAIZmlsZU5hbWVxAH4ACkwACm1ldGhvZE5hbWVxAH4ACnhwAAADwHQAJmNvbS5jbG91ZC52bS5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsdAAeVmlydHVhbE1hY2hpbmVNYW5hZ2VySW1wbC5qYXZhdAAQb3JjaGVzdHJhdGVTdGFydHNxAH4AEQAAEgtxAH4AE3EAfgAUcQB-ABVzcQB-ABH_____dAAmc3VuLnJlZmxlY3QuR2VuZXJhdGVkTWV0aG9kQWNjZXNzb3IxOTlwdAAGaW52b2tlc3EAfgARAAAAK3QAKHN1bi5yZWZsZWN0LkRlbGVnYXRpbmdNZXRob2RBY2Nlc3NvckltcGx0ACFEZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsLmphdmFxAH4AGXNxAH4AEQAAAfJ0ABhqYXZhLmxhbmcucmVmbGVjdC5NZXRob2R0AAtNZXRob2QuamF2YXEAfgAZc3EAfgARAAAAa3QAImNvbS5jbG91ZC52bS5WbVdvcmtKb2JIYW5kbGVyUHJveHl0ABpWbVdvcmtKb2JIYW5kbGVyUHJveHkuamF2YXQAD2hhbmRsZVZtV29ya0pvYnNxAH4AEQAAEqxxAH4AE3EAfgAUcQB-ACNzcQB-ABEAAABmdAAgY29tLmNsb3VkLnZtLlZtV29ya0pvYkRpc3BhdGNoZXJ0ABhWbVdvcmtKb2JEaXNwYXRjaGVyLmphdmF0AAZydW5Kb2JzcQB-ABEAAAIqdAA_b3JnLmFwYWNoZS5jbG91ZHN0YWNrLmZyYW1ld29yay5qb2JzLmltcGwuQXN5bmNKb2JNYW5hZ2VySW1wbCQ1dAAYQXN5bmNKb2JNYW5hZ2VySW1wbC5qYXZhdAAMcnVuSW5Db250ZXh0c3EAfgARAAAAMXQAPm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZSQxdAAbTWFuYWdlZENvbnRleHRSdW5uYWJsZS5qYXZhdAADcnVuc3EAfgARAAAAOHQAQm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5EZWZhdWx0TWFuYWdlZENvbnRleHQkMXQAGkRlZmF1bHRNYW5hZ2VkQ29udGV4dC5qYXZhdAAEY2FsbHNxAH4AEQAAAGd0AEBvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0cQB-ADN0AA9jYWxsV2l0aENvbnRleHRzcQB-ABEAAAA1cQB-ADZxAH4AM3QADnJ1bldpdGhDb250ZXh0c3EAfgARAAAALnQAPG9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZXEAfgAvcQB-ADBzcQB-ABEAAAH2cQB-ACpxAH4AK3EAfgAwc3EAfgARAAAB_3QALmphdmEudXRpbC5jb25jdXJyZW50LkV4ZWN1dG9ycyRSdW5uYWJsZUFkYXB0ZXJ0AA5FeGVjdXRvcnMuamF2YXEAfgA0c3EAfgARAAABCnQAH2phdmEudXRpbC5jb25jdXJyZW50LkZ1dHVyZVRhc2t0AA9GdXR1cmVUYXNrLmphdmFxAH4AMHNxAH4AEQAABH10ACdqYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3J0ABdUaHJlYWRQb29sRXhlY3V0b3IuamF2YXQACXJ1bldvcmtlcnNxAH4AEQAAAnB0AC5qYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3IkV29ya2VycQB-AEVxAH4AMHNxAH4AEQAAAux0ABBqYXZhLmxhbmcuVGhyZWFkdAALVGhyZWFkLmphdmFxAH4AMHNyACZqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlTGlzdPwPJTG17I4QAgABTAAEbGlzdHEAfgAMeHIALGphdmEudXRpbC5Db2xsZWN0aW9ucyRVbm1vZGlmaWFibGVDb2xsZWN0aW9uGUIAgMte9x4CAAFMAAFjdAAWTGphdmEvdXRpbC9Db2xsZWN0aW9uO3hwc3IAE2phdmEudXRpbC5BcnJheUxpc3R4gdIdmcdhnQMAAUkABHNpemV4cAAAAAB3BAAAAAB4cQB-AFF4c3IAEWphdmEubGFuZy5JbnRlZ2VyEuKgpPeBhzgCAAFJAAV2YWx1ZXhyABBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAAB4cAAAEO9zcQB-AFAAAAAAdwQAAAAAeHNyAA5qYXZhLmxhbmcuTG9uZzuL5JDMjyPfAgABSgAFdmFsdWV4cQB-AFMAAAAAAAAAAXZyABdjb20uY2xvdWQuZGMuRGF0YUNlbnRlcrLxCuun53i-AgAAeHAA
- 2017-12-01 00:02:02,167 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592) (logid:a98dfed6) Publish async job-73592 complete on message bus
- 2017-12-01 00:02:02,167 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592) (logid:a98dfed6) Wake up jobs related to job-73592
- 2017-12-01 00:02:02,167 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592) (logid:a98dfed6) Update db status for job-73592
- 2017-12-01 00:02:02,171 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
- 2017-12-01 00:02:02,171 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592) (logid:a98dfed6) Wake up jobs joined with job-73592 and disjoin all subjobs created from job- 73592
- 2017-12-01 00:02:02,172 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) Removing from the clusterId list these clusters from avoid set: [1]
- 2017-12-01 00:02:02,172 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) No clusters found after removing disabled clusters and clusters in avoid list, returning.
- 2017-12-01 00:02:02,176 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592) (logid:a98dfed6) Done executing com.cloud.vm.VmWorkStart for job-73592
- 2017-12-01 00:02:02,177 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-36:ctx-0e327fea job-1/job-73592) (logid:a98dfed6) Remove job-73592 from job monitoring
- 2017-12-01 00:02:02,183 WARN [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) Exception while trying to start console proxy
- com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24525-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
- at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
- at java.lang.reflect.Method.invoke(Method.java:498)
- at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
- at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
- at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
- at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
- at java.util.concurrent.FutureTask.run(FutureTask.java:266)
- at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
- at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
- at java.lang.Thread.run(Thread.java:748)
- 2017-12-01 00:02:02,183 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
- 2017-12-01 00:02:02,183 ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) Invocation exception, caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24526-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- 2017-12-01 00:02:02,186 INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593 ctx-703caffb) (logid:32b654cc) Rethrow exception com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24526-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- 2017-12-01 00:02:02,186 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593) (logid:32b654cc) Done with run of VM work job: com.cloud.vm.VmWorkStart for VM 24526, job origin: 2
- 2017-12-01 00:02:02,186 ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593) (logid:32b654cc) Unable to complete AsyncJobVO {id:73593, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfznQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:02:00 CST 2017}, job origin:2
- com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24526-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
- at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
- at java.lang.reflect.Method.invoke(Method.java:498)
- at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
- at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
- at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
- at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
- at java.util.concurrent.FutureTask.run(FutureTask.java:266)
- at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
- at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
- at java.lang.Thread.run(Thread.java:748)
- 2017-12-01 00:02:02,186 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593) (logid:32b654cc) Complete async job-73593, jobStatus: FAILED, resultCode: 0, result: rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdABDVW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW1NlY29uZGFyeVN0b3JhZ2VWbXxzLTI0NTI2LVZNXXVyAB5bTGphdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudDsCRio8PP0iOQIAAHhwAAAAFHNyABtqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnRhCcWaJjbdhQIABEkACmxpbmVOdW1iZXJMAA5kZWNsYXJpbmdDbGFzc3EAfgAKTAAIZmlsZU5hbWVxAH4ACkwACm1ldGhvZE5hbWVxAH4ACnhwAAADwHQAJmNvbS5jbG91ZC52bS5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsdAAeVmlydHVhbE1hY2hpbmVNYW5hZ2VySW1wbC5qYXZhdAAQb3JjaGVzdHJhdGVTdGFydHNxAH4AEQAAEgtxAH4AE3EAfgAUcQB-ABVzcQB-ABH_____dAAmc3VuLnJlZmxlY3QuR2VuZXJhdGVkTWV0aG9kQWNjZXNzb3IxOTlwdAAGaW52b2tlc3EAfgARAAAAK3QAKHN1bi5yZWZsZWN0LkRlbGVnYXRpbmdNZXRob2RBY2Nlc3NvckltcGx0ACFEZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsLmphdmFxAH4AGXNxAH4AEQAAAfJ0ABhqYXZhLmxhbmcucmVmbGVjdC5NZXRob2R0AAtNZXRob2QuamF2YXEAfgAZc3EAfgARAAAAa3QAImNvbS5jbG91ZC52bS5WbVdvcmtKb2JIYW5kbGVyUHJveHl0ABpWbVdvcmtKb2JIYW5kbGVyUHJveHkuamF2YXQAD2hhbmRsZVZtV29ya0pvYnNxAH4AEQAAEqxxAH4AE3EAfgAUcQB-ACNzcQB-ABEAAABmdAAgY29tLmNsb3VkLnZtLlZtV29ya0pvYkRpc3BhdGNoZXJ0ABhWbVdvcmtKb2JEaXNwYXRjaGVyLmphdmF0AAZydW5Kb2JzcQB-ABEAAAIqdAA_b3JnLmFwYWNoZS5jbG91ZHN0YWNrLmZyYW1ld29yay5qb2JzLmltcGwuQXN5bmNKb2JNYW5hZ2VySW1wbCQ1dAAYQXN5bmNKb2JNYW5hZ2VySW1wbC5qYXZhdAAMcnVuSW5Db250ZXh0c3EAfgARAAAAMXQAPm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZSQxdAAbTWFuYWdlZENvbnRleHRSdW5uYWJsZS5qYXZhdAADcnVuc3EAfgARAAAAOHQAQm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5EZWZhdWx0TWFuYWdlZENvbnRleHQkMXQAGkRlZmF1bHRNYW5hZ2VkQ29udGV4dC5qYXZhdAAEY2FsbHNxAH4AEQAAAGd0AEBvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0cQB-ADN0AA9jYWxsV2l0aENvbnRleHRzcQB-ABEAAAA1cQB-ADZxAH4AM3QADnJ1bldpdGhDb250ZXh0c3EAfgARAAAALnQAPG9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZXEAfgAvcQB-ADBzcQB-ABEAAAH2cQB-ACpxAH4AK3EAfgAwc3EAfgARAAAB_3QALmphdmEudXRpbC5jb25jdXJyZW50LkV4ZWN1dG9ycyRSdW5uYWJsZUFkYXB0ZXJ0AA5FeGVjdXRvcnMuamF2YXEAfgA0c3EAfgARAAABCnQAH2phdmEudXRpbC5jb25jdXJyZW50LkZ1dHVyZVRhc2t0AA9GdXR1cmVUYXNrLmphdmFxAH4AMHNxAH4AEQAABH10ACdqYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3J0ABdUaHJlYWRQb29sRXhlY3V0b3IuamF2YXQACXJ1bldvcmtlcnNxAH4AEQAAAnB0AC5qYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3IkV29ya2VycQB-AEVxAH4AMHNxAH4AEQAAAux0ABBqYXZhLmxhbmcuVGhyZWFkdAALVGhyZWFkLmphdmFxAH4AMHNyACZqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlTGlzdPwPJTG17I4QAgABTAAEbGlzdHEAfgAMeHIALGphdmEudXRpbC5Db2xsZWN0aW9ucyRVbm1vZGlmaWFibGVDb2xsZWN0aW9uGUIAgMte9x4CAAFMAAFjdAAWTGphdmEvdXRpbC9Db2xsZWN0aW9uO3hwc3IAE2phdmEudXRpbC5BcnJheUxpc3R4gdIdmcdhnQMAAUkABHNpemV4cAAAAAB3BAAAAAB4cQB-AFF4c3IAEWphdmEubGFuZy5JbnRlZ2VyEuKgpPeBhzgCAAFJAAV2YWx1ZXhyABBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAAB4cAAAEO9zcQB-AFAAAAAAdwQAAAAAeHNyAA5qYXZhLmxhbmcuTG9uZzuL5JDMjyPfAgABSgAFdmFsdWV4cQB-AFMAAAAAAAAAAXZyABdjb20uY2xvdWQuZGMuRGF0YUNlbnRlcrLxCuun53i-AgAAeHAA
- 2017-12-01 00:02:02,187 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593) (logid:32b654cc) Publish async job-73593 complete on message bus
- 2017-12-01 00:02:02,187 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593) (logid:32b654cc) Wake up jobs related to job-73593
- 2017-12-01 00:02:02,187 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593) (logid:32b654cc) Update db status for job-73593
- 2017-12-01 00:02:02,188 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593) (logid:32b654cc) Wake up jobs joined with job-73593 and disjoin all subjobs created from job- 73593
- 2017-12-01 00:02:02,193 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593) (logid:32b654cc) Done executing com.cloud.vm.VmWorkStart for job-73593
- 2017-12-01 00:02:02,198 WARN [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) Exception while trying to start secondary storage vm
- com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24526-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
- at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
- at java.lang.reflect.Method.invoke(Method.java:498)
- at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
- at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
- at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
- at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
- at java.util.concurrent.FutureTask.run(FutureTask.java:266)
- at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
- at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
- at java.lang.Thread.run(Thread.java:748)
- 2017-12-01 00:02:02,198 INFO [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) Unable to start secondary storage vm for standby capacity, vm id : 24526, will recycle it and start a new one
- 2017-12-01 00:02:02,198 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) received secondary storage vm alert
- 2017-12-01 00:02:02,198 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) Secondary Storage Vm creation failure, zone: Zone-Orion
- 2017-12-01 00:02:02,183 INFO [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) Unable to start console proxy vm for standby capacity, vm id : 24525, will recycle it and start a new one
- 2017-12-01 00:02:02,199 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) received console proxy alert
- 2017-12-01 00:02:02,199 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) Console proxy creation failure, zone: Zone-Orion
- 2017-12-01 00:02:02,199 WARN [o.a.c.alerts] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) alertType:: 19 // dataCenterId:: 1 // podId:: null // clusterId:: null // message:: Secondary Storage Vm creation failure. zone: Zone-Orion, error details: null
- 2017-12-01 00:02:02,199 WARN [o.a.c.alerts] (consoleproxy-1:ctx-9f10da4e) (logid:37dff626) alertType:: 10 // dataCenterId:: 1 // podId:: null // clusterId:: null // message:: Console proxy creation failure. zone: Zone-Orion, error details: null
- 2017-12-01 00:02:02,203 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-37:ctx-83e161b3 job-2/job-73593) (logid:32b654cc) Remove job-73593 from job monitoring
- 2017-12-01 00:02:02,206 INFO [o.a.c.s.PremiumSecondaryStorageManagerImpl] (secstorage-1:ctx-dd8d5db2) (logid:57fcec7f) Primary secondary storage is not even started, wait until next turn
- 2017-12-01 00:02:04,104 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-03429a27) (logid:f8110cbb) Begin cleanup expired async-jobs
- 2017-12-01 00:02:04,109 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-03429a27) (logid:f8110cbb) End cleanup expired async-jobs
- 2017-12-01 00:02:14,104 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-1c3a6d58) (logid:34ad03f9) Begin cleanup expired async-jobs
- 2017-12-01 00:02:14,108 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-1c3a6d58) (logid:34ad03f9) End cleanup expired async-jobs
- 2017-12-01 00:02:15,645 DEBUG [c.c.s.StatsCollector] (StatsCollector-6:ctx-3acf58f2) (logid:f6ebd6ab) HostStatsCollector is running...
- 2017-12-01 00:02:15,652 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-334:ctx-f115684c) (logid:844373e9) Seq 1-3458483038843866940: Executing request
- 2017-12-01 00:02:15,765 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-334:ctx-f115684c) (logid:f6ebd6ab) Seq 1-3458483038843866940: Response Received:
- 2017-12-01 00:02:15,765 DEBUG [c.c.a.t.Request] (StatsCollector-6:ctx-3acf58f2) (logid:f6ebd6ab) Seq 1-3458483038843866940: Received: { Ans: , MgmtId: 345052167237, via: 1(r6-l06-esx01.cisco.com), Ver: v1, Flags: 10, { GetHostStatsAnswer } }
- 2017-12-01 00:02:24,104 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-594ac3cb) (logid:2492e1b1) Begin cleanup expired async-jobs
- 2017-12-01 00:02:24,109 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-594ac3cb) (logid:2492e1b1) End cleanup expired async-jobs
- 2017-12-01 00:02:24,338 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-c64af272) (logid:5a018070) Found 0 routers to update status.
- 2017-12-01 00:02:24,339 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-c64af272) (logid:5a018070) Found 0 VPC networks to update Redundant State.
- 2017-12-01 00:02:24,339 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-c64af272) (logid:5a018070) Found 0 networks to update RvR status.
- 2017-12-01 00:02:30,238 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) Zone 1 is ready to launch console proxy
- 2017-12-01 00:02:30,238 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) Expand console proxy standby capacity for zone Zone-Orion
- 2017-12-01 00:02:30,239 INFO [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) Found a stopped console proxy, starting it. Vm id : 24525
- 2017-12-01 00:02:30,248 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) Sync job-73594 execution on object VmWorkJobQueue.24525
- 2017-12-01 00:02:30,355 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Zone 1 is ready to launch secondary storage VM
- 2017-12-01 00:02:30,357 INFO [o.a.c.s.PremiumSecondaryStorageManagerImpl] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) No running secondary storage vms found in datacenter id=1, starting one
- 2017-12-01 00:02:30,360 INFO [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Found a stopped secondary storage vm, starting it. Vm id : 24526
- 2017-12-01 00:02:30,366 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Sync job-73595 execution on object VmWorkJobQueue.24526
- 2017-12-01 00:02:32,106 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-98b3a9ac) (logid:6671f2c7) Execute sync-queue item: SyncQueueItemVO {id:73576, queueId: 73574, contentType: AsyncJob, contentId: 73594, lastProcessMsid: 345052167237, lastprocessNumber: 2, lastProcessTime: Fri Dec 01 00:02:32 CST 2017, created: Fri Dec 01 00:02:30 CST 2017}
- 2017-12-01 00:02:32,107 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-98b3a9ac) (logid:6671f2c7) Schedule queued job-73594
- 2017-12-01 00:02:32,109 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-98b3a9ac) (logid:6671f2c7) Execute sync-queue item: SyncQueueItemVO {id:73577, queueId: 73575, contentType: AsyncJob, contentId: 73595, lastProcessMsid: 345052167237, lastprocessNumber: 2, lastProcessTime: Fri Dec 01 00:02:32 CST 2017, created: Fri Dec 01 00:02:30 CST 2017}
- 2017-12-01 00:02:32,109 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-98b3a9ac) (logid:6671f2c7) Schedule queued job-73595
- 2017-12-01 00:02:32,110 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594) (logid:6a649155) Add job-73594 into job monitoring
- 2017-12-01 00:02:32,112 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595) (logid:71655c09) Add job-73595 into job monitoring
- 2017-12-01 00:02:32,116 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594) (logid:a98dfed6) Executing AsyncJobVO {id:73594, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfzXQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:02:30 CST 2017}
- 2017-12-01 00:02:32,117 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594) (logid:a98dfed6) Run VM work job: com.cloud.vm.VmWorkStart for VM 24525, job origin: 1
- 2017-12-01 00:02:32,118 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) Execute VM work job: com.cloud.vm.VmWorkStart{"dcId":0,"userId":1,"accountId":1,"vmId":24525,"handlerName":"VirtualMachineManagerImpl"}
- 2017-12-01 00:02:32,118 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595) (logid:32b654cc) Executing AsyncJobVO {id:73595, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfznQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:02:30 CST 2017}
- 2017-12-01 00:02:32,119 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595) (logid:32b654cc) Run VM work job: com.cloud.vm.VmWorkStart for VM 24526, job origin: 2
- 2017-12-01 00:02:32,121 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) Execute VM work job: com.cloud.vm.VmWorkStart{"dcId":0,"userId":1,"accountId":1,"vmId":24526,"handlerName":"VirtualMachineManagerImpl"}
- 2017-12-01 00:02:32,124 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
- 2017-12-01 00:02:32,124 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) Successfully transitioned to start state for VM[ConsoleProxy|v-24525-VM] reservation id = eebf5298-b344-4d23-bb75-acf26107e9f6
- 2017-12-01 00:02:32,125 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) Trying to deploy VM, vm has dcId: 1 and podId: null
- 2017-12-01 00:02:32,125 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) Deploy avoids pods: null, clusters: null, hosts: null
- 2017-12-01 00:02:32,127 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
- 2017-12-01 00:02:32,127 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) Successfully transitioned to start state for VM[SecondaryStorageVm|s-24526-VM] reservation id = 6772c934-3782-4563-9b95-52a6b7561c91
- 2017-12-01 00:02:32,128 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) Trying to deploy VM, vm has dcId: 1 and podId: null
- 2017-12-01 00:02:32,128 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) Deploy avoids pods: null, clusters: null, hosts: null
- 2017-12-01 00:02:32,128 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) Deploy avoids pods: null, clusters: null, hosts: null
- 2017-12-01 00:02:32,129 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@eecdd04
- 2017-12-01 00:02:32,129 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) Trying to allocate a host and storage pools from dc:1, pod:null,cluster:null, requested cpu: 500, requested ram: 1073741824
- 2017-12-01 00:02:32,129 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) Is ROOT volume READY (pool already allocated)?: No
- 2017-12-01 00:02:32,129 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) Searching all possible resources under this Zone: 1
- 2017-12-01 00:02:32,130 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
- 2017-12-01 00:02:32,134 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) Deploy avoids pods: null, clusters: null, hosts: null
- 2017-12-01 00:02:32,136 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@eecdd04
- 2017-12-01 00:02:32,136 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) Trying to allocate a host and storage pools from dc:1, pod:null,cluster:null, requested cpu: 500, requested ram: 536870912
- 2017-12-01 00:02:32,136 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) Is ROOT volume READY (pool already allocated)?: No
- 2017-12-01 00:02:32,136 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) Searching all possible resources under this Zone: 1
- 2017-12-01 00:02:32,137 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
- 2017-12-01 00:02:32,140 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) Checking resources in Cluster: 1 under Pod: 1
- 2017-12-01 00:02:32,140 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33 FirstFitRoutingAllocator) (logid:a98dfed6) Looking for hosts in dc: 1 pod:1 cluster:1
- 2017-12-01 00:02:32,142 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33 FirstFitRoutingAllocator) (logid:a98dfed6) FirstFitAllocator has 1 hosts to check for allocation: [Host[-1-Routing]]
- 2017-12-01 00:02:32,145 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33 FirstFitRoutingAllocator) (logid:a98dfed6) Found 1 hosts for allocation after prioritization: [Host[-1-Routing]]
- 2017-12-01 00:02:32,145 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33 FirstFitRoutingAllocator) (logid:a98dfed6) Looking for speed=500Mhz, Ram=1024
- 2017-12-01 00:02:32,145 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) Checking resources in Cluster: 1 under Pod: 1
- 2017-12-01 00:02:32,145 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133 FirstFitRoutingAllocator) (logid:32b654cc) Looking for hosts in dc: 1 pod:1 cluster:1
- 2017-12-01 00:02:32,147 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133 FirstFitRoutingAllocator) (logid:32b654cc) FirstFitAllocator has 1 hosts to check for allocation: [Host[-1-Routing]]
- 2017-12-01 00:02:32,150 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33 FirstFitRoutingAllocator) (logid:a98dfed6) Host: 1 has cpu capability (cpu:16, speed:2533) to support requested CPU: 1 and requested speed: 500
- 2017-12-01 00:02:32,150 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33 FirstFitRoutingAllocator) (logid:a98dfed6) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
- 2017-12-01 00:02:32,150 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133 FirstFitRoutingAllocator) (logid:32b654cc) Found 1 hosts for allocation after prioritization: [Host[-1-Routing]]
- 2017-12-01 00:02:32,150 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133 FirstFitRoutingAllocator) (logid:32b654cc) Looking for speed=500Mhz, Ram=512
- 2017-12-01 00:02:32,152 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33 FirstFitRoutingAllocator) (logid:a98dfed6) Hosts's actual total CPU: 40528 and CPU after applying overprovisioning: 40528
- 2017-12-01 00:02:32,152 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33 FirstFitRoutingAllocator) (logid:a98dfed6) Free CPU: 40528 , Requested CPU: 500
- 2017-12-01 00:02:32,152 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33 FirstFitRoutingAllocator) (logid:a98dfed6) Free RAM: 42880884736 , Requested RAM: 1073741824
- 2017-12-01 00:02:32,152 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33 FirstFitRoutingAllocator) (logid:a98dfed6) Host has enough CPU and RAM available
- 2017-12-01 00:02:32,152 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33 FirstFitRoutingAllocator) (logid:a98dfed6) STATS: Can alloc CPU from host: 1, used: 0, reserved: 0, actual total: 40528, total with overprovisioning: 40528; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
- 2017-12-01 00:02:32,152 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33 FirstFitRoutingAllocator) (logid:a98dfed6) STATS: Can alloc MEM from host: 1, used: 0, reserved: 0, total: 42880884736; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
- 2017-12-01 00:02:32,152 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33 FirstFitRoutingAllocator) (logid:a98dfed6) Found a suitable host, adding to list: 1
- 2017-12-01 00:02:32,152 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33 FirstFitRoutingAllocator) (logid:a98dfed6) Host Allocator returning 1 suitable hosts
- 2017-12-01 00:02:32,154 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) Checking suitable pools for volume (Id, Type): (24525,ROOT)
- 2017-12-01 00:02:32,154 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) We need to allocate new storagepool for this volume
- 2017-12-01 00:02:32,154 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) Calling StoragePoolAllocators to find suitable pools
- 2017-12-01 00:02:32,155 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) System VMs will use shared storage for zone id=1
- 2017-12-01 00:02:32,155 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) LocalStoragePoolAllocator trying to find storage pool to fit the vm
- 2017-12-01 00:02:32,155 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) ClusterScopeStoragePoolAllocator looking for storage pool
- 2017-12-01 00:02:32,155 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) Looking for pools in dc: 1 pod:1 cluster:1. Disabled pools will be ignored.
- 2017-12-01 00:02:32,155 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) Found pools matching tags: []
- 2017-12-01 00:02:32,155 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133 FirstFitRoutingAllocator) (logid:32b654cc) Host: 1 has cpu capability (cpu:16, speed:2533) to support requested CPU: 1 and requested speed: 500
- 2017-12-01 00:02:32,155 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133 FirstFitRoutingAllocator) (logid:32b654cc) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 536870912 , cpuOverprovisioningFactor: 1.0
- 2017-12-01 00:02:32,156 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) No storage pools available for shared volume allocation, returning
- 2017-12-01 00:02:32,156 DEBUG [o.a.c.s.a.ZoneWideStoragePoolAllocator] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) ZoneWideStoragePoolAllocator to find storage pool
- 2017-12-01 00:02:32,157 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) No suitable pools found for volume: Vol[24525|vm=24525|ROOT] under cluster: 1
- 2017-12-01 00:02:32,157 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) No suitable pools found
- 2017-12-01 00:02:32,157 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) No suitable storagePools found under this Cluster: 1
- 2017-12-01 00:02:32,157 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133 FirstFitRoutingAllocator) (logid:32b654cc) Hosts's actual total CPU: 40528 and CPU after applying overprovisioning: 40528
- 2017-12-01 00:02:32,157 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133 FirstFitRoutingAllocator) (logid:32b654cc) Free CPU: 40528 , Requested CPU: 500
- 2017-12-01 00:02:32,157 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133 FirstFitRoutingAllocator) (logid:32b654cc) Free RAM: 42880884736 , Requested RAM: 536870912
- 2017-12-01 00:02:32,157 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133 FirstFitRoutingAllocator) (logid:32b654cc) Host has enough CPU and RAM available
- 2017-12-01 00:02:32,157 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133 FirstFitRoutingAllocator) (logid:32b654cc) STATS: Can alloc CPU from host: 1, used: 0, reserved: 0, actual total: 40528, total with overprovisioning: 40528; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
- 2017-12-01 00:02:32,157 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133 FirstFitRoutingAllocator) (logid:32b654cc) STATS: Can alloc MEM from host: 1, used: 0, reserved: 0, total: 42880884736; requested mem: 536870912,alloc_from_last_host?:false ,considerReservedCapacity?: true
- 2017-12-01 00:02:32,157 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133 FirstFitRoutingAllocator) (logid:32b654cc) Found a suitable host, adding to list: 1
- 2017-12-01 00:02:32,157 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133 FirstFitRoutingAllocator) (logid:32b654cc) Host Allocator returning 1 suitable hosts
- 2017-12-01 00:02:32,157 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) Could not find suitable Deployment Destination for this VM under any clusters, returning.
- 2017-12-01 00:02:32,157 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) Searching all possible resources under this Zone: 1
- 2017-12-01 00:02:32,158 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
- 2017-12-01 00:02:32,159 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) Checking suitable pools for volume (Id, Type): (24526,ROOT)
- 2017-12-01 00:02:32,159 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) We need to allocate new storagepool for this volume
- 2017-12-01 00:02:32,159 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) Removing from the clusterId list these clusters from avoid set: [1]
- 2017-12-01 00:02:32,159 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) No clusters found after removing disabled clusters and clusters in avoid list, returning.
- 2017-12-01 00:02:32,160 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) Calling StoragePoolAllocators to find suitable pools
- 2017-12-01 00:02:32,160 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) System VMs will use shared storage for zone id=1
- 2017-12-01 00:02:32,160 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) LocalStoragePoolAllocator trying to find storage pool to fit the vm
- 2017-12-01 00:02:32,160 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) ClusterScopeStoragePoolAllocator looking for storage pool
- 2017-12-01 00:02:32,160 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) Looking for pools in dc: 1 pod:1 cluster:1. Disabled pools will be ignored.
- 2017-12-01 00:02:32,161 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) Found pools matching tags: []
- 2017-12-01 00:02:32,161 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) No storage pools available for shared volume allocation, returning
- 2017-12-01 00:02:32,161 DEBUG [o.a.c.s.a.ZoneWideStoragePoolAllocator] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) ZoneWideStoragePoolAllocator to find storage pool
- 2017-12-01 00:02:32,162 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) No suitable pools found for volume: Vol[24526|vm=24526|ROOT] under cluster: 1
- 2017-12-01 00:02:32,162 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) No suitable pools found
- 2017-12-01 00:02:32,162 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) No suitable storagePools found under this Cluster: 1
- 2017-12-01 00:02:32,163 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) Could not find suitable Deployment Destination for this VM under any clusters, returning.
- 2017-12-01 00:02:32,163 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) Searching all possible resources under this Zone: 1
- 2017-12-01 00:02:32,163 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
- 2017-12-01 00:02:32,164 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) Removing from the clusterId list these clusters from avoid set: [1]
- 2017-12-01 00:02:32,165 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) No clusters found after removing disabled clusters and clusters in avoid list, returning.
- 2017-12-01 00:02:32,166 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
- 2017-12-01 00:02:32,166 ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) Invocation exception, caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24525-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- 2017-12-01 00:02:32,166 INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594 ctx-c654dc33) (logid:a98dfed6) Rethrow exception com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24525-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- 2017-12-01 00:02:32,166 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594) (logid:a98dfed6) Done with run of VM work job: com.cloud.vm.VmWorkStart for VM 24525, job origin: 1
- 2017-12-01 00:02:32,166 ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594) (logid:a98dfed6) Unable to complete AsyncJobVO {id:73594, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfzXQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:02:30 CST 2017}, job origin:1
- com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24525-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
- at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
- at java.lang.reflect.Method.invoke(Method.java:498)
- at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
- at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
- at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
- at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
- at java.util.concurrent.FutureTask.run(FutureTask.java:266)
- at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
- at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
- at java.lang.Thread.run(Thread.java:748)
- 2017-12-01 00:02:32,167 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594) (logid:a98dfed6) Complete async job-73594, jobStatus: FAILED, resultCode: 0, result: rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdAA9VW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW0NvbnNvbGVQcm94eXx2LTI0NTI1LVZNXXVyAB5bTGphdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudDsCRio8PP0iOQIAAHhwAAAAFHNyABtqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnRhCcWaJjbdhQIABEkACmxpbmVOdW1iZXJMAA5kZWNsYXJpbmdDbGFzc3EAfgAKTAAIZmlsZU5hbWVxAH4ACkwACm1ldGhvZE5hbWVxAH4ACnhwAAADwHQAJmNvbS5jbG91ZC52bS5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsdAAeVmlydHVhbE1hY2hpbmVNYW5hZ2VySW1wbC5qYXZhdAAQb3JjaGVzdHJhdGVTdGFydHNxAH4AEQAAEgtxAH4AE3EAfgAUcQB-ABVzcQB-ABH_____dAAmc3VuLnJlZmxlY3QuR2VuZXJhdGVkTWV0aG9kQWNjZXNzb3IxOTlwdAAGaW52b2tlc3EAfgARAAAAK3QAKHN1bi5yZWZsZWN0LkRlbGVnYXRpbmdNZXRob2RBY2Nlc3NvckltcGx0ACFEZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsLmphdmFxAH4AGXNxAH4AEQAAAfJ0ABhqYXZhLmxhbmcucmVmbGVjdC5NZXRob2R0AAtNZXRob2QuamF2YXEAfgAZc3EAfgARAAAAa3QAImNvbS5jbG91ZC52bS5WbVdvcmtKb2JIYW5kbGVyUHJveHl0ABpWbVdvcmtKb2JIYW5kbGVyUHJveHkuamF2YXQAD2hhbmRsZVZtV29ya0pvYnNxAH4AEQAAEqxxAH4AE3EAfgAUcQB-ACNzcQB-ABEAAABmdAAgY29tLmNsb3VkLnZtLlZtV29ya0pvYkRpc3BhdGNoZXJ0ABhWbVdvcmtKb2JEaXNwYXRjaGVyLmphdmF0AAZydW5Kb2JzcQB-ABEAAAIqdAA_b3JnLmFwYWNoZS5jbG91ZHN0YWNrLmZyYW1ld29yay5qb2JzLmltcGwuQXN5bmNKb2JNYW5hZ2VySW1wbCQ1dAAYQXN5bmNKb2JNYW5hZ2VySW1wbC5qYXZhdAAMcnVuSW5Db250ZXh0c3EAfgARAAAAMXQAPm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZSQxdAAbTWFuYWdlZENvbnRleHRSdW5uYWJsZS5qYXZhdAADcnVuc3EAfgARAAAAOHQAQm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5EZWZhdWx0TWFuYWdlZENvbnRleHQkMXQAGkRlZmF1bHRNYW5hZ2VkQ29udGV4dC5qYXZhdAAEY2FsbHNxAH4AEQAAAGd0AEBvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0cQB-ADN0AA9jYWxsV2l0aENvbnRleHRzcQB-ABEAAAA1cQB-ADZxAH4AM3QADnJ1bldpdGhDb250ZXh0c3EAfgARAAAALnQAPG9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZXEAfgAvcQB-ADBzcQB-ABEAAAH2cQB-ACpxAH4AK3EAfgAwc3EAfgARAAAB_3QALmphdmEudXRpbC5jb25jdXJyZW50LkV4ZWN1dG9ycyRSdW5uYWJsZUFkYXB0ZXJ0AA5FeGVjdXRvcnMuamF2YXEAfgA0c3EAfgARAAABCnQAH2phdmEudXRpbC5jb25jdXJyZW50LkZ1dHVyZVRhc2t0AA9GdXR1cmVUYXNrLmphdmFxAH4AMHNxAH4AEQAABH10ACdqYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3J0ABdUaHJlYWRQb29sRXhlY3V0b3IuamF2YXQACXJ1bldvcmtlcnNxAH4AEQAAAnB0AC5qYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3IkV29ya2VycQB-AEVxAH4AMHNxAH4AEQAAAux0ABBqYXZhLmxhbmcuVGhyZWFkdAALVGhyZWFkLmphdmFxAH4AMHNyACZqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlTGlzdPwPJTG17I4QAgABTAAEbGlzdHEAfgAMeHIALGphdmEudXRpbC5Db2xsZWN0aW9ucyRVbm1vZGlmaWFibGVDb2xsZWN0aW9uGUIAgMte9x4CAAFMAAFjdAAWTGphdmEvdXRpbC9Db2xsZWN0aW9uO3hwc3IAE2phdmEudXRpbC5BcnJheUxpc3R4gdIdmcdhnQMAAUkABHNpemV4cAAAAAB3BAAAAAB4cQB-AFF4c3IAEWphdmEubGFuZy5JbnRlZ2VyEuKgpPeBhzgCAAFJAAV2YWx1ZXhyABBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAAB4cAAAEO9zcQB-AFAAAAAAdwQAAAAAeHNyAA5qYXZhLmxhbmcuTG9uZzuL5JDMjyPfAgABSgAFdmFsdWV4cQB-AFMAAAAAAAAAAXZyABdjb20uY2xvdWQuZGMuRGF0YUNlbnRlcrLxCuun53i-AgAAeHAA
- 2017-12-01 00:02:32,167 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594) (logid:a98dfed6) Publish async job-73594 complete on message bus
- 2017-12-01 00:02:32,167 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594) (logid:a98dfed6) Wake up jobs related to job-73594
- 2017-12-01 00:02:32,167 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594) (logid:a98dfed6) Update db status for job-73594
- 2017-12-01 00:02:32,168 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594) (logid:a98dfed6) Wake up jobs joined with job-73594 and disjoin all subjobs created from job- 73594
- 2017-12-01 00:02:32,173 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594) (logid:a98dfed6) Done executing com.cloud.vm.VmWorkStart for job-73594
- 2017-12-01 00:02:32,174 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-38:ctx-5facf559 job-1/job-73594) (logid:a98dfed6) Remove job-73594 from job monitoring
- 2017-12-01 00:02:32,181 WARN [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) Exception while trying to start console proxy
- com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24525-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
- at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
- at java.lang.reflect.Method.invoke(Method.java:498)
- at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
- at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
- at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
- at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
- at java.util.concurrent.FutureTask.run(FutureTask.java:266)
- at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
- at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
- at java.lang.Thread.run(Thread.java:748)
- 2017-12-01 00:02:32,181 INFO [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) Unable to start console proxy vm for standby capacity, vm id : 24525, will recycle it and start a new one
- 2017-12-01 00:02:32,181 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
- 2017-12-01 00:02:32,181 ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) Invocation exception, caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24526-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- 2017-12-01 00:02:32,185 INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595 ctx-18a30133) (logid:32b654cc) Rethrow exception com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24526-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- 2017-12-01 00:02:32,185 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595) (logid:32b654cc) Done with run of VM work job: com.cloud.vm.VmWorkStart for VM 24526, job origin: 2
- 2017-12-01 00:02:32,185 ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595) (logid:32b654cc) Unable to complete AsyncJobVO {id:73595, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfznQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:02:30 CST 2017}, job origin:2
- com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24526-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
- at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
- at java.lang.reflect.Method.invoke(Method.java:498)
- at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
- at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
- at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
- at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
- at java.util.concurrent.FutureTask.run(FutureTask.java:266)
- at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
- at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
- at java.lang.Thread.run(Thread.java:748)
- 2017-12-01 00:02:32,186 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595) (logid:32b654cc) Complete async job-73595, jobStatus: FAILED, resultCode: 0, result: rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdABDVW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW1NlY29uZGFyeVN0b3JhZ2VWbXxzLTI0NTI2LVZNXXVyAB5bTGphdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudDsCRio8PP0iOQIAAHhwAAAAFHNyABtqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnRhCcWaJjbdhQIABEkACmxpbmVOdW1iZXJMAA5kZWNsYXJpbmdDbGFzc3EAfgAKTAAIZmlsZU5hbWVxAH4ACkwACm1ldGhvZE5hbWVxAH4ACnhwAAADwHQAJmNvbS5jbG91ZC52bS5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsdAAeVmlydHVhbE1hY2hpbmVNYW5hZ2VySW1wbC5qYXZhdAAQb3JjaGVzdHJhdGVTdGFydHNxAH4AEQAAEgtxAH4AE3EAfgAUcQB-ABVzcQB-ABH_____dAAmc3VuLnJlZmxlY3QuR2VuZXJhdGVkTWV0aG9kQWNjZXNzb3IxOTlwdAAGaW52b2tlc3EAfgARAAAAK3QAKHN1bi5yZWZsZWN0LkRlbGVnYXRpbmdNZXRob2RBY2Nlc3NvckltcGx0ACFEZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsLmphdmFxAH4AGXNxAH4AEQAAAfJ0ABhqYXZhLmxhbmcucmVmbGVjdC5NZXRob2R0AAtNZXRob2QuamF2YXEAfgAZc3EAfgARAAAAa3QAImNvbS5jbG91ZC52bS5WbVdvcmtKb2JIYW5kbGVyUHJveHl0ABpWbVdvcmtKb2JIYW5kbGVyUHJveHkuamF2YXQAD2hhbmRsZVZtV29ya0pvYnNxAH4AEQAAEqxxAH4AE3EAfgAUcQB-ACNzcQB-ABEAAABmdAAgY29tLmNsb3VkLnZtLlZtV29ya0pvYkRpc3BhdGNoZXJ0ABhWbVdvcmtKb2JEaXNwYXRjaGVyLmphdmF0AAZydW5Kb2JzcQB-ABEAAAIqdAA_b3JnLmFwYWNoZS5jbG91ZHN0YWNrLmZyYW1ld29yay5qb2JzLmltcGwuQXN5bmNKb2JNYW5hZ2VySW1wbCQ1dAAYQXN5bmNKb2JNYW5hZ2VySW1wbC5qYXZhdAAMcnVuSW5Db250ZXh0c3EAfgARAAAAMXQAPm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZSQxdAAbTWFuYWdlZENvbnRleHRSdW5uYWJsZS5qYXZhdAADcnVuc3EAfgARAAAAOHQAQm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5EZWZhdWx0TWFuYWdlZENvbnRleHQkMXQAGkRlZmF1bHRNYW5hZ2VkQ29udGV4dC5qYXZhdAAEY2FsbHNxAH4AEQAAAGd0AEBvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0cQB-ADN0AA9jYWxsV2l0aENvbnRleHRzcQB-ABEAAAA1cQB-ADZxAH4AM3QADnJ1bldpdGhDb250ZXh0c3EAfgARAAAALnQAPG9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZXEAfgAvcQB-ADBzcQB-ABEAAAH2cQB-ACpxAH4AK3EAfgAwc3EAfgARAAAB_3QALmphdmEudXRpbC5jb25jdXJyZW50LkV4ZWN1dG9ycyRSdW5uYWJsZUFkYXB0ZXJ0AA5FeGVjdXRvcnMuamF2YXEAfgA0c3EAfgARAAABCnQAH2phdmEudXRpbC5jb25jdXJyZW50LkZ1dHVyZVRhc2t0AA9GdXR1cmVUYXNrLmphdmFxAH4AMHNxAH4AEQAABH10ACdqYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3J0ABdUaHJlYWRQb29sRXhlY3V0b3IuamF2YXQACXJ1bldvcmtlcnNxAH4AEQAAAnB0AC5qYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3IkV29ya2VycQB-AEVxAH4AMHNxAH4AEQAAAux0ABBqYXZhLmxhbmcuVGhyZWFkdAALVGhyZWFkLmphdmFxAH4AMHNyACZqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlTGlzdPwPJTG17I4QAgABTAAEbGlzdHEAfgAMeHIALGphdmEudXRpbC5Db2xsZWN0aW9ucyRVbm1vZGlmaWFibGVDb2xsZWN0aW9uGUIAgMte9x4CAAFMAAFjdAAWTGphdmEvdXRpbC9Db2xsZWN0aW9uO3hwc3IAE2phdmEudXRpbC5BcnJheUxpc3R4gdIdmcdhnQMAAUkABHNpemV4cAAAAAB3BAAAAAB4cQB-AFF4c3IAEWphdmEubGFuZy5JbnRlZ2VyEuKgpPeBhzgCAAFJAAV2YWx1ZXhyABBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAAB4cAAAEO9zcQB-AFAAAAAAdwQAAAAAeHNyAA5qYXZhLmxhbmcuTG9uZzuL5JDMjyPfAgABSgAFdmFsdWV4cQB-AFMAAAAAAAAAAXZyABdjb20uY2xvdWQuZGMuRGF0YUNlbnRlcrLxCuun53i-AgAAeHAA
- 2017-12-01 00:02:32,188 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595) (logid:32b654cc) Publish async job-73595 complete on message bus
- 2017-12-01 00:02:32,188 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595) (logid:32b654cc) Wake up jobs related to job-73595
- 2017-12-01 00:02:32,188 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595) (logid:32b654cc) Update db status for job-73595
- 2017-12-01 00:02:32,189 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595) (logid:32b654cc) Wake up jobs joined with job-73595 and disjoin all subjobs created from job- 73595
- 2017-12-01 00:02:32,195 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595) (logid:32b654cc) Done executing com.cloud.vm.VmWorkStart for job-73595
- 2017-12-01 00:02:32,196 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-39:ctx-62f2d298 job-2/job-73595) (logid:32b654cc) Remove job-73595 from job monitoring
- 2017-12-01 00:02:32,203 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) Sync job-73596 execution on object VmWorkJobQueue.24525
- 2017-12-01 00:02:32,206 WARN [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Exception while trying to start secondary storage vm
- com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24526-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
- at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
- at java.lang.reflect.Method.invoke(Method.java:498)
- at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
- at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
- at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
- at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
- at java.util.concurrent.FutureTask.run(FutureTask.java:266)
- at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
- at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
- at java.lang.Thread.run(Thread.java:748)
- 2017-12-01 00:02:32,207 INFO [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Unable to start secondary storage vm for standby capacity, vm id : 24526, will recycle it and start a new one
- 2017-12-01 00:02:32,232 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Sync job-73597 execution on object VmWorkJobQueue.24526
- 2017-12-01 00:02:33,496 INFO [c.c.h.v.r.VmwareResource] (DirectAgentCronJob-384:ctx-1ad9b4f5) (logid:a81378fd) Scan hung worker VM to recycle
- 2017-12-01 00:02:33,679 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgentCronJob-384:ctx-1ad9b4f5) (logid:a81378fd) Ping from 1(r6-l06-esx01.cisco.com)
- 2017-12-01 00:02:33,679 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-384:ctx-1ad9b4f5) (logid:a81378fd) Process host VM state report from ping process. host: 1
- 2017-12-01 00:02:33,679 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-384:ctx-1ad9b4f5) (logid:a81378fd) Process VM state report. host: 1, number of records in report: 0
- 2017-12-01 00:02:33,681 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-384:ctx-1ad9b4f5) (logid:a81378fd) Done with process of VM state report. host: 1
- 2017-12-01 00:02:34,106 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-ae06fe36) (logid:e400cce1) Execute sync-queue item: SyncQueueItemVO {id:73578, queueId: 73574, contentType: AsyncJob, contentId: 73596, lastProcessMsid: 345052167237, lastprocessNumber: 3, lastProcessTime: Fri Dec 01 00:02:34 CST 2017, created: Fri Dec 01 00:02:32 CST 2017}
- 2017-12-01 00:02:34,107 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-ae06fe36) (logid:e400cce1) Schedule queued job-73596
- 2017-12-01 00:02:34,109 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-ae06fe36) (logid:e400cce1) Execute sync-queue item: SyncQueueItemVO {id:73579, queueId: 73575, contentType: AsyncJob, contentId: 73597, lastProcessMsid: 345052167237, lastprocessNumber: 3, lastProcessTime: Fri Dec 01 00:02:34 CST 2017, created: Fri Dec 01 00:02:32 CST 2017}
- 2017-12-01 00:02:34,110 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-ae06fe36) (logid:e400cce1) Schedule queued job-73597
- 2017-12-01 00:02:34,110 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-41:ctx-261a669f job-1/job-73596) (logid:6131d308) Add job-73596 into job monitoring
- 2017-12-01 00:02:34,114 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-c47f8708) (logid:73eda64c) Begin cleanup expired async-jobs
- 2017-12-01 00:02:34,114 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-41:ctx-261a669f job-1/job-73596) (logid:a98dfed6) Executing AsyncJobVO {id:73596, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStop, cmdInfo: rO0ABXNyABdjb20uY2xvdWQudm0uVm1Xb3JrU3RvcALQ4GymiWjjAgABWgAHY2xlYW51cHhyABNjb20uY2xvdWQudm0uVm1Xb3Jrn5m2VvAlZ2sCAARKAAlhY2NvdW50SWRKAAZ1c2VySWRKAAR2bUlkTAALaGFuZGxlck5hbWV0ABJMamF2YS9sYW5nL1N0cmluZzt4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfzXQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:02:32 CST 2017}
- 2017-12-01 00:02:34,115 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-41:ctx-261a669f job-1/job-73596) (logid:a98dfed6) Run VM work job: com.cloud.vm.VmWorkStop for VM 24525, job origin: 1
- 2017-12-01 00:02:34,115 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-40:ctx-cfdbeef1 job-2/job-73597) (logid:17f979d4) Add job-73597 into job monitoring
- 2017-12-01 00:02:34,119 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-c47f8708) (logid:73eda64c) End cleanup expired async-jobs
- 2017-12-01 00:02:34,120 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-40:ctx-cfdbeef1 job-2/job-73597) (logid:32b654cc) Executing AsyncJobVO {id:73597, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStop, cmdInfo: rO0ABXNyABdjb20uY2xvdWQudm0uVm1Xb3JrU3RvcALQ4GymiWjjAgABWgAHY2xlYW51cHhyABNjb20uY2xvdWQudm0uVm1Xb3Jrn5m2VvAlZ2sCAARKAAlhY2NvdW50SWRKAAZ1c2VySWRKAAR2bUlkTAALaGFuZGxlck5hbWV0ABJMamF2YS9sYW5nL1N0cmluZzt4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfznQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:02:32 CST 2017}
- 2017-12-01 00:02:34,120 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-40:ctx-cfdbeef1 job-2/job-73597) (logid:32b654cc) Run VM work job: com.cloud.vm.VmWorkStop for VM 24526, job origin: 2
- 2017-12-01 00:02:34,120 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-41:ctx-261a669f job-1/job-73596 ctx-f13b619d) (logid:a98dfed6) Execute VM work job: com.cloud.vm.VmWorkStop{"cleanup":false,"userId":1,"accountId":1,"vmId":24525,"handlerName":"VirtualMachineManagerImpl"}
- 2017-12-01 00:02:34,121 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-40:ctx-cfdbeef1 job-2/job-73597 ctx-19abb798) (logid:32b654cc) Execute VM work job: com.cloud.vm.VmWorkStop{"cleanup":false,"userId":1,"accountId":1,"vmId":24526,"handlerName":"VirtualMachineManagerImpl"}
- 2017-12-01 00:02:34,122 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-41:ctx-261a669f job-1/job-73596 ctx-f13b619d) (logid:a98dfed6) VM is already stopped: VM[ConsoleProxy|v-24525-VM]
- 2017-12-01 00:02:34,122 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-41:ctx-261a669f job-1/job-73596 ctx-f13b619d) (logid:a98dfed6) Done executing VM work job: com.cloud.vm.VmWorkStop{"cleanup":false,"userId":1,"accountId":1,"vmId":24525,"handlerName":"VirtualMachineManagerImpl"}
- 2017-12-01 00:02:34,122 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-41:ctx-261a669f job-1/job-73596 ctx-f13b619d) (logid:a98dfed6) Complete async job-73596, jobStatus: SUCCEEDED, resultCode: 0, result: null
- 2017-12-01 00:02:34,123 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-40:ctx-cfdbeef1 job-2/job-73597 ctx-19abb798) (logid:32b654cc) VM is already stopped: VM[SecondaryStorageVm|s-24526-VM]
- 2017-12-01 00:02:34,123 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-40:ctx-cfdbeef1 job-2/job-73597 ctx-19abb798) (logid:32b654cc) Done executing VM work job: com.cloud.vm.VmWorkStop{"cleanup":false,"userId":1,"accountId":1,"vmId":24526,"handlerName":"VirtualMachineManagerImpl"}
- 2017-12-01 00:02:34,123 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-40:ctx-cfdbeef1 job-2/job-73597 ctx-19abb798) (logid:32b654cc) Complete async job-73597, jobStatus: SUCCEEDED, resultCode: 0, result: null
- 2017-12-01 00:02:34,123 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-41:ctx-261a669f job-1/job-73596 ctx-f13b619d) (logid:a98dfed6) Publish async job-73596 complete on message bus
- 2017-12-01 00:02:34,123 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-41:ctx-261a669f job-1/job-73596 ctx-f13b619d) (logid:a98dfed6) Wake up jobs related to job-73596
- 2017-12-01 00:02:34,123 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-41:ctx-261a669f job-1/job-73596 ctx-f13b619d) (logid:a98dfed6) Update db status for job-73596
- 2017-12-01 00:02:34,124 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-40:ctx-cfdbeef1 job-2/job-73597 ctx-19abb798) (logid:32b654cc) Publish async job-73597 complete on message bus
- 2017-12-01 00:02:34,124 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-40:ctx-cfdbeef1 job-2/job-73597 ctx-19abb798) (logid:32b654cc) Wake up jobs related to job-73597
- 2017-12-01 00:02:34,124 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-40:ctx-cfdbeef1 job-2/job-73597 ctx-19abb798) (logid:32b654cc) Update db status for job-73597
- 2017-12-01 00:02:34,124 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-41:ctx-261a669f job-1/job-73596 ctx-f13b619d) (logid:a98dfed6) Wake up jobs joined with job-73596 and disjoin all subjobs created from job- 73596
- 2017-12-01 00:02:34,124 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-40:ctx-cfdbeef1 job-2/job-73597 ctx-19abb798) (logid:32b654cc) Wake up jobs joined with job-73597 and disjoin all subjobs created from job- 73597
- 2017-12-01 00:02:34,128 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-41:ctx-261a669f job-1/job-73596) (logid:a98dfed6) Done with run of VM work job: com.cloud.vm.VmWorkStop for VM 24525, job origin: 1
- 2017-12-01 00:02:34,128 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-41:ctx-261a669f job-1/job-73596) (logid:a98dfed6) Done executing com.cloud.vm.VmWorkStop for job-73596
- 2017-12-01 00:02:34,130 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-40:ctx-cfdbeef1 job-2/job-73597) (logid:32b654cc) Done with run of VM work job: com.cloud.vm.VmWorkStop for VM 24526, job origin: 2
- 2017-12-01 00:02:34,130 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-40:ctx-cfdbeef1 job-2/job-73597) (logid:32b654cc) Done executing com.cloud.vm.VmWorkStop for job-73597
- 2017-12-01 00:02:34,136 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-41:ctx-261a669f job-1/job-73596) (logid:a98dfed6) Remove job-73596 from job monitoring
- 2017-12-01 00:02:34,137 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-40:ctx-cfdbeef1 job-2/job-73597) (logid:32b654cc) Remove job-73597 from job monitoring
- 2017-12-01 00:02:34,139 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) VM state transitted from :Stopped to Expunging with event: ExpungeOperationvm's original host id: null new host id: null host id before state transition: null
- 2017-12-01 00:02:34,139 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) Destroying vm VM[ConsoleProxy|v-24525-VM]
- 2017-12-01 00:02:34,139 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) Cleaning up NICS
- 2017-12-01 00:02:34,141 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) VM state transitted from :Stopped to Expunging with event: ExpungeOperationvm's original host id: null new host id: null host id before state transition: null
- 2017-12-01 00:02:34,141 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Destroying vm VM[SecondaryStorageVm|s-24526-VM]
- 2017-12-01 00:02:34,141 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Cleaning up NICS
- 2017-12-01 00:02:34,143 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) Cleaning network for vm: 24525
- 2017-12-01 00:02:34,145 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Cleaning network for vm: 24526
- 2017-12-01 00:02:34,149 DEBUG [c.c.n.g.PublicNetworkGuru] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) public network deallocate network: networkId: 200, ip: 10.89.98.210
- 2017-12-01 00:02:34,151 DEBUG [c.c.n.g.PublicNetworkGuru] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) public network deallocate network: networkId: 200, ip: 10.89.98.211
- 2017-12-01 00:02:34,153 DEBUG [c.c.n.g.PublicNetworkGuru] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) Deallocated nic: NicProfile[85835-24525-null-null-null
- 2017-12-01 00:02:34,155 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) Removed nic id=85835
- 2017-12-01 00:02:34,155 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) Revoving nic secondary ip entry ...
- 2017-12-01 00:02:34,155 DEBUG [c.c.n.g.PublicNetworkGuru] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Deallocated nic: NicProfile[85838-24526-null-null-null
- 2017-12-01 00:02:34,157 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Removed nic id=85838
- 2017-12-01 00:02:34,158 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Revoving nic secondary ip entry ...
- 2017-12-01 00:02:34,163 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) Removed nic id=85836
- 2017-12-01 00:02:34,164 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) Revoving nic secondary ip entry ...
- 2017-12-01 00:02:34,165 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Removed nic id=85839
- 2017-12-01 00:02:34,166 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Revoving nic secondary ip entry ...
- 2017-12-01 00:02:34,170 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) Removed nic id=85837
- 2017-12-01 00:02:34,171 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) Revoving nic secondary ip entry ...
- 2017-12-01 00:02:34,171 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) Cleaning up hypervisor data structures (ex. SRs in XenServer) for managed storage
- 2017-12-01 00:02:34,172 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Removed nic id=85840
- 2017-12-01 00:02:34,173 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Revoving nic secondary ip entry ...
- 2017-12-01 00:02:34,173 DEBUG [o.a.c.e.o.VolumeOrchestrator] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) Cleaning storage for vm: 24525
- 2017-12-01 00:02:34,180 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Removed nic id=85841
- 2017-12-01 00:02:34,181 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Revoving nic secondary ip entry ...
- 2017-12-01 00:02:34,181 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Cleaning up hypervisor data structures (ex. SRs in XenServer) for managed storage
- 2017-12-01 00:02:34,183 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) Expunge volume with no data store specified
- 2017-12-01 00:02:34,183 DEBUG [o.a.c.e.o.VolumeOrchestrator] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Cleaning storage for vm: 24526
- 2017-12-01 00:02:34,185 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) Volume 24525 is not referred anywhere, remove it from volumes table
- 2017-12-01 00:02:34,190 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) Expunged VM[ConsoleProxy|v-24525-VM]
- 2017-12-01 00:02:34,193 INFO [o.a.c.s.v.VolumeServiceImpl] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Expunge volume with no data store specified
- 2017-12-01 00:02:34,194 INFO [o.a.c.s.v.VolumeServiceImpl] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Volume 24526 is not referred anywhere, remove it from volumes table
- 2017-12-01 00:02:34,195 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) received console proxy alert
- 2017-12-01 00:02:34,195 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) Console proxy creation failure, zone: Zone-Orion
- 2017-12-01 00:02:34,196 WARN [o.a.c.alerts] (consoleproxy-1:ctx-14a9f103) (logid:5ce5c76f) alertType:: 10 // dataCenterId:: 1 // podId:: null // clusterId:: null // message:: Console proxy creation failure. zone: Zone-Orion, error details: null
- 2017-12-01 00:02:34,202 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Expunged VM[SecondaryStorageVm|s-24526-VM]
- 2017-12-01 00:02:34,205 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) received secondary storage vm alert
- 2017-12-01 00:02:34,205 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Secondary Storage Vm creation failure, zone: Zone-Orion
- 2017-12-01 00:02:34,206 WARN [o.a.c.alerts] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) alertType:: 19 // dataCenterId:: 1 // podId:: null // clusterId:: null // message:: Secondary Storage Vm creation failure. zone: Zone-Orion, error details: null
- 2017-12-01 00:02:34,209 INFO [o.a.c.s.PremiumSecondaryStorageManagerImpl] (secstorage-1:ctx-1d3acba5) (logid:30adfe40) Primary secondary storage is not even started, wait until next turn
- 2017-12-01 00:02:38,374 DEBUG [c.c.s.StatsCollector] (StatsCollector-5:ctx-5a8d12e7) (logid:1a825310) AutoScaling Monitor is running...
- 2017-12-01 00:02:44,104 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-65902106) (logid:34358bde) Begin cleanup expired async-jobs
- 2017-12-01 00:02:44,108 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-65902106) (logid:34358bde) End cleanup expired async-jobs
- 2017-12-01 00:02:52,036 DEBUG [c.c.s.StatsCollector] (StatsCollector-4:ctx-84ec1561) (logid:2bd3dea3) StorageCollector is running...
- 2017-12-01 00:02:52,041 DEBUG [c.c.s.StatsCollector] (StatsCollector-4:ctx-84ec1561) (logid:2bd3dea3) There is no secondary storage VM for secondary storage host secondary
- 2017-12-01 00:02:52,042 DEBUG [c.c.h.o.r.Ovm3HypervisorGuru] (StatsCollector-4:ctx-84ec1561) (logid:2bd3dea3) getCommandHostDelegation: class com.cloud.agent.api.GetStorageStatsCommand
- 2017-12-01 00:02:52,042 DEBUG [c.c.h.XenServerGuru] (StatsCollector-4:ctx-84ec1561) (logid:2bd3dea3) getCommandHostDelegation: class com.cloud.agent.api.GetStorageStatsCommand
- 2017-12-01 00:02:52,043 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-84:ctx-0000b415) (logid:bc7f5bb2) Seq 1-3458483038843866941: Executing request
- 2017-12-01 00:02:52,170 DEBUG [c.c.h.v.r.VmwareResource] (DirectAgent-84:ctx-0000b415 r6-l06-esx01.cisco.com, cmd: GetStorageStatsCommand) (logid:2bd3dea3) Datastore summary info, storageId: 260fa543-e292-4f78-820c-dae49505e528, localPath: datastore-2475, poolType: VMFS, capacity: 1751809785856, free: 1750779035648, used: 1030750208
- 2017-12-01 00:02:52,170 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-84:ctx-0000b415) (logid:2bd3dea3) Seq 1-3458483038843866941: Response Received:
- 2017-12-01 00:02:52,170 DEBUG [c.c.a.t.Request] (StatsCollector-4:ctx-84ec1561) (logid:2bd3dea3) Seq 1-3458483038843866941: Received: { Ans: , MgmtId: 345052167237, via: 1(r6-l06-esx01.cisco.com), Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
- 2017-12-01 00:02:52,171 DEBUG [c.c.h.o.r.Ovm3HypervisorGuru] (StatsCollector-4:ctx-84ec1561) (logid:2bd3dea3) getCommandHostDelegation: class com.cloud.agent.api.GetStorageStatsCommand
- 2017-12-01 00:02:52,171 DEBUG [c.c.h.XenServerGuru] (StatsCollector-4:ctx-84ec1561) (logid:2bd3dea3) getCommandHostDelegation: class com.cloud.agent.api.GetStorageStatsCommand
- 2017-12-01 00:02:52,172 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-335:ctx-84f09b2f) (logid:acae3053) Seq 1-3458483038843866942: Executing request
- 2017-12-01 00:02:52,285 DEBUG [c.c.h.v.r.VmwareResource] (DirectAgent-335:ctx-84f09b2f r6-l06-esx01.cisco.com, cmd: GetStorageStatsCommand) (logid:2bd3dea3) Datastore summary info, storageId: 09198288-c7af-4569-9202-4616ec2b0b92, localPath: datastore-2476, poolType: VMFS, capacity: 137975824384, free: 47294971904, used: 90680852480
- 2017-12-01 00:02:52,285 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-335:ctx-84f09b2f) (logid:2bd3dea3) Seq 1-3458483038843866942: Response Received:
- 2017-12-01 00:02:52,285 DEBUG [c.c.a.t.Request] (StatsCollector-4:ctx-84ec1561) (logid:2bd3dea3) Seq 1-3458483038843866942: Received: { Ans: , MgmtId: 345052167237, via: 1(r6-l06-esx01.cisco.com), Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
- 2017-12-01 00:02:54,104 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-273ca88c) (logid:1892daf0) Begin cleanup expired async-jobs
- 2017-12-01 00:02:54,108 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-273ca88c) (logid:1892daf0) End cleanup expired async-jobs
- 2017-12-01 00:02:54,338 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-c0e92a4a) (logid:7c07399f) Found 0 routers to update status.
- 2017-12-01 00:02:54,339 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-c0e92a4a) (logid:7c07399f) Found 0 VPC networks to update Redundant State.
- 2017-12-01 00:02:54,340 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-c0e92a4a) (logid:7c07399f) Found 0 networks to update RvR status.
- 2017-12-01 00:02:59,354 DEBUG [o.a.c.f.j.d.VmWorkJobDaoImpl] (Vm-Operations-Cleanup-1:ctx-07692899) (logid:d17f6b6d) Expunge completed work job-73232
- 2017-12-01 00:02:59,357 DEBUG [o.a.c.f.j.d.VmWorkJobDaoImpl] (Vm-Operations-Cleanup-1:ctx-07692899) (logid:d17f6b6d) Expunge completed work job-73233
- 2017-12-01 00:02:59,360 DEBUG [o.a.c.f.j.d.VmWorkJobDaoImpl] (Vm-Operations-Cleanup-1:ctx-07692899) (logid:d17f6b6d) Expunge completed work job-73234
- 2017-12-01 00:02:59,363 DEBUG [o.a.c.f.j.d.VmWorkJobDaoImpl] (Vm-Operations-Cleanup-1:ctx-07692899) (logid:d17f6b6d) Expunge completed work job-73235
- 2017-12-01 00:02:59,366 DEBUG [o.a.c.f.j.d.VmWorkJobDaoImpl] (Vm-Operations-Cleanup-1:ctx-07692899) (logid:d17f6b6d) Expunge completed work job-73236
- 2017-12-01 00:02:59,370 DEBUG [o.a.c.f.j.d.VmWorkJobDaoImpl] (Vm-Operations-Cleanup-1:ctx-07692899) (logid:d17f6b6d) Expunge completed work job-73237
- 2017-12-01 00:03:00,238 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) Zone 1 is ready to launch console proxy
- 2017-12-01 00:03:00,238 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) Expand console proxy standby capacity for zone Zone-Orion
- 2017-12-01 00:03:00,238 INFO [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) No stopped console proxy is available, need to allocate a new console proxy
- 2017-12-01 00:03:00,239 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) Assign console proxy from a newly started instance for request from data center : 1
- 2017-12-01 00:03:00,248 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) Found existing network configuration for offering [Network Offering [1-Public-System-Public-Network]: Ntwk[200|Public|1]
- 2017-12-01 00:03:00,248 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
- 2017-12-01 00:03:00,252 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) Found existing network configuration for offering [Network Offering [3-Control-System-Control-Network]: Ntwk[202|Control|3]
- 2017-12-01 00:03:00,252 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
- 2017-12-01 00:03:00,257 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) Found existing network configuration for offering [Network Offering [2-Management-System-Management-Network]: Ntwk[201|Management|2]
- 2017-12-01 00:03:00,257 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
- 2017-12-01 00:03:00,266 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) Allocating entries for VM: VM[ConsoleProxy|v-24527-VM]
- 2017-12-01 00:03:00,267 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) Allocating nics for VM[ConsoleProxy|v-24527-VM]
- 2017-12-01 00:03:00,268 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) Allocating nic for vm VM[ConsoleProxy|v-24527-VM] in network Ntwk[200|Public|1] with requested profile NicProfile[0-0-null-null-null
- 2017-12-01 00:03:00,278 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) Allocating nic for vm VM[ConsoleProxy|v-24527-VM] in network Ntwk[202|Control|3] with requested profile null
- 2017-12-01 00:03:00,284 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) Allocating nic for vm VM[ConsoleProxy|v-24527-VM] in network Ntwk[201|Management|2] with requested profile null
- 2017-12-01 00:03:00,288 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) Allocating disks for VM[ConsoleProxy|v-24527-VM]
- 2017-12-01 00:03:00,291 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) Allocation completed for VM: VM[ConsoleProxy|v-24527-VM]
- 2017-12-01 00:03:00,293 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) received console proxy alert
- 2017-12-01 00:03:00,293 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) New console proxy created, zone: Zone-Orion, proxy: v-24527-VM, public IP: null, private IP: null
- 2017-12-01 00:03:00,301 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) Sync job-73598 execution on object VmWorkJobQueue.24527
- 2017-12-01 00:03:00,356 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-63eab848) (logid:5a929269) Zone 1 is ready to launch secondary storage VM
- 2017-12-01 00:03:00,357 INFO [o.a.c.s.PremiumSecondaryStorageManagerImpl] (secstorage-1:ctx-63eab848) (logid:5a929269) No running secondary storage vms found in datacenter id=1, starting one
- 2017-12-01 00:03:00,359 INFO [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-63eab848) (logid:5a929269) No stopped secondary storage vm is available, need to allocate a new secondary storage vm
- 2017-12-01 00:03:00,360 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-63eab848) (logid:5a929269) Assign secondary storage vm from a newly started instance for request from data center : 1
- 2017-12-01 00:03:00,367 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-63eab848) (logid:5a929269) Found existing network configuration for offering [Network Offering [1-Public-System-Public-Network]: Ntwk[200|Public|1]
- 2017-12-01 00:03:00,367 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-63eab848) (logid:5a929269) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
- 2017-12-01 00:03:00,372 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-63eab848) (logid:5a929269) Found existing network configuration for offering [Network Offering [3-Control-System-Control-Network]: Ntwk[202|Control|3]
- 2017-12-01 00:03:00,372 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-63eab848) (logid:5a929269) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
- 2017-12-01 00:03:00,377 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-63eab848) (logid:5a929269) Found existing network configuration for offering [Network Offering [2-Management-System-Management-Network]: Ntwk[201|Management|2]
- 2017-12-01 00:03:00,377 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-63eab848) (logid:5a929269) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
- 2017-12-01 00:03:00,382 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-63eab848) (logid:5a929269) Found existing network configuration for offering [Network Offering [4-Storage-System-Storage-Network]: Ntwk[203|Storage|4]
- 2017-12-01 00:03:00,382 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-63eab848) (logid:5a929269) Releasing lock for Acct[f967690d-cae6-11e7-89d8-005056b63c45-system]
- 2017-12-01 00:03:00,393 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-63eab848) (logid:5a929269) Allocating entries for VM: VM[SecondaryStorageVm|s-24528-VM]
- 2017-12-01 00:03:00,394 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-63eab848) (logid:5a929269) Allocating nics for VM[SecondaryStorageVm|s-24528-VM]
- 2017-12-01 00:03:00,395 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-63eab848) (logid:5a929269) Allocating nic for vm VM[SecondaryStorageVm|s-24528-VM] in network Ntwk[200|Public|1] with requested profile NicProfile[0-0-null-null-null
- 2017-12-01 00:03:00,404 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-63eab848) (logid:5a929269) Allocating nic for vm VM[SecondaryStorageVm|s-24528-VM] in network Ntwk[202|Control|3] with requested profile null
- 2017-12-01 00:03:00,410 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-63eab848) (logid:5a929269) Allocating nic for vm VM[SecondaryStorageVm|s-24528-VM] in network Ntwk[201|Management|2] with requested profile null
- 2017-12-01 00:03:00,414 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-63eab848) (logid:5a929269) Allocating nic for vm VM[SecondaryStorageVm|s-24528-VM] in network Ntwk[203|Storage|4] with requested profile null
- 2017-12-01 00:03:00,417 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-63eab848) (logid:5a929269) Allocating disks for VM[SecondaryStorageVm|s-24528-VM]
- 2017-12-01 00:03:00,421 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-63eab848) (logid:5a929269) Allocation completed for VM: VM[SecondaryStorageVm|s-24528-VM]
- 2017-12-01 00:03:00,423 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-63eab848) (logid:5a929269) received secondary storage vm alert
- 2017-12-01 00:03:00,423 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-63eab848) (logid:5a929269) New secondary storage vm created, zone: Zone-Orion, secStorageVm: s-24528-VM, public IP: null, private IP: null
- 2017-12-01 00:03:00,431 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (secstorage-1:ctx-63eab848) (logid:5a929269) Sync job-73599 execution on object VmWorkJobQueue.24528
- 2017-12-01 00:03:02,106 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-10d7a5fb) (logid:58301089) Execute sync-queue item: SyncQueueItemVO {id:73580, queueId: 73580, contentType: AsyncJob, contentId: 73598, lastProcessMsid: 345052167237, lastprocessNumber: 1, lastProcessTime: Fri Dec 01 00:03:02 CST 2017, created: Fri Dec 01 00:03:00 CST 2017}
- 2017-12-01 00:03:02,107 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-10d7a5fb) (logid:58301089) Schedule queued job-73598
- 2017-12-01 00:03:02,109 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-10d7a5fb) (logid:58301089) Execute sync-queue item: SyncQueueItemVO {id:73581, queueId: 73581, contentType: AsyncJob, contentId: 73599, lastProcessMsid: 345052167237, lastprocessNumber: 1, lastProcessTime: Fri Dec 01 00:03:02 CST 2017, created: Fri Dec 01 00:03:00 CST 2017}
- 2017-12-01 00:03:02,110 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-10d7a5fb) (logid:58301089) Schedule queued job-73599
- 2017-12-01 00:03:02,110 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598) (logid:d0217a89) Add job-73598 into job monitoring
- 2017-12-01 00:03:02,113 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599) (logid:b1e233db) Add job-73599 into job monitoring
- 2017-12-01 00:03:02,117 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598) (logid:a98dfed6) Executing AsyncJobVO {id:73598, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfz3QAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:03:00 CST 2017}
- 2017-12-01 00:03:02,117 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598) (logid:a98dfed6) Run VM work job: com.cloud.vm.VmWorkStart for VM 24527, job origin: 1
- 2017-12-01 00:03:02,118 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) Execute VM work job: com.cloud.vm.VmWorkStart{"dcId":0,"userId":1,"accountId":1,"vmId":24527,"handlerName":"VirtualMachineManagerImpl"}
- 2017-12-01 00:03:02,119 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599) (logid:32b654cc) Executing AsyncJobVO {id:73599, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABf0HQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:03:00 CST 2017}
- 2017-12-01 00:03:02,119 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599) (logid:32b654cc) Run VM work job: com.cloud.vm.VmWorkStart for VM 24528, job origin: 2
- 2017-12-01 00:03:02,122 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) Execute VM work job: com.cloud.vm.VmWorkStart{"dcId":0,"userId":1,"accountId":1,"vmId":24528,"handlerName":"VirtualMachineManagerImpl"}
- 2017-12-01 00:03:02,124 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
- 2017-12-01 00:03:02,124 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) Successfully transitioned to start state for VM[ConsoleProxy|v-24527-VM] reservation id = 96c52f47-3a97-48d9-b0b4-9e12a04f930e
- 2017-12-01 00:03:02,125 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) Trying to deploy VM, vm has dcId: 1 and podId: null
- 2017-12-01 00:03:02,125 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) Deploy avoids pods: null, clusters: null, hosts: null
- 2017-12-01 00:03:02,128 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
- 2017-12-01 00:03:02,128 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) Successfully transitioned to start state for VM[SecondaryStorageVm|s-24528-VM] reservation id = 31208475-b540-46fc-adcc-478e7c960b87
- 2017-12-01 00:03:02,128 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) Deploy avoids pods: null, clusters: null, hosts: null
- 2017-12-01 00:03:02,129 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@eecdd04
- 2017-12-01 00:03:02,129 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) Trying to allocate a host and storage pools from dc:1, pod:null,cluster:null, requested cpu: 500, requested ram: 1073741824
- 2017-12-01 00:03:02,129 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) Is ROOT volume READY (pool already allocated)?: No
- 2017-12-01 00:03:02,129 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) Searching all possible resources under this Zone: 1
- 2017-12-01 00:03:02,129 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) Trying to deploy VM, vm has dcId: 1 and podId: null
- 2017-12-01 00:03:02,129 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) Deploy avoids pods: null, clusters: null, hosts: null
- 2017-12-01 00:03:02,129 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
- 2017-12-01 00:03:02,132 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) Deploy avoids pods: null, clusters: null, hosts: null
- 2017-12-01 00:03:02,133 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@eecdd04
- 2017-12-01 00:03:02,133 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) Trying to allocate a host and storage pools from dc:1, pod:null,cluster:null, requested cpu: 500, requested ram: 536870912
- 2017-12-01 00:03:02,133 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) Is ROOT volume READY (pool already allocated)?: No
- 2017-12-01 00:03:02,133 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) Searching all possible resources under this Zone: 1
- 2017-12-01 00:03:02,133 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
- 2017-12-01 00:03:02,138 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) Checking resources in Cluster: 1 under Pod: 1
- 2017-12-01 00:03:02,138 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9 FirstFitRoutingAllocator) (logid:a98dfed6) Looking for hosts in dc: 1 pod:1 cluster:1
- 2017-12-01 00:03:02,140 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9 FirstFitRoutingAllocator) (logid:a98dfed6) FirstFitAllocator has 1 hosts to check for allocation: [Host[-1-Routing]]
- 2017-12-01 00:03:02,142 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) Checking resources in Cluster: 1 under Pod: 1
- 2017-12-01 00:03:02,142 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252 FirstFitRoutingAllocator) (logid:32b654cc) Looking for hosts in dc: 1 pod:1 cluster:1
- 2017-12-01 00:03:02,143 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9 FirstFitRoutingAllocator) (logid:a98dfed6) Found 1 hosts for allocation after prioritization: [Host[-1-Routing]]
- 2017-12-01 00:03:02,143 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252 FirstFitRoutingAllocator) (logid:32b654cc) FirstFitAllocator has 1 hosts to check for allocation: [Host[-1-Routing]]
- 2017-12-01 00:03:02,143 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9 FirstFitRoutingAllocator) (logid:a98dfed6) Looking for speed=500Mhz, Ram=1024
- 2017-12-01 00:03:02,147 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252 FirstFitRoutingAllocator) (logid:32b654cc) Found 1 hosts for allocation after prioritization: [Host[-1-Routing]]
- 2017-12-01 00:03:02,147 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252 FirstFitRoutingAllocator) (logid:32b654cc) Looking for speed=500Mhz, Ram=512
- 2017-12-01 00:03:02,149 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9 FirstFitRoutingAllocator) (logid:a98dfed6) Host: 1 has cpu capability (cpu:16, speed:2533) to support requested CPU: 1 and requested speed: 500
- 2017-12-01 00:03:02,149 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9 FirstFitRoutingAllocator) (logid:a98dfed6) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
- 2017-12-01 00:03:02,150 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9 FirstFitRoutingAllocator) (logid:a98dfed6) Hosts's actual total CPU: 40528 and CPU after applying overprovisioning: 40528
- 2017-12-01 00:03:02,150 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9 FirstFitRoutingAllocator) (logid:a98dfed6) Free CPU: 40528 , Requested CPU: 500
- 2017-12-01 00:03:02,150 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9 FirstFitRoutingAllocator) (logid:a98dfed6) Free RAM: 42880884736 , Requested RAM: 1073741824
- 2017-12-01 00:03:02,150 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9 FirstFitRoutingAllocator) (logid:a98dfed6) Host has enough CPU and RAM available
- 2017-12-01 00:03:02,150 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9 FirstFitRoutingAllocator) (logid:a98dfed6) STATS: Can alloc CPU from host: 1, used: 0, reserved: 0, actual total: 40528, total with overprovisioning: 40528; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
- 2017-12-01 00:03:02,150 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9 FirstFitRoutingAllocator) (logid:a98dfed6) STATS: Can alloc MEM from host: 1, used: 0, reserved: 0, total: 42880884736; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
- 2017-12-01 00:03:02,150 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9 FirstFitRoutingAllocator) (logid:a98dfed6) Found a suitable host, adding to list: 1
- 2017-12-01 00:03:02,150 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9 FirstFitRoutingAllocator) (logid:a98dfed6) Host Allocator returning 1 suitable hosts
- 2017-12-01 00:03:02,152 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252 FirstFitRoutingAllocator) (logid:32b654cc) Host: 1 has cpu capability (cpu:16, speed:2533) to support requested CPU: 1 and requested speed: 500
- 2017-12-01 00:03:02,152 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252 FirstFitRoutingAllocator) (logid:32b654cc) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 536870912 , cpuOverprovisioningFactor: 1.0
- 2017-12-01 00:03:02,152 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) Checking suitable pools for volume (Id, Type): (24527,ROOT)
- 2017-12-01 00:03:02,152 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) We need to allocate new storagepool for this volume
- 2017-12-01 00:03:02,153 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) Calling StoragePoolAllocators to find suitable pools
- 2017-12-01 00:03:02,153 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252 FirstFitRoutingAllocator) (logid:32b654cc) Hosts's actual total CPU: 40528 and CPU after applying overprovisioning: 40528
- 2017-12-01 00:03:02,153 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252 FirstFitRoutingAllocator) (logid:32b654cc) Free CPU: 40528 , Requested CPU: 500
- 2017-12-01 00:03:02,153 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252 FirstFitRoutingAllocator) (logid:32b654cc) Free RAM: 42880884736 , Requested RAM: 536870912
- 2017-12-01 00:03:02,153 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252 FirstFitRoutingAllocator) (logid:32b654cc) Host has enough CPU and RAM available
- 2017-12-01 00:03:02,153 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252 FirstFitRoutingAllocator) (logid:32b654cc) STATS: Can alloc CPU from host: 1, used: 0, reserved: 0, actual total: 40528, total with overprovisioning: 40528; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
- 2017-12-01 00:03:02,153 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252 FirstFitRoutingAllocator) (logid:32b654cc) STATS: Can alloc MEM from host: 1, used: 0, reserved: 0, total: 42880884736; requested mem: 536870912,alloc_from_last_host?:false ,considerReservedCapacity?: true
- 2017-12-01 00:03:02,153 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252 FirstFitRoutingAllocator) (logid:32b654cc) Found a suitable host, adding to list: 1
- 2017-12-01 00:03:02,153 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252 FirstFitRoutingAllocator) (logid:32b654cc) Host Allocator returning 1 suitable hosts
- 2017-12-01 00:03:02,154 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) System VMs will use shared storage for zone id=1
- 2017-12-01 00:03:02,154 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) LocalStoragePoolAllocator trying to find storage pool to fit the vm
- 2017-12-01 00:03:02,154 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) ClusterScopeStoragePoolAllocator looking for storage pool
- 2017-12-01 00:03:02,154 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) Looking for pools in dc: 1 pod:1 cluster:1. Disabled pools will be ignored.
- 2017-12-01 00:03:02,154 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) Found pools matching tags: []
- 2017-12-01 00:03:02,154 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) No storage pools available for shared volume allocation, returning
- 2017-12-01 00:03:02,154 DEBUG [o.a.c.s.a.ZoneWideStoragePoolAllocator] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) ZoneWideStoragePoolAllocator to find storage pool
- 2017-12-01 00:03:02,155 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) Checking suitable pools for volume (Id, Type): (24528,ROOT)
- 2017-12-01 00:03:02,155 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) We need to allocate new storagepool for this volume
- 2017-12-01 00:03:02,155 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) No suitable pools found for volume: Vol[24527|vm=24527|ROOT] under cluster: 1
- 2017-12-01 00:03:02,155 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) No suitable pools found
- 2017-12-01 00:03:02,155 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) No suitable storagePools found under this Cluster: 1
- 2017-12-01 00:03:02,156 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) Calling StoragePoolAllocators to find suitable pools
- 2017-12-01 00:03:02,156 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) Could not find suitable Deployment Destination for this VM under any clusters, returning.
- 2017-12-01 00:03:02,156 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) Searching all possible resources under this Zone: 1
- 2017-12-01 00:03:02,156 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
- 2017-12-01 00:03:02,157 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) System VMs will use shared storage for zone id=1
- 2017-12-01 00:03:02,157 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) LocalStoragePoolAllocator trying to find storage pool to fit the vm
- 2017-12-01 00:03:02,157 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) ClusterScopeStoragePoolAllocator looking for storage pool
- 2017-12-01 00:03:02,157 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) Looking for pools in dc: 1 pod:1 cluster:1. Disabled pools will be ignored.
- 2017-12-01 00:03:02,157 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) Found pools matching tags: []
- 2017-12-01 00:03:02,157 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) No storage pools available for shared volume allocation, returning
- 2017-12-01 00:03:02,157 DEBUG [o.a.c.s.a.ZoneWideStoragePoolAllocator] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) ZoneWideStoragePoolAllocator to find storage pool
- 2017-12-01 00:03:02,157 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) Removing from the clusterId list these clusters from avoid set: [1]
- 2017-12-01 00:03:02,158 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) No clusters found after removing disabled clusters and clusters in avoid list, returning.
- 2017-12-01 00:03:02,158 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) No suitable pools found for volume: Vol[24528|vm=24528|ROOT] under cluster: 1
- 2017-12-01 00:03:02,158 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) No suitable pools found
- 2017-12-01 00:03:02,158 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) No suitable storagePools found under this Cluster: 1
- 2017-12-01 00:03:02,159 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) Could not find suitable Deployment Destination for this VM under any clusters, returning.
- 2017-12-01 00:03:02,159 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) Searching all possible resources under this Zone: 1
- 2017-12-01 00:03:02,159 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
- 2017-12-01 00:03:02,160 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) Removing from the clusterId list these clusters from avoid set: [1]
- 2017-12-01 00:03:02,161 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) No clusters found after removing disabled clusters and clusters in avoid list, returning.
- 2017-12-01 00:03:02,165 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
- 2017-12-01 00:03:02,165 ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) Invocation exception, caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24527-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- 2017-12-01 00:03:02,165 INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598 ctx-e4efb0a9) (logid:a98dfed6) Rethrow exception com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24527-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- 2017-12-01 00:03:02,165 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598) (logid:a98dfed6) Done with run of VM work job: com.cloud.vm.VmWorkStart for VM 24527, job origin: 1
- 2017-12-01 00:03:02,165 ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598) (logid:a98dfed6) Unable to complete AsyncJobVO {id:73598, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfz3QAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:03:00 CST 2017}, job origin:1
- com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24527-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
- at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
- at java.lang.reflect.Method.invoke(Method.java:498)
- at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
- at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
- at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
- at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
- at java.util.concurrent.FutureTask.run(FutureTask.java:266)
- at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
- at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
- at java.lang.Thread.run(Thread.java:748)
- 2017-12-01 00:03:02,166 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598) (logid:a98dfed6) Complete async job-73598, jobStatus: FAILED, resultCode: 0, result: rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdAA9VW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW0NvbnNvbGVQcm94eXx2LTI0NTI3LVZNXXVyAB5bTGphdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudDsCRio8PP0iOQIAAHhwAAAAFHNyABtqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnRhCcWaJjbdhQIABEkACmxpbmVOdW1iZXJMAA5kZWNsYXJpbmdDbGFzc3EAfgAKTAAIZmlsZU5hbWVxAH4ACkwACm1ldGhvZE5hbWVxAH4ACnhwAAADwHQAJmNvbS5jbG91ZC52bS5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsdAAeVmlydHVhbE1hY2hpbmVNYW5hZ2VySW1wbC5qYXZhdAAQb3JjaGVzdHJhdGVTdGFydHNxAH4AEQAAEgtxAH4AE3EAfgAUcQB-ABVzcQB-ABH_____dAAmc3VuLnJlZmxlY3QuR2VuZXJhdGVkTWV0aG9kQWNjZXNzb3IxOTlwdAAGaW52b2tlc3EAfgARAAAAK3QAKHN1bi5yZWZsZWN0LkRlbGVnYXRpbmdNZXRob2RBY2Nlc3NvckltcGx0ACFEZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsLmphdmFxAH4AGXNxAH4AEQAAAfJ0ABhqYXZhLmxhbmcucmVmbGVjdC5NZXRob2R0AAtNZXRob2QuamF2YXEAfgAZc3EAfgARAAAAa3QAImNvbS5jbG91ZC52bS5WbVdvcmtKb2JIYW5kbGVyUHJveHl0ABpWbVdvcmtKb2JIYW5kbGVyUHJveHkuamF2YXQAD2hhbmRsZVZtV29ya0pvYnNxAH4AEQAAEqxxAH4AE3EAfgAUcQB-ACNzcQB-ABEAAABmdAAgY29tLmNsb3VkLnZtLlZtV29ya0pvYkRpc3BhdGNoZXJ0ABhWbVdvcmtKb2JEaXNwYXRjaGVyLmphdmF0AAZydW5Kb2JzcQB-ABEAAAIqdAA_b3JnLmFwYWNoZS5jbG91ZHN0YWNrLmZyYW1ld29yay5qb2JzLmltcGwuQXN5bmNKb2JNYW5hZ2VySW1wbCQ1dAAYQXN5bmNKb2JNYW5hZ2VySW1wbC5qYXZhdAAMcnVuSW5Db250ZXh0c3EAfgARAAAAMXQAPm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZSQxdAAbTWFuYWdlZENvbnRleHRSdW5uYWJsZS5qYXZhdAADcnVuc3EAfgARAAAAOHQAQm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5EZWZhdWx0TWFuYWdlZENvbnRleHQkMXQAGkRlZmF1bHRNYW5hZ2VkQ29udGV4dC5qYXZhdAAEY2FsbHNxAH4AEQAAAGd0AEBvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0cQB-ADN0AA9jYWxsV2l0aENvbnRleHRzcQB-ABEAAAA1cQB-ADZxAH4AM3QADnJ1bldpdGhDb250ZXh0c3EAfgARAAAALnQAPG9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZXEAfgAvcQB-ADBzcQB-ABEAAAH2cQB-ACpxAH4AK3EAfgAwc3EAfgARAAAB_3QALmphdmEudXRpbC5jb25jdXJyZW50LkV4ZWN1dG9ycyRSdW5uYWJsZUFkYXB0ZXJ0AA5FeGVjdXRvcnMuamF2YXEAfgA0c3EAfgARAAABCnQAH2phdmEudXRpbC5jb25jdXJyZW50LkZ1dHVyZVRhc2t0AA9GdXR1cmVUYXNrLmphdmFxAH4AMHNxAH4AEQAABH10ACdqYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3J0ABdUaHJlYWRQb29sRXhlY3V0b3IuamF2YXQACXJ1bldvcmtlcnNxAH4AEQAAAnB0AC5qYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3IkV29ya2VycQB-AEVxAH4AMHNxAH4AEQAAAux0ABBqYXZhLmxhbmcuVGhyZWFkdAALVGhyZWFkLmphdmFxAH4AMHNyACZqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlTGlzdPwPJTG17I4QAgABTAAEbGlzdHEAfgAMeHIALGphdmEudXRpbC5Db2xsZWN0aW9ucyRVbm1vZGlmaWFibGVDb2xsZWN0aW9uGUIAgMte9x4CAAFMAAFjdAAWTGphdmEvdXRpbC9Db2xsZWN0aW9uO3hwc3IAE2phdmEudXRpbC5BcnJheUxpc3R4gdIdmcdhnQMAAUkABHNpemV4cAAAAAB3BAAAAAB4cQB-AFF4c3IAEWphdmEubGFuZy5JbnRlZ2VyEuKgpPeBhzgCAAFJAAV2YWx1ZXhyABBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAAB4cAAAEO9zcQB-AFAAAAAAdwQAAAAAeHNyAA5qYXZhLmxhbmcuTG9uZzuL5JDMjyPfAgABSgAFdmFsdWV4cQB-AFMAAAAAAAAAAXZyABdjb20uY2xvdWQuZGMuRGF0YUNlbnRlcrLxCuun53i-AgAAeHAA
- 2017-12-01 00:03:02,166 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598) (logid:a98dfed6) Publish async job-73598 complete on message bus
- 2017-12-01 00:03:02,166 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598) (logid:a98dfed6) Wake up jobs related to job-73598
- 2017-12-01 00:03:02,166 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598) (logid:a98dfed6) Update db status for job-73598
- 2017-12-01 00:03:02,167 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598) (logid:a98dfed6) Wake up jobs joined with job-73598 and disjoin all subjobs created from job- 73598
- 2017-12-01 00:03:02,176 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598) (logid:a98dfed6) Done executing com.cloud.vm.VmWorkStart for job-73598
- 2017-12-01 00:03:02,176 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
- 2017-12-01 00:03:02,176 ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) Invocation exception, caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24528-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- 2017-12-01 00:03:02,176 INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599 ctx-4f1f7252) (logid:32b654cc) Rethrow exception com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24528-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- 2017-12-01 00:03:02,176 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599) (logid:32b654cc) Done with run of VM work job: com.cloud.vm.VmWorkStart for VM 24528, job origin: 2
- 2017-12-01 00:03:02,176 ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599) (logid:32b654cc) Unable to complete AsyncJobVO {id:73599, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABf0HQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:03:00 CST 2017}, job origin:2
- com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24528-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
- at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
- at java.lang.reflect.Method.invoke(Method.java:498)
- at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
- at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
- at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
- at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
- at java.util.concurrent.FutureTask.run(FutureTask.java:266)
- at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
- at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
- at java.lang.Thread.run(Thread.java:748)
- 2017-12-01 00:03:02,177 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599) (logid:32b654cc) Complete async job-73599, jobStatus: FAILED, resultCode: 0, result: rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdABDVW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW1NlY29uZGFyeVN0b3JhZ2VWbXxzLTI0NTI4LVZNXXVyAB5bTGphdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudDsCRio8PP0iOQIAAHhwAAAAFHNyABtqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnRhCcWaJjbdhQIABEkACmxpbmVOdW1iZXJMAA5kZWNsYXJpbmdDbGFzc3EAfgAKTAAIZmlsZU5hbWVxAH4ACkwACm1ldGhvZE5hbWVxAH4ACnhwAAADwHQAJmNvbS5jbG91ZC52bS5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsdAAeVmlydHVhbE1hY2hpbmVNYW5hZ2VySW1wbC5qYXZhdAAQb3JjaGVzdHJhdGVTdGFydHNxAH4AEQAAEgtxAH4AE3EAfgAUcQB-ABVzcQB-ABH_____dAAmc3VuLnJlZmxlY3QuR2VuZXJhdGVkTWV0aG9kQWNjZXNzb3IxOTlwdAAGaW52b2tlc3EAfgARAAAAK3QAKHN1bi5yZWZsZWN0LkRlbGVnYXRpbmdNZXRob2RBY2Nlc3NvckltcGx0ACFEZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsLmphdmFxAH4AGXNxAH4AEQAAAfJ0ABhqYXZhLmxhbmcucmVmbGVjdC5NZXRob2R0AAtNZXRob2QuamF2YXEAfgAZc3EAfgARAAAAa3QAImNvbS5jbG91ZC52bS5WbVdvcmtKb2JIYW5kbGVyUHJveHl0ABpWbVdvcmtKb2JIYW5kbGVyUHJveHkuamF2YXQAD2hhbmRsZVZtV29ya0pvYnNxAH4AEQAAEqxxAH4AE3EAfgAUcQB-ACNzcQB-ABEAAABmdAAgY29tLmNsb3VkLnZtLlZtV29ya0pvYkRpc3BhdGNoZXJ0ABhWbVdvcmtKb2JEaXNwYXRjaGVyLmphdmF0AAZydW5Kb2JzcQB-ABEAAAIqdAA_b3JnLmFwYWNoZS5jbG91ZHN0YWNrLmZyYW1ld29yay5qb2JzLmltcGwuQXN5bmNKb2JNYW5hZ2VySW1wbCQ1dAAYQXN5bmNKb2JNYW5hZ2VySW1wbC5qYXZhdAAMcnVuSW5Db250ZXh0c3EAfgARAAAAMXQAPm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZSQxdAAbTWFuYWdlZENvbnRleHRSdW5uYWJsZS5qYXZhdAADcnVuc3EAfgARAAAAOHQAQm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5EZWZhdWx0TWFuYWdlZENvbnRleHQkMXQAGkRlZmF1bHRNYW5hZ2VkQ29udGV4dC5qYXZhdAAEY2FsbHNxAH4AEQAAAGd0AEBvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0cQB-ADN0AA9jYWxsV2l0aENvbnRleHRzcQB-ABEAAAA1cQB-ADZxAH4AM3QADnJ1bldpdGhDb250ZXh0c3EAfgARAAAALnQAPG9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZXEAfgAvcQB-ADBzcQB-ABEAAAH2cQB-ACpxAH4AK3EAfgAwc3EAfgARAAAB_3QALmphdmEudXRpbC5jb25jdXJyZW50LkV4ZWN1dG9ycyRSdW5uYWJsZUFkYXB0ZXJ0AA5FeGVjdXRvcnMuamF2YXEAfgA0c3EAfgARAAABCnQAH2phdmEudXRpbC5jb25jdXJyZW50LkZ1dHVyZVRhc2t0AA9GdXR1cmVUYXNrLmphdmFxAH4AMHNxAH4AEQAABH10ACdqYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3J0ABdUaHJlYWRQb29sRXhlY3V0b3IuamF2YXQACXJ1bldvcmtlcnNxAH4AEQAAAnB0AC5qYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3IkV29ya2VycQB-AEVxAH4AMHNxAH4AEQAAAux0ABBqYXZhLmxhbmcuVGhyZWFkdAALVGhyZWFkLmphdmFxAH4AMHNyACZqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlTGlzdPwPJTG17I4QAgABTAAEbGlzdHEAfgAMeHIALGphdmEudXRpbC5Db2xsZWN0aW9ucyRVbm1vZGlmaWFibGVDb2xsZWN0aW9uGUIAgMte9x4CAAFMAAFjdAAWTGphdmEvdXRpbC9Db2xsZWN0aW9uO3hwc3IAE2phdmEudXRpbC5BcnJheUxpc3R4gdIdmcdhnQMAAUkABHNpemV4cAAAAAB3BAAAAAB4cQB-AFF4c3IAEWphdmEubGFuZy5JbnRlZ2VyEuKgpPeBhzgCAAFJAAV2YWx1ZXhyABBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAAB4cAAAEO9zcQB-AFAAAAAAdwQAAAAAeHNyAA5qYXZhLmxhbmcuTG9uZzuL5JDMjyPfAgABSgAFdmFsdWV4cQB-AFMAAAAAAAAAAXZyABdjb20uY2xvdWQuZGMuRGF0YUNlbnRlcrLxCuun53i-AgAAeHAA
- 2017-12-01 00:03:02,183 WARN [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) Exception while trying to start console proxy
- com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24527-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
- at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
- at java.lang.reflect.Method.invoke(Method.java:498)
- at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
- at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
- at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
- at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
- at java.util.concurrent.FutureTask.run(FutureTask.java:266)
- at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
- at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
- at java.lang.Thread.run(Thread.java:748)
- 2017-12-01 00:03:02,186 INFO [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) Unable to start console proxy vm for standby capacity, vm id : 24527, will recycle it and start a new one
- 2017-12-01 00:03:02,186 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) received console proxy alert
- 2017-12-01 00:03:02,186 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) Console proxy creation failure, zone: Zone-Orion
- 2017-12-01 00:03:02,186 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599) (logid:32b654cc) Publish async job-73599 complete on message bus
- 2017-12-01 00:03:02,186 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599) (logid:32b654cc) Wake up jobs related to job-73599
- 2017-12-01 00:03:02,186 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599) (logid:32b654cc) Update db status for job-73599
- 2017-12-01 00:03:02,186 WARN [o.a.c.alerts] (consoleproxy-1:ctx-cd3c853a) (logid:7ba1fe15) alertType:: 10 // dataCenterId:: 1 // podId:: null // clusterId:: null // message:: Console proxy creation failure. zone: Zone-Orion, error details: null
- 2017-12-01 00:03:02,187 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599) (logid:32b654cc) Wake up jobs joined with job-73599 and disjoin all subjobs created from job- 73599
- 2017-12-01 00:03:02,188 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-42:ctx-0d799e7d job-1/job-73598) (logid:a98dfed6) Remove job-73598 from job monitoring
- 2017-12-01 00:03:02,195 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599) (logid:32b654cc) Done executing com.cloud.vm.VmWorkStart for job-73599
- 2017-12-01 00:03:02,196 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-43:ctx-214ba3af job-2/job-73599) (logid:32b654cc) Remove job-73599 from job monitoring
- 2017-12-01 00:03:02,201 WARN [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-63eab848) (logid:5a929269) Exception while trying to start secondary storage vm
- com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24528-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
- at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
- at java.lang.reflect.Method.invoke(Method.java:498)
- at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
- at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
- at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
- at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
- at java.util.concurrent.FutureTask.run(FutureTask.java:266)
- at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
- at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
- at java.lang.Thread.run(Thread.java:748)
- 2017-12-01 00:03:02,203 INFO [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-63eab848) (logid:5a929269) Unable to start secondary storage vm for standby capacity, vm id : 24528, will recycle it and start a new one
- 2017-12-01 00:03:02,203 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-63eab848) (logid:5a929269) received secondary storage vm alert
- 2017-12-01 00:03:02,203 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-63eab848) (logid:5a929269) Secondary Storage Vm creation failure, zone: Zone-Orion
- 2017-12-01 00:03:02,204 WARN [o.a.c.alerts] (secstorage-1:ctx-63eab848) (logid:5a929269) alertType:: 19 // dataCenterId:: 1 // podId:: null // clusterId:: null // message:: Secondary Storage Vm creation failure. zone: Zone-Orion, error details: null
- 2017-12-01 00:03:02,209 INFO [o.a.c.s.PremiumSecondaryStorageManagerImpl] (secstorage-1:ctx-63eab848) (logid:5a929269) Primary secondary storage is not even started, wait until next turn
- 2017-12-01 00:03:04,104 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-469b6761) (logid:85962c36) Begin cleanup expired async-jobs
- 2017-12-01 00:03:04,108 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-469b6761) (logid:85962c36) End cleanup expired async-jobs
- 2017-12-01 00:03:14,104 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-2ae0cdd0) (logid:65fa0435) Begin cleanup expired async-jobs
- 2017-12-01 00:03:14,108 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-2ae0cdd0) (logid:65fa0435) End cleanup expired async-jobs
- 2017-12-01 00:03:15,766 DEBUG [c.c.s.StatsCollector] (StatsCollector-2:ctx-e7b2657e) (logid:17ac8a41) HostStatsCollector is running...
- 2017-12-01 00:03:15,772 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-168:ctx-6f9bd7da) (logid:c92362ee) Seq 1-3458483038843866943: Executing request
- 2017-12-01 00:03:15,902 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-168:ctx-6f9bd7da) (logid:17ac8a41) Seq 1-3458483038843866943: Response Received:
- 2017-12-01 00:03:15,902 DEBUG [c.c.a.t.Request] (StatsCollector-2:ctx-e7b2657e) (logid:17ac8a41) Seq 1-3458483038843866943: Received: { Ans: , MgmtId: 345052167237, via: 1(r6-l06-esx01.cisco.com), Ver: v1, Flags: 10, { GetHostStatsAnswer } }
- 2017-12-01 00:03:24,104 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-5f8d89aa) (logid:ea14d3c2) Begin cleanup expired async-jobs
- 2017-12-01 00:03:24,108 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-5f8d89aa) (logid:ea14d3c2) End cleanup expired async-jobs
- 2017-12-01 00:03:24,338 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-e407e1d1) (logid:46daa6e6) Found 0 routers to update status.
- 2017-12-01 00:03:24,339 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-e407e1d1) (logid:46daa6e6) Found 0 VPC networks to update Redundant State.
- 2017-12-01 00:03:24,339 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-e407e1d1) (logid:46daa6e6) Found 0 networks to update RvR status.
- 2017-12-01 00:03:30,238 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-c3994110) (logid:d0865f01) Zone 1 is ready to launch console proxy
- 2017-12-01 00:03:30,238 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-c3994110) (logid:d0865f01) Expand console proxy standby capacity for zone Zone-Orion
- 2017-12-01 00:03:30,239 INFO [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-c3994110) (logid:d0865f01) Found a stopped console proxy, starting it. Vm id : 24527
- 2017-12-01 00:03:30,245 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (consoleproxy-1:ctx-c3994110) (logid:d0865f01) Sync job-73600 execution on object VmWorkJobQueue.24527
- 2017-12-01 00:03:30,355 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-11936d05) (logid:5925c756) Zone 1 is ready to launch secondary storage VM
- 2017-12-01 00:03:30,357 INFO [o.a.c.s.PremiumSecondaryStorageManagerImpl] (secstorage-1:ctx-11936d05) (logid:5925c756) No running secondary storage vms found in datacenter id=1, starting one
- 2017-12-01 00:03:30,359 INFO [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-11936d05) (logid:5925c756) Found a stopped secondary storage vm, starting it. Vm id : 24528
- 2017-12-01 00:03:30,365 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (secstorage-1:ctx-11936d05) (logid:5925c756) Sync job-73601 execution on object VmWorkJobQueue.24528
- 2017-12-01 00:03:31,133 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-728b60b5) (logid:2f37a48f) Resetting hosts suitable for reconnect
- 2017-12-01 00:03:31,134 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-728b60b5) (logid:2f37a48f) Completed resetting hosts suitable for reconnect
- 2017-12-01 00:03:31,134 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-728b60b5) (logid:2f37a48f) Acquiring hosts for clusters already owned by this management server
- 2017-12-01 00:03:31,135 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-728b60b5) (logid:2f37a48f) Completed acquiring hosts for clusters already owned by this management server
- 2017-12-01 00:03:31,135 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-728b60b5) (logid:2f37a48f) Acquiring hosts for clusters not owned by any management server
- 2017-12-01 00:03:31,135 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-728b60b5) (logid:2f37a48f) Completed acquiring hosts for clusters not owned by any management server
- 2017-12-01 00:03:32,106 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-b4a725e7) (logid:d6fc7ed1) Execute sync-queue item: SyncQueueItemVO {id:73582, queueId: 73580, contentType: AsyncJob, contentId: 73600, lastProcessMsid: 345052167237, lastprocessNumber: 2, lastProcessTime: Fri Dec 01 00:03:32 CST 2017, created: Fri Dec 01 00:03:30 CST 2017}
- 2017-12-01 00:03:32,107 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-b4a725e7) (logid:d6fc7ed1) Schedule queued job-73600
- 2017-12-01 00:03:32,109 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-b4a725e7) (logid:d6fc7ed1) Execute sync-queue item: SyncQueueItemVO {id:73583, queueId: 73581, contentType: AsyncJob, contentId: 73601, lastProcessMsid: 345052167237, lastprocessNumber: 2, lastProcessTime: Fri Dec 01 00:03:32 CST 2017, created: Fri Dec 01 00:03:30 CST 2017}
- 2017-12-01 00:03:32,109 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-b4a725e7) (logid:d6fc7ed1) Schedule queued job-73601
- 2017-12-01 00:03:32,110 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600) (logid:69311199) Add job-73600 into job monitoring
- 2017-12-01 00:03:32,113 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601) (logid:b8bd8b2e) Add job-73601 into job monitoring
- 2017-12-01 00:03:32,117 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600) (logid:a98dfed6) Executing AsyncJobVO {id:73600, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfz3QAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:03:30 CST 2017}
- 2017-12-01 00:03:32,117 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600) (logid:a98dfed6) Run VM work job: com.cloud.vm.VmWorkStart for VM 24527, job origin: 1
- 2017-12-01 00:03:32,118 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) Execute VM work job: com.cloud.vm.VmWorkStart{"dcId":0,"userId":1,"accountId":1,"vmId":24527,"handlerName":"VirtualMachineManagerImpl"}
- 2017-12-01 00:03:32,119 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601) (logid:32b654cc) Executing AsyncJobVO {id:73601, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABf0HQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:03:30 CST 2017}
- 2017-12-01 00:03:32,119 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601) (logid:32b654cc) Run VM work job: com.cloud.vm.VmWorkStart for VM 24528, job origin: 2
- 2017-12-01 00:03:32,122 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) Execute VM work job: com.cloud.vm.VmWorkStart{"dcId":0,"userId":1,"accountId":1,"vmId":24528,"handlerName":"VirtualMachineManagerImpl"}
- 2017-12-01 00:03:32,124 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
- 2017-12-01 00:03:32,124 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) Successfully transitioned to start state for VM[ConsoleProxy|v-24527-VM] reservation id = 3f8dbd95-f02b-4f03-81fd-aa1b7bc062fa
- 2017-12-01 00:03:32,126 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) Trying to deploy VM, vm has dcId: 1 and podId: null
- 2017-12-01 00:03:32,126 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) Deploy avoids pods: null, clusters: null, hosts: null
- 2017-12-01 00:03:32,127 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
- 2017-12-01 00:03:32,127 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) Successfully transitioned to start state for VM[SecondaryStorageVm|s-24528-VM] reservation id = a6523cff-e5b6-4bfc-b5ca-ff16b6cc91b8
- 2017-12-01 00:03:32,129 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) Trying to deploy VM, vm has dcId: 1 and podId: null
- 2017-12-01 00:03:32,129 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) Deploy avoids pods: null, clusters: null, hosts: null
- 2017-12-01 00:03:32,129 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) Deploy avoids pods: null, clusters: null, hosts: null
- 2017-12-01 00:03:32,130 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@eecdd04
- 2017-12-01 00:03:32,130 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) Trying to allocate a host and storage pools from dc:1, pod:null,cluster:null, requested cpu: 500, requested ram: 1073741824
- 2017-12-01 00:03:32,130 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) Is ROOT volume READY (pool already allocated)?: No
- 2017-12-01 00:03:32,130 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) Searching all possible resources under this Zone: 1
- 2017-12-01 00:03:32,130 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
- 2017-12-01 00:03:32,132 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) Deploy avoids pods: null, clusters: null, hosts: null
- 2017-12-01 00:03:32,132 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@eecdd04
- 2017-12-01 00:03:32,132 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) Trying to allocate a host and storage pools from dc:1, pod:null,cluster:null, requested cpu: 500, requested ram: 536870912
- 2017-12-01 00:03:32,132 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) Is ROOT volume READY (pool already allocated)?: No
- 2017-12-01 00:03:32,132 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) Searching all possible resources under this Zone: 1
- 2017-12-01 00:03:32,133 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
- 2017-12-01 00:03:32,139 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) Checking resources in Cluster: 1 under Pod: 1
- 2017-12-01 00:03:32,139 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b FirstFitRoutingAllocator) (logid:a98dfed6) Looking for hosts in dc: 1 pod:1 cluster:1
- 2017-12-01 00:03:32,141 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b FirstFitRoutingAllocator) (logid:a98dfed6) FirstFitAllocator has 1 hosts to check for allocation: [Host[-1-Routing]]
- 2017-12-01 00:03:32,141 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) Checking resources in Cluster: 1 under Pod: 1
- 2017-12-01 00:03:32,141 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae FirstFitRoutingAllocator) (logid:32b654cc) Looking for hosts in dc: 1 pod:1 cluster:1
- 2017-12-01 00:03:32,143 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae FirstFitRoutingAllocator) (logid:32b654cc) FirstFitAllocator has 1 hosts to check for allocation: [Host[-1-Routing]]
- 2017-12-01 00:03:32,145 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b FirstFitRoutingAllocator) (logid:a98dfed6) Found 1 hosts for allocation after prioritization: [Host[-1-Routing]]
- 2017-12-01 00:03:32,145 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b FirstFitRoutingAllocator) (logid:a98dfed6) Looking for speed=500Mhz, Ram=1024
- 2017-12-01 00:03:32,147 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae FirstFitRoutingAllocator) (logid:32b654cc) Found 1 hosts for allocation after prioritization: [Host[-1-Routing]]
- 2017-12-01 00:03:32,147 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae FirstFitRoutingAllocator) (logid:32b654cc) Looking for speed=500Mhz, Ram=512
- 2017-12-01 00:03:32,150 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b FirstFitRoutingAllocator) (logid:a98dfed6) Host: 1 has cpu capability (cpu:16, speed:2533) to support requested CPU: 1 and requested speed: 500
- 2017-12-01 00:03:32,150 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b FirstFitRoutingAllocator) (logid:a98dfed6) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
- 2017-12-01 00:03:32,151 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b FirstFitRoutingAllocator) (logid:a98dfed6) Hosts's actual total CPU: 40528 and CPU after applying overprovisioning: 40528
- 2017-12-01 00:03:32,151 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b FirstFitRoutingAllocator) (logid:a98dfed6) Free CPU: 40528 , Requested CPU: 500
- 2017-12-01 00:03:32,151 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b FirstFitRoutingAllocator) (logid:a98dfed6) Free RAM: 42880884736 , Requested RAM: 1073741824
- 2017-12-01 00:03:32,151 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b FirstFitRoutingAllocator) (logid:a98dfed6) Host has enough CPU and RAM available
- 2017-12-01 00:03:32,151 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b FirstFitRoutingAllocator) (logid:a98dfed6) STATS: Can alloc CPU from host: 1, used: 0, reserved: 0, actual total: 40528, total with overprovisioning: 40528; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
- 2017-12-01 00:03:32,151 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b FirstFitRoutingAllocator) (logid:a98dfed6) STATS: Can alloc MEM from host: 1, used: 0, reserved: 0, total: 42880884736; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
- 2017-12-01 00:03:32,151 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b FirstFitRoutingAllocator) (logid:a98dfed6) Found a suitable host, adding to list: 1
- 2017-12-01 00:03:32,151 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b FirstFitRoutingAllocator) (logid:a98dfed6) Host Allocator returning 1 suitable hosts
- 2017-12-01 00:03:32,152 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae FirstFitRoutingAllocator) (logid:32b654cc) Host: 1 has cpu capability (cpu:16, speed:2533) to support requested CPU: 1 and requested speed: 500
- 2017-12-01 00:03:32,152 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae FirstFitRoutingAllocator) (logid:32b654cc) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 536870912 , cpuOverprovisioningFactor: 1.0
- 2017-12-01 00:03:32,153 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) Checking suitable pools for volume (Id, Type): (24527,ROOT)
- 2017-12-01 00:03:32,153 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) We need to allocate new storagepool for this volume
- 2017-12-01 00:03:32,153 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae FirstFitRoutingAllocator) (logid:32b654cc) Hosts's actual total CPU: 40528 and CPU after applying overprovisioning: 40528
- 2017-12-01 00:03:32,153 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae FirstFitRoutingAllocator) (logid:32b654cc) Free CPU: 40528 , Requested CPU: 500
- 2017-12-01 00:03:32,153 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae FirstFitRoutingAllocator) (logid:32b654cc) Free RAM: 42880884736 , Requested RAM: 536870912
- 2017-12-01 00:03:32,153 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae FirstFitRoutingAllocator) (logid:32b654cc) Host has enough CPU and RAM available
- 2017-12-01 00:03:32,153 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae FirstFitRoutingAllocator) (logid:32b654cc) STATS: Can alloc CPU from host: 1, used: 0, reserved: 0, actual total: 40528, total with overprovisioning: 40528; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
- 2017-12-01 00:03:32,153 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae FirstFitRoutingAllocator) (logid:32b654cc) STATS: Can alloc MEM from host: 1, used: 0, reserved: 0, total: 42880884736; requested mem: 536870912,alloc_from_last_host?:false ,considerReservedCapacity?: true
- 2017-12-01 00:03:32,153 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae FirstFitRoutingAllocator) (logid:32b654cc) Found a suitable host, adding to list: 1
- 2017-12-01 00:03:32,153 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae FirstFitRoutingAllocator) (logid:32b654cc) Host Allocator returning 1 suitable hosts
- 2017-12-01 00:03:32,154 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) Calling StoragePoolAllocators to find suitable pools
- 2017-12-01 00:03:32,155 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) System VMs will use shared storage for zone id=1
- 2017-12-01 00:03:32,155 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) LocalStoragePoolAllocator trying to find storage pool to fit the vm
- 2017-12-01 00:03:32,155 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) ClusterScopeStoragePoolAllocator looking for storage pool
- 2017-12-01 00:03:32,155 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) Looking for pools in dc: 1 pod:1 cluster:1. Disabled pools will be ignored.
- 2017-12-01 00:03:32,155 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) Found pools matching tags: []
- 2017-12-01 00:03:32,155 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) Checking suitable pools for volume (Id, Type): (24528,ROOT)
- 2017-12-01 00:03:32,155 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) We need to allocate new storagepool for this volume
- 2017-12-01 00:03:32,155 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) No storage pools available for shared volume allocation, returning
- 2017-12-01 00:03:32,155 DEBUG [o.a.c.s.a.ZoneWideStoragePoolAllocator] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) ZoneWideStoragePoolAllocator to find storage pool
- 2017-12-01 00:03:32,156 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) Calling StoragePoolAllocators to find suitable pools
- 2017-12-01 00:03:32,156 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) No suitable pools found for volume: Vol[24527|vm=24527|ROOT] under cluster: 1
- 2017-12-01 00:03:32,156 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) No suitable pools found
- 2017-12-01 00:03:32,156 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) No suitable storagePools found under this Cluster: 1
- 2017-12-01 00:03:32,156 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) System VMs will use shared storage for zone id=1
- 2017-12-01 00:03:32,156 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) LocalStoragePoolAllocator trying to find storage pool to fit the vm
- 2017-12-01 00:03:32,156 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) ClusterScopeStoragePoolAllocator looking for storage pool
- 2017-12-01 00:03:32,156 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) Looking for pools in dc: 1 pod:1 cluster:1. Disabled pools will be ignored.
- 2017-12-01 00:03:32,157 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) Found pools matching tags: []
- 2017-12-01 00:03:32,157 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) Could not find suitable Deployment Destination for this VM under any clusters, returning.
- 2017-12-01 00:03:32,157 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) Searching all possible resources under this Zone: 1
- 2017-12-01 00:03:32,157 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) No storage pools available for shared volume allocation, returning
- 2017-12-01 00:03:32,157 DEBUG [o.a.c.s.a.ZoneWideStoragePoolAllocator] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) ZoneWideStoragePoolAllocator to find storage pool
- 2017-12-01 00:03:32,157 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
- 2017-12-01 00:03:32,158 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) No suitable pools found for volume: Vol[24528|vm=24528|ROOT] under cluster: 1
- 2017-12-01 00:03:32,158 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) No suitable pools found
- 2017-12-01 00:03:32,158 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) No suitable storagePools found under this Cluster: 1
- 2017-12-01 00:03:32,158 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) Removing from the clusterId list these clusters from avoid set: [1]
- 2017-12-01 00:03:32,159 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) No clusters found after removing disabled clusters and clusters in avoid list, returning.
- 2017-12-01 00:03:32,159 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) Could not find suitable Deployment Destination for this VM under any clusters, returning.
- 2017-12-01 00:03:32,159 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) Searching all possible resources under this Zone: 1
- 2017-12-01 00:03:32,159 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
- 2017-12-01 00:03:32,160 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) Removing from the clusterId list these clusters from avoid set: [1]
- 2017-12-01 00:03:32,161 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) No clusters found after removing disabled clusters and clusters in avoid list, returning.
- 2017-12-01 00:03:32,166 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
- 2017-12-01 00:03:32,166 ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) Invocation exception, caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24527-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- 2017-12-01 00:03:32,166 INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600 ctx-d3747d6b) (logid:a98dfed6) Rethrow exception com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24527-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- 2017-12-01 00:03:32,166 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600) (logid:a98dfed6) Done with run of VM work job: com.cloud.vm.VmWorkStart for VM 24527, job origin: 1
- 2017-12-01 00:03:32,166 ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600) (logid:a98dfed6) Unable to complete AsyncJobVO {id:73600, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfz3QAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:03:30 CST 2017}, job origin:1
- com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24527-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
- at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
- at java.lang.reflect.Method.invoke(Method.java:498)
- at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
- at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
- at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
- at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
- at java.util.concurrent.FutureTask.run(FutureTask.java:266)
- at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
- at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
- at java.lang.Thread.run(Thread.java:748)
- 2017-12-01 00:03:32,167 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600) (logid:a98dfed6) Complete async job-73600, jobStatus: FAILED, resultCode: 0, result: rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdAA9VW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW0NvbnNvbGVQcm94eXx2LTI0NTI3LVZNXXVyAB5bTGphdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudDsCRio8PP0iOQIAAHhwAAAAFHNyABtqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnRhCcWaJjbdhQIABEkACmxpbmVOdW1iZXJMAA5kZWNsYXJpbmdDbGFzc3EAfgAKTAAIZmlsZU5hbWVxAH4ACkwACm1ldGhvZE5hbWVxAH4ACnhwAAADwHQAJmNvbS5jbG91ZC52bS5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsdAAeVmlydHVhbE1hY2hpbmVNYW5hZ2VySW1wbC5qYXZhdAAQb3JjaGVzdHJhdGVTdGFydHNxAH4AEQAAEgtxAH4AE3EAfgAUcQB-ABVzcQB-ABH_____dAAmc3VuLnJlZmxlY3QuR2VuZXJhdGVkTWV0aG9kQWNjZXNzb3IxOTlwdAAGaW52b2tlc3EAfgARAAAAK3QAKHN1bi5yZWZsZWN0LkRlbGVnYXRpbmdNZXRob2RBY2Nlc3NvckltcGx0ACFEZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsLmphdmFxAH4AGXNxAH4AEQAAAfJ0ABhqYXZhLmxhbmcucmVmbGVjdC5NZXRob2R0AAtNZXRob2QuamF2YXEAfgAZc3EAfgARAAAAa3QAImNvbS5jbG91ZC52bS5WbVdvcmtKb2JIYW5kbGVyUHJveHl0ABpWbVdvcmtKb2JIYW5kbGVyUHJveHkuamF2YXQAD2hhbmRsZVZtV29ya0pvYnNxAH4AEQAAEqxxAH4AE3EAfgAUcQB-ACNzcQB-ABEAAABmdAAgY29tLmNsb3VkLnZtLlZtV29ya0pvYkRpc3BhdGNoZXJ0ABhWbVdvcmtKb2JEaXNwYXRjaGVyLmphdmF0AAZydW5Kb2JzcQB-ABEAAAIqdAA_b3JnLmFwYWNoZS5jbG91ZHN0YWNrLmZyYW1ld29yay5qb2JzLmltcGwuQXN5bmNKb2JNYW5hZ2VySW1wbCQ1dAAYQXN5bmNKb2JNYW5hZ2VySW1wbC5qYXZhdAAMcnVuSW5Db250ZXh0c3EAfgARAAAAMXQAPm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZSQxdAAbTWFuYWdlZENvbnRleHRSdW5uYWJsZS5qYXZhdAADcnVuc3EAfgARAAAAOHQAQm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5EZWZhdWx0TWFuYWdlZENvbnRleHQkMXQAGkRlZmF1bHRNYW5hZ2VkQ29udGV4dC5qYXZhdAAEY2FsbHNxAH4AEQAAAGd0AEBvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0cQB-ADN0AA9jYWxsV2l0aENvbnRleHRzcQB-ABEAAAA1cQB-ADZxAH4AM3QADnJ1bldpdGhDb250ZXh0c3EAfgARAAAALnQAPG9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZXEAfgAvcQB-ADBzcQB-ABEAAAH2cQB-ACpxAH4AK3EAfgAwc3EAfgARAAAB_3QALmphdmEudXRpbC5jb25jdXJyZW50LkV4ZWN1dG9ycyRSdW5uYWJsZUFkYXB0ZXJ0AA5FeGVjdXRvcnMuamF2YXEAfgA0c3EAfgARAAABCnQAH2phdmEudXRpbC5jb25jdXJyZW50LkZ1dHVyZVRhc2t0AA9GdXR1cmVUYXNrLmphdmFxAH4AMHNxAH4AEQAABH10ACdqYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3J0ABdUaHJlYWRQb29sRXhlY3V0b3IuamF2YXQACXJ1bldvcmtlcnNxAH4AEQAAAnB0AC5qYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3IkV29ya2VycQB-AEVxAH4AMHNxAH4AEQAAAux0ABBqYXZhLmxhbmcuVGhyZWFkdAALVGhyZWFkLmphdmFxAH4AMHNyACZqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlTGlzdPwPJTG17I4QAgABTAAEbGlzdHEAfgAMeHIALGphdmEudXRpbC5Db2xsZWN0aW9ucyRVbm1vZGlmaWFibGVDb2xsZWN0aW9uGUIAgMte9x4CAAFMAAFjdAAWTGphdmEvdXRpbC9Db2xsZWN0aW9uO3hwc3IAE2phdmEudXRpbC5BcnJheUxpc3R4gdIdmcdhnQMAAUkABHNpemV4cAAAAAB3BAAAAAB4cQB-AFF4c3IAEWphdmEubGFuZy5JbnRlZ2VyEuKgpPeBhzgCAAFJAAV2YWx1ZXhyABBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAAB4cAAAEO9zcQB-AFAAAAAAdwQAAAAAeHNyAA5qYXZhLmxhbmcuTG9uZzuL5JDMjyPfAgABSgAFdmFsdWV4cQB-AFMAAAAAAAAAAXZyABdjb20uY2xvdWQuZGMuRGF0YUNlbnRlcrLxCuun53i-AgAAeHAA
- 2017-12-01 00:03:32,167 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
- 2017-12-01 00:03:32,167 ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) Invocation exception, caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24528-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- 2017-12-01 00:03:32,168 INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601 ctx-f36eb8ae) (logid:32b654cc) Rethrow exception com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24528-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- 2017-12-01 00:03:32,168 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601) (logid:32b654cc) Done with run of VM work job: com.cloud.vm.VmWorkStart for VM 24528, job origin: 2
- 2017-12-01 00:03:32,168 ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601) (logid:32b654cc) Unable to complete AsyncJobVO {id:73601, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABf0HQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:03:30 CST 2017}, job origin:2
- com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24528-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
- at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
- at java.lang.reflect.Method.invoke(Method.java:498)
- at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
- at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
- at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
- at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
- at java.util.concurrent.FutureTask.run(FutureTask.java:266)
- at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
- at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
- at java.lang.Thread.run(Thread.java:748)
- 2017-12-01 00:03:32,168 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601) (logid:32b654cc) Complete async job-73601, jobStatus: FAILED, resultCode: 0, result: rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdABDVW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW1NlY29uZGFyeVN0b3JhZ2VWbXxzLTI0NTI4LVZNXXVyAB5bTGphdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudDsCRio8PP0iOQIAAHhwAAAAFHNyABtqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnRhCcWaJjbdhQIABEkACmxpbmVOdW1iZXJMAA5kZWNsYXJpbmdDbGFzc3EAfgAKTAAIZmlsZU5hbWVxAH4ACkwACm1ldGhvZE5hbWVxAH4ACnhwAAADwHQAJmNvbS5jbG91ZC52bS5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsdAAeVmlydHVhbE1hY2hpbmVNYW5hZ2VySW1wbC5qYXZhdAAQb3JjaGVzdHJhdGVTdGFydHNxAH4AEQAAEgtxAH4AE3EAfgAUcQB-ABVzcQB-ABH_____dAAmc3VuLnJlZmxlY3QuR2VuZXJhdGVkTWV0aG9kQWNjZXNzb3IxOTlwdAAGaW52b2tlc3EAfgARAAAAK3QAKHN1bi5yZWZsZWN0LkRlbGVnYXRpbmdNZXRob2RBY2Nlc3NvckltcGx0ACFEZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsLmphdmFxAH4AGXNxAH4AEQAAAfJ0ABhqYXZhLmxhbmcucmVmbGVjdC5NZXRob2R0AAtNZXRob2QuamF2YXEAfgAZc3EAfgARAAAAa3QAImNvbS5jbG91ZC52bS5WbVdvcmtKb2JIYW5kbGVyUHJveHl0ABpWbVdvcmtKb2JIYW5kbGVyUHJveHkuamF2YXQAD2hhbmRsZVZtV29ya0pvYnNxAH4AEQAAEqxxAH4AE3EAfgAUcQB-ACNzcQB-ABEAAABmdAAgY29tLmNsb3VkLnZtLlZtV29ya0pvYkRpc3BhdGNoZXJ0ABhWbVdvcmtKb2JEaXNwYXRjaGVyLmphdmF0AAZydW5Kb2JzcQB-ABEAAAIqdAA_b3JnLmFwYWNoZS5jbG91ZHN0YWNrLmZyYW1ld29yay5qb2JzLmltcGwuQXN5bmNKb2JNYW5hZ2VySW1wbCQ1dAAYQXN5bmNKb2JNYW5hZ2VySW1wbC5qYXZhdAAMcnVuSW5Db250ZXh0c3EAfgARAAAAMXQAPm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZSQxdAAbTWFuYWdlZENvbnRleHRSdW5uYWJsZS5qYXZhdAADcnVuc3EAfgARAAAAOHQAQm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5EZWZhdWx0TWFuYWdlZENvbnRleHQkMXQAGkRlZmF1bHRNYW5hZ2VkQ29udGV4dC5qYXZhdAAEY2FsbHNxAH4AEQAAAGd0AEBvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0cQB-ADN0AA9jYWxsV2l0aENvbnRleHRzcQB-ABEAAAA1cQB-ADZxAH4AM3QADnJ1bldpdGhDb250ZXh0c3EAfgARAAAALnQAPG9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZXEAfgAvcQB-ADBzcQB-ABEAAAH2cQB-ACpxAH4AK3EAfgAwc3EAfgARAAAB_3QALmphdmEudXRpbC5jb25jdXJyZW50LkV4ZWN1dG9ycyRSdW5uYWJsZUFkYXB0ZXJ0AA5FeGVjdXRvcnMuamF2YXEAfgA0c3EAfgARAAABCnQAH2phdmEudXRpbC5jb25jdXJyZW50LkZ1dHVyZVRhc2t0AA9GdXR1cmVUYXNrLmphdmFxAH4AMHNxAH4AEQAABH10ACdqYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3J0ABdUaHJlYWRQb29sRXhlY3V0b3IuamF2YXQACXJ1bldvcmtlcnNxAH4AEQAAAnB0AC5qYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3IkV29ya2VycQB-AEVxAH4AMHNxAH4AEQAAAux0ABBqYXZhLmxhbmcuVGhyZWFkdAALVGhyZWFkLmphdmFxAH4AMHNyACZqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlTGlzdPwPJTG17I4QAgABTAAEbGlzdHEAfgAMeHIALGphdmEudXRpbC5Db2xsZWN0aW9ucyRVbm1vZGlmaWFibGVDb2xsZWN0aW9uGUIAgMte9x4CAAFMAAFjdAAWTGphdmEvdXRpbC9Db2xsZWN0aW9uO3hwc3IAE2phdmEudXRpbC5BcnJheUxpc3R4gdIdmcdhnQMAAUkABHNpemV4cAAAAAB3BAAAAAB4cQB-AFF4c3IAEWphdmEubGFuZy5JbnRlZ2VyEuKgpPeBhzgCAAFJAAV2YWx1ZXhyABBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAAB4cAAAEO9zcQB-AFAAAAAAdwQAAAAAeHNyAA5qYXZhLmxhbmcuTG9uZzuL5JDMjyPfAgABSgAFdmFsdWV4cQB-AFMAAAAAAAAAAXZyABdjb20uY2xvdWQuZGMuRGF0YUNlbnRlcrLxCuun53i-AgAAeHAA
- 2017-12-01 00:03:32,169 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601) (logid:32b654cc) Publish async job-73601 complete on message bus
- 2017-12-01 00:03:32,169 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601) (logid:32b654cc) Wake up jobs related to job-73601
- 2017-12-01 00:03:32,169 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601) (logid:32b654cc) Update db status for job-73601
- 2017-12-01 00:03:32,170 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601) (logid:32b654cc) Wake up jobs joined with job-73601 and disjoin all subjobs created from job- 73601
- 2017-12-01 00:03:32,174 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601) (logid:32b654cc) Done executing com.cloud.vm.VmWorkStart for job-73601
- 2017-12-01 00:03:32,181 WARN [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-11936d05) (logid:5925c756) Exception while trying to start secondary storage vm
- com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-24528-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
- at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
- at java.lang.reflect.Method.invoke(Method.java:498)
- at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
- at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
- at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
- at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
- at java.util.concurrent.FutureTask.run(FutureTask.java:266)
- at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
- at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
- at java.lang.Thread.run(Thread.java:748)
- 2017-12-01 00:03:32,185 INFO [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-11936d05) (logid:5925c756) Unable to start secondary storage vm for standby capacity, vm id : 24528, will recycle it and start a new one
- 2017-12-01 00:03:32,185 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600) (logid:a98dfed6) Publish async job-73600 complete on message bus
- 2017-12-01 00:03:32,185 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600) (logid:a98dfed6) Wake up jobs related to job-73600
- 2017-12-01 00:03:32,185 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600) (logid:a98dfed6) Update db status for job-73600
- 2017-12-01 00:03:32,186 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600) (logid:a98dfed6) Wake up jobs joined with job-73600 and disjoin all subjobs created from job- 73600
- 2017-12-01 00:03:32,181 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-44:ctx-234ebdfe job-2/job-73601) (logid:32b654cc) Remove job-73601 from job monitoring
- 2017-12-01 00:03:32,196 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (secstorage-1:ctx-11936d05) (logid:5925c756) Sync job-73602 execution on object VmWorkJobQueue.24528
- 2017-12-01 00:03:32,197 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600) (logid:a98dfed6) Done executing com.cloud.vm.VmWorkStart for job-73600
- 2017-12-01 00:03:32,198 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-45:ctx-d484e82f job-1/job-73600) (logid:a98dfed6) Remove job-73600 from job monitoring
- 2017-12-01 00:03:32,204 WARN [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-c3994110) (logid:d0865f01) Exception while trying to start console proxy
- com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-24527-VM]Scope=interface com.cloud.dc.DataCenter; id=1
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
- at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
- at sun.reflect.GeneratedMethodAccessor199.invoke(Unknown Source)
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
- at java.lang.reflect.Method.invoke(Method.java:498)
- at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
- at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
- at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
- at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
- at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
- at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
- at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
- at java.util.concurrent.FutureTask.run(FutureTask.java:266)
- at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
- at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
- at java.lang.Thread.run(Thread.java:748)
- 2017-12-01 00:03:32,215 INFO [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-c3994110) (logid:d0865f01) Unable to start console proxy vm for standby capacity, vm id : 24527, will recycle it and start a new one
- 2017-12-01 00:03:32,226 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (consoleproxy-1:ctx-c3994110) (logid:d0865f01) Sync job-73603 execution on object VmWorkJobQueue.24527
- 2017-12-01 00:03:33,499 INFO [c.c.h.v.r.VmwareResource] (DirectAgentCronJob-384:ctx-e2f917ca) (logid:f7d9e7a5) Scan hung worker VM to recycle
- 2017-12-01 00:03:33,681 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgentCronJob-384:ctx-e2f917ca) (logid:f7d9e7a5) Ping from 1(r6-l06-esx01.cisco.com)
- 2017-12-01 00:03:33,681 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-384:ctx-e2f917ca) (logid:f7d9e7a5) Process host VM state report from ping process. host: 1
- 2017-12-01 00:03:33,681 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-384:ctx-e2f917ca) (logid:f7d9e7a5) Process VM state report. host: 1, number of records in report: 0
- 2017-12-01 00:03:33,683 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-384:ctx-e2f917ca) (logid:f7d9e7a5) Done with process of VM state report. host: 1
- 2017-12-01 00:03:34,106 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-7d229549) (logid:a7887a0e) Execute sync-queue item: SyncQueueItemVO {id:73584, queueId: 73581, contentType: AsyncJob, contentId: 73602, lastProcessMsid: 345052167237, lastprocessNumber: 3, lastProcessTime: Fri Dec 01 00:03:34 CST 2017, created: Fri Dec 01 00:03:32 CST 2017}
- 2017-12-01 00:03:34,107 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-7d229549) (logid:a7887a0e) Schedule queued job-73602
- 2017-12-01 00:03:34,109 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-7d229549) (logid:a7887a0e) Execute sync-queue item: SyncQueueItemVO {id:73585, queueId: 73580, contentType: AsyncJob, contentId: 73603, lastProcessMsid: 345052167237, lastprocessNumber: 3, lastProcessTime: Fri Dec 01 00:03:34 CST 2017, created: Fri Dec 01 00:03:32 CST 2017}
- 2017-12-01 00:03:34,109 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-7d229549) (logid:a7887a0e) Schedule queued job-73603
- 2017-12-01 00:03:34,109 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-47:ctx-efc94df6 job-2/job-73602) (logid:1d064cfe) Add job-73602 into job monitoring
- 2017-12-01 00:03:34,112 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-46:ctx-cc7e43c1 job-1/job-73603) (logid:d1c55486) Add job-73603 into job monitoring
- 2017-12-01 00:03:34,114 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-47:ctx-efc94df6 job-2/job-73602) (logid:32b654cc) Executing AsyncJobVO {id:73602, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStop, cmdInfo: rO0ABXNyABdjb20uY2xvdWQudm0uVm1Xb3JrU3RvcALQ4GymiWjjAgABWgAHY2xlYW51cHhyABNjb20uY2xvdWQudm0uVm1Xb3Jrn5m2VvAlZ2sCAARKAAlhY2NvdW50SWRKAAZ1c2VySWRKAAR2bUlkTAALaGFuZGxlck5hbWV0ABJMamF2YS9sYW5nL1N0cmluZzt4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABf0HQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:03:32 CST 2017}
- 2017-12-01 00:03:34,114 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-47:ctx-efc94df6 job-2/job-73602) (logid:32b654cc) Run VM work job: com.cloud.vm.VmWorkStop for VM 24528, job origin: 2
- 2017-12-01 00:03:34,115 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-47:ctx-efc94df6 job-2/job-73602 ctx-c1c78d53) (logid:32b654cc) Execute VM work job: com.cloud.vm.VmWorkStop{"cleanup":false,"userId":1,"accountId":1,"vmId":24528,"handlerName":"VirtualMachineManagerImpl"}
- 2017-12-01 00:03:34,116 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-46:ctx-cc7e43c1 job-1/job-73603) (logid:a98dfed6) Executing AsyncJobVO {id:73603, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStop, cmdInfo: rO0ABXNyABdjb20uY2xvdWQudm0uVm1Xb3JrU3RvcALQ4GymiWjjAgABWgAHY2xlYW51cHhyABNjb20uY2xvdWQudm0uVm1Xb3Jrn5m2VvAlZ2sCAARKAAlhY2NvdW50SWRKAAZ1c2VySWRKAAR2bUlkTAALaGFuZGxlck5hbWV0ABJMamF2YS9sYW5nL1N0cmluZzt4cAAAAAAAAAABAAAAAAAAAAEAAAAAAABfz3QAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 345052167237, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Dec 01 00:03:32 CST 2017}
Add Comment
Please, Sign In to add comment