xofapcom

cloudstack

Oct 30th, 2017
73
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 51.50 KB | None | 0 0
  1. 2017-10-30 16:12:50,566 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-126:ctx-aa6eac46 job-2/job-136 ctx-08ce88b9) (logid:983ac3d9) release cpu from host: 1, old used: 1000,reserved: 0, actual total: 20264, total with overprovisioning: 20264; new used: 500,reserved:0; movedfromreserved: false,moveToReserveredfalse
  2. 2017-10-30 16:12:50,566 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-126:ctx-aa6eac46 job-2/job-136 ctx-08ce88b9) (logid:983ac3d9) release mem from host: 1, old used: 1610612736,reserved: 0, total: 15744483328; new used: 536870912,reserved:0; movedfromreserved: false,moveToReserveredfalse
  3. 2017-10-30 16:12:50,598 ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-126:ctx-aa6eac46 job-2/job-136 ctx-08ce88b9) (logid:983ac3d9) Invocation exception, caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-42-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  4. 2017-10-30 16:12:50,598 INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-126:ctx-aa6eac46 job-2/job-136 ctx-08ce88b9) (logid:983ac3d9) Rethrow exception com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-42-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  5. 2017-10-30 16:12:50,598 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-126:ctx-aa6eac46 job-2/job-136) (logid:983ac3d9) Done with run of VM work job: com.cloud.vm.VmWorkStart for VM 42, job origin: 2
  6. 2017-10-30 16:12:50,598 ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-126:ctx-aa6eac46 job-2/job-136) (logid:983ac3d9) Unable to complete AsyncJobVO {id:136, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAAAAKnQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 130586213177, completeMsid: null, lastUpdated: null, lastPolled: null, created: Mon Oct 30 16:02:50 WIB 2017}, job origin:2
  7. com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-42-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  8. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
  9. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
  10. at sun.reflect.GeneratedMethodAccessor186.invoke(Unknown Source)
  11. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  12. at java.lang.reflect.Method.invoke(Method.java:606)
  13. at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
  14. at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
  15. at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
  16. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
  17. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  18. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  19. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  20. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  21. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  22. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
  23. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:473)
  24. at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  25. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
  26. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:622)
  27. at java.lang.Thread.run(Thread.java:748)
  28. 2017-10-30 16:12:50,599 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-126:ctx-aa6eac46 job-2/job-136) (logid:983ac3d9) Complete async job-136, jobStatus: FAILED, resultCode: 0, result: rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdAA6VW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW0NvbnNvbGVQcm94eXx2LTQyLVZNXXVyAB5bTGphdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudDsCRio8PP0iOQIAAHhwAAAAFHNyABtqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnRhCcWaJjbdhQIABEkACmxpbmVOdW1iZXJMAA5kZWNsYXJpbmdDbGFzc3EAfgAKTAAIZmlsZU5hbWVxAH4ACkwACm1ldGhvZE5hbWVxAH4ACnhwAAADwHQAJmNvbS5jbG91ZC52bS5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsdAAeVmlydHVhbE1hY2hpbmVNYW5hZ2VySW1wbC5qYXZhdAAQb3JjaGVzdHJhdGVTdGFydHNxAH4AEQAAEgtxAH4AE3EAfgAUcQB-ABVzcQB-ABH_____dAAmc3VuLnJlZmxlY3QuR2VuZXJhdGVkTWV0aG9kQWNjZXNzb3IxODZwdAAGaW52b2tlc3EAfgARAAAAK3QAKHN1bi5yZWZsZWN0LkRlbGVnYXRpbmdNZXRob2RBY2Nlc3NvckltcGx0ACFEZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsLmphdmFxAH4AGXNxAH4AEQAAAl50ABhqYXZhLmxhbmcucmVmbGVjdC5NZXRob2R0AAtNZXRob2QuamF2YXEAfgAZc3EAfgARAAAAa3QAImNvbS5jbG91ZC52bS5WbVdvcmtKb2JIYW5kbGVyUHJveHl0ABpWbVdvcmtKb2JIYW5kbGVyUHJveHkuamF2YXQAD2hhbmRsZVZtV29ya0pvYnNxAH4AEQAAEqxxAH4AE3EAfgAUcQB-ACNzcQB-ABEAAABmdAAgY29tLmNsb3VkLnZtLlZtV29ya0pvYkRpc3BhdGNoZXJ0ABhWbVdvcmtKb2JEaXNwYXRjaGVyLmphdmF0AAZydW5Kb2JzcQB-ABEAAAIqdAA_b3JnLmFwYWNoZS5jbG91ZHN0YWNrLmZyYW1ld29yay5qb2JzLmltcGwuQXN5bmNKb2JNYW5hZ2VySW1wbCQ1dAAYQXN5bmNKb2JNYW5hZ2VySW1wbC5qYXZhdAAMcnVuSW5Db250ZXh0c3EAfgARAAAAMXQAPm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZSQxdAAbTWFuYWdlZENvbnRleHRSdW5uYWJsZS5qYXZhdAADcnVuc3EAfgARAAAAOHQAQm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5EZWZhdWx0TWFuYWdlZENvbnRleHQkMXQAGkRlZmF1bHRNYW5hZ2VkQ29udGV4dC5qYXZhdAAEY2FsbHNxAH4AEQAAAGd0AEBvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0cQB-ADN0AA9jYWxsV2l0aENvbnRleHRzcQB-ABEAAAA1cQB-ADZxAH4AM3QADnJ1bldpdGhDb250ZXh0c3EAfgARAAAALnQAPG9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZXEAfgAvcQB-ADBzcQB-ABEAAAH2cQB-ACpxAH4AK3EAfgAwc3EAfgARAAAB2XQALmphdmEudXRpbC5jb25jdXJyZW50LkV4ZWN1dG9ycyRSdW5uYWJsZUFkYXB0ZXJ0AA5FeGVjdXRvcnMuamF2YXEAfgA0c3EAfgARAAABBnQAH2phdmEudXRpbC5jb25jdXJyZW50LkZ1dHVyZVRhc2t0AA9GdXR1cmVUYXNrLmphdmFxAH4AMHNxAH4AEQAABIB0ACdqYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3J0ABdUaHJlYWRQb29sRXhlY3V0b3IuamF2YXQACXJ1bldvcmtlcnNxAH4AEQAAAm50AC5qYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3IkV29ya2VycQB-AEVxAH4AMHNxAH4AEQAAAux0ABBqYXZhLmxhbmcuVGhyZWFkdAALVGhyZWFkLmphdmFxAH4AMHNyACZqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlTGlzdPwPJTG17I4QAgABTAAEbGlzdHEAfgAMeHIALGphdmEudXRpbC5Db2xsZWN0aW9ucyRVbm1vZGlmaWFibGVDb2xsZWN0aW9uGUIAgMte9x4CAAFMAAFjdAAWTGphdmEvdXRpbC9Db2xsZWN0aW9uO3hwc3IAE2phdmEudXRpbC5BcnJheUxpc3R4gdIdmcdhnQMAAUkABHNpemV4cAAAAAB3BAAAAAB4cQB-AFF4c3IAEWphdmEubGFuZy5JbnRlZ2VyEuKgpPeBhzgCAAFJAAV2YWx1ZXhyABBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAAB4cAAAEO9zcQB-AFAAAAAAdwQAAAAAeHNyAA5qYXZhLmxhbmcuTG9uZzuL5JDMjyPfAgABSgAFdmFsdWV4cQB-AFMAAAAAAAAAAXZyABdjb20uY2xvdWQuZGMuRGF0YUNlbnRlcrLxCuun53i-AgAAeHAA
  29. 2017-10-30 16:12:50,600 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-126:ctx-aa6eac46 job-2/job-136) (logid:983ac3d9) Publish async job-136 complete on message bus
  30. 2017-10-30 16:12:50,600 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-126:ctx-aa6eac46 job-2/job-136) (logid:983ac3d9) Wake up jobs related to job-136
  31. 2017-10-30 16:12:50,600 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-126:ctx-aa6eac46 job-2/job-136) (logid:983ac3d9) Update db status for job-136
  32. 2017-10-30 16:12:50,600 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-126:ctx-aa6eac46 job-2/job-136) (logid:983ac3d9) Wake up jobs joined with job-136 and disjoin all subjobs created from job- 136
  33. 2017-10-30 16:12:50,631 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-126:ctx-aa6eac46 job-2/job-136) (logid:983ac3d9) Done executing com.cloud.vm.VmWorkStart for job-136
  34. 2017-10-30 16:12:50,631 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-126:ctx-aa6eac46 job-2/job-136) (logid:983ac3d9) Remove job-136 from job monitoring
  35. 2017-10-30 16:12:50,666 WARN [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-1a3c95e0) (logid:74012c81) Exception while trying to start console proxy
  36. com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-42-VM]Scope=interface com.cloud.dc.DataCenter; id=1
  37. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
  38. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4619)
  39. at sun.reflect.GeneratedMethodAccessor186.invoke(Unknown Source)
  40. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  41. at java.lang.reflect.Method.invoke(Method.java:606)
  42. at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
  43. at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4780)
  44. at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
  45. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)
  46. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  47. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  48. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  49. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  50. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  51. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)
  52. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:473)
  53. at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  54. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
  55. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:622)
  56. at java.lang.Thread.run(Thread.java:748)
  57. 2017-10-30 16:12:50,667 INFO [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-1a3c95e0) (logid:74012c81) Unable to start console proxy vm for standby capacity, vm id : 42, will recycle it and start a new one
  58. 2017-10-30 16:12:50,715 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (consoleproxy-1:ctx-1a3c95e0) (logid:74012c81) Sync job-139 execution on object VmWorkJobQueue.42
  59. 2017-10-30 16:12:51,638 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-60337cda) (logid:68ea7ea6) Execute sync-queue item: SyncQueueItemVO {id:129, queueId: 124, contentType: AsyncJob, contentId: 139, lastProcessMsid: 130586213177, lastprocessNumber: 3, lastProcessTime: Mon Oct 30 16:12:51 WIB 2017, created: Mon Oct 30 16:12:50 WIB 2017}
  60. 2017-10-30 16:12:51,639 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-60337cda) (logid:68ea7ea6) Schedule queued job-139
  61. 2017-10-30 16:12:51,690 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-129:ctx-ae046916 job-2/job-139) (logid:472c8b2c) Add job-139 into job monitoring
  62. 2017-10-30 16:12:51,693 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-129:ctx-ae046916 job-2/job-139) (logid:983ac3d9) Executing AsyncJobVO {id:139, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStop, cmdInfo: rO0ABXNyABdjb20uY2xvdWQudm0uVm1Xb3JrU3RvcALQ4GymiWjjAgABWgAHY2xlYW51cHhyABNjb20uY2xvdWQudm0uVm1Xb3Jrn5m2VvAlZ2sCAARKAAlhY2NvdW50SWRKAAZ1c2VySWRKAAR2bUlkTAALaGFuZGxlck5hbWV0ABJMamF2YS9sYW5nL1N0cmluZzt4cAAAAAAAAAABAAAAAAAAAAEAAAAAAAAAKnQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 130586213177, completeMsid: null, lastUpdated: null, lastPolled: null, created: Mon Oct 30 16:12:50 WIB 2017}
  63. 2017-10-30 16:12:51,693 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-129:ctx-ae046916 job-2/job-139) (logid:983ac3d9) Run VM work job: com.cloud.vm.VmWorkStop for VM 42, job origin: 2
  64. 2017-10-30 16:12:51,695 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-129:ctx-ae046916 job-2/job-139 ctx-e8d4aada) (logid:983ac3d9) Execute VM work job: com.cloud.vm.VmWorkStop{"cleanup":false,"userId":1,"accountId":1,"vmId":42,"handlerName":"VirtualMachineManagerImpl"}
  65. 2017-10-30 16:12:51,696 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-129:ctx-ae046916 job-2/job-139 ctx-e8d4aada) (logid:983ac3d9) VM is already stopped: VM[ConsoleProxy|v-42-VM]
  66. 2017-10-30 16:12:51,696 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-129:ctx-ae046916 job-2/job-139 ctx-e8d4aada) (logid:983ac3d9) Done executing VM work job: com.cloud.vm.VmWorkStop{"cleanup":false,"userId":1,"accountId":1,"vmId":42,"handlerName":"VirtualMachineManagerImpl"}
  67. 2017-10-30 16:12:51,696 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-129:ctx-ae046916 job-2/job-139 ctx-e8d4aada) (logid:983ac3d9) Complete async job-139, jobStatus: SUCCEEDED, resultCode: 0, result: null
  68. 2017-10-30 16:12:51,697 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-129:ctx-ae046916 job-2/job-139 ctx-e8d4aada) (logid:983ac3d9) Publish async job-139 complete on message bus
  69. 2017-10-30 16:12:51,697 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-129:ctx-ae046916 job-2/job-139 ctx-e8d4aada) (logid:983ac3d9) Wake up jobs related to job-139
  70. 2017-10-30 16:12:51,697 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-129:ctx-ae046916 job-2/job-139 ctx-e8d4aada) (logid:983ac3d9) Update db status for job-139
  71. 2017-10-30 16:12:51,697 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-129:ctx-ae046916 job-2/job-139 ctx-e8d4aada) (logid:983ac3d9) Wake up jobs joined with job-139 and disjoin all subjobs created from job- 139
  72. 2017-10-30 16:12:51,789 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-129:ctx-ae046916 job-2/job-139) (logid:983ac3d9) Done with run of VM work job: com.cloud.vm.VmWorkStop for VM 42, job origin: 2
  73. 2017-10-30 16:12:51,789 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-129:ctx-ae046916 job-2/job-139) (logid:983ac3d9) Done executing com.cloud.vm.VmWorkStop for job-139
  74. 2017-10-30 16:12:51,790 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-129:ctx-ae046916 job-2/job-139) (logid:983ac3d9) Remove job-139 from job monitoring
  75. 2017-10-30 16:12:51,947 DEBUG [c.c.c.CapacityManagerImpl] (consoleproxy-1:ctx-1a3c95e0) (logid:74012c81) VM state transitted from :Stopped to Expunging with event: ExpungeOperationvm's original host id: null new host id: null host id before state transition: null
  76. 2017-10-30 16:12:51,948 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-1a3c95e0) (logid:74012c81) Destroying vm VM[ConsoleProxy|v-42-VM]
  77. 2017-10-30 16:12:51,948 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-1a3c95e0) (logid:74012c81) Cleaning up NICS
  78. 2017-10-30 16:12:51,948 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-1a3c95e0) (logid:74012c81) Cleaning network for vm: 42
  79. 2017-10-30 16:12:52,000 DEBUG [c.c.n.g.DirectNetworkGuru] (consoleproxy-1:ctx-1a3c95e0) (logid:74012c81) Deallocate network: networkId: 204, ip: 192.168.1.204
  80. 2017-10-30 16:12:52,002 DEBUG [c.c.n.g.DirectNetworkGuru] (consoleproxy-1:ctx-1a3c95e0) (logid:74012c81) remove nic 124 secondary ip
  81. 2017-10-30 16:12:52,062 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-1a3c95e0) (logid:74012c81) Removed nic id=124
  82. 2017-10-30 16:12:52,063 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-1a3c95e0) (logid:74012c81) Revoving nic secondary ip entry ...
  83. 2017-10-30 16:12:52,267 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-1a3c95e0) (logid:74012c81) Removed nic id=125
  84. 2017-10-30 16:12:52,268 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-1a3c95e0) (logid:74012c81) Revoving nic secondary ip entry ...
  85. 2017-10-30 16:12:52,334 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-1a3c95e0) (logid:74012c81) Removed nic id=126
  86. 2017-10-30 16:12:52,334 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-1a3c95e0) (logid:74012c81) Revoving nic secondary ip entry ...
  87. 2017-10-30 16:12:52,334 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-1a3c95e0) (logid:74012c81) Cleaning up hypervisor data structures (ex. SRs in XenServer) for managed storage
  88. 2017-10-30 16:12:52,334 DEBUG [o.a.c.e.o.VolumeOrchestrator] (consoleproxy-1:ctx-1a3c95e0) (logid:74012c81) Cleaning storage for vm: 42
  89. 2017-10-30 16:12:52,370 DEBUG [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-1a3c95e0) (logid:74012c81) Marking volume that was never created as destroyed: Vol[42|vm=42|ROOT]
  90. 2017-10-30 16:12:52,403 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-1a3c95e0) (logid:74012c81) Expunged VM[ConsoleProxy|v-42-VM]
  91. 2017-10-30 16:12:52,434 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-1a3c95e0) (logid:74012c81) received console proxy alert
  92. 2017-10-30 16:12:52,434 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-1a3c95e0) (logid:74012c81) Console proxy creation failure, zone: Zone1
  93. 2017-10-30 16:12:52,434 WARN [o.a.c.alerts] (consoleproxy-1:ctx-1a3c95e0) (logid:74012c81) alertType:: 10 // dataCenterId:: 1 // podId:: null // clusterId:: null // message:: Console proxy creation failure. zone: Zone1, error details: null
  94. 2017-10-30 16:12:52,473 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-6369da51) (logid:82cc1802) Zone 1 is ready to launch console proxy
  95. 2017-10-30 16:12:52,473 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-6369da51) (logid:82cc1802) Expand console proxy standby capacity for zone Zone1
  96. 2017-10-30 16:12:52,474 INFO [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-6369da51) (logid:82cc1802) No stopped console proxy is available, need to allocate a new console proxy
  97. 2017-10-30 16:12:52,474 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-6369da51) (logid:82cc1802) Assign console proxy from a newly started instance for request from data center : 1
  98. 2017-10-30 16:12:52,576 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-6369da51) (logid:82cc1802) Found existing network configuration for offering [Network Offering [6-Guest-DefaultSharedNetworkOfferingWithSGService]: Ntwk[204|Guest|6]
  99. 2017-10-30 16:12:52,576 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-6369da51) (logid:82cc1802) Releasing lock for Acct[b4328301-bd2f-11e7-b646-001e678b7b39-system]
  100. 2017-10-30 16:12:52,688 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-6369da51) (logid:82cc1802) Found existing network configuration for offering [Network Offering [3-Control-System-Control-Network]: Ntwk[202|Control|3]
  101. 2017-10-30 16:12:52,688 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-6369da51) (logid:82cc1802) Releasing lock for Acct[b4328301-bd2f-11e7-b646-001e678b7b39-system]
  102. 2017-10-30 16:12:52,832 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-6369da51) (logid:82cc1802) Found existing network configuration for offering [Network Offering [2-Management-System-Management-Network]: Ntwk[201|Management|2]
  103. 2017-10-30 16:12:52,832 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-6369da51) (logid:82cc1802) Releasing lock for Acct[b4328301-bd2f-11e7-b646-001e678b7b39-system]
  104. 2017-10-30 16:12:52,925 DEBUG [c.c.a.ApiServlet] (catalina-exec-3:ctx-2562a5cd) (logid:f6654f8b) ===START=== 192.168.1.149 -- GET command=listSystemVms&response=json&_=1509354772716
  105. 2017-10-30 16:12:52,941 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-6369da51) (logid:82cc1802) Allocating entries for VM: VM[ConsoleProxy|v-44-VM]
  106. 2017-10-30 16:12:52,941 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-6369da51) (logid:82cc1802) Allocating nics for VM[ConsoleProxy|v-44-VM]
  107. 2017-10-30 16:12:52,942 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-6369da51) (logid:82cc1802) Allocating nic for vm VM[ConsoleProxy|v-44-VM] in network Ntwk[204|Guest|6] with requested profile NicProfile[0-0-null-null-null
  108. 2017-10-30 16:12:52,944 DEBUG [c.c.a.ApiServlet] (catalina-exec-3:ctx-2562a5cd ctx-0b22b071) (logid:f6654f8b) ===END=== 192.168.1.149 -- GET command=listSystemVms&response=json&_=1509354772716
  109. 2017-10-30 16:12:52,946 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-6369da51) (logid:82cc1802) Allocating nic for vm VM[ConsoleProxy|v-44-VM] in network Ntwk[202|Control|3] with requested profile null
  110. 2017-10-30 16:12:52,948 DEBUG [o.a.c.e.o.NetworkOrchestrator] (consoleproxy-1:ctx-6369da51) (logid:82cc1802) Allocating nic for vm VM[ConsoleProxy|v-44-VM] in network Ntwk[201|Management|2] with requested profile null
  111. 2017-10-30 16:12:52,951 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-6369da51) (logid:82cc1802) Allocating disks for VM[ConsoleProxy|v-44-VM]
  112. 2017-10-30 16:12:52,980 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-6369da51) (logid:82cc1802) Allocation completed for VM: VM[ConsoleProxy|v-44-VM]
  113. 2017-10-30 16:12:53,007 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-6369da51) (logid:82cc1802) received console proxy alert
  114. 2017-10-30 16:12:53,007 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-6369da51) (logid:82cc1802) New console proxy created, zone: Zone1, proxy: v-44-VM, public IP: null, private IP: null
  115. 2017-10-30 16:12:53,087 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (consoleproxy-1:ctx-6369da51) (logid:82cc1802) Sync job-140 execution on object VmWorkJobQueue.44
  116. 2017-10-30 16:12:53,655 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-c0d782a9) (logid:3249211a) Execute sync-queue item: SyncQueueItemVO {id:130, queueId: 130, contentType: AsyncJob, contentId: 140, lastProcessMsid: 130586213177, lastprocessNumber: 1, lastProcessTime: Mon Oct 30 16:12:53 WIB 2017, created: Mon Oct 30 16:12:53 WIB 2017}
  117. 2017-10-30 16:12:53,656 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-c0d782a9) (logid:3249211a) Schedule queued job-140
  118. 2017-10-30 16:12:53,690 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140) (logid:b20fd58e) Add job-140 into job monitoring
  119. 2017-10-30 16:12:53,694 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140) (logid:983ac3d9) Executing AsyncJobVO {id:140, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAAAALHQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 130586213177, completeMsid: null, lastUpdated: null, lastPolled: null, created: Mon Oct 30 16:12:53 WIB 2017}
  120. 2017-10-30 16:12:53,695 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140) (logid:983ac3d9) Run VM work job: com.cloud.vm.VmWorkStart for VM 44, job origin: 2
  121. 2017-10-30 16:12:53,695 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) Execute VM work job: com.cloud.vm.VmWorkStart{"dcId":0,"userId":1,"accountId":1,"vmId":44,"handlerName":"VirtualMachineManagerImpl"}
  122. 2017-10-30 16:12:53,700 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
  123. 2017-10-30 16:12:53,700 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) Successfully transitioned to start state for VM[ConsoleProxy|v-44-VM] reservation id = f2c64e79-31d7-4e30-b53c-a4ba8f929f26
  124. 2017-10-30 16:12:53,802 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) Trying to deploy VM, vm has dcId: 1 and podId: null
  125. 2017-10-30 16:12:53,802 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) Deploy avoids pods: null, clusters: null, hosts: null
  126. 2017-10-30 16:12:53,804 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) Deploy avoids pods: null, clusters: null, hosts: null
  127. 2017-10-30 16:12:53,805 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@51ab0a47
  128. 2017-10-30 16:12:53,805 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) Trying to allocate a host and storage pools from dc:1, pod:null,cluster:null, requested cpu: 500, requested ram: 1073741824
  129. 2017-10-30 16:12:53,805 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) Is ROOT volume READY (pool already allocated)?: No
  130. 2017-10-30 16:12:53,805 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) Searching all possible resources under this Zone: 1
  131. 2017-10-30 16:12:53,805 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
  132. 2017-10-30 16:12:53,810 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) Checking resources in Cluster: 1 under Pod: 1
  133. 2017-10-30 16:12:53,810 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab FirstFitRoutingAllocator) (logid:983ac3d9) Looking for hosts in dc: 1 pod:1 cluster:1
  134. 2017-10-30 16:12:53,811 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab FirstFitRoutingAllocator) (logid:983ac3d9) FirstFitAllocator has 1 hosts to check for allocation: [Host[-1-Routing]]
  135. 2017-10-30 16:12:53,812 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab FirstFitRoutingAllocator) (logid:983ac3d9) Found 1 hosts for allocation after prioritization: [Host[-1-Routing]]
  136. 2017-10-30 16:12:53,812 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab FirstFitRoutingAllocator) (logid:983ac3d9) Looking for speed=500Mhz, Ram=1024
  137. 2017-10-30 16:12:53,815 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab FirstFitRoutingAllocator) (logid:983ac3d9) Host: 1 has cpu capability (cpu:8, speed:2533) to support requested CPU: 1 and requested speed: 500
  138. 2017-10-30 16:12:53,815 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab FirstFitRoutingAllocator) (logid:983ac3d9) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  139. 2017-10-30 16:12:53,816 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab FirstFitRoutingAllocator) (logid:983ac3d9) Hosts's actual total CPU: 20264 and CPU after applying overprovisioning: 20264
  140. 2017-10-30 16:12:53,816 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab FirstFitRoutingAllocator) (logid:983ac3d9) Free CPU: 19764 , Requested CPU: 500
  141. 2017-10-30 16:12:53,816 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab FirstFitRoutingAllocator) (logid:983ac3d9) Free RAM: 15207612416 , Requested RAM: 1073741824
  142. 2017-10-30 16:12:53,816 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab FirstFitRoutingAllocator) (logid:983ac3d9) Host has enough CPU and RAM available
  143. 2017-10-30 16:12:53,816 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab FirstFitRoutingAllocator) (logid:983ac3d9) STATS: Can alloc CPU from host: 1, used: 500, reserved: 0, actual total: 20264, total with overprovisioning: 20264; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  144. 2017-10-30 16:12:53,816 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab FirstFitRoutingAllocator) (logid:983ac3d9) STATS: Can alloc MEM from host: 1, used: 536870912, reserved: 0, total: 15744483328; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  145. 2017-10-30 16:12:53,816 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab FirstFitRoutingAllocator) (logid:983ac3d9) Found a suitable host, adding to list: 1
  146. 2017-10-30 16:12:53,816 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab FirstFitRoutingAllocator) (logid:983ac3d9) Host Allocator returning 1 suitable hosts
  147. 2017-10-30 16:12:53,817 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) Checking suitable pools for volume (Id, Type): (44,ROOT)
  148. 2017-10-30 16:12:53,817 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) We need to allocate new storagepool for this volume
  149. 2017-10-30 16:12:53,817 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) Calling StoragePoolAllocators to find suitable pools
  150. 2017-10-30 16:12:53,818 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) System VMs will use shared storage for zone id=1
  151. 2017-10-30 16:12:53,818 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) LocalStoragePoolAllocator trying to find storage pool to fit the vm
  152. 2017-10-30 16:12:53,818 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) ClusterScopeStoragePoolAllocator looking for storage pool
  153. 2017-10-30 16:12:53,818 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) Looking for pools in dc: 1 pod:1 cluster:1. Disabled pools will be ignored.
  154. 2017-10-30 16:12:53,818 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) Found pools matching tags: [Pool[2|NetworkFilesystem]]
  155. 2017-10-30 16:12:53,819 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) Checking if storage pool is suitable, name: null ,poolId: 2
  156. 2017-10-30 16:12:53,819 INFO [c.c.s.StorageManagerImpl] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) Storage pool null (2) does not supply IOPS capacity, assuming enough capacity
  157. 2017-10-30 16:12:53,820 DEBUG [c.c.s.StorageManagerImpl] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) Checking pool 2 for storage, totalSize: 1898486300672, usedBytes: 131072, usedPct: 6.904026642362652E-8, disable threshold: 0.85
  158. 2017-10-30 16:12:53,820 DEBUG [c.c.s.StorageManagerImpl] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) Destination pool id: 2
  159. 2017-10-30 16:12:53,833 DEBUG [c.c.s.StorageManagerImpl] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) pool id for the volume with id: 44 is null
  160. 2017-10-30 16:12:53,834 DEBUG [c.c.s.StorageManagerImpl] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) Found storage pool primary1 of type NetworkFilesystem with overprovisioning factor 2
  161. 2017-10-30 16:12:53,834 DEBUG [c.c.s.StorageManagerImpl] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) Total over provisioned capacity calculated is 2 * 1898486300672
  162. 2017-10-30 16:12:53,834 DEBUG [c.c.s.StorageManagerImpl] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) Total capacity of the pool primary1 id: 2 is 3796972601344
  163. 2017-10-30 16:12:53,834 DEBUG [c.c.s.StorageManagerImpl] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) Checking pool: 2 for volume allocation [Vol[44|vm=44|ROOT]], maxSize : 3796972601344, totalAllocatedSize : 0, askingSize : 0, allocated disable threshold: 0.85
  164. 2017-10-30 16:12:53,834 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
  165. 2017-10-30 16:12:53,834 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) Trying to find a potenial host and associated storage pools from the suitable host/pool lists for this VM
  166. 2017-10-30 16:12:53,834 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) Checking if host: 1 can access any suitable storage pool for volume: ROOT
  167. 2017-10-30 16:12:53,835 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) Host: 1 can access pool: 2
  168. 2017-10-30 16:12:53,835 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) Found a potential host id: 1 name: kvmhost01.xofap.com and associated storage pools for this VM
  169. 2017-10-30 16:12:53,835 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) Returning Deployment Destination: Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(1)-Storage(Volume(44|ROOT-->Pool(2))]
  170. 2017-10-30 16:12:53,835 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) Deployment found - P0=VM[ConsoleProxy|v-44-VM], P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(1)-Storage(Volume(44|ROOT-->Pool(2))]
  171. 2017-10-30 16:12:53,864 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) VM state transitted from :Starting to Starting with event: OperationRetryvm's original host id: null new host id: 1 host id before state transition: null
  172. 2017-10-30 16:12:53,867 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) Hosts's actual total CPU: 20264 and CPU after applying overprovisioning: 20264
  173. 2017-10-30 16:12:53,867 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) We are allocating VM, increasing the used capacity of this host:1
  174. 2017-10-30 16:12:53,867 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) Current Used CPU: 500 , Free CPU:19764 ,Requested CPU: 500
  175. 2017-10-30 16:12:53,867 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) Current Used RAM: 536870912 , Free RAM:15207612416 ,Requested RAM: 1073741824
  176. 2017-10-30 16:12:53,867 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) CPU STATS after allocation: for host: 1, old used: 500, old reserved: 0, actual total: 20264, total with overprovisioning: 20264; new used:1000, reserved:0; requested cpu:500,alloc_from_last:false
  177. 2017-10-30 16:12:53,867 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) RAM STATS after allocation: for host: 1, old used: 536870912, old reserved: 0, total: 15744483328; new used: 1610612736, reserved: 0; requested mem: 1073741824,alloc_from_last:false
  178. 2017-10-30 16:12:53,898 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) VM is being created in podId: 1
  179. 2017-10-30 16:12:53,901 DEBUG [o.a.c.e.o.NetworkOrchestrator] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) Network id=204 is already implemented
  180. 2017-10-30 16:12:54,020 DEBUG [o.a.c.e.o.NetworkOrchestrator] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) Asking VirtualRouter to prepare for Nic[130-44-f2c64e79-31d7-4e30-b53c-a4ba8f929f26-192.168.1.204]
  181. 2017-10-30 16:12:54,022 DEBUG [o.a.c.e.o.NetworkOrchestrator] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) Asking SecurityGroupProvider to prepare for Nic[130-44-f2c64e79-31d7-4e30-b53c-a4ba8f929f26-192.168.1.204]
  182. 2017-10-30 16:12:54,024 DEBUG [o.a.c.e.o.NetworkOrchestrator] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) Network id=202 is already implemented
  183. 2017-10-30 16:12:54,166 DEBUG [o.a.c.e.o.NetworkOrchestrator] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) Network id=201 is already implemented
  184. 2017-10-30 16:12:54,214 DEBUG [c.c.d.d.DataCenterIpAddressDaoImpl] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) Releasing ip address for instance=132
  185. 2017-10-30 16:12:54,247 DEBUG [c.c.n.g.PodBasedNetworkGuru] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) Allocated a nic NicProfile[132-44-f2c64e79-31d7-4e30-b53c-a4ba8f929f26-192.168.1.219-null for VM[ConsoleProxy|v-44-VM]
  186. 2017-10-30 16:12:54,282 DEBUG [o.a.c.e.o.VolumeOrchestrator] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) Checking if we need to prepare 1 volumes for VM[ConsoleProxy|v-44-VM]
  187. 2017-10-30 16:12:54,285 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) template 3 is already in store:1, type:Image
  188. 2017-10-30 16:12:54,287 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) template 3 is already in store:2, type:Primary
  189. 2017-10-30 16:12:54,416 DEBUG [o.a.c.s.m.AncientDataMotionStrategy] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) copyAsync inspecting src type TEMPLATE copyAsync inspecting dest type VOLUME
  190. 2017-10-30 16:12:54,419 DEBUG [c.c.h.o.r.Ovm3HypervisorGuru] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) getCommandHostDelegation: class org.apache.cloudstack.storage.command.CopyCommand
  191. 2017-10-30 16:12:54,419 DEBUG [c.c.h.XenServerGuru] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) getCommandHostDelegation: class org.apache.cloudstack.storage.command.CopyCommand
  192. 2017-10-30 16:12:54,420 DEBUG [c.c.a.t.Request] (Work-Job-Executor-130:ctx-ecd0abfc job-2/job-140 ctx-0f18a8ab) (logid:983ac3d9) Seq 1-7713258786802106450: Waiting for Seq 7713258786802106438 Scheduling: { Cmd , MgmtId: 130586213177, via: 1(kvmhost01.xofap.com), Ver: v1, Flags: 100111, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"c55a81c2-bd2d-11e7-a545-001e678b7b39","origUrl":"http://cloudstack.apt-get.eu/systemvm/4.6/systemvm64template-4.6.0-kvm.qcow2.bz2","uuid":"c55a81c2-bd2d-11e7-a545-001e678b7b39","id":3,"format":"QCOW2","accountId":1,"checksum":"c059b0d051e0cd6fbe9d5d4fc40c7e5d","hvm":false,"displayText":"SystemVM Template (KVM)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"b6bf2d91-6371-3d90-ae93-b8102ebc6a39","id":2,"poolType":"NetworkFilesystem","host":"192.168.1.214","path":"/primary","port":2049,"url":"NetworkFilesystem://192.168.1.214/primary/?ROLE=Primary&STOREUUID=b6bf2d91-6371-3d90-ae93-b8102ebc6a39"}},"name":"routing-3","hypervisorType":"KVM"}},"destTO":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"16092d1d-145c-494a-8957-f809f5a520be","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"b6bf2d91-6371-3d90-ae93-b8102ebc6a39","id":2,"poolType":"NetworkFilesystem","host":"192.168.1.214","path":"/primary","port":2049,"url":"NetworkFilesystem://192.168.1.214/primary/?ROLE=Primary&STOREUUID=b6bf2d91-6371-3d90-ae93-b8102ebc6a39"}},"name":"ROOT-44","size":0,"volumeId":44,"vmName":"v-44-VM","accountId":1,"format":"QCOW2","provisioningType":"THIN","id":44,"deviceId":0,"hypervisorType":"KVM"}},"executeInSequence":true,"options":{},"options2":{},"wait":0}}] }
  193. 2017-10-30 16:12:57,602 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-5bb87943) (logid:d42e6794) Begin cleanup expired async-jobs
  194. 2017-10-30 16:12:57,604 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-5bb87943) (logid:d42e6794) End cleanup expired async-jobs
  195. 2017-10-30 16:12:57,924 DEBUG [c.c.a.ApiServlet] (catalina-exec-8:ctx-25424d3c) (logid:3e5e31a5) ===START=== 192.168.1.149 -- GET command=listSystemVms&response=json&_=1509354777716
  196. 2017-10-30 16:12:57,960 DEBUG [c.c.a.ApiServlet] (catalina-exec-8:ctx-25424d3c ctx-cfe534fe) (logid:3e5e31a5) ===END=== 192.168.1.149 -- GET command=listSystemVms&response=json&_=1509354777716
  197. 2017-10-30 16:12:58,309 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-d39f6ce3) (logid:34ad5c04) Found 0 routers to update status.
  198. 2017-10-30 16:12:58,309 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-d39f6ce3) (logid:34ad5c04) Found 0 VPC networks to update Redundant State.
  199. 2017-10-30 16:12:58,310 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-d39f6ce3) (logid:34ad5c04) Found 0 networks to update RvR status.
  200. 2017-10-30 16:13:02,925 DEBUG [c.c.a.ApiServlet] (catalina-exec-7:ctx-dd54c466) (logid:8f471ec6) ===START=== 192.168.1.149 -- GET command=listSystemVms&response=json&_=1509354782716
  201. 2017-10-30 16:13:02,956 DEBUG [c.c.a.ApiServlet] (catalina-exec-7:ctx-dd54c466 ctx-e03dae43) (logid:8f471ec6) ===END=== 192.168.1.149 -- GET command=listSystemVms&response=json&_=1509354782716
  202. 2017-10-30 16:13:07,602 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-6927e483) (logid:f3a21f2b) Begin cleanup expired async-jobs
  203. 2017-10-30 16:13:07,604 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-6927e483) (logid:f3a21f2b) End cleanup expired async-jobs
  204. 2017-10-30 16:13:07,924 DEBUG [c.c.a.ApiServlet] (catalina-exec-5:ctx-4d5ffacb) (logid:c0a235b8) ===START=== 192.168.1.149 -- GET command=listSystemVms&response=json&_=1509354787716
  205. 2017-10-30 16:13:07,955 DEBUG [c.c.a.ApiServlet] (catalina-exec-5:ctx-4d5ffacb ctx-50125a16) (logid:c0a235b8) ===END=== 192.168.1.149 -- GET command=listSystemVms&response=json&_=1509354787716
  206. 2017-10-30 16:13:12,925 DEBUG [c.c.a.ApiServlet] (catalina-exec-9:ctx-ae799d94) (logid:fe458dad) ===START=== 192.168.1.149 -- GET command=listSystemVms&response=json&_=1509354792716
  207. 2017-10-30 16:13:12,957 DEBUG [c.c.a.ApiServlet] (catalina-exec-9:ctx-ae799d94 ctx-45193290) (logid:fe458dad) ===END=== 192.168.1.149 -- GET command=listSystemVms&response=json&_=1509354792716
  208. 2017-10-30 16:13:16,309 WARN [o.a.c.f.j.i.AsyncJobMonitor] (Timer-1:ctx-435cc44a) (logid:162458e8) Task (job-138) has been pending for 322 seconds
  209. 2017-10-30 16:13:17,602 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-f784c915) (logid:5b6d876d) Begin cleanup expired async-jobs
  210. 2017-10-30 16:13:17,604 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-f784c915) (logid:5b6d876d) End cleanup expired async-jobs
  211. 2017-10-30 16:13:17,925 DEBUG [c.c.a.ApiServlet] (catalina-exec-10:ctx-324621aa) (logid:4c176383) ===START=== 192.168.1.149 -- GET command=listSystemVms&response=json&_=1509354797716
  212. 2017-10-30 16:13:17,956 DEBUG [c.c.a.ApiServlet] (catalina-exec-10:ctx-324621aa ctx-ef41e077) (logid:4c176383) ===END=== 192.168.1.149 -- GET command=listSystemVms&response=json&_=1509354797716
  213. 2017-10-30 16:13:22,925 DEBUG [c.c.a.ApiServlet] (catalina-exec-14:ctx-ca61b19f) (logid:3b7e61b2) ===START=== 192.168.1.149 -- GET command=listSystemVms&response=json&_=1509354802716
  214. 2017-10-30 16:13:22,957 DEBUG [c.c.a.ApiServlet] (catalina-exec-14:ctx-ca61b19f ctx-14161282) (logid:3b7e61b2) ===END=== 192.168.1.149 -- GET command=listSystemVms&response=json&_=1509354802716
  215. 2017-10-30 16:13:27,602 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-e70474cf) (logid:de8b520a) Begin cleanup expired async-jobs
  216. 2017-10-30 16:13:27,604 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-e70474cf) (logid:de8b520a) End cleanup expired async-jobs
  217. 2017-10-30 16:13:27,925 DEBUG [c.c.a.ApiServlet] (catalina-exec-13:ctx-8ad538a1) (logid:4cb4c575) ===START=== 192.168.1.149 -- GET command=listSystemVms&response=json&_=1509354807716
  218. 2017-10-30 16:13:27,956 DEBUG [c.c.a.ApiServlet] (catalina-exec-13:ctx-8ad538a1 ctx-c4bc94e5) (logid:4cb4c575) ===END=== 192.168.1.149 -- GET command=listSystemVms&response=json&_=1509354807716
  219. 2017-10-30 16:13:28,309 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-051bd2bd) (logid:83c8d8af) Found 0 routers to update status.
  220. 2017-10-30 16:13:28,316 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-051bd2bd) (logid:83c8d8af) Found 0 VPC networks to update Redundant State.
  221. 2017-10-30 16:13:28,317 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-051bd2bd) (logid:83c8d8af) Found 0 networks to update RvR status.
  222. 2017-10-30 16:13:29,719 DEBUG [c.c.s.StatsCollector] (StatsCollector-6:ctx-3ead8f41) (logid:016b6521) HostStatsCollector is running...
  223. 2017-10-30 16:13:29,730 DEBUG [c.c.a.t.Request] (StatsCollector-6:ctx-3ead8f41) (logid:016b6521) Seq 1-7713258786802106451: Received: { Ans: , MgmtId: 130586213177, via: 1(kvmhost01.xofap.com), Ver: v1, Flags: 10, { GetHostStatsAnswer } }
  224. 2017-10-30 16:13:29,741 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-13:null) (logid:) Ping from 1(kvmhost01.xofap.com)
  225. 2017-10-30 16:13:29,742 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (AgentManager-Handler-13:null) (logid:) Process host VM state report from ping process. host: 1
  226. 2017-10-30 16:13:29,742 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (AgentManager-Handler-13:null) (logid:) Process VM state report. host: 1, number of records in report: 0
  227. 2017-10-30 16:13:29,743 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (AgentManager-Handler-13:null) (logid:) Run missing VM report. current time: 1509354809743
  228. 2017-10-30 16:13:29,744 WARN [c.c.v.VirtualMachinePowerStateSyncImpl] (AgentManager-Handler-13:null) (logid:) VM state was updated but update time is null?! vm id: 43
  229. 2017-10-30 16:13:29,744 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (AgentManager-Handler-13:null) (logid:) Detected missing VM. host: 1, vm id: 43, power state: PowerReportMissing, last state update: 1509354809743
  230. 2017-10-30 16:13:29,744 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (AgentManager-Handler-13:null) (logid:) vm id: 43 - time since last state update(0ms) has not passed graceful period yet
  231. 2017-10-30 16:13:29,745 WARN [c.c.v.VirtualMachinePowerStateSyncImpl] (AgentManager-Handler-13:null) (logid:) VM state was updated but update time is null?! vm id: 44
  232. 2017-10-30 16:13:29,745 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (AgentManager-Handler-13:null) (logid:) Detected missing VM. host: 1, vm id: 44, power state: PowerReportMissing, last state update: 1509354809743
  233. 2017-10-30 16:13:29,745 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (AgentManager-Handler-13:null) (logid:) vm id: 44 - time since last state update(0ms) has not passed graceful period yet
  234. 2017-10-30 16:13:29,745 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (AgentManager-Handler-13:null) (logid:) Done with process of VM state report. host: 1
  235. 2017-10-30 16:13:30,560 DEBUG [c.c.s.StatsCollector] (StatsCollector-4:ctx-f66078fd) (logid:6054b2d4) StorageCollector is running...
  236. 2017-10-30 16:13:30,563 DEBUG [c.c.s.StatsCollector] (StatsCollector-4:ctx-f66078fd) (logid:6054b2d4) There is no secondary storage VM for secondary storage host nfs://192.168.1.214/secondary
  237. 2017-10-30 16:13:30,564 DEBUG [c.c.h.o.r.Ovm3HypervisorGuru] (StatsCollector-4:ctx-f66078fd) (logid:6054b2d4) getCommandHostDelegation: class com.cloud.agent.api.GetStorageStatsCommand
  238. 2017-10-30 16:13:30,564 DEBUG [c.c.h.XenServerGuru] (StatsCollector-4:ctx-f66078fd) (logid:6054b2d4) getCommandHostDelegation: class com.cloud.agent.api.GetStorageStatsCommand
  239. 2017-10-30 16:13:30,624 DEBUG [c.c.a.t.Request] (StatsCollector-4:ctx-f66078fd) (logid:6054b2d4) Seq 1-7713258786802106452: Received: { Ans: , MgmtId: 130586213177, via: 1(kvmhost01.xofap.com), Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
  240. 2017-10-30 16:13:32,821 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-dd02f038) (logid:7a5f8794) Resetting hosts suitable for reconnect
  241. 2017-10-30 16:13:32,821 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-dd02f038) (logid:7a5f8794) Completed resetting hosts suitable for reconnect
  242. 2017-10-30 16:13:32,822 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-dd02f038) (logid:7a5f8794) Acquiring hosts for clusters already owned by this management server
  243. 2017-10-30 16:13:32,822 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-dd02f038) (logid:7a5f8794) Completed acquiring hosts for clusters already owned by this management server
  244. 2017-10-30 16:13:32,822 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-dd02f038) (logid:7a5f8794) Acquiring hosts for clusters not owned by any management server
  245. 2017-10-30 16:13:32,822 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-dd02f038) (logid:7a5f8794) Completed acquiring hosts for clusters not owned by any management server
Advertisement
Add Comment
Please, Sign In to add comment