sonali_jadhav

BUg_ACS4.5.1

Jul 9th, 2015
291
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 46.15 KB | None | 0 0
  1. [root@CSMgmt01 ~]# tail -f /var/log/cloudstack/management/management-server.log
  2. 2015-07-09 14:26:47,053 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-437:ctx-83fc6554) Seq 4-1439744505875005884: MgmtId 249373720971888: Resp: Routing to peer
  3. 2015-07-09 14:26:47,071 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-452:ctx-a9dcaef1) Seq 5-199847233464566413: Executing request
  4. 2015-07-09 14:26:47,115 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-452:ctx-a9dcaef1) Seq 5-199847233464566413: Response Received:
  5. 2015-07-09 14:26:47,115 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-452:ctx-a9dcaef1) Seq 5-199847233464566413: MgmtId 249373720971888: Resp: Routing to peer
  6. 2015-07-09 14:26:48,046 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-4:null) SeqA 11-89046: Processing Seq 11-89046: { Cmd , MgmtId: -1, via: 11, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":80,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
  7. 2015-07-09 14:26:48,095 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-4:null) SeqA 11-89046: Sending Seq 11-89046: { Ans: , MgmtId: 59778234354585, via: 11, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
  8. 2015-07-09 14:26:50,720 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-2a1bf1c3) Begin cleanup expired async-jobs
  9. 2015-07-09 14:26:50,730 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-2a1bf1c3) End cleanup expired async-jobs
  10. 2015-07-09 14:26:50,881 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-bdd4d42b) Found 11 routers to update status.
  11. 2015-07-09 14:26:50,883 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-bdd4d42b) Found 0 networks to update RvR status.
  12. 2015-07-09 14:26:57,520 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-af59808f) Resetting hosts suitable for reconnect
  13. 2015-07-09 14:26:57,523 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-af59808f) Completed resetting hosts suitable for reconnect
  14. 2015-07-09 14:26:57,523 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-af59808f) Acquiring hosts for clusters already owned by this management server
  15. 2015-07-09 14:26:57,525 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-af59808f) Completed acquiring hosts for clusters already owned by this management server
  16. 2015-07-09 14:26:57,525 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-af59808f) Acquiring hosts for clusters not owned by any management server
  17. 2015-07-09 14:26:57,525 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-af59808f) Completed acquiring hosts for clusters not owned by any management server
  18. 2015-07-09 14:26:58,009 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-10:null) SeqA 11-89047: Processing Seq 11-89047: { Cmd , MgmtId: -1, via: 11, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":80,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
  19. 2015-07-09 14:26:58,055 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-10:null) SeqA 11-89047: Sending Seq 11-89047: { Ans: , MgmtId: 59778234354585, via: 11, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
  20. 2015-07-09 14:26:59,207 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgentCronJob-47:ctx-d3279a21) Ping from 5(SeSolXS03)
  21. 2015-07-09 14:26:59,208 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-47:ctx-d3279a21) Process host VM state report from ping process. host: 5
  22. 2015-07-09 14:26:59,218 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-47:ctx-d3279a21) Process VM state report. host: 5, number of records in report: 3
  23. 2015-07-09 14:26:59,218 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-47:ctx-d3279a21) VM state report. host: 5, vm id: 34, power state: PowerOn
  24. 2015-07-09 14:26:59,222 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-47:ctx-d3279a21) VM power state does not change, skip DB writing. vm id: 34
  25. 2015-07-09 14:26:59,222 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-47:ctx-d3279a21) VM state report. host: 5, vm id: 32, power state: PowerOn
  26. 2015-07-09 14:26:59,227 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-47:ctx-d3279a21) VM power state does not change, skip DB writing. vm id: 32
  27. 2015-07-09 14:26:59,227 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-47:ctx-d3279a21) VM state report. host: 5, vm id: 31, power state: PowerOn
  28. 2015-07-09 14:26:59,231 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-47:ctx-d3279a21) VM power state does not change, skip DB writing. vm id: 31
  29. 2015-07-09 14:26:59,235 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-47:ctx-d3279a21) Done with process of VM state report. host: 5
  30. 2015-07-09 14:26:59,282 DEBUG [c.c.s.StatsCollector] (StatsCollector-1:ctx-f4eb40ed) AutoScaling Monitor is running...
  31. 2015-07-09 14:27:00,078 DEBUG [c.c.a.ApiServlet] (http-6443-exec-6:ctx-57ba06ba) ===START=== 100.10.134.114 -- GET command=prepareHostForMaintenance&id=c3c78959-6387-4cc9-8f59-23d44d2257a8&response=json&sessionkey=CKs86aKuYTrqGpOtTh9Nkn%2Frelg%3D&_=1436444821608
  32. 2015-07-09 14:27:00,193 INFO [o.a.c.f.j.i.AsyncJobMonitor] (API-Job-Executor-107:ctx-4f5d495d job-4088) Add job-4088 into job monitoring
  33. 2015-07-09 14:27:00,205 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (http-6443-exec-6:ctx-57ba06ba ctx-b431bbdb) submit async job-4088, details: AsyncJobVO {id:4088, userId: 2, accountId: 2, instanceType: Host, instanceId: 5, cmd: org.apache.cloudstack.api.command.admin.host.PrepareForMaintenanceCmd, cmdInfo: {"response":"json","id":"c3c78959-6387-4cc9-8f59-23d44d2257a8","sessionkey":"CKs86aKuYTrqGpOtTh9Nkn/relg\u003d","ctxDetails":"{\"com.cloud.host.Host\":\"c3c78959-6387-4cc9-8f59-23d44d2257a8\"}","cmdEventType":"MAINT.PREPARE","ctxUserId":"2","httpmethod":"GET","_":"1436444821608","uuid":"c3c78959-6387-4cc9-8f59-23d44d2257a8","ctxAccountId":"2","ctxStartEventId":"11908"}, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 59778234354585, completeMsid: null, lastUpdated: null, lastPolled: null, created: null}
  34. 2015-07-09 14:27:00,205 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-107:ctx-4f5d495d job-4088) Executing AsyncJobVO {id:4088, userId: 2, accountId: 2, instanceType: Host, instanceId: 5, cmd: org.apache.cloudstack.api.command.admin.host.PrepareForMaintenanceCmd, cmdInfo: {"response":"json","id":"c3c78959-6387-4cc9-8f59-23d44d2257a8","sessionkey":"CKs86aKuYTrqGpOtTh9Nkn/relg\u003d","ctxDetails":"{\"com.cloud.host.Host\":\"c3c78959-6387-4cc9-8f59-23d44d2257a8\"}","cmdEventType":"MAINT.PREPARE","ctxUserId":"2","httpmethod":"GET","_":"1436444821608","uuid":"c3c78959-6387-4cc9-8f59-23d44d2257a8","ctxAccountId":"2","ctxStartEventId":"11908"}, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 59778234354585, completeMsid: null, lastUpdated: null, lastPolled: null, created: null}
  35. 2015-07-09 14:27:00,206 DEBUG [c.c.a.ApiServlet] (http-6443-exec-6:ctx-57ba06ba ctx-b431bbdb) ===END=== 100.10.134.114 -- GET command=prepareHostForMaintenance&id=c3c78959-6387-4cc9-8f59-23d44d2257a8&response=json&sessionkey=CKs86aKuYTrqGpOtTh9Nkn%2Frelg%3D&_=1436444821608
  36. 2015-07-09 14:27:00,234 DEBUG [c.c.a.t.Request] (API-Job-Executor-107:ctx-4f5d495d job-4088 ctx-5921f0d2) Seq 5-1214283049529770767: Sending { Cmd , MgmtId: 59778234354585, via: 5(SeSolXS03), Ver: v1, Flags: 100111, [{"com.cloud.agent.api.MaintainCommand":{"wait":0}}] }
  37. 2015-07-09 14:27:00,234 DEBUG [c.c.a.t.Request] (API-Job-Executor-107:ctx-4f5d495d job-4088 ctx-5921f0d2) Seq 5-1214283049529770767: Executing: { Cmd , MgmtId: 59778234354585, via: 5(SeSolXS03), Ver: v1, Flags: 100111, [{"com.cloud.agent.api.MaintainCommand":{"wait":0}}] }
  38. 2015-07-09 14:27:00,235 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-446:ctx-c315e3b1) Seq 5-1214283049529770767: Executing request
  39. 2015-07-09 14:27:00,266 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-446:ctx-c315e3b1) Seq 5-1214283049529770767: Response Received:
  40. 2015-07-09 14:27:00,267 DEBUG [c.c.a.t.Request] (DirectAgent-446:ctx-c315e3b1) Seq 5-1214283049529770767: Processing: { Ans: , MgmtId: 59778234354585, via: 5, Ver: v1, Flags: 110, [{"com.cloud.agent.api.MaintainAnswer":{"willMigrate":true,"result":true,"wait":0}}] }
  41. 2015-07-09 14:27:00,267 DEBUG [c.c.a.m.AgentAttache] (DirectAgent-446:ctx-c315e3b1) Seq 5-1214283049529770767: No more commands found
  42. 2015-07-09 14:27:00,267 DEBUG [c.c.a.t.Request] (API-Job-Executor-107:ctx-4f5d495d job-4088 ctx-5921f0d2) Seq 5-1214283049529770767: Received: { Ans: , MgmtId: 59778234354585, via: 5, Ver: v1, Flags: 110, { MaintainAnswer } }
  43. 2015-07-09 14:27:00,365 DEBUG [c.c.r.ResourceState] (API-Job-Executor-107:ctx-4f5d495d job-4088 ctx-5921f0d2) Resource state update: [id = 5; name = SeSolXS03; old state = Enabled; event = AdminAskMaintenace; new state = PrepareForMaintenance]
  44. 2015-07-09 14:27:00,534 INFO [c.c.h.HighAvailabilityManagerImpl] (HA-Worker-1:ctx-105d205a work-72) Processing HAWork[72-Migration-31-Running-Scheduled]
  45. 2015-07-09 14:27:00,633 WARN [o.a.c.f.j.AsyncJobExecutionContext] (HA-Worker-1:ctx-105d205a work-72) Job is executed without a context, setup psudo job for the executing thread
  46. 2015-07-09 14:27:00,651 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (HA-Worker-1:ctx-105d205a work-72) Sync job-4089 execution on object VmWorkJobQueue.31
  47. 2015-07-09 14:27:00,678 INFO [c.c.h.HighAvailabilityManagerImpl] (HA-Worker-2:ctx-68459b74 work-73) Processing HAWork[73-Migration-32-Running-Scheduled]
  48. 2015-07-09 14:27:00,739 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-667c217c) Begin cleanup expired async-jobs
  49. 2015-07-09 14:27:00,751 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-667c217c) End cleanup expired async-jobs
  50. 2015-07-09 14:27:00,862 WARN [o.a.c.f.j.AsyncJobExecutionContext] (HA-Worker-2:ctx-68459b74 work-73) Job is executed without a context, setup psudo job for the executing thread
  51. 2015-07-09 14:27:00,877 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (HA-Worker-2:ctx-68459b74 work-73) Sync job-4090 execution on object VmWorkJobQueue.32
  52. 2015-07-09 14:27:00,908 INFO [c.c.h.HighAvailabilityManagerImpl] (HA-Worker-3:ctx-6ee7e62f work-74) Processing HAWork[74-Migration-34-Running-Scheduled]
  53. 2015-07-09 14:27:01,147 WARN [o.a.c.f.j.AsyncJobExecutionContext] (HA-Worker-3:ctx-6ee7e62f work-74) Job is executed without a context, setup psudo job for the executing thread
  54. 2015-07-09 14:27:01,162 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (HA-Worker-3:ctx-6ee7e62f work-74) Sync job-4091 execution on object VmWorkJobQueue.34
  55. 2015-07-09 14:27:01,191 DEBUG [c.c.r.ResourceManagerImpl] (API-Job-Executor-107:ctx-4f5d495d job-4088 ctx-5921f0d2) Sent resource event EVENT_PREPARE_MAINTENANCE_AFTER to listener CapacityManagerImpl
  56. 2015-07-09 14:27:01,206 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-107:ctx-4f5d495d job-4088 ctx-5921f0d2) Complete async job-4088, jobStatus: SUCCEEDED, resultCode: 0, result: org.apache.cloudstack.api.response.HostResponse/host/{"id":"c3c78959-6387-4cc9-8f59-23d44d2257a8","name":"SeSolXS03","state":"Up","disconnected":"2015-07-03T12:13:06+0200","type":"Routing","ipaddress":"172.16.5.188","zoneid":"1baf17c9-8325-4fa6-bffc-e502a33b578b","zonename":"Solna","podid":"07de38ee-b63f-4285-819c-8abbdc392ab0","podname":"SeSolRack1","version":"4.5.1","hypervisor":"XenServer","cpusockets":2,"cpunumber":24,"cpuspeed":2400,"cpuallocated":"0%","cpuused":"0%","cpuwithoverprovisioning":"57600.0","networkkbsread":0,"networkkbswrite":0,"memorytotal":95574311424,"memoryallocated":0,"memoryused":13790400,"capabilities":"xen-3.0-x86_64 , xen-3.0-x86_32p , hvm-3.0-x86_32 , hvm-3.0-x86_32p , hvm-3.0-x86_64","lastpinged":"1970-01-17T06:39:19+0100","managementserverid":59778234354585,"clusterid":"fe15e305-5c11-4785-a13d-e4581e23f5e7","clustername":"SeSolCluster1","clustertype":"CloudManaged","islocalstorageactive":false,"created":"2015-01-27T10:55:13+0100","events":"ManagementServerDown; AgentConnected; Ping; Remove; AgentDisconnected; HostDown; ShutdownRequested; StartAgentRebalance; PingTimeout","resourcestate":"PrepareForMaintenance","hypervisorversion":"6.2.0","hahost":false,"jobid":"7ad72023-a16f-4abf-84a3-83dd0e9f6bfd","jobstatus":0}
  57. 2015-07-09 14:27:01,208 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-107:ctx-4f5d495d job-4088 ctx-5921f0d2) Publish async job-4088 complete on message bus
  58. 2015-07-09 14:27:01,208 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-107:ctx-4f5d495d job-4088 ctx-5921f0d2) Wake up jobs related to job-4088
  59. 2015-07-09 14:27:01,209 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-107:ctx-4f5d495d job-4088 ctx-5921f0d2) Update db status for job-4088
  60. 2015-07-09 14:27:01,211 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-107:ctx-4f5d495d job-4088 ctx-5921f0d2) Wake up jobs joined with job-4088 and disjoin all subjobs created from job- 4088
  61. 2015-07-09 14:27:01,386 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-107:ctx-4f5d495d job-4088) Done executing org.apache.cloudstack.api.command.admin.host.PrepareForMaintenanceCmd for job-4088
  62. 2015-07-09 14:27:01,389 INFO [o.a.c.f.j.i.AsyncJobMonitor] (API-Job-Executor-107:ctx-4f5d495d job-4088) Remove job-4088 from job monitoring
  63. 2015-07-09 14:27:02,755 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-1c99f7cd) Execute sync-queue item: SyncQueueItemVO {id:2326, queueId: 251, contentType: AsyncJob, contentId: 4091, lastProcessMsid: 59778234354585, lastprocessNumber: 193, lastProcessTime: Thu Jul 09 14:27:02 CEST 2015, created: Thu Jul 09 14:27:01 CEST 2015}
  64. 2015-07-09 14:27:02,758 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-1c99f7cd) Schedule queued job-4091
  65. 2015-07-09 14:27:02,810 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-65:ctx-82ed9c8f job-3573/job-4091) Add job-4091 into job monitoring
  66. 2015-07-09 14:27:02,819 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-65:ctx-82ed9c8f job-3573/job-4091) Executing AsyncJobVO {id:4091, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkMigrateAway, cmdInfo: rO0ABXNyAB5jb20uY2xvdWQudm0uVm1Xb3JrTWlncmF0ZUF3YXmt4MX4jtcEmwIAAUoACXNyY0hvc3RJZHhyABNjb20uY2xvdWQudm0uVm1Xb3Jrn5m2VvAlZ2sCAARKAAlhY2NvdW50SWRKAAZ1c2VySWRKAAR2bUlkTAALaGFuZGxlck5hbWV0ABJMamF2YS9sYW5nL1N0cmluZzt4cAAAAAAAAAABAAAAAAAAAAEAAAAAAAAAInQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAABQ, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 59778234354585, completeMsid: null, lastUpdated: null, lastPolled: null, created: Thu Jul 09 14:27:01 CEST 2015}
  67. 2015-07-09 14:27:02,820 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-65:ctx-82ed9c8f job-3573/job-4091) Run VM work job: com.cloud.vm.VmWorkMigrateAway for VM 34, job origin: 3573
  68. 2015-07-09 14:27:02,822 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-65:ctx-82ed9c8f job-3573/job-4091 ctx-744a984e) Execute VM work job: com.cloud.vm.VmWorkMigrateAway{"srcHostId":5,"userId":1,"accountId":1,"vmId":34,"handlerName":"VirtualMachineManagerImpl"}
  69. 2015-07-09 14:27:02,852 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-65:ctx-82ed9c8f job-3573/job-4091 ctx-744a984e) Deploy avoids pods: [], clusters: [], hosts: [5]
  70. 2015-07-09 14:27:02,855 ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-65:ctx-82ed9c8f job-3573/job-4091 ctx-744a984e) Invocation exception, caused by: java.lang.NullPointerException
  71. 2015-07-09 14:27:02,855 INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-65:ctx-82ed9c8f job-3573/job-4091 ctx-744a984e) Rethrow exception java.lang.NullPointerException
  72. 2015-07-09 14:27:02,855 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-65:ctx-82ed9c8f job-3573/job-4091) Done with run of VM work job: com.cloud.vm.VmWorkMigrateAway for VM 34, job origin: 3573
  73. 2015-07-09 14:27:02,855 ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-65:ctx-82ed9c8f job-3573/job-4091) Unable to complete AsyncJobVO {id:4091, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkMigrateAway, cmdInfo: rO0ABXNyAB5jb20uY2xvdWQudm0uVm1Xb3JrTWlncmF0ZUF3YXmt4MX4jtcEmwIAAUoACXNyY0hvc3RJZHhyABNjb20uY2xvdWQudm0uVm1Xb3Jrn5m2VvAlZ2sCAARKAAlhY2NvdW50SWRKAAZ1c2VySWRKAAR2bUlkTAALaGFuZGxlck5hbWV0ABJMamF2YS9sYW5nL1N0cmluZzt4cAAAAAAAAAABAAAAAAAAAAEAAAAAAAAAInQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAABQ, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 59778234354585, completeMsid: null, lastUpdated: null, lastPolled: null, created: Thu Jul 09 14:27:01 CEST 2015}, job origin:3573
  74. java.lang.NullPointerException
  75. at com.cloud.deploy.DeploymentPlanningManagerImpl.planDeployment(DeploymentPlanningManagerImpl.java:292)
  76. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateMigrateAway(VirtualMachineManagerImpl.java:2376)
  77. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateMigrateAway(VirtualMachineManagerImpl.java:4517)
  78. at sun.reflect.GeneratedMethodAccessor563.invoke(Unknown Source)
  79. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  80. at java.lang.reflect.Method.invoke(Method.java:606)
  81. at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
  82. at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4636)
  83. at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:103)
  84. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
  85. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  86. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  87. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  88. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  89. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  90. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
  91. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  92. at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  93. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  94. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  95. at java.lang.Thread.run(Thread.java:744)
  96. 2015-07-09 14:27:02,863 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-65:ctx-82ed9c8f job-3573/job-4091) Complete async job-4091, jobStatus: FAILED, resultCode: 0, result: rO0ABXNyAB5qYXZhLmxhbmcuTnVsbFBvaW50ZXJFeGNlcHRpb25HpaGO_zHhuAIAAHhyABpqYXZhLmxhbmcuUnVudGltZUV4Y2VwdGlvbp5fBkcKNIPlAgAAeHIAE2phdmEubGFuZy5FeGNlcHRpb27Q_R8-GjscxAIAAHhyABNqYXZhLmxhbmcuVGhyb3dhYmxl1cY1Jzl3uMsDAARMAAVjYXVzZXQAFUxqYXZhL2xhbmcvVGhyb3dhYmxlO0wADWRldGFpbE1lc3NhZ2V0ABJMamF2YS9sYW5nL1N0cmluZztbAApzdGFja1RyYWNldAAeW0xqYXZhL2xhbmcvU3RhY2tUcmFjZUVsZW1lbnQ7TAAUc3VwcHJlc3NlZEV4Y2VwdGlvbnN0ABBMamF2YS91dGlsL0xpc3Q7eHBxAH4ACHB1cgAeW0xqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnQ7AkYqPDz9IjkCAAB4cAAAABVzcgAbamF2YS5sYW5nLlN0YWNrVHJhY2VFbGVtZW50YQnFmiY23YUCAARJAApsaW5lTnVtYmVyTAAOZGVjbGFyaW5nQ2xhc3NxAH4ABUwACGZpbGVOYW1lcQB-AAVMAAptZXRob2ROYW1lcQB-AAV4cAAAASR0AC5jb20uY2xvdWQuZGVwbG95LkRlcGxveW1lbnRQbGFubmluZ01hbmFnZXJJbXBsdAAiRGVwbG95bWVudFBsYW5uaW5nTWFuYWdlckltcGwuamF2YXQADnBsYW5EZXBsb3ltZW50c3EAfgALAAAJSHQAJmNvbS5jbG91ZC52bS5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsdAAeVmlydHVhbE1hY2hpbmVNYW5hZ2VySW1wbC5qYXZhdAAWb3JjaGVzdHJhdGVNaWdyYXRlQXdheXNxAH4ACwAAEaVxAH4AEXEAfgAScQB-ABNzcQB-AAv_____dAAmc3VuLnJlZmxlY3QuR2VuZXJhdGVkTWV0aG9kQWNjZXNzb3I1NjNwdAAGaW52b2tlc3EAfgALAAAAK3QAKHN1bi5yZWZsZWN0LkRlbGVnYXRpbmdNZXRob2RBY2Nlc3NvckltcGx0ACFEZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsLmphdmFxAH4AF3NxAH4ACwAAAl50ABhqYXZhLmxhbmcucmVmbGVjdC5NZXRob2R0AAtNZXRob2QuamF2YXEAfgAXc3EAfgALAAAAa3QAImNvbS5jbG91ZC52bS5WbVdvcmtKb2JIYW5kbGVyUHJveHl0ABpWbVdvcmtKb2JIYW5kbGVyUHJveHkuamF2YXQAD2hhbmRsZVZtV29ya0pvYnNxAH4ACwAAEhxxAH4AEXEAfgAScQB-ACFzcQB-AAsAAABndAAgY29tLmNsb3VkLnZtLlZtV29ya0pvYkRpc3BhdGNoZXJ0ABhWbVdvcmtKb2JEaXNwYXRjaGVyLmphdmF0AAZydW5Kb2JzcQB-AAsAAAIZdAA_b3JnLmFwYWNoZS5jbG91ZHN0YWNrLmZyYW1ld29yay5qb2JzLmltcGwuQXN5bmNKb2JNYW5hZ2VySW1wbCQ1dAAYQXN5bmNKb2JNYW5hZ2VySW1wbC5qYXZhdAAMcnVuSW5Db250ZXh0c3EAfgALAAAAMXQAPm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZSQxdAAbTWFuYWdlZENvbnRleHRSdW5uYWJsZS5qYXZhdAADcnVuc3EAfgALAAAAOHQAQm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5EZWZhdWx0TWFuYWdlZENvbnRleHQkMXQAGkRlZmF1bHRNYW5hZ2VkQ29udGV4dC5qYXZhdAAEY2FsbHNxAH4ACwAAAGd0AEBvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0cQB-ADF0AA9jYWxsV2l0aENvbnRleHRzcQB-AAsAAAA1cQB-ADRxAH4AMXQADnJ1bldpdGhDb250ZXh0c3EAfgALAAAALnQAPG9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZXEAfgAtcQB-AC5zcQB-AAsAAAHucQB-AChxAH4AKXEAfgAuc3EAfgALAAAB13QALmphdmEudXRpbC5jb25jdXJyZW50LkV4ZWN1dG9ycyRSdW5uYWJsZUFkYXB0ZXJ0AA5FeGVjdXRvcnMuamF2YXEAfgAyc3EAfgALAAABBnQAH2phdmEudXRpbC5jb25jdXJyZW50LkZ1dHVyZVRhc2t0AA9GdXR1cmVUYXNrLmphdmFxAH4ALnNxAH4ACwAABHl0ACdqYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3J0ABdUaHJlYWRQb29sRXhlY3V0b3IuamF2YXQACXJ1bldvcmtlcnNxAH4ACwAAAmd0AC5qYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3IkV29ya2VycQB-AENxAH4ALnNxAH4ACwAAAuh0ABBqYXZhLmxhbmcuVGhyZWFkdAALVGhyZWFkLmphdmFxAH4ALnNyACZqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlTGlzdPwPJTG17I4QAgABTAAEbGlzdHEAfgAHeHIALGphdmEudXRpbC5Db2xsZWN0aW9ucyRVbm1vZGlmaWFibGVDb2xsZWN0aW9uGUIAgMte9x4CAAFMAAFjdAAWTGphdmEvdXRpbC9Db2xsZWN0aW9uO3hwc3IAE2phdmEudXRpbC5BcnJheUxpc3R4gdIdmcdhnQMAAUkABHNpemV4cAAAAAB3BAAAAAB4cQB-AE94
  97. 2015-07-09 14:27:02,866 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-65:ctx-82ed9c8f job-3573/job-4091) Publish async job-4091 complete on message bus
  98. 2015-07-09 14:27:02,866 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-65:ctx-82ed9c8f job-3573/job-4091) Wake up jobs related to job-4091
  99. 2015-07-09 14:27:02,866 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-65:ctx-82ed9c8f job-3573/job-4091) Update db status for job-4091
  100. 2015-07-09 14:27:02,868 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-65:ctx-82ed9c8f job-3573/job-4091) Wake up jobs joined with job-4091 and disjoin all subjobs created from job- 4091
  101. 2015-07-09 14:27:02,918 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-65:ctx-82ed9c8f job-3573/job-4091) Done executing com.cloud.vm.VmWorkMigrateAway for job-4091
  102. 2015-07-09 14:27:02,926 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-65:ctx-82ed9c8f job-3573/job-4091) Remove job-4091 from job monitoring
  103. 2015-07-09 14:27:02,979 WARN [c.c.h.HighAvailabilityManagerImpl] (HA-Worker-3:ctx-6ee7e62f work-74) Encountered unhandled exception during HA process, reschedule retry
  104. java.lang.NullPointerException
  105. at com.cloud.deploy.DeploymentPlanningManagerImpl.planDeployment(DeploymentPlanningManagerImpl.java:292)
  106. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateMigrateAway(VirtualMachineManagerImpl.java:2376)
  107. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateMigrateAway(VirtualMachineManagerImpl.java:4517)
  108. at sun.reflect.GeneratedMethodAccessor563.invoke(Unknown Source)
  109. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  110. at java.lang.reflect.Method.invoke(Method.java:606)
  111. at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
  112. at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4636)
  113. at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:103)
  114. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
  115. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  116. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  117. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  118. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  119. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  120. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
  121. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  122. at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  123. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  124. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  125. at java.lang.Thread.run(Thread.java:744)
  126. 2015-07-09 14:27:02,980 INFO [c.c.h.HighAvailabilityManagerImpl] (HA-Worker-3:ctx-6ee7e62f work-74) Rescheduling HAWork[74-Migration-34-Running-Migrating] to try again at Thu Jul 09 14:37:16 CEST 2015
  127. 2015-07-09 14:27:03,008 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-14:null) SeqA 11-89048: Processing Seq 11-89048: { Cmd , MgmtId: -1, via: 11, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":80,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
  128. 2015-07-09 14:27:03,027 WARN [c.c.h.HighAvailabilityManagerImpl] (HA-Worker-2:ctx-68459b74 work-73) Encountered unhandled exception during HA process, reschedule retry
  129. java.lang.NullPointerException
  130. at com.cloud.deploy.DeploymentPlanningManagerImpl.planDeployment(DeploymentPlanningManagerImpl.java:292)
  131. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateMigrateAway(VirtualMachineManagerImpl.java:2376)
  132. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateMigrateAway(VirtualMachineManagerImpl.java:4517)
  133. at sun.reflect.GeneratedMethodAccessor299.invoke(Unknown Source)
  134. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  135. at java.lang.reflect.Method.invoke(Method.java:606)
  136. at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
  137. at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4636)
  138. at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:103)
  139. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
  140. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  141. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  142. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  143. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  144. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  145. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
  146. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  147. at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  148. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  149. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  150. at java.lang.Thread.run(Thread.java:744)
  151. 2015-07-09 14:27:03,030 INFO [c.c.h.HighAvailabilityManagerImpl] (HA-Worker-2:ctx-68459b74 work-73) Rescheduling HAWork[73-Migration-32-Running-Migrating] to try again at Thu Jul 09 14:37:16 CEST 2015
  152. 2015-07-09 14:27:03,075 WARN [c.c.h.HighAvailabilityManagerImpl] (HA-Worker-1:ctx-105d205a work-72) Encountered unhandled exception during HA process, reschedule retry
  153. java.lang.NullPointerException
  154. at com.cloud.deploy.DeploymentPlanningManagerImpl.planDeployment(DeploymentPlanningManagerImpl.java:292)
  155. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateMigrateAway(VirtualMachineManagerImpl.java:2376)
  156. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateMigrateAway(VirtualMachineManagerImpl.java:4517)
  157. at sun.reflect.GeneratedMethodAccessor299.invoke(Unknown Source)
  158. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  159. at java.lang.reflect.Method.invoke(Method.java:606)
  160. at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
  161. at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4636)
  162. at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:103)
  163. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
  164. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  165. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  166. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  167. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  168. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  169. at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
  170. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  171. at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  172. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  173. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  174. at java.lang.Thread.run(Thread.java:744)
  175. 2015-07-09 14:27:03,076 INFO [c.c.h.HighAvailabilityManagerImpl] (HA-Worker-1:ctx-105d205a work-72) Rescheduling HAWork[72-Migration-31-Running-Migrating] to try again at Thu Jul 09 14:37:16 CEST 2015
  176. 2015-07-09 14:27:03,165 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-14:null) SeqA 11-89048: Sending Seq 11-89048: { Ans: , MgmtId: 59778234354585, via: 11, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
  177. 2015-07-09 14:27:03,542 DEBUG [c.c.a.ApiServlet] (http-6443-exec-8:ctx-04a064f4) ===START=== 100.10.134.114 -- GET command=queryAsyncJobResult&jobId=7ad72023-a16f-4abf-84a3-83dd0e9f6bfd&response=json&sessionkey=CKs86aKuYTrqGpOtTh9Nkn%2Frelg%3D&_=1436444825072
  178. 2015-07-09 14:27:03,620 DEBUG [c.c.a.ApiServlet] (http-6443-exec-8:ctx-04a064f4 ctx-922ed733) ===END=== 100.10.134.114 -- GET command=queryAsyncJobResult&jobId=7ad72023-a16f-4abf-84a3-83dd0e9f6bfd&response=json&sessionkey=CKs86aKuYTrqGpOtTh9Nkn%2Frelg%3D&_=1436444825072
  179. 2015-07-09 14:27:03,971 DEBUG [c.c.a.ApiServlet] (http-6443-exec-7:ctx-a4b451af) ===START=== 100.10.134.114 -- GET command=listZones&response=json&sessionkey=CKs86aKuYTrqGpOtTh9Nkn%2Frelg%3D&id=1baf17c9-8325-4fa6-bffc-e502a33b578b&_=1436444825503
  180. 2015-07-09 14:27:03,997 DEBUG [c.c.a.ApiServlet] (http-6443-exec-7:ctx-a4b451af ctx-8c6d3236) ===END=== 100.10.134.114 -- GET command=listZones&response=json&sessionkey=CKs86aKuYTrqGpOtTh9Nkn%2Frelg%3D&id=1baf17c9-8325-4fa6-bffc-e502a33b578b&_=1436444825503
  181. 2015-07-09 14:27:04,336 DEBUG [c.c.a.ApiServlet] (http-6443-exec-12:ctx-79eacf0c) ===START=== 100.10.134.114 -- GET command=listHosts&id=c3c78959-6387-4cc9-8f59-23d44d2257a8&response=json&sessionkey=CKs86aKuYTrqGpOtTh9Nkn%2Frelg%3D&_=1436444825868
  182. 2015-07-09 14:27:04,347 DEBUG [c.c.a.q.QueryManagerImpl] (http-6443-exec-12:ctx-79eacf0c ctx-5c363b5c) >>>Searching for hosts>>>
  183. 2015-07-09 14:27:04,357 DEBUG [c.c.a.q.QueryManagerImpl] (http-6443-exec-12:ctx-79eacf0c ctx-5c363b5c) >>>Generating Response>>>
  184. 2015-07-09 14:27:04,366 DEBUG [c.c.a.ApiServlet] (http-6443-exec-12:ctx-79eacf0c ctx-5c363b5c) ===END=== 100.10.134.114 -- GET command=listHosts&id=c3c78959-6387-4cc9-8f59-23d44d2257a8&response=json&sessionkey=CKs86aKuYTrqGpOtTh9Nkn%2Frelg%3D&_=1436444825868
  185. 2015-07-09 14:27:04,710 DEBUG [c.c.a.ApiServlet] (http-6443-exec-1:ctx-00a582c9) ===START=== 100.10.134.114 -- GET command=listDedicatedHosts&hostid=c3c78959-6387-4cc9-8f59-23d44d2257a8&response=json&sessionkey=CKs86aKuYTrqGpOtTh9Nkn%2Frelg%3D&_=1436444826240
  186. 2015-07-09 14:27:04,725 DEBUG [c.c.a.ApiServlet] (http-6443-exec-1:ctx-00a582c9 ctx-86a95c0e) ===END=== 100.10.134.114 -- GET command=listDedicatedHosts&hostid=c3c78959-6387-4cc9-8f59-23d44d2257a8&response=json&sessionkey=CKs86aKuYTrqGpOtTh9Nkn%2Frelg%3D&_=1436444826240
  187. 2015-07-09 14:27:05,046 DEBUG [c.c.a.ApiServlet] (http-6443-exec-6:ctx-31927c48) ===START=== 100.10.134.114 -- GET command=listConfigurations&name=ha.tag&response=json&sessionkey=CKs86aKuYTrqGpOtTh9Nkn%2Frelg%3D&_=1436444826577
  188. 2015-07-09 14:27:05,064 DEBUG [c.c.a.ApiServlet] (http-6443-exec-6:ctx-31927c48 ctx-a5b30873) ===END=== 100.10.134.114 -- GET command=listConfigurations&name=ha.tag&response=json&sessionkey=CKs86aKuYTrqGpOtTh9Nkn%2Frelg%3D&_=1436444826577
  189. 2015-07-09 14:27:05,394 DEBUG [c.c.a.ApiServlet] (http-6443-exec-8:ctx-98516472) ===START=== 100.10.134.114 -- GET command=listOsCategories&response=json&sessionkey=CKs86aKuYTrqGpOtTh9Nkn%2Frelg%3D&_=1436444826926
  190. 2015-07-09 14:27:05,409 DEBUG [c.c.a.ApiServlet] (http-6443-exec-8:ctx-98516472 ctx-cae488c1) ===END=== 100.10.134.114 -- GET command=listOsCategories&response=json&sessionkey=CKs86aKuYTrqGpOtTh9Nkn%2Frelg%3D&_=1436444826926
  191. 2015-07-09 14:27:06,486 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-71b00281) Zone 1 is ready to launch secondary storage VM
  192. 2015-07-09 14:27:06,712 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-9bce827c) Zone 1 is ready to launch console proxy
  193. 2015-07-09 14:27:10,720 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-96532ab5) Begin cleanup expired async-jobs
  194. 2015-07-09 14:27:10,730 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-96532ab5) End cleanup expired async-jobs
  195. 2015-07-09 14:27:13,010 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-3:null) SeqA 11-89049: Processing Seq 11-89049: { Cmd , MgmtId: -1, via: 11, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":80,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
  196. 2015-07-09 14:27:13,055 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-3:null) SeqA 11-89049: Sending Seq 11-89049: { Ans: , MgmtId: 59778234354585, via: 11, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
  197. 2015-07-09 14:27:18,009 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-11:null) SeqA 11-89050: Processing Seq 11-89050: { Cmd , MgmtId: -1, via: 11, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":80,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
  198. 2015-07-09 14:27:18,057 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-11:null) SeqA 11-89050: Sending Seq 11-89050: { Ans: , MgmtId: 59778234354585, via: 11, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
  199. 2015-07-09 14:27:19,097 DEBUG [c.c.s.StatsCollector] (StatsCollector-2:ctx-bbec189b) StorageCollector is running...
  200. 2015-07-09 14:27:19,158 DEBUG [c.c.a.t.Request] (StatsCollector-2:ctx-bbec189b) Seq 10-3037959423638118975: Received: { Ans: , MgmtId: 59778234354585, via: 10, Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
  201. 2015-07-09 14:27:19,163 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-447:ctx-223d2d7a) Seq 4-5299892336484942354: Executing request
  202. 2015-07-09 14:27:19,698 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-447:ctx-223d2d7a) Seq 4-5299892336484942354: Response Received:
  203. 2015-07-09 14:27:19,698 DEBUG [c.c.a.t.Request] (StatsCollector-2:ctx-bbec189b) Seq 4-5299892336484942354: Received: { Ans: , MgmtId: 59778234354585, via: 4, Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
  204. 2015-07-09 14:27:20,719 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-98d93e59) Begin cleanup expired async-jobs
  205. 2015-07-09 14:27:20,730 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-98d93e59) End cleanup expired async-jobs
  206. 2015-07-09 14:27:20,881 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-41bc49c0) Found 11 routers to update status.
  207. 2015-07-09 14:27:20,883 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-41bc49c0) Found 0 networks to update RvR status.
  208. 2015-07-09 14:27:28,011 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-15:null) SeqA 11-89051: Processing Seq 11-89051: { Cmd , MgmtId: -1, via: 11, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":80,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
  209. 2015-07-09 14:27:28,078 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-15:null) SeqA 11-89051: Sending Seq 11-89051: { Ans: , MgmtId: 59778234354585, via: 11, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
  210. 2015-07-09 14:27:28,715 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgentCronJob-369:ctx-a59be56c) Ping from 1(SeSolXS01)
  211. 2015-07-09 14:27:28,715 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-369:ctx-a59be56c) Process host VM state report from ping process. host: 1
  212. 2015-07-09 14:27:28,748 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-369:ctx-a59be56c) Process VM state report. host: 1, number of records in report: 10
  213. 2015-07-09 14:27:28,749 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-369:ctx-a59be56c) VM state report. host: 1, vm id: 35, power state: PowerOn
  214. 2015-07-09 14:27:28,752 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-369:ctx-a59be56c) VM power state does not change, skip DB writing. vm id: 35
  215. 2015-07-09 14:27:28,753 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-369:ctx-a59be56c) VM state report. host: 1, vm id: 87, power state: PowerOn
  216. 2015-07-09 14:27:28,757 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-369:ctx-a59be56c) VM power state does not change, skip DB writing. vm id: 87
  217. 2015-07-09 14:27:28,757 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-369:ctx-a59be56c) VM state report. host: 1, vm id: 81, power state: PowerOn
  218. 2015-07-09 14:27:28,761 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-369:ctx-a59be56c) VM power state does not change, skip DB writing. vm id: 81
  219. 2015-07-09 14:27:28,761 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-369:ctx-a59be56c) VM state report. host: 1, vm id: 39, power state: PowerOn
  220. 2015-07-09 14:27:28,765 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-369:ctx-a59be56c) VM power state does not change, skip DB writing. vm id: 39
  221. 2015-07-09 14:27:28,765 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-369:ctx-a59be56c) VM state report. host: 1, vm id: 40, power state: PowerOn
  222. 2015-07-09 14:27:28,769 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-369:ctx-a59be56c) VM power state does not change, skip DB writing. vm id: 40
  223. 2015-07-09 14:27:28,769 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-369:ctx-a59be56c) VM state report. host: 1, vm id: 79, power state: PowerOn
  224. 2015-07-09 14:27:28,773 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-369:ctx-a59be56c) VM power state does not change, skip DB writing. vm id: 79
  225. 2015-07-09 14:27:28,773 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-369:ctx-a59be56c) VM state report. host: 1, vm id: 88, power state: PowerOn
  226. 2015-07-09 14:27:28,777 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-369:ctx-a59be56c) VM power state does not change, skip DB writing. vm id: 88
  227. 2015-07-09 14:27:28,777 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-369:ctx-a59be56c) VM state report. host: 1, vm id: 91, power state: PowerOn
  228. 2015-07-09 14:27:28,781 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-369:ctx-a59be56c) VM power state does not change, skip DB writing. vm id: 91
  229. 2015-07-09 14:27:28,781 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-369:ctx-a59be56c) VM state report. host: 1, vm id: 90, power state: PowerOn
  230. 2015-07-09 14:27:28,785 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-369:ctx-a59be56c) VM power state does not change, skip DB writing. vm id: 90
  231. 2015-07-09 14:27:28,785 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-369:ctx-a59be56c) VM state report. host: 1, vm id: 30, power state: PowerOn
  232. 2015-07-09 14:27:28,789 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-369:ctx-a59be56c) VM power state does not change, skip DB writing. vm id: 30
  233. 2015-07-09 14:27:28,799 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-369:ctx-a59be56c) Done with process of VM state report. host: 1
  234. 2015-07-09 14:27:28,840 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgentCronJob-93:ctx-6fbddfb4) Ping from 6(SeSolXS04)
  235. 2015-07-09 14:27:28,840 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-93:ctx-6fbddfb4) Process host VM state report from ping process. host: 6
  236. 2015-07-09 14:27:28,840 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-93:ctx-6fbddfb4) Process VM state report. host: 6, number of records in report: 0
  237. 2015-07-09 14:27:28,842 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-93:ctx-6fbddfb4) Done with process of VM state report. host: 6
  238. 2015-07-09 14:27:29,530 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgentCronJob-363:ctx-d480707a) Ping from 4(SeSolXS02)
  239. 2015-07-09 14:27:29,530 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-363:ctx-d480707a) Process host VM state report from ping process. host: 4
  240. 2015-07-09 14:27:29,543 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-363:ctx-d480707a) Process VM state report. host: 4, number of records in report: 4
  241. 2015-07-09 14:27:29,543 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-363:ctx-d480707a) VM state report. host: 4, vm id: 80, power state: PowerOn
  242. 2015-07-09 14:27:29,547 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-363:ctx-d480707a) VM power state does not change, skip DB writing. vm id: 80
  243. 2015-07-09 14:27:29,547 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-363:ctx-d480707a) VM state report. host: 4, vm id: 6, power state: PowerOn
  244. 2015-07-09 14:27:29,551 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-363:ctx-d480707a) VM power state does not change, skip DB writing. vm id: 6
  245. 2015-07-09 14:27:29,551 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-363:ctx-d480707a) VM state report. host: 4, vm id: 28, power state: PowerOn
  246. 2015-07-09 14:27:29,555 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-363:ctx-d480707a) VM power state does not change, skip DB writing. vm id: 28
  247. 2015-07-09 14:27:29,555 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-363:ctx-d480707a) VM state report. host: 4, vm id: 14, power state: PowerOn
  248. 2015-07-09 14:27:29,559 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-363:ctx-d480707a) VM power state does not change, skip DB writing. vm id: 14
  249. 2015-07-09 14:27:29,565 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (DirectAgentCronJob-363:ctx-d480707a) Done with process of VM state report. host: 4
  250. 2015-07-09 14:27:30,719 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-22efe9fb) Begin cleanup expired async-jobs
  251. 2015-07-09 14:27:30,730 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-22efe9fb) End cleanup expired async-jobs
  252. 2015-07-09 14:27:35,031 DEBUG [c.c.a.m.ClusteredAgentAttache] (AgentManager-Handler-6:null) Seq 10-2327516582420423019: Routing from 249373720971888
  253. 2015-07-09 14:27:35,079 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (AgentManager-Handler-5:null) Seq 10-2327516582420423019: MgmtId 249373720971888: Resp: Routing to peer
  254. 2015-07-09 14:27:35,088 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-453:ctx-37533df8) Seq 1-1147010530095924037: Executing request
  255. 2015-07-09 14:27:35,594 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-453:ctx-37533df8) Seq 1-1147010530095924037: Response Received:
  256. 2015-07-09 14:27:35,595 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-453:ctx-37533df8) Seq 1-1147010530095924037: MgmtId 249373720971888: Resp: Routing to peer
  257. 2015-07-09 14:27:35,791 DEBUG [c.c.s.StatsCollector] (StatsCollector-4:ctx-0a009a92) VmStatsCollector is running...
  258. 2015-07-09 14:27:35,823 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-113:ctx-2877f8a1) Seq 1-1244400872037811363: Executing request
  259. 2015-07-09 14:27:35,872 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-113:ctx-2877f8a1) Vm cpu utilization 0.11638888888888888
  260. 2015-07-09 14:27:35,872 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-113:ctx-2877f8a1) Vm cpu utilization 0.5297222222222221
  261. 2015-07-09 14:27:35,873 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-113:ctx-2877f8a1) Vm cpu utilization 0.11472222222222223
  262. 2015-07-09 14:27:35,873 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-113:ctx-2877f8a1) Vm cpu utilization 0.13069444444444445
  263. 2015-07-09 14:27:35,873 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-113:ctx-2877f8a1) Seq 1-1244400872037811363: Response Received:
  264. 2015-07-09 14:27:35,873 DEBUG [c.c.a.t.Request] (StatsCollector-4:ctx-0a009a92) Seq 1-1244400872037811363: Received: { Ans: , MgmtId: 59778234354585, via: 1, Ver: v1, Flags: 10, { GetVmStatsAnswer } }
  265. 2015-07-09 14:27:36,486 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-5c215006) Zone 1 is ready to launch secondary storage VM
  266. 2015-07-09 14:27:36,604 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-13:null) Ping from 10
  267. 2015-07-09 14:27:36,711 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-767440d4) Zone 1 is ready to launch console proxy
  268. 2015-07-09 14:27:38,011 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-1:null) SeqA 11-89052: Processing Seq 11-89052: { Cmd , MgmtId: -1, via: 11, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":80,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
  269. 2015-07-09 14:27:38,055 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-1:null) SeqA 11-89052: Sending Seq 11-89052: { Ans: , MgmtId: 59778234354585, via: 11, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
  270. ^C
Advertisement
Add Comment
Please, Sign In to add comment