API tools faq
paste
Guest User

CloudStack-3535-continued

a guest
Aug 28th, 2013
239
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 104.55 KB | None | 0 0
raw download clone embed print report
  1. 2013-08-28 15:52:37,338 DEBUG [cloud.ha.UserVmDomRInvestigator] (AgentTaskPool-2:null) sending ping from (6) to agent's host ip address (10.0.100.62)
  2. 2013-08-28 15:52:37,339 DEBUG [agent.manager.AgentAttache] (AgentTaskPool-14:null) Seq 3-837681681: Sending disconnect to class com.cloud.agent.manager.SynchronousListener
  3. 2013-08-28 15:52:37,339 DEBUG [agent.manager.AgentAttache] (StatsCollector-3:null) Seq 3-837681681: Waiting some more time because this is the current command
  4. 2013-08-28 15:52:37,339 DEBUG [agent.manager.AgentAttache] (StatsCollector-3:null) Seq 3-837681681: Waiting some more time because this is the current command
  5. 2013-08-28 15:52:37,339 INFO [utils.exception.CSExceptionErrorCode] (StatsCollector-3:null) Could not find exception: com.cloud.exception.OperationTimedoutException in error code list for exceptions
  6. 2013-08-28 15:52:37,339 DEBUG [agent.manager.AgentManagerImpl] (AgentTaskPool-14:null) Sending Disconnect to listener: com.cloud.hypervisor.xen.discoverer.XcpServerDiscoverer_EnhancerByCloudStack_640675db
  7. 2013-08-28 15:52:37,340 DEBUG [agent.manager.AgentManagerImpl] (AgentTaskPool-14:null) Sending Disconnect to listener: com.cloud.deploy.DeploymentPlanningManagerImpl_EnhancerByCloudStack_2acb0051
  8. 2013-08-28 15:52:37,340 DEBUG [agent.manager.AgentManagerImpl] (AgentTaskPool-14:null) Sending Disconnect to listener: com.cloud.network.NetworkManagerImpl_EnhancerByCloudStack_3c5c11e4
  9. 2013-08-28 15:52:37,340 DEBUG [agent.manager.AgentManagerImpl] (AgentTaskPool-14:null) Sending Disconnect to listener: com.cloud.storage.secondary.SecondaryStorageListener
  10. 2013-08-28 15:52:37,340 DEBUG [agent.manager.AgentManagerImpl] (AgentTaskPool-14:null) Sending Disconnect to listener: com.cloud.network.security.SecurityGroupListener
  11. 2013-08-28 15:52:37,341 DEBUG [agent.manager.AgentManagerImpl] (AgentTaskPool-14:null) Sending Disconnect to listener: com.cloud.storage.listener.StoragePoolMonitor
  12. 2013-08-28 15:52:37,341 DEBUG [agent.manager.AgentManagerImpl] (AgentTaskPool-14:null) Sending Disconnect to listener: com.cloud.vm.ClusteredVirtualMachineManagerImpl_EnhancerByCloudStack_691cc2e8
  13. 2013-08-28 15:52:37,341 DEBUG [agent.manager.AgentManagerImpl] (AgentTaskPool-14:null) Sending Disconnect to listener: com.cloud.storage.LocalStoragePoolListener
  14. 2013-08-28 15:52:37,341 DEBUG [agent.manager.AgentManagerImpl] (AgentTaskPool-14:null) Sending Disconnect to listener: com.cloud.network.SshKeysDistriMonitor
  15. 2013-08-28 15:52:37,341 DEBUG [agent.manager.AgentManagerImpl] (AgentTaskPool-14:null) Sending Disconnect to listener: com.cloud.network.router.VirtualNetworkApplianceManagerImpl_EnhancerByCloudStack_28e2f89
  16. 2013-08-28 15:52:37,341 DEBUG [agent.manager.AgentManagerImpl] (AgentTaskPool-14:null) Sending Disconnect to listener: com.cloud.network.SshKeysDistriMonitor
  17. 2013-08-28 15:52:37,341 DEBUG [agent.manager.AgentManagerImpl] (AgentTaskPool-14:null) Sending Disconnect to listener: com.cloud.network.router.VpcVirtualNetworkApplianceManagerImpl_EnhancerByCloudStack_7d71f7ac
  18. 2013-08-28 15:52:37,341 DEBUG [agent.manager.AgentManagerImpl] (AgentTaskPool-14:null) Sending Disconnect to listener: com.cloud.storage.upload.UploadListener
  19. 2013-08-28 15:52:37,341 DEBUG [agent.manager.AgentManagerImpl] (AgentTaskPool-14:null) Sending Disconnect to listener: com.cloud.storage.download.DownloadListener
  20. 2013-08-28 15:52:37,341 DEBUG [agent.manager.AgentManagerImpl] (AgentTaskPool-14:null) Sending Disconnect to listener: com.cloud.agent.manager.AgentMonitor
  21. 2013-08-28 15:52:37,341 DEBUG [agent.manager.AgentManagerImpl] (AgentTaskPool-14:null) Sending Disconnect to listener: com.cloud.capacity.StorageCapacityListener
  22. 2013-08-28 15:52:37,341 DEBUG [agent.manager.AgentManagerImpl] (AgentTaskPool-14:null) Sending Disconnect to listener: com.cloud.capacity.ComputeCapacityListener
  23. 2013-08-28 15:52:37,341 DEBUG [agent.manager.AgentManagerImpl] (AgentTaskPool-14:null) Sending Disconnect to listener: com.cloud.network.NetworkUsageManagerImpl$DirectNetworkStatsListener
  24. 2013-08-28 15:52:37,341 DEBUG [cloud.network.NetworkUsageManagerImpl] (AgentTaskPool-14:null) Disconnected called on 3 with status Down
  25. 2013-08-28 15:52:37,342 DEBUG [agent.manager.AgentManagerImpl] (AgentTaskPool-14:null) Sending Disconnect to listener: com.cloud.consoleproxy.ConsoleProxyListener
  26. 2013-08-28 15:52:37,342 DEBUG [cloud.host.Status] (AgentTaskPool-14:null) Transition:[Resource state = Enabled, Agent event = HostDown, Host id = 3, name = KVM-42-16616]
  27. 2013-08-28 15:52:37,341 DEBUG [agent.transport.Request] (AgentTaskPool-2:null) Seq 6-1333919781: Sending { Cmd , MgmtId: 345049337494, via: 6, Ver: v1, Flags: 100011, [{"com.cloud.agent.api.PingTestCommand":{"_computingHostIp":"10.0.100.62","wait":20}}] }
  28. 2013-08-28 15:52:37,340 WARN [agent.manager.AgentAttache] (StatsCollector-3:null) Seq 3-837681681: Timed out on null
  29. 2013-08-28 15:52:37,342 DEBUG [agent.manager.AgentAttache] (StatsCollector-3:null) Seq 3-837681681: Cancelling.
  30. 2013-08-28 15:52:37,342 DEBUG [cloud.storage.StorageManagerImpl] (StatsCollector-3:null) Unable to send storage pool command to Pool[1|NetworkFilesystem] via 3
  31. com.cloud.exception.OperationTimedoutException: Commands 837681681 to Host 3 timed out after 3600
  32. at com.cloud.agent.manager.AgentAttache.send(AgentAttache.java:430)
  33. at com.cloud.agent.manager.AgentManagerImpl.send(AgentManagerImpl.java:486)
  34. at com.cloud.agent.manager.AgentManagerImpl.send(AgentManagerImpl.java:439)
  35. at com.cloud.storage.StorageManagerImpl.sendToPool(StorageManagerImpl.java:1061)
  36. at com.cloud.storage.StorageManagerImpl.sendToPool(StorageManagerImpl.java:441)
  37. at com.cloud.storage.StorageManagerImpl.sendToPool(StorageManagerImpl.java:455)
  38. at com.cloud.server.StatsCollector$StorageCollector.run(StatsCollector.java:562)
  39. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  40. at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351)
  41. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178)
  42. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165)
  43. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267)
  44. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
  45. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  46. at java.lang.Thread.run(Thread.java:679)
  47. 2013-08-28 15:52:37,353 DEBUG [cloud.host.Status] (AgentTaskPool-14:null) Agent status update: [id = 3; name = KVM-42-16616; old status = Up; event = HostDown; new status = Down; old update count = 2; new update count = 3]
  48. 2013-08-28 15:52:37,353 DEBUG [agent.manager.ClusteredAgentManagerImpl] (AgentTaskPool-14:null) Notifying other nodes of to disconnect
  49. 2013-08-28 15:52:37,355 WARN [cloud.ha.HighAvailabilityManagerImpl] (AgentTaskPool-14:null) Scheduling restart for VMs on host 3
  50. 2013-08-28 15:52:37,357 WARN [apache.cloudstack.alerts] (AgentTaskPool-14:null) alertType:: 7 // dataCenterId:: 1 // podId:: 1 // clusterId:: null // message:: Host is down, name: KVM-42-16616 (id:3), availability zone: TestZone, pod: P1
  51. 2013-08-28 15:52:37,362 DEBUG [cloud.ha.HighAvailabilityManagerImpl] (AgentTaskPool-14:null) Notifying HA Mgr of to restart vm 3-HA-Test1
  52. 2013-08-28 15:52:37,366 INFO [cloud.ha.HighAvailabilityManagerImpl] (AgentTaskPool-14:null) Schedule vm for HA: VM[User|HA-Test1]
  53. 2013-08-28 15:52:37,373 DEBUG [agent.manager.ClusteredAgentManagerImpl] (AgentTaskPool-14:null) Notifying other nodes of to disconnect
  54. 2013-08-28 15:52:37,374 INFO [cloud.ha.HighAvailabilityManagerImpl] (HA-Worker-0:work-2) Processing HAWork[2-HA-3-Running-Investigating]
  55. 2013-08-28 15:52:37,378 INFO [cloud.ha.HighAvailabilityManagerImpl] (HA-Worker-0:work-2) HA on VM[User|HA-Test1]
  56. 2013-08-28 15:52:37,381 DEBUG [cloud.ha.CheckOnAgentInvestigator] (HA-Worker-0:work-2) Unable to reach the agent for VM[User|HA-Test1]: Resource [Host:3] is unreachable: Host 3: Host with specified id is not in the right state: Down
  57. 2013-08-28 15:52:37,381 INFO [cloud.ha.HighAvailabilityManagerImpl] (HA-Worker-0:work-2) SimpleInvestigator found VM[User|HA-Test1]to be alive? null
  58. 2013-08-28 15:52:37,381 INFO [cloud.ha.HighAvailabilityManagerImpl] (HA-Worker-0:work-2) XenServerInvestigator found VM[User|HA-Test1]to be alive? null
  59. 2013-08-28 15:52:37,381 DEBUG [cloud.ha.UserVmDomRInvestigator] (HA-Worker-0:work-2) testing if VM[User|HA-Test1] is alive
  60. 2013-08-28 15:52:37,388 DEBUG [agent.transport.Request] (HA-Worker-0:work-2) Seq 6-1333919784: Sending { Cmd , MgmtId: 345049337494, via: 6, Ver: v1, Flags: 100011, [{"com.cloud.agent.api.PingTestCommand":{"_routerIp":"169.254.1.176","_privateIp":"192.168.1.3","wait":20}}] }
  61. 2013-08-28 15:52:37,626 DEBUG [agent.transport.Request] (StatsCollector-3:null) Seq 6-1333919782: Received: { Ans: , MgmtId: 345049337494, via: 6, Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
  62. 2013-08-28 15:52:37,893 DEBUG [agent.transport.Request] (StatsCollector-2:null) Seq 6-1333919783: Received: { Ans: , MgmtId: 345049337494, via: 6, Ver: v1, Flags: 10, { GetHostStatsAnswer } }
  63. 2013-08-28 15:52:38,048 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-12:null) SeqA 5-3221: Processing Seq 5-3221: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":2,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
  64. 2013-08-28 15:52:38,055 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-12:null) SeqA 5-3221: Sending Seq 5-3221: { Ans: , MgmtId: 345049337494, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
  65. 2013-08-28 15:52:38,177 DEBUG [cloud.api.ApiServlet] (catalina-exec-12:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=ba2a348a-ca6c-4c20-b692-327701fe9da4&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701543309
  66. 2013-08-28 15:52:38,186 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-12:null) Async job-12 = [ ba2a348a-ca6c-4c20-b692-327701fe9da4 ] completed
  67. 2013-08-28 15:52:38,190 DEBUG [cloud.api.ApiServlet] (catalina-exec-12:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=ba2a348a-ca6c-4c20-b692-327701fe9da4&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701543309
  68. 2013-08-28 15:52:38,345 DEBUG [cloud.api.ApiServlet] (catalina-exec-9:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=5bee707f-ea32-410d-8b43-064217ddf54b&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701543462
  69. 2013-08-28 15:52:38,353 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-9:null) Async job-17 = [ 5bee707f-ea32-410d-8b43-064217ddf54b ] completed
  70. 2013-08-28 15:52:38,358 DEBUG [cloud.api.ApiServlet] (catalina-exec-9:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=5bee707f-ea32-410d-8b43-064217ddf54b&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701543462
  71. 2013-08-28 15:52:39,163 DEBUG [cloud.api.ApiServlet] (catalina-exec-19:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=bd8bd897-dde9-48f5-a1bc-7cdc89fb92a0&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701544292
  72. 2013-08-28 15:52:39,172 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-19:null) Async job-11 = [ bd8bd897-dde9-48f5-a1bc-7cdc89fb92a0 ] completed
  73. 2013-08-28 15:52:39,177 DEBUG [cloud.api.ApiServlet] (catalina-exec-19:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=bd8bd897-dde9-48f5-a1bc-7cdc89fb92a0&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701544292
  74. 2013-08-28 15:52:39,406 DEBUG [cloud.api.ApiServlet] (catalina-exec-3:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=6f1e0a24-f03b-42ce-8bdc-5e26c8312a73&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701544544
  75. 2013-08-28 15:52:39,416 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-3:null) Async job-18 = [ 6f1e0a24-f03b-42ce-8bdc-5e26c8312a73 ] completed
  76. 2013-08-28 15:52:39,420 DEBUG [cloud.api.ApiServlet] (catalina-exec-3:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=6f1e0a24-f03b-42ce-8bdc-5e26c8312a73&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701544544
  77. 2013-08-28 15:52:40,225 DEBUG [cloud.api.ApiServlet] (catalina-exec-23:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=e2556b10-ae28-423b-bcf2-39a58734f603&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701545342
  78. 2013-08-28 15:52:40,233 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-23:null) Async job-19 = [ e2556b10-ae28-423b-bcf2-39a58734f603 ] completed
  79. 2013-08-28 15:52:40,237 DEBUG [cloud.api.ApiServlet] (catalina-exec-23:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=e2556b10-ae28-423b-bcf2-39a58734f603&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701545342
  80. 2013-08-28 15:52:40,369 DEBUG [agent.transport.Request] (AgentManager-Handler-13:null) Seq 6-1333919781: Processing: { Ans: , MgmtId: 345049337494, via: 6, Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":false,"details":"Unable to ping computing host, exiting","wait":0}}] }
  81. 2013-08-28 15:52:40,369 DEBUG [agent.transport.Request] (AgentTaskPool-2:null) Seq 6-1333919781: Received: { Ans: , MgmtId: 345049337494, via: 6, Ver: v1, Flags: 10, { Answer } }
  82. 2013-08-28 15:52:40,369 DEBUG [cloud.ha.AbstractInvestigatorImpl] (AgentTaskPool-2:null) host (10.0.100.62) cannot be pinged, returning null ('I don't know')
  83. 2013-08-28 15:52:40,369 DEBUG [cloud.ha.UserVmDomRInvestigator] (AgentTaskPool-2:null) could not reach agent, could not reach agent's host, returning that we don't have enough information
  84. 2013-08-28 15:52:40,369 DEBUG [cloud.ha.HighAvailabilityManagerImpl] (AgentTaskPool-2:null) null unable to determine the state of the host. Moving on.
  85. 2013-08-28 15:52:40,369 DEBUG [cloud.ha.HighAvailabilityManagerImpl] (AgentTaskPool-2:null) null unable to determine the state of the host. Moving on.
  86. 2013-08-28 15:52:40,374 DEBUG [agent.transport.Request] (AgentTaskPool-2:null) Seq 6-1333919785: Sending { Cmd , MgmtId: 345049337494, via: 6, Ver: v1, Flags: 100011, [{"com.cloud.agent.api.CheckOnHostCommand":{"host":{"guid":"3854dba5-02ef-329d-b6a0-cc66f5b87b91-LibvirtComputingResource","privateNetwork":{"ip":"10.0.100.62","netmask":"255.255.0.0","mac":"00:50:56:8b:45:5e","isSecurityGroupEnabled":false},"storageNetwork1":{"ip":"10.0.100.62","netmask":"255.255.0.0","mac":"00:50:56:8b:45:5e","isSecurityGroupEnabled":false}},"wait":20}}] }
  87. 2013-08-28 15:52:40,434 DEBUG [agent.transport.Request] (AgentManager-Handler-15:null) Seq 6-1333919785: Processing: { Ans: , MgmtId: 345049337494, via: 6, Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}}] }
  88. 2013-08-28 15:52:40,434 DEBUG [agent.transport.Request] (AgentTaskPool-2:null) Seq 6-1333919785: Received: { Ans: , MgmtId: 345049337494, via: 6, Ver: v1, Flags: 10, { Answer } }
  89. 2013-08-28 15:52:40,434 DEBUG [cloud.ha.HighAvailabilityManagerImpl] (AgentTaskPool-2:null) KVMInvestigator was able to determine host 3 is in Down
  90. 2013-08-28 15:52:40,434 INFO [agent.manager.AgentManagerImpl] (AgentTaskPool-2:null) The state determined is Down
  91. 2013-08-28 15:52:40,434 ERROR [agent.manager.AgentManagerImpl] (AgentTaskPool-2:null) Host is down: 3-KVM-42-16616. Starting HA on the VMs
  92. 2013-08-28 15:52:40,434 INFO [agent.manager.AgentManagerImpl] (AgentTaskPool-2:null) Host 3 is disconnecting with event HostDown
  93. 2013-08-28 15:52:40,436 DEBUG [agent.manager.AgentManagerImpl] (AgentTaskPool-2:null) Host 3 is already Down
  94. 2013-08-28 15:52:40,436 DEBUG [agent.manager.AgentManagerImpl] (AgentTaskPool-2:null) Deregistering link for 3 with state Down
  95. 2013-08-28 15:52:40,436 DEBUG [agent.manager.AgentManagerImpl] (AgentTaskPool-2:null) Remove Agent : 3
  96. 2013-08-28 15:52:40,436 DEBUG [agent.manager.AgentManagerImpl] (AgentTaskPool-2:null) Sending Disconnect to listener: com.cloud.hypervisor.xen.discoverer.XcpServerDiscoverer_EnhancerByCloudStack_640675db
  97. 2013-08-28 15:52:40,436 DEBUG [agent.manager.AgentManagerImpl] (AgentTaskPool-2:null) Sending Disconnect to listener: com.cloud.deploy.DeploymentPlanningManagerImpl_EnhancerByCloudStack_2acb0051
  98. 2013-08-28 15:52:40,436 DEBUG [agent.manager.AgentManagerImpl] (AgentTaskPool-2:null) Sending Disconnect to listener: com.cloud.network.NetworkManagerImpl_EnhancerByCloudStack_3c5c11e4
  99. 2013-08-28 15:52:40,436 DEBUG [agent.manager.AgentManagerImpl] (AgentTaskPool-2:null) Sending Disconnect to listener: com.cloud.storage.secondary.SecondaryStorageListener
  100. 2013-08-28 15:52:40,437 DEBUG [agent.manager.AgentManagerImpl] (AgentTaskPool-2:null) Sending Disconnect to listener: com.cloud.network.security.SecurityGroupListener
  101. 2013-08-28 15:52:40,437 DEBUG [agent.manager.AgentManagerImpl] (AgentTaskPool-2:null) Sending Disconnect to listener: com.cloud.storage.listener.StoragePoolMonitor
  102. 2013-08-28 15:52:40,437 DEBUG [agent.manager.AgentManagerImpl] (AgentTaskPool-2:null) Sending Disconnect to listener: com.cloud.vm.ClusteredVirtualMachineManagerImpl_EnhancerByCloudStack_691cc2e8
  103. 2013-08-28 15:52:40,437 DEBUG [agent.manager.AgentManagerImpl] (AgentTaskPool-2:null) Sending Disconnect to listener: com.cloud.storage.LocalStoragePoolListener
  104. 2013-08-28 15:52:40,437 DEBUG [agent.manager.AgentManagerImpl] (AgentTaskPool-2:null) Sending Disconnect to listener: com.cloud.network.SshKeysDistriMonitor
  105. 2013-08-28 15:52:40,437 DEBUG [agent.manager.AgentManagerImpl] (AgentTaskPool-2:null) Sending Disconnect to listener: com.cloud.network.router.VirtualNetworkApplianceManagerImpl_EnhancerByCloudStack_28e2f89
  106. 2013-08-28 15:52:40,437 DEBUG [agent.manager.AgentManagerImpl] (AgentTaskPool-2:null) Sending Disconnect to listener: com.cloud.network.SshKeysDistriMonitor
  107. 2013-08-28 15:52:40,437 DEBUG [agent.manager.AgentManagerImpl] (AgentTaskPool-2:null) Sending Disconnect to listener: com.cloud.network.router.VpcVirtualNetworkApplianceManagerImpl_EnhancerByCloudStack_7d71f7ac
  108. 2013-08-28 15:52:40,437 DEBUG [agent.manager.AgentManagerImpl] (AgentTaskPool-2:null) Sending Disconnect to listener: com.cloud.storage.upload.UploadListener
  109. 2013-08-28 15:52:40,437 DEBUG [agent.manager.AgentManagerImpl] (AgentTaskPool-2:null) Sending Disconnect to listener: com.cloud.storage.download.DownloadListener
  110. 2013-08-28 15:52:40,437 DEBUG [agent.manager.AgentManagerImpl] (AgentTaskPool-2:null) Sending Disconnect to listener: com.cloud.agent.manager.AgentMonitor
  111. 2013-08-28 15:52:40,437 DEBUG [agent.manager.AgentManagerImpl] (AgentTaskPool-2:null) Sending Disconnect to listener: com.cloud.capacity.StorageCapacityListener
  112. 2013-08-28 15:52:40,437 DEBUG [agent.manager.AgentManagerImpl] (AgentTaskPool-2:null) Sending Disconnect to listener: com.cloud.capacity.ComputeCapacityListener
  113. 2013-08-28 15:52:40,437 DEBUG [agent.manager.AgentManagerImpl] (AgentTaskPool-2:null) Sending Disconnect to listener: com.cloud.network.NetworkUsageManagerImpl$DirectNetworkStatsListener
  114. 2013-08-28 15:52:40,437 DEBUG [cloud.network.NetworkUsageManagerImpl] (AgentTaskPool-2:null) Disconnected called on 3 with status Down
  115. 2013-08-28 15:52:40,437 DEBUG [agent.manager.AgentManagerImpl] (AgentTaskPool-2:null) Sending Disconnect to listener: com.cloud.consoleproxy.ConsoleProxyListener
  116. 2013-08-28 15:52:40,438 DEBUG [cloud.host.Status] (AgentTaskPool-2:null) Transition:[Resource state = Enabled, Agent event = HostDown, Host id = 3, name = KVM-42-16616]
  117. 2013-08-28 15:52:40,438 DEBUG [cloud.host.Status] (AgentTaskPool-2:null) Cannot transit agent status with event HostDown for host 3, name=KVM-42-16616, mangement server id is 345049337494
  118. 2013-08-28 15:52:40,438 ERROR [agent.manager.AgentManagerImpl] (AgentTaskPool-2:null) Exception caught while handling disconnect:
  119. com.cloud.utils.exception.CloudRuntimeException: Cannot transit agent status with event HostDown for host 3, mangement server id is 345049337494,Unable to transition to a new state from Down via HostDown
  120. at com.cloud.agent.manager.AgentManagerImpl.agentStatusTransitTo(AgentManagerImpl.java:1410)
  121. at com.cloud.agent.manager.AgentManagerImpl.disconnectAgent(AgentManagerImpl.java:1425)
  122. at com.cloud.agent.manager.AgentManagerImpl.handleDisconnectWithoutInvestigation(AgentManagerImpl.java:856)
  123. at com.cloud.agent.manager.ClusteredAgentManagerImpl.handleDisconnect(ClusteredAgentManagerImpl.java:298)
  124. at com.cloud.agent.manager.ClusteredAgentManagerImpl.handleDisconnectWithoutInvestigation(ClusteredAgentManagerImpl.java:287)
  125. at com.cloud.agent.manager.AgentManagerImpl.handleDisconnectWithInvestigation(AgentManagerImpl.java:931)
  126. at com.cloud.agent.manager.ClusteredAgentManagerImpl.handleDisconnect(ClusteredAgentManagerImpl.java:300)
  127. at com.cloud.agent.manager.ClusteredAgentManagerImpl.handleDisconnectWithInvestigation(ClusteredAgentManagerImpl.java:292)
  128. at com.cloud.agent.manager.AgentManagerImpl$DisconnectTask.run(AgentManagerImpl.java:955)
  129. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  130. at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
  131. at java.util.concurrent.FutureTask.run(FutureTask.java:166)
  132. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
  133. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  134. at java.lang.Thread.run(Thread.java:679)
  135. 2013-08-28 15:52:41,318 DEBUG [cloud.api.ApiServlet] (catalina-exec-20:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=ba2a348a-ca6c-4c20-b692-327701fe9da4&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701546444
  136. 2013-08-28 15:52:41,326 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-20:null) Async job-12 = [ ba2a348a-ca6c-4c20-b692-327701fe9da4 ] completed
  137. 2013-08-28 15:52:41,329 DEBUG [cloud.api.ApiServlet] (catalina-exec-20:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=ba2a348a-ca6c-4c20-b692-327701fe9da4&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701546444
  138. 2013-08-28 15:52:41,460 DEBUG [cloud.api.ApiServlet] (catalina-exec-14:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=5bee707f-ea32-410d-8b43-064217ddf54b&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701546587
  139. 2013-08-28 15:52:41,468 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-14:null) Async job-17 = [ 5bee707f-ea32-410d-8b43-064217ddf54b ] completed
  140. 2013-08-28 15:52:41,472 DEBUG [cloud.api.ApiServlet] (catalina-exec-14:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=5bee707f-ea32-410d-8b43-064217ddf54b&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701546587
  141. 2013-08-28 15:52:41,606 DEBUG [agent.transport.Request] (AgentManager-Handler-14:null) Seq 6-1333919784: Processing: { Ans: , MgmtId: 345049337494, via: 6, Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":false,"details":"Warning: Permanently added '[169.254.1.176]:3922' (RSA) to the list of known hosts.PING 192.168.1.3 (192.168.1.3): 48 data bytes60 bytes from 192.168.1.4: Destination Host UnreachableVr HL TOS Len ID Flg off TTL Pro cks Src Dst Data 4 5 00 4c00 0000 0 0040 40 01 59b7 192.168.1.4 192.168.1.3 --- 192.168.1.3 ping statistics ---1 packets transmitted, 0 packets received, 100% packet lossUnable to ping the vm, exiting","wait":0}}] }
  142. 2013-08-28 15:52:41,606 DEBUG [agent.transport.Request] (HA-Worker-0:work-2) Seq 6-1333919784: Received: { Ans: , MgmtId: 345049337494, via: 6, Ver: v1, Flags: 10, { Answer } }
  143. 2013-08-28 15:52:41,606 DEBUG [agent.manager.AgentManagerImpl] (HA-Worker-0:work-2) Details from executing class com.cloud.agent.api.PingTestCommand: Warning: Permanently added '[169.254.1.176]:3922' (RSA) to the list of known hosts.PING 192.168.1.3 (192.168.1.3): 48 data bytes60 bytes from 192.168.1.4: Destination Host UnreachableVr HL TOS Len ID Flg off TTL Pro cks Src Dst Data 4 5 00 4c00 0000 0 0040 40 01 59b7 192.168.1.4 192.168.1.3 --- 192.168.1.3 ping statistics ---1 packets transmitted, 0 packets received, 100% packet lossUnable to ping the vm, exiting
  144. 2013-08-28 15:52:41,606 DEBUG [cloud.ha.UserVmDomRInvestigator] (HA-Worker-0:work-2) VM[User|HA-Test1] could not be pinged, returning that it is unknown
  145. 2013-08-28 15:52:41,606 DEBUG [cloud.ha.UserVmDomRInvestigator] (HA-Worker-0:work-2) Returning null since we're unable to determine state of VM[User|HA-Test1]
  146. 2013-08-28 15:52:41,606 INFO [cloud.ha.HighAvailabilityManagerImpl] (HA-Worker-0:work-2) null found VM[User|HA-Test1]to be alive? null
  147. 2013-08-28 15:52:41,606 DEBUG [cloud.ha.ManagementIPSystemVMInvestigator] (HA-Worker-0:work-2) Not a System Vm, unable to determine state of VM[User|HA-Test1] returning null
  148. 2013-08-28 15:52:41,607 DEBUG [cloud.ha.ManagementIPSystemVMInvestigator] (HA-Worker-0:work-2) Testing if VM[User|HA-Test1] is alive
  149. 2013-08-28 15:52:41,610 DEBUG [cloud.ha.ManagementIPSystemVMInvestigator] (HA-Worker-0:work-2) Unable to find a management nic, cannot ping this system VM, unable to determine state of VM[User|HA-Test1] returning null
  150. 2013-08-28 15:52:41,610 INFO [cloud.ha.HighAvailabilityManagerImpl] (HA-Worker-0:work-2) null found VM[User|HA-Test1]to be alive? null
  151. 2013-08-28 15:52:41,614 DEBUG [agent.transport.Request] (HA-Worker-0:work-2) Seq 6-1333919786: Sending { Cmd , MgmtId: 345049337494, via: 6, Ver: v1, Flags: 100011, [{"com.cloud.agent.api.CheckOnHostCommand":{"host":{"guid":"3854dba5-02ef-329d-b6a0-cc66f5b87b91-LibvirtComputingResource","privateNetwork":{"ip":"10.0.100.62","netmask":"255.255.0.0","mac":"00:50:56:8b:45:5e","isSecurityGroupEnabled":false},"storageNetwork1":{"ip":"10.0.100.62","netmask":"255.255.0.0","mac":"00:50:56:8b:45:5e","isSecurityGroupEnabled":false}},"wait":20}}] }
  152. 2013-08-28 15:52:41,714 DEBUG [agent.transport.Request] (AgentManager-Handler-1:null) Seq 6-1333919786: Processing: { Ans: , MgmtId: 345049337494, via: 6, Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}}] }
  153. 2013-08-28 15:52:41,714 DEBUG [agent.transport.Request] (HA-Worker-0:work-2) Seq 6-1333919786: Received: { Ans: , MgmtId: 345049337494, via: 6, Ver: v1, Flags: 10, { Answer } }
  154. 2013-08-28 15:52:41,714 INFO [cloud.ha.HighAvailabilityManagerImpl] (HA-Worker-0:work-2) KVMInvestigator found VM[User|HA-Test1]to be alive? null
  155. 2013-08-28 15:52:41,714 DEBUG [cloud.ha.HighAvailabilityManagerImpl] (HA-Worker-0:work-2) Fencing off VM that we don't know the state of
  156. 2013-08-28 15:52:41,714 DEBUG [cloud.ha.XenServerFencer] (HA-Worker-0:work-2) Don't know how to fence non XenServer hosts KVM
  157. 2013-08-28 15:52:41,714 INFO [cloud.ha.HighAvailabilityManagerImpl] (HA-Worker-0:work-2) Fencer null returned null
  158. 2013-08-28 15:52:41,718 DEBUG [agent.transport.Request] (HA-Worker-0:work-2) Seq 6-1333919787: Sending { Cmd , MgmtId: 345049337494, via: 6, Ver: v1, Flags: 100011, [{"com.cloud.agent.api.FenceCommand":{"vmName":"i-2-3-VM","hostGuid":"3854dba5-02ef-329d-b6a0-cc66f5b87b91-LibvirtComputingResource","hostIp":"10.0.100.62","inSeq":false,"wait":0}}] }
  159. 2013-08-28 15:52:41,821 DEBUG [agent.transport.Request] (AgentManager-Handler-2:null) Seq 6-1333919787: Processing: { Ans: , MgmtId: 345049337494, via: 6, Ver: v1, Flags: 10, [{"com.cloud.agent.api.FenceAnswer":{"result":true,"wait":0}}] }
  160. 2013-08-28 15:52:41,821 DEBUG [agent.transport.Request] (HA-Worker-0:work-2) Seq 6-1333919787: Received: { Ans: , MgmtId: 345049337494, via: 6, Ver: v1, Flags: 10, { FenceAnswer } }
  161. 2013-08-28 15:52:41,821 INFO [cloud.ha.HighAvailabilityManagerImpl] (HA-Worker-0:work-2) Fencer KVMFenceBuilder returned true
  162. 2013-08-28 15:52:41,828 DEBUG [cloud.capacity.CapacityManagerImpl] (HA-Worker-0:work-2) VM state transitted from :Running to Stopping with event: StopRequestedvm's original host id: 6 new host id: 3 host id before state transition: 3
  163. 2013-08-28 15:52:41,832 WARN [cloud.vm.VirtualMachineManagerImpl] (HA-Worker-0:work-2) Unable to stop vm, agent unavailable: com.cloud.exception.AgentUnavailableException: Resource [Host:3] is unreachable: Host 3: Host with specified id is not in the right state: Down
  164. 2013-08-28 15:52:41,832 WARN [cloud.vm.VirtualMachineManagerImpl] (HA-Worker-0:work-2) Unable to actually stop VM[User|HA-Test1] but continue with release because it's a force stop
  165. 2013-08-28 15:52:41,835 DEBUG [cloud.vm.VirtualMachineManagerImpl] (HA-Worker-0:work-2) VM[User|HA-Test1] is stopped on the host. Proceeding to release resource held.
  166. 2013-08-28 15:52:41,838 DEBUG [cloud.network.NetworkManagerImpl] (HA-Worker-0:work-2) Changing active number of nics for network id=203 on -1
  167. 2013-08-28 15:52:41,842 DEBUG [cloud.vm.VirtualMachineManagerImpl] (HA-Worker-0:work-2) Successfully released network resources for the vm VM[User|HA-Test1]
  168. 2013-08-28 15:52:41,842 DEBUG [cloud.vm.VirtualMachineManagerImpl] (HA-Worker-0:work-2) Successfully released storage resources for the vm VM[User|HA-Test1]
  169. 2013-08-28 15:52:41,874 DEBUG [cloud.capacity.CapacityManagerImpl] (HA-Worker-0:work-2) VM state transitted from :Stopping to Stopped with event: OperationSucceededvm's original host id: 3 new host id: null host id before state transition: 3
  170. 2013-08-28 15:52:41,879 DEBUG [cloud.capacity.CapacityManagerImpl] (HA-Worker-0:work-2) Hosts's actual total CPU: 6584 and CPU after applying overprovisioning: 26336
  171. 2013-08-28 15:52:41,879 DEBUG [cloud.capacity.CapacityManagerImpl] (HA-Worker-0:work-2) Hosts's actual total RAM: 6137352192 and RAM after applying overprovisioning: 6137352192
  172. 2013-08-28 15:52:41,879 DEBUG [cloud.capacity.CapacityManagerImpl] (HA-Worker-0:work-2) release cpu from host: 3, old used: 1000,reserved: 0, actual total: 6584, total with overprovisioning: 26336; new used: 0,reserved:1000; movedfromreserved: false,moveToReserveredtrue
  173. 2013-08-28 15:52:41,879 DEBUG [cloud.capacity.CapacityManagerImpl] (HA-Worker-0:work-2) release mem from host: 3, old used: 536870912,reserved: 0, total: 6137352192; new used: 0,reserved:536870912; movedfromreserved: false,moveToReserveredtrue
  174. 2013-08-28 15:52:41,893 ERROR [cloud.ha.HighAvailabilityManagerImpl] (HA-Worker-0:work-2) Terminating HAWork[2-HA-3-Running-Scheduled]
  175. java.lang.NullPointerException
  176. at com.cloud.storage.VolumeManagerImpl.canVmRestartOnAnotherServer(VolumeManagerImpl.java:2631)
  177. at com.cloud.ha.HighAvailabilityManagerImpl.restart(HighAvailabilityManagerImpl.java:516)
  178. at com.cloud.ha.HighAvailabilityManagerImpl$WorkerThread.run(HighAvailabilityManagerImpl.java:831)
  179. 2013-08-28 15:52:42,277 DEBUG [cloud.api.ApiServlet] (catalina-exec-10:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=bd8bd897-dde9-48f5-a1bc-7cdc89fb92a0&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701547414
  180. 2013-08-28 15:52:42,286 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-10:null) Async job-11 = [ bd8bd897-dde9-48f5-a1bc-7cdc89fb92a0 ] completed
  181. 2013-08-28 15:52:42,290 DEBUG [cloud.api.ApiServlet] (catalina-exec-10:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=bd8bd897-dde9-48f5-a1bc-7cdc89fb92a0&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701547414
  182. 2013-08-28 15:52:42,545 DEBUG [cloud.api.ApiServlet] (catalina-exec-11:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=6f1e0a24-f03b-42ce-8bdc-5e26c8312a73&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701547669
  183. 2013-08-28 15:52:42,557 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-11:null) Async job-18 = [ 6f1e0a24-f03b-42ce-8bdc-5e26c8312a73 ] completed
  184. 2013-08-28 15:52:42,561 DEBUG [cloud.api.ApiServlet] (catalina-exec-11:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=6f1e0a24-f03b-42ce-8bdc-5e26c8312a73&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701547669
  185. 2013-08-28 15:52:43,050 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-3:null) SeqA 5-3222: Processing Seq 5-3222: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":2,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
  186. 2013-08-28 15:52:43,055 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-3:null) SeqA 5-3222: Sending Seq 5-3222: { Ans: , MgmtId: 345049337494, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
  187. 2013-08-28 15:52:43,341 DEBUG [cloud.api.ApiServlet] (catalina-exec-13:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=e2556b10-ae28-423b-bcf2-39a58734f603&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701548464
  188. 2013-08-28 15:52:43,351 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-13:null) Async job-19 = [ e2556b10-ae28-423b-bcf2-39a58734f603 ] completed
  189. 2013-08-28 15:52:43,355 DEBUG [cloud.api.ApiServlet] (catalina-exec-13:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=e2556b10-ae28-423b-bcf2-39a58734f603&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701548464
  190. 2013-08-28 15:52:44,436 DEBUG [cloud.api.ApiServlet] (catalina-exec-25:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=ba2a348a-ca6c-4c20-b692-327701fe9da4&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701549570
  191. 2013-08-28 15:52:44,454 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-25:null) Async job-12 = [ ba2a348a-ca6c-4c20-b692-327701fe9da4 ] completed
  192. 2013-08-28 15:52:44,458 DEBUG [cloud.api.ApiServlet] (catalina-exec-25:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=ba2a348a-ca6c-4c20-b692-327701fe9da4&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701549570
  193. 2013-08-28 15:52:44,587 DEBUG [cloud.api.ApiServlet] (catalina-exec-2:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=5bee707f-ea32-410d-8b43-064217ddf54b&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701549718
  194. 2013-08-28 15:52:44,596 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-2:null) Async job-17 = [ 5bee707f-ea32-410d-8b43-064217ddf54b ] completed
  195. 2013-08-28 15:52:44,600 DEBUG [cloud.api.ApiServlet] (catalina-exec-2:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=5bee707f-ea32-410d-8b43-064217ddf54b&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701549718
  196. 2013-08-28 15:52:45,431 DEBUG [cloud.api.ApiServlet] (catalina-exec-6:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=bd8bd897-dde9-48f5-a1bc-7cdc89fb92a0&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701550551
  197. 2013-08-28 15:52:45,440 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-6:null) Async job-11 = [ bd8bd897-dde9-48f5-a1bc-7cdc89fb92a0 ] completed
  198. 2013-08-28 15:52:45,445 DEBUG [cloud.api.ApiServlet] (catalina-exec-6:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=bd8bd897-dde9-48f5-a1bc-7cdc89fb92a0&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701550551
  199. 2013-08-28 15:52:45,675 DEBUG [cloud.api.ApiServlet] (catalina-exec-4:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=6f1e0a24-f03b-42ce-8bdc-5e26c8312a73&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701550806
  200. 2013-08-28 15:52:45,684 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-4:null) Async job-18 = [ 6f1e0a24-f03b-42ce-8bdc-5e26c8312a73 ] completed
  201. 2013-08-28 15:52:45,689 DEBUG [cloud.api.ApiServlet] (catalina-exec-4:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=6f1e0a24-f03b-42ce-8bdc-5e26c8312a73&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701550806
  202. 2013-08-28 15:52:45,881 DEBUG [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Zone 1 is ready to launch secondary storage VM
  203. 2013-08-28 15:52:46,470 DEBUG [cloud.api.ApiServlet] (catalina-exec-18:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=e2556b10-ae28-423b-bcf2-39a58734f603&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701551593
  204. 2013-08-28 15:52:46,478 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-18:null) Async job-19 = [ e2556b10-ae28-423b-bcf2-39a58734f603 ] completed
  205. 2013-08-28 15:52:46,482 DEBUG [cloud.api.ApiServlet] (catalina-exec-18:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=e2556b10-ae28-423b-bcf2-39a58734f603&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701551593
  206. 2013-08-28 15:52:46,915 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl] (consoleproxy-1:null) Zone 1 is ready to launch console proxy
  207. 2013-08-28 15:52:47,588 DEBUG [cloud.api.ApiServlet] (catalina-exec-5:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=ba2a348a-ca6c-4c20-b692-327701fe9da4&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701552702
  208. 2013-08-28 15:52:47,596 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-5:null) Async job-12 = [ ba2a348a-ca6c-4c20-b692-327701fe9da4 ] completed
  209. 2013-08-28 15:52:47,600 DEBUG [cloud.api.ApiServlet] (catalina-exec-5:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=ba2a348a-ca6c-4c20-b692-327701fe9da4&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701552702
  210. 2013-08-28 15:52:47,729 DEBUG [cloud.api.ApiServlet] (catalina-exec-21:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=5bee707f-ea32-410d-8b43-064217ddf54b&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701552863
  211. 2013-08-28 15:52:47,737 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-21:null) Async job-17 = [ 5bee707f-ea32-410d-8b43-064217ddf54b ] completed
  212. 2013-08-28 15:52:47,741 DEBUG [cloud.api.ApiServlet] (catalina-exec-21:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=5bee707f-ea32-410d-8b43-064217ddf54b&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701552863
  213. 2013-08-28 15:52:48,546 DEBUG [cloud.api.ApiServlet] (catalina-exec-15:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=bd8bd897-dde9-48f5-a1bc-7cdc89fb92a0&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701553681
  214. 2013-08-28 15:52:48,558 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-15:null) Async job-11 = [ bd8bd897-dde9-48f5-a1bc-7cdc89fb92a0 ] completed
  215. 2013-08-28 15:52:48,562 DEBUG [cloud.api.ApiServlet] (catalina-exec-15:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=bd8bd897-dde9-48f5-a1bc-7cdc89fb92a0&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701553681
  216. 2013-08-28 15:52:48,817 DEBUG [cloud.api.ApiServlet] (catalina-exec-17:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=6f1e0a24-f03b-42ce-8bdc-5e26c8312a73&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701553934
  217. 2013-08-28 15:52:48,826 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-17:null) Async job-18 = [ 6f1e0a24-f03b-42ce-8bdc-5e26c8312a73 ] completed
  218. 2013-08-28 15:52:48,830 DEBUG [cloud.api.ApiServlet] (catalina-exec-17:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=6f1e0a24-f03b-42ce-8bdc-5e26c8312a73&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701553934
  219. 2013-08-28 15:52:49,610 DEBUG [cloud.api.ApiServlet] (catalina-exec-8:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=e2556b10-ae28-423b-bcf2-39a58734f603&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701554729
  220. 2013-08-28 15:52:49,619 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-8:null) Async job-19 = [ e2556b10-ae28-423b-bcf2-39a58734f603 ] completed
  221. 2013-08-28 15:52:49,623 DEBUG [cloud.api.ApiServlet] (catalina-exec-8:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=e2556b10-ae28-423b-bcf2-39a58734f603&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701554729
  222. 2013-08-28 15:52:50,704 DEBUG [cloud.api.ApiServlet] (catalina-exec-7:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=ba2a348a-ca6c-4c20-b692-327701fe9da4&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701555833
  223. 2013-08-28 15:52:50,712 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-7:null) Async job-12 = [ ba2a348a-ca6c-4c20-b692-327701fe9da4 ] completed
  224. 2013-08-28 15:52:50,716 DEBUG [cloud.api.ApiServlet] (catalina-exec-7:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=ba2a348a-ca6c-4c20-b692-327701fe9da4&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701555833
  225. 2013-08-28 15:52:50,870 DEBUG [cloud.api.ApiServlet] (catalina-exec-22:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=5bee707f-ea32-410d-8b43-064217ddf54b&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701555999
  226. 2013-08-28 15:52:50,879 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-22:null) Async job-17 = [ 5bee707f-ea32-410d-8b43-064217ddf54b ] completed
  227. 2013-08-28 15:52:50,883 DEBUG [cloud.api.ApiServlet] (catalina-exec-22:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=5bee707f-ea32-410d-8b43-064217ddf54b&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701555999
  228. 2013-08-28 15:52:51,570 DEBUG [cloud.network.ExternalDeviceUsageManagerImpl] (ExternalNetworkMonitor-1:null) External devices stats collector is running...
  229. 2013-08-28 15:52:51,689 DEBUG [cloud.api.ApiServlet] (catalina-exec-1:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=bd8bd897-dde9-48f5-a1bc-7cdc89fb92a0&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701556820
  230. 2013-08-28 15:52:51,698 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-1:null) Async job-11 = [ bd8bd897-dde9-48f5-a1bc-7cdc89fb92a0 ] completed
  231. 2013-08-28 15:52:51,702 DEBUG [cloud.api.ApiServlet] (catalina-exec-1:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=bd8bd897-dde9-48f5-a1bc-7cdc89fb92a0&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701556820
  232. 2013-08-28 15:52:51,925 DEBUG [network.router.VirtualNetworkApplianceManagerImpl] (RouterMonitor-1:null) Found 0 running routers.
  233. 2013-08-28 15:52:51,931 DEBUG [cloud.api.ApiServlet] (catalina-exec-24:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=6f1e0a24-f03b-42ce-8bdc-5e26c8312a73&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701557057
  234. 2013-08-28 15:52:51,941 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-24:null) Async job-18 = [ 6f1e0a24-f03b-42ce-8bdc-5e26c8312a73 ] completed
  235. 2013-08-28 15:52:51,946 DEBUG [network.router.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:null) Found 0 routers to update status.
  236. 2013-08-28 15:52:51,947 DEBUG [network.router.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:null) Found 0 networks to update RvR status.
  237. 2013-08-28 15:52:51,949 DEBUG [cloud.api.ApiServlet] (catalina-exec-24:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=6f1e0a24-f03b-42ce-8bdc-5e26c8312a73&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701557057
  238. 2013-08-28 15:52:52,072 DEBUG [network.router.VirtualNetworkApplianceManagerImpl] (RouterMonitor-1:null) Found 0 running routers.
  239. 2013-08-28 15:52:52,086 DEBUG [network.router.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:null) Found 0 routers to update status.
  240. 2013-08-28 15:52:52,088 DEBUG [network.router.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:null) Found 0 networks to update RvR status.
  241. 2013-08-28 15:52:52,173 DEBUG [storage.snapshot.SnapshotSchedulerImpl] (SnapshotPollTask:null) Snapshot scheduler.poll is being called at 2013-08-28 14:52:52 GMT
  242. 2013-08-28 15:52:52,174 DEBUG [storage.snapshot.SnapshotSchedulerImpl] (SnapshotPollTask:null) Got 0 snapshots to be executed at 2013-08-28 14:52:52 GMT
  243. 2013-08-28 15:52:52,730 DEBUG [cloud.api.ApiServlet] (catalina-exec-16:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=e2556b10-ae28-423b-bcf2-39a58734f603&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701557852
  244. 2013-08-28 15:52:52,738 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-16:null) Async job-19 = [ e2556b10-ae28-423b-bcf2-39a58734f603 ] completed
  245. 2013-08-28 15:52:52,742 DEBUG [cloud.api.ApiServlet] (catalina-exec-16:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=e2556b10-ae28-423b-bcf2-39a58734f603&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701557852
  246. 2013-08-28 15:52:53,051 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-4:null) SeqA 5-3223: Processing Seq 5-3223: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":2,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
  247. 2013-08-28 15:52:53,057 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-4:null) SeqA 5-3223: Sending Seq 5-3223: { Ans: , MgmtId: 345049337494, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
  248. 2013-08-28 15:52:53,873 DEBUG [cloud.api.ApiServlet] (catalina-exec-12:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=ba2a348a-ca6c-4c20-b692-327701fe9da4&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701558992
  249. 2013-08-28 15:52:53,881 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-12:null) Async job-12 = [ ba2a348a-ca6c-4c20-b692-327701fe9da4 ] completed
  250. 2013-08-28 15:52:53,885 DEBUG [cloud.api.ApiServlet] (catalina-exec-12:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=ba2a348a-ca6c-4c20-b692-327701fe9da4&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701558992
  251. 2013-08-28 15:52:54,015 DEBUG [cloud.api.ApiServlet] (catalina-exec-9:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=5bee707f-ea32-410d-8b43-064217ddf54b&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701559139
  252. 2013-08-28 15:52:54,023 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-9:null) Async job-17 = [ 5bee707f-ea32-410d-8b43-064217ddf54b ] completed
  253. 2013-08-28 15:52:54,027 DEBUG [cloud.api.ApiServlet] (catalina-exec-9:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=5bee707f-ea32-410d-8b43-064217ddf54b&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701559139
  254. 2013-08-28 15:52:54,145 INFO [agent.manager.AgentMonitor] (Thread-6:null) Found the following agents behind on ping: [1]
  255. 2013-08-28 15:52:54,147 DEBUG [cloud.host.Status] (Thread-6:null) Ping timeout for host 1, do invstigation
  256. 2013-08-28 15:52:54,148 INFO [agent.manager.AgentManagerImpl] (AgentTaskPool-3:null) Investigating why host 1 has disconnected with event PingTimeout
  257. 2013-08-28 15:52:54,149 DEBUG [agent.manager.AgentManagerImpl] (AgentTaskPool-3:null) checking if agent (1) is alive
  258. 2013-08-28 15:52:54,152 DEBUG [agent.transport.Request] (AgentTaskPool-3:null) Seq 1-1384055134: Sending { Cmd , MgmtId: 345049337494, via: 1, Ver: v1, Flags: 100011, [{"com.cloud.agent.api.CheckHealthCommand":{"wait":50}}] }
  259. 2013-08-28 15:52:54,152 INFO [agent.manager.AgentAttache] (AgentTaskPool-3:null) Seq 1-1384055134: Unable to send due to Resource [Host:1] is unreachable: Host 1: Channel is closed
  260. 2013-08-28 15:52:54,153 DEBUG [agent.manager.AgentAttache] (AgentTaskPool-3:null) Seq 1-1384055134: Cancelling.
  261. 2013-08-28 15:52:54,153 WARN [agent.manager.AgentManagerImpl] (AgentTaskPool-3:null) Resource [Host:1] is unreachable: Host 1: Channel is closed
  262. 2013-08-28 15:52:54,154 DEBUG [cloud.ha.HighAvailabilityManagerImpl] (AgentTaskPool-3:null) SimpleInvestigator unable to determine the state of the host. Moving on.
  263. 2013-08-28 15:52:54,154 DEBUG [cloud.ha.HighAvailabilityManagerImpl] (AgentTaskPool-3:null) XenServerInvestigator unable to determine the state of the host. Moving on.
  264. 2013-08-28 15:52:54,154 DEBUG [cloud.ha.UserVmDomRInvestigator] (AgentTaskPool-3:null) checking if agent (1) is alive
  265. 2013-08-28 15:52:54,154 DEBUG [cloud.ha.HighAvailabilityManagerImpl] (AgentTaskPool-3:null) null unable to determine the state of the host. Moving on.
  266. 2013-08-28 15:52:54,154 DEBUG [cloud.ha.HighAvailabilityManagerImpl] (AgentTaskPool-3:null) null unable to determine the state of the host. Moving on.
  267. 2013-08-28 15:52:54,155 DEBUG [cloud.ha.HighAvailabilityManagerImpl] (AgentTaskPool-3:null) KVMInvestigator unable to determine the state of the host. Moving on.
  268. 2013-08-28 15:52:54,155 WARN [agent.manager.AgentManagerImpl] (AgentTaskPool-3:null) Agent state cannot be determined, do nothing
  269. 2013-08-28 15:52:54,833 DEBUG [cloud.api.ApiServlet] (catalina-exec-19:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=bd8bd897-dde9-48f5-a1bc-7cdc89fb92a0&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701559967
  270. 2013-08-28 15:52:54,842 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-19:null) Async job-11 = [ bd8bd897-dde9-48f5-a1bc-7cdc89fb92a0 ] completed
  271. 2013-08-28 15:52:54,846 DEBUG [cloud.api.ApiServlet] (catalina-exec-19:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=bd8bd897-dde9-48f5-a1bc-7cdc89fb92a0&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701559967
  272. 2013-08-28 15:52:55,051 DEBUG [cloud.api.ApiServlet] (catalina-exec-3:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=6f1e0a24-f03b-42ce-8bdc-5e26c8312a73&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701560189
  273. 2013-08-28 15:52:55,060 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-3:null) Async job-18 = [ 6f1e0a24-f03b-42ce-8bdc-5e26c8312a73 ] completed
  274. 2013-08-28 15:52:55,065 DEBUG [cloud.api.ApiServlet] (catalina-exec-3:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=6f1e0a24-f03b-42ce-8bdc-5e26c8312a73&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701560189
  275. 2013-08-28 15:52:55,846 DEBUG [cloud.api.ApiServlet] (catalina-exec-23:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=e2556b10-ae28-423b-bcf2-39a58734f603&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701560969
  276. 2013-08-28 15:52:55,866 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-23:null) Async job-19 = [ e2556b10-ae28-423b-bcf2-39a58734f603 ] completed
  277. 2013-08-28 15:52:55,870 DEBUG [cloud.api.ApiServlet] (catalina-exec-23:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=e2556b10-ae28-423b-bcf2-39a58734f603&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701560969
  278. 2013-08-28 15:52:56,976 DEBUG [cloud.api.ApiServlet] (catalina-exec-20:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=ba2a348a-ca6c-4c20-b692-327701fe9da4&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701562091
  279. 2013-08-28 15:52:56,984 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-20:null) Async job-12 = [ ba2a348a-ca6c-4c20-b692-327701fe9da4 ] completed
  280. 2013-08-28 15:52:56,988 DEBUG [cloud.api.ApiServlet] (catalina-exec-20:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=ba2a348a-ca6c-4c20-b692-327701fe9da4&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701562091
  281. 2013-08-28 15:52:57,167 DEBUG [cloud.api.ApiServlet] (catalina-exec-14:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=5bee707f-ea32-410d-8b43-064217ddf54b&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701562288
  282. 2013-08-28 15:52:57,175 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-14:null) Async job-17 = [ 5bee707f-ea32-410d-8b43-064217ddf54b ] completed
  283. 2013-08-28 15:52:57,179 DEBUG [cloud.api.ApiServlet] (catalina-exec-14:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=5bee707f-ea32-410d-8b43-064217ddf54b&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701562288
  284. 2013-08-28 15:52:57,233 DEBUG [cloud.api.ApiServlet] (catalina-exec-10:null) ===START=== 10.0.0.36 -- GET command=listZones&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701562342
  285. 2013-08-28 15:52:57,240 DEBUG [cloud.api.ApiServlet] (catalina-exec-10:null) ===END=== 10.0.0.36 -- GET command=listZones&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701562342
  286. 2013-08-28 15:52:57,269 DEBUG [cloud.api.ApiServlet] (catalina-exec-11:null) ===START=== 10.0.0.36 -- GET command=listPods&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&page=1&pagesize=1&_=1377701562385
  287. 2013-08-28 15:52:57,277 DEBUG [cloud.api.ApiServlet] (catalina-exec-11:null) ===END=== 10.0.0.36 -- GET command=listPods&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&page=1&pagesize=1&_=1377701562385
  288. 2013-08-28 15:52:57,310 DEBUG [cloud.api.ApiServlet] (catalina-exec-13:null) ===START=== 10.0.0.36 -- GET command=listClusters&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&page=1&pagesize=1&_=1377701562426
  289. 2013-08-28 15:52:57,319 DEBUG [cloud.api.ApiServlet] (catalina-exec-13:null) ===END=== 10.0.0.36 -- GET command=listClusters&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&page=1&pagesize=1&_=1377701562426
  290. 2013-08-28 15:52:57,348 DEBUG [cloud.api.ApiServlet] (catalina-exec-25:null) ===START=== 10.0.0.36 -- GET command=listHosts&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&type=routing&page=1&pagesize=1&_=1377701562465
  291. 2013-08-28 15:52:57,353 DEBUG [api.query.QueryManagerImpl] (catalina-exec-25:null) >>>Searching for hosts>>>
  292. 2013-08-28 15:52:57,359 DEBUG [api.query.QueryManagerImpl] (catalina-exec-25:null) >>>Generating Response>>>
  293. 2013-08-28 15:52:57,362 DEBUG [cloud.api.ApiServlet] (catalina-exec-25:null) ===END=== 10.0.0.36 -- GET command=listHosts&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&type=routing&page=1&pagesize=1&_=1377701562465
  294. 2013-08-28 15:52:57,392 DEBUG [cloud.api.ApiServlet] (catalina-exec-2:null) ===START=== 10.0.0.36 -- GET command=listStoragePools&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&page=1&pagesize=1&_=1377701562509
  295. 2013-08-28 15:52:57,401 DEBUG [cloud.api.ApiServlet] (catalina-exec-2:null) ===END=== 10.0.0.36 -- GET command=listStoragePools&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&page=1&pagesize=1&_=1377701562509
  296. 2013-08-28 15:52:57,432 DEBUG [cloud.api.ApiServlet] (catalina-exec-6:null) ===START=== 10.0.0.36 -- GET command=listImageStores&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&type=SecondaryStorage&page=1&pagesize=1&_=1377701562547
  297. 2013-08-28 15:52:57,441 DEBUG [cloud.api.ApiServlet] (catalina-exec-6:null) ===END=== 10.0.0.36 -- GET command=listImageStores&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&type=SecondaryStorage&page=1&pagesize=1&_=1377701562547
  298. 2013-08-28 15:52:57,471 DEBUG [cloud.api.ApiServlet] (catalina-exec-4:null) ===START=== 10.0.0.36 -- GET command=listSystemVms&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&page=1&pagesize=1&_=1377701562588
  299. 2013-08-28 15:52:57,519 DEBUG [cloud.api.ApiServlet] (catalina-exec-4:null) ===END=== 10.0.0.36 -- GET command=listSystemVms&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&page=1&pagesize=1&_=1377701562588
  300. 2013-08-28 15:52:57,549 DEBUG [cloud.api.ApiServlet] (catalina-exec-18:null) ===START=== 10.0.0.36 -- GET command=listRouters&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&projectid=-1&page=1&pagesize=1&_=1377701562664
  301. 2013-08-28 15:52:57,560 DEBUG [cloud.api.ApiServlet] (catalina-exec-18:null) ===END=== 10.0.0.36 -- GET command=listRouters&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&projectid=-1&page=1&pagesize=1&_=1377701562664
  302. 2013-08-28 15:52:57,592 DEBUG [cloud.api.ApiServlet] (catalina-exec-5:null) ===START=== 10.0.0.36 -- GET command=listRouters&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&listAll=true&page=1&pagesize=1&_=1377701562710
  303. 2013-08-28 15:52:57,607 DEBUG [cloud.api.ApiServlet] (catalina-exec-5:null) ===END=== 10.0.0.36 -- GET command=listRouters&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&listAll=true&page=1&pagesize=1&_=1377701562710
  304. 2013-08-28 15:52:57,636 DEBUG [cloud.api.ApiServlet] (catalina-exec-21:null) ===START=== 10.0.0.36 -- GET command=listCapacity&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701562752
  305. 2013-08-28 15:52:57,647 DEBUG [cloud.api.ApiServlet] (catalina-exec-21:null) ===END=== 10.0.0.36 -- GET command=listCapacity&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701562752
  306. 2013-08-28 15:52:57,977 DEBUG [cloud.api.ApiServlet] (catalina-exec-15:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=bd8bd897-dde9-48f5-a1bc-7cdc89fb92a0&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701563112
  307. 2013-08-28 15:52:57,987 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-15:null) Async job-11 = [ bd8bd897-dde9-48f5-a1bc-7cdc89fb92a0 ] completed
  308. 2013-08-28 15:52:57,991 DEBUG [cloud.api.ApiServlet] (catalina-exec-15:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=bd8bd897-dde9-48f5-a1bc-7cdc89fb92a0&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701563112
  309. 2013-08-28 15:52:58,052 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-6:null) SeqA 5-3224: Processing Seq 5-3224: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":2,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
  310. 2013-08-28 15:52:58,057 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-6:null) SeqA 5-3224: Sending Seq 5-3224: { Ans: , MgmtId: 345049337494, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
  311. 2013-08-28 15:52:58,220 DEBUG [cloud.api.ApiServlet] (catalina-exec-17:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=6f1e0a24-f03b-42ce-8bdc-5e26c8312a73&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701563336
  312. 2013-08-28 15:52:58,229 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-17:null) Async job-18 = [ 6f1e0a24-f03b-42ce-8bdc-5e26c8312a73 ] completed
  313. 2013-08-28 15:52:58,233 DEBUG [cloud.api.ApiServlet] (catalina-exec-17:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=6f1e0a24-f03b-42ce-8bdc-5e26c8312a73&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701563336
  314. 2013-08-28 15:52:58,788 DEBUG [cloud.api.ApiServlet] (catalina-exec-8:null) ===START=== 10.0.0.36 -- GET command=listHosts&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&page=1&pageSize=20&type=routing&listAll=true&_=1377701563909
  315. 2013-08-28 15:52:58,793 DEBUG [api.query.QueryManagerImpl] (catalina-exec-8:null) >>>Searching for hosts>>>
  316. 2013-08-28 15:52:58,799 DEBUG [api.query.QueryManagerImpl] (catalina-exec-8:null) >>>Generating Response>>>
  317. 2013-08-28 15:52:58,805 DEBUG [cloud.api.ApiServlet] (catalina-exec-8:null) ===END=== 10.0.0.36 -- GET command=listHosts&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&page=1&pageSize=20&type=routing&listAll=true&_=1377701563909
  318. 2013-08-28 15:52:58,987 DEBUG [cloud.api.ApiServlet] (catalina-exec-7:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=e2556b10-ae28-423b-bcf2-39a58734f603&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701564112
  319. 2013-08-28 15:52:58,996 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-7:null) Async job-19 = [ e2556b10-ae28-423b-bcf2-39a58734f603 ] completed
  320. 2013-08-28 15:52:59,000 DEBUG [cloud.api.ApiServlet] (catalina-exec-7:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=e2556b10-ae28-423b-bcf2-39a58734f603&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701564112
  321. 2013-08-28 15:53:00,239 DEBUG [cloud.api.ApiServlet] (catalina-exec-22:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=ba2a348a-ca6c-4c20-b692-327701fe9da4&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701565224
  322. 2013-08-28 15:53:00,248 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-22:null) Async job-12 = [ ba2a348a-ca6c-4c20-b692-327701fe9da4 ] completed
  323. 2013-08-28 15:53:00,251 DEBUG [cloud.api.ApiServlet] (catalina-exec-22:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=ba2a348a-ca6c-4c20-b692-327701fe9da4&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701565224
  324. 2013-08-28 15:53:00,740 DEBUG [cloud.api.ApiServlet] (catalina-exec-1:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=5bee707f-ea32-410d-8b43-064217ddf54b&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701565544
  325. 2013-08-28 15:53:00,749 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-1:null) Async job-17 = [ 5bee707f-ea32-410d-8b43-064217ddf54b ] completed
  326. 2013-08-28 15:53:00,754 DEBUG [cloud.api.ApiServlet] (catalina-exec-1:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=5bee707f-ea32-410d-8b43-064217ddf54b&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701565544
  327. 2013-08-28 15:53:01,584 DEBUG [cloud.api.ApiServlet] (catalina-exec-24:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=bd8bd897-dde9-48f5-a1bc-7cdc89fb92a0&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701566715
  328. 2013-08-28 15:53:01,594 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-24:null) Async job-11 = [ bd8bd897-dde9-48f5-a1bc-7cdc89fb92a0 ] completed
  329. 2013-08-28 15:53:01,598 DEBUG [cloud.api.ApiServlet] (catalina-exec-24:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=bd8bd897-dde9-48f5-a1bc-7cdc89fb92a0&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701566715
  330. 2013-08-28 15:53:01,729 DEBUG [cloud.api.ApiServlet] (catalina-exec-16:null) ===START=== 10.0.0.36 -- GET command=listVirtualMachines&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&listAll=true&page=1&pagesize=20&_=1377701566833
  331. 2013-08-28 15:53:01,746 DEBUG [cloud.api.ApiServlet] (catalina-exec-16:null) ===END=== 10.0.0.36 -- GET command=listVirtualMachines&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&listAll=true&page=1&pagesize=20&_=1377701566833
  332. 2013-08-28 15:53:01,801 DEBUG [cloud.api.ApiServlet] (catalina-exec-12:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=6f1e0a24-f03b-42ce-8bdc-5e26c8312a73&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701566927
  333. 2013-08-28 15:53:01,809 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-12:null) Async job-18 = [ 6f1e0a24-f03b-42ce-8bdc-5e26c8312a73 ] completed
  334. 2013-08-28 15:53:01,813 DEBUG [cloud.api.ApiServlet] (catalina-exec-12:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=6f1e0a24-f03b-42ce-8bdc-5e26c8312a73&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701566927
  335. 2013-08-28 15:53:02,568 DEBUG [cloud.api.ApiServlet] (catalina-exec-9:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=e2556b10-ae28-423b-bcf2-39a58734f603&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701567701
  336. 2013-08-28 15:53:02,578 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-9:null) Async job-19 = [ e2556b10-ae28-423b-bcf2-39a58734f603 ] completed
  337. 2013-08-28 15:53:02,582 DEBUG [cloud.api.ApiServlet] (catalina-exec-9:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=e2556b10-ae28-423b-bcf2-39a58734f603&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701567701
  338. 2013-08-28 15:53:03,053 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-5:null) SeqA 5-3225: Processing Seq 5-3225: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":2,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
  339. 2013-08-28 15:53:03,059 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-5:null) SeqA 5-3225: Sending Seq 5-3225: { Ans: , MgmtId: 345049337494, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
  340. 2013-08-28 15:53:03,741 DEBUG [cloud.api.ApiServlet] (catalina-exec-19:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=5bee707f-ea32-410d-8b43-064217ddf54b&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701568632
  341. 2013-08-28 15:53:03,750 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-19:null) Async job-17 = [ 5bee707f-ea32-410d-8b43-064217ddf54b ] completed
  342. 2013-08-28 15:53:03,754 DEBUG [cloud.api.ApiServlet] (catalina-exec-19:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=5bee707f-ea32-410d-8b43-064217ddf54b&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701568632
  343. 2013-08-28 15:53:03,783 DEBUG [cloud.api.ApiServlet] (catalina-exec-3:null) ===START=== 10.0.0.36 -- GET command=listZones&id=0705bdf7-3350-4c28-929e-edc6bc82b008&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701568901
  344. 2013-08-28 15:53:03,792 DEBUG [cloud.api.ApiServlet] (catalina-exec-3:null) ===END=== 10.0.0.36 -- GET command=listZones&id=0705bdf7-3350-4c28-929e-edc6bc82b008&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701568901
  345. 2013-08-28 15:53:03,823 DEBUG [cloud.api.ApiServlet] (catalina-exec-23:null) ===START=== 10.0.0.36 -- GET command=listVirtualMachines&id=4b1d0d90-c66d-4aa3-bebb-3bfb6b93db05&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701568948
  346. 2013-08-28 15:53:03,840 DEBUG [cloud.api.ApiServlet] (catalina-exec-23:null) ===END=== 10.0.0.36 -- GET command=listVirtualMachines&id=4b1d0d90-c66d-4aa3-bebb-3bfb6b93db05&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701568948
  347. 2013-08-28 15:53:03,896 DEBUG [cloud.api.ApiServlet] (catalina-exec-20:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=ba2a348a-ca6c-4c20-b692-327701fe9da4&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701568985
  348. 2013-08-28 15:53:03,896 DEBUG [cloud.api.ApiServlet] (catalina-exec-14:null) ===START=== 10.0.0.36 -- GET command=listOsTypes&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701568991
  349. 2013-08-28 15:53:03,897 DEBUG [cloud.api.ApiServlet] (catalina-exec-10:null) ===START=== 10.0.0.36 -- GET command=listTags&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&resourceId=4b1d0d90-c66d-4aa3-bebb-3bfb6b93db05&resourceType=UserVm&listAll=true&_=1377701569013
  350. 2013-08-28 15:53:03,920 DEBUG [cloud.api.ApiServlet] (catalina-exec-10:null) ===END=== 10.0.0.36 -- GET command=listTags&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&resourceId=4b1d0d90-c66d-4aa3-bebb-3bfb6b93db05&resourceType=UserVm&listAll=true&_=1377701569013
  351. 2013-08-28 15:53:03,926 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-20:null) Async job-12 = [ ba2a348a-ca6c-4c20-b692-327701fe9da4 ] completed
  352. 2013-08-28 15:53:03,930 DEBUG [cloud.api.ApiServlet] (catalina-exec-20:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=ba2a348a-ca6c-4c20-b692-327701fe9da4&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701568985
  353. 2013-08-28 15:53:04,063 DEBUG [cloud.api.ApiServlet] (catalina-exec-14:null) ===END=== 10.0.0.36 -- GET command=listOsTypes&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701568991
  354. 2013-08-28 15:53:05,046 DEBUG [cloud.api.ApiServlet] (catalina-exec-11:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=bd8bd897-dde9-48f5-a1bc-7cdc89fb92a0&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701570183
  355. 2013-08-28 15:53:05,057 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-11:null) Async job-11 = [ bd8bd897-dde9-48f5-a1bc-7cdc89fb92a0 ] completed
  356. 2013-08-28 15:53:05,061 DEBUG [cloud.api.ApiServlet] (catalina-exec-11:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=bd8bd897-dde9-48f5-a1bc-7cdc89fb92a0&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701570183
  357. 2013-08-28 15:53:05,266 DEBUG [cloud.api.ApiServlet] (catalina-exec-13:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=6f1e0a24-f03b-42ce-8bdc-5e26c8312a73&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701570388
  358. 2013-08-28 15:53:05,275 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-13:null) Async job-18 = [ 6f1e0a24-f03b-42ce-8bdc-5e26c8312a73 ] completed
  359. 2013-08-28 15:53:05,279 DEBUG [cloud.api.ApiServlet] (catalina-exec-13:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=6f1e0a24-f03b-42ce-8bdc-5e26c8312a73&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701570388
  360. 2013-08-28 15:53:06,034 DEBUG [cloud.api.ApiServlet] (catalina-exec-25:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=e2556b10-ae28-423b-bcf2-39a58734f603&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701571172
  361. 2013-08-28 15:53:06,043 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-25:null) Async job-19 = [ e2556b10-ae28-423b-bcf2-39a58734f603 ] completed
  362. 2013-08-28 15:53:06,047 DEBUG [cloud.api.ApiServlet] (catalina-exec-25:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=e2556b10-ae28-423b-bcf2-39a58734f603&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701571172
  363. 2013-08-28 15:53:06,302 DEBUG [cloud.api.ApiServlet] (catalina-exec-2:null) ===START=== 10.0.0.36 -- GET command=listZones&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701571386
  364. 2013-08-28 15:53:06,310 DEBUG [cloud.api.ApiServlet] (catalina-exec-2:null) ===END=== 10.0.0.36 -- GET command=listZones&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701571386
  365. 2013-08-28 15:53:06,339 DEBUG [cloud.api.ApiServlet] (catalina-exec-6:null) ===START=== 10.0.0.36 -- GET command=listPods&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&page=1&pagesize=1&_=1377701571455
  366. 2013-08-28 15:53:06,347 DEBUG [cloud.api.ApiServlet] (catalina-exec-6:null) ===END=== 10.0.0.36 -- GET command=listPods&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&page=1&pagesize=1&_=1377701571455
  367. 2013-08-28 15:53:06,375 DEBUG [cloud.api.ApiServlet] (catalina-exec-4:null) ===START=== 10.0.0.36 -- GET command=listClusters&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&page=1&pagesize=1&_=1377701571492
  368. 2013-08-28 15:53:06,384 DEBUG [cloud.api.ApiServlet] (catalina-exec-4:null) ===END=== 10.0.0.36 -- GET command=listClusters&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&page=1&pagesize=1&_=1377701571492
  369. 2013-08-28 15:53:06,414 DEBUG [cloud.api.ApiServlet] (catalina-exec-18:null) ===START=== 10.0.0.36 -- GET command=listHosts&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&type=routing&page=1&pagesize=1&_=1377701571530
  370. 2013-08-28 15:53:06,418 DEBUG [api.query.QueryManagerImpl] (catalina-exec-18:null) >>>Searching for hosts>>>
  371. 2013-08-28 15:53:06,424 DEBUG [api.query.QueryManagerImpl] (catalina-exec-18:null) >>>Generating Response>>>
  372. 2013-08-28 15:53:06,428 DEBUG [cloud.api.ApiServlet] (catalina-exec-18:null) ===END=== 10.0.0.36 -- GET command=listHosts&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&type=routing&page=1&pagesize=1&_=1377701571530
  373. 2013-08-28 15:53:06,456 DEBUG [cloud.api.ApiServlet] (catalina-exec-5:null) ===START=== 10.0.0.36 -- GET command=listStoragePools&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&page=1&pagesize=1&_=1377701571573
  374. 2013-08-28 15:53:06,467 DEBUG [cloud.api.ApiServlet] (catalina-exec-5:null) ===END=== 10.0.0.36 -- GET command=listStoragePools&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&page=1&pagesize=1&_=1377701571573
  375. 2013-08-28 15:53:06,496 DEBUG [cloud.api.ApiServlet] (catalina-exec-21:null) ===START=== 10.0.0.36 -- GET command=listImageStores&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&type=SecondaryStorage&page=1&pagesize=1&_=1377701571613
  376. 2013-08-28 15:53:06,506 DEBUG [cloud.api.ApiServlet] (catalina-exec-21:null) ===END=== 10.0.0.36 -- GET command=listImageStores&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&type=SecondaryStorage&page=1&pagesize=1&_=1377701571613
  377. 2013-08-28 15:53:06,534 DEBUG [cloud.api.ApiServlet] (catalina-exec-15:null) ===START=== 10.0.0.36 -- GET command=listSystemVms&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&page=1&pagesize=1&_=1377701571652
  378. 2013-08-28 15:53:06,588 DEBUG [cloud.api.ApiServlet] (catalina-exec-15:null) ===END=== 10.0.0.36 -- GET command=listSystemVms&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&page=1&pagesize=1&_=1377701571652
  379. 2013-08-28 15:53:06,618 DEBUG [cloud.api.ApiServlet] (catalina-exec-17:null) ===START=== 10.0.0.36 -- GET command=listRouters&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&projectid=-1&page=1&pagesize=1&_=1377701571734
  380. 2013-08-28 15:53:06,626 DEBUG [cloud.api.ApiServlet] (catalina-exec-17:null) ===END=== 10.0.0.36 -- GET command=listRouters&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&projectid=-1&page=1&pagesize=1&_=1377701571734
  381. 2013-08-28 15:53:06,658 DEBUG [cloud.api.ApiServlet] (catalina-exec-8:null) ===START=== 10.0.0.36 -- GET command=listRouters&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&listAll=true&page=1&pagesize=1&_=1377701571775
  382. 2013-08-28 15:53:06,671 DEBUG [cloud.api.ApiServlet] (catalina-exec-8:null) ===END=== 10.0.0.36 -- GET command=listRouters&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&listAll=true&page=1&pagesize=1&_=1377701571775
  383. 2013-08-28 15:53:06,701 DEBUG [cloud.api.ApiServlet] (catalina-exec-7:null) ===START=== 10.0.0.36 -- GET command=listCapacity&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701571817
  384. 2013-08-28 15:53:06,713 DEBUG [cloud.api.ApiServlet] (catalina-exec-7:null) ===END=== 10.0.0.36 -- GET command=listCapacity&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701571817
  385. 2013-08-28 15:53:06,719 DEBUG [cloud.api.ApiServlet] (catalina-exec-22:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=5bee707f-ea32-410d-8b43-064217ddf54b&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701571855
  386. 2013-08-28 15:53:06,726 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-22:null) Async job-17 = [ 5bee707f-ea32-410d-8b43-064217ddf54b ] completed
  387. 2013-08-28 15:53:06,731 DEBUG [cloud.api.ApiServlet] (catalina-exec-22:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=5bee707f-ea32-410d-8b43-064217ddf54b&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701571855
  388. 2013-08-28 15:53:06,960 DEBUG [cloud.api.ApiServlet] (catalina-exec-1:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=ba2a348a-ca6c-4c20-b692-327701fe9da4&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701572089
  389. 2013-08-28 15:53:06,969 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-1:null) Async job-12 = [ ba2a348a-ca6c-4c20-b692-327701fe9da4 ] completed
  390. 2013-08-28 15:53:06,973 DEBUG [cloud.api.ApiServlet] (catalina-exec-1:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=ba2a348a-ca6c-4c20-b692-327701fe9da4&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701572089
  391. 2013-08-28 15:53:08,054 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-7:null) SeqA 5-3226: Processing Seq 5-3226: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":2,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
  392. 2013-08-28 15:53:08,058 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-7:null) SeqA 5-3226: Sending Seq 5-3226: { Ans: , MgmtId: 345049337494, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
  393. 2013-08-28 15:53:08,204 DEBUG [cloud.api.ApiServlet] (catalina-exec-24:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=bd8bd897-dde9-48f5-a1bc-7cdc89fb92a0&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701573331
  394. 2013-08-28 15:53:08,204 DEBUG [cloud.api.ApiServlet] (catalina-exec-16:null) ===START=== 10.0.0.36 -- GET command=listHosts&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&page=1&pageSize=20&type=routing&listAll=true&_=1377701573325
  395. 2013-08-28 15:53:08,215 DEBUG [api.query.QueryManagerImpl] (catalina-exec-16:null) >>>Searching for hosts>>>
  396. 2013-08-28 15:53:08,223 DEBUG [api.query.QueryManagerImpl] (catalina-exec-16:null) >>>Generating Response>>>
  397. 2013-08-28 15:53:08,225 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-24:null) Async job-11 = [ bd8bd897-dde9-48f5-a1bc-7cdc89fb92a0 ] completed
  398. 2013-08-28 15:53:08,231 DEBUG [cloud.api.ApiServlet] (catalina-exec-24:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=bd8bd897-dde9-48f5-a1bc-7cdc89fb92a0&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701573331
  399. 2013-08-28 15:53:08,236 DEBUG [cloud.api.ApiServlet] (catalina-exec-16:null) ===END=== 10.0.0.36 -- GET command=listHosts&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&page=1&pageSize=20&type=routing&listAll=true&_=1377701573325
  400. 2013-08-28 15:53:08,391 DEBUG [cloud.api.ApiServlet] (catalina-exec-12:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=6f1e0a24-f03b-42ce-8bdc-5e26c8312a73&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701573507
  401. 2013-08-28 15:53:08,400 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-12:null) Async job-18 = [ 6f1e0a24-f03b-42ce-8bdc-5e26c8312a73 ] completed
  402. 2013-08-28 15:53:08,405 DEBUG [cloud.api.ApiServlet] (catalina-exec-12:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=6f1e0a24-f03b-42ce-8bdc-5e26c8312a73&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701573507
  403. 2013-08-28 15:53:09,185 DEBUG [cloud.api.ApiServlet] (catalina-exec-9:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=e2556b10-ae28-423b-bcf2-39a58734f603&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701574314
  404. 2013-08-28 15:53:09,194 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-9:null) Async job-19 = [ e2556b10-ae28-423b-bcf2-39a58734f603 ] completed
  405. 2013-08-28 15:53:09,198 DEBUG [cloud.api.ApiServlet] (catalina-exec-9:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=e2556b10-ae28-423b-bcf2-39a58734f603&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701574314
  406. 2013-08-28 15:53:09,878 DEBUG [cloud.api.ApiServlet] (catalina-exec-19:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=5bee707f-ea32-410d-8b43-064217ddf54b&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701575004
  407. 2013-08-28 15:53:09,886 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-19:null) Async job-17 = [ 5bee707f-ea32-410d-8b43-064217ddf54b ] completed
  408. 2013-08-28 15:53:09,890 DEBUG [cloud.api.ApiServlet] (catalina-exec-19:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=5bee707f-ea32-410d-8b43-064217ddf54b&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701575004
  409. 2013-08-28 15:53:09,928 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-9:null) Ping from 4
  410. 2013-08-28 15:53:10,120 DEBUG [cloud.api.ApiServlet] (catalina-exec-3:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=ba2a348a-ca6c-4c20-b692-327701fe9da4&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701575238
  411. 2013-08-28 15:53:10,129 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-3:null) Async job-12 = [ ba2a348a-ca6c-4c20-b692-327701fe9da4 ] completed
  412. 2013-08-28 15:53:10,134 DEBUG [cloud.api.ApiServlet] (catalina-exec-3:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=ba2a348a-ca6c-4c20-b692-327701fe9da4&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701575238
  413. 2013-08-28 15:53:11,315 DEBUG [cloud.api.ApiServlet] (catalina-exec-23:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=bd8bd897-dde9-48f5-a1bc-7cdc89fb92a0&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701576435
  414. 2013-08-28 15:53:11,323 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-23:null) Async job-11 = [ bd8bd897-dde9-48f5-a1bc-7cdc89fb92a0 ] completed
  415. 2013-08-28 15:53:11,328 DEBUG [cloud.api.ApiServlet] (catalina-exec-23:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=bd8bd897-dde9-48f5-a1bc-7cdc89fb92a0&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701576435
  416. 2013-08-28 15:53:11,537 DEBUG [cloud.api.ApiServlet] (catalina-exec-10:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=6f1e0a24-f03b-42ce-8bdc-5e26c8312a73&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701576652
  417. 2013-08-28 15:53:11,545 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-10:null) Async job-18 = [ 6f1e0a24-f03b-42ce-8bdc-5e26c8312a73 ] completed
  418. 2013-08-28 15:53:11,549 DEBUG [cloud.api.ApiServlet] (catalina-exec-10:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=6f1e0a24-f03b-42ce-8bdc-5e26c8312a73&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701576652
  419. 2013-08-28 15:53:12,356 DEBUG [cloud.api.ApiServlet] (catalina-exec-20:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=e2556b10-ae28-423b-bcf2-39a58734f603&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701577473
  420. 2013-08-28 15:53:12,364 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-20:null) Async job-19 = [ e2556b10-ae28-423b-bcf2-39a58734f603 ] completed
  421. 2013-08-28 15:53:12,368 DEBUG [cloud.api.ApiServlet] (catalina-exec-20:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=e2556b10-ae28-423b-bcf2-39a58734f603&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701577473
  422. 2013-08-28 15:53:13,048 DEBUG [cloud.api.ApiServlet] (catalina-exec-14:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=5bee707f-ea32-410d-8b43-064217ddf54b&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701578172
  423. 2013-08-28 15:53:13,055 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-8:null) SeqA 5-3227: Processing Seq 5-3227: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":2,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
  424. 2013-08-28 15:53:13,060 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-14:null) Async job-17 = [ 5bee707f-ea32-410d-8b43-064217ddf54b ] completed
  425. 2013-08-28 15:53:13,062 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-8:null) SeqA 5-3227: Sending Seq 5-3227: { Ans: , MgmtId: 345049337494, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
  426. 2013-08-28 15:53:13,066 DEBUG [cloud.api.ApiServlet] (catalina-exec-14:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=5bee707f-ea32-410d-8b43-064217ddf54b&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701578172
  427. 2013-08-28 15:53:13,271 DEBUG [cloud.api.ApiServlet] (catalina-exec-11:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=ba2a348a-ca6c-4c20-b692-327701fe9da4&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701578404
  428. 2013-08-28 15:53:13,279 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-11:null) Async job-12 = [ ba2a348a-ca6c-4c20-b692-327701fe9da4 ] completed
  429. 2013-08-28 15:53:13,283 DEBUG [cloud.api.ApiServlet] (catalina-exec-11:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=ba2a348a-ca6c-4c20-b692-327701fe9da4&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701578404
  430. 2013-08-28 15:53:13,491 INFO [agent.manager.AgentManagerImpl] (AgentManager-Handler-10:null) Connection from /10.0.100.51 closed but no cleanup was done.
  431. 2013-08-28 15:53:14,466 DEBUG [cloud.api.ApiServlet] (catalina-exec-13:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=bd8bd897-dde9-48f5-a1bc-7cdc89fb92a0&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701579582
  432. 2013-08-28 15:53:14,475 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-13:null) Async job-11 = [ bd8bd897-dde9-48f5-a1bc-7cdc89fb92a0 ] completed
  433. 2013-08-28 15:53:14,479 DEBUG [cloud.api.ApiServlet] (catalina-exec-13:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=bd8bd897-dde9-48f5-a1bc-7cdc89fb92a0&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701579582
  434. 2013-08-28 15:53:14,684 DEBUG [cloud.api.ApiServlet] (catalina-exec-25:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=6f1e0a24-f03b-42ce-8bdc-5e26c8312a73&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701579799
  435. 2013-08-28 15:53:14,694 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-25:null) Async job-18 = [ 6f1e0a24-f03b-42ce-8bdc-5e26c8312a73 ] completed
  436. 2013-08-28 15:53:14,698 DEBUG [cloud.api.ApiServlet] (catalina-exec-25:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=6f1e0a24-f03b-42ce-8bdc-5e26c8312a73&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701579799
  437. 2013-08-28 15:53:15,506 DEBUG [cloud.api.ApiServlet] (catalina-exec-2:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=e2556b10-ae28-423b-bcf2-39a58734f603&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701580623
  438. 2013-08-28 15:53:15,515 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-2:null) Async job-19 = [ e2556b10-ae28-423b-bcf2-39a58734f603 ] completed
  439. 2013-08-28 15:53:15,519 DEBUG [cloud.api.ApiServlet] (catalina-exec-2:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=e2556b10-ae28-423b-bcf2-39a58734f603&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701580623
  440. 2013-08-28 15:53:15,881 DEBUG [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Zone 1 is ready to launch secondary storage VM
  441. 2013-08-28 15:53:16,202 DEBUG [cloud.api.ApiServlet] (catalina-exec-6:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=5bee707f-ea32-410d-8b43-064217ddf54b&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701581324
  442. 2013-08-28 15:53:16,215 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-6:null) Async job-17 = [ 5bee707f-ea32-410d-8b43-064217ddf54b ] completed
  443. 2013-08-28 15:53:16,220 DEBUG [cloud.api.ApiServlet] (catalina-exec-6:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=5bee707f-ea32-410d-8b43-064217ddf54b&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701581324
  444. 2013-08-28 15:53:16,452 DEBUG [cloud.api.ApiServlet] (catalina-exec-4:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=ba2a348a-ca6c-4c20-b692-327701fe9da4&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701581577
  445. 2013-08-28 15:53:16,462 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-4:null) Async job-12 = [ ba2a348a-ca6c-4c20-b692-327701fe9da4 ] completed
  446. 2013-08-28 15:53:16,466 DEBUG [cloud.api.ApiServlet] (catalina-exec-4:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=ba2a348a-ca6c-4c20-b692-327701fe9da4&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701581577
  447. 2013-08-28 15:53:16,914 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl] (consoleproxy-1:null) Zone 1 is ready to launch console proxy
  448. 2013-08-28 15:53:17,623 DEBUG [cloud.api.ApiServlet] (catalina-exec-18:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=bd8bd897-dde9-48f5-a1bc-7cdc89fb92a0&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701582746
  449. 2013-08-28 15:53:17,632 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-18:null) Async job-11 = [ bd8bd897-dde9-48f5-a1bc-7cdc89fb92a0 ] completed
  450. 2013-08-28 15:53:17,637 DEBUG [cloud.api.ApiServlet] (catalina-exec-18:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=bd8bd897-dde9-48f5-a1bc-7cdc89fb92a0&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701582746
  451. 2013-08-28 15:53:17,818 DEBUG [cloud.api.ApiServlet] (catalina-exec-5:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=6f1e0a24-f03b-42ce-8bdc-5e26c8312a73&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701582954
  452. 2013-08-28 15:53:17,830 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-5:null) Async job-18 = [ 6f1e0a24-f03b-42ce-8bdc-5e26c8312a73 ] completed
  453. 2013-08-28 15:53:17,834 DEBUG [cloud.api.ApiServlet] (catalina-exec-5:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=6f1e0a24-f03b-42ce-8bdc-5e26c8312a73&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701582954
  454. 2013-08-28 15:53:18,640 DEBUG [cloud.api.ApiServlet] (catalina-exec-21:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=e2556b10-ae28-423b-bcf2-39a58734f603&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701583764
  455. 2013-08-28 15:53:18,650 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-21:null) Async job-19 = [ e2556b10-ae28-423b-bcf2-39a58734f603 ] completed
  456. 2013-08-28 15:53:18,654 DEBUG [cloud.api.ApiServlet] (catalina-exec-21:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=e2556b10-ae28-423b-bcf2-39a58734f603&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701583764
  457. 2013-08-28 15:53:19,335 DEBUG [cloud.api.ApiServlet] (catalina-exec-15:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=5bee707f-ea32-410d-8b43-064217ddf54b&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701584457
  458. 2013-08-28 15:53:19,343 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-15:null) Async job-17 = [ 5bee707f-ea32-410d-8b43-064217ddf54b ] completed
  459. 2013-08-28 15:53:19,348 DEBUG [cloud.api.ApiServlet] (catalina-exec-15:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=5bee707f-ea32-410d-8b43-064217ddf54b&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701584457
  460. 2013-08-28 15:53:19,577 DEBUG [cloud.api.ApiServlet] (catalina-exec-17:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=ba2a348a-ca6c-4c20-b692-327701fe9da4&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701584711
  461. 2013-08-28 15:53:19,586 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-17:null) Async job-12 = [ ba2a348a-ca6c-4c20-b692-327701fe9da4 ] completed
  462. 2013-08-28 15:53:19,591 DEBUG [cloud.api.ApiServlet] (catalina-exec-17:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=ba2a348a-ca6c-4c20-b692-327701fe9da4&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701584711
  463. 2013-08-28 15:53:20,746 DEBUG [cloud.api.ApiServlet] (catalina-exec-8:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=bd8bd897-dde9-48f5-a1bc-7cdc89fb92a0&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701585878
  464. 2013-08-28 15:53:20,756 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-8:null) Async job-11 = [ bd8bd897-dde9-48f5-a1bc-7cdc89fb92a0 ] completed
  465. 2013-08-28 15:53:20,760 DEBUG [cloud.api.ApiServlet] (catalina-exec-8:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=bd8bd897-dde9-48f5-a1bc-7cdc89fb92a0&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701585878
  466. 2013-08-28 15:53:20,958 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-11:null) Ping from 5
  467. 2013-08-28 15:53:20,965 DEBUG [cloud.api.ApiServlet] (catalina-exec-7:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=6f1e0a24-f03b-42ce-8bdc-5e26c8312a73&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701586079
  468. 2013-08-28 15:53:20,974 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-7:null) Async job-18 = [ 6f1e0a24-f03b-42ce-8bdc-5e26c8312a73 ] completed
  469. 2013-08-28 15:53:20,978 DEBUG [cloud.api.ApiServlet] (catalina-exec-7:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=6f1e0a24-f03b-42ce-8bdc-5e26c8312a73&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701586079
  470. 2013-08-28 15:53:21,760 DEBUG [cloud.api.ApiServlet] (catalina-exec-22:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=e2556b10-ae28-423b-bcf2-39a58734f603&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701586898
  471. 2013-08-28 15:53:21,769 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-22:null) Async job-19 = [ e2556b10-ae28-423b-bcf2-39a58734f603 ] completed
  472. 2013-08-28 15:53:21,773 DEBUG [cloud.api.ApiServlet] (catalina-exec-22:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=e2556b10-ae28-423b-bcf2-39a58734f603&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701586898
  473. 2013-08-28 15:53:21,946 DEBUG [network.router.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:null) Found 0 routers to update status.
  474. 2013-08-28 15:53:21,948 DEBUG [network.router.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:null) Found 0 networks to update RvR status.
  475. 2013-08-28 15:53:22,087 DEBUG [network.router.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:null) Found 0 routers to update status.
  476. 2013-08-28 15:53:22,088 DEBUG [network.router.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:null) Found 0 networks to update RvR status.
  477. 2013-08-28 15:53:22,170 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (HostReservationReleaseChecker:null) Checking if any host reservation can be released ...
  478. 2013-08-28 15:53:22,174 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (HostReservationReleaseChecker:null) Done running HostReservationReleaseChecker ...
  479. 2013-08-28 15:53:22,185 DEBUG [cloud.alert.AlertManagerImpl] (CapacityChecker:null) Running Capacity Checker ...
  480. 2013-08-28 15:53:22,185 DEBUG [cloud.alert.AlertManagerImpl] (CapacityChecker:null) recalculating system capacity
  481. 2013-08-28 15:53:22,185 DEBUG [cloud.alert.AlertManagerImpl] (CapacityChecker:null) Executing cpu/ram capacity update
  482. 2013-08-28 15:53:22,191 DEBUG [cloud.capacity.CapacityManagerImpl] (CapacityChecker:null) Found 0 VMs on host 3
  483. 2013-08-28 15:53:22,195 DEBUG [cloud.capacity.CapacityManagerImpl] (CapacityChecker:null) Found 1 VM, not running on host 3
  484. 2013-08-28 15:53:22,199 DEBUG [cloud.capacity.CapacityManagerImpl] (CapacityChecker:null) No need to calibrate cpu capacity, host:3 usedCpu: 0 reservedCpu: 1000
  485. 2013-08-28 15:53:22,199 DEBUG [cloud.capacity.CapacityManagerImpl] (CapacityChecker:null) No need to calibrate memory capacity, host:3 usedMem: 0 reservedMem: 536870912
  486. 2013-08-28 15:53:22,204 DEBUG [cloud.capacity.CapacityManagerImpl] (CapacityChecker:null) Found 3 VMs on host 6
  487. 2013-08-28 15:53:22,211 DEBUG [cloud.capacity.CapacityManagerImpl] (CapacityChecker:null) Found 0 VM, not running on host 6
  488. 2013-08-28 15:53:22,213 DEBUG [cloud.capacity.CapacityManagerImpl] (CapacityChecker:null) No need to calibrate cpu capacity, host:6 usedCpu: 1500 reservedCpu: 0
  489. 2013-08-28 15:53:22,213 DEBUG [cloud.capacity.CapacityManagerImpl] (CapacityChecker:null) No need to calibrate memory capacity, host:6 usedMem: 1476395008 reservedMem: 0
  490. 2013-08-28 15:53:22,213 DEBUG [cloud.alert.AlertManagerImpl] (CapacityChecker:null) Done executing cpu/ram capacity update
  491. 2013-08-28 15:53:22,213 DEBUG [cloud.alert.AlertManagerImpl] (CapacityChecker:null) Executing storage capacity update
  492. 2013-08-28 15:53:22,224 DEBUG [cloud.storage.StorageManagerImpl] (CapacityChecker:null) Successfully set Capacity - 15668229439488 for capacity type - 3 , DataCenterId - 1, HostOrPoolId - 1, PodId 1
  493. 2013-08-28 15:53:22,224 DEBUG [cloud.alert.AlertManagerImpl] (CapacityChecker:null) Done executing storage capacity update
  494. 2013-08-28 15:53:22,224 DEBUG [cloud.alert.AlertManagerImpl] (CapacityChecker:null) Executing capacity updates for public ip and Vlans
  495. 2013-08-28 15:53:22,237 DEBUG [cloud.alert.AlertManagerImpl] (CapacityChecker:null) Done capacity updates for public ip and Vlans
  496. 2013-08-28 15:53:22,237 DEBUG [cloud.alert.AlertManagerImpl] (CapacityChecker:null) Executing capacity updates for private ip
  497. 2013-08-28 15:53:22,242 DEBUG [cloud.alert.AlertManagerImpl] (CapacityChecker:null) Done executing capacity updates for private ip
  498. 2013-08-28 15:53:22,242 DEBUG [cloud.alert.AlertManagerImpl] (CapacityChecker:null) Done recalculating system capacity
  499. 2013-08-28 15:53:22,263 DEBUG [cloud.alert.AlertManagerImpl] (CapacityChecker:null) Done running Capacity Checker ...
  500. 2013-08-28 15:53:22,454 DEBUG [cloud.api.ApiServlet] (catalina-exec-1:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=5bee707f-ea32-410d-8b43-064217ddf54b&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701587576
  501. 2013-08-28 15:53:22,463 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-1:null) Async job-17 = [ 5bee707f-ea32-410d-8b43-064217ddf54b ] completed
  502. 2013-08-28 15:53:22,468 DEBUG [cloud.api.ApiServlet] (catalina-exec-1:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=5bee707f-ea32-410d-8b43-064217ddf54b&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701587576
  503. 2013-08-28 15:53:22,722 DEBUG [cloud.api.ApiServlet] (catalina-exec-24:null) ===START=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=ba2a348a-ca6c-4c20-b692-327701fe9da4&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701587841
  504. 2013-08-28 15:53:22,731 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-24:null) Async job-12 = [ ba2a348a-ca6c-4c20-b692-327701fe9da4 ] completed
  505. 2013-08-28 15:53:22,735 DEBUG [cloud.api.ApiServlet] (catalina-exec-24:null) ===END=== 10.0.0.36 -- GET command=queryAsyncJobResult&jobId=ba2a348a-ca6c-4c20-b692-327701fe9da4&response=json&sessionkey=gn74ulSBYRUYb8ErSf0YdJL053A%3D&_=1377701587841
  506. 2013-08-28 15:53:23,056 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-12:null) SeqA 5-3229: Processing Seq 5-3229: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":2,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
  507. 2013-08-28 15:53:23,060 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-12:null) SeqA 5-3229: Sending Seq 5-3229: { Ans: , MgmtId: 345049337494, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
  508. 2013-08-28 15:53:23,674 ERROR [agent.transport.Request] (AgentManager-Handler-15:null) Caught problem with [{"StartupRoutingCommand":{"cpus":2,"speed":3292,"memory":6137352192,"dom0MinMemory":613735219,"poolSync":false,"vms":{},"caps":"hvm,snapshot","pool":"/root","hypervisorType":"KVM","hostDetails":{"com.cloud.network.Networks.RouterPrivateIpStrategy":"HostLocal","Host.OS":"CentOS","Host.OS.Kernel.Version":"2.6.32-279.el6.x86_64","Host.OS.Version":"6.3"},"type":"Routing","dataCenter":"1","pod":"1","cluster":"1","guid":"cfcad8ed-6379-3d3b-9339-5d668e4bb67b-LibvirtComputingResource","name":"KVM-41-1","version":"4.1.1","privateIpAddress":"10.0.100.51","privateMacAddress":"00:50:56:8b:5a:3c","privateNetmask":"255.255.0.0","storageIpAddress":"10.0.100.51","storageNetmask":"255.255.0.0","storageMacAddress":"00:50:56:8b:5a:3c","resourceName":"LibvirtComputingResource","gatewayIpAddress":"10.0.1.1","contextMap":{},"wait":0}},{"StartupStorageCommand":{"totalSize":0,"poolInfo":{"uuid":"26fc5a23-9636-4c22-bd19-362aa12f4c3f","host":"10.0.100.51","localPath":"/var/lib/libvirt/images/","hostPath":"/var/lib/libvirt/images/","poolType":"Filesystem","capacityBytes":25232281600,"availableBytes":23940042752},"resourceType":"STORAGE_POOL","hostDetails":{},"type":"Storage","dataCenter":"1","pod":"1","guid":"cfcad8ed-6379-3d3b-9339-5d668e4bb67b-LibvirtComputingResource","name":"KVM-41-1","version":"4.1.1","resourceName":"LibvirtComputingResource","contextMap":{},"wait":0}}]
  509. com.google.gson.JsonParseException: The JsonDeserializer com.cloud.agent.transport.ArrayTypeAdaptor@1d8c3d92 failed to deserialize json object [{"StartupRoutingCommand":{"cpus":2,"speed":3292,"memory":6137352192,"dom0MinMemory":613735219,"poolSync":false,"vms":{},"caps":"hvm,snapshot","pool":"/root","hypervisorType":"KVM","hostDetails":{"com.cloud.network.Networks.RouterPrivateIpStrategy":"HostLocal","Host.OS":"CentOS","Host.OS.Kernel.Version":"2.6.32-279.el6.x86_64","Host.OS.Version":"6.3"},"type":"Routing","dataCenter":"1","pod":"1","cluster":"1","guid":"cfcad8ed-6379-3d3b-9339-5d668e4bb67b-LibvirtComputingResource","name":"KVM-41-1","version":"4.1.1","privateIpAddress":"10.0.100.51","privateMacAddress":"00:50:56:8b:5a:3c","privateNetmask":"255.255.0.0","storageIpAddress":"10.0.100.51","storageNetmask":"255.255.0.0","storageMacAddress":"00:50:56:8b:5a:3c","resourceName":"LibvirtComputingResource","gatewayIpAddress":"10.0.1.1","contextMap":{},"wait":0}},{"StartupStorageCommand":{"totalSize":0,"poolInfo":{"uuid":"26fc5a23-9636-4c22-bd19-362aa12f4c3f","host":"10.0.100.51","localPath":"/var/lib/libvirt/images/","hostPath":"/var/lib/libvirt/images/","poolType":"Filesystem","capacityBytes":25232281600,"availableBytes":23940042752},"resourceType":"STORAGE_POOL","hostDetails":{},"type":"Storage","dataCenter":"1","pod":"1","guid":"cfcad8ed-6379-3d3b-9339-5d668e4bb67b-LibvirtComputingResource","name":"KVM-41-1","version":"4.1.1","resourceName":"LibvirtComputingResource","contextMap":{},"wait":0}}] given the type class [Lcom.cloud.agent.api.Command;
  510. at com.google.gson.JsonDeserializerExceptionWrapper.deserialize(JsonDeserializerExceptionWrapper.java:64)
  511. at com.google.gson.JsonDeserializationVisitor.invokeCustomDeserializer(JsonDeserializationVisitor.java:92)
  512. at com.google.gson.JsonDeserializationVisitor.visitUsingCustomHandler(JsonDeserializationVisitor.java:80)
  513. at com.google.gson.ObjectNavigator.accept(ObjectNavigator.java:101)
  514. at com.google.gson.JsonDeserializationContextDefault.fromJsonArray(JsonDeserializationContextDefault.java:67)
  515. at com.google.gson.JsonDeserializationContextDefault.deserialize(JsonDeserializationContextDefault.java:52)
  516. at com.google.gson.Gson.fromJson(Gson.java:551)
  517. at com.google.gson.Gson.fromJson(Gson.java:498)
  518. at com.cloud.agent.transport.Request.getCommands(Request.java:235)
  519. at com.cloud.agent.manager.AgentManagerImpl$AgentHandler.processRequest(AgentManagerImpl.java:1195)
  520. at com.cloud.agent.manager.AgentManagerImpl$AgentHandler.doTask(AgentManagerImpl.java:1348)
  521. at com.cloud.agent.manager.ClusteredAgentManagerImpl$ClusteredAgentHandler.doTask(ClusteredAgentManagerImpl.java:666)
  522. at com.cloud.utils.nio.Task.run(Task.java:83)
  523. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
  524. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  525. at java.lang.Thread.run(Thread.java:679)
  526. Caused by: com.cloud.utils.exception.CloudRuntimeException: can't find StartupRoutingCommand
  527. at com.cloud.agent.transport.ArrayTypeAdaptor.deserialize(ArrayTypeAdaptor.java:77)
  528. at com.cloud.agent.transport.ArrayTypeAdaptor.deserialize(ArrayTypeAdaptor.java:37)
  529. at com.google.gson.JsonDeserializerExceptionWrapper.deserialize(JsonDeserializerExceptionWrapper.java:51)
  530. ... 15 more
  531. 2013-08-28 15:53:23,675 WARN [utils.nio.Task] (AgentManager-Handler-15:null) Caught the following exception but pushing on
  532. com.google.gson.JsonParseException: The JsonDeserializer com.cloud.agent.transport.ArrayTypeAdaptor@1d8c3d92 failed to deserialize json object [{"StartupRoutingCommand":{"cpus":2,"speed":3292,"memory":6137352192,"dom0MinMemory":613735219,"poolSync":false,"vms":{},"caps":"hvm,snapshot","pool":"/root","hypervisorType":"KVM","hostDetails":{"com.cloud.network.Networks.RouterPrivateIpStrategy":"HostLocal","Host.OS":"CentOS","Host.OS.Kernel.Version":"2.6.32-279.el6.x86_64","Host.OS.Version":"6.3"},"type":"Routing","dataCenter":"1","pod":"1","cluster":"1","guid":"cfcad8ed-6379-3d3b-9339-5d668e4bb67b-LibvirtComputingResource","name":"KVM-41-1","version":"4.1.1","privateIpAddress":"10.0.100.51","privateMacAddress":"00:50:56:8b:5a:3c","privateNetmask":"255.255.0.0","storageIpAddress":"10.0.100.51","storageNetmask":"255.255.0.0","storageMacAddress":"00:50:56:8b:5a:3c","resourceName":"LibvirtComputingResource","gatewayIpAddress":"10.0.1.1","contextMap":{},"wait":0}},{"StartupStorageCommand":{"totalSize":0,"poolInfo":{"uuid":"26fc5a23-9636-4c22-bd19-362aa12f4c3f","host":"10.0.100.51","localPath":"/var/lib/libvirt/images/","hostPath":"/var/lib/libvirt/images/","poolType":"Filesystem","capacityBytes":25232281600,"availableBytes":23940042752},"resourceType":"STORAGE_POOL","hostDetails":{},"type":"Storage","dataCenter":"1","pod":"1","guid":"cfcad8ed-6379-3d3b-9339-5d668e4bb67b-LibvirtComputingResource","name":"KVM-41-1","version":"4.1.1","resourceName":"LibvirtComputingResource","contextMap":{},"wait":0}}] given the type class [Lcom.cloud.agent.api.Command;
  533. at com.google.gson.JsonDeserializerExceptionWrapper.deserialize(JsonDeserializerExceptionWrapper.java:64)
  534. at com.google.gson.JsonDeserializationVisitor.invokeCustomDeserializer(JsonDeserializationVisitor.java:92)
  535. at com.google.gson.JsonDeserializationVisitor.visitUsingCustomHandler(JsonDeserializationVisitor.java:80)
  536. at com.google.gson.ObjectNavigator.accept(ObjectNavigator.java:101)
  537. at com.google.gson.JsonDeserializationContextDefault.fromJsonArray(JsonDeserializationContextDefault.java:67)
  538. at com.google.gson.JsonDeserializationContextDefault.deserialize(JsonDeserializationContextDefault.java:52)
  539. at com.google.gson.Gson.fromJson(Gson.java:551)
  540. at com.google.gson.Gson.fromJson(Gson.java:498)
  541. at com.cloud.agent.transport.Request.getCommands(Request.java:235)
  542. at com.cloud.agent.manager.AgentManagerImpl$AgentHandler.processRequest(AgentManagerImpl.java:1195)
  543. at com.cloud.agent.manager.AgentManagerImpl$AgentHandler.doTask(AgentManagerImpl.java:1348)
  544. at com.cloud.agent.manager.ClusteredAgentManagerImpl$ClusteredAgentHandler.doTask(ClusteredAgentManagerImpl.java:666)
  545. at com.cloud.utils.nio.Task.run(Task.java:83)
  546. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
  547. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  548. at java.lang.Thread.run(Thread.java:679)
  549. Caused by: com.cloud.utils.exception.CloudRuntimeException: can't find StartupRoutingCommand
  550. at com.cloud.agent.transport.ArrayTypeAdaptor.deserialize(ArrayTypeAdaptor.java:77)
  551. at com.cloud.agent.transport.ArrayTypeAdaptor.deserialize(ArrayTypeAdaptor.java:37)
  552. at com.google.gson.JsonDeserializerExceptionWrapper.deserialize(JsonDeserializerExceptionWrapper.java:51)
  553. ... 15 more
  554. 2013-08-28 15:53:23,872 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-14:null) Ping from 6
Advertisement
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!