Guest User

Untitled

a guest
May 23rd, 2013
83
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 117.00 KB | None | 0 0
  1. 2013-05-24 00:04:14,509 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-230:null) Seq 17-231931906: Executing request
  2. 2013-05-24 00:04:14,572 DEBUG [xen.resource.CitrixResourceBase] (DirectAgent-230:null) Not the master node so just return ok: 10.16.140.31
  3. 2013-05-24 00:04:14,572 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-230:null) Seq 17-231931906: Response Received:
  4. 2013-05-24 00:04:14,572 DEBUG [agent.transport.Request] (DirectAgent-230:null) Seq 17-231931906: Processing: { Ans: , MgmtId: 144350996536, via: 17, Ver: v1, Flags: 10, [{"ClusterSyncAnswer":{"_clusterId":2,"_type":-1,"isExecuted":false,"result":false,"details":"Ignore sync as this is not a pool master","wait":0}}] }
  5. 2013-05-24 00:04:15,321 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-76:null) Seq 19-800129026: Executing request
  6. 2013-05-24 00:04:15,382 DEBUG [xen.resource.CitrixResourceBase] (DirectAgent-76:null) Not the master node so just return ok: 10.16.140.33
  7. 2013-05-24 00:04:15,382 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-76:null) Seq 19-800129026: Response Received:
  8. 2013-05-24 00:04:15,383 DEBUG [agent.transport.Request] (DirectAgent-76:null) Seq 19-800129026: Processing: { Ans: , MgmtId: 144350996536, via: 19, Ver: v1, Flags: 10, [{"ClusterSyncAnswer":{"_clusterId":2,"_type":-1,"isExecuted":false,"result":false,"details":"Ignore sync as this is not a pool master","wait":0}}] }
  9. 2013-05-24 00:04:16,006 DEBUG [cloud.user.AccountManagerImpl] (http-12449-1:null) Access granted to Acct[32-1230883_J.Cangelli] to Domain:1/ by DomainChecker
  10. 2013-05-24 00:04:16,070 DEBUG [cloud.user.AccountManagerImpl] (http-12449-1:null) Access granted to Acct[32-1230883_J.Cangelli] to Domain:1/ by DomainChecker
  11. 2013-05-24 00:04:23,010 DEBUG [cloud.user.AccountManagerImpl] (http-12449-1:null) Access to Acct[32-1230883_J.Cangelli] granted to Acct[32-1230883_J.Cangelli] by DomainChecker
  12. 2013-05-24 00:04:23,013 DEBUG [cloud.network.NetworkManagerImpl] (http-12449-1:null) Associate IP address called for user 115 account 32
  13. 2013-05-24 00:04:23,015 DEBUG [cloud.network.NetworkManagerImpl] (http-12449-1:null) Associate IP address lock acquired
  14. 2013-05-24 00:04:23,025 DEBUG [cloud.network.NetworkManagerImpl] (http-12449-1:null) Got 200.170.219.59 to assign for account 32 in zone 1
  15. 2013-05-24 00:04:23,036 DEBUG [cloud.network.NetworkManagerImpl] (http-12449-1:null) Associate IP address lock released
  16. 2013-05-24 00:04:23,057 DEBUG [cloud.async.AsyncJobManagerImpl] (http-12449-1:null) submit async job-11904, details: AsyncJobVO {id:11904, userId: 115, accountId: 32, sessionKey: null, instanceType: IpAddress, instanceId: 448, cmd: com.cloud.api.commands.AssociateIPAddrCmd, cmdOriginator: null, cmdInfo: {"id":"448","response":"json","sessionkey":"qzj1pQU3WT72URSP6v0UoBN94hA\u003d","ctxUserId":"115","zoneid":"1","_":"1369360075792","ctxAccountId":"32","ctxStartEventId":"120247"}, cmdVersion: 0, callbackType: 0, callbackAddress: null, status: 0, processStatus: 0, resultCode: 0, result: null, initMsid: 144350996536, completeMsid: null, lastUpdated: null, lastPolled: null, created: null}
  17. 2013-05-24 00:04:23,058 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-3:job-11904) Executing com.cloud.api.commands.AssociateIPAddrCmd for job-11904
  18. 2013-05-24 00:04:23,062 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-3:job-11904) Sync job-11904 execution on object network.226
  19. 2013-05-24 00:04:23,071 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-3:job-11904) job com.cloud.api.commands.AssociateIPAddrCmd for job-11904 was queued, processing the queue.
  20. 2013-05-24 00:04:23,095 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-3:job-11904) Executing sync queue item: SyncQueueItemVO {id:1949, queueId: 22, contentType: AsyncJob, contentId: 11904, lastProcessMsid: 144350996536, lastprocessNumber: 190, created: Fri May 24 00:04:23 BRT 2013}
  21. 2013-05-24 00:04:23,096 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-3:job-11904) Schedule queued job-11904
  22. 2013-05-24 00:04:23,104 DEBUG [cloud.async.SyncQueueManagerImpl] (Job-Executor-3:job-11904) There is a pending process in sync queue(id: 22)
  23. 2013-05-24 00:04:23,105 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-4:job-11904) Executing com.cloud.api.commands.AssociateIPAddrCmd for job-11904
  24. 2013-05-24 00:04:23,113 DEBUG [cloud.user.AccountManagerImpl] (Job-Executor-4:job-11904) Access to Ip[200.170.219.59-1] granted to Acct[32-1230883_J.Cangelli] by DomainChecker
  25. 2013-05-24 00:04:23,136 DEBUG [agent.transport.Request] (Job-Executor-4:job-11904) Seq 3-1675755852: Sending { Cmd , MgmtId: 144350996536, via: 3, Ver: v1, Flags: 100001, [{"routing.IpAssocCommand":{"ipAddresses":[{"accountId":32,"publicIp":"200.170.219.59","sourceNat":false,"add":true,"oneToOneNat":false,"firstIP":true,"vlanId":"1465","vlanGateway":"200.170.219.33","vlanNetmask":"255.255.255.224","vifMacAddress":"06:0b:92:00:02:89","networkRate":-1,"trafficType":"Public"}],"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"10.16.140.121","router.name":"r-915-VM"},"wait":0}},{"routing.IpAssocCommand":{"ipAddresses":[{"accountId":32,"publicIp":"200.170.219.18","sourceNat":false,"add":true,"oneToOneNat":false,"firstIP":true,"vlanId":"1464","vlanGateway":"200.170.219.1","vlanNetmask":"255.255.255.224","vifMacAddress":"06:21:96:00:02:25","networkRate":-1,"trafficType":"Public"}],"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"10.16.140.121","router.name":"r-915-VM"},"wait":0}},{"routing.IpAssocCommand":{"ipAddresses":[{"accountId":32,"publicIp":"200.170.208.56","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":true,"vlanId":"1460","vlanGateway":"200.170.208.33","vlanNetmask":"255.255.255.224","vifMacAddress":"06:0a:22:00:00:e0","networkRate":-1,"trafficType":"Public"}],"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"10.16.140.121","router.name":"r-915-VM"},"wait":0}},{"routing.IpAssocCommand":{"ipAddresses":[{"accountId":32,"publicIp":"200.170.208.85","sourceNat":false,"add":true,"oneToOneNat":false,"firstIP":true,"vlanId":"1461","vlanGateway":"200.170.208.65","vlanNetmask":"255.255.255.224","vifMacAddress":"06:aa:be:00:00:fa","networkRate":-1,"trafficType":"Public"}],"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"10.16.140.121","router.name":"r-915-VM"},"wait":0}}] }
  26. 2013-05-24 00:04:23,137 DEBUG [agent.transport.Request] (Job-Executor-4:job-11904) Seq 3-1675755852: Executing: { Cmd , MgmtId: 144350996536, via: 3, Ver: v1, Flags: 100001, [{"routing.IpAssocCommand":{"ipAddresses":[{"accountId":32,"publicIp":"200.170.219.59","sourceNat":false,"add":true,"oneToOneNat":false,"firstIP":true,"vlanId":"1465","vlanGateway":"200.170.219.33","vlanNetmask":"255.255.255.224","vifMacAddress":"06:0b:92:00:02:89","networkRate":-1,"trafficType":"Public"}],"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"10.16.140.121","router.name":"r-915-VM"},"wait":0}},{"routing.IpAssocCommand":{"ipAddresses":[{"accountId":32,"publicIp":"200.170.219.18","sourceNat":false,"add":true,"oneToOneNat":false,"firstIP":true,"vlanId":"1464","vlanGateway":"200.170.219.1","vlanNetmask":"255.255.255.224","vifMacAddress":"06:21:96:00:02:25","networkRate":-1,"trafficType":"Public"}],"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"10.16.140.121","router.name":"r-915-VM"},"wait":0}},{"routing.IpAssocCommand":{"ipAddresses":[{"accountId":32,"publicIp":"200.170.208.56","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":true,"vlanId":"1460","vlanGateway":"200.170.208.33","vlanNetmask":"255.255.255.224","vifMacAddress":"06:0a:22:00:00:e0","networkRate":-1,"trafficType":"Public"}],"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"10.16.140.121","router.name":"r-915-VM"},"wait":0}},{"routing.IpAssocCommand":{"ipAddresses":[{"accountId":32,"publicIp":"200.170.208.85","sourceNat":false,"add":true,"oneToOneNat":false,"firstIP":true,"vlanId":"1461","vlanGateway":"200.170.208.65","vlanNetmask":"255.255.255.224","vifMacAddress":"06:aa:be:00:00:fa","networkRate":-1,"trafficType":"Public"}],"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"10.16.140.121","router.name":"r-915-VM"},"wait":0}}] }
  27. 2013-05-24 00:04:23,137 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-112:null) Seq 3-1675755852: Executing request
  28. 2013-05-24 00:04:23,137 INFO [vmware.resource.VmwareResource] (DirectAgent-112:esx02.vsphere.telium.local) Executing resource IPAssocCommand: {"ipAddresses":[{"accountId":32,"publicIp":"200.170.219.59","sourceNat":false,"add":true,"oneToOneNat":false,"firstIP":true,"vlanId":"1465","vlanGateway":"200.170.219.33","vlanNetmask":"255.255.255.224","vifMacAddress":"06:0b:92:00:02:89","networkRate":-1,"trafficType":"Public"}],"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"10.16.140.121","router.name":"r-915-VM"},"wait":0}
  29. 2013-05-24 00:04:23,137 DEBUG [vmware.resource.VmwareResource] (DirectAgent-112:esx02.vsphere.telium.local) Use router's private IP for SSH control. IP : 10.16.140.121
  30. 2013-05-24 00:04:23,138 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) find VM r-915-VM on host
  31. 2013-05-24 00:04:23,138 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) load VM cache on host
  32. 2013-05-24 00:04:23,358 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-20-232-VM into host cache
  33. 2013-05-24 00:04:23,358 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-610-VM into host cache
  34. 2013-05-24 00:04:23,358 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-613-VM into host cache
  35. 2013-05-24 00:04:23,358 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-615-VM into host cache
  36. 2013-05-24 00:04:23,359 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-616-VM into host cache
  37. 2013-05-24 00:04:23,359 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-617-VM into host cache
  38. 2013-05-24 00:04:23,359 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-619-VM into host cache
  39. 2013-05-24 00:04:23,359 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-640-VM into host cache
  40. 2013-05-24 00:04:23,359 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-83-639-VM into host cache
  41. 2013-05-24 00:04:23,359 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-24-645-VM into host cache
  42. 2013-05-24 00:04:23,359 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-646-VM into host cache
  43. 2013-05-24 00:04:23,359 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-665-VM into host cache
  44. 2013-05-24 00:04:23,359 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-671-VM into host cache
  45. 2013-05-24 00:04:23,359 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-46-361-VM into host cache
  46. 2013-05-24 00:04:23,359 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-57-398-VM into host cache
  47. 2013-05-24 00:04:23,359 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-52-378-VM into host cache
  48. 2013-05-24 00:04:23,359 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-5-389-VM into host cache
  49. 2013-05-24 00:04:23,359 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-11-443-VM into host cache
  50. 2013-05-24 00:04:23,359 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-2-363-VM into host cache
  51. 2013-05-24 00:04:23,359 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-460-VM into host cache
  52. 2013-05-24 00:04:23,359 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-368-VM into host cache
  53. 2013-05-24 00:04:23,359 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-561-VM into host cache
  54. 2013-05-24 00:04:23,359 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-689-VM into host cache
  55. 2013-05-24 00:04:23,359 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-92-701-VM into host cache
  56. 2013-05-24 00:04:23,359 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-97-711-VM into host cache
  57. 2013-05-24 00:04:23,359 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-757-VM into host cache
  58. 2013-05-24 00:04:23,359 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-111-756-VM into host cache
  59. 2013-05-24 00:04:23,359 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-777-VM into host cache
  60. 2013-05-24 00:04:23,359 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-118-776-VM into host cache
  61. 2013-05-24 00:04:23,359 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-123-836-VM into host cache
  62. 2013-05-24 00:04:23,359 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-123-845-VM into host cache
  63. 2013-05-24 00:04:23,359 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-2-848-VM into host cache
  64. 2013-05-24 00:04:23,359 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-108-855-VM into host cache
  65. 2013-05-24 00:04:23,359 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-2-865-VM into host cache
  66. 2013-05-24 00:04:23,359 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-28-870-VM into host cache
  67. 2013-05-24 00:04:23,359 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-123-877-VM into host cache
  68. 2013-05-24 00:04:23,359 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-123-880-VM into host cache
  69. 2013-05-24 00:04:23,359 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-892-VM into host cache
  70. 2013-05-24 00:04:23,359 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-135-893-VM into host cache
  71. 2013-05-24 00:04:23,359 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-135-894-VM into host cache
  72. 2013-05-24 00:04:23,359 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-915-VM into host cache
  73. 2013-05-24 00:04:23,359 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-11-191-VM into host cache
  74. 2013-05-24 00:04:23,577 DEBUG [vmware.resource.VmwareResource] (DirectAgent-112:esx02.vsphere.telium.local) Find public NIC index, public network name: cloud.public.1465, index: -1
  75. 2013-05-24 00:04:23,577 DEBUG [vmware.resource.VmwareResource] (DirectAgent-112:esx02.vsphere.telium.local) Plug new NIC to associate10.16.140.121 to 200.170.219.59
  76. 2013-05-24 00:04:25,868 DEBUG [vmware.mo.HypervisorHostHelper] (DirectAgent-112:esx02.vsphere.telium.local) prepare public network on other host, vlan: 1465, host: esx03.vsphere.telium.local
  77. 2013-05-24 00:04:27,339 INFO [vmware.mo.HypervisorHostHelper] (DirectAgent-112:esx02.vsphere.telium.local) Network cloud.public.1465.0.1-vSwitch1 is ready on vSwitch vSwitch1
  78. 2013-05-24 00:04:27,546 DEBUG [vmware.mo.HypervisorHostHelper] (DirectAgent-112:esx02.vsphere.telium.local) prepare public network on other host, vlan: 1465, host: esx01.vsphere.telium.local
  79. 2013-05-24 00:04:29,042 INFO [vmware.mo.HypervisorHostHelper] (DirectAgent-112:esx02.vsphere.telium.local) Network cloud.public.1465.0.1-vSwitch1 is ready on vSwitch vSwitch1
  80. 2013-05-24 00:04:29,043 INFO [vmware.mo.HypervisorHostHelper] (DirectAgent-112:esx02.vsphere.telium.local) Network cloud.public.1465.0.1-vSwitch1 is ready on vSwitch vSwitch1
  81. 2013-05-24 00:04:29,673 ERROR [vmware.resource.VmwareResource] (DirectAgent-112:esx02.vsphere.telium.local) Unexpected exception: java.lang.Exception: Could not allocate a free public NIC will shortcut rest of IPAssoc commands
  82. java.lang.Exception: Could not allocate a free public NIC
  83. at com.cloud.hypervisor.vmware.resource.VmwareResource.allocPublicNicIndex(VmwareResource.java:835)
  84. at com.cloud.hypervisor.vmware.resource.VmwareResource.plugPublicNic(VmwareResource.java:785)
  85. at com.cloud.hypervisor.vmware.resource.VmwareResource.assignPublicIpAddress(VmwareResource.java:708)
  86. at com.cloud.hypervisor.vmware.resource.VmwareResource.execute(VmwareResource.java:862)
  87. at com.cloud.hypervisor.vmware.resource.VmwareResource.executeRequest(VmwareResource.java:305)
  88. at com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:192)
  89. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  90. at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
  91. at java.util.concurrent.FutureTask.run(FutureTask.java:166)
  92. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)
  93. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)
  94. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
  95. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
  96. at java.lang.Thread.run(Thread.java:636)
  97. 2013-05-24 00:04:29,674 INFO [vmware.resource.VmwareResource] (DirectAgent-112:esx02.vsphere.telium.local) Executing resource IPAssocCommand: {"ipAddresses":[{"accountId":32,"publicIp":"200.170.219.18","sourceNat":false,"add":true,"oneToOneNat":false,"firstIP":true,"vlanId":"1464","vlanGateway":"200.170.219.1","vlanNetmask":"255.255.255.224","vifMacAddress":"06:21:96:00:02:25","networkRate":-1,"trafficType":"Public"}],"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"10.16.140.121","router.name":"r-915-VM"},"wait":0}
  98. 2013-05-24 00:04:29,674 DEBUG [vmware.resource.VmwareResource] (DirectAgent-112:esx02.vsphere.telium.local) Use router's private IP for SSH control. IP : 10.16.140.121
  99. 2013-05-24 00:04:29,674 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) find VM r-915-VM on host
  100. 2013-05-24 00:04:29,674 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) load VM cache on host
  101. 2013-05-24 00:04:29,894 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-20-232-VM into host cache
  102. 2013-05-24 00:04:29,894 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-610-VM into host cache
  103. 2013-05-24 00:04:29,894 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-613-VM into host cache
  104. 2013-05-24 00:04:29,894 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-615-VM into host cache
  105. 2013-05-24 00:04:29,894 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-616-VM into host cache
  106. 2013-05-24 00:04:29,894 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-617-VM into host cache
  107. 2013-05-24 00:04:29,894 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-619-VM into host cache
  108. 2013-05-24 00:04:29,894 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-640-VM into host cache
  109. 2013-05-24 00:04:29,894 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-83-639-VM into host cache
  110. 2013-05-24 00:04:29,895 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-24-645-VM into host cache
  111. 2013-05-24 00:04:29,895 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-646-VM into host cache
  112. 2013-05-24 00:04:29,895 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-665-VM into host cache
  113. 2013-05-24 00:04:29,895 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-671-VM into host cache
  114. 2013-05-24 00:04:29,895 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-46-361-VM into host cache
  115. 2013-05-24 00:04:29,895 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-57-398-VM into host cache
  116. 2013-05-24 00:04:29,895 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-52-378-VM into host cache
  117. 2013-05-24 00:04:29,895 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-5-389-VM into host cache
  118. 2013-05-24 00:04:29,895 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-11-443-VM into host cache
  119. 2013-05-24 00:04:29,895 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-2-363-VM into host cache
  120. 2013-05-24 00:04:29,895 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-460-VM into host cache
  121. 2013-05-24 00:04:29,895 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-368-VM into host cache
  122. 2013-05-24 00:04:29,895 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-561-VM into host cache
  123. 2013-05-24 00:04:29,895 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-689-VM into host cache
  124. 2013-05-24 00:04:29,895 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-92-701-VM into host cache
  125. 2013-05-24 00:04:29,895 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-97-711-VM into host cache
  126. 2013-05-24 00:04:29,895 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-757-VM into host cache
  127. 2013-05-24 00:04:29,895 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-111-756-VM into host cache
  128. 2013-05-24 00:04:29,895 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-777-VM into host cache
  129. 2013-05-24 00:04:29,895 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-118-776-VM into host cache
  130. 2013-05-24 00:04:29,895 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-123-836-VM into host cache
  131. 2013-05-24 00:04:29,895 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-123-845-VM into host cache
  132. 2013-05-24 00:04:29,895 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-2-848-VM into host cache
  133. 2013-05-24 00:04:29,895 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-108-855-VM into host cache
  134. 2013-05-24 00:04:29,895 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-2-865-VM into host cache
  135. 2013-05-24 00:04:29,895 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-28-870-VM into host cache
  136. 2013-05-24 00:04:29,895 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-123-877-VM into host cache
  137. 2013-05-24 00:04:29,895 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-123-880-VM into host cache
  138. 2013-05-24 00:04:29,895 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-892-VM into host cache
  139. 2013-05-24 00:04:29,895 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-135-893-VM into host cache
  140. 2013-05-24 00:04:29,895 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-135-894-VM into host cache
  141. 2013-05-24 00:04:29,895 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-915-VM into host cache
  142. 2013-05-24 00:04:29,895 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-11-191-VM into host cache
  143. 2013-05-24 00:04:30,160 DEBUG [vmware.resource.VmwareResource] (DirectAgent-112:esx02.vsphere.telium.local) Find public NIC index, public network name: cloud.public.1464, index: 3
  144. 2013-05-24 00:04:30,161 DEBUG [vmware.resource.VmwareResource] (DirectAgent-112:esx02.vsphere.telium.local) Run command on domain router 10.16.140.121, /root/ipassoc.sh -A -f -l 200.170.219.18/27 -c eth3
  145. 2013-05-24 00:04:33,452 INFO [vmware.resource.VmwareResource] (DirectAgent-112:esx02.vsphere.telium.local) ipassoc command on domain router 10.16.140.121 completed
  146. 2013-05-24 00:04:33,454 INFO [vmware.resource.VmwareResource] (DirectAgent-112:esx02.vsphere.telium.local) Executing resource IPAssocCommand: {"ipAddresses":[{"accountId":32,"publicIp":"200.170.208.56","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":true,"vlanId":"1460","vlanGateway":"200.170.208.33","vlanNetmask":"255.255.255.224","vifMacAddress":"06:0a:22:00:00:e0","networkRate":-1,"trafficType":"Public"}],"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"10.16.140.121","router.name":"r-915-VM"},"wait":0}
  147. 2013-05-24 00:04:33,454 DEBUG [vmware.resource.VmwareResource] (DirectAgent-112:esx02.vsphere.telium.local) Use router's private IP for SSH control. IP : 10.16.140.121
  148. 2013-05-24 00:04:33,454 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) find VM r-915-VM on host
  149. 2013-05-24 00:04:33,454 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) load VM cache on host
  150. 2013-05-24 00:04:33,674 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-20-232-VM into host cache
  151. 2013-05-24 00:04:33,674 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-610-VM into host cache
  152. 2013-05-24 00:04:33,674 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-613-VM into host cache
  153. 2013-05-24 00:04:33,674 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-615-VM into host cache
  154. 2013-05-24 00:04:33,674 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-616-VM into host cache
  155. 2013-05-24 00:04:33,674 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-617-VM into host cache
  156. 2013-05-24 00:04:33,674 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-619-VM into host cache
  157. 2013-05-24 00:04:33,674 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-640-VM into host cache
  158. 2013-05-24 00:04:33,674 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-83-639-VM into host cache
  159. 2013-05-24 00:04:33,674 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-24-645-VM into host cache
  160. 2013-05-24 00:04:33,674 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-646-VM into host cache
  161. 2013-05-24 00:04:33,674 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-665-VM into host cache
  162. 2013-05-24 00:04:33,674 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-671-VM into host cache
  163. 2013-05-24 00:04:33,674 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-46-361-VM into host cache
  164. 2013-05-24 00:04:33,674 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-57-398-VM into host cache
  165. 2013-05-24 00:04:33,674 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-52-378-VM into host cache
  166. 2013-05-24 00:04:33,674 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-5-389-VM into host cache
  167. 2013-05-24 00:04:33,674 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-11-443-VM into host cache
  168. 2013-05-24 00:04:33,674 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-2-363-VM into host cache
  169. 2013-05-24 00:04:33,674 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-460-VM into host cache
  170. 2013-05-24 00:04:33,674 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-368-VM into host cache
  171. 2013-05-24 00:04:33,674 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-561-VM into host cache
  172. 2013-05-24 00:04:33,674 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-689-VM into host cache
  173. 2013-05-24 00:04:33,674 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-92-701-VM into host cache
  174. 2013-05-24 00:04:33,674 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-97-711-VM into host cache
  175. 2013-05-24 00:04:33,674 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-757-VM into host cache
  176. 2013-05-24 00:04:33,674 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-111-756-VM into host cache
  177. 2013-05-24 00:04:33,674 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-777-VM into host cache
  178. 2013-05-24 00:04:33,674 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-118-776-VM into host cache
  179. 2013-05-24 00:04:33,674 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-123-836-VM into host cache
  180. 2013-05-24 00:04:33,674 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-123-845-VM into host cache
  181. 2013-05-24 00:04:33,674 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-2-848-VM into host cache
  182. 2013-05-24 00:04:33,674 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-108-855-VM into host cache
  183. 2013-05-24 00:04:33,674 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-2-865-VM into host cache
  184. 2013-05-24 00:04:33,674 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-28-870-VM into host cache
  185. 2013-05-24 00:04:33,674 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-123-877-VM into host cache
  186. 2013-05-24 00:04:33,674 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-123-880-VM into host cache
  187. 2013-05-24 00:04:33,674 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-892-VM into host cache
  188. 2013-05-24 00:04:33,674 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-135-893-VM into host cache
  189. 2013-05-24 00:04:33,675 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-135-894-VM into host cache
  190. 2013-05-24 00:04:33,675 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-915-VM into host cache
  191. 2013-05-24 00:04:33,675 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-11-191-VM into host cache
  192. 2013-05-24 00:04:33,887 DEBUG [vmware.resource.VmwareResource] (DirectAgent-112:esx02.vsphere.telium.local) Find public NIC index, public network name: cloud.public.1460, index: 2
  193. 2013-05-24 00:04:33,887 DEBUG [vmware.resource.VmwareResource] (DirectAgent-112:esx02.vsphere.telium.local) Run command on domain router 10.16.140.121, /root/ipassoc.sh -A -f -l 200.170.208.56/27 -c eth2
  194. 2013-05-24 00:04:35,008 DEBUG [cloud.server.StatsCollector] (StatsCollector-3:null) StorageCollector is running...
  195. 2013-05-24 00:04:35,092 DEBUG [cloud.vm.VirtualMachineManagerImpl] (AgentManager-Handler-4:null) Cleanup succeeded. Details null
  196. 2013-05-24 00:04:35,092 DEBUG [agent.transport.Request] (StatsCollector-3:null) Seq 25-296288292: Received: { Ans: , MgmtId: 144350996536, via: 25, Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
  197. 2013-05-24 00:04:35,092 DEBUG [cloud.vm.VirtualMachineManagerImpl] (StatsCollector-3:null) Cleanup succeeded. Details null
  198. 2013-05-24 00:04:35,096 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-244:null) Seq 4-1278542154: Executing request
  199. 2013-05-24 00:04:35,936 DEBUG [vmware.resource.VmwareResource] (DirectAgent-244:esx01.vsphere.telium.local) Datastore summary info, storageId: 691bb89e-a724-3d2f-bd9a-b14a9a441f52, localPath: /TELIUMSPO/SAS_R5_VOL1, poolType: VMFS, capacity: 1099243192320, free: 1097461661696, used: 1781530624
  200. 2013-05-24 00:04:35,937 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-244:null) Seq 4-1278542154: Response Received:
  201. 2013-05-24 00:04:35,938 DEBUG [agent.transport.Request] (StatsCollector-3:null) Seq 4-1278542154: Received: { Ans: , MgmtId: 144350996536, via: 4, Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
  202. 2013-05-24 00:04:35,938 DEBUG [cloud.vm.VirtualMachineManagerImpl] (DirectAgent-244:null) Cleanup succeeded. Details null
  203. 2013-05-24 00:04:35,938 DEBUG [cloud.vm.VirtualMachineManagerImpl] (StatsCollector-3:null) Cleanup succeeded. Details null
  204. 2013-05-24 00:04:35,940 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-457:null) Seq 2-339935506: Executing request
  205. 2013-05-24 00:04:36,021 DEBUG [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Zone 1 is ready to launch secondary storage VM
  206. 2013-05-24 00:04:36,263 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl] (consoleproxy-1:null) Zone 1 is ready to launch console proxy
  207. 2013-05-24 00:04:36,670 DEBUG [network.router.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:null) Found 71 routers.
  208. 2013-05-24 00:04:36,794 DEBUG [vmware.resource.VmwareResource] (DirectAgent-457:esx03.vsphere.telium.local) Datastore summary info, storageId: a157ebb1-d2cb-3d83-a089-bfbc85d83985, localPath: /TELIUMSPO/SAS_R10_VOL1, poolType: VMFS, capacity: 598879502336, free: 597193392128, used: 1686110208
  209. 2013-05-24 00:04:36,794 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-457:null) Seq 2-339935506: Response Received:
  210. 2013-05-24 00:04:36,794 DEBUG [cloud.vm.VirtualMachineManagerImpl] (DirectAgent-457:null) Cleanup succeeded. Details null
  211. 2013-05-24 00:04:36,794 DEBUG [agent.transport.Request] (StatsCollector-3:null) Seq 2-339935506: Received: { Ans: , MgmtId: 144350996536, via: 2, Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
  212. 2013-05-24 00:04:36,794 DEBUG [cloud.vm.VirtualMachineManagerImpl] (StatsCollector-3:null) Cleanup succeeded. Details null
  213. 2013-05-24 00:04:36,797 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-364:null) Seq 16-1501626510: Executing request
  214. 2013-05-24 00:04:37,174 INFO [vmware.resource.VmwareResource] (DirectAgent-112:esx02.vsphere.telium.local) ipassoc command on domain router 10.16.140.121 completed
  215. 2013-05-24 00:04:37,176 INFO [vmware.resource.VmwareResource] (DirectAgent-112:esx02.vsphere.telium.local) Executing resource IPAssocCommand: {"ipAddresses":[{"accountId":32,"publicIp":"200.170.208.85","sourceNat":false,"add":true,"oneToOneNat":false,"firstIP":true,"vlanId":"1461","vlanGateway":"200.170.208.65","vlanNetmask":"255.255.255.224","vifMacAddress":"06:aa:be:00:00:fa","networkRate":-1,"trafficType":"Public"}],"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"10.16.140.121","router.name":"r-915-VM"},"wait":0}
  216. 2013-05-24 00:04:37,176 DEBUG [vmware.resource.VmwareResource] (DirectAgent-112:esx02.vsphere.telium.local) Use router's private IP for SSH control. IP : 10.16.140.121
  217. 2013-05-24 00:04:37,176 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) find VM r-915-VM on host
  218. 2013-05-24 00:04:37,176 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) load VM cache on host
  219. 2013-05-24 00:04:37,392 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-20-232-VM into host cache
  220. 2013-05-24 00:04:37,392 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-610-VM into host cache
  221. 2013-05-24 00:04:37,392 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-613-VM into host cache
  222. 2013-05-24 00:04:37,392 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-615-VM into host cache
  223. 2013-05-24 00:04:37,392 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-616-VM into host cache
  224. 2013-05-24 00:04:37,392 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-617-VM into host cache
  225. 2013-05-24 00:04:37,392 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-619-VM into host cache
  226. 2013-05-24 00:04:37,392 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-640-VM into host cache
  227. 2013-05-24 00:04:37,392 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-83-639-VM into host cache
  228. 2013-05-24 00:04:37,392 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-24-645-VM into host cache
  229. 2013-05-24 00:04:37,392 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-646-VM into host cache
  230. 2013-05-24 00:04:37,393 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-665-VM into host cache
  231. 2013-05-24 00:04:37,393 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-671-VM into host cache
  232. 2013-05-24 00:04:37,393 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-46-361-VM into host cache
  233. 2013-05-24 00:04:37,393 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-57-398-VM into host cache
  234. 2013-05-24 00:04:37,393 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-52-378-VM into host cache
  235. 2013-05-24 00:04:37,393 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-5-389-VM into host cache
  236. 2013-05-24 00:04:37,393 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-11-443-VM into host cache
  237. 2013-05-24 00:04:37,393 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-2-363-VM into host cache
  238. 2013-05-24 00:04:37,393 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-460-VM into host cache
  239. 2013-05-24 00:04:37,393 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-368-VM into host cache
  240. 2013-05-24 00:04:37,393 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-561-VM into host cache
  241. 2013-05-24 00:04:37,393 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-689-VM into host cache
  242. 2013-05-24 00:04:37,393 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-92-701-VM into host cache
  243. 2013-05-24 00:04:37,393 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-97-711-VM into host cache
  244. 2013-05-24 00:04:37,393 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-757-VM into host cache
  245. 2013-05-24 00:04:37,393 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-111-756-VM into host cache
  246. 2013-05-24 00:04:37,393 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-777-VM into host cache
  247. 2013-05-24 00:04:37,393 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-118-776-VM into host cache
  248. 2013-05-24 00:04:37,393 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-123-836-VM into host cache
  249. 2013-05-24 00:04:37,393 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-123-845-VM into host cache
  250. 2013-05-24 00:04:37,393 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-2-848-VM into host cache
  251. 2013-05-24 00:04:37,393 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-108-855-VM into host cache
  252. 2013-05-24 00:04:37,393 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-2-865-VM into host cache
  253. 2013-05-24 00:04:37,393 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-28-870-VM into host cache
  254. 2013-05-24 00:04:37,393 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-123-877-VM into host cache
  255. 2013-05-24 00:04:37,393 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-123-880-VM into host cache
  256. 2013-05-24 00:04:37,393 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-892-VM into host cache
  257. 2013-05-24 00:04:37,393 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-135-893-VM into host cache
  258. 2013-05-24 00:04:37,393 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-135-894-VM into host cache
  259. 2013-05-24 00:04:37,393 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put r-915-VM into host cache
  260. 2013-05-24 00:04:37,393 DEBUG [vmware.mo.HostMO] (DirectAgent-112:esx02.vsphere.telium.local) put i-11-191-VM into host cache
  261. 2013-05-24 00:04:37,609 DEBUG [vmware.resource.VmwareResource] (DirectAgent-112:esx02.vsphere.telium.local) Find public NIC index, public network name: cloud.public.1461, index: 4
  262. 2013-05-24 00:04:37,609 DEBUG [vmware.resource.VmwareResource] (DirectAgent-112:esx02.vsphere.telium.local) Run command on domain router 10.16.140.121, /root/ipassoc.sh -A -f -l 200.170.208.85/27 -c eth4
  263. 2013-05-24 00:04:39,333 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-364:null) Seq 16-1501626510: Response Received:
  264. 2013-05-24 00:04:39,333 DEBUG [cloud.vm.VirtualMachineManagerImpl] (DirectAgent-364:null) Cleanup succeeded. Details null
  265. 2013-05-24 00:04:39,333 DEBUG [agent.transport.Request] (StatsCollector-3:null) Seq 16-1501626510: Received: { Ans: , MgmtId: 144350996536, via: 16, Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
  266. 2013-05-24 00:04:39,333 DEBUG [cloud.vm.VirtualMachineManagerImpl] (StatsCollector-3:null) Cleanup succeeded. Details null
  267. 2013-05-24 00:04:39,336 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-151:null) Seq 19-800129228: Executing request
  268. 2013-05-24 00:04:40,461 DEBUG [cloud.server.StatsCollector] (StatsCollector-2:null) HostStatsCollector is running...
  269. 2013-05-24 00:04:40,467 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-137:null) Seq 2-339935507: Executing request
  270. 2013-05-24 00:04:40,896 INFO [vmware.resource.VmwareResource] (DirectAgent-112:esx02.vsphere.telium.local) ipassoc command on domain router 10.16.140.121 completed
  271. 2013-05-24 00:04:40,898 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-112:null) Seq 3-1675755852: Response Received:
  272. 2013-05-24 00:04:40,899 DEBUG [agent.transport.Request] (DirectAgent-112:null) Seq 3-1675755852: Processing: { Ans: , MgmtId: 144350996536, via: 3, Ver: v1, Flags: 0, [{"routing.IpAssocAnswer":{"results":["Failed"],"result":false,"wait":0}},{"routing.IpAssocAnswer":{"results":["200.170.219.18 - success"],"result":true,"wait":0}},{"routing.IpAssocAnswer":{"results":["200.170.208.56 - success"],"result":true,"wait":0}},{"routing.IpAssocAnswer":{"results":["200.170.208.85 - success"],"result":true,"wait":0}}] }
  273. 2013-05-24 00:04:40,899 DEBUG [agent.transport.Request] (Job-Executor-4:job-11904) Seq 3-1675755852: Received: { Ans: , MgmtId: 144350996536, via: 3, Ver: v1, Flags: 0, { IpAssocAnswer, IpAssocAnswer, IpAssocAnswer, IpAssocAnswer } }
  274. 2013-05-24 00:04:40,899 WARN [cloud.vm.VirtualMachineManagerImpl] (DirectAgent-112:null) Cleanup failed due to null for com.cloud.agent.api.routing.IpAssocAnswer
  275. 2013-05-24 00:04:40,899 WARN [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-4:job-11904) Cleanup failed due to null for com.cloud.agent.api.routing.IpAssocAnswer
  276. 2013-05-24 00:04:40,899 DEBUG [cloud.vm.VirtualMachineManagerImpl] (DirectAgent-112:null) Cleanup succeeded. Details null
  277. 2013-05-24 00:04:40,900 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-4:job-11904) Cleanup succeeded. Details null
  278. 2013-05-24 00:04:40,900 DEBUG [cloud.vm.VirtualMachineManagerImpl] (DirectAgent-112:null) Cleanup succeeded. Details null
  279. 2013-05-24 00:04:40,900 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-4:job-11904) Cleanup succeeded. Details null
  280. 2013-05-24 00:04:40,900 DEBUG [cloud.vm.VirtualMachineManagerImpl] (DirectAgent-112:null) Cleanup succeeded. Details null
  281. 2013-05-24 00:04:40,900 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-4:job-11904) Cleanup succeeded. Details null
  282. 2013-05-24 00:04:40,900 ERROR [cloud.network.NetworkManagerImpl] (Job-Executor-4:job-11904) Unable to associate ip address due to resource unavailable exception
  283. com.cloud.exception.ResourceUnavailableException: Resource [VirtualRouter:915] is unreachable: Unable to associate ip addresses on router
  284. at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.associateIP(VirtualNetworkApplianceManagerImpl.java:2483)
  285. at com.cloud.network.element.VirtualRouterElement.applyIps(VirtualRouterElement.java:266)
  286. at com.cloud.network.NetworkManagerImpl.applyIpAssociations(NetworkManagerImpl.java:489)
  287. at com.cloud.network.NetworkManagerImpl.associateIP(NetworkManagerImpl.java:674)
  288. at com.cloud.utils.component.ComponentLocator$InterceptorDispatcher.intercept(ComponentLocator.java:1128)
  289. at com.cloud.api.commands.AssociateIPAddrCmd.execute(AssociateIPAddrCmd.java:168)
  290. at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:131)
  291. at com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:430)
  292. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  293. at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
  294. at java.util.concurrent.FutureTask.run(FutureTask.java:166)
  295. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
  296. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
  297. at java.lang.Thread.run(Thread.java:636)
  298. 2013-05-24 00:04:40,900 WARN [cloud.network.NetworkManagerImpl] (Job-Executor-4:job-11904) Failed to associate ip address Ip[200.170.219.59-1]
  299. 2013-05-24 00:04:40,931 DEBUG [agent.transport.Request] (Job-Executor-4:job-11904) Seq 3-1675755853: Sending { Cmd , MgmtId: 144350996536, via: 3, Ver: v1, Flags: 100001, [{"routing.IpAssocCommand":{"ipAddresses":[{"accountId":32,"publicIp":"200.170.219.59","sourceNat":false,"add":false,"oneToOneNat":false,"firstIP":true,"vlanId":"1465","vlanGateway":"200.170.219.33","vlanNetmask":"255.255.255.224","vifMacAddress":"06:9f:68:00:02:89","networkRate":-1,"trafficType":"Public"}],"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"10.16.140.121","router.name":"r-915-VM"},"wait":0}},{"routing.IpAssocCommand":{"ipAddresses":[{"accountId":32,"publicIp":"200.170.219.18","sourceNat":false,"add":true,"oneToOneNat":false,"firstIP":true,"vlanId":"1464","vlanGateway":"200.170.219.1","vlanNetmask":"255.255.255.224","vifMacAddress":"06:aa:42:00:02:25","networkRate":-1,"trafficType":"Public"}],"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"10.16.140.121","router.name":"r-915-VM"},"wait":0}},{"routing.IpAssocCommand":{"ipAddresses":[{"accountId":32,"publicIp":"200.170.208.56","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":true,"vlanId":"1460","vlanGateway":"200.170.208.33","vlanNetmask":"255.255.255.224","vifMacAddress":"06:58:12:00:00:e0","networkRate":-1,"trafficType":"Public"}],"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"10.16.140.121","router.name":"r-915-VM"},"wait":0}},{"routing.IpAssocCommand":{"ipAddresses":[{"accountId":32,"publicIp":"200.170.208.85","sourceNat":false,"add":true,"oneToOneNat":false,"firstIP":true,"vlanId":"1461","vlanGateway":"200.170.208.65","vlanNetmask":"255.255.255.224","vifMacAddress":"06:b7:32:00:00:fa","networkRate":-1,"trafficType":"Public"}],"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"10.16.140.121","router.name":"r-915-VM"},"wait":0}}] }
  300. 2013-05-24 00:04:40,932 DEBUG [agent.transport.Request] (Job-Executor-4:job-11904) Seq 3-1675755853: Executing: { Cmd , MgmtId: 144350996536, via: 3, Ver: v1, Flags: 100001, [{"routing.IpAssocCommand":{"ipAddresses":[{"accountId":32,"publicIp":"200.170.219.59","sourceNat":false,"add":false,"oneToOneNat":false,"firstIP":true,"vlanId":"1465","vlanGateway":"200.170.219.33","vlanNetmask":"255.255.255.224","vifMacAddress":"06:9f:68:00:02:89","networkRate":-1,"trafficType":"Public"}],"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"10.16.140.121","router.name":"r-915-VM"},"wait":0}},{"routing.IpAssocCommand":{"ipAddresses":[{"accountId":32,"publicIp":"200.170.219.18","sourceNat":false,"add":true,"oneToOneNat":false,"firstIP":true,"vlanId":"1464","vlanGateway":"200.170.219.1","vlanNetmask":"255.255.255.224","vifMacAddress":"06:aa:42:00:02:25","networkRate":-1,"trafficType":"Public"}],"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"10.16.140.121","router.name":"r-915-VM"},"wait":0}},{"routing.IpAssocCommand":{"ipAddresses":[{"accountId":32,"publicIp":"200.170.208.56","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":true,"vlanId":"1460","vlanGateway":"200.170.208.33","vlanNetmask":"255.255.255.224","vifMacAddress":"06:58:12:00:00:e0","networkRate":-1,"trafficType":"Public"}],"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"10.16.140.121","router.name":"r-915-VM"},"wait":0}},{"routing.IpAssocCommand":{"ipAddresses":[{"accountId":32,"publicIp":"200.170.208.85","sourceNat":false,"add":true,"oneToOneNat":false,"firstIP":true,"vlanId":"1461","vlanGateway":"200.170.208.65","vlanNetmask":"255.255.255.224","vifMacAddress":"06:b7:32:00:00:fa","networkRate":-1,"trafficType":"Public"}],"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"10.16.140.121","router.name":"r-915-VM"},"wait":0}}] }
  301. 2013-05-24 00:04:40,932 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-16:null) Seq 3-1675755853: Executing request
  302. 2013-05-24 00:04:40,933 INFO [vmware.resource.VmwareResource] (DirectAgent-16:esx02.vsphere.telium.local) Executing resource IPAssocCommand: {"ipAddresses":[{"accountId":32,"publicIp":"200.170.219.59","sourceNat":false,"add":false,"oneToOneNat":false,"firstIP":true,"vlanId":"1465","vlanGateway":"200.170.219.33","vlanNetmask":"255.255.255.224","vifMacAddress":"06:9f:68:00:02:89","networkRate":-1,"trafficType":"Public"}],"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"10.16.140.121","router.name":"r-915-VM"},"wait":0}
  303. 2013-05-24 00:04:40,933 DEBUG [vmware.resource.VmwareResource] (DirectAgent-16:esx02.vsphere.telium.local) Use router's private IP for SSH control. IP : 10.16.140.121
  304. 2013-05-24 00:04:40,933 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) find VM r-915-VM on host
  305. 2013-05-24 00:04:40,933 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) load VM cache on host
  306. 2013-05-24 00:04:40,996 DEBUG [cloud.storage.StorageManagerImpl] (StorageManager-Scavenger-1:null) Storage pool garbage collector found 0 templates to clean up in storage pool: SSR51
  307. 2013-05-24 00:04:40,997 DEBUG [cloud.storage.StorageManagerImpl] (StorageManager-Scavenger-1:null) Storage pool garbage collector found 0 templates to clean up in storage pool: SSR101
  308. 2013-05-24 00:04:41,000 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-137:null) Seq 2-339935507: Response Received:
  309. 2013-05-24 00:04:41,000 DEBUG [agent.transport.Request] (StatsCollector-2:null) Seq 2-339935507: Received: { Ans: , MgmtId: 144350996536, via: 2, Ver: v1, Flags: 10, { GetHostStatsAnswer } }
  310. 2013-05-24 00:04:41,000 DEBUG [cloud.vm.VirtualMachineManagerImpl] (StatsCollector-2:null) Cleanup succeeded. Details null
  311. 2013-05-24 00:04:41,000 DEBUG [cloud.vm.VirtualMachineManagerImpl] (DirectAgent-137:null) Cleanup succeeded. Details null
  312. 2013-05-24 00:04:41,007 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-48:null) Seq 3-1675755854: Executing request
  313. 2013-05-24 00:04:41,010 DEBUG [cloud.storage.StorageManagerImpl] (StorageManager-Scavenger-1:null) Storage pool garbage collector found 0 templates to clean up in storage pool: STR10_1
  314. 2013-05-24 00:04:41,019 DEBUG [cloud.storage.StorageManagerImpl] (StorageManager-Scavenger-1:null) Storage pool garbage collector found 0 templates to clean up in storage pool: STR10_2
  315. 2013-05-24 00:04:41,065 DEBUG [cloud.storage.StorageManagerImpl] (StorageManager-Scavenger-1:null) Storage pool garbage collector found 0 templates to clean up in storage pool: STR10_3
  316. 2013-05-24 00:04:41,075 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-151:null) Seq 19-800129228: Response Received:
  317. 2013-05-24 00:04:41,075 DEBUG [cloud.vm.VirtualMachineManagerImpl] (DirectAgent-151:null) Cleanup succeeded. Details null
  318. 2013-05-24 00:04:41,075 DEBUG [agent.transport.Request] (StatsCollector-3:null) Seq 19-800129228: Received: { Ans: , MgmtId: 144350996536, via: 19, Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
  319. 2013-05-24 00:04:41,075 DEBUG [cloud.vm.VirtualMachineManagerImpl] (StatsCollector-3:null) Cleanup succeeded. Details null
  320. 2013-05-24 00:04:41,076 DEBUG [cloud.storage.StorageManagerImpl] (StorageManager-Scavenger-1:null) Storage pool garbage collector found 0 templates to clean up in storage pool: STR10_4
  321. 2013-05-24 00:04:41,076 DEBUG [cloud.storage.StorageManagerImpl] (StorageManager-Scavenger-1:null) Storage pool garbage collector found 0 templates to clean up in storage pool: SSR5_1
  322. 2013-05-24 00:04:41,079 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-389:null) Seq 19-800129229: Executing request
  323. 2013-05-24 00:04:41,085 DEBUG [cloud.storage.StorageManagerImpl] (StorageManager-Scavenger-1:null) Storage pool garbage collector found 0 templates to clean up in storage pool: VMDATA01
  324. 2013-05-24 00:04:41,093 DEBUG [cloud.storage.StorageManagerImpl] (StorageManager-Scavenger-1:null) Storage pool garbage collector found 0 templates to clean up in storage pool: XENDATA01
  325. 2013-05-24 00:04:41,099 DEBUG [cloud.storage.StorageManagerImpl] (StorageManager-Scavenger-1:null) Storage pool garbage collector found 0 templates to clean up in storage pool: XENDATA02
  326. 2013-05-24 00:04:41,099 DEBUG [cloud.storage.StorageManagerImpl] (StorageManager-Scavenger-1:null) Storage pool garbage collector found 0 templates to clean up in storage pool: VMDATA02
  327. 2013-05-24 00:04:41,100 DEBUG [cloud.storage.StorageManagerImpl] (StorageManager-Scavenger-1:null) Storage pool garbage collector found 0 templates to clean up in storage pool: VMDATA03
  328. 2013-05-24 00:04:41,103 DEBUG [cloud.storage.StorageManagerImpl] (StorageManager-Scavenger-1:null) Storage pool garbage collector found 0 templates to clean up in storage pool: VMDATA04
  329. 2013-05-24 00:04:41,105 DEBUG [cloud.storage.StorageManagerImpl] (StorageManager-Scavenger-1:null) Storage pool garbage collector found 0 templates to clean up in storage pool: VMDATA05
  330. 2013-05-24 00:04:41,110 DEBUG [cloud.storage.StorageManagerImpl] (StorageManager-Scavenger-1:null) Storage pool garbage collector found 0 templates to clean up in storage pool: VMDATA06
  331. 2013-05-24 00:04:41,111 DEBUG [cloud.storage.StorageManagerImpl] (StorageManager-Scavenger-1:null) Storage pool garbage collector found 0 templates to clean up in storage pool: XENDATA03
  332. 2013-05-24 00:04:41,112 DEBUG [cloud.storage.StorageManagerImpl] (StorageManager-Scavenger-1:null) Storage pool garbage collector found 0 templates to clean up in storage pool: XENDATA04
  333. 2013-05-24 00:04:41,112 DEBUG [cloud.storage.StorageManagerImpl] (StorageManager-Scavenger-1:null) Storage pool garbage collector found 0 templates to clean up in storage pool: VMDATA07
  334. 2013-05-24 00:04:41,116 DEBUG [cloud.storage.StorageManagerImpl] (StorageManager-Scavenger-1:null) Storage pool garbage collector found 0 templates to clean up in storage pool: VMDATA08
  335. 2013-05-24 00:04:41,116 DEBUG [cloud.storage.StorageManagerImpl] (StorageManager-Scavenger-1:null) Storage pool garbage collector found 0 templates to clean up in storage pool: VMDATA09
  336. 2013-05-24 00:04:41,118 DEBUG [cloud.storage.StorageManagerImpl] (StorageManager-Scavenger-1:null) Secondary storage garbage collector found 6 templates to cleanup on secondary storage host: nfs://10.16.140.11/export
  337. 2013-05-24 00:04:41,120 DEBUG [cloud.template.TemplateManagerImpl] (StorageManager-Scavenger-1:null) Template Ubuntu 10.04 (64-bit) - LAMP in zone TELIUMSPO is not deleteable because there are non-expunged VMs deployed from this template.
  338. 2013-05-24 00:04:41,120 DEBUG [cloud.storage.StorageManagerImpl] (StorageManager-Scavenger-1:null) Not deleting template at: TmplHost[18-214-1template/tmpl/2/214//e27db36c-6a99-3aa2-b812-45b6ae1261c5.ova]
  339. 2013-05-24 00:04:41,122 DEBUG [cloud.template.TemplateManagerImpl] (StorageManager-Scavenger-1:null) Template Debian 5.0 (64-bit) - LAMP in zone TELIUMSPO is not deleteable because there are non-expunged VMs deployed from this template.
  340. 2013-05-24 00:04:41,123 DEBUG [cloud.storage.StorageManagerImpl] (StorageManager-Scavenger-1:null) Not deleting template at: TmplHost[44-239-1template/tmpl/2/239//99c86da0-b916-3581-b723-d1a92111e490.ova]
  341. 2013-05-24 00:04:41,126 DEBUG [cloud.template.TemplateManagerImpl] (StorageManager-Scavenger-1:null) Template l2tp_radius_auth-OK in zone TELIUMSPO is not deleteable because there are non-expunged VMs deployed from this template.
  342. 2013-05-24 00:04:41,126 DEBUG [cloud.storage.StorageManagerImpl] (StorageManager-Scavenger-1:null) Not deleting template at: TmplHost[107-305-1template/tmpl/75/305/526c62e4-9161-48e3-9970-3002081dee44.vhd]
  343. 2013-05-24 00:04:41,129 DEBUG [cloud.template.TemplateManagerImpl] (StorageManager-Scavenger-1:null) Template i-123-845-VM_ROOT in zone TELIUMSPO is not deleteable because there are non-expunged VMs deployed from this template.
  344. 2013-05-24 00:04:41,129 DEBUG [cloud.storage.StorageManagerImpl] (StorageManager-Scavenger-1:null) Not deleting template at: TmplHost[131-355-1template/tmpl/123/355/e29a0b29-0b4f-4362-9199-965b487d50cd.ova]
  345. 2013-05-24 00:04:41,131 DEBUG [cloud.template.TemplateManagerImpl] (StorageManager-Scavenger-1:null) Template i-123-830-VM in zone TELIUMSPO is not deleteable because there are non-expunged VMs deployed from this template.
  346. 2013-05-24 00:04:41,131 DEBUG [cloud.storage.StorageManagerImpl] (StorageManager-Scavenger-1:null) Not deleting template at: TmplHost[132-356-1template/tmpl/123/356/2898902d-4756-4431-8453-d7a03b466918.ova]
  347. 2013-05-24 00:04:41,133 DEBUG [cloud.template.TemplateManagerImpl] (StorageManager-Scavenger-1:null) Template i-123-827-VM in zone TELIUMSPO is not deleteable because there are non-expunged VMs deployed from this template.
  348. 2013-05-24 00:04:41,133 DEBUG [cloud.storage.StorageManagerImpl] (StorageManager-Scavenger-1:null) Not deleting template at: TmplHost[133-357-1template/tmpl/123/357/50a44714-bb75-4077-9b4a-5e2b99be32cd.ova]
  349. 2013-05-24 00:04:41,152 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-20-232-VM into host cache
  350. 2013-05-24 00:04:41,153 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-610-VM into host cache
  351. 2013-05-24 00:04:41,153 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-613-VM into host cache
  352. 2013-05-24 00:04:41,153 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-615-VM into host cache
  353. 2013-05-24 00:04:41,153 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-616-VM into host cache
  354. 2013-05-24 00:04:41,153 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-617-VM into host cache
  355. 2013-05-24 00:04:41,153 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-619-VM into host cache
  356. 2013-05-24 00:04:41,153 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-640-VM into host cache
  357. 2013-05-24 00:04:41,153 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-83-639-VM into host cache
  358. 2013-05-24 00:04:41,153 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-24-645-VM into host cache
  359. 2013-05-24 00:04:41,153 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-646-VM into host cache
  360. 2013-05-24 00:04:41,153 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-665-VM into host cache
  361. 2013-05-24 00:04:41,153 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-671-VM into host cache
  362. 2013-05-24 00:04:41,153 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-46-361-VM into host cache
  363. 2013-05-24 00:04:41,153 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-57-398-VM into host cache
  364. 2013-05-24 00:04:41,153 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-52-378-VM into host cache
  365. 2013-05-24 00:04:41,153 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-5-389-VM into host cache
  366. 2013-05-24 00:04:41,153 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-11-443-VM into host cache
  367. 2013-05-24 00:04:41,153 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-2-363-VM into host cache
  368. 2013-05-24 00:04:41,153 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-460-VM into host cache
  369. 2013-05-24 00:04:41,153 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-368-VM into host cache
  370. 2013-05-24 00:04:41,153 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-561-VM into host cache
  371. 2013-05-24 00:04:41,153 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-689-VM into host cache
  372. 2013-05-24 00:04:41,153 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-92-701-VM into host cache
  373. 2013-05-24 00:04:41,153 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-97-711-VM into host cache
  374. 2013-05-24 00:04:41,153 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-757-VM into host cache
  375. 2013-05-24 00:04:41,153 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-111-756-VM into host cache
  376. 2013-05-24 00:04:41,153 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-777-VM into host cache
  377. 2013-05-24 00:04:41,153 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-118-776-VM into host cache
  378. 2013-05-24 00:04:41,153 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-123-836-VM into host cache
  379. 2013-05-24 00:04:41,153 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-123-845-VM into host cache
  380. 2013-05-24 00:04:41,153 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-2-848-VM into host cache
  381. 2013-05-24 00:04:41,153 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-108-855-VM into host cache
  382. 2013-05-24 00:04:41,153 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-2-865-VM into host cache
  383. 2013-05-24 00:04:41,153 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-28-870-VM into host cache
  384. 2013-05-24 00:04:41,153 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-123-877-VM into host cache
  385. 2013-05-24 00:04:41,153 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-123-880-VM into host cache
  386. 2013-05-24 00:04:41,153 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-892-VM into host cache
  387. 2013-05-24 00:04:41,153 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-135-893-VM into host cache
  388. 2013-05-24 00:04:41,153 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-135-894-VM into host cache
  389. 2013-05-24 00:04:41,154 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-915-VM into host cache
  390. 2013-05-24 00:04:41,154 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-11-191-VM into host cache
  391. 2013-05-24 00:04:41,367 DEBUG [vmware.resource.VmwareResource] (DirectAgent-16:esx02.vsphere.telium.local) Find public NIC index, public network name: cloud.public.1465, index: -1
  392. 2013-05-24 00:04:41,367 DEBUG [vmware.resource.VmwareResource] (DirectAgent-16:esx02.vsphere.telium.local) Unplug NIC -1
  393. 2013-05-24 00:04:41,367 ERROR [vmware.resource.VmwareResource] (DirectAgent-16:esx02.vsphere.telium.local) Failed to find DomR VIF to associate/disassociate IP with.
  394. 2013-05-24 00:04:41,367 ERROR [vmware.resource.VmwareResource] (DirectAgent-16:esx02.vsphere.telium.local) Unexpected exception: com.cloud.exception.InternalErrorException: Failed to find DomR VIF to associate/disassociate IP with. will shortcut rest of IPAssoc commands
  395. com.cloud.exception.InternalErrorException: Failed to find DomR VIF to associate/disassociate IP with.
  396. at com.cloud.hypervisor.vmware.resource.VmwareResource.assignPublicIpAddress(VmwareResource.java:718)
  397. at com.cloud.hypervisor.vmware.resource.VmwareResource.execute(VmwareResource.java:862)
  398. at com.cloud.hypervisor.vmware.resource.VmwareResource.executeRequest(VmwareResource.java:305)
  399. at com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:192)
  400. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  401. at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
  402. at java.util.concurrent.FutureTask.run(FutureTask.java:166)
  403. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)
  404. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)
  405. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
  406. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
  407. at java.lang.Thread.run(Thread.java:636)
  408. 2013-05-24 00:04:41,369 INFO [vmware.resource.VmwareResource] (DirectAgent-16:esx02.vsphere.telium.local) Executing resource IPAssocCommand: {"ipAddresses":[{"accountId":32,"publicIp":"200.170.219.18","sourceNat":false,"add":true,"oneToOneNat":false,"firstIP":true,"vlanId":"1464","vlanGateway":"200.170.219.1","vlanNetmask":"255.255.255.224","vifMacAddress":"06:aa:42:00:02:25","networkRate":-1,"trafficType":"Public"}],"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"10.16.140.121","router.name":"r-915-VM"},"wait":0}
  409. 2013-05-24 00:04:41,369 DEBUG [vmware.resource.VmwareResource] (DirectAgent-16:esx02.vsphere.telium.local) Use router's private IP for SSH control. IP : 10.16.140.121
  410. 2013-05-24 00:04:41,369 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) find VM r-915-VM on host
  411. 2013-05-24 00:04:41,369 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) load VM cache on host
  412. 2013-05-24 00:04:41,543 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-48:null) Seq 3-1675755854: Response Received:
  413. 2013-05-24 00:04:41,543 DEBUG [agent.transport.Request] (StatsCollector-2:null) Seq 3-1675755854: Received: { Ans: , MgmtId: 144350996536, via: 3, Ver: v1, Flags: 10, { GetHostStatsAnswer } }
  414. 2013-05-24 00:04:41,543 DEBUG [cloud.vm.VirtualMachineManagerImpl] (DirectAgent-48:null) Cleanup succeeded. Details null
  415. 2013-05-24 00:04:41,543 DEBUG [cloud.vm.VirtualMachineManagerImpl] (StatsCollector-2:null) Cleanup succeeded. Details null
  416. 2013-05-24 00:04:41,547 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-423:null) Seq 4-1278542155: Executing request
  417. 2013-05-24 00:04:41,587 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-20-232-VM into host cache
  418. 2013-05-24 00:04:41,588 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-610-VM into host cache
  419. 2013-05-24 00:04:41,588 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-613-VM into host cache
  420. 2013-05-24 00:04:41,588 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-615-VM into host cache
  421. 2013-05-24 00:04:41,588 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-616-VM into host cache
  422. 2013-05-24 00:04:41,588 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-617-VM into host cache
  423. 2013-05-24 00:04:41,588 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-619-VM into host cache
  424. 2013-05-24 00:04:41,588 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-640-VM into host cache
  425. 2013-05-24 00:04:41,588 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-83-639-VM into host cache
  426. 2013-05-24 00:04:41,588 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-24-645-VM into host cache
  427. 2013-05-24 00:04:41,588 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-646-VM into host cache
  428. 2013-05-24 00:04:41,588 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-665-VM into host cache
  429. 2013-05-24 00:04:41,588 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-671-VM into host cache
  430. 2013-05-24 00:04:41,588 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-46-361-VM into host cache
  431. 2013-05-24 00:04:41,588 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-57-398-VM into host cache
  432. 2013-05-24 00:04:41,588 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-52-378-VM into host cache
  433. 2013-05-24 00:04:41,588 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-5-389-VM into host cache
  434. 2013-05-24 00:04:41,588 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-11-443-VM into host cache
  435. 2013-05-24 00:04:41,588 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-2-363-VM into host cache
  436. 2013-05-24 00:04:41,588 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-460-VM into host cache
  437. 2013-05-24 00:04:41,588 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-368-VM into host cache
  438. 2013-05-24 00:04:41,588 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-561-VM into host cache
  439. 2013-05-24 00:04:41,588 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-689-VM into host cache
  440. 2013-05-24 00:04:41,588 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-92-701-VM into host cache
  441. 2013-05-24 00:04:41,588 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-97-711-VM into host cache
  442. 2013-05-24 00:04:41,588 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-757-VM into host cache
  443. 2013-05-24 00:04:41,588 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-111-756-VM into host cache
  444. 2013-05-24 00:04:41,588 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-777-VM into host cache
  445. 2013-05-24 00:04:41,588 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-118-776-VM into host cache
  446. 2013-05-24 00:04:41,588 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-123-836-VM into host cache
  447. 2013-05-24 00:04:41,588 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-123-845-VM into host cache
  448. 2013-05-24 00:04:41,588 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-2-848-VM into host cache
  449. 2013-05-24 00:04:41,588 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-108-855-VM into host cache
  450. 2013-05-24 00:04:41,588 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-2-865-VM into host cache
  451. 2013-05-24 00:04:41,588 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-28-870-VM into host cache
  452. 2013-05-24 00:04:41,588 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-123-877-VM into host cache
  453. 2013-05-24 00:04:41,588 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-123-880-VM into host cache
  454. 2013-05-24 00:04:41,588 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-892-VM into host cache
  455. 2013-05-24 00:04:41,588 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-135-893-VM into host cache
  456. 2013-05-24 00:04:41,589 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-135-894-VM into host cache
  457. 2013-05-24 00:04:41,589 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-915-VM into host cache
  458. 2013-05-24 00:04:41,589 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-11-191-VM into host cache
  459. 2013-05-24 00:04:41,815 DEBUG [vmware.resource.VmwareResource] (DirectAgent-16:esx02.vsphere.telium.local) Find public NIC index, public network name: cloud.public.1464, index: 3
  460. 2013-05-24 00:04:41,815 DEBUG [vmware.resource.VmwareResource] (DirectAgent-16:esx02.vsphere.telium.local) Run command on domain router 10.16.140.121, /root/ipassoc.sh -A -f -l 200.170.219.18/27 -c eth3
  461. 2013-05-24 00:04:42,108 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-423:null) Seq 4-1278542155: Response Received:
  462. 2013-05-24 00:04:42,109 DEBUG [agent.transport.Request] (StatsCollector-2:null) Seq 4-1278542155: Received: { Ans: , MgmtId: 144350996536, via: 4, Ver: v1, Flags: 10, { GetHostStatsAnswer } }
  463. 2013-05-24 00:04:42,109 DEBUG [cloud.vm.VirtualMachineManagerImpl] (DirectAgent-423:null) Cleanup succeeded. Details null
  464. 2013-05-24 00:04:42,109 DEBUG [cloud.vm.VirtualMachineManagerImpl] (StatsCollector-2:null) Cleanup succeeded. Details null
  465. 2013-05-24 00:04:42,113 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-403:null) Seq 14-1205272766: Executing request
  466. 2013-05-24 00:04:42,266 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-403:null) Seq 14-1205272766: Response Received:
  467. 2013-05-24 00:04:42,267 DEBUG [cloud.vm.VirtualMachineManagerImpl] (DirectAgent-403:null) Cleanup succeeded. Details null
  468. 2013-05-24 00:04:42,267 DEBUG [agent.transport.Request] (StatsCollector-2:null) Seq 14-1205272766: Received: { Ans: , MgmtId: 144350996536, via: 14, Ver: v1, Flags: 10, { GetHostStatsAnswer } }
  469. 2013-05-24 00:04:42,267 DEBUG [cloud.vm.VirtualMachineManagerImpl] (StatsCollector-2:null) Cleanup succeeded. Details null
  470. 2013-05-24 00:04:42,271 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-103:null) Seq 16-1501626511: Executing request
  471. 2013-05-24 00:04:42,554 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-103:null) Seq 16-1501626511: Response Received:
  472. 2013-05-24 00:04:42,555 DEBUG [cloud.vm.VirtualMachineManagerImpl] (DirectAgent-103:null) Cleanup succeeded. Details null
  473. 2013-05-24 00:04:42,555 DEBUG [agent.transport.Request] (StatsCollector-2:null) Seq 16-1501626511: Received: { Ans: , MgmtId: 144350996536, via: 16, Ver: v1, Flags: 10, { GetHostStatsAnswer } }
  474. 2013-05-24 00:04:42,555 DEBUG [cloud.vm.VirtualMachineManagerImpl] (StatsCollector-2:null) Cleanup succeeded. Details null
  475. 2013-05-24 00:04:42,559 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-54:null) Seq 17-231932133: Executing request
  476. 2013-05-24 00:04:42,607 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-8:null) Ping from 29
  477. 2013-05-24 00:04:42,786 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-389:null) Seq 19-800129229: Response Received:
  478. 2013-05-24 00:04:42,786 DEBUG [cloud.vm.VirtualMachineManagerImpl] (DirectAgent-389:null) Cleanup succeeded. Details null
  479. 2013-05-24 00:04:42,786 DEBUG [agent.transport.Request] (StatsCollector-3:null) Seq 19-800129229: Received: { Ans: , MgmtId: 144350996536, via: 19, Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
  480. 2013-05-24 00:04:42,786 DEBUG [cloud.vm.VirtualMachineManagerImpl] (StatsCollector-3:null) Cleanup succeeded. Details null
  481. 2013-05-24 00:04:42,789 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-465:null) Seq 16-1501626512: Executing request
  482. 2013-05-24 00:04:42,848 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-54:null) Seq 17-231932133: Response Received:
  483. 2013-05-24 00:04:42,848 DEBUG [cloud.vm.VirtualMachineManagerImpl] (DirectAgent-54:null) Cleanup succeeded. Details null
  484. 2013-05-24 00:04:42,848 DEBUG [agent.transport.Request] (StatsCollector-2:null) Seq 17-231932133: Received: { Ans: , MgmtId: 144350996536, via: 17, Ver: v1, Flags: 10, { GetHostStatsAnswer } }
  485. 2013-05-24 00:04:42,848 DEBUG [cloud.vm.VirtualMachineManagerImpl] (StatsCollector-2:null) Cleanup succeeded. Details null
  486. 2013-05-24 00:04:42,852 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-298:null) Seq 19-800129230: Executing request
  487. 2013-05-24 00:04:43,198 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-298:null) Seq 19-800129230: Response Received:
  488. 2013-05-24 00:04:43,198 DEBUG [cloud.vm.VirtualMachineManagerImpl] (DirectAgent-298:null) Cleanup succeeded. Details null
  489. 2013-05-24 00:04:43,198 DEBUG [agent.transport.Request] (StatsCollector-2:null) Seq 19-800129230: Received: { Ans: , MgmtId: 144350996536, via: 19, Ver: v1, Flags: 10, { GetHostStatsAnswer } }
  490. 2013-05-24 00:04:43,198 DEBUG [cloud.vm.VirtualMachineManagerImpl] (StatsCollector-2:null) Cleanup succeeded. Details null
  491. 2013-05-24 00:04:44,458 DEBUG [cloud.server.StatsCollector] (StatsCollector-2:null) VmStatsCollector is running...
  492. 2013-05-24 00:04:44,473 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-445:null) Seq 2-339935508: Executing request
  493. 2013-05-24 00:04:44,752 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-465:null) Seq 16-1501626512: Response Received:
  494. 2013-05-24 00:04:44,752 DEBUG [agent.transport.Request] (StatsCollector-3:null) Seq 16-1501626512: Received: { Ans: , MgmtId: 144350996536, via: 16, Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
  495. 2013-05-24 00:04:44,752 DEBUG [cloud.vm.VirtualMachineManagerImpl] (DirectAgent-465:null) Cleanup succeeded. Details null
  496. 2013-05-24 00:04:44,752 DEBUG [cloud.vm.VirtualMachineManagerImpl] (StatsCollector-3:null) Cleanup succeeded. Details null
  497. 2013-05-24 00:04:44,755 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-480:null) Seq 17-231932134: Executing request
  498. 2013-05-24 00:04:45,150 INFO [vmware.resource.VmwareResource] (DirectAgent-16:esx02.vsphere.telium.local) ipassoc command on domain router 10.16.140.121 completed
  499. 2013-05-24 00:04:45,152 INFO [vmware.resource.VmwareResource] (DirectAgent-16:esx02.vsphere.telium.local) Executing resource IPAssocCommand: {"ipAddresses":[{"accountId":32,"publicIp":"200.170.208.56","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":true,"vlanId":"1460","vlanGateway":"200.170.208.33","vlanNetmask":"255.255.255.224","vifMacAddress":"06:58:12:00:00:e0","networkRate":-1,"trafficType":"Public"}],"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"10.16.140.121","router.name":"r-915-VM"},"wait":0}
  500. 2013-05-24 00:04:45,152 DEBUG [vmware.resource.VmwareResource] (DirectAgent-16:esx02.vsphere.telium.local) Use router's private IP for SSH control. IP : 10.16.140.121
  501. 2013-05-24 00:04:45,152 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) find VM r-915-VM on host
  502. 2013-05-24 00:04:45,152 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) load VM cache on host
  503. 2013-05-24 00:04:45,207 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-9:null) Ping from 25
  504. 2013-05-24 00:04:45,302 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) find VM i-32-298-VM on host
  505. 2013-05-24 00:04:45,302 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) load VM cache on host
  506. 2013-05-24 00:04:45,368 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-20-232-VM into host cache
  507. 2013-05-24 00:04:45,368 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-610-VM into host cache
  508. 2013-05-24 00:04:45,368 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-613-VM into host cache
  509. 2013-05-24 00:04:45,368 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-615-VM into host cache
  510. 2013-05-24 00:04:45,368 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-616-VM into host cache
  511. 2013-05-24 00:04:45,368 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-617-VM into host cache
  512. 2013-05-24 00:04:45,368 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-619-VM into host cache
  513. 2013-05-24 00:04:45,368 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-640-VM into host cache
  514. 2013-05-24 00:04:45,368 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-83-639-VM into host cache
  515. 2013-05-24 00:04:45,368 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-24-645-VM into host cache
  516. 2013-05-24 00:04:45,368 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-646-VM into host cache
  517. 2013-05-24 00:04:45,368 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-665-VM into host cache
  518. 2013-05-24 00:04:45,368 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-671-VM into host cache
  519. 2013-05-24 00:04:45,368 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-46-361-VM into host cache
  520. 2013-05-24 00:04:45,368 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-57-398-VM into host cache
  521. 2013-05-24 00:04:45,369 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-52-378-VM into host cache
  522. 2013-05-24 00:04:45,369 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-5-389-VM into host cache
  523. 2013-05-24 00:04:45,369 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-11-443-VM into host cache
  524. 2013-05-24 00:04:45,369 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-2-363-VM into host cache
  525. 2013-05-24 00:04:45,369 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-460-VM into host cache
  526. 2013-05-24 00:04:45,369 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-368-VM into host cache
  527. 2013-05-24 00:04:45,369 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-561-VM into host cache
  528. 2013-05-24 00:04:45,369 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-689-VM into host cache
  529. 2013-05-24 00:04:45,369 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-92-701-VM into host cache
  530. 2013-05-24 00:04:45,369 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-97-711-VM into host cache
  531. 2013-05-24 00:04:45,369 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-757-VM into host cache
  532. 2013-05-24 00:04:45,369 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-111-756-VM into host cache
  533. 2013-05-24 00:04:45,369 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-777-VM into host cache
  534. 2013-05-24 00:04:45,369 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-118-776-VM into host cache
  535. 2013-05-24 00:04:45,369 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-123-836-VM into host cache
  536. 2013-05-24 00:04:45,369 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-123-845-VM into host cache
  537. 2013-05-24 00:04:45,369 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-2-848-VM into host cache
  538. 2013-05-24 00:04:45,369 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-108-855-VM into host cache
  539. 2013-05-24 00:04:45,369 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-2-865-VM into host cache
  540. 2013-05-24 00:04:45,369 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-28-870-VM into host cache
  541. 2013-05-24 00:04:45,369 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-123-877-VM into host cache
  542. 2013-05-24 00:04:45,369 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-123-880-VM into host cache
  543. 2013-05-24 00:04:45,369 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-892-VM into host cache
  544. 2013-05-24 00:04:45,369 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-135-893-VM into host cache
  545. 2013-05-24 00:04:45,369 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-135-894-VM into host cache
  546. 2013-05-24 00:04:45,369 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-915-VM into host cache
  547. 2013-05-24 00:04:45,369 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-11-191-VM into host cache
  548. 2013-05-24 00:04:45,517 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) put i-32-298-VM into host cache
  549. 2013-05-24 00:04:45,517 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) put r-679-VM into host cache
  550. 2013-05-24 00:04:45,517 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) put i-92-681-VM into host cache
  551. 2013-05-24 00:04:45,517 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) put r-688-VM into host cache
  552. 2013-05-24 00:04:45,517 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) put r-692-VM into host cache
  553. 2013-05-24 00:04:45,517 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) put r-698-VM into host cache
  554. 2013-05-24 00:04:45,517 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) put i-92-699-VM into host cache
  555. 2013-05-24 00:04:45,517 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) put r-728-VM into host cache
  556. 2013-05-24 00:04:45,517 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) put ec4d862b-ffe7-35c0-b500-d9829666723e into host cache
  557. 2013-05-24 00:04:45,517 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) put 47555aea-2d69-334f-9cfe-6f9835087446 into host cache
  558. 2013-05-24 00:04:45,517 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) put i-2-800-VM into host cache
  559. 2013-05-24 00:04:45,517 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) put r-807-VM into host cache
  560. 2013-05-24 00:04:45,517 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) put r-811-VM into host cache
  561. 2013-05-24 00:04:45,517 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) put a5caab1b-18c7-3876-acf0-a70f1bf8b396 into host cache
  562. 2013-05-24 00:04:45,517 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) put r-828-VM into host cache
  563. 2013-05-24 00:04:45,517 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) put e8f8575e-f244-39c0-9f17-551a163f8c93 into host cache
  564. 2013-05-24 00:04:45,517 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) put i-123-830-VM into host cache
  565. 2013-05-24 00:04:45,517 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) put r-832-VM into host cache
  566. 2013-05-24 00:04:45,517 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) put i-125-833-VM into host cache
  567. 2013-05-24 00:04:45,517 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) put i-126-842-VM into host cache
  568. 2013-05-24 00:04:45,517 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) put 64924b21-0af5-348d-8f1c-f7a365810696 into host cache
  569. 2013-05-24 00:04:45,517 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) put i-92-844-VM into host cache
  570. 2013-05-24 00:04:45,517 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) put r-850-VM into host cache
  571. 2013-05-24 00:04:45,517 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) put 30382ef8-9bdb-3a7f-ade5-1cc2e389b336 into host cache
  572. 2013-05-24 00:04:45,517 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) put dd60c0fc-a67c-3120-b6d6-fcdc943c4312 into host cache
  573. 2013-05-24 00:04:45,518 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) put fda25927-444d-3634-816c-02204d25f85f into host cache
  574. 2013-05-24 00:04:45,518 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) put r-886-VM into host cache
  575. 2013-05-24 00:04:45,518 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) put i-135-888-VM into host cache
  576. 2013-05-24 00:04:45,518 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) put i-135-890-VM into host cache
  577. 2013-05-24 00:04:45,518 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) put r-900-VM into host cache
  578. 2013-05-24 00:04:45,518 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) put aaeb91b7-a66d-3f87-a205-2b8f60df60c9 into host cache
  579. 2013-05-24 00:04:45,518 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) put r-904-VM into host cache
  580. 2013-05-24 00:04:45,518 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) put i-139-905-VM into host cache
  581. 2013-05-24 00:04:45,586 DEBUG [vmware.resource.VmwareResource] (DirectAgent-16:esx02.vsphere.telium.local) Find public NIC index, public network name: cloud.public.1460, index: 2
  582. 2013-05-24 00:04:45,586 DEBUG [vmware.resource.VmwareResource] (DirectAgent-16:esx02.vsphere.telium.local) Run command on domain router 10.16.140.121, /root/ipassoc.sh -A -f -l 200.170.208.56/27 -c eth2
  583. 2013-05-24 00:04:45,723 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) find VM i-92-681-VM on host
  584. 2013-05-24 00:04:45,723 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) VM i-92-681-VM found in host cache
  585. 2013-05-24 00:04:45,934 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) find VM i-92-699-VM on host
  586. 2013-05-24 00:04:45,934 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) VM i-92-699-VM found in host cache
  587. 2013-05-24 00:04:46,145 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) find VM i-123-830-VM on host
  588. 2013-05-24 00:04:46,145 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) VM i-123-830-VM found in host cache
  589. 2013-05-24 00:04:46,359 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) find VM i-125-833-VM on host
  590. 2013-05-24 00:04:46,359 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) VM i-125-833-VM found in host cache
  591. 2013-05-24 00:04:46,408 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-480:null) Seq 17-231932134: Response Received:
  592. 2013-05-24 00:04:46,408 DEBUG [agent.transport.Request] (StatsCollector-3:null) Seq 17-231932134: Received: { Ans: , MgmtId: 144350996536, via: 17, Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
  593. 2013-05-24 00:04:46,408 DEBUG [cloud.vm.VirtualMachineManagerImpl] (DirectAgent-480:null) Cleanup succeeded. Details null
  594. 2013-05-24 00:04:46,408 DEBUG [cloud.vm.VirtualMachineManagerImpl] (StatsCollector-3:null) Cleanup succeeded. Details null
  595. 2013-05-24 00:04:46,411 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-231:null) Seq 2-339935509: Executing request
  596. 2013-05-24 00:04:46,570 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) find VM i-126-842-VM on host
  597. 2013-05-24 00:04:46,570 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) VM i-126-842-VM found in host cache
  598. 2013-05-24 00:04:46,781 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) find VM i-92-844-VM on host
  599. 2013-05-24 00:04:46,781 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) VM i-92-844-VM found in host cache
  600. 2013-05-24 00:04:46,996 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) find VM i-135-888-VM on host
  601. 2013-05-24 00:04:46,997 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) VM i-135-888-VM found in host cache
  602. 2013-05-24 00:04:47,202 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) find VM i-135-890-VM on host
  603. 2013-05-24 00:04:47,202 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) VM i-135-890-VM found in host cache
  604. 2013-05-24 00:04:47,239 DEBUG [vmware.resource.VmwareResource] (DirectAgent-231:esx03.vsphere.telium.local) Datastore summary info, storageId: 16f6d0b5-bba2-3fa2-a991-5fcb05d9f89b, localPath: /TELIUMSPO/VMDATA01, poolType: VMFS, capacity: 1099243192320, free: 145127112704, used: 954116079616
  605. 2013-05-24 00:04:47,239 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-231:null) Seq 2-339935509: Response Received:
  606. 2013-05-24 00:04:47,239 DEBUG [agent.transport.Request] (StatsCollector-3:null) Seq 2-339935509: Received: { Ans: , MgmtId: 144350996536, via: 2, Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
  607. 2013-05-24 00:04:47,239 DEBUG [cloud.vm.VirtualMachineManagerImpl] (DirectAgent-231:null) Cleanup succeeded. Details null
  608. 2013-05-24 00:04:47,239 DEBUG [cloud.vm.VirtualMachineManagerImpl] (StatsCollector-3:null) Cleanup succeeded. Details null
  609. 2013-05-24 00:04:47,242 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-197:null) Seq 17-231932135: Executing request
  610. 2013-05-24 00:04:47,413 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) find VM i-139-905-VM on host
  611. 2013-05-24 00:04:47,413 DEBUG [vmware.mo.HostMO] (DirectAgent-445:esx03.vsphere.telium.local) VM i-139-905-VM found in host cache
  612. 2013-05-24 00:04:47,622 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-445:null) Seq 2-339935508: Response Received:
  613. 2013-05-24 00:04:47,623 DEBUG [cloud.vm.VirtualMachineManagerImpl] (DirectAgent-445:null) Cleanup succeeded. Details null
  614. 2013-05-24 00:04:47,623 DEBUG [agent.transport.Request] (StatsCollector-2:null) Seq 2-339935508: Received: { Ans: , MgmtId: 144350996536, via: 2, Ver: v1, Flags: 10, { GetVmStatsAnswer } }
  615. 2013-05-24 00:04:47,623 DEBUG [cloud.vm.VirtualMachineManagerImpl] (StatsCollector-2:null) Cleanup succeeded. Details null
  616. 2013-05-24 00:04:47,649 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-420:null) Seq 3-1675755855: Executing request
  617. 2013-05-24 00:04:48,530 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) find VM i-20-232-VM on host
  618. 2013-05-24 00:04:48,530 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) load VM cache on host
  619. 2013-05-24 00:04:48,746 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) put i-20-232-VM into host cache
  620. 2013-05-24 00:04:48,746 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) put r-610-VM into host cache
  621. 2013-05-24 00:04:48,746 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) put r-613-VM into host cache
  622. 2013-05-24 00:04:48,746 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) put r-615-VM into host cache
  623. 2013-05-24 00:04:48,746 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) put r-616-VM into host cache
  624. 2013-05-24 00:04:48,746 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) put r-617-VM into host cache
  625. 2013-05-24 00:04:48,746 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) put r-619-VM into host cache
  626. 2013-05-24 00:04:48,746 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) put r-640-VM into host cache
  627. 2013-05-24 00:04:48,746 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) put i-83-639-VM into host cache
  628. 2013-05-24 00:04:48,746 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) put i-24-645-VM into host cache
  629. 2013-05-24 00:04:48,746 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) put r-646-VM into host cache
  630. 2013-05-24 00:04:48,746 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) put r-665-VM into host cache
  631. 2013-05-24 00:04:48,746 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) put r-671-VM into host cache
  632. 2013-05-24 00:04:48,746 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) put i-46-361-VM into host cache
  633. 2013-05-24 00:04:48,746 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) put i-57-398-VM into host cache
  634. 2013-05-24 00:04:48,746 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) put i-52-378-VM into host cache
  635. 2013-05-24 00:04:48,746 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) put i-5-389-VM into host cache
  636. 2013-05-24 00:04:48,746 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) put i-11-443-VM into host cache
  637. 2013-05-24 00:04:48,746 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) put i-2-363-VM into host cache
  638. 2013-05-24 00:04:48,746 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) put r-460-VM into host cache
  639. 2013-05-24 00:04:48,746 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) put r-368-VM into host cache
  640. 2013-05-24 00:04:48,746 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) put r-561-VM into host cache
  641. 2013-05-24 00:04:48,746 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) put r-689-VM into host cache
  642. 2013-05-24 00:04:48,746 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) put i-92-701-VM into host cache
  643. 2013-05-24 00:04:48,746 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) put i-97-711-VM into host cache
  644. 2013-05-24 00:04:48,746 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) put r-757-VM into host cache
  645. 2013-05-24 00:04:48,746 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) put i-111-756-VM into host cache
  646. 2013-05-24 00:04:48,746 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) put r-777-VM into host cache
  647. 2013-05-24 00:04:48,746 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) put i-118-776-VM into host cache
  648. 2013-05-24 00:04:48,746 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) put i-123-836-VM into host cache
  649. 2013-05-24 00:04:48,746 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) put i-123-845-VM into host cache
  650. 2013-05-24 00:04:48,746 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) put i-2-848-VM into host cache
  651. 2013-05-24 00:04:48,746 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) put i-108-855-VM into host cache
  652. 2013-05-24 00:04:48,746 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) put i-2-865-VM into host cache
  653. 2013-05-24 00:04:48,746 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) put i-28-870-VM into host cache
  654. 2013-05-24 00:04:48,746 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) put i-123-877-VM into host cache
  655. 2013-05-24 00:04:48,746 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) put i-123-880-VM into host cache
  656. 2013-05-24 00:04:48,747 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) put r-892-VM into host cache
  657. 2013-05-24 00:04:48,747 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) put i-135-893-VM into host cache
  658. 2013-05-24 00:04:48,747 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) put i-135-894-VM into host cache
  659. 2013-05-24 00:04:48,747 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) put r-915-VM into host cache
  660. 2013-05-24 00:04:48,747 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) put i-11-191-VM into host cache
  661. 2013-05-24 00:04:48,873 INFO [vmware.resource.VmwareResource] (DirectAgent-16:esx02.vsphere.telium.local) ipassoc command on domain router 10.16.140.121 completed
  662. 2013-05-24 00:04:48,875 INFO [vmware.resource.VmwareResource] (DirectAgent-16:esx02.vsphere.telium.local) Executing resource IPAssocCommand: {"ipAddresses":[{"accountId":32,"publicIp":"200.170.208.85","sourceNat":false,"add":true,"oneToOneNat":false,"firstIP":true,"vlanId":"1461","vlanGateway":"200.170.208.65","vlanNetmask":"255.255.255.224","vifMacAddress":"06:b7:32:00:00:fa","networkRate":-1,"trafficType":"Public"}],"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"10.16.140.121","router.name":"r-915-VM"},"wait":0}
  663. 2013-05-24 00:04:48,875 DEBUG [vmware.resource.VmwareResource] (DirectAgent-16:esx02.vsphere.telium.local) Use router's private IP for SSH control. IP : 10.16.140.121
  664. 2013-05-24 00:04:48,875 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) find VM r-915-VM on host
  665. 2013-05-24 00:04:48,875 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) load VM cache on host
  666. 2013-05-24 00:04:48,951 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) find VM i-83-639-VM on host
  667. 2013-05-24 00:04:48,951 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) VM i-83-639-VM found in host cache
  668. 2013-05-24 00:04:49,020 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-197:null) Seq 17-231932135: Response Received:
  669. 2013-05-24 00:04:49,020 DEBUG [agent.transport.Request] (StatsCollector-3:null) Seq 17-231932135: Received: { Ans: , MgmtId: 144350996536, via: 17, Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
  670. 2013-05-24 00:04:49,020 DEBUG [cloud.vm.VirtualMachineManagerImpl] (DirectAgent-197:null) Cleanup succeeded. Details null
  671. 2013-05-24 00:04:49,020 DEBUG [cloud.vm.VirtualMachineManagerImpl] (StatsCollector-3:null) Cleanup succeeded. Details null
  672. 2013-05-24 00:04:49,023 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-185:null) Seq 14-1205272767: Executing request
  673. 2013-05-24 00:04:49,091 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-20-232-VM into host cache
  674. 2013-05-24 00:04:49,091 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-610-VM into host cache
  675. 2013-05-24 00:04:49,091 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-613-VM into host cache
  676. 2013-05-24 00:04:49,091 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-615-VM into host cache
  677. 2013-05-24 00:04:49,091 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-616-VM into host cache
  678. 2013-05-24 00:04:49,091 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-617-VM into host cache
  679. 2013-05-24 00:04:49,092 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-619-VM into host cache
  680. 2013-05-24 00:04:49,092 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-640-VM into host cache
  681. 2013-05-24 00:04:49,092 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-83-639-VM into host cache
  682. 2013-05-24 00:04:49,092 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-24-645-VM into host cache
  683. 2013-05-24 00:04:49,092 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-646-VM into host cache
  684. 2013-05-24 00:04:49,092 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-665-VM into host cache
  685. 2013-05-24 00:04:49,092 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-671-VM into host cache
  686. 2013-05-24 00:04:49,092 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-46-361-VM into host cache
  687. 2013-05-24 00:04:49,092 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-57-398-VM into host cache
  688. 2013-05-24 00:04:49,092 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-52-378-VM into host cache
  689. 2013-05-24 00:04:49,092 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-5-389-VM into host cache
  690. 2013-05-24 00:04:49,092 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-11-443-VM into host cache
  691. 2013-05-24 00:04:49,092 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-2-363-VM into host cache
  692. 2013-05-24 00:04:49,092 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-460-VM into host cache
  693. 2013-05-24 00:04:49,092 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-368-VM into host cache
  694. 2013-05-24 00:04:49,092 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-561-VM into host cache
  695. 2013-05-24 00:04:49,092 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-689-VM into host cache
  696. 2013-05-24 00:04:49,092 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-92-701-VM into host cache
  697. 2013-05-24 00:04:49,092 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-97-711-VM into host cache
  698. 2013-05-24 00:04:49,092 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-757-VM into host cache
  699. 2013-05-24 00:04:49,092 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-111-756-VM into host cache
  700. 2013-05-24 00:04:49,092 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-777-VM into host cache
  701. 2013-05-24 00:04:49,092 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-118-776-VM into host cache
  702. 2013-05-24 00:04:49,092 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-123-836-VM into host cache
  703. 2013-05-24 00:04:49,092 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-123-845-VM into host cache
  704. 2013-05-24 00:04:49,092 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-2-848-VM into host cache
  705. 2013-05-24 00:04:49,092 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-108-855-VM into host cache
  706. 2013-05-24 00:04:49,092 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-2-865-VM into host cache
  707. 2013-05-24 00:04:49,092 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-28-870-VM into host cache
  708. 2013-05-24 00:04:49,092 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-123-877-VM into host cache
  709. 2013-05-24 00:04:49,092 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-123-880-VM into host cache
  710. 2013-05-24 00:04:49,092 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-892-VM into host cache
  711. 2013-05-24 00:04:49,092 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-135-893-VM into host cache
  712. 2013-05-24 00:04:49,092 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-135-894-VM into host cache
  713. 2013-05-24 00:04:49,092 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put r-915-VM into host cache
  714. 2013-05-24 00:04:49,092 DEBUG [vmware.mo.HostMO] (DirectAgent-16:esx02.vsphere.telium.local) put i-11-191-VM into host cache
  715. 2013-05-24 00:04:49,161 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) find VM i-24-645-VM on host
  716. 2013-05-24 00:04:49,161 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) VM i-24-645-VM found in host cache
  717. 2013-05-24 00:04:49,315 DEBUG [vmware.resource.VmwareResource] (DirectAgent-16:esx02.vsphere.telium.local) Find public NIC index, public network name: cloud.public.1461, index: 4
  718. 2013-05-24 00:04:49,315 DEBUG [vmware.resource.VmwareResource] (DirectAgent-16:esx02.vsphere.telium.local) Run command on domain router 10.16.140.121, /root/ipassoc.sh -A -f -l 200.170.208.85/27 -c eth4
  719. 2013-05-24 00:04:49,373 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) find VM i-46-361-VM on host
  720. 2013-05-24 00:04:49,374 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) VM i-46-361-VM found in host cache
  721. 2013-05-24 00:04:49,583 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) find VM i-57-398-VM on host
  722. 2013-05-24 00:04:49,583 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) VM i-57-398-VM found in host cache
  723. 2013-05-24 00:04:49,791 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) find VM i-52-378-VM on host
  724. 2013-05-24 00:04:49,792 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) VM i-52-378-VM found in host cache
  725. 2013-05-24 00:04:50,000 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) find VM i-5-389-VM on host
  726. 2013-05-24 00:04:50,000 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) VM i-5-389-VM found in host cache
  727. 2013-05-24 00:04:50,211 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) find VM i-11-443-VM on host
  728. 2013-05-24 00:04:50,211 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) VM i-11-443-VM found in host cache
  729. 2013-05-24 00:04:50,423 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) find VM i-2-363-VM on host
  730. 2013-05-24 00:04:50,423 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) VM i-2-363-VM found in host cache
  731. 2013-05-24 00:04:50,632 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) find VM i-92-701-VM on host
  732. 2013-05-24 00:04:50,632 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) VM i-92-701-VM found in host cache
  733. 2013-05-24 00:04:50,843 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) find VM i-97-711-VM on host
  734. 2013-05-24 00:04:50,843 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) VM i-97-711-VM found in host cache
  735. 2013-05-24 00:04:50,925 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-185:null) Seq 14-1205272767: Response Received:
  736. 2013-05-24 00:04:50,925 DEBUG [agent.transport.Request] (StatsCollector-3:null) Seq 14-1205272767: Received: { Ans: , MgmtId: 144350996536, via: 14, Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
  737. 2013-05-24 00:04:50,925 DEBUG [cloud.vm.VirtualMachineManagerImpl] (DirectAgent-185:null) Cleanup succeeded. Details null
  738. 2013-05-24 00:04:50,925 DEBUG [cloud.vm.VirtualMachineManagerImpl] (StatsCollector-3:null) Cleanup succeeded. Details null
  739. 2013-05-24 00:04:50,928 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-292:null) Seq 3-1675755856: Executing request
  740. 2013-05-24 00:04:51,054 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) find VM i-111-756-VM on host
  741. 2013-05-24 00:04:51,054 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) VM i-111-756-VM found in host cache
  742. 2013-05-24 00:04:51,262 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) find VM i-118-776-VM on host
  743. 2013-05-24 00:04:51,262 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) VM i-118-776-VM found in host cache
  744. 2013-05-24 00:04:51,471 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) find VM i-123-836-VM on host
  745. 2013-05-24 00:04:51,471 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) VM i-123-836-VM found in host cache
  746. 2013-05-24 00:04:51,682 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) find VM i-123-845-VM on host
  747. 2013-05-24 00:04:51,682 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) VM i-123-845-VM found in host cache
  748. 2013-05-24 00:04:51,760 DEBUG [vmware.resource.VmwareResource] (DirectAgent-292:esx02.vsphere.telium.local) Datastore summary info, storageId: c62f3198-6ab3-3047-95f6-76fc48d3149f, localPath: /TELIUMSPO/VMDATA02, poolType: VMFS, capacity: 1099243192320, free: 1098639212544, used: 603979776
  749. 2013-05-24 00:04:51,761 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-292:null) Seq 3-1675755856: Response Received:
  750. 2013-05-24 00:04:51,762 DEBUG [agent.transport.Request] (StatsCollector-3:null) Seq 3-1675755856: Received: { Ans: , MgmtId: 144350996536, via: 3, Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
  751. 2013-05-24 00:04:51,762 DEBUG [cloud.vm.VirtualMachineManagerImpl] (DirectAgent-292:null) Cleanup succeeded. Details null
  752. 2013-05-24 00:04:51,762 DEBUG [cloud.vm.VirtualMachineManagerImpl] (StatsCollector-3:null) Cleanup succeeded. Details null
  753. 2013-05-24 00:04:51,764 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-345:null) Seq 4-1278542156: Executing request
  754. 2013-05-24 00:04:51,895 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) find VM i-2-848-VM on host
  755. 2013-05-24 00:04:51,895 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) VM i-2-848-VM found in host cache
  756. 2013-05-24 00:04:52,103 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) find VM i-108-855-VM on host
  757. 2013-05-24 00:04:52,103 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) VM i-108-855-VM found in host cache
  758. 2013-05-24 00:04:52,315 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) find VM i-2-865-VM on host
  759. 2013-05-24 00:04:52,315 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) VM i-2-865-VM found in host cache
  760. 2013-05-24 00:04:52,523 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) find VM i-28-870-VM on host
  761. 2013-05-24 00:04:52,523 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) VM i-28-870-VM found in host cache
  762. 2013-05-24 00:04:52,601 DEBUG [vmware.resource.VmwareResource] (DirectAgent-345:esx01.vsphere.telium.local) Datastore summary info, storageId: 2b22a1fd-35c4-307a-be85-abc6e71ef4f3, localPath: /TELIUMSPO/VMDATA03, poolType: VMFS, capacity: 1099243192320, free: 1098635018240, used: 608174080
  763. 2013-05-24 00:04:52,603 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-345:null) Seq 4-1278542156: Response Received:
  764. 2013-05-24 00:04:52,603 DEBUG [agent.transport.Request] (StatsCollector-3:null) Seq 4-1278542156: Received: { Ans: , MgmtId: 144350996536, via: 4, Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
  765. 2013-05-24 00:04:52,603 DEBUG [cloud.vm.VirtualMachineManagerImpl] (DirectAgent-345:null) Cleanup succeeded. Details null
  766. 2013-05-24 00:04:52,603 DEBUG [cloud.vm.VirtualMachineManagerImpl] (StatsCollector-3:null) Cleanup succeeded. Details null
  767. 2013-05-24 00:04:52,606 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-252:null) Seq 4-1278542157: Executing request
  768. 2013-05-24 00:04:52,613 INFO [vmware.resource.VmwareResource] (DirectAgent-16:esx02.vsphere.telium.local) ipassoc command on domain router 10.16.140.121 completed
  769. 2013-05-24 00:04:52,614 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-16:null) Seq 3-1675755853: Response Received:
  770. 2013-05-24 00:04:52,615 DEBUG [agent.transport.Request] (DirectAgent-16:null) Seq 3-1675755853: Processing: { Ans: , MgmtId: 144350996536, via: 3, Ver: v1, Flags: 0, [{"routing.IpAssocAnswer":{"results":["Failed"],"result":false,"wait":0}},{"routing.IpAssocAnswer":{"results":["200.170.219.18 - success"],"result":true,"wait":0}},{"routing.IpAssocAnswer":{"results":["200.170.208.56 - success"],"result":true,"wait":0}},{"routing.IpAssocAnswer":{"results":["200.170.208.85 - success"],"result":true,"wait":0}}] }
  771. 2013-05-24 00:04:52,615 DEBUG [agent.transport.Request] (Job-Executor-4:job-11904) Seq 3-1675755853: Received: { Ans: , MgmtId: 144350996536, via: 3, Ver: v1, Flags: 0, { IpAssocAnswer, IpAssocAnswer, IpAssocAnswer, IpAssocAnswer } }
  772. 2013-05-24 00:04:52,615 WARN [cloud.vm.VirtualMachineManagerImpl] (DirectAgent-16:null) Cleanup failed due to null for com.cloud.agent.api.routing.IpAssocAnswer
  773. 2013-05-24 00:04:52,615 WARN [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-4:job-11904) Cleanup failed due to null for com.cloud.agent.api.routing.IpAssocAnswer
  774. 2013-05-24 00:04:52,615 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-4:job-11904) Cleanup succeeded. Details null
  775. 2013-05-24 00:04:52,615 DEBUG [cloud.vm.VirtualMachineManagerImpl] (DirectAgent-16:null) Cleanup succeeded. Details null
  776. 2013-05-24 00:04:52,615 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-4:job-11904) Cleanup succeeded. Details null
  777. 2013-05-24 00:04:52,615 DEBUG [cloud.vm.VirtualMachineManagerImpl] (DirectAgent-16:null) Cleanup succeeded. Details null
  778. 2013-05-24 00:04:52,615 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-4:job-11904) Cleanup succeeded. Details null
  779. 2013-05-24 00:04:52,615 DEBUG [cloud.vm.VirtualMachineManagerImpl] (DirectAgent-16:null) Cleanup succeeded. Details null
  780. 2013-05-24 00:04:52,615 DEBUG [cloud.network.NetworkManagerImpl] (Job-Executor-4:job-11904) Resource is not available: DomainRouter
  781. com.cloud.exception.ResourceUnavailableException: Resource [VirtualRouter:915] is unreachable: Unable to associate ip addresses on router
  782. at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.associateIP(VirtualNetworkApplianceManagerImpl.java:2483)
  783. at com.cloud.network.element.VirtualRouterElement.applyIps(VirtualRouterElement.java:266)
  784. at com.cloud.network.NetworkManagerImpl.applyIpAssociations(NetworkManagerImpl.java:489)
  785. at com.cloud.network.NetworkManagerImpl.associateIP(NetworkManagerImpl.java:690)
  786. at com.cloud.utils.component.ComponentLocator$InterceptorDispatcher.intercept(ComponentLocator.java:1128)
  787. at com.cloud.api.commands.AssociateIPAddrCmd.execute(AssociateIPAddrCmd.java:168)
  788. at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:131)
  789. at com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:430)
  790. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  791. at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
  792. at java.util.concurrent.FutureTask.run(FutureTask.java:166)
  793. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
  794. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
  795. at java.lang.Thread.run(Thread.java:636)
  796. 2013-05-24 00:04:52,632 WARN [cloud.api.ApiDispatcher] (Job-Executor-4:job-11904) class com.cloud.api.ServerApiException : Failed to assign ip address
  797. 2013-05-24 00:04:52,633 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-4:job-11904) Complete async job-11904, jobStatus: 2, resultCode: 530, result: com.cloud.api.response.ExceptionResponse@159d486
  798. 2013-05-24 00:04:52,639 DEBUG [cloud.async.SyncQueueManagerImpl] (Job-Executor-4:job-11904) Sync queue (22) is currently empty
  799. 2013-05-24 00:04:52,639 WARN [cloud.async.AsyncJobManagerImpl] (Job-Executor-4:job-11904) Unable to unregister active job 11904 from JMX minotoring
  800. 2013-05-24 00:04:52,736 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) find VM i-123-877-VM on host
  801. 2013-05-24 00:04:52,736 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) VM i-123-877-VM found in host cache
  802. 2013-05-24 00:04:52,944 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) find VM i-123-880-VM on host
  803. 2013-05-24 00:04:52,944 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) VM i-123-880-VM found in host cache
  804. 2013-05-24 00:04:53,096 DEBUG [cloud.async.AsyncJobManagerImpl] (http-12449-1:null) Async job-11904 completed
  805. 2013-05-24 00:04:53,155 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) find VM i-135-893-VM on host
  806. 2013-05-24 00:04:53,155 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) VM i-135-893-VM found in host cache
  807. 2013-05-24 00:04:53,366 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) find VM i-135-894-VM on host
  808. 2013-05-24 00:04:53,366 DEBUG [vmware.mo.HostMO] (DirectAgent-420:esx02.vsphere.telium.local) VM i-135-894-VM found in host cache
Advertisement
Add Comment
Please, Sign In to add comment