API tools faq
paste
Guest User

Management-server

a guest
Jan 29th, 2013
139
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 487.33 KB | None | 0 0
raw download clone embed print report
  1. 2013-01-29 14:28:19,155 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Cleaning up resources for the vm VM[SecondaryStorageVm|s-201-VM] in Starting state
  2. 2013-01-29 14:28:19,156 DEBUG [agent.transport.Request] (secstorage-1:null) Seq 7-2090140026: Sending { Cmd , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 100111, [{"StopCommand":{"isProxy":false,"vmName":"s-201-VM","wait":0}}] }
  3. 2013-01-29 14:28:19,262 DEBUG [agent.transport.Request] (AgentManager-Handler-10:null) Seq 7-2090140026: Processing: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, [{"StopAnswer":{"vncPort":0,"result":true,"wait":0}}] }
  4. 2013-01-29 14:28:19,262 DEBUG [agent.manager.AgentAttache] (AgentManager-Handler-10:null) Seq 7-2090140026: No more commands found
  5. 2013-01-29 14:28:19,262 DEBUG [agent.transport.Request] (secstorage-1:null) Seq 7-2090140026: Received: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, { StopAnswer } }
  6. 2013-01-29 14:28:19,314 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Service SecurityGroup is not supported in the network id=222
  7. 2013-01-29 14:28:19,414 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to release Nic[734-201-fe76dd94-05ae-4702-b713-8ba4fe801ee3-212.70.6.205]
  8. 2013-01-29 14:28:19,414 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to release Nic[734-201-fe76dd94-05ae-4702-b713-8ba4fe801ee3-212.70.6.205]
  9. 2013-01-29 14:28:19,414 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to release Nic[734-201-fe76dd94-05ae-4702-b713-8ba4fe801ee3-212.70.6.205]
  10. 2013-01-29 14:28:19,414 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to release Nic[734-201-fe76dd94-05ae-4702-b713-8ba4fe801ee3-212.70.6.205]
  11. 2013-01-29 14:28:19,414 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to release Nic[734-201-fe76dd94-05ae-4702-b713-8ba4fe801ee3-212.70.6.205]
  12. 2013-01-29 14:28:19,414 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to release Nic[734-201-fe76dd94-05ae-4702-b713-8ba4fe801ee3-212.70.6.205]
  13. 2013-01-29 14:28:19,414 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to release Nic[734-201-fe76dd94-05ae-4702-b713-8ba4fe801ee3-212.70.6.205]
  14. 2013-01-29 14:28:19,514 DEBUG [network.guru.ControlNetworkGuru] (secstorage-1:null) Released nic: NicProfile[735-201-null-null-null
  15. 2013-01-29 14:28:19,556 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to release Nic[735-201-fe76dd94-05ae-4702-b713-8ba4fe801ee3-null]
  16. 2013-01-29 14:28:19,556 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to release Nic[735-201-fe76dd94-05ae-4702-b713-8ba4fe801ee3-null]
  17. 2013-01-29 14:28:19,556 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to release Nic[735-201-fe76dd94-05ae-4702-b713-8ba4fe801ee3-null]
  18. 2013-01-29 14:28:19,556 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to release Nic[735-201-fe76dd94-05ae-4702-b713-8ba4fe801ee3-null]
  19. 2013-01-29 14:28:19,556 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to release Nic[735-201-fe76dd94-05ae-4702-b713-8ba4fe801ee3-null]
  20. 2013-01-29 14:28:19,556 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to release Nic[735-201-fe76dd94-05ae-4702-b713-8ba4fe801ee3-null]
  21. 2013-01-29 14:28:19,556 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to release Nic[735-201-fe76dd94-05ae-4702-b713-8ba4fe801ee3-null]
  22. 2013-01-29 14:28:19,607 DEBUG [dc.dao.DataCenterIpAddressDaoImpl] (secstorage-1:null) Releasing ip address for reservationId=fe76dd94-05ae-4702-b713-8ba4fe801ee3, instance=736
  23. 2013-01-29 14:28:19,648 DEBUG [network.guru.PodBasedNetworkGuru] (secstorage-1:null) Released nic: NicProfile[736-201-null-null-null
  24. 2013-01-29 14:28:19,706 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to release Nic[736-201-fe76dd94-05ae-4702-b713-8ba4fe801ee3-null]
  25. 2013-01-29 14:28:19,707 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to release Nic[736-201-fe76dd94-05ae-4702-b713-8ba4fe801ee3-null]
  26. 2013-01-29 14:28:19,707 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to release Nic[736-201-fe76dd94-05ae-4702-b713-8ba4fe801ee3-null]
  27. 2013-01-29 14:28:19,707 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to release Nic[736-201-fe76dd94-05ae-4702-b713-8ba4fe801ee3-null]
  28. 2013-01-29 14:28:19,707 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to release Nic[736-201-fe76dd94-05ae-4702-b713-8ba4fe801ee3-null]
  29. 2013-01-29 14:28:19,707 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to release Nic[736-201-fe76dd94-05ae-4702-b713-8ba4fe801ee3-null]
  30. 2013-01-29 14:28:19,707 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to release Nic[736-201-fe76dd94-05ae-4702-b713-8ba4fe801ee3-null]
  31. 2013-01-29 14:28:19,750 DEBUG [dc.dao.DataCenterIpAddressDaoImpl] (secstorage-1:null) Releasing ip address for reservationId=fe76dd94-05ae-4702-b713-8ba4fe801ee3, instance=737
  32. 2013-01-29 14:28:19,791 DEBUG [network.guru.PodBasedNetworkGuru] (secstorage-1:null) Released nic: NicProfile[737-201-null-null-null
  33. 2013-01-29 14:28:19,833 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to release Nic[737-201-fe76dd94-05ae-4702-b713-8ba4fe801ee3-null]
  34. 2013-01-29 14:28:19,833 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to release Nic[737-201-fe76dd94-05ae-4702-b713-8ba4fe801ee3-null]
  35. 2013-01-29 14:28:19,833 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to release Nic[737-201-fe76dd94-05ae-4702-b713-8ba4fe801ee3-null]
  36. 2013-01-29 14:28:19,833 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to release Nic[737-201-fe76dd94-05ae-4702-b713-8ba4fe801ee3-null]
  37. 2013-01-29 14:28:19,833 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to release Nic[737-201-fe76dd94-05ae-4702-b713-8ba4fe801ee3-null]
  38. 2013-01-29 14:28:19,833 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to release Nic[737-201-fe76dd94-05ae-4702-b713-8ba4fe801ee3-null]
  39. 2013-01-29 14:28:19,833 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to release Nic[737-201-fe76dd94-05ae-4702-b713-8ba4fe801ee3-null]
  40. 2013-01-29 14:28:19,833 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Successfully released network resources for the vm VM[SecondaryStorageVm|s-201-VM]
  41. 2013-01-29 14:28:19,833 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Successfully cleanued up resources for the vm VM[SecondaryStorageVm|s-201-VM] in Starting state
  42. 2013-01-29 14:28:19,933 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: 7
  43. 2013-01-29 14:28:19,935 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) Hosts's actual total CPU: 12004 and CPU after applying overprovisioning: 12004
  44. 2013-01-29 14:28:19,935 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) release cpu from host: 7, old used: 500,reserved: 0, actual total: 12004, total with overprovisioning: 12004; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  45. 2013-01-29 14:28:19,935 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) release mem from host: 7, old used: 268435456,reserved: 0, total: 8269606912; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  46. 2013-01-29 14:28:19,983 WARN [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Exception while trying to start secondary storage vm
  47. com.cloud.exception.AgentUnavailableException: Resource [Host:7] is unreachable: Host 7: Unable to start instance due to com.cloud.agent.api.Answer cannot be cast to com.cloud.agent.api.storage.PrimaryStorageDownloadAnswer
  48. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:847)
  49. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:472)
  50. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:465)
  51. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.startSecStorageVm(SecondaryStorageManagerImpl.java:257)
  52. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.allocCapacity(SecondaryStorageManagerImpl.java:684)
  53. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.expandPool(SecondaryStorageManagerImpl.java:1310)
  54. at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:119)
  55. at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:50)
  56. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:106)
  57. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:34)
  58. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:83)
  59. at com.cloud.vm.SystemVmLoadScanner$1.run(SystemVmLoadScanner.java:73)
  60. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  61. at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351)
  62. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178)
  63. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165)
  64. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267)
  65. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
  66. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
  67. at java.lang.Thread.run(Thread.java:679)
  68. Caused by: java.lang.ClassCastException: com.cloud.agent.api.Answer cannot be cast to com.cloud.agent.api.storage.PrimaryStorageDownloadAnswer
  69. at com.cloud.template.TemplateManagerImpl.prepareTemplateForCreate(TemplateManagerImpl.java:663)
  70. at com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34)
  71. at com.cloud.storage.StorageManagerImpl.createVolume(StorageManagerImpl.java:3442)
  72. at com.cloud.storage.StorageManagerImpl.prepare(StorageManagerImpl.java:3351)
  73. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:754)
  74. ... 20 more
  75. 2013-01-29 14:28:19,983 INFO [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Unable to start secondary storage vm for standby capacity, secStorageVm vm Id : 201, will recycle it and start a new one
  76. 2013-01-29 14:28:19,983 INFO [cloud.secstorage.PremiumSecondaryStorageManagerImpl] (secstorage-1:null) Primary secondary storage is not even started, wait until next turn
  77. 2013-01-29 14:28:28,542 DEBUG [cloud.server.StatsCollector] (StatsCollector-2:null) HostStatsCollector is running...
  78. 2013-01-29 14:28:29,172 DEBUG [agent.transport.Request] (StatsCollector-2:null) Seq 1-89030376: Received: { Ans: , MgmtId: 60908668245, via: 1, Ver: v1, Flags: 10, { GetHostStatsAnswer } }
  79. 2013-01-29 14:28:29,784 DEBUG [agent.transport.Request] (StatsCollector-2:null) Seq 4-220941125: Received: { Ans: , MgmtId: 60908668245, via: 4, Ver: v1, Flags: 10, { GetHostStatsAnswer } }
  80. 2013-01-29 14:28:30,339 DEBUG [agent.transport.Request] (StatsCollector-2:null) Seq 7-2090140027: Received: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 10, { GetHostStatsAnswer } }
  81. 2013-01-29 14:28:45,898 DEBUG [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Zone 1 is ready to launch secondary storage VM
  82. 2013-01-29 14:28:45,905 DEBUG [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Zone 3 is ready to launch secondary storage VM
  83. 2013-01-29 14:28:45,907 INFO [cloud.secstorage.PremiumSecondaryStorageManagerImpl] (secstorage-1:null) No running secondary storage vms found in datacenter id=3, starting one
  84. 2013-01-29 14:28:45,912 INFO [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Found a stopped secondary storage vm, bring it up to running pool. secStorageVm vm id : 201
  85. 2013-01-29 14:28:45,916 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
  86. 2013-01-29 14:28:45,916 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Successfully transitioned to start state for VM[SecondaryStorageVm|s-201-VM] reservation id = 046f9a18-d15c-4208-87c9-6e737b463c12
  87. 2013-01-29 14:28:45,987 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Trying to deploy VM, vm has dcId: 3 and podId: 3
  88. 2013-01-29 14:28:45,987 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Deploy avoids pods: null, clusters: null, hosts: null
  89. 2013-01-29 14:28:45,988 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) DeploymentPlanner allocation algorithm: random
  90. 2013-01-29 14:28:45,988 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Trying to allocate a host and storage pools from dc:3, pod:3,cluster:null, requested cpu: 500, requested ram: 268435456
  91. 2013-01-29 14:28:45,988 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Is ROOT volume READY (pool already allocated)?: No
  92. 2013-01-29 14:28:45,988 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Searching resources only under specified Pod: 3
  93. 2013-01-29 14:28:45,989 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Pod: 3
  94. 2013-01-29 14:28:45,989 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) CPUOverprovisioningFactor considered: 1.0
  95. 2013-01-29 14:28:46,000 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Checking resources in Cluster: 3 under Pod: 3
  96. 2013-01-29 14:28:46,000 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Calling HostAllocators to find suitable hosts
  97. 2013-01-29 14:28:46,000 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) Looking for hosts in dc: 3 pod:3 cluster:3
  98. 2013-01-29 14:28:46,001 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) FirstFitAllocator has 1 hosts to check for allocation: [Host[-7-Routing]]
  99. 2013-01-29 14:28:46,002 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) Found 1 hosts for allocation after prioritization: [Host[-7-Routing]]
  100. 2013-01-29 14:28:46,002 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=256
  101. 2013-01-29 14:28:46,003 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) Checking if host: 7 has enough capacity for requested CPU: 500 and requested RAM: 268435456 , cpuOverprovisioningFactor: 1.0
  102. 2013-01-29 14:28:46,004 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) Hosts's actual total CPU: 12004 and CPU after applying overprovisioning: 12004
  103. 2013-01-29 14:28:46,004 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) Free CPU: 12004 , Requested CPU: 500
  104. 2013-01-29 14:28:46,004 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) Free RAM: 8269606912 , Requested RAM: 268435456
  105. 2013-01-29 14:28:46,004 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) Host has enough CPU and RAM available
  106. 2013-01-29 14:28:46,004 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 7, used: 0, reserved: 0, actual total: 12004, total with overprovisioning: 12004; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  107. 2013-01-29 14:28:46,004 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 7, used: 0, reserved: 0, total: 8269606912; requested mem: 268435456,alloc_from_last_host?:false ,considerReservedCapacity?: true
  108. 2013-01-29 14:28:46,004 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) Found a suitable host, adding to list: 7
  109. 2013-01-29 14:28:46,004 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) Host Allocator returning 1 suitable hosts
  110. 2013-01-29 14:28:46,005 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Checking suitable pools for volume (Id, Type): (203,ROOT)
  111. 2013-01-29 14:28:46,005 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) We need to allocate new storagepool for this volume
  112. 2013-01-29 14:28:46,005 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Calling StoragePoolAllocators to find suitable pools
  113. 2013-01-29 14:28:46,006 DEBUG [storage.allocator.FirstFitStoragePoolAllocator] (secstorage-1:null) Looking for pools in dc: 3 pod:3 cluster:3
  114. 2013-01-29 14:28:46,006 DEBUG [storage.allocator.FirstFitStoragePoolAllocator] (secstorage-1:null) FirstFitStoragePoolAllocator has 1 pools to check for allocation
  115. 2013-01-29 14:28:46,006 DEBUG [storage.allocator.AbstractStoragePoolAllocator] (secstorage-1:null) Checking if storage pool is suitable, name: DRDB10 ,poolId: 204
  116. 2013-01-29 14:28:46,006 DEBUG [storage.allocator.AbstractStoragePoolAllocator] (secstorage-1:null) Is localStorageAllocationNeeded? false
  117. 2013-01-29 14:28:46,006 DEBUG [storage.allocator.AbstractStoragePoolAllocator] (secstorage-1:null) Is storage pool shared? true
  118. 2013-01-29 14:28:46,007 DEBUG [cloud.storage.StorageManagerImpl] (secstorage-1:null) Checking pool 204 for storage, totalSize: 1968949690368, usedBytes: 204734464, usedPct: 1.039815618456634E-4, disable threshold: 0.85
  119. 2013-01-29 14:28:46,010 DEBUG [cloud.storage.StorageManagerImpl] (secstorage-1:null) Checking pool: 204 for volume allocation [Vol[203|vm=201|ROOT]], maxSize : 3937899380736, totalAllocatedSize : 0, askingSize : 0, allocated disable threshold: 0.85
  120. 2013-01-29 14:28:46,010 DEBUG [storage.allocator.FirstFitStoragePoolAllocator] (secstorage-1:null) FirstFitStoragePoolAllocator returning 1 suitable storage pools
  121. 2013-01-29 14:28:46,010 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Trying to find a potenial host and associated storage pools from the suitable host/pool lists for this VM
  122. 2013-01-29 14:28:46,010 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Checking if host: 7 can access any suitable storage pool for volume: ROOT
  123. 2013-01-29 14:28:46,011 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Host: 7 can access pool: 204
  124. 2013-01-29 14:28:46,011 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Found a potential host id: 7 name: mc1 and associated storage pools for this VM
  125. 2013-01-29 14:28:46,011 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Returning Deployment Destination: Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(3)-Pod(3)-Cluster(3)-Host(7)-Storage(Volume(203|ROOT-->Pool(204))]
  126. 2013-01-29 14:28:46,011 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Deployment found - P0=VM[SecondaryStorageVm|s-201-VM], P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(3)-Pod(3)-Cluster(3)-Host(7)-Storage(Volume(203|ROOT-->Pool(204))]
  127. 2013-01-29 14:28:46,017 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl] (consoleproxy-1:null) Zone 1 is ready to launch console proxy
  128. 2013-01-29 14:28:46,020 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl] (consoleproxy-1:null) Zone 3 is ready to launch console proxy
  129. 2013-01-29 14:28:46,020 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl] (consoleproxy-1:null) Expand console proxy standby capacity for zone Mira
  130. 2013-01-29 14:28:46,022 INFO [cloud.consoleproxy.ConsoleProxyManagerImpl] (consoleproxy-1:null) Found a stopped console proxy, bring it up to running pool. proxy vm id : 32
  131. 2013-01-29 14:28:46,027 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
  132. 2013-01-29 14:28:46,027 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Successfully transitioned to start state for VM[ConsoleProxy|v-32-VM] reservation id = 9e07b47b-807b-4f84-acea-4f777fd86ea5
  133. 2013-01-29 14:28:46,146 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Trying to deploy VM, vm has dcId: 3 and podId: 3
  134. 2013-01-29 14:28:46,146 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Deploy avoids pods: null, clusters: null, hosts: null
  135. 2013-01-29 14:28:46,148 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) DeploymentPlanner allocation algorithm: random
  136. 2013-01-29 14:28:46,148 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Trying to allocate a host and storage pools from dc:3, pod:3,cluster:null, requested cpu: 500, requested ram: 1073741824
  137. 2013-01-29 14:28:46,148 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Is ROOT volume READY (pool already allocated)?: No
  138. 2013-01-29 14:28:46,148 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Searching resources only under specified Pod: 3
  139. 2013-01-29 14:28:46,148 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Pod: 3
  140. 2013-01-29 14:28:46,148 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) CPUOverprovisioningFactor considered: 1.0
  141. 2013-01-29 14:28:46,152 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Checking resources in Cluster: 3 under Pod: 3
  142. 2013-01-29 14:28:46,152 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Calling HostAllocators to find suitable hosts
  143. 2013-01-29 14:28:46,152 DEBUG [allocator.impl.FirstFitAllocator] (consoleproxy-1:FirstFitRoutingAllocator) Looking for hosts in dc: 3 pod:3 cluster:3
  144. 2013-01-29 14:28:46,152 DEBUG [allocator.impl.FirstFitAllocator] (consoleproxy-1:FirstFitRoutingAllocator) FirstFitAllocator has 1 hosts to check for allocation: [Host[-7-Routing]]
  145. 2013-01-29 14:28:46,153 DEBUG [allocator.impl.FirstFitAllocator] (consoleproxy-1:FirstFitRoutingAllocator) Found 1 hosts for allocation after prioritization: [Host[-7-Routing]]
  146. 2013-01-29 14:28:46,153 DEBUG [allocator.impl.FirstFitAllocator] (consoleproxy-1:FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=1024
  147. 2013-01-29 14:28:46,154 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) Checking if host: 7 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  148. 2013-01-29 14:28:46,155 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) Hosts's actual total CPU: 12004 and CPU after applying overprovisioning: 12004
  149. 2013-01-29 14:28:46,155 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) Free CPU: 12004 , Requested CPU: 500
  150. 2013-01-29 14:28:46,155 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) Free RAM: 8269606912 , Requested RAM: 1073741824
  151. 2013-01-29 14:28:46,155 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) Host has enough CPU and RAM available
  152. 2013-01-29 14:28:46,155 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 7, used: 0, reserved: 0, actual total: 12004, total with overprovisioning: 12004; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  153. 2013-01-29 14:28:46,155 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 7, used: 0, reserved: 0, total: 8269606912; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  154. 2013-01-29 14:28:46,155 DEBUG [allocator.impl.FirstFitAllocator] (consoleproxy-1:FirstFitRoutingAllocator) Found a suitable host, adding to list: 7
  155. 2013-01-29 14:28:46,155 DEBUG [allocator.impl.FirstFitAllocator] (consoleproxy-1:FirstFitRoutingAllocator) Host Allocator returning 1 suitable hosts
  156. 2013-01-29 14:28:46,156 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Checking suitable pools for volume (Id, Type): (34,ROOT)
  157. 2013-01-29 14:28:46,156 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) We need to allocate new storagepool for this volume
  158. 2013-01-29 14:28:46,156 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Calling StoragePoolAllocators to find suitable pools
  159. 2013-01-29 14:28:46,157 DEBUG [storage.allocator.FirstFitStoragePoolAllocator] (consoleproxy-1:null) Looking for pools in dc: 3 pod:3 cluster:3
  160. 2013-01-29 14:28:46,157 DEBUG [storage.allocator.FirstFitStoragePoolAllocator] (consoleproxy-1:null) FirstFitStoragePoolAllocator has 1 pools to check for allocation
  161. 2013-01-29 14:28:46,157 DEBUG [storage.allocator.AbstractStoragePoolAllocator] (consoleproxy-1:null) Checking if storage pool is suitable, name: DRDB10 ,poolId: 204
  162. 2013-01-29 14:28:46,157 DEBUG [storage.allocator.AbstractStoragePoolAllocator] (consoleproxy-1:null) Is localStorageAllocationNeeded? false
  163. 2013-01-29 14:28:46,157 DEBUG [storage.allocator.AbstractStoragePoolAllocator] (consoleproxy-1:null) Is storage pool shared? true
  164. 2013-01-29 14:28:46,158 DEBUG [cloud.storage.StorageManagerImpl] (consoleproxy-1:null) Checking pool 204 for storage, totalSize: 1968949690368, usedBytes: 204734464, usedPct: 1.039815618456634E-4, disable threshold: 0.85
  165. 2013-01-29 14:28:46,160 DEBUG [cloud.storage.StorageManagerImpl] (consoleproxy-1:null) Checking pool: 204 for volume allocation [Vol[34|vm=32|ROOT]], maxSize : 3937899380736, totalAllocatedSize : 0, askingSize : 0, allocated disable threshold: 0.85
  166. 2013-01-29 14:28:46,160 DEBUG [storage.allocator.FirstFitStoragePoolAllocator] (consoleproxy-1:null) FirstFitStoragePoolAllocator returning 1 suitable storage pools
  167. 2013-01-29 14:28:46,160 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Trying to find a potenial host and associated storage pools from the suitable host/pool lists for this VM
  168. 2013-01-29 14:28:46,160 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Checking if host: 7 can access any suitable storage pool for volume: ROOT
  169. 2013-01-29 14:28:46,160 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Host: 7 can access pool: 204
  170. 2013-01-29 14:28:46,160 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Found a potential host id: 7 name: mc1 and associated storage pools for this VM
  171. 2013-01-29 14:28:46,161 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Returning Deployment Destination: Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(3)-Pod(3)-Cluster(3)-Host(7)-Storage(Volume(34|ROOT-->Pool(204))]
  172. 2013-01-29 14:28:46,161 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Deployment found - P0=VM[ConsoleProxy|v-32-VM], P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(3)-Pod(3)-Cluster(3)-Host(7)-Storage(Volume(34|ROOT-->Pool(204))]
  173. 2013-01-29 14:28:46,197 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) VM state transitted from :Starting to Starting with event: OperationRetryvm's original host id: null new host id: 7 host id before state transition: null
  174. 2013-01-29 14:28:46,200 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) Hosts's actual total CPU: 12004 and CPU after applying overprovisioning: 12004
  175. 2013-01-29 14:28:46,200 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) We are allocating VM, increasing the used capacity of this host:7
  176. 2013-01-29 14:28:46,200 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) Current Used CPU: 0 , Free CPU:12004 ,Requested CPU: 500
  177. 2013-01-29 14:28:46,200 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) Current Used RAM: 0 , Free RAM:8269606912 ,Requested RAM: 268435456
  178. 2013-01-29 14:28:46,200 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) CPU STATS after allocation: for host: 7, old used: 0, old reserved: 0, actual total: 12004, total with overprovisioning: 12004; new used:500, reserved:0; requested cpu:500,alloc_from_last:false
  179. 2013-01-29 14:28:46,200 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) RAM STATS after allocation: for host: 7, old used: 0, old reserved: 0, total: 8269606912; new used: 268435456, reserved: 0; requested mem: 268435456,alloc_from_last:false
  180. 2013-01-29 14:28:46,289 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) VM is being created in podId: 3
  181. 2013-01-29 14:28:46,290 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is acquired for network id 222 as a part of network implement
  182. 2013-01-29 14:28:46,290 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Network id=222 is already implemented
  183. 2013-01-29 14:28:46,291 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is released for network id 222 as a part of network implement
  184. 2013-01-29 14:28:46,339 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) VM state transitted from :Starting to Starting with event: OperationRetryvm's original host id: null new host id: 7 host id before state transition: null
  185. 2013-01-29 14:28:46,343 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) Hosts's actual total CPU: 12004 and CPU after applying overprovisioning: 12004
  186. 2013-01-29 14:28:46,343 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) We are allocating VM, increasing the used capacity of this host:7
  187. 2013-01-29 14:28:46,343 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) Current Used CPU: 500 , Free CPU:11504 ,Requested CPU: 500
  188. 2013-01-29 14:28:46,343 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) Current Used RAM: 268435456 , Free RAM:8001171456 ,Requested RAM: 1073741824
  189. 2013-01-29 14:28:46,343 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) CPU STATS after allocation: for host: 7, old used: 500, old reserved: 0, actual total: 12004, total with overprovisioning: 12004; new used:1000, reserved:0; requested cpu:500,alloc_from_last:false
  190. 2013-01-29 14:28:46,343 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) RAM STATS after allocation: for host: 7, old used: 268435456, old reserved: 0, total: 8269606912; new used: 1342177280, reserved: 0; requested mem: 1073741824,alloc_from_last:false
  191. 2013-01-29 14:28:46,389 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Service SecurityGroup is not supported in the network id=222
  192. 2013-01-29 14:28:46,428 DEBUG [network.router.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:null) Found 5 routers.
  193. 2013-01-29 14:28:46,431 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) VM is being created in podId: 3
  194. 2013-01-29 14:28:46,433 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Lock is acquired for network id 222 as a part of network implement
  195. 2013-01-29 14:28:46,433 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Network id=222 is already implemented
  196. 2013-01-29 14:28:46,433 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Lock is released for network id 222 as a part of network implement
  197. 2013-01-29 14:28:46,473 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to prepare for Nic[734-201-046f9a18-d15c-4208-87c9-6e737b463c12-212.70.6.205]
  198. 2013-01-29 14:28:46,473 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to prepare for Nic[734-201-046f9a18-d15c-4208-87c9-6e737b463c12-212.70.6.205]
  199. 2013-01-29 14:28:46,473 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to prepare for Nic[734-201-046f9a18-d15c-4208-87c9-6e737b463c12-212.70.6.205]
  200. 2013-01-29 14:28:46,474 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to prepare for Nic[734-201-046f9a18-d15c-4208-87c9-6e737b463c12-212.70.6.205]
  201. 2013-01-29 14:28:46,474 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to prepare for Nic[734-201-046f9a18-d15c-4208-87c9-6e737b463c12-212.70.6.205]
  202. 2013-01-29 14:28:46,474 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to prepare for Nic[734-201-046f9a18-d15c-4208-87c9-6e737b463c12-212.70.6.205]
  203. 2013-01-29 14:28:46,474 WARN [network.element.VpcVirtualRouterElement] (secstorage-1:null) Network Ntwk[222|Guest|7] is not associated with any VPC
  204. 2013-01-29 14:28:46,474 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to prepare for Nic[734-201-046f9a18-d15c-4208-87c9-6e737b463c12-212.70.6.205]
  205. 2013-01-29 14:28:46,474 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Service SecurityGroup is not supported in the network id=222
  206. 2013-01-29 14:28:46,475 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is acquired for network id 220 as a part of network implement
  207. 2013-01-29 14:28:46,475 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Network id=220 is already implemented
  208. 2013-01-29 14:28:46,475 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is released for network id 220 as a part of network implement
  209. 2013-01-29 14:28:46,515 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Service SecurityGroup is not supported in the network id=222
  210. 2013-01-29 14:28:46,631 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VirtualRouter to prepare for Nic[59-32-9e07b47b-807b-4f84-acea-4f777fd86ea5-212.70.6.202]
  211. 2013-01-29 14:28:46,631 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking Ovs to prepare for Nic[59-32-9e07b47b-807b-4f84-acea-4f777fd86ea5-212.70.6.202]
  212. 2013-01-29 14:28:46,631 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking ExternalDhcpServer to prepare for Nic[59-32-9e07b47b-807b-4f84-acea-4f777fd86ea5-212.70.6.202]
  213. 2013-01-29 14:28:46,631 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking BareMetal to prepare for Nic[59-32-9e07b47b-807b-4f84-acea-4f777fd86ea5-212.70.6.202]
  214. 2013-01-29 14:28:46,631 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking SecurityGroupProvider to prepare for Nic[59-32-9e07b47b-807b-4f84-acea-4f777fd86ea5-212.70.6.202]
  215. 2013-01-29 14:28:46,631 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VpcVirtualRouter to prepare for Nic[59-32-9e07b47b-807b-4f84-acea-4f777fd86ea5-212.70.6.202]
  216. 2013-01-29 14:28:46,631 WARN [network.element.VpcVirtualRouterElement] (consoleproxy-1:null) Network Ntwk[222|Guest|7] is not associated with any VPC
  217. 2013-01-29 14:28:46,631 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking NiciraNvp to prepare for Nic[59-32-9e07b47b-807b-4f84-acea-4f777fd86ea5-212.70.6.202]
  218. 2013-01-29 14:28:46,632 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Service SecurityGroup is not supported in the network id=222
  219. 2013-01-29 14:28:46,633 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Lock is acquired for network id 220 as a part of network implement
  220. 2013-01-29 14:28:46,633 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Network id=220 is already implemented
  221. 2013-01-29 14:28:46,633 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Lock is released for network id 220 as a part of network implement
  222. 2013-01-29 14:28:46,782 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to prepare for Nic[735-201-046f9a18-d15c-4208-87c9-6e737b463c12-169.254.0.222]
  223. 2013-01-29 14:28:46,782 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to prepare for Nic[735-201-046f9a18-d15c-4208-87c9-6e737b463c12-169.254.0.222]
  224. 2013-01-29 14:28:46,782 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to prepare for Nic[735-201-046f9a18-d15c-4208-87c9-6e737b463c12-169.254.0.222]
  225. 2013-01-29 14:28:46,782 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to prepare for Nic[735-201-046f9a18-d15c-4208-87c9-6e737b463c12-169.254.0.222]
  226. 2013-01-29 14:28:46,782 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to prepare for Nic[735-201-046f9a18-d15c-4208-87c9-6e737b463c12-169.254.0.222]
  227. 2013-01-29 14:28:46,782 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to prepare for Nic[735-201-046f9a18-d15c-4208-87c9-6e737b463c12-169.254.0.222]
  228. 2013-01-29 14:28:46,782 WARN [network.element.VpcVirtualRouterElement] (secstorage-1:null) Network Ntwk[220|Control|3] is not associated with any VPC
  229. 2013-01-29 14:28:46,782 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to prepare for Nic[735-201-046f9a18-d15c-4208-87c9-6e737b463c12-169.254.0.222]
  230. 2013-01-29 14:28:46,783 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is acquired for network id 219 as a part of network implement
  231. 2013-01-29 14:28:46,783 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Network id=219 is already implemented
  232. 2013-01-29 14:28:46,784 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is released for network id 219 as a part of network implement
  233. 2013-01-29 14:28:46,933 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VirtualRouter to prepare for Nic[60-32-9e07b47b-807b-4f84-acea-4f777fd86ea5-169.254.3.109]
  234. 2013-01-29 14:28:46,933 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking Ovs to prepare for Nic[60-32-9e07b47b-807b-4f84-acea-4f777fd86ea5-169.254.3.109]
  235. 2013-01-29 14:28:46,933 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking ExternalDhcpServer to prepare for Nic[60-32-9e07b47b-807b-4f84-acea-4f777fd86ea5-169.254.3.109]
  236. 2013-01-29 14:28:46,933 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking BareMetal to prepare for Nic[60-32-9e07b47b-807b-4f84-acea-4f777fd86ea5-169.254.3.109]
  237. 2013-01-29 14:28:46,933 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking SecurityGroupProvider to prepare for Nic[60-32-9e07b47b-807b-4f84-acea-4f777fd86ea5-169.254.3.109]
  238. 2013-01-29 14:28:46,933 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VpcVirtualRouter to prepare for Nic[60-32-9e07b47b-807b-4f84-acea-4f777fd86ea5-169.254.3.109]
  239. 2013-01-29 14:28:46,933 WARN [network.element.VpcVirtualRouterElement] (consoleproxy-1:null) Network Ntwk[220|Control|3] is not associated with any VPC
  240. 2013-01-29 14:28:46,933 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking NiciraNvp to prepare for Nic[60-32-9e07b47b-807b-4f84-acea-4f777fd86ea5-169.254.3.109]
  241. 2013-01-29 14:28:46,934 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Lock is acquired for network id 219 as a part of network implement
  242. 2013-01-29 14:28:46,934 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Network id=219 is already implemented
  243. 2013-01-29 14:28:46,934 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Lock is released for network id 219 as a part of network implement
  244. 2013-01-29 14:28:46,983 DEBUG [network.guru.PodBasedNetworkGuru] (secstorage-1:null) Allocated a nic NicProfile[736-201-046f9a18-d15c-4208-87c9-6e737b463c12-212.70.6.79-null for VM[SecondaryStorageVm|s-201-VM]
  245. 2013-01-29 14:28:47,100 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to prepare for Nic[736-201-046f9a18-d15c-4208-87c9-6e737b463c12-212.70.6.79]
  246. 2013-01-29 14:28:47,100 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to prepare for Nic[736-201-046f9a18-d15c-4208-87c9-6e737b463c12-212.70.6.79]
  247. 2013-01-29 14:28:47,100 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to prepare for Nic[736-201-046f9a18-d15c-4208-87c9-6e737b463c12-212.70.6.79]
  248. 2013-01-29 14:28:47,100 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to prepare for Nic[736-201-046f9a18-d15c-4208-87c9-6e737b463c12-212.70.6.79]
  249. 2013-01-29 14:28:47,100 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to prepare for Nic[736-201-046f9a18-d15c-4208-87c9-6e737b463c12-212.70.6.79]
  250. 2013-01-29 14:28:47,100 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to prepare for Nic[736-201-046f9a18-d15c-4208-87c9-6e737b463c12-212.70.6.79]
  251. 2013-01-29 14:28:47,100 WARN [network.element.VpcVirtualRouterElement] (secstorage-1:null) Network Ntwk[219|Management|2] is not associated with any VPC
  252. 2013-01-29 14:28:47,100 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to prepare for Nic[736-201-046f9a18-d15c-4208-87c9-6e737b463c12-212.70.6.79]
  253. 2013-01-29 14:28:47,101 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is acquired for network id 221 as a part of network implement
  254. 2013-01-29 14:28:47,101 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Network id=221 is already implemented
  255. 2013-01-29 14:28:47,102 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is released for network id 221 as a part of network implement
  256. 2013-01-29 14:28:47,158 DEBUG [network.guru.PodBasedNetworkGuru] (consoleproxy-1:null) Allocated a nic NicProfile[61-32-9e07b47b-807b-4f84-acea-4f777fd86ea5-212.70.6.83-null for VM[ConsoleProxy|v-32-VM]
  257. 2013-01-29 14:28:47,275 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VirtualRouter to prepare for Nic[61-32-9e07b47b-807b-4f84-acea-4f777fd86ea5-212.70.6.83]
  258. 2013-01-29 14:28:47,275 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking Ovs to prepare for Nic[61-32-9e07b47b-807b-4f84-acea-4f777fd86ea5-212.70.6.83]
  259. 2013-01-29 14:28:47,275 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking ExternalDhcpServer to prepare for Nic[61-32-9e07b47b-807b-4f84-acea-4f777fd86ea5-212.70.6.83]
  260. 2013-01-29 14:28:47,275 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking BareMetal to prepare for Nic[61-32-9e07b47b-807b-4f84-acea-4f777fd86ea5-212.70.6.83]
  261. 2013-01-29 14:28:47,275 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking SecurityGroupProvider to prepare for Nic[61-32-9e07b47b-807b-4f84-acea-4f777fd86ea5-212.70.6.83]
  262. 2013-01-29 14:28:47,276 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VpcVirtualRouter to prepare for Nic[61-32-9e07b47b-807b-4f84-acea-4f777fd86ea5-212.70.6.83]
  263. 2013-01-29 14:28:47,276 WARN [network.element.VpcVirtualRouterElement] (consoleproxy-1:null) Network Ntwk[219|Management|2] is not associated with any VPC
  264. 2013-01-29 14:28:47,276 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking NiciraNvp to prepare for Nic[61-32-9e07b47b-807b-4f84-acea-4f777fd86ea5-212.70.6.83]
  265. 2013-01-29 14:28:47,276 DEBUG [cloud.storage.StorageManagerImpl] (consoleproxy-1:null) Checking if we need to prepare 1 volumes for VM[ConsoleProxy|v-32-VM]
  266. 2013-01-29 14:28:47,326 DEBUG [network.guru.PodBasedNetworkGuru] (secstorage-1:null) Allocated a nic NicProfile[737-201-046f9a18-d15c-4208-87c9-6e737b463c12-212.70.6.67-null for VM[SecondaryStorageVm|s-201-VM]
  267. 2013-01-29 14:28:47,377 DEBUG [cloud.storage.StorageManagerImpl] (consoleproxy-1:null) Creating volume: Vol[34|vm=32|ROOT]
  268. 2013-01-29 14:28:47,378 DEBUG [cloud.storage.StorageManagerImpl] (consoleproxy-1:null) Trying to create in Pool[204|NetworkFilesystem]
  269. 2013-01-29 14:28:47,425 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to prepare for Nic[737-201-046f9a18-d15c-4208-87c9-6e737b463c12-212.70.6.67]
  270. 2013-01-29 14:28:47,425 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to prepare for Nic[737-201-046f9a18-d15c-4208-87c9-6e737b463c12-212.70.6.67]
  271. 2013-01-29 14:28:47,425 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to prepare for Nic[737-201-046f9a18-d15c-4208-87c9-6e737b463c12-212.70.6.67]
  272. 2013-01-29 14:28:47,426 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to prepare for Nic[737-201-046f9a18-d15c-4208-87c9-6e737b463c12-212.70.6.67]
  273. 2013-01-29 14:28:47,426 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to prepare for Nic[737-201-046f9a18-d15c-4208-87c9-6e737b463c12-212.70.6.67]
  274. 2013-01-29 14:28:47,426 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to prepare for Nic[737-201-046f9a18-d15c-4208-87c9-6e737b463c12-212.70.6.67]
  275. 2013-01-29 14:28:47,426 WARN [network.element.VpcVirtualRouterElement] (secstorage-1:null) Network Ntwk[221|Storage|4] is not associated with any VPC
  276. 2013-01-29 14:28:47,426 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to prepare for Nic[737-201-046f9a18-d15c-4208-87c9-6e737b463c12-212.70.6.67]
  277. 2013-01-29 14:28:47,427 DEBUG [cloud.storage.StorageManagerImpl] (secstorage-1:null) Checking if we need to prepare 1 volumes for VM[SecondaryStorageVm|s-201-VM]
  278. 2013-01-29 14:28:47,520 DEBUG [cloud.storage.StorageManagerImpl] (secstorage-1:null) Creating volume: Vol[203|vm=201|ROOT]
  279. 2013-01-29 14:28:47,520 DEBUG [cloud.storage.StorageManagerImpl] (secstorage-1:null) Trying to create in Pool[204|NetworkFilesystem]
  280. 2013-01-29 14:28:47,563 DEBUG [cloud.template.TemplateManagerImpl] (consoleproxy-1:null) Downloading 3 via 7
  281. 2013-01-29 14:28:47,565 DEBUG [agent.transport.Request] (consoleproxy-1:null) Seq 7-2090140028: Sending { Cmd , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 100111, [{"storage.PrimaryStorageDownloadCommand":{"localPath":"/mnt/99898908-d913-39c8-b61d-c7e6b6dbd8f0","poolUuid":"99898908-d913-39c8-b61d-c7e6b6dbd8f0","poolId":204,"secondaryStorageUrl":"nfs://cloudmanager.mira.dk/export/mirazone","primaryStorageUrl":"nfs://10.212.212.249/export/drbd10","url":"nfs://cloudmanager.mira.dk/export/mirazone/template/tmpl/1/3/","format":"QCOW2","accountId":1,"name":"routing-3","wait":10800}}] }
  282. 2013-01-29 14:28:47,713 DEBUG [agent.transport.Request] (AgentManager-Handler-4:null) Seq 7-2090140028: Processing: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, [{"Answer":{"result":false,"details":"java.lang.NullPointerException\n\tat com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.createStoragePool(LibvirtStorageAdaptor.java:462)\n\tat com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.getStoragePoolByURI(LibvirtStorageAdaptor.java:745)\n\tat com.cloud.hypervisor.kvm.storage.KVMStoragePoolManager.getStoragePoolByURI(KVMStoragePoolManager.java:52)\n\tat com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:2017)\n\tat com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1009)\n\tat com.cloud.agent.Agent.processRequest(Agent.java:518)\n\tat com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:831)\n\tat com.cloud.utils.nio.Task.run(Task.java:83)\n\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)\n\tat java.lang.Thread.run(Thread.java:679)\n","wait":0}}] }
  283. 2013-01-29 14:28:47,713 DEBUG [agent.manager.AgentAttache] (AgentManager-Handler-4:null) Seq 7-2090140028: No more commands found
  284. 2013-01-29 14:28:47,713 DEBUG [agent.transport.Request] (consoleproxy-1:null) Seq 7-2090140028: Received: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, { Answer } }
  285. 2013-01-29 14:28:47,713 DEBUG [agent.manager.AgentManagerImpl] (consoleproxy-1:null) Details from executing class com.cloud.agent.api.storage.PrimaryStorageDownloadCommand: java.lang.NullPointerException
  286. at com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.createStoragePool(LibvirtStorageAdaptor.java:462)
  287. at com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.getStoragePoolByURI(LibvirtStorageAdaptor.java:745)
  288. at com.cloud.hypervisor.kvm.storage.KVMStoragePoolManager.getStoragePoolByURI(KVMStoragePoolManager.java:52)
  289. at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:2017)
  290. at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1009)
  291. at com.cloud.agent.Agent.processRequest(Agent.java:518)
  292. at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:831)
  293. at com.cloud.utils.nio.Task.run(Task.java:83)
  294. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
  295. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
  296. at java.lang.Thread.run(Thread.java:679)
  297.  
  298. 2013-01-29 14:28:47,714 ERROR [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Failed to start instance VM[ConsoleProxy|v-32-VM]
  299. java.lang.ClassCastException: com.cloud.agent.api.Answer cannot be cast to com.cloud.agent.api.storage.PrimaryStorageDownloadAnswer
  300. at com.cloud.template.TemplateManagerImpl.prepareTemplateForCreate(TemplateManagerImpl.java:663)
  301. at com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34)
  302. at com.cloud.storage.StorageManagerImpl.createVolume(StorageManagerImpl.java:3442)
  303. at com.cloud.storage.StorageManagerImpl.prepare(StorageManagerImpl.java:3351)
  304. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:754)
  305. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:472)
  306. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:465)
  307. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.startProxy(ConsoleProxyManagerImpl.java:627)
  308. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.allocCapacity(ConsoleProxyManagerImpl.java:1164)
  309. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:1981)
  310. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:173)
  311. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:113)
  312. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:34)
  313. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:83)
  314. at com.cloud.vm.SystemVmLoadScanner$1.run(SystemVmLoadScanner.java:73)
  315. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  316. at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351)
  317. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178)
  318. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165)
  319. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267)
  320. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
  321. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
  322. at java.lang.Thread.run(Thread.java:679)
  323. 2013-01-29 14:28:47,922 DEBUG [cloud.template.TemplateManagerImpl] (secstorage-1:null) Downloading 3 via 7
  324. 2013-01-29 14:28:47,923 DEBUG [agent.transport.Request] (secstorage-1:null) Seq 7-2090140029: Sending { Cmd , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 100111, [{"storage.PrimaryStorageDownloadCommand":{"localPath":"/mnt/99898908-d913-39c8-b61d-c7e6b6dbd8f0","poolUuid":"99898908-d913-39c8-b61d-c7e6b6dbd8f0","poolId":204,"secondaryStorageUrl":"nfs://cloudmanager.mira.dk/export/mirazone","primaryStorageUrl":"nfs://10.212.212.249/export/drbd10","url":"nfs://cloudmanager.mira.dk/export/mirazone/template/tmpl/1/3/","format":"QCOW2","accountId":1,"name":"routing-3","wait":10800}}] }
  325. 2013-01-29 14:28:47,979 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Cleaning up resources for the vm VM[ConsoleProxy|v-32-VM] in Starting state
  326. 2013-01-29 14:28:47,980 DEBUG [agent.transport.Request] (consoleproxy-1:null) Seq 7-2090140030: Waiting for Seq 2090140029 Scheduling: { Cmd , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 100111, [{"StopCommand":{"isProxy":false,"vmName":"v-32-VM","wait":0}}] }
  327. 2013-01-29 14:28:49,273 DEBUG [agent.transport.Request] (AgentManager-Handler-11:null) Seq 7-2090140029: Processing: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, [{"Answer":{"result":false,"details":"java.lang.NullPointerException\n\tat com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.createStoragePool(LibvirtStorageAdaptor.java:462)\n\tat com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.getStoragePoolByURI(LibvirtStorageAdaptor.java:745)\n\tat com.cloud.hypervisor.kvm.storage.KVMStoragePoolManager.getStoragePoolByURI(KVMStoragePoolManager.java:52)\n\tat com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:2017)\n\tat com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1009)\n\tat com.cloud.agent.Agent.processRequest(Agent.java:518)\n\tat com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:831)\n\tat com.cloud.utils.nio.Task.run(Task.java:83)\n\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)\n\tat java.lang.Thread.run(Thread.java:679)\n","wait":0}}] }
  328. 2013-01-29 14:28:49,273 DEBUG [agent.manager.AgentAttache] (AgentManager-Handler-11:null) Seq 7-2090140030: Sending now. is current sequence.
  329. 2013-01-29 14:28:49,273 DEBUG [agent.transport.Request] (secstorage-1:null) Seq 7-2090140029: Received: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, { Answer } }
  330. 2013-01-29 14:28:49,273 DEBUG [agent.manager.AgentManagerImpl] (secstorage-1:null) Details from executing class com.cloud.agent.api.storage.PrimaryStorageDownloadCommand: java.lang.NullPointerException
  331. at com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.createStoragePool(LibvirtStorageAdaptor.java:462)
  332. at com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.getStoragePoolByURI(LibvirtStorageAdaptor.java:745)
  333. at com.cloud.hypervisor.kvm.storage.KVMStoragePoolManager.getStoragePoolByURI(KVMStoragePoolManager.java:52)
  334. at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:2017)
  335. at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1009)
  336. at com.cloud.agent.Agent.processRequest(Agent.java:518)
  337. at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:831)
  338. at com.cloud.utils.nio.Task.run(Task.java:83)
  339. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
  340. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
  341. at java.lang.Thread.run(Thread.java:679)
  342.  
  343. 2013-01-29 14:28:49,273 ERROR [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Failed to start instance VM[SecondaryStorageVm|s-201-VM]
  344. java.lang.ClassCastException: com.cloud.agent.api.Answer cannot be cast to com.cloud.agent.api.storage.PrimaryStorageDownloadAnswer
  345. at com.cloud.template.TemplateManagerImpl.prepareTemplateForCreate(TemplateManagerImpl.java:663)
  346. at com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34)
  347. at com.cloud.storage.StorageManagerImpl.createVolume(StorageManagerImpl.java:3442)
  348. at com.cloud.storage.StorageManagerImpl.prepare(StorageManagerImpl.java:3351)
  349. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:754)
  350. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:472)
  351. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:465)
  352. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.startSecStorageVm(SecondaryStorageManagerImpl.java:257)
  353. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.allocCapacity(SecondaryStorageManagerImpl.java:684)
  354. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.expandPool(SecondaryStorageManagerImpl.java:1310)
  355. at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:119)
  356. at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:50)
  357. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:106)
  358. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:34)
  359. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:83)
  360. at com.cloud.vm.SystemVmLoadScanner$1.run(SystemVmLoadScanner.java:73)
  361. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  362. at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351)
  363. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178)
  364. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165)
  365. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267)
  366. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
  367. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
  368. at java.lang.Thread.run(Thread.java:679)
  369. 2013-01-29 14:28:49,388 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Cleaning up resources for the vm VM[SecondaryStorageVm|s-201-VM] in Starting state
  370. 2013-01-29 14:28:49,388 DEBUG [agent.transport.Request] (secstorage-1:null) Seq 7-2090140031: Waiting for Seq 2090140030 Scheduling: { Cmd , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 100111, [{"StopCommand":{"isProxy":false,"vmName":"s-201-VM","wait":0}}] }
  371. 2013-01-29 14:28:49,416 DEBUG [agent.transport.Request] (AgentManager-Handler-15:null) Seq 7-2090140030: Processing: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, [{"StopAnswer":{"vncPort":0,"result":true,"wait":0}}] }
  372. 2013-01-29 14:28:49,416 DEBUG [agent.manager.AgentAttache] (AgentManager-Handler-15:null) Seq 7-2090140031: Sending now. is current sequence.
  373. 2013-01-29 14:28:49,416 DEBUG [agent.transport.Request] (consoleproxy-1:null) Seq 7-2090140030: Received: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, { StopAnswer } }
  374. 2013-01-29 14:28:49,463 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Service SecurityGroup is not supported in the network id=222
  375. 2013-01-29 14:28:49,513 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VirtualRouter to release Nic[59-32-9e07b47b-807b-4f84-acea-4f777fd86ea5-212.70.6.202]
  376. 2013-01-29 14:28:49,513 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking Ovs to release Nic[59-32-9e07b47b-807b-4f84-acea-4f777fd86ea5-212.70.6.202]
  377. 2013-01-29 14:28:49,513 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking ExternalDhcpServer to release Nic[59-32-9e07b47b-807b-4f84-acea-4f777fd86ea5-212.70.6.202]
  378. 2013-01-29 14:28:49,513 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking BareMetal to release Nic[59-32-9e07b47b-807b-4f84-acea-4f777fd86ea5-212.70.6.202]
  379. 2013-01-29 14:28:49,513 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking SecurityGroupProvider to release Nic[59-32-9e07b47b-807b-4f84-acea-4f777fd86ea5-212.70.6.202]
  380. 2013-01-29 14:28:49,513 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VpcVirtualRouter to release Nic[59-32-9e07b47b-807b-4f84-acea-4f777fd86ea5-212.70.6.202]
  381. 2013-01-29 14:28:49,513 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking NiciraNvp to release Nic[59-32-9e07b47b-807b-4f84-acea-4f777fd86ea5-212.70.6.202]
  382. 2013-01-29 14:28:49,556 DEBUG [agent.transport.Request] (AgentManager-Handler-7:null) Seq 7-2090140031: Processing: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, [{"StopAnswer":{"vncPort":0,"result":true,"wait":0}}] }
  383. 2013-01-29 14:28:49,556 DEBUG [agent.manager.AgentAttache] (AgentManager-Handler-7:null) Seq 7-2090140031: No more commands found
  384. 2013-01-29 14:28:49,556 DEBUG [agent.transport.Request] (secstorage-1:null) Seq 7-2090140031: Received: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, { StopAnswer } }
  385. 2013-01-29 14:28:49,622 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Service SecurityGroup is not supported in the network id=222
  386. 2013-01-29 14:28:49,672 DEBUG [network.guru.ControlNetworkGuru] (consoleproxy-1:null) Released nic: NicProfile[60-32-null-null-null
  387. 2013-01-29 14:28:49,714 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to release Nic[734-201-046f9a18-d15c-4208-87c9-6e737b463c12-212.70.6.205]
  388. 2013-01-29 14:28:49,714 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to release Nic[734-201-046f9a18-d15c-4208-87c9-6e737b463c12-212.70.6.205]
  389. 2013-01-29 14:28:49,714 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to release Nic[734-201-046f9a18-d15c-4208-87c9-6e737b463c12-212.70.6.205]
  390. 2013-01-29 14:28:49,714 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to release Nic[734-201-046f9a18-d15c-4208-87c9-6e737b463c12-212.70.6.205]
  391. 2013-01-29 14:28:49,714 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to release Nic[734-201-046f9a18-d15c-4208-87c9-6e737b463c12-212.70.6.205]
  392. 2013-01-29 14:28:49,714 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to release Nic[734-201-046f9a18-d15c-4208-87c9-6e737b463c12-212.70.6.205]
  393. 2013-01-29 14:28:49,714 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to release Nic[734-201-046f9a18-d15c-4208-87c9-6e737b463c12-212.70.6.205]
  394. 2013-01-29 14:28:49,764 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VirtualRouter to release Nic[60-32-9e07b47b-807b-4f84-acea-4f777fd86ea5-null]
  395. 2013-01-29 14:28:49,764 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking Ovs to release Nic[60-32-9e07b47b-807b-4f84-acea-4f777fd86ea5-null]
  396. 2013-01-29 14:28:49,764 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking ExternalDhcpServer to release Nic[60-32-9e07b47b-807b-4f84-acea-4f777fd86ea5-null]
  397. 2013-01-29 14:28:49,764 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking BareMetal to release Nic[60-32-9e07b47b-807b-4f84-acea-4f777fd86ea5-null]
  398. 2013-01-29 14:28:49,764 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking SecurityGroupProvider to release Nic[60-32-9e07b47b-807b-4f84-acea-4f777fd86ea5-null]
  399. 2013-01-29 14:28:49,764 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VpcVirtualRouter to release Nic[60-32-9e07b47b-807b-4f84-acea-4f777fd86ea5-null]
  400. 2013-01-29 14:28:49,764 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking NiciraNvp to release Nic[60-32-9e07b47b-807b-4f84-acea-4f777fd86ea5-null]
  401. 2013-01-29 14:28:49,915 DEBUG [dc.dao.DataCenterIpAddressDaoImpl] (consoleproxy-1:null) Releasing ip address for reservationId=9e07b47b-807b-4f84-acea-4f777fd86ea5, instance=61
  402. 2013-01-29 14:28:49,973 DEBUG [network.guru.ControlNetworkGuru] (secstorage-1:null) Released nic: NicProfile[735-201-null-null-null
  403. 2013-01-29 14:28:50,015 DEBUG [network.guru.PodBasedNetworkGuru] (consoleproxy-1:null) Released nic: NicProfile[61-32-null-null-null
  404. 2013-01-29 14:28:50,057 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to release Nic[735-201-046f9a18-d15c-4208-87c9-6e737b463c12-null]
  405. 2013-01-29 14:28:50,058 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to release Nic[735-201-046f9a18-d15c-4208-87c9-6e737b463c12-null]
  406. 2013-01-29 14:28:50,058 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to release Nic[735-201-046f9a18-d15c-4208-87c9-6e737b463c12-null]
  407. 2013-01-29 14:28:50,058 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to release Nic[735-201-046f9a18-d15c-4208-87c9-6e737b463c12-null]
  408. 2013-01-29 14:28:50,058 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to release Nic[735-201-046f9a18-d15c-4208-87c9-6e737b463c12-null]
  409. 2013-01-29 14:28:50,058 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to release Nic[735-201-046f9a18-d15c-4208-87c9-6e737b463c12-null]
  410. 2013-01-29 14:28:50,058 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to release Nic[735-201-046f9a18-d15c-4208-87c9-6e737b463c12-null]
  411. 2013-01-29 14:28:50,107 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VirtualRouter to release Nic[61-32-9e07b47b-807b-4f84-acea-4f777fd86ea5-null]
  412. 2013-01-29 14:28:50,107 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking Ovs to release Nic[61-32-9e07b47b-807b-4f84-acea-4f777fd86ea5-null]
  413. 2013-01-29 14:28:50,107 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking ExternalDhcpServer to release Nic[61-32-9e07b47b-807b-4f84-acea-4f777fd86ea5-null]
  414. 2013-01-29 14:28:50,107 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking BareMetal to release Nic[61-32-9e07b47b-807b-4f84-acea-4f777fd86ea5-null]
  415. 2013-01-29 14:28:50,107 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking SecurityGroupProvider to release Nic[61-32-9e07b47b-807b-4f84-acea-4f777fd86ea5-null]
  416. 2013-01-29 14:28:50,107 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VpcVirtualRouter to release Nic[61-32-9e07b47b-807b-4f84-acea-4f777fd86ea5-null]
  417. 2013-01-29 14:28:50,107 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking NiciraNvp to release Nic[61-32-9e07b47b-807b-4f84-acea-4f777fd86ea5-null]
  418. 2013-01-29 14:28:50,107 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Successfully released network resources for the vm VM[ConsoleProxy|v-32-VM]
  419. 2013-01-29 14:28:50,107 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Successfully cleanued up resources for the vm VM[ConsoleProxy|v-32-VM] in Starting state
  420. 2013-01-29 14:28:50,150 DEBUG [dc.dao.DataCenterIpAddressDaoImpl] (secstorage-1:null) Releasing ip address for reservationId=046f9a18-d15c-4208-87c9-6e737b463c12, instance=736
  421. 2013-01-29 14:28:50,241 DEBUG [network.guru.PodBasedNetworkGuru] (secstorage-1:null) Released nic: NicProfile[736-201-null-null-null
  422. 2013-01-29 14:28:50,291 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: 7
  423. 2013-01-29 14:28:50,294 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) Hosts's actual total CPU: 12004 and CPU after applying overprovisioning: 12004
  424. 2013-01-29 14:28:50,294 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) release cpu from host: 7, old used: 1000,reserved: 0, actual total: 12004, total with overprovisioning: 12004; new used: 500,reserved:0; movedfromreserved: false,moveToReserveredfalse
  425. 2013-01-29 14:28:50,294 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) release mem from host: 7, old used: 1342177280,reserved: 0, total: 8269606912; new used: 268435456,reserved:0; movedfromreserved: false,moveToReserveredfalse
  426. 2013-01-29 14:28:50,383 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to release Nic[736-201-046f9a18-d15c-4208-87c9-6e737b463c12-null]
  427. 2013-01-29 14:28:50,383 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to release Nic[736-201-046f9a18-d15c-4208-87c9-6e737b463c12-null]
  428. 2013-01-29 14:28:50,383 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to release Nic[736-201-046f9a18-d15c-4208-87c9-6e737b463c12-null]
  429. 2013-01-29 14:28:50,383 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to release Nic[736-201-046f9a18-d15c-4208-87c9-6e737b463c12-null]
  430. 2013-01-29 14:28:50,383 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to release Nic[736-201-046f9a18-d15c-4208-87c9-6e737b463c12-null]
  431. 2013-01-29 14:28:50,383 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to release Nic[736-201-046f9a18-d15c-4208-87c9-6e737b463c12-null]
  432. 2013-01-29 14:28:50,383 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to release Nic[736-201-046f9a18-d15c-4208-87c9-6e737b463c12-null]
  433. 2013-01-29 14:28:50,491 WARN [cloud.consoleproxy.ConsoleProxyManagerImpl] (consoleproxy-1:null) Exception while trying to start console proxy
  434. com.cloud.exception.AgentUnavailableException: Resource [Host:7] is unreachable: Host 7: Unable to start instance due to com.cloud.agent.api.Answer cannot be cast to com.cloud.agent.api.storage.PrimaryStorageDownloadAnswer
  435. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:847)
  436. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:472)
  437. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:465)
  438. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.startProxy(ConsoleProxyManagerImpl.java:627)
  439. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.allocCapacity(ConsoleProxyManagerImpl.java:1164)
  440. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:1981)
  441. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:173)
  442. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:113)
  443. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:34)
  444. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:83)
  445. at com.cloud.vm.SystemVmLoadScanner$1.run(SystemVmLoadScanner.java:73)
  446. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  447. at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351)
  448. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178)
  449. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165)
  450. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267)
  451. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
  452. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
  453. at java.lang.Thread.run(Thread.java:679)
  454. Caused by: java.lang.ClassCastException: com.cloud.agent.api.Answer cannot be cast to com.cloud.agent.api.storage.PrimaryStorageDownloadAnswer
  455. at com.cloud.template.TemplateManagerImpl.prepareTemplateForCreate(TemplateManagerImpl.java:663)
  456. at com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34)
  457. at com.cloud.storage.StorageManagerImpl.createVolume(StorageManagerImpl.java:3442)
  458. at com.cloud.storage.StorageManagerImpl.prepare(StorageManagerImpl.java:3351)
  459. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:754)
  460. ... 19 more
  461. 2013-01-29 14:28:50,579 DEBUG [dc.dao.DataCenterIpAddressDaoImpl] (secstorage-1:null) Releasing ip address for reservationId=046f9a18-d15c-4208-87c9-6e737b463c12, instance=737
  462. 2013-01-29 14:28:50,633 DEBUG [network.guru.PodBasedNetworkGuru] (secstorage-1:null) Released nic: NicProfile[737-201-null-null-null
  463. 2013-01-29 14:28:50,706 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to release Nic[737-201-046f9a18-d15c-4208-87c9-6e737b463c12-null]
  464. 2013-01-29 14:28:50,706 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to release Nic[737-201-046f9a18-d15c-4208-87c9-6e737b463c12-null]
  465. 2013-01-29 14:28:50,706 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to release Nic[737-201-046f9a18-d15c-4208-87c9-6e737b463c12-null]
  466. 2013-01-29 14:28:50,706 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to release Nic[737-201-046f9a18-d15c-4208-87c9-6e737b463c12-null]
  467. 2013-01-29 14:28:50,706 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to release Nic[737-201-046f9a18-d15c-4208-87c9-6e737b463c12-null]
  468. 2013-01-29 14:28:50,706 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to release Nic[737-201-046f9a18-d15c-4208-87c9-6e737b463c12-null]
  469. 2013-01-29 14:28:50,706 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to release Nic[737-201-046f9a18-d15c-4208-87c9-6e737b463c12-null]
  470. 2013-01-29 14:28:50,706 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Successfully released network resources for the vm VM[SecondaryStorageVm|s-201-VM]
  471. 2013-01-29 14:28:50,706 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Successfully cleanued up resources for the vm VM[SecondaryStorageVm|s-201-VM] in Starting state
  472. 2013-01-29 14:28:51,017 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: 7
  473. 2013-01-29 14:28:51,020 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) Hosts's actual total CPU: 12004 and CPU after applying overprovisioning: 12004
  474. 2013-01-29 14:28:51,020 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) release cpu from host: 7, old used: 500,reserved: 0, actual total: 12004, total with overprovisioning: 12004; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  475. 2013-01-29 14:28:51,020 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) release mem from host: 7, old used: 268435456,reserved: 0, total: 8269606912; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  476. 2013-01-29 14:28:51,109 WARN [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Exception while trying to start secondary storage vm
  477. com.cloud.exception.AgentUnavailableException: Resource [Host:7] is unreachable: Host 7: Unable to start instance due to com.cloud.agent.api.Answer cannot be cast to com.cloud.agent.api.storage.PrimaryStorageDownloadAnswer
  478. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:847)
  479. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:472)
  480. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:465)
  481. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.startSecStorageVm(SecondaryStorageManagerImpl.java:257)
  482. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.allocCapacity(SecondaryStorageManagerImpl.java:684)
  483. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.expandPool(SecondaryStorageManagerImpl.java:1310)
  484. at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:119)
  485. at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:50)
  486. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:106)
  487. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:34)
  488. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:83)
  489. at com.cloud.vm.SystemVmLoadScanner$1.run(SystemVmLoadScanner.java:73)
  490. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  491. at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351)
  492. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178)
  493. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165)
  494. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267)
  495. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
  496. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
  497. at java.lang.Thread.run(Thread.java:679)
  498. Caused by: java.lang.ClassCastException: com.cloud.agent.api.Answer cannot be cast to com.cloud.agent.api.storage.PrimaryStorageDownloadAnswer
  499. at com.cloud.template.TemplateManagerImpl.prepareTemplateForCreate(TemplateManagerImpl.java:663)
  500. at com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34)
  501. at com.cloud.storage.StorageManagerImpl.createVolume(StorageManagerImpl.java:3442)
  502. at com.cloud.storage.StorageManagerImpl.prepare(StorageManagerImpl.java:3351)
  503. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:754)
  504. ... 20 more
  505. 2013-01-29 14:28:51,109 INFO [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Unable to start secondary storage vm for standby capacity, secStorageVm vm Id : 201, will recycle it and start a new one
  506. 2013-01-29 14:28:51,111 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) VM is already stopped: VM[SecondaryStorageVm|s-201-VM]
  507. 2013-01-29 14:28:51,169 DEBUG [cloud.server.StatsCollector] (StatsCollector-2:null) StorageCollector is running...
  508. 2013-01-29 14:28:51,193 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) VM state transitted from :Stopped to Expunging with event: ExpungeOperationvm's original host id: null new host id: null host id before state transition: null
  509. 2013-01-29 14:28:51,194 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Destroying vm VM[SecondaryStorageVm|s-201-VM]
  510. 2013-01-29 14:28:51,194 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Cleaning up NICS
  511. 2013-01-29 14:28:51,194 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Cleaning network for vm: 201
  512. 2013-01-29 14:28:51,224 DEBUG [agent.transport.Request] (StatsCollector-2:null) Seq 5-632235895: Received: { Ans: , MgmtId: 60908668245, via: 5, Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
  513. 2013-01-29 14:28:51,226 DEBUG [cloud.server.StatsCollector] (StatsCollector-2:null) There is no secondary storage VM for secondary storage host nfs://cloudmanager.mira.dk/export/mirazone
  514. 2013-01-29 14:28:51,268 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Service SecurityGroup is not supported in the network id=222
  515. 2013-01-29 14:28:51,269 DEBUG [agent.transport.Request] (StatsCollector-2:null) Seq 4-220941126: Received: { Ans: , MgmtId: 60908668245, via: 4, Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
  516. 2013-01-29 14:28:51,270 DEBUG [network.guru.DirectNetworkGuru] (secstorage-1:null) Deallocate network: networkId: 222, ip: 212.70.6.205
  517. 2013-01-29 14:28:51,290 DEBUG [agent.transport.Request] (StatsCollector-2:null) Seq 7-2090140032: Received: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
  518. 2013-01-29 14:28:51,461 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Removed nic id=734
  519. 2013-01-29 14:28:51,576 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Removed nic id=735
  520. 2013-01-29 14:28:51,737 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Removed nic id=736
  521. 2013-01-29 14:28:51,887 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Removed nic id=737
  522. 2013-01-29 14:28:51,888 DEBUG [cloud.storage.StorageManagerImpl] (secstorage-1:null) Cleaning storage for vm: 201
  523. 2013-01-29 14:28:51,979 DEBUG [cloud.storage.StorageManagerImpl] (secstorage-1:null) Expunging Vol[203|vm=201|ROOT]
  524. 2013-01-29 14:28:51,981 DEBUG [cloud.storage.StorageManagerImpl] (secstorage-1:null) Marking volume that was never created as destroyed: Vol[203|vm=201|ROOT]
  525. 2013-01-29 14:28:52,121 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Expunged VM[SecondaryStorageVm|s-201-VM]
  526. 2013-01-29 14:28:52,179 INFO [cloud.secstorage.PremiumSecondaryStorageManagerImpl] (secstorage-1:null) Primary secondary storage is not even started, wait until next turn
  527. 2013-01-29 14:28:55,017 DEBUG [storage.snapshot.SnapshotSchedulerImpl] (SnapshotPollTask:null) Snapshot scheduler.poll is being called at 2013-01-29 13:28:55 GMT
  528. 2013-01-29 14:28:55,017 DEBUG [storage.snapshot.SnapshotSchedulerImpl] (SnapshotPollTask:null) Got 0 snapshots to be executed at 2013-01-29 13:28:55 GMT
  529. 2013-01-29 14:28:55,110 DEBUG [cloud.server.StatsCollector] (StatsCollector-2:null) VmStatsCollector is running...
  530. 2013-01-29 14:28:55,141 DEBUG [agent.transport.Request] (StatsCollector-2:null) Seq 1-89030377: Received: { Ans: , MgmtId: 60908668245, via: 1, Ver: v1, Flags: 10, { GetVmStatsAnswer } }
  531. 2013-01-29 14:28:55,161 DEBUG [agent.transport.Request] (StatsCollector-2:null) Seq 4-220941127: Received: { Ans: , MgmtId: 60908668245, via: 4, Ver: v1, Flags: 10, { GetVmStatsAnswer } }
  532. 2013-01-29 14:29:03,200 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-8:null) Ping from 1
  533. 2013-01-29 14:29:04,565 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-2:null) Ping from 4
  534. 2013-01-29 14:29:05,044 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-10:null) Ping from 3
  535. 2013-01-29 14:29:05,343 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-12:null) Ping from 5
  536. 2013-01-29 14:29:15,331 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-13:null) Ping from 7
  537. 2013-01-29 14:29:15,898 DEBUG [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Zone 1 is ready to launch secondary storage VM
  538. 2013-01-29 14:29:15,911 DEBUG [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Zone 3 is ready to launch secondary storage VM
  539. 2013-01-29 14:29:15,913 INFO [cloud.secstorage.PremiumSecondaryStorageManagerImpl] (secstorage-1:null) No running secondary storage vms found in datacenter id=3, starting one
  540. 2013-01-29 14:29:15,916 INFO [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) No stopped secondary storage vm is available, need to allocate a new secondary storage vm
  541. 2013-01-29 14:29:15,917 DEBUG [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Assign secondary storage vm from a newly started instance for request from data center : 3
  542. 2013-01-29 14:29:15,959 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Found existing network configuration for offering [Network Offering [7-Guest-DefaultSharedNetworkOffering]: Ntwk[222|Guest|7]
  543. 2013-01-29 14:29:15,959 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Releasing lock for Acct[1-system]
  544. 2013-01-29 14:29:15,960 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Found existing network configuration for offering [Network Offering [3-Control-System-Control-Network]: Ntwk[220|Control|3]
  545. 2013-01-29 14:29:15,960 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Releasing lock for Acct[1-system]
  546. 2013-01-29 14:29:15,961 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Found existing network configuration for offering [Network Offering [2-Management-System-Management-Network]: Ntwk[219|Management|2]
  547. 2013-01-29 14:29:15,961 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Releasing lock for Acct[1-system]
  548. 2013-01-29 14:29:15,962 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Found existing network configuration for offering [Network Offering [4-Storage-System-Storage-Network]: Ntwk[221|Storage|4]
  549. 2013-01-29 14:29:15,962 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Releasing lock for Acct[1-system]
  550. 2013-01-29 14:29:15,965 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Allocating entries for VM: VM[SecondaryStorageVm|s-202-VM]
  551. 2013-01-29 14:29:15,968 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Allocating nics for VM[SecondaryStorageVm|s-202-VM]
  552. 2013-01-29 14:29:15,968 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Allocating nic for vm VM[SecondaryStorageVm|s-202-VM] in network Ntwk[222|Guest|7] with requested profile NicProfile[0-0-null-null-null
  553. 2013-01-29 14:29:15,972 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Service SecurityGroup is not supported in the network id=222
  554. 2013-01-29 14:29:15,972 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Allocating nic for vm VM[SecondaryStorageVm|s-202-VM] in network Ntwk[220|Control|3] with requested profile null
  555. 2013-01-29 14:29:15,976 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Allocating nic for vm VM[SecondaryStorageVm|s-202-VM] in network Ntwk[219|Management|2] with requested profile null
  556. 2013-01-29 14:29:15,980 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Allocating nic for vm VM[SecondaryStorageVm|s-202-VM] in network Ntwk[221|Storage|4] with requested profile null
  557. 2013-01-29 14:29:15,984 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Allocaing disks for VM[SecondaryStorageVm|s-202-VM]
  558. 2013-01-29 14:29:16,015 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl] (consoleproxy-1:null) Zone 1 is ready to launch console proxy
  559. 2013-01-29 14:29:16,017 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl] (consoleproxy-1:null) Zone 3 is ready to launch console proxy
  560. 2013-01-29 14:29:16,017 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl] (consoleproxy-1:null) Expand console proxy standby capacity for zone Mira
  561. 2013-01-29 14:29:16,019 INFO [cloud.consoleproxy.ConsoleProxyManagerImpl] (consoleproxy-1:null) Found a stopped console proxy, bring it up to running pool. proxy vm id : 32
  562. 2013-01-29 14:29:16,026 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
  563. 2013-01-29 14:29:16,026 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Successfully transitioned to start state for VM[ConsoleProxy|v-32-VM] reservation id = 185d0935-8aa8-42a8-a683-1020f9373f55
  564. 2013-01-29 14:29:16,032 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Allocation completed for VM: VM[SecondaryStorageVm|s-202-VM]
  565. 2013-01-29 14:29:16,034 DEBUG [cloud.alert.SecondaryStorageVmAlertAdapter] (secstorage-1:null) received secondary storage vm alert
  566. 2013-01-29 14:29:16,034 DEBUG [cloud.alert.SecondaryStorageVmAlertAdapter] (secstorage-1:null) New secondary storage vm created, zone: Mira, secStorageVm: s-202-VM, public IP: null, private IP: null
  567. 2013-01-29 14:29:16,037 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
  568. 2013-01-29 14:29:16,037 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Successfully transitioned to start state for VM[SecondaryStorageVm|s-202-VM] reservation id = 4076d570-7e80-48eb-bc20-b2429f79956a
  569. 2013-01-29 14:29:16,083 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Trying to deploy VM, vm has dcId: 3 and podId: 3
  570. 2013-01-29 14:29:16,084 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Deploy avoids pods: null, clusters: null, hosts: null
  571. 2013-01-29 14:29:16,085 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) DeploymentPlanner allocation algorithm: random
  572. 2013-01-29 14:29:16,085 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Trying to allocate a host and storage pools from dc:3, pod:3,cluster:null, requested cpu: 500, requested ram: 1073741824
  573. 2013-01-29 14:29:16,085 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Is ROOT volume READY (pool already allocated)?: No
  574. 2013-01-29 14:29:16,085 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Searching resources only under specified Pod: 3
  575. 2013-01-29 14:29:16,085 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Pod: 3
  576. 2013-01-29 14:29:16,086 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) CPUOverprovisioningFactor considered: 1.0
  577. 2013-01-29 14:29:16,089 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Checking resources in Cluster: 3 under Pod: 3
  578. 2013-01-29 14:29:16,090 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Calling HostAllocators to find suitable hosts
  579. 2013-01-29 14:29:16,090 DEBUG [allocator.impl.FirstFitAllocator] (consoleproxy-1:FirstFitRoutingAllocator) Looking for hosts in dc: 3 pod:3 cluster:3
  580. 2013-01-29 14:29:16,090 DEBUG [allocator.impl.FirstFitAllocator] (consoleproxy-1:FirstFitRoutingAllocator) FirstFitAllocator has 1 hosts to check for allocation: [Host[-7-Routing]]
  581. 2013-01-29 14:29:16,091 DEBUG [allocator.impl.FirstFitAllocator] (consoleproxy-1:FirstFitRoutingAllocator) Found 1 hosts for allocation after prioritization: [Host[-7-Routing]]
  582. 2013-01-29 14:29:16,091 DEBUG [allocator.impl.FirstFitAllocator] (consoleproxy-1:FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=1024
  583. 2013-01-29 14:29:16,092 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) Checking if host: 7 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  584. 2013-01-29 14:29:16,093 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) Hosts's actual total CPU: 12004 and CPU after applying overprovisioning: 12004
  585. 2013-01-29 14:29:16,093 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) Free CPU: 12004 , Requested CPU: 500
  586. 2013-01-29 14:29:16,093 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) Free RAM: 8269606912 , Requested RAM: 1073741824
  587. 2013-01-29 14:29:16,093 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) Host has enough CPU and RAM available
  588. 2013-01-29 14:29:16,093 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 7, used: 0, reserved: 0, actual total: 12004, total with overprovisioning: 12004; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  589. 2013-01-29 14:29:16,093 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 7, used: 0, reserved: 0, total: 8269606912; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  590. 2013-01-29 14:29:16,093 DEBUG [allocator.impl.FirstFitAllocator] (consoleproxy-1:FirstFitRoutingAllocator) Found a suitable host, adding to list: 7
  591. 2013-01-29 14:29:16,093 DEBUG [allocator.impl.FirstFitAllocator] (consoleproxy-1:FirstFitRoutingAllocator) Host Allocator returning 1 suitable hosts
  592. 2013-01-29 14:29:16,094 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Checking suitable pools for volume (Id, Type): (34,ROOT)
  593. 2013-01-29 14:29:16,094 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) We need to allocate new storagepool for this volume
  594. 2013-01-29 14:29:16,094 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Calling StoragePoolAllocators to find suitable pools
  595. 2013-01-29 14:29:16,095 DEBUG [storage.allocator.FirstFitStoragePoolAllocator] (consoleproxy-1:null) Looking for pools in dc: 3 pod:3 cluster:3
  596. 2013-01-29 14:29:16,095 DEBUG [storage.allocator.FirstFitStoragePoolAllocator] (consoleproxy-1:null) FirstFitStoragePoolAllocator has 1 pools to check for allocation
  597. 2013-01-29 14:29:16,095 DEBUG [storage.allocator.AbstractStoragePoolAllocator] (consoleproxy-1:null) Checking if storage pool is suitable, name: DRDB10 ,poolId: 204
  598. 2013-01-29 14:29:16,095 DEBUG [storage.allocator.AbstractStoragePoolAllocator] (consoleproxy-1:null) Is localStorageAllocationNeeded? false
  599. 2013-01-29 14:29:16,095 DEBUG [storage.allocator.AbstractStoragePoolAllocator] (consoleproxy-1:null) Is storage pool shared? true
  600. 2013-01-29 14:29:16,096 DEBUG [cloud.storage.StorageManagerImpl] (consoleproxy-1:null) Checking pool 204 for storage, totalSize: 1968949690368, usedBytes: 204734464, usedPct: 1.039815618456634E-4, disable threshold: 0.85
  601. 2013-01-29 14:29:16,098 DEBUG [cloud.storage.StorageManagerImpl] (consoleproxy-1:null) Checking pool: 204 for volume allocation [Vol[34|vm=32|ROOT]], maxSize : 3937899380736, totalAllocatedSize : 0, askingSize : 0, allocated disable threshold: 0.85
  602. 2013-01-29 14:29:16,098 DEBUG [storage.allocator.FirstFitStoragePoolAllocator] (consoleproxy-1:null) FirstFitStoragePoolAllocator returning 1 suitable storage pools
  603. 2013-01-29 14:29:16,098 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Trying to find a potenial host and associated storage pools from the suitable host/pool lists for this VM
  604. 2013-01-29 14:29:16,098 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Checking if host: 7 can access any suitable storage pool for volume: ROOT
  605. 2013-01-29 14:29:16,099 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Host: 7 can access pool: 204
  606. 2013-01-29 14:29:16,099 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Found a potential host id: 7 name: mc1 and associated storage pools for this VM
  607. 2013-01-29 14:29:16,100 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Returning Deployment Destination: Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(3)-Pod(3)-Cluster(3)-Host(7)-Storage(Volume(34|ROOT-->Pool(204))]
  608. 2013-01-29 14:29:16,100 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Deployment found - P0=VM[ConsoleProxy|v-32-VM], P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(3)-Pod(3)-Cluster(3)-Host(7)-Storage(Volume(34|ROOT-->Pool(204))]
  609. 2013-01-29 14:29:16,124 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Trying to deploy VM, vm has dcId: 3 and podId: null
  610. 2013-01-29 14:29:16,124 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Deploy avoids pods: null, clusters: null, hosts: null
  611. 2013-01-29 14:29:16,125 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) DeploymentPlanner allocation algorithm: random
  612. 2013-01-29 14:29:16,125 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Trying to allocate a host and storage pools from dc:3, pod:null,cluster:null, requested cpu: 500, requested ram: 268435456
  613. 2013-01-29 14:29:16,125 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Is ROOT volume READY (pool already allocated)?: No
  614. 2013-01-29 14:29:16,125 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Searching all possible resources under this Zone: 3
  615. 2013-01-29 14:29:16,126 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 3
  616. 2013-01-29 14:29:16,127 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) CPUOverprovisioningFactor considered: 1.0
  617. 2013-01-29 14:29:16,130 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Checking resources in Cluster: 3 under Pod: 3
  618. 2013-01-29 14:29:16,130 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Calling HostAllocators to find suitable hosts
  619. 2013-01-29 14:29:16,130 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) Looking for hosts in dc: 3 pod:3 cluster:3
  620. 2013-01-29 14:29:16,131 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) FirstFitAllocator has 1 hosts to check for allocation: [Host[-7-Routing]]
  621. 2013-01-29 14:29:16,132 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) Found 1 hosts for allocation after prioritization: [Host[-7-Routing]]
  622. 2013-01-29 14:29:16,132 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=256
  623. 2013-01-29 14:29:16,132 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) Checking if host: 7 has enough capacity for requested CPU: 500 and requested RAM: 268435456 , cpuOverprovisioningFactor: 1.0
  624. 2013-01-29 14:29:16,134 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) Hosts's actual total CPU: 12004 and CPU after applying overprovisioning: 12004
  625. 2013-01-29 14:29:16,134 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) Free CPU: 12004 , Requested CPU: 500
  626. 2013-01-29 14:29:16,134 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) Free RAM: 8269606912 , Requested RAM: 268435456
  627. 2013-01-29 14:29:16,134 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) Host has enough CPU and RAM available
  628. 2013-01-29 14:29:16,134 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 7, used: 0, reserved: 0, actual total: 12004, total with overprovisioning: 12004; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  629. 2013-01-29 14:29:16,134 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 7, used: 0, reserved: 0, total: 8269606912; requested mem: 268435456,alloc_from_last_host?:false ,considerReservedCapacity?: true
  630. 2013-01-29 14:29:16,134 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) Found a suitable host, adding to list: 7
  631. 2013-01-29 14:29:16,134 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) Host Allocator returning 1 suitable hosts
  632. 2013-01-29 14:29:16,141 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Checking suitable pools for volume (Id, Type): (204,ROOT)
  633. 2013-01-29 14:29:16,141 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) We need to allocate new storagepool for this volume
  634. 2013-01-29 14:29:16,141 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Calling StoragePoolAllocators to find suitable pools
  635. 2013-01-29 14:29:16,142 DEBUG [storage.allocator.FirstFitStoragePoolAllocator] (secstorage-1:null) Looking for pools in dc: 3 pod:3 cluster:3
  636. 2013-01-29 14:29:16,142 DEBUG [storage.allocator.FirstFitStoragePoolAllocator] (secstorage-1:null) FirstFitStoragePoolAllocator has 1 pools to check for allocation
  637. 2013-01-29 14:29:16,142 DEBUG [storage.allocator.AbstractStoragePoolAllocator] (secstorage-1:null) Checking if storage pool is suitable, name: DRDB10 ,poolId: 204
  638. 2013-01-29 14:29:16,142 DEBUG [storage.allocator.AbstractStoragePoolAllocator] (secstorage-1:null) Is localStorageAllocationNeeded? false
  639. 2013-01-29 14:29:16,142 DEBUG [storage.allocator.AbstractStoragePoolAllocator] (secstorage-1:null) Is storage pool shared? true
  640. 2013-01-29 14:29:16,143 DEBUG [cloud.storage.StorageManagerImpl] (secstorage-1:null) Checking pool 204 for storage, totalSize: 1968949690368, usedBytes: 204734464, usedPct: 1.039815618456634E-4, disable threshold: 0.85
  641. 2013-01-29 14:29:16,145 DEBUG [cloud.storage.StorageManagerImpl] (secstorage-1:null) Checking pool: 204 for volume allocation [Vol[204|vm=202|ROOT]], maxSize : 3937899380736, totalAllocatedSize : 0, askingSize : 0, allocated disable threshold: 0.85
  642. 2013-01-29 14:29:16,145 DEBUG [storage.allocator.FirstFitStoragePoolAllocator] (secstorage-1:null) FirstFitStoragePoolAllocator returning 1 suitable storage pools
  643. 2013-01-29 14:29:16,145 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Trying to find a potenial host and associated storage pools from the suitable host/pool lists for this VM
  644. 2013-01-29 14:29:16,145 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Checking if host: 7 can access any suitable storage pool for volume: ROOT
  645. 2013-01-29 14:29:16,146 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Host: 7 can access pool: 204
  646. 2013-01-29 14:29:16,146 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Found a potential host id: 7 name: mc1 and associated storage pools for this VM
  647. 2013-01-29 14:29:16,146 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Returning Deployment Destination: Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(3)-Pod(3)-Cluster(3)-Host(7)-Storage(Volume(204|ROOT-->Pool(204))]
  648. 2013-01-29 14:29:16,146 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Deployment found - P0=VM[SecondaryStorageVm|s-202-VM], P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(3)-Pod(3)-Cluster(3)-Host(7)-Storage(Volume(204|ROOT-->Pool(204))]
  649. 2013-01-29 14:29:16,266 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) VM state transitted from :Starting to Starting with event: OperationRetryvm's original host id: null new host id: 7 host id before state transition: null
  650. 2013-01-29 14:29:16,269 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) Hosts's actual total CPU: 12004 and CPU after applying overprovisioning: 12004
  651. 2013-01-29 14:29:16,270 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) We are allocating VM, increasing the used capacity of this host:7
  652. 2013-01-29 14:29:16,270 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) Current Used CPU: 0 , Free CPU:12004 ,Requested CPU: 500
  653. 2013-01-29 14:29:16,270 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) Current Used RAM: 0 , Free RAM:8269606912 ,Requested RAM: 1073741824
  654. 2013-01-29 14:29:16,270 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) CPU STATS after allocation: for host: 7, old used: 0, old reserved: 0, actual total: 12004, total with overprovisioning: 12004; new used:500, reserved:0; requested cpu:500,alloc_from_last:false
  655. 2013-01-29 14:29:16,270 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) RAM STATS after allocation: for host: 7, old used: 0, old reserved: 0, total: 8269606912; new used: 1073741824, reserved: 0; requested mem: 1073741824,alloc_from_last:false
  656. 2013-01-29 14:29:16,308 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) VM state transitted from :Starting to Starting with event: OperationRetryvm's original host id: null new host id: 7 host id before state transition: null
  657. 2013-01-29 14:29:16,312 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) Hosts's actual total CPU: 12004 and CPU after applying overprovisioning: 12004
  658. 2013-01-29 14:29:16,312 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) We are allocating VM, increasing the used capacity of this host:7
  659. 2013-01-29 14:29:16,313 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) Current Used CPU: 500 , Free CPU:11504 ,Requested CPU: 500
  660. 2013-01-29 14:29:16,313 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) Current Used RAM: 1073741824 , Free RAM:7195865088 ,Requested RAM: 268435456
  661. 2013-01-29 14:29:16,313 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) CPU STATS after allocation: for host: 7, old used: 500, old reserved: 0, actual total: 12004, total with overprovisioning: 12004; new used:1000, reserved:0; requested cpu:500,alloc_from_last:false
  662. 2013-01-29 14:29:16,313 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) RAM STATS after allocation: for host: 7, old used: 1073741824, old reserved: 0, total: 8269606912; new used: 1342177280, reserved: 0; requested mem: 268435456,alloc_from_last:false
  663. 2013-01-29 14:29:16,350 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) VM is being created in podId: 3
  664. 2013-01-29 14:29:16,353 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Lock is acquired for network id 222 as a part of network implement
  665. 2013-01-29 14:29:16,353 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Network id=222 is already implemented
  666. 2013-01-29 14:29:16,353 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Lock is released for network id 222 as a part of network implement
  667. 2013-01-29 14:29:16,371 DEBUG [cloud.network.ExternalLoadBalancerUsageManagerImpl] (ExternalNetworkMonitor-1:null) External load balancer devices stats collector is running...
  668. 2013-01-29 14:29:16,377 DEBUG [cloud.network.ExternalLoadBalancerUsageManagerImpl] (ExternalNetworkMonitor-1:null) Network 204 is not configured for external networking, so skipping usage check.
  669. 2013-01-29 14:29:16,378 DEBUG [cloud.network.ExternalLoadBalancerUsageManagerImpl] (ExternalNetworkMonitor-1:null) Network 205 is not configured for external networking, so skipping usage check.
  670. 2013-01-29 14:29:16,378 DEBUG [cloud.network.ExternalLoadBalancerUsageManagerImpl] (ExternalNetworkMonitor-1:null) Network 208 is not configured for external networking, so skipping usage check.
  671. 2013-01-29 14:29:16,379 DEBUG [cloud.network.ExternalLoadBalancerUsageManagerImpl] (ExternalNetworkMonitor-1:null) Network 211 is not configured for external networking, so skipping usage check.
  672. 2013-01-29 14:29:16,380 DEBUG [cloud.network.ExternalLoadBalancerUsageManagerImpl] (ExternalNetworkMonitor-1:null) Network 212 is not configured for external networking, so skipping usage check.
  673. 2013-01-29 14:29:16,400 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) VM is being created in podId: 3
  674. 2013-01-29 14:29:16,402 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is acquired for network id 222 as a part of network implement
  675. 2013-01-29 14:29:16,402 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Network id=222 is already implemented
  676. 2013-01-29 14:29:16,402 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is released for network id 222 as a part of network implement
  677. 2013-01-29 14:29:16,405 INFO [cloud.ha.HighAvailabilityManagerImpl] (HA-4:null) checking health of usage server
  678. 2013-01-29 14:29:16,406 DEBUG [cloud.ha.HighAvailabilityManagerImpl] (HA-4:null) usage server running? false, heartbeat: null
  679. 2013-01-29 14:29:16,406 DEBUG [cloud.alert.AlertManagerImpl] (HA-4:null) Have already sent: 1 emails for alert type '12' -- skipping send email
  680. 2013-01-29 14:29:16,416 DEBUG [network.router.VirtualNetworkApplianceManagerImpl] (RouterMonitor-1:null) Found 3 running routers.
  681. 2013-01-29 14:29:16,428 DEBUG [network.router.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:null) Found 5 routers.
  682. 2013-01-29 14:29:16,451 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Service SecurityGroup is not supported in the network id=222
  683. 2013-01-29 14:29:16,501 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Service SecurityGroup is not supported in the network id=222
  684. 2013-01-29 14:29:16,553 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VirtualRouter to prepare for Nic[59-32-185d0935-8aa8-42a8-a683-1020f9373f55-212.70.6.202]
  685. 2013-01-29 14:29:16,554 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking Ovs to prepare for Nic[59-32-185d0935-8aa8-42a8-a683-1020f9373f55-212.70.6.202]
  686. 2013-01-29 14:29:16,554 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking ExternalDhcpServer to prepare for Nic[59-32-185d0935-8aa8-42a8-a683-1020f9373f55-212.70.6.202]
  687. 2013-01-29 14:29:16,554 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking BareMetal to prepare for Nic[59-32-185d0935-8aa8-42a8-a683-1020f9373f55-212.70.6.202]
  688. 2013-01-29 14:29:16,554 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking SecurityGroupProvider to prepare for Nic[59-32-185d0935-8aa8-42a8-a683-1020f9373f55-212.70.6.202]
  689. 2013-01-29 14:29:16,554 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VpcVirtualRouter to prepare for Nic[59-32-185d0935-8aa8-42a8-a683-1020f9373f55-212.70.6.202]
  690. 2013-01-29 14:29:16,554 WARN [network.element.VpcVirtualRouterElement] (consoleproxy-1:null) Network Ntwk[222|Guest|7] is not associated with any VPC
  691. 2013-01-29 14:29:16,554 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking NiciraNvp to prepare for Nic[59-32-185d0935-8aa8-42a8-a683-1020f9373f55-212.70.6.202]
  692. 2013-01-29 14:29:16,555 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Service SecurityGroup is not supported in the network id=222
  693. 2013-01-29 14:29:16,555 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Lock is acquired for network id 220 as a part of network implement
  694. 2013-01-29 14:29:16,555 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Network id=220 is already implemented
  695. 2013-01-29 14:29:16,556 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Lock is released for network id 220 as a part of network implement
  696. 2013-01-29 14:29:16,568 DEBUG [agent.transport.Request] (AgentManager-Handler-9:null) Seq 1-89030378: Processing: { Ans: , MgmtId: 60908668245, via: 1, Ver: v1, Flags: 10, [{"NetworkUsageAnswer":{"routerName":"r-4-VM","bytesSent":9018422648,"bytesReceived":2927395399,"result":true,"details":"","wait":0}}] }
  697. 2013-01-29 14:29:16,568 DEBUG [agent.transport.Request] (RouterMonitor-1:null) Seq 1-89030378: Received: { Ans: , MgmtId: 60908668245, via: 1, Ver: v1, Flags: 10, { NetworkUsageAnswer } }
  698. 2013-01-29 14:29:16,568 DEBUG [agent.manager.AgentManagerImpl] (RouterMonitor-1:null) Details from executing class com.cloud.agent.api.NetworkUsageCommand:
  699. 2013-01-29 14:29:16,569 WARN [network.router.VirtualNetworkApplianceManagerImpl] (RouterMonitor-1:null) unable to find stats for account: 2
  700. 2013-01-29 14:29:16,569 DEBUG [db.Transaction.Transaction] (RouterMonitor-1:null) Rolling back the transaction: Time = 1 Name = -VirtualNetworkApplianceManagerImpl$NetworkUsageTask.run:790-Executors$RunnableAdapter.call:471-FutureTask$Sync.innerRunAndReset:351-FutureTask.runAndReset:178-ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201:165-ScheduledThreadPoolExecutor$ScheduledFutureTask.run:267-ThreadPoolExecutor.runWorker:1110-ThreadPoolExecutor$Worker.run:603-Thread.run:679; called by -Transaction.rollback:887-Transaction.removeUpTo:830-Transaction.close:649-VirtualNetworkApplianceManagerImpl$NetworkUsageTask.run:840-Executors$RunnableAdapter.call:471-FutureTask$Sync.innerRunAndReset:351-FutureTask.runAndReset:178-ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201:165-ScheduledThreadPoolExecutor$ScheduledFutureTask.run:267-ThreadPoolExecutor.runWorker:1110-ThreadPoolExecutor$Worker.run:603-Thread.run:679
  701. 2013-01-29 14:29:16,695 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to prepare for Nic[738-202-4076d570-7e80-48eb-bc20-b2429f79956a-212.70.6.205]
  702. 2013-01-29 14:29:16,695 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to prepare for Nic[738-202-4076d570-7e80-48eb-bc20-b2429f79956a-212.70.6.205]
  703. 2013-01-29 14:29:16,695 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to prepare for Nic[738-202-4076d570-7e80-48eb-bc20-b2429f79956a-212.70.6.205]
  704. 2013-01-29 14:29:16,695 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to prepare for Nic[738-202-4076d570-7e80-48eb-bc20-b2429f79956a-212.70.6.205]
  705. 2013-01-29 14:29:16,695 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to prepare for Nic[738-202-4076d570-7e80-48eb-bc20-b2429f79956a-212.70.6.205]
  706. 2013-01-29 14:29:16,695 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to prepare for Nic[738-202-4076d570-7e80-48eb-bc20-b2429f79956a-212.70.6.205]
  707. 2013-01-29 14:29:16,695 WARN [network.element.VpcVirtualRouterElement] (secstorage-1:null) Network Ntwk[222|Guest|7] is not associated with any VPC
  708. 2013-01-29 14:29:16,696 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to prepare for Nic[738-202-4076d570-7e80-48eb-bc20-b2429f79956a-212.70.6.205]
  709. 2013-01-29 14:29:16,696 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Service SecurityGroup is not supported in the network id=222
  710. 2013-01-29 14:29:16,697 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is acquired for network id 220 as a part of network implement
  711. 2013-01-29 14:29:16,697 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Network id=220 is already implemented
  712. 2013-01-29 14:29:16,697 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is released for network id 220 as a part of network implement
  713. 2013-01-29 14:29:16,728 DEBUG [agent.transport.Request] (AgentManager-Handler-4:null) Seq 1-89030379: Processing: { Ans: , MgmtId: 60908668245, via: 1, Ver: v1, Flags: 10, [{"NetworkUsageAnswer":{"routerName":"r-8-VM","bytesSent":11014792,"bytesReceived":5286458,"result":true,"details":"","wait":0}}] }
  714. 2013-01-29 14:29:16,728 DEBUG [agent.transport.Request] (RouterMonitor-1:null) Seq 1-89030379: Received: { Ans: , MgmtId: 60908668245, via: 1, Ver: v1, Flags: 10, { NetworkUsageAnswer } }
  715. 2013-01-29 14:29:16,728 DEBUG [agent.manager.AgentManagerImpl] (RouterMonitor-1:null) Details from executing class com.cloud.agent.api.NetworkUsageCommand:
  716. 2013-01-29 14:29:16,729 WARN [network.router.VirtualNetworkApplianceManagerImpl] (RouterMonitor-1:null) unable to find stats for account: 2
  717. 2013-01-29 14:29:16,729 DEBUG [db.Transaction.Transaction] (RouterMonitor-1:null) Rolling back the transaction: Time = 1 Name = -VirtualNetworkApplianceManagerImpl$NetworkUsageTask.run:790-Executors$RunnableAdapter.call:471-FutureTask$Sync.innerRunAndReset:351-FutureTask.runAndReset:178-ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201:165-ScheduledThreadPoolExecutor$ScheduledFutureTask.run:267-ThreadPoolExecutor.runWorker:1110-ThreadPoolExecutor$Worker.run:603-Thread.run:679; called by -Transaction.rollback:887-Transaction.removeUpTo:830-Transaction.close:649-VirtualNetworkApplianceManagerImpl$NetworkUsageTask.run:840-Executors$RunnableAdapter.call:471-FutureTask$Sync.innerRunAndReset:351-FutureTask.runAndReset:178-ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201:165-ScheduledThreadPoolExecutor$ScheduledFutureTask.run:267-ThreadPoolExecutor.runWorker:1110-ThreadPoolExecutor$Worker.run:603-Thread.run:679
  718. 2013-01-29 14:29:16,829 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VirtualRouter to prepare for Nic[60-32-185d0935-8aa8-42a8-a683-1020f9373f55-169.254.0.20]
  719. 2013-01-29 14:29:16,829 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking Ovs to prepare for Nic[60-32-185d0935-8aa8-42a8-a683-1020f9373f55-169.254.0.20]
  720. 2013-01-29 14:29:16,829 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking ExternalDhcpServer to prepare for Nic[60-32-185d0935-8aa8-42a8-a683-1020f9373f55-169.254.0.20]
  721. 2013-01-29 14:29:16,829 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking BareMetal to prepare for Nic[60-32-185d0935-8aa8-42a8-a683-1020f9373f55-169.254.0.20]
  722. 2013-01-29 14:29:16,829 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking SecurityGroupProvider to prepare for Nic[60-32-185d0935-8aa8-42a8-a683-1020f9373f55-169.254.0.20]
  723. 2013-01-29 14:29:16,829 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VpcVirtualRouter to prepare for Nic[60-32-185d0935-8aa8-42a8-a683-1020f9373f55-169.254.0.20]
  724. 2013-01-29 14:29:16,829 WARN [network.element.VpcVirtualRouterElement] (consoleproxy-1:null) Network Ntwk[220|Control|3] is not associated with any VPC
  725. 2013-01-29 14:29:16,829 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking NiciraNvp to prepare for Nic[60-32-185d0935-8aa8-42a8-a683-1020f9373f55-169.254.0.20]
  726. 2013-01-29 14:29:16,831 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Lock is acquired for network id 219 as a part of network implement
  727. 2013-01-29 14:29:16,831 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Network id=219 is already implemented
  728. 2013-01-29 14:29:16,831 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Lock is released for network id 219 as a part of network implement
  729. 2013-01-29 14:29:16,888 DEBUG [agent.transport.Request] (AgentManager-Handler-11:null) Seq 4-220941128: Processing: { Ans: , MgmtId: 60908668245, via: 4, Ver: v1, Flags: 10, [{"NetworkUsageAnswer":{"routerName":"r-30-VM","bytesSent":52980032,"bytesReceived":250121537,"result":true,"details":"","wait":0}}] }
  730. 2013-01-29 14:29:16,888 DEBUG [agent.transport.Request] (RouterMonitor-1:null) Seq 4-220941128: Received: { Ans: , MgmtId: 60908668245, via: 4, Ver: v1, Flags: 10, { NetworkUsageAnswer } }
  731. 2013-01-29 14:29:16,888 DEBUG [agent.manager.AgentManagerImpl] (RouterMonitor-1:null) Details from executing class com.cloud.agent.api.NetworkUsageCommand:
  732. 2013-01-29 14:29:16,889 WARN [network.router.VirtualNetworkApplianceManagerImpl] (RouterMonitor-1:null) unable to find stats for account: 2
  733. 2013-01-29 14:29:16,889 DEBUG [db.Transaction.Transaction] (RouterMonitor-1:null) Rolling back the transaction: Time = 1 Name = -VirtualNetworkApplianceManagerImpl$NetworkUsageTask.run:790-Executors$RunnableAdapter.call:471-FutureTask$Sync.innerRunAndReset:351-FutureTask.runAndReset:178-ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201:165-ScheduledThreadPoolExecutor$ScheduledFutureTask.run:267-ThreadPoolExecutor.runWorker:1110-ThreadPoolExecutor$Worker.run:603-Thread.run:679; called by -Transaction.rollback:887-Transaction.removeUpTo:830-Transaction.close:649-VirtualNetworkApplianceManagerImpl$NetworkUsageTask.run:840-Executors$RunnableAdapter.call:471-FutureTask$Sync.innerRunAndReset:351-FutureTask.runAndReset:178-ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201:165-ScheduledThreadPoolExecutor$ScheduledFutureTask.run:267-ThreadPoolExecutor.runWorker:1110-ThreadPoolExecutor$Worker.run:603-Thread.run:679
  734. 2013-01-29 14:29:16,955 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to prepare for Nic[739-202-4076d570-7e80-48eb-bc20-b2429f79956a-169.254.3.27]
  735. 2013-01-29 14:29:16,955 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to prepare for Nic[739-202-4076d570-7e80-48eb-bc20-b2429f79956a-169.254.3.27]
  736. 2013-01-29 14:29:16,955 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to prepare for Nic[739-202-4076d570-7e80-48eb-bc20-b2429f79956a-169.254.3.27]
  737. 2013-01-29 14:29:16,955 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to prepare for Nic[739-202-4076d570-7e80-48eb-bc20-b2429f79956a-169.254.3.27]
  738. 2013-01-29 14:29:16,955 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to prepare for Nic[739-202-4076d570-7e80-48eb-bc20-b2429f79956a-169.254.3.27]
  739. 2013-01-29 14:29:16,955 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to prepare for Nic[739-202-4076d570-7e80-48eb-bc20-b2429f79956a-169.254.3.27]
  740. 2013-01-29 14:29:16,955 WARN [network.element.VpcVirtualRouterElement] (secstorage-1:null) Network Ntwk[220|Control|3] is not associated with any VPC
  741. 2013-01-29 14:29:16,955 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to prepare for Nic[739-202-4076d570-7e80-48eb-bc20-b2429f79956a-169.254.3.27]
  742. 2013-01-29 14:29:16,956 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is acquired for network id 219 as a part of network implement
  743. 2013-01-29 14:29:16,956 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Network id=219 is already implemented
  744. 2013-01-29 14:29:16,956 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is released for network id 219 as a part of network implement
  745. 2013-01-29 14:29:17,013 DEBUG [network.guru.PodBasedNetworkGuru] (consoleproxy-1:null) Allocated a nic NicProfile[61-32-185d0935-8aa8-42a8-a683-1020f9373f55-212.70.6.78-null for VM[ConsoleProxy|v-32-VM]
  746. 2013-01-29 14:29:17,122 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VirtualRouter to prepare for Nic[61-32-185d0935-8aa8-42a8-a683-1020f9373f55-212.70.6.78]
  747. 2013-01-29 14:29:17,122 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking Ovs to prepare for Nic[61-32-185d0935-8aa8-42a8-a683-1020f9373f55-212.70.6.78]
  748. 2013-01-29 14:29:17,122 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking ExternalDhcpServer to prepare for Nic[61-32-185d0935-8aa8-42a8-a683-1020f9373f55-212.70.6.78]
  749. 2013-01-29 14:29:17,122 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking BareMetal to prepare for Nic[61-32-185d0935-8aa8-42a8-a683-1020f9373f55-212.70.6.78]
  750. 2013-01-29 14:29:17,122 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking SecurityGroupProvider to prepare for Nic[61-32-185d0935-8aa8-42a8-a683-1020f9373f55-212.70.6.78]
  751. 2013-01-29 14:29:17,122 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VpcVirtualRouter to prepare for Nic[61-32-185d0935-8aa8-42a8-a683-1020f9373f55-212.70.6.78]
  752. 2013-01-29 14:29:17,122 WARN [network.element.VpcVirtualRouterElement] (consoleproxy-1:null) Network Ntwk[219|Management|2] is not associated with any VPC
  753. 2013-01-29 14:29:17,122 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking NiciraNvp to prepare for Nic[61-32-185d0935-8aa8-42a8-a683-1020f9373f55-212.70.6.78]
  754. 2013-01-29 14:29:17,123 DEBUG [cloud.storage.StorageManagerImpl] (consoleproxy-1:null) Checking if we need to prepare 1 volumes for VM[ConsoleProxy|v-32-VM]
  755. 2013-01-29 14:29:17,172 DEBUG [network.guru.PodBasedNetworkGuru] (secstorage-1:null) Allocated a nic NicProfile[740-202-4076d570-7e80-48eb-bc20-b2429f79956a-212.70.6.90-null for VM[SecondaryStorageVm|s-202-VM]
  756. 2013-01-29 14:29:17,222 DEBUG [cloud.storage.StorageManagerImpl] (consoleproxy-1:null) Creating volume: Vol[34|vm=32|ROOT]
  757. 2013-01-29 14:29:17,223 DEBUG [cloud.storage.StorageManagerImpl] (consoleproxy-1:null) Trying to create in Pool[204|NetworkFilesystem]
  758. 2013-01-29 14:29:17,273 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to prepare for Nic[740-202-4076d570-7e80-48eb-bc20-b2429f79956a-212.70.6.90]
  759. 2013-01-29 14:29:17,273 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to prepare for Nic[740-202-4076d570-7e80-48eb-bc20-b2429f79956a-212.70.6.90]
  760. 2013-01-29 14:29:17,273 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to prepare for Nic[740-202-4076d570-7e80-48eb-bc20-b2429f79956a-212.70.6.90]
  761. 2013-01-29 14:29:17,273 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to prepare for Nic[740-202-4076d570-7e80-48eb-bc20-b2429f79956a-212.70.6.90]
  762. 2013-01-29 14:29:17,273 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to prepare for Nic[740-202-4076d570-7e80-48eb-bc20-b2429f79956a-212.70.6.90]
  763. 2013-01-29 14:29:17,273 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to prepare for Nic[740-202-4076d570-7e80-48eb-bc20-b2429f79956a-212.70.6.90]
  764. 2013-01-29 14:29:17,273 WARN [network.element.VpcVirtualRouterElement] (secstorage-1:null) Network Ntwk[219|Management|2] is not associated with any VPC
  765. 2013-01-29 14:29:17,273 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to prepare for Nic[740-202-4076d570-7e80-48eb-bc20-b2429f79956a-212.70.6.90]
  766. 2013-01-29 14:29:17,274 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is acquired for network id 221 as a part of network implement
  767. 2013-01-29 14:29:17,274 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Network id=221 is already implemented
  768. 2013-01-29 14:29:17,274 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is released for network id 221 as a part of network implement
  769. 2013-01-29 14:29:17,434 DEBUG [cloud.template.TemplateManagerImpl] (consoleproxy-1:null) Downloading 3 via 7
  770. 2013-01-29 14:29:17,436 DEBUG [agent.transport.Request] (consoleproxy-1:null) Seq 7-2090140033: Sending { Cmd , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 100111, [{"storage.PrimaryStorageDownloadCommand":{"localPath":"/mnt/99898908-d913-39c8-b61d-c7e6b6dbd8f0","poolUuid":"99898908-d913-39c8-b61d-c7e6b6dbd8f0","poolId":204,"secondaryStorageUrl":"nfs://cloudmanager.mira.dk/export/mirazone","primaryStorageUrl":"nfs://10.212.212.249/export/drbd10","url":"nfs://cloudmanager.mira.dk/export/mirazone/template/tmpl/1/3/","format":"QCOW2","accountId":1,"name":"routing-3","wait":10800}}] }
  771. 2013-01-29 14:29:17,489 DEBUG [network.guru.PodBasedNetworkGuru] (secstorage-1:null) Allocated a nic NicProfile[741-202-4076d570-7e80-48eb-bc20-b2429f79956a-212.70.6.85-null for VM[SecondaryStorageVm|s-202-VM]
  772. 2013-01-29 14:29:17,548 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to prepare for Nic[741-202-4076d570-7e80-48eb-bc20-b2429f79956a-212.70.6.85]
  773. 2013-01-29 14:29:17,548 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to prepare for Nic[741-202-4076d570-7e80-48eb-bc20-b2429f79956a-212.70.6.85]
  774. 2013-01-29 14:29:17,548 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to prepare for Nic[741-202-4076d570-7e80-48eb-bc20-b2429f79956a-212.70.6.85]
  775. 2013-01-29 14:29:17,548 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to prepare for Nic[741-202-4076d570-7e80-48eb-bc20-b2429f79956a-212.70.6.85]
  776. 2013-01-29 14:29:17,548 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to prepare for Nic[741-202-4076d570-7e80-48eb-bc20-b2429f79956a-212.70.6.85]
  777. 2013-01-29 14:29:17,548 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to prepare for Nic[741-202-4076d570-7e80-48eb-bc20-b2429f79956a-212.70.6.85]
  778. 2013-01-29 14:29:17,548 WARN [network.element.VpcVirtualRouterElement] (secstorage-1:null) Network Ntwk[221|Storage|4] is not associated with any VPC
  779. 2013-01-29 14:29:17,548 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to prepare for Nic[741-202-4076d570-7e80-48eb-bc20-b2429f79956a-212.70.6.85]
  780. 2013-01-29 14:29:17,549 DEBUG [cloud.storage.StorageManagerImpl] (secstorage-1:null) Checking if we need to prepare 1 volumes for VM[SecondaryStorageVm|s-202-VM]
  781. 2013-01-29 14:29:17,576 DEBUG [agent.transport.Request] (AgentManager-Handler-15:null) Seq 7-2090140033: Processing: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, [{"Answer":{"result":false,"details":"java.lang.NullPointerException\n\tat com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.createStoragePool(LibvirtStorageAdaptor.java:462)\n\tat com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.getStoragePoolByURI(LibvirtStorageAdaptor.java:745)\n\tat com.cloud.hypervisor.kvm.storage.KVMStoragePoolManager.getStoragePoolByURI(KVMStoragePoolManager.java:52)\n\tat com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:2017)\n\tat com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1009)\n\tat com.cloud.agent.Agent.processRequest(Agent.java:518)\n\tat com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:831)\n\tat com.cloud.utils.nio.Task.run(Task.java:83)\n\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)\n\tat java.lang.Thread.run(Thread.java:679)\n","wait":0}}] }
  782. 2013-01-29 14:29:17,576 DEBUG [agent.manager.AgentAttache] (AgentManager-Handler-15:null) Seq 7-2090140033: No more commands found
  783. 2013-01-29 14:29:17,576 DEBUG [agent.transport.Request] (consoleproxy-1:null) Seq 7-2090140033: Received: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, { Answer } }
  784. 2013-01-29 14:29:17,576 DEBUG [agent.manager.AgentManagerImpl] (consoleproxy-1:null) Details from executing class com.cloud.agent.api.storage.PrimaryStorageDownloadCommand: java.lang.NullPointerException
  785. at com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.createStoragePool(LibvirtStorageAdaptor.java:462)
  786. at com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.getStoragePoolByURI(LibvirtStorageAdaptor.java:745)
  787. at com.cloud.hypervisor.kvm.storage.KVMStoragePoolManager.getStoragePoolByURI(KVMStoragePoolManager.java:52)
  788. at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:2017)
  789. at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1009)
  790. at com.cloud.agent.Agent.processRequest(Agent.java:518)
  791. at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:831)
  792. at com.cloud.utils.nio.Task.run(Task.java:83)
  793. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
  794. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
  795. at java.lang.Thread.run(Thread.java:679)
  796.  
  797. 2013-01-29 14:29:17,576 ERROR [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Failed to start instance VM[ConsoleProxy|v-32-VM]
  798. java.lang.ClassCastException: com.cloud.agent.api.Answer cannot be cast to com.cloud.agent.api.storage.PrimaryStorageDownloadAnswer
  799. at com.cloud.template.TemplateManagerImpl.prepareTemplateForCreate(TemplateManagerImpl.java:663)
  800. at com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34)
  801. at com.cloud.storage.StorageManagerImpl.createVolume(StorageManagerImpl.java:3442)
  802. at com.cloud.storage.StorageManagerImpl.prepare(StorageManagerImpl.java:3351)
  803. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:754)
  804. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:472)
  805. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:465)
  806. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.startProxy(ConsoleProxyManagerImpl.java:627)
  807. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.allocCapacity(ConsoleProxyManagerImpl.java:1164)
  808. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:1981)
  809. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:173)
  810. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:113)
  811. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:34)
  812. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:83)
  813. at com.cloud.vm.SystemVmLoadScanner$1.run(SystemVmLoadScanner.java:73)
  814. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  815. at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351)
  816. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178)
  817. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165)
  818. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267)
  819. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
  820. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
  821. at java.lang.Thread.run(Thread.java:679)
  822. 2013-01-29 14:29:17,590 DEBUG [cloud.storage.StorageManagerImpl] (secstorage-1:null) Creating volume: Vol[204|vm=202|ROOT]
  823. 2013-01-29 14:29:17,591 DEBUG [cloud.storage.StorageManagerImpl] (secstorage-1:null) Trying to create in Pool[204|NetworkFilesystem]
  824. 2013-01-29 14:29:17,640 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Cleaning up resources for the vm VM[ConsoleProxy|v-32-VM] in Starting state
  825. 2013-01-29 14:29:17,641 DEBUG [agent.transport.Request] (consoleproxy-1:null) Seq 7-2090140034: Sending { Cmd , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 100111, [{"StopCommand":{"isProxy":false,"vmName":"v-32-VM","wait":0}}] }
  826. 2013-01-29 14:29:17,743 DEBUG [cloud.template.TemplateManagerImpl] (secstorage-1:null) Downloading 3 via 7
  827. 2013-01-29 14:29:17,745 DEBUG [agent.transport.Request] (secstorage-1:null) Seq 7-2090140035: Waiting for Seq 2090140034 Scheduling: { Cmd , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 100111, [{"storage.PrimaryStorageDownloadCommand":{"localPath":"/mnt/99898908-d913-39c8-b61d-c7e6b6dbd8f0","poolUuid":"99898908-d913-39c8-b61d-c7e6b6dbd8f0","poolId":204,"secondaryStorageUrl":"nfs://cloudmanager.mira.dk/export/mirazone","primaryStorageUrl":"nfs://10.212.212.249/export/drbd10","url":"nfs://cloudmanager.mira.dk/export/mirazone/template/tmpl/1/3/","format":"QCOW2","accountId":1,"name":"routing-3","wait":10800}}] }
  828. 2013-01-29 14:29:17,750 DEBUG [agent.transport.Request] (AgentManager-Handler-7:null) Seq 7-2090140034: Processing: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, [{"StopAnswer":{"vncPort":0,"result":true,"wait":0}}] }
  829. 2013-01-29 14:29:17,750 DEBUG [agent.manager.AgentAttache] (AgentManager-Handler-7:null) Seq 7-2090140035: Sending now. is current sequence.
  830. 2013-01-29 14:29:17,750 DEBUG [agent.transport.Request] (consoleproxy-1:null) Seq 7-2090140034: Received: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, { StopAnswer } }
  831. 2013-01-29 14:29:17,792 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Service SecurityGroup is not supported in the network id=222
  832. 2013-01-29 14:29:17,882 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VirtualRouter to release Nic[59-32-185d0935-8aa8-42a8-a683-1020f9373f55-212.70.6.202]
  833. 2013-01-29 14:29:17,883 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking Ovs to release Nic[59-32-185d0935-8aa8-42a8-a683-1020f9373f55-212.70.6.202]
  834. 2013-01-29 14:29:17,883 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking ExternalDhcpServer to release Nic[59-32-185d0935-8aa8-42a8-a683-1020f9373f55-212.70.6.202]
  835. 2013-01-29 14:29:17,883 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking BareMetal to release Nic[59-32-185d0935-8aa8-42a8-a683-1020f9373f55-212.70.6.202]
  836. 2013-01-29 14:29:17,883 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking SecurityGroupProvider to release Nic[59-32-185d0935-8aa8-42a8-a683-1020f9373f55-212.70.6.202]
  837. 2013-01-29 14:29:17,883 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VpcVirtualRouter to release Nic[59-32-185d0935-8aa8-42a8-a683-1020f9373f55-212.70.6.202]
  838. 2013-01-29 14:29:17,883 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking NiciraNvp to release Nic[59-32-185d0935-8aa8-42a8-a683-1020f9373f55-212.70.6.202]
  839. 2013-01-29 14:29:17,992 DEBUG [network.guru.ControlNetworkGuru] (consoleproxy-1:null) Released nic: NicProfile[60-32-null-null-null
  840. 2013-01-29 14:29:18,050 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VirtualRouter to release Nic[60-32-185d0935-8aa8-42a8-a683-1020f9373f55-null]
  841. 2013-01-29 14:29:18,050 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking Ovs to release Nic[60-32-185d0935-8aa8-42a8-a683-1020f9373f55-null]
  842. 2013-01-29 14:29:18,050 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking ExternalDhcpServer to release Nic[60-32-185d0935-8aa8-42a8-a683-1020f9373f55-null]
  843. 2013-01-29 14:29:18,050 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking BareMetal to release Nic[60-32-185d0935-8aa8-42a8-a683-1020f9373f55-null]
  844. 2013-01-29 14:29:18,050 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking SecurityGroupProvider to release Nic[60-32-185d0935-8aa8-42a8-a683-1020f9373f55-null]
  845. 2013-01-29 14:29:18,050 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VpcVirtualRouter to release Nic[60-32-185d0935-8aa8-42a8-a683-1020f9373f55-null]
  846. 2013-01-29 14:29:18,050 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking NiciraNvp to release Nic[60-32-185d0935-8aa8-42a8-a683-1020f9373f55-null]
  847. 2013-01-29 14:29:18,093 DEBUG [dc.dao.DataCenterIpAddressDaoImpl] (consoleproxy-1:null) Releasing ip address for reservationId=185d0935-8aa8-42a8-a683-1020f9373f55, instance=61
  848. 2013-01-29 14:29:18,142 DEBUG [network.guru.PodBasedNetworkGuru] (consoleproxy-1:null) Released nic: NicProfile[61-32-null-null-null
  849. 2013-01-29 14:29:18,184 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VirtualRouter to release Nic[61-32-185d0935-8aa8-42a8-a683-1020f9373f55-null]
  850. 2013-01-29 14:29:18,184 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking Ovs to release Nic[61-32-185d0935-8aa8-42a8-a683-1020f9373f55-null]
  851. 2013-01-29 14:29:18,184 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking ExternalDhcpServer to release Nic[61-32-185d0935-8aa8-42a8-a683-1020f9373f55-null]
  852. 2013-01-29 14:29:18,184 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking BareMetal to release Nic[61-32-185d0935-8aa8-42a8-a683-1020f9373f55-null]
  853. 2013-01-29 14:29:18,184 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking SecurityGroupProvider to release Nic[61-32-185d0935-8aa8-42a8-a683-1020f9373f55-null]
  854. 2013-01-29 14:29:18,184 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VpcVirtualRouter to release Nic[61-32-185d0935-8aa8-42a8-a683-1020f9373f55-null]
  855. 2013-01-29 14:29:18,184 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking NiciraNvp to release Nic[61-32-185d0935-8aa8-42a8-a683-1020f9373f55-null]
  856. 2013-01-29 14:29:18,184 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Successfully released network resources for the vm VM[ConsoleProxy|v-32-VM]
  857. 2013-01-29 14:29:18,184 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Successfully cleanued up resources for the vm VM[ConsoleProxy|v-32-VM] in Starting state
  858. 2013-01-29 14:29:18,278 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: 7
  859. 2013-01-29 14:29:18,280 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) Hosts's actual total CPU: 12004 and CPU after applying overprovisioning: 12004
  860. 2013-01-29 14:29:18,280 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) release cpu from host: 7, old used: 1000,reserved: 0, actual total: 12004, total with overprovisioning: 12004; new used: 500,reserved:0; movedfromreserved: false,moveToReserveredfalse
  861. 2013-01-29 14:29:18,280 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) release mem from host: 7, old used: 1342177280,reserved: 0, total: 8269606912; new used: 268435456,reserved:0; movedfromreserved: false,moveToReserveredfalse
  862. 2013-01-29 14:29:18,326 WARN [cloud.consoleproxy.ConsoleProxyManagerImpl] (consoleproxy-1:null) Exception while trying to start console proxy
  863. com.cloud.exception.AgentUnavailableException: Resource [Host:7] is unreachable: Host 7: Unable to start instance due to com.cloud.agent.api.Answer cannot be cast to com.cloud.agent.api.storage.PrimaryStorageDownloadAnswer
  864. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:847)
  865. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:472)
  866. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:465)
  867. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.startProxy(ConsoleProxyManagerImpl.java:627)
  868. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.allocCapacity(ConsoleProxyManagerImpl.java:1164)
  869. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:1981)
  870. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:173)
  871. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:113)
  872. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:34)
  873. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:83)
  874. at com.cloud.vm.SystemVmLoadScanner$1.run(SystemVmLoadScanner.java:73)
  875. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  876. at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351)
  877. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178)
  878. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165)
  879. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267)
  880. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
  881. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
  882. at java.lang.Thread.run(Thread.java:679)
  883. Caused by: java.lang.ClassCastException: com.cloud.agent.api.Answer cannot be cast to com.cloud.agent.api.storage.PrimaryStorageDownloadAnswer
  884. at com.cloud.template.TemplateManagerImpl.prepareTemplateForCreate(TemplateManagerImpl.java:663)
  885. at com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34)
  886. at com.cloud.storage.StorageManagerImpl.createVolume(StorageManagerImpl.java:3442)
  887. at com.cloud.storage.StorageManagerImpl.prepare(StorageManagerImpl.java:3351)
  888. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:754)
  889. ... 19 more
  890. 2013-01-29 14:29:19,148 DEBUG [agent.transport.Request] (AgentManager-Handler-1:null) Seq 7-2090140035: Processing: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, [{"Answer":{"result":false,"details":"java.lang.NullPointerException\n\tat com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.createStoragePool(LibvirtStorageAdaptor.java:462)\n\tat com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.getStoragePoolByURI(LibvirtStorageAdaptor.java:745)\n\tat com.cloud.hypervisor.kvm.storage.KVMStoragePoolManager.getStoragePoolByURI(KVMStoragePoolManager.java:52)\n\tat com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:2017)\n\tat com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1009)\n\tat com.cloud.agent.Agent.processRequest(Agent.java:518)\n\tat com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:831)\n\tat com.cloud.utils.nio.Task.run(Task.java:83)\n\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)\n\tat java.lang.Thread.run(Thread.java:679)\n","wait":0}}] }
  891. 2013-01-29 14:29:19,148 DEBUG [agent.manager.AgentAttache] (AgentManager-Handler-1:null) Seq 7-2090140035: No more commands found
  892. 2013-01-29 14:29:19,148 DEBUG [agent.transport.Request] (secstorage-1:null) Seq 7-2090140035: Received: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, { Answer } }
  893. 2013-01-29 14:29:19,148 DEBUG [agent.manager.AgentManagerImpl] (secstorage-1:null) Details from executing class com.cloud.agent.api.storage.PrimaryStorageDownloadCommand: java.lang.NullPointerException
  894. at com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.createStoragePool(LibvirtStorageAdaptor.java:462)
  895. at com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.getStoragePoolByURI(LibvirtStorageAdaptor.java:745)
  896. at com.cloud.hypervisor.kvm.storage.KVMStoragePoolManager.getStoragePoolByURI(KVMStoragePoolManager.java:52)
  897. at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:2017)
  898. at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1009)
  899. at com.cloud.agent.Agent.processRequest(Agent.java:518)
  900. at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:831)
  901. at com.cloud.utils.nio.Task.run(Task.java:83)
  902. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
  903. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
  904. at java.lang.Thread.run(Thread.java:679)
  905.  
  906. 2013-01-29 14:29:19,149 ERROR [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Failed to start instance VM[SecondaryStorageVm|s-202-VM]
  907. java.lang.ClassCastException: com.cloud.agent.api.Answer cannot be cast to com.cloud.agent.api.storage.PrimaryStorageDownloadAnswer
  908. at com.cloud.template.TemplateManagerImpl.prepareTemplateForCreate(TemplateManagerImpl.java:663)
  909. at com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34)
  910. at com.cloud.storage.StorageManagerImpl.createVolume(StorageManagerImpl.java:3442)
  911. at com.cloud.storage.StorageManagerImpl.prepare(StorageManagerImpl.java:3351)
  912. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:754)
  913. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:472)
  914. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:465)
  915. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.startSecStorageVm(SecondaryStorageManagerImpl.java:257)
  916. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.allocCapacity(SecondaryStorageManagerImpl.java:684)
  917. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.expandPool(SecondaryStorageManagerImpl.java:1310)
  918. at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:119)
  919. at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:50)
  920. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:106)
  921. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:34)
  922. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:83)
  923. at com.cloud.vm.SystemVmLoadScanner$1.run(SystemVmLoadScanner.java:73)
  924. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  925. at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351)
  926. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178)
  927. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165)
  928. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267)
  929. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
  930. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
  931. at java.lang.Thread.run(Thread.java:679)
  932. 2013-01-29 14:29:19,203 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Cleaning up resources for the vm VM[SecondaryStorageVm|s-202-VM] in Starting state
  933. 2013-01-29 14:29:19,204 DEBUG [agent.transport.Request] (secstorage-1:null) Seq 7-2090140036: Sending { Cmd , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 100111, [{"StopCommand":{"isProxy":false,"vmName":"s-202-VM","wait":0}}] }
  934. 2013-01-29 14:29:19,299 DEBUG [agent.transport.Request] (AgentManager-Handler-5:null) Seq 7-2090140036: Processing: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, [{"StopAnswer":{"vncPort":0,"result":true,"wait":0}}] }
  935. 2013-01-29 14:29:19,299 DEBUG [agent.manager.AgentAttache] (AgentManager-Handler-5:null) Seq 7-2090140036: No more commands found
  936. 2013-01-29 14:29:19,299 DEBUG [agent.transport.Request] (secstorage-1:null) Seq 7-2090140036: Received: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, { StopAnswer } }
  937. 2013-01-29 14:29:19,371 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Service SecurityGroup is not supported in the network id=222
  938. 2013-01-29 14:29:19,533 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to release Nic[738-202-4076d570-7e80-48eb-bc20-b2429f79956a-212.70.6.205]
  939. 2013-01-29 14:29:19,533 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to release Nic[738-202-4076d570-7e80-48eb-bc20-b2429f79956a-212.70.6.205]
  940. 2013-01-29 14:29:19,533 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to release Nic[738-202-4076d570-7e80-48eb-bc20-b2429f79956a-212.70.6.205]
  941. 2013-01-29 14:29:19,533 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to release Nic[738-202-4076d570-7e80-48eb-bc20-b2429f79956a-212.70.6.205]
  942. 2013-01-29 14:29:19,533 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to release Nic[738-202-4076d570-7e80-48eb-bc20-b2429f79956a-212.70.6.205]
  943. 2013-01-29 14:29:19,533 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to release Nic[738-202-4076d570-7e80-48eb-bc20-b2429f79956a-212.70.6.205]
  944. 2013-01-29 14:29:19,533 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to release Nic[738-202-4076d570-7e80-48eb-bc20-b2429f79956a-212.70.6.205]
  945. 2013-01-29 14:29:20,032 DEBUG [network.guru.ControlNetworkGuru] (secstorage-1:null) Released nic: NicProfile[739-202-null-null-null
  946. 2013-01-29 14:29:20,113 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to release Nic[739-202-4076d570-7e80-48eb-bc20-b2429f79956a-null]
  947. 2013-01-29 14:29:20,113 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to release Nic[739-202-4076d570-7e80-48eb-bc20-b2429f79956a-null]
  948. 2013-01-29 14:29:20,113 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to release Nic[739-202-4076d570-7e80-48eb-bc20-b2429f79956a-null]
  949. 2013-01-29 14:29:20,113 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to release Nic[739-202-4076d570-7e80-48eb-bc20-b2429f79956a-null]
  950. 2013-01-29 14:29:20,113 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to release Nic[739-202-4076d570-7e80-48eb-bc20-b2429f79956a-null]
  951. 2013-01-29 14:29:20,113 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to release Nic[739-202-4076d570-7e80-48eb-bc20-b2429f79956a-null]
  952. 2013-01-29 14:29:20,113 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to release Nic[739-202-4076d570-7e80-48eb-bc20-b2429f79956a-null]
  953. 2013-01-29 14:29:20,201 DEBUG [dc.dao.DataCenterIpAddressDaoImpl] (secstorage-1:null) Releasing ip address for reservationId=4076d570-7e80-48eb-bc20-b2429f79956a, instance=740
  954. 2013-01-29 14:29:20,339 DEBUG [network.guru.PodBasedNetworkGuru] (secstorage-1:null) Released nic: NicProfile[740-202-null-null-null
  955. 2013-01-29 14:29:20,460 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to release Nic[740-202-4076d570-7e80-48eb-bc20-b2429f79956a-null]
  956. 2013-01-29 14:29:20,460 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to release Nic[740-202-4076d570-7e80-48eb-bc20-b2429f79956a-null]
  957. 2013-01-29 14:29:20,460 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to release Nic[740-202-4076d570-7e80-48eb-bc20-b2429f79956a-null]
  958. 2013-01-29 14:29:20,460 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to release Nic[740-202-4076d570-7e80-48eb-bc20-b2429f79956a-null]
  959. 2013-01-29 14:29:20,460 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to release Nic[740-202-4076d570-7e80-48eb-bc20-b2429f79956a-null]
  960. 2013-01-29 14:29:20,460 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to release Nic[740-202-4076d570-7e80-48eb-bc20-b2429f79956a-null]
  961. 2013-01-29 14:29:20,460 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to release Nic[740-202-4076d570-7e80-48eb-bc20-b2429f79956a-null]
  962. 2013-01-29 14:29:20,547 DEBUG [dc.dao.DataCenterIpAddressDaoImpl] (secstorage-1:null) Releasing ip address for reservationId=4076d570-7e80-48eb-bc20-b2429f79956a, instance=741
  963. 2013-01-29 14:29:20,598 DEBUG [network.guru.PodBasedNetworkGuru] (secstorage-1:null) Released nic: NicProfile[741-202-null-null-null
  964. 2013-01-29 14:29:20,656 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to release Nic[741-202-4076d570-7e80-48eb-bc20-b2429f79956a-null]
  965. 2013-01-29 14:29:20,656 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to release Nic[741-202-4076d570-7e80-48eb-bc20-b2429f79956a-null]
  966. 2013-01-29 14:29:20,656 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to release Nic[741-202-4076d570-7e80-48eb-bc20-b2429f79956a-null]
  967. 2013-01-29 14:29:20,656 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to release Nic[741-202-4076d570-7e80-48eb-bc20-b2429f79956a-null]
  968. 2013-01-29 14:29:20,656 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to release Nic[741-202-4076d570-7e80-48eb-bc20-b2429f79956a-null]
  969. 2013-01-29 14:29:20,656 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to release Nic[741-202-4076d570-7e80-48eb-bc20-b2429f79956a-null]
  970. 2013-01-29 14:29:20,656 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to release Nic[741-202-4076d570-7e80-48eb-bc20-b2429f79956a-null]
  971. 2013-01-29 14:29:20,657 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Successfully released network resources for the vm VM[SecondaryStorageVm|s-202-VM]
  972. 2013-01-29 14:29:20,657 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Successfully cleanued up resources for the vm VM[SecondaryStorageVm|s-202-VM] in Starting state
  973. 2013-01-29 14:29:20,765 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: 7
  974. 2013-01-29 14:29:20,767 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) Hosts's actual total CPU: 12004 and CPU after applying overprovisioning: 12004
  975. 2013-01-29 14:29:20,767 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) release cpu from host: 7, old used: 500,reserved: 0, actual total: 12004, total with overprovisioning: 12004; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  976. 2013-01-29 14:29:20,767 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) release mem from host: 7, old used: 268435456,reserved: 0, total: 8269606912; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  977. 2013-01-29 14:29:20,840 WARN [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Exception while trying to start secondary storage vm
  978. com.cloud.exception.AgentUnavailableException: Resource [Host:7] is unreachable: Host 7: Unable to start instance due to com.cloud.agent.api.Answer cannot be cast to com.cloud.agent.api.storage.PrimaryStorageDownloadAnswer
  979. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:847)
  980. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:472)
  981. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:465)
  982. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.startSecStorageVm(SecondaryStorageManagerImpl.java:257)
  983. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.allocCapacity(SecondaryStorageManagerImpl.java:684)
  984. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.expandPool(SecondaryStorageManagerImpl.java:1310)
  985. at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:119)
  986. at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:50)
  987. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:106)
  988. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:34)
  989. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:83)
  990. at com.cloud.vm.SystemVmLoadScanner$1.run(SystemVmLoadScanner.java:73)
  991. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  992. at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351)
  993. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178)
  994. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165)
  995. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267)
  996. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
  997. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
  998. at java.lang.Thread.run(Thread.java:679)
  999. Caused by: java.lang.ClassCastException: com.cloud.agent.api.Answer cannot be cast to com.cloud.agent.api.storage.PrimaryStorageDownloadAnswer
  1000. at com.cloud.template.TemplateManagerImpl.prepareTemplateForCreate(TemplateManagerImpl.java:663)
  1001. at com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34)
  1002. at com.cloud.storage.StorageManagerImpl.createVolume(StorageManagerImpl.java:3442)
  1003. at com.cloud.storage.StorageManagerImpl.prepare(StorageManagerImpl.java:3351)
  1004. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:754)
  1005. ... 20 more
  1006. 2013-01-29 14:29:20,841 INFO [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Unable to start secondary storage vm for standby capacity, secStorageVm vm Id : 202, will recycle it and start a new one
  1007. 2013-01-29 14:29:20,841 INFO [cloud.secstorage.PremiumSecondaryStorageManagerImpl] (secstorage-1:null) Primary secondary storage is not even started, wait until next turn
  1008. 2013-01-29 14:29:25,156 DEBUG [cloud.alert.AlertManagerImpl] (CapacityChecker:null) Running Capacity Checker ...
  1009. 2013-01-29 14:29:25,156 DEBUG [cloud.alert.AlertManagerImpl] (CapacityChecker:null) recalculating system capacity
  1010. 2013-01-29 14:29:25,156 DEBUG [cloud.alert.AlertManagerImpl] (CapacityChecker:null) Executing cpu/ram capacity update
  1011. 2013-01-29 14:29:25,162 DEBUG [cloud.capacity.CapacityManagerImpl] (CapacityChecker:null) Found 6 VMs on host 1
  1012. 2013-01-29 14:29:25,164 DEBUG [cloud.capacity.CapacityManagerImpl] (CapacityChecker:null) Found 2 VM, not running on host 1
  1013. 2013-01-29 14:29:25,166 DEBUG [cloud.capacity.CapacityManagerImpl] (CapacityChecker:null) No need to calibrate cpu capacity, host:1 usedCpu: 7000 reservedCpu: 1000
  1014. 2013-01-29 14:29:25,166 DEBUG [cloud.capacity.CapacityManagerImpl] (CapacityChecker:null) No need to calibrate memory capacity, host:1 usedMem: 11072962560 reservedMem: 268435456
  1015. 2013-01-29 14:29:25,169 DEBUG [cloud.capacity.CapacityManagerImpl] (CapacityChecker:null) Found 2 VMs on host 4
  1016. 2013-01-29 14:29:25,171 DEBUG [cloud.capacity.CapacityManagerImpl] (CapacityChecker:null) Found 1 VM, not running on host 4
  1017. 2013-01-29 14:29:25,172 DEBUG [cloud.capacity.CapacityManagerImpl] (CapacityChecker:null) Calibrate reserved cpu for host: 4 old reservedCpu:1025 new reservedCpu:0
  1018. 2013-01-29 14:29:25,172 DEBUG [cloud.capacity.CapacityManagerImpl] (CapacityChecker:null) Calibrate reserved memory for host: 4 old reservedMem:1073741824 new reservedMem:0
  1019. 2013-01-29 14:29:25,283 DEBUG [cloud.capacity.CapacityManagerImpl] (CapacityChecker:null) Found 0 VMs on host 7
  1020. 2013-01-29 14:29:25,284 DEBUG [cloud.capacity.CapacityManagerImpl] (CapacityChecker:null) Found 0 VM, not running on host 7
  1021. 2013-01-29 14:29:25,285 DEBUG [cloud.capacity.CapacityManagerImpl] (CapacityChecker:null) No need to calibrate cpu capacity, host:7 usedCpu: 0 reservedCpu: 0
  1022. 2013-01-29 14:29:25,285 DEBUG [cloud.capacity.CapacityManagerImpl] (CapacityChecker:null) No need to calibrate memory capacity, host:7 usedMem: 0 reservedMem: 0
  1023. 2013-01-29 14:29:25,285 DEBUG [cloud.alert.AlertManagerImpl] (CapacityChecker:null) Done executing cpu/ram capacity update
  1024. 2013-01-29 14:29:25,285 DEBUG [cloud.alert.AlertManagerImpl] (CapacityChecker:null) Executing storage capacity update
  1025. 2013-01-29 14:29:25,373 DEBUG [cloud.storage.StorageManagerImpl] (CapacityChecker:null) Successfully set Capacity - 999051755520 for capacity type - 3 , DataCenterId - 1, HostOrPoolId - 200, PodId 1
  1026. 2013-01-29 14:29:25,375 DEBUG [cloud.storage.StorageManagerImpl] (CapacityChecker:null) Successfully set Capacity - 3937899380736 for capacity type - 3 , DataCenterId - 3, HostOrPoolId - 204, PodId 3
  1027. 2013-01-29 14:29:25,375 DEBUG [cloud.alert.AlertManagerImpl] (CapacityChecker:null) Done executing storage capacity update
  1028. 2013-01-29 14:29:25,375 DEBUG [cloud.alert.AlertManagerImpl] (CapacityChecker:null) Executing capacity updates for public ip and Vlans
  1029. 2013-01-29 14:29:25,385 DEBUG [cloud.alert.AlertManagerImpl] (CapacityChecker:null) Done capacity updates for public ip and Vlans
  1030. 2013-01-29 14:29:25,385 DEBUG [cloud.alert.AlertManagerImpl] (CapacityChecker:null) Executing capacity updates for private ip
  1031. 2013-01-29 14:29:25,397 DEBUG [cloud.alert.AlertManagerImpl] (CapacityChecker:null) Done executing capacity updates for private ip
  1032. 2013-01-29 14:29:25,397 DEBUG [cloud.alert.AlertManagerImpl] (CapacityChecker:null) Done recalculating system capacity
  1033. 2013-01-29 14:29:25,414 DEBUG [cloud.alert.AlertManagerImpl] (CapacityChecker:null) Done running Capacity Checker ...
  1034. 2013-01-29 14:29:30,339 DEBUG [cloud.server.StatsCollector] (StatsCollector-2:null) HostStatsCollector is running...
  1035. 2013-01-29 14:29:30,929 DEBUG [agent.transport.Request] (StatsCollector-2:null) Seq 1-89030380: Received: { Ans: , MgmtId: 60908668245, via: 1, Ver: v1, Flags: 10, { GetHostStatsAnswer } }
  1036. 2013-01-29 14:29:31,504 DEBUG [agent.transport.Request] (StatsCollector-2:null) Seq 4-220941129: Received: { Ans: , MgmtId: 60908668245, via: 4, Ver: v1, Flags: 10, { GetHostStatsAnswer } }
  1037. 2013-01-29 14:29:32,060 DEBUG [agent.transport.Request] (StatsCollector-2:null) Seq 7-2090140037: Received: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 10, { GetHostStatsAnswer } }
  1038. 2013-01-29 14:29:45,898 DEBUG [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Zone 1 is ready to launch secondary storage VM
  1039. 2013-01-29 14:29:45,905 DEBUG [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Zone 3 is ready to launch secondary storage VM
  1040. 2013-01-29 14:29:45,908 INFO [cloud.secstorage.PremiumSecondaryStorageManagerImpl] (secstorage-1:null) No running secondary storage vms found in datacenter id=3, starting one
  1041. 2013-01-29 14:29:45,912 INFO [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Found a stopped secondary storage vm, bring it up to running pool. secStorageVm vm id : 202
  1042. 2013-01-29 14:29:45,916 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
  1043. 2013-01-29 14:29:45,916 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Successfully transitioned to start state for VM[SecondaryStorageVm|s-202-VM] reservation id = 6c395753-87a8-492f-ae56-deda1cb6f970
  1044. 2013-01-29 14:29:45,977 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Trying to deploy VM, vm has dcId: 3 and podId: 3
  1045. 2013-01-29 14:29:45,977 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Deploy avoids pods: null, clusters: null, hosts: null
  1046. 2013-01-29 14:29:45,978 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) DeploymentPlanner allocation algorithm: random
  1047. 2013-01-29 14:29:45,978 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Trying to allocate a host and storage pools from dc:3, pod:3,cluster:null, requested cpu: 500, requested ram: 268435456
  1048. 2013-01-29 14:29:45,978 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Is ROOT volume READY (pool already allocated)?: No
  1049. 2013-01-29 14:29:45,979 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Searching resources only under specified Pod: 3
  1050. 2013-01-29 14:29:45,979 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Pod: 3
  1051. 2013-01-29 14:29:45,979 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) CPUOverprovisioningFactor considered: 1.0
  1052. 2013-01-29 14:29:45,983 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Checking resources in Cluster: 3 under Pod: 3
  1053. 2013-01-29 14:29:45,983 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Calling HostAllocators to find suitable hosts
  1054. 2013-01-29 14:29:45,983 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) Looking for hosts in dc: 3 pod:3 cluster:3
  1055. 2013-01-29 14:29:45,984 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) FirstFitAllocator has 1 hosts to check for allocation: [Host[-7-Routing]]
  1056. 2013-01-29 14:29:45,985 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) Found 1 hosts for allocation after prioritization: [Host[-7-Routing]]
  1057. 2013-01-29 14:29:45,985 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=256
  1058. 2013-01-29 14:29:45,985 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) Checking if host: 7 has enough capacity for requested CPU: 500 and requested RAM: 268435456 , cpuOverprovisioningFactor: 1.0
  1059. 2013-01-29 14:29:45,986 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) Hosts's actual total CPU: 12004 and CPU after applying overprovisioning: 12004
  1060. 2013-01-29 14:29:45,987 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) Free CPU: 12004 , Requested CPU: 500
  1061. 2013-01-29 14:29:45,987 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) Free RAM: 8269606912 , Requested RAM: 268435456
  1062. 2013-01-29 14:29:45,987 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) Host has enough CPU and RAM available
  1063. 2013-01-29 14:29:45,987 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 7, used: 0, reserved: 0, actual total: 12004, total with overprovisioning: 12004; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1064. 2013-01-29 14:29:45,987 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 7, used: 0, reserved: 0, total: 8269606912; requested mem: 268435456,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1065. 2013-01-29 14:29:45,987 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) Found a suitable host, adding to list: 7
  1066. 2013-01-29 14:29:45,987 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) Host Allocator returning 1 suitable hosts
  1067. 2013-01-29 14:29:45,987 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Checking suitable pools for volume (Id, Type): (204,ROOT)
  1068. 2013-01-29 14:29:45,987 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) We need to allocate new storagepool for this volume
  1069. 2013-01-29 14:29:45,987 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Calling StoragePoolAllocators to find suitable pools
  1070. 2013-01-29 14:29:45,988 DEBUG [storage.allocator.FirstFitStoragePoolAllocator] (secstorage-1:null) Looking for pools in dc: 3 pod:3 cluster:3
  1071. 2013-01-29 14:29:45,988 DEBUG [storage.allocator.FirstFitStoragePoolAllocator] (secstorage-1:null) FirstFitStoragePoolAllocator has 1 pools to check for allocation
  1072. 2013-01-29 14:29:45,988 DEBUG [storage.allocator.AbstractStoragePoolAllocator] (secstorage-1:null) Checking if storage pool is suitable, name: DRDB10 ,poolId: 204
  1073. 2013-01-29 14:29:45,988 DEBUG [storage.allocator.AbstractStoragePoolAllocator] (secstorage-1:null) Is localStorageAllocationNeeded? false
  1074. 2013-01-29 14:29:45,988 DEBUG [storage.allocator.AbstractStoragePoolAllocator] (secstorage-1:null) Is storage pool shared? true
  1075. 2013-01-29 14:29:45,989 DEBUG [cloud.storage.StorageManagerImpl] (secstorage-1:null) Checking pool 204 for storage, totalSize: 1968949690368, usedBytes: 204734464, usedPct: 1.039815618456634E-4, disable threshold: 0.85
  1076. 2013-01-29 14:29:45,997 DEBUG [cloud.storage.StorageManagerImpl] (secstorage-1:null) Checking pool: 204 for volume allocation [Vol[204|vm=202|ROOT]], maxSize : 3937899380736, totalAllocatedSize : 0, askingSize : 0, allocated disable threshold: 0.85
  1077. 2013-01-29 14:29:45,997 DEBUG [storage.allocator.FirstFitStoragePoolAllocator] (secstorage-1:null) FirstFitStoragePoolAllocator returning 1 suitable storage pools
  1078. 2013-01-29 14:29:45,997 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Trying to find a potenial host and associated storage pools from the suitable host/pool lists for this VM
  1079. 2013-01-29 14:29:45,997 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Checking if host: 7 can access any suitable storage pool for volume: ROOT
  1080. 2013-01-29 14:29:45,998 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Host: 7 can access pool: 204
  1081. 2013-01-29 14:29:45,998 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Found a potential host id: 7 name: mc1 and associated storage pools for this VM
  1082. 2013-01-29 14:29:45,998 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Returning Deployment Destination: Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(3)-Pod(3)-Cluster(3)-Host(7)-Storage(Volume(204|ROOT-->Pool(204))]
  1083. 2013-01-29 14:29:45,998 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Deployment found - P0=VM[SecondaryStorageVm|s-202-VM], P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(3)-Pod(3)-Cluster(3)-Host(7)-Storage(Volume(204|ROOT-->Pool(204))]
  1084. 2013-01-29 14:29:46,016 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl] (consoleproxy-1:null) Zone 1 is ready to launch console proxy
  1085. 2013-01-29 14:29:46,019 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl] (consoleproxy-1:null) Zone 3 is ready to launch console proxy
  1086. 2013-01-29 14:29:46,019 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl] (consoleproxy-1:null) Expand console proxy standby capacity for zone Mira
  1087. 2013-01-29 14:29:46,021 INFO [cloud.consoleproxy.ConsoleProxyManagerImpl] (consoleproxy-1:null) Found a stopped console proxy, bring it up to running pool. proxy vm id : 32
  1088. 2013-01-29 14:29:46,025 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
  1089. 2013-01-29 14:29:46,025 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Successfully transitioned to start state for VM[ConsoleProxy|v-32-VM] reservation id = fae333c1-5821-440f-ad29-f5ba10276b85
  1090. 2013-01-29 14:29:46,094 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Trying to deploy VM, vm has dcId: 3 and podId: 3
  1091. 2013-01-29 14:29:46,094 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Deploy avoids pods: null, clusters: null, hosts: null
  1092. 2013-01-29 14:29:46,095 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) DeploymentPlanner allocation algorithm: random
  1093. 2013-01-29 14:29:46,095 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Trying to allocate a host and storage pools from dc:3, pod:3,cluster:null, requested cpu: 500, requested ram: 1073741824
  1094. 2013-01-29 14:29:46,095 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Is ROOT volume READY (pool already allocated)?: No
  1095. 2013-01-29 14:29:46,095 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Searching resources only under specified Pod: 3
  1096. 2013-01-29 14:29:46,096 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Pod: 3
  1097. 2013-01-29 14:29:46,096 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) CPUOverprovisioningFactor considered: 1.0
  1098. 2013-01-29 14:29:46,100 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Checking resources in Cluster: 3 under Pod: 3
  1099. 2013-01-29 14:29:46,100 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Calling HostAllocators to find suitable hosts
  1100. 2013-01-29 14:29:46,100 DEBUG [allocator.impl.FirstFitAllocator] (consoleproxy-1:FirstFitRoutingAllocator) Looking for hosts in dc: 3 pod:3 cluster:3
  1101. 2013-01-29 14:29:46,101 DEBUG [allocator.impl.FirstFitAllocator] (consoleproxy-1:FirstFitRoutingAllocator) FirstFitAllocator has 1 hosts to check for allocation: [Host[-7-Routing]]
  1102. 2013-01-29 14:29:46,102 DEBUG [allocator.impl.FirstFitAllocator] (consoleproxy-1:FirstFitRoutingAllocator) Found 1 hosts for allocation after prioritization: [Host[-7-Routing]]
  1103. 2013-01-29 14:29:46,102 DEBUG [allocator.impl.FirstFitAllocator] (consoleproxy-1:FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=1024
  1104. 2013-01-29 14:29:46,103 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) Checking if host: 7 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  1105. 2013-01-29 14:29:46,104 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) Hosts's actual total CPU: 12004 and CPU after applying overprovisioning: 12004
  1106. 2013-01-29 14:29:46,104 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) Free CPU: 12004 , Requested CPU: 500
  1107. 2013-01-29 14:29:46,104 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) Free RAM: 8269606912 , Requested RAM: 1073741824
  1108. 2013-01-29 14:29:46,104 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) Host has enough CPU and RAM available
  1109. 2013-01-29 14:29:46,104 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 7, used: 0, reserved: 0, actual total: 12004, total with overprovisioning: 12004; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1110. 2013-01-29 14:29:46,104 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 7, used: 0, reserved: 0, total: 8269606912; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1111. 2013-01-29 14:29:46,104 DEBUG [allocator.impl.FirstFitAllocator] (consoleproxy-1:FirstFitRoutingAllocator) Found a suitable host, adding to list: 7
  1112. 2013-01-29 14:29:46,104 DEBUG [allocator.impl.FirstFitAllocator] (consoleproxy-1:FirstFitRoutingAllocator) Host Allocator returning 1 suitable hosts
  1113. 2013-01-29 14:29:46,105 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Checking suitable pools for volume (Id, Type): (34,ROOT)
  1114. 2013-01-29 14:29:46,105 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) We need to allocate new storagepool for this volume
  1115. 2013-01-29 14:29:46,105 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Calling StoragePoolAllocators to find suitable pools
  1116. 2013-01-29 14:29:46,105 DEBUG [storage.allocator.FirstFitStoragePoolAllocator] (consoleproxy-1:null) Looking for pools in dc: 3 pod:3 cluster:3
  1117. 2013-01-29 14:29:46,106 DEBUG [storage.allocator.FirstFitStoragePoolAllocator] (consoleproxy-1:null) FirstFitStoragePoolAllocator has 1 pools to check for allocation
  1118. 2013-01-29 14:29:46,106 DEBUG [storage.allocator.AbstractStoragePoolAllocator] (consoleproxy-1:null) Checking if storage pool is suitable, name: DRDB10 ,poolId: 204
  1119. 2013-01-29 14:29:46,106 DEBUG [storage.allocator.AbstractStoragePoolAllocator] (consoleproxy-1:null) Is localStorageAllocationNeeded? false
  1120. 2013-01-29 14:29:46,106 DEBUG [storage.allocator.AbstractStoragePoolAllocator] (consoleproxy-1:null) Is storage pool shared? true
  1121. 2013-01-29 14:29:46,107 DEBUG [cloud.storage.StorageManagerImpl] (consoleproxy-1:null) Checking pool 204 for storage, totalSize: 1968949690368, usedBytes: 204734464, usedPct: 1.039815618456634E-4, disable threshold: 0.85
  1122. 2013-01-29 14:29:46,109 DEBUG [cloud.storage.StorageManagerImpl] (consoleproxy-1:null) Checking pool: 204 for volume allocation [Vol[34|vm=32|ROOT]], maxSize : 3937899380736, totalAllocatedSize : 0, askingSize : 0, allocated disable threshold: 0.85
  1123. 2013-01-29 14:29:46,109 DEBUG [storage.allocator.FirstFitStoragePoolAllocator] (consoleproxy-1:null) FirstFitStoragePoolAllocator returning 1 suitable storage pools
  1124. 2013-01-29 14:29:46,109 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Trying to find a potenial host and associated storage pools from the suitable host/pool lists for this VM
  1125. 2013-01-29 14:29:46,109 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Checking if host: 7 can access any suitable storage pool for volume: ROOT
  1126. 2013-01-29 14:29:46,110 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Host: 7 can access pool: 204
  1127. 2013-01-29 14:29:46,110 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Found a potential host id: 7 name: mc1 and associated storage pools for this VM
  1128. 2013-01-29 14:29:46,110 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Returning Deployment Destination: Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(3)-Pod(3)-Cluster(3)-Host(7)-Storage(Volume(34|ROOT-->Pool(204))]
  1129. 2013-01-29 14:29:46,110 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Deployment found - P0=VM[ConsoleProxy|v-32-VM], P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(3)-Pod(3)-Cluster(3)-Host(7)-Storage(Volume(34|ROOT-->Pool(204))]
  1130. 2013-01-29 14:29:46,144 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) VM state transitted from :Starting to Starting with event: OperationRetryvm's original host id: null new host id: 7 host id before state transition: null
  1131. 2013-01-29 14:29:46,148 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) Hosts's actual total CPU: 12004 and CPU after applying overprovisioning: 12004
  1132. 2013-01-29 14:29:46,148 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) We are allocating VM, increasing the used capacity of this host:7
  1133. 2013-01-29 14:29:46,148 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) Current Used CPU: 0 , Free CPU:12004 ,Requested CPU: 500
  1134. 2013-01-29 14:29:46,148 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) Current Used RAM: 0 , Free RAM:8269606912 ,Requested RAM: 268435456
  1135. 2013-01-29 14:29:46,148 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) CPU STATS after allocation: for host: 7, old used: 0, old reserved: 0, actual total: 12004, total with overprovisioning: 12004; new used:500, reserved:0; requested cpu:500,alloc_from_last:false
  1136. 2013-01-29 14:29:46,148 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) RAM STATS after allocation: for host: 7, old used: 0, old reserved: 0, total: 8269606912; new used: 268435456, reserved: 0; requested mem: 268435456,alloc_from_last:false
  1137. 2013-01-29 14:29:46,236 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) VM is being created in podId: 3
  1138. 2013-01-29 14:29:46,238 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is acquired for network id 222 as a part of network implement
  1139. 2013-01-29 14:29:46,238 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Network id=222 is already implemented
  1140. 2013-01-29 14:29:46,238 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is released for network id 222 as a part of network implement
  1141. 2013-01-29 14:29:46,278 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) VM state transitted from :Starting to Starting with event: OperationRetryvm's original host id: null new host id: 7 host id before state transition: null
  1142. 2013-01-29 14:29:46,282 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) Hosts's actual total CPU: 12004 and CPU after applying overprovisioning: 12004
  1143. 2013-01-29 14:29:46,282 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) We are allocating VM, increasing the used capacity of this host:7
  1144. 2013-01-29 14:29:46,282 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) Current Used CPU: 500 , Free CPU:11504 ,Requested CPU: 500
  1145. 2013-01-29 14:29:46,282 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) Current Used RAM: 268435456 , Free RAM:8001171456 ,Requested RAM: 1073741824
  1146. 2013-01-29 14:29:46,282 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) CPU STATS after allocation: for host: 7, old used: 500, old reserved: 0, actual total: 12004, total with overprovisioning: 12004; new used:1000, reserved:0; requested cpu:500,alloc_from_last:false
  1147. 2013-01-29 14:29:46,282 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) RAM STATS after allocation: for host: 7, old used: 268435456, old reserved: 0, total: 8269606912; new used: 1342177280, reserved: 0; requested mem: 1073741824,alloc_from_last:false
  1148. 2013-01-29 14:29:46,320 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Service SecurityGroup is not supported in the network id=222
  1149. 2013-01-29 14:29:46,378 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) VM is being created in podId: 3
  1150. 2013-01-29 14:29:46,381 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Lock is acquired for network id 222 as a part of network implement
  1151. 2013-01-29 14:29:46,381 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Network id=222 is already implemented
  1152. 2013-01-29 14:29:46,381 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Lock is released for network id 222 as a part of network implement
  1153. 2013-01-29 14:29:46,428 DEBUG [network.router.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:null) Found 5 routers.
  1154. 2013-01-29 14:29:46,437 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to prepare for Nic[738-202-6c395753-87a8-492f-ae56-deda1cb6f970-212.70.6.205]
  1155. 2013-01-29 14:29:46,437 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to prepare for Nic[738-202-6c395753-87a8-492f-ae56-deda1cb6f970-212.70.6.205]
  1156. 2013-01-29 14:29:46,438 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to prepare for Nic[738-202-6c395753-87a8-492f-ae56-deda1cb6f970-212.70.6.205]
  1157. 2013-01-29 14:29:46,438 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to prepare for Nic[738-202-6c395753-87a8-492f-ae56-deda1cb6f970-212.70.6.205]
  1158. 2013-01-29 14:29:46,438 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to prepare for Nic[738-202-6c395753-87a8-492f-ae56-deda1cb6f970-212.70.6.205]
  1159. 2013-01-29 14:29:46,438 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to prepare for Nic[738-202-6c395753-87a8-492f-ae56-deda1cb6f970-212.70.6.205]
  1160. 2013-01-29 14:29:46,438 WARN [network.element.VpcVirtualRouterElement] (secstorage-1:null) Network Ntwk[222|Guest|7] is not associated with any VPC
  1161. 2013-01-29 14:29:46,438 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to prepare for Nic[738-202-6c395753-87a8-492f-ae56-deda1cb6f970-212.70.6.205]
  1162. 2013-01-29 14:29:46,438 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Service SecurityGroup is not supported in the network id=222
  1163. 2013-01-29 14:29:46,439 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is acquired for network id 220 as a part of network implement
  1164. 2013-01-29 14:29:46,439 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Network id=220 is already implemented
  1165. 2013-01-29 14:29:46,440 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is released for network id 220 as a part of network implement
  1166. 2013-01-29 14:29:46,496 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Service SecurityGroup is not supported in the network id=222
  1167. 2013-01-29 14:29:46,597 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VirtualRouter to prepare for Nic[59-32-fae333c1-5821-440f-ad29-f5ba10276b85-212.70.6.202]
  1168. 2013-01-29 14:29:46,597 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking Ovs to prepare for Nic[59-32-fae333c1-5821-440f-ad29-f5ba10276b85-212.70.6.202]
  1169. 2013-01-29 14:29:46,597 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking ExternalDhcpServer to prepare for Nic[59-32-fae333c1-5821-440f-ad29-f5ba10276b85-212.70.6.202]
  1170. 2013-01-29 14:29:46,597 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking BareMetal to prepare for Nic[59-32-fae333c1-5821-440f-ad29-f5ba10276b85-212.70.6.202]
  1171. 2013-01-29 14:29:46,597 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking SecurityGroupProvider to prepare for Nic[59-32-fae333c1-5821-440f-ad29-f5ba10276b85-212.70.6.202]
  1172. 2013-01-29 14:29:46,597 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VpcVirtualRouter to prepare for Nic[59-32-fae333c1-5821-440f-ad29-f5ba10276b85-212.70.6.202]
  1173. 2013-01-29 14:29:46,597 WARN [network.element.VpcVirtualRouterElement] (consoleproxy-1:null) Network Ntwk[222|Guest|7] is not associated with any VPC
  1174. 2013-01-29 14:29:46,597 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking NiciraNvp to prepare for Nic[59-32-fae333c1-5821-440f-ad29-f5ba10276b85-212.70.6.202]
  1175. 2013-01-29 14:29:46,597 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Service SecurityGroup is not supported in the network id=222
  1176. 2013-01-29 14:29:46,598 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Lock is acquired for network id 220 as a part of network implement
  1177. 2013-01-29 14:29:46,598 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Network id=220 is already implemented
  1178. 2013-01-29 14:29:46,599 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Lock is released for network id 220 as a part of network implement
  1179. 2013-01-29 14:29:46,755 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to prepare for Nic[739-202-6c395753-87a8-492f-ae56-deda1cb6f970-169.254.0.117]
  1180. 2013-01-29 14:29:46,755 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to prepare for Nic[739-202-6c395753-87a8-492f-ae56-deda1cb6f970-169.254.0.117]
  1181. 2013-01-29 14:29:46,755 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to prepare for Nic[739-202-6c395753-87a8-492f-ae56-deda1cb6f970-169.254.0.117]
  1182. 2013-01-29 14:29:46,755 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to prepare for Nic[739-202-6c395753-87a8-492f-ae56-deda1cb6f970-169.254.0.117]
  1183. 2013-01-29 14:29:46,755 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to prepare for Nic[739-202-6c395753-87a8-492f-ae56-deda1cb6f970-169.254.0.117]
  1184. 2013-01-29 14:29:46,755 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to prepare for Nic[739-202-6c395753-87a8-492f-ae56-deda1cb6f970-169.254.0.117]
  1185. 2013-01-29 14:29:46,755 WARN [network.element.VpcVirtualRouterElement] (secstorage-1:null) Network Ntwk[220|Control|3] is not associated with any VPC
  1186. 2013-01-29 14:29:46,755 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to prepare for Nic[739-202-6c395753-87a8-492f-ae56-deda1cb6f970-169.254.0.117]
  1187. 2013-01-29 14:29:46,756 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is acquired for network id 219 as a part of network implement
  1188. 2013-01-29 14:29:46,756 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Network id=219 is already implemented
  1189. 2013-01-29 14:29:46,756 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is released for network id 219 as a part of network implement
  1190. 2013-01-29 14:29:46,906 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VirtualRouter to prepare for Nic[60-32-fae333c1-5821-440f-ad29-f5ba10276b85-169.254.2.115]
  1191. 2013-01-29 14:29:46,906 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking Ovs to prepare for Nic[60-32-fae333c1-5821-440f-ad29-f5ba10276b85-169.254.2.115]
  1192. 2013-01-29 14:29:46,906 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking ExternalDhcpServer to prepare for Nic[60-32-fae333c1-5821-440f-ad29-f5ba10276b85-169.254.2.115]
  1193. 2013-01-29 14:29:46,906 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking BareMetal to prepare for Nic[60-32-fae333c1-5821-440f-ad29-f5ba10276b85-169.254.2.115]
  1194. 2013-01-29 14:29:46,906 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking SecurityGroupProvider to prepare for Nic[60-32-fae333c1-5821-440f-ad29-f5ba10276b85-169.254.2.115]
  1195. 2013-01-29 14:29:46,906 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VpcVirtualRouter to prepare for Nic[60-32-fae333c1-5821-440f-ad29-f5ba10276b85-169.254.2.115]
  1196. 2013-01-29 14:29:46,906 WARN [network.element.VpcVirtualRouterElement] (consoleproxy-1:null) Network Ntwk[220|Control|3] is not associated with any VPC
  1197. 2013-01-29 14:29:46,906 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking NiciraNvp to prepare for Nic[60-32-fae333c1-5821-440f-ad29-f5ba10276b85-169.254.2.115]
  1198. 2013-01-29 14:29:46,907 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Lock is acquired for network id 219 as a part of network implement
  1199. 2013-01-29 14:29:46,907 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Network id=219 is already implemented
  1200. 2013-01-29 14:29:46,907 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Lock is released for network id 219 as a part of network implement
  1201. 2013-01-29 14:29:46,956 DEBUG [network.guru.PodBasedNetworkGuru] (secstorage-1:null) Allocated a nic NicProfile[740-202-6c395753-87a8-492f-ae56-deda1cb6f970-212.70.6.89-null for VM[SecondaryStorageVm|s-202-VM]
  1202. 2013-01-29 14:29:47,040 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to prepare for Nic[740-202-6c395753-87a8-492f-ae56-deda1cb6f970-212.70.6.89]
  1203. 2013-01-29 14:29:47,040 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to prepare for Nic[740-202-6c395753-87a8-492f-ae56-deda1cb6f970-212.70.6.89]
  1204. 2013-01-29 14:29:47,040 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to prepare for Nic[740-202-6c395753-87a8-492f-ae56-deda1cb6f970-212.70.6.89]
  1205. 2013-01-29 14:29:47,040 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to prepare for Nic[740-202-6c395753-87a8-492f-ae56-deda1cb6f970-212.70.6.89]
  1206. 2013-01-29 14:29:47,040 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to prepare for Nic[740-202-6c395753-87a8-492f-ae56-deda1cb6f970-212.70.6.89]
  1207. 2013-01-29 14:29:47,040 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to prepare for Nic[740-202-6c395753-87a8-492f-ae56-deda1cb6f970-212.70.6.89]
  1208. 2013-01-29 14:29:47,040 WARN [network.element.VpcVirtualRouterElement] (secstorage-1:null) Network Ntwk[219|Management|2] is not associated with any VPC
  1209. 2013-01-29 14:29:47,040 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to prepare for Nic[740-202-6c395753-87a8-492f-ae56-deda1cb6f970-212.70.6.89]
  1210. 2013-01-29 14:29:47,041 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is acquired for network id 221 as a part of network implement
  1211. 2013-01-29 14:29:47,041 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Network id=221 is already implemented
  1212. 2013-01-29 14:29:47,041 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is released for network id 221 as a part of network implement
  1213. 2013-01-29 14:29:47,089 DEBUG [network.guru.PodBasedNetworkGuru] (consoleproxy-1:null) Allocated a nic NicProfile[61-32-fae333c1-5821-440f-ad29-f5ba10276b85-212.70.6.86-null for VM[ConsoleProxy|v-32-VM]
  1214. 2013-01-29 14:29:47,190 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VirtualRouter to prepare for Nic[61-32-fae333c1-5821-440f-ad29-f5ba10276b85-212.70.6.86]
  1215. 2013-01-29 14:29:47,191 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking Ovs to prepare for Nic[61-32-fae333c1-5821-440f-ad29-f5ba10276b85-212.70.6.86]
  1216. 2013-01-29 14:29:47,191 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking ExternalDhcpServer to prepare for Nic[61-32-fae333c1-5821-440f-ad29-f5ba10276b85-212.70.6.86]
  1217. 2013-01-29 14:29:47,191 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking BareMetal to prepare for Nic[61-32-fae333c1-5821-440f-ad29-f5ba10276b85-212.70.6.86]
  1218. 2013-01-29 14:29:47,191 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking SecurityGroupProvider to prepare for Nic[61-32-fae333c1-5821-440f-ad29-f5ba10276b85-212.70.6.86]
  1219. 2013-01-29 14:29:47,191 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VpcVirtualRouter to prepare for Nic[61-32-fae333c1-5821-440f-ad29-f5ba10276b85-212.70.6.86]
  1220. 2013-01-29 14:29:47,191 WARN [network.element.VpcVirtualRouterElement] (consoleproxy-1:null) Network Ntwk[219|Management|2] is not associated with any VPC
  1221. 2013-01-29 14:29:47,191 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking NiciraNvp to prepare for Nic[61-32-fae333c1-5821-440f-ad29-f5ba10276b85-212.70.6.86]
  1222. 2013-01-29 14:29:47,191 DEBUG [cloud.storage.StorageManagerImpl] (consoleproxy-1:null) Checking if we need to prepare 1 volumes for VM[ConsoleProxy|v-32-VM]
  1223. 2013-01-29 14:29:47,248 DEBUG [network.guru.PodBasedNetworkGuru] (secstorage-1:null) Allocated a nic NicProfile[741-202-6c395753-87a8-492f-ae56-deda1cb6f970-212.70.6.63-null for VM[SecondaryStorageVm|s-202-VM]
  1224. 2013-01-29 14:29:47,291 DEBUG [cloud.storage.StorageManagerImpl] (consoleproxy-1:null) Creating volume: Vol[34|vm=32|ROOT]
  1225. 2013-01-29 14:29:47,292 DEBUG [cloud.storage.StorageManagerImpl] (consoleproxy-1:null) Trying to create in Pool[204|NetworkFilesystem]
  1226. 2013-01-29 14:29:47,341 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to prepare for Nic[741-202-6c395753-87a8-492f-ae56-deda1cb6f970-212.70.6.63]
  1227. 2013-01-29 14:29:47,341 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to prepare for Nic[741-202-6c395753-87a8-492f-ae56-deda1cb6f970-212.70.6.63]
  1228. 2013-01-29 14:29:47,342 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to prepare for Nic[741-202-6c395753-87a8-492f-ae56-deda1cb6f970-212.70.6.63]
  1229. 2013-01-29 14:29:47,342 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to prepare for Nic[741-202-6c395753-87a8-492f-ae56-deda1cb6f970-212.70.6.63]
  1230. 2013-01-29 14:29:47,342 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to prepare for Nic[741-202-6c395753-87a8-492f-ae56-deda1cb6f970-212.70.6.63]
  1231. 2013-01-29 14:29:47,342 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to prepare for Nic[741-202-6c395753-87a8-492f-ae56-deda1cb6f970-212.70.6.63]
  1232. 2013-01-29 14:29:47,342 WARN [network.element.VpcVirtualRouterElement] (secstorage-1:null) Network Ntwk[221|Storage|4] is not associated with any VPC
  1233. 2013-01-29 14:29:47,342 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to prepare for Nic[741-202-6c395753-87a8-492f-ae56-deda1cb6f970-212.70.6.63]
  1234. 2013-01-29 14:29:47,343 DEBUG [cloud.storage.StorageManagerImpl] (secstorage-1:null) Checking if we need to prepare 1 volumes for VM[SecondaryStorageVm|s-202-VM]
  1235. 2013-01-29 14:29:47,441 DEBUG [cloud.storage.StorageManagerImpl] (secstorage-1:null) Creating volume: Vol[204|vm=202|ROOT]
  1236. 2013-01-29 14:29:47,441 DEBUG [cloud.storage.StorageManagerImpl] (secstorage-1:null) Trying to create in Pool[204|NetworkFilesystem]
  1237. 2013-01-29 14:29:47,487 DEBUG [cloud.template.TemplateManagerImpl] (consoleproxy-1:null) Downloading 3 via 7
  1238. 2013-01-29 14:29:47,488 DEBUG [agent.transport.Request] (consoleproxy-1:null) Seq 7-2090140038: Sending { Cmd , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 100111, [{"storage.PrimaryStorageDownloadCommand":{"localPath":"/mnt/99898908-d913-39c8-b61d-c7e6b6dbd8f0","poolUuid":"99898908-d913-39c8-b61d-c7e6b6dbd8f0","poolId":204,"secondaryStorageUrl":"nfs://cloudmanager.mira.dk/export/mirazone","primaryStorageUrl":"nfs://10.212.212.249/export/drbd10","url":"nfs://cloudmanager.mira.dk/export/mirazone/template/tmpl/1/3/","format":"QCOW2","accountId":1,"name":"routing-3","wait":10800}}] }
  1239. 2013-01-29 14:29:47,646 DEBUG [agent.transport.Request] (AgentManager-Handler-8:null) Seq 7-2090140038: Processing: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, [{"Answer":{"result":false,"details":"java.lang.NullPointerException\n\tat com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.createStoragePool(LibvirtStorageAdaptor.java:462)\n\tat com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.getStoragePoolByURI(LibvirtStorageAdaptor.java:745)\n\tat com.cloud.hypervisor.kvm.storage.KVMStoragePoolManager.getStoragePoolByURI(KVMStoragePoolManager.java:52)\n\tat com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:2017)\n\tat com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1009)\n\tat com.cloud.agent.Agent.processRequest(Agent.java:518)\n\tat com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:831)\n\tat com.cloud.utils.nio.Task.run(Task.java:83)\n\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)\n\tat java.lang.Thread.run(Thread.java:679)\n","wait":0}}] }
  1240. 2013-01-29 14:29:47,646 DEBUG [agent.manager.AgentAttache] (AgentManager-Handler-8:null) Seq 7-2090140038: No more commands found
  1241. 2013-01-29 14:29:47,646 DEBUG [agent.transport.Request] (consoleproxy-1:null) Seq 7-2090140038: Received: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, { Answer } }
  1242. 2013-01-29 14:29:47,646 DEBUG [agent.manager.AgentManagerImpl] (consoleproxy-1:null) Details from executing class com.cloud.agent.api.storage.PrimaryStorageDownloadCommand: java.lang.NullPointerException
  1243. at com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.createStoragePool(LibvirtStorageAdaptor.java:462)
  1244. at com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.getStoragePoolByURI(LibvirtStorageAdaptor.java:745)
  1245. at com.cloud.hypervisor.kvm.storage.KVMStoragePoolManager.getStoragePoolByURI(KVMStoragePoolManager.java:52)
  1246. at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:2017)
  1247. at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1009)
  1248. at com.cloud.agent.Agent.processRequest(Agent.java:518)
  1249. at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:831)
  1250. at com.cloud.utils.nio.Task.run(Task.java:83)
  1251. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
  1252. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
  1253. at java.lang.Thread.run(Thread.java:679)
  1254.  
  1255. 2013-01-29 14:29:47,646 ERROR [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Failed to start instance VM[ConsoleProxy|v-32-VM]
  1256. java.lang.ClassCastException: com.cloud.agent.api.Answer cannot be cast to com.cloud.agent.api.storage.PrimaryStorageDownloadAnswer
  1257. at com.cloud.template.TemplateManagerImpl.prepareTemplateForCreate(TemplateManagerImpl.java:663)
  1258. at com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34)
  1259. at com.cloud.storage.StorageManagerImpl.createVolume(StorageManagerImpl.java:3442)
  1260. at com.cloud.storage.StorageManagerImpl.prepare(StorageManagerImpl.java:3351)
  1261. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:754)
  1262. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:472)
  1263. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:465)
  1264. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.startProxy(ConsoleProxyManagerImpl.java:627)
  1265. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.allocCapacity(ConsoleProxyManagerImpl.java:1164)
  1266. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:1981)
  1267. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:173)
  1268. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:113)
  1269. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:34)
  1270. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:83)
  1271. at com.cloud.vm.SystemVmLoadScanner$1.run(SystemVmLoadScanner.java:73)
  1272. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  1273. at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351)
  1274. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178)
  1275. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165)
  1276. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267)
  1277. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
  1278. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
  1279. at java.lang.Thread.run(Thread.java:679)
  1280. 2013-01-29 14:29:47,694 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Cleaning up resources for the vm VM[ConsoleProxy|v-32-VM] in Starting state
  1281. 2013-01-29 14:29:47,694 DEBUG [agent.transport.Request] (consoleproxy-1:null) Seq 7-2090140039: Sending { Cmd , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 100111, [{"StopCommand":{"isProxy":false,"vmName":"v-32-VM","wait":0}}] }
  1282. 2013-01-29 14:29:47,799 DEBUG [agent.transport.Request] (AgentManager-Handler-2:null) Seq 7-2090140039: Processing: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, [{"StopAnswer":{"vncPort":0,"result":true,"wait":0}}] }
  1283. 2013-01-29 14:29:47,799 DEBUG [agent.manager.AgentAttache] (AgentManager-Handler-2:null) Seq 7-2090140039: No more commands found
  1284. 2013-01-29 14:29:47,799 DEBUG [agent.transport.Request] (consoleproxy-1:null) Seq 7-2090140039: Received: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, { StopAnswer } }
  1285. 2013-01-29 14:29:47,869 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Service SecurityGroup is not supported in the network id=222
  1286. 2013-01-29 14:29:47,917 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VirtualRouter to release Nic[59-32-fae333c1-5821-440f-ad29-f5ba10276b85-212.70.6.202]
  1287. 2013-01-29 14:29:47,917 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking Ovs to release Nic[59-32-fae333c1-5821-440f-ad29-f5ba10276b85-212.70.6.202]
  1288. 2013-01-29 14:29:47,917 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking ExternalDhcpServer to release Nic[59-32-fae333c1-5821-440f-ad29-f5ba10276b85-212.70.6.202]
  1289. 2013-01-29 14:29:47,917 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking BareMetal to release Nic[59-32-fae333c1-5821-440f-ad29-f5ba10276b85-212.70.6.202]
  1290. 2013-01-29 14:29:47,917 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking SecurityGroupProvider to release Nic[59-32-fae333c1-5821-440f-ad29-f5ba10276b85-212.70.6.202]
  1291. 2013-01-29 14:29:47,917 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VpcVirtualRouter to release Nic[59-32-fae333c1-5821-440f-ad29-f5ba10276b85-212.70.6.202]
  1292. 2013-01-29 14:29:47,917 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking NiciraNvp to release Nic[59-32-fae333c1-5821-440f-ad29-f5ba10276b85-212.70.6.202]
  1293. 2013-01-29 14:29:48,017 DEBUG [network.guru.ControlNetworkGuru] (consoleproxy-1:null) Released nic: NicProfile[60-32-null-null-null
  1294. 2013-01-29 14:29:48,067 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VirtualRouter to release Nic[60-32-fae333c1-5821-440f-ad29-f5ba10276b85-null]
  1295. 2013-01-29 14:29:48,068 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking Ovs to release Nic[60-32-fae333c1-5821-440f-ad29-f5ba10276b85-null]
  1296. 2013-01-29 14:29:48,068 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking ExternalDhcpServer to release Nic[60-32-fae333c1-5821-440f-ad29-f5ba10276b85-null]
  1297. 2013-01-29 14:29:48,068 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking BareMetal to release Nic[60-32-fae333c1-5821-440f-ad29-f5ba10276b85-null]
  1298. 2013-01-29 14:29:48,068 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking SecurityGroupProvider to release Nic[60-32-fae333c1-5821-440f-ad29-f5ba10276b85-null]
  1299. 2013-01-29 14:29:48,068 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VpcVirtualRouter to release Nic[60-32-fae333c1-5821-440f-ad29-f5ba10276b85-null]
  1300. 2013-01-29 14:29:48,068 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking NiciraNvp to release Nic[60-32-fae333c1-5821-440f-ad29-f5ba10276b85-null]
  1301. 2013-01-29 14:29:48,121 DEBUG [dc.dao.DataCenterIpAddressDaoImpl] (consoleproxy-1:null) Releasing ip address for reservationId=fae333c1-5821-440f-ad29-f5ba10276b85, instance=61
  1302. 2013-01-29 14:29:48,176 DEBUG [network.guru.PodBasedNetworkGuru] (consoleproxy-1:null) Released nic: NicProfile[61-32-null-null-null
  1303. 2013-01-29 14:29:48,229 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VirtualRouter to release Nic[61-32-fae333c1-5821-440f-ad29-f5ba10276b85-null]
  1304. 2013-01-29 14:29:48,229 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking Ovs to release Nic[61-32-fae333c1-5821-440f-ad29-f5ba10276b85-null]
  1305. 2013-01-29 14:29:48,229 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking ExternalDhcpServer to release Nic[61-32-fae333c1-5821-440f-ad29-f5ba10276b85-null]
  1306. 2013-01-29 14:29:48,229 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking BareMetal to release Nic[61-32-fae333c1-5821-440f-ad29-f5ba10276b85-null]
  1307. 2013-01-29 14:29:48,229 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking SecurityGroupProvider to release Nic[61-32-fae333c1-5821-440f-ad29-f5ba10276b85-null]
  1308. 2013-01-29 14:29:48,229 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VpcVirtualRouter to release Nic[61-32-fae333c1-5821-440f-ad29-f5ba10276b85-null]
  1309. 2013-01-29 14:29:48,229 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking NiciraNvp to release Nic[61-32-fae333c1-5821-440f-ad29-f5ba10276b85-null]
  1310. 2013-01-29 14:29:48,229 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Successfully released network resources for the vm VM[ConsoleProxy|v-32-VM]
  1311. 2013-01-29 14:29:48,229 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Successfully cleanued up resources for the vm VM[ConsoleProxy|v-32-VM] in Starting state
  1312. 2013-01-29 14:29:48,321 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: 7
  1313. 2013-01-29 14:29:48,323 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) Hosts's actual total CPU: 12004 and CPU after applying overprovisioning: 12004
  1314. 2013-01-29 14:29:48,323 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) release cpu from host: 7, old used: 1000,reserved: 0, actual total: 12004, total with overprovisioning: 12004; new used: 500,reserved:0; movedfromreserved: false,moveToReserveredfalse
  1315. 2013-01-29 14:29:48,323 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) release mem from host: 7, old used: 1342177280,reserved: 0, total: 8269606912; new used: 268435456,reserved:0; movedfromreserved: false,moveToReserveredfalse
  1316. 2013-01-29 14:29:48,378 WARN [cloud.consoleproxy.ConsoleProxyManagerImpl] (consoleproxy-1:null) Exception while trying to start console proxy
  1317. com.cloud.exception.AgentUnavailableException: Resource [Host:7] is unreachable: Host 7: Unable to start instance due to com.cloud.agent.api.Answer cannot be cast to com.cloud.agent.api.storage.PrimaryStorageDownloadAnswer
  1318. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:847)
  1319. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:472)
  1320. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:465)
  1321. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.startProxy(ConsoleProxyManagerImpl.java:627)
  1322. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.allocCapacity(ConsoleProxyManagerImpl.java:1164)
  1323. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:1981)
  1324. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:173)
  1325. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:113)
  1326. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:34)
  1327. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:83)
  1328. at com.cloud.vm.SystemVmLoadScanner$1.run(SystemVmLoadScanner.java:73)
  1329. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  1330. at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351)
  1331. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178)
  1332. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165)
  1333. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267)
  1334. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
  1335. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
  1336. at java.lang.Thread.run(Thread.java:679)
  1337. Caused by: java.lang.ClassCastException: com.cloud.agent.api.Answer cannot be cast to com.cloud.agent.api.storage.PrimaryStorageDownloadAnswer
  1338. at com.cloud.template.TemplateManagerImpl.prepareTemplateForCreate(TemplateManagerImpl.java:663)
  1339. at com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34)
  1340. at com.cloud.storage.StorageManagerImpl.createVolume(StorageManagerImpl.java:3442)
  1341. at com.cloud.storage.StorageManagerImpl.prepare(StorageManagerImpl.java:3351)
  1342. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:754)
  1343. ... 19 more
  1344. 2013-01-29 14:29:51,290 DEBUG [cloud.server.StatsCollector] (StatsCollector-2:null) StorageCollector is running...
  1345. 2013-01-29 14:29:51,344 DEBUG [agent.transport.Request] (StatsCollector-2:null) Seq 5-632235896: Received: { Ans: , MgmtId: 60908668245, via: 5, Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
  1346. 2013-01-29 14:29:51,345 DEBUG [cloud.server.StatsCollector] (StatsCollector-2:null) There is no secondary storage VM for secondary storage host nfs://cloudmanager.mira.dk/export/mirazone
  1347. 2013-01-29 14:29:51,388 DEBUG [agent.transport.Request] (StatsCollector-2:null) Seq 1-89030381: Received: { Ans: , MgmtId: 60908668245, via: 1, Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
  1348. 2013-01-29 14:29:51,409 DEBUG [agent.transport.Request] (StatsCollector-2:null) Seq 7-2090140040: Received: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
  1349. 2013-01-29 14:29:52,587 DEBUG [cloud.template.TemplateManagerImpl] (secstorage-1:null) Downloading 3 via 7
  1350. 2013-01-29 14:29:52,589 DEBUG [agent.transport.Request] (secstorage-1:null) Seq 7-2090140041: Sending { Cmd , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 100111, [{"storage.PrimaryStorageDownloadCommand":{"localPath":"/mnt/99898908-d913-39c8-b61d-c7e6b6dbd8f0","poolUuid":"99898908-d913-39c8-b61d-c7e6b6dbd8f0","poolId":204,"secondaryStorageUrl":"nfs://cloudmanager.mira.dk/export/mirazone","primaryStorageUrl":"nfs://10.212.212.249/export/drbd10","url":"nfs://cloudmanager.mira.dk/export/mirazone/template/tmpl/1/3/","format":"QCOW2","accountId":1,"name":"routing-3","wait":10800}}] }
  1351. 2013-01-29 14:29:52,826 DEBUG [agent.transport.Request] (AgentManager-Handler-9:null) Seq 7-2090140041: Processing: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, [{"Answer":{"result":false,"details":"java.lang.NullPointerException\n\tat com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.createStoragePool(LibvirtStorageAdaptor.java:462)\n\tat com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.getStoragePoolByURI(LibvirtStorageAdaptor.java:745)\n\tat com.cloud.hypervisor.kvm.storage.KVMStoragePoolManager.getStoragePoolByURI(KVMStoragePoolManager.java:52)\n\tat com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:2017)\n\tat com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1009)\n\tat com.cloud.agent.Agent.processRequest(Agent.java:518)\n\tat com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:831)\n\tat com.cloud.utils.nio.Task.run(Task.java:83)\n\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)\n\tat java.lang.Thread.run(Thread.java:679)\n","wait":0}}] }
  1352. 2013-01-29 14:29:52,826 DEBUG [agent.manager.AgentAttache] (AgentManager-Handler-9:null) Seq 7-2090140041: No more commands found
  1353. 2013-01-29 14:29:52,826 DEBUG [agent.transport.Request] (secstorage-1:null) Seq 7-2090140041: Received: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, { Answer } }
  1354. 2013-01-29 14:29:52,826 DEBUG [agent.manager.AgentManagerImpl] (secstorage-1:null) Details from executing class com.cloud.agent.api.storage.PrimaryStorageDownloadCommand: java.lang.NullPointerException
  1355. at com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.createStoragePool(LibvirtStorageAdaptor.java:462)
  1356. at com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.getStoragePoolByURI(LibvirtStorageAdaptor.java:745)
  1357. at com.cloud.hypervisor.kvm.storage.KVMStoragePoolManager.getStoragePoolByURI(KVMStoragePoolManager.java:52)
  1358. at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:2017)
  1359. at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1009)
  1360. at com.cloud.agent.Agent.processRequest(Agent.java:518)
  1361. at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:831)
  1362. at com.cloud.utils.nio.Task.run(Task.java:83)
  1363. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
  1364. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
  1365. at java.lang.Thread.run(Thread.java:679)
  1366.  
  1367. 2013-01-29 14:29:52,827 ERROR [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Failed to start instance VM[SecondaryStorageVm|s-202-VM]
  1368. java.lang.ClassCastException: com.cloud.agent.api.Answer cannot be cast to com.cloud.agent.api.storage.PrimaryStorageDownloadAnswer
  1369. at com.cloud.template.TemplateManagerImpl.prepareTemplateForCreate(TemplateManagerImpl.java:663)
  1370. at com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34)
  1371. at com.cloud.storage.StorageManagerImpl.createVolume(StorageManagerImpl.java:3442)
  1372. at com.cloud.storage.StorageManagerImpl.prepare(StorageManagerImpl.java:3351)
  1373. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:754)
  1374. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:472)
  1375. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:465)
  1376. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.startSecStorageVm(SecondaryStorageManagerImpl.java:257)
  1377. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.allocCapacity(SecondaryStorageManagerImpl.java:684)
  1378. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.expandPool(SecondaryStorageManagerImpl.java:1310)
  1379. at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:119)
  1380. at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:50)
  1381. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:106)
  1382. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:34)
  1383. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:83)
  1384. at com.cloud.vm.SystemVmLoadScanner$1.run(SystemVmLoadScanner.java:73)
  1385. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  1386. at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351)
  1387. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178)
  1388. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165)
  1389. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267)
  1390. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
  1391. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
  1392. at java.lang.Thread.run(Thread.java:679)
  1393. 2013-01-29 14:29:52,872 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Cleaning up resources for the vm VM[SecondaryStorageVm|s-202-VM] in Starting state
  1394. 2013-01-29 14:29:52,873 DEBUG [agent.transport.Request] (secstorage-1:null) Seq 7-2090140042: Sending { Cmd , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 100111, [{"StopCommand":{"isProxy":false,"vmName":"s-202-VM","wait":0}}] }
  1395. 2013-01-29 14:29:52,981 DEBUG [agent.transport.Request] (AgentManager-Handler-4:null) Seq 7-2090140042: Processing: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, [{"StopAnswer":{"vncPort":0,"result":true,"wait":0}}] }
  1396. 2013-01-29 14:29:52,981 DEBUG [agent.manager.AgentAttache] (AgentManager-Handler-4:null) Seq 7-2090140042: No more commands found
  1397. 2013-01-29 14:29:52,981 DEBUG [agent.transport.Request] (secstorage-1:null) Seq 7-2090140042: Received: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, { StopAnswer } }
  1398. 2013-01-29 14:29:53,023 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Service SecurityGroup is not supported in the network id=222
  1399. 2013-01-29 14:29:53,072 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to release Nic[738-202-6c395753-87a8-492f-ae56-deda1cb6f970-212.70.6.205]
  1400. 2013-01-29 14:29:53,072 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to release Nic[738-202-6c395753-87a8-492f-ae56-deda1cb6f970-212.70.6.205]
  1401. 2013-01-29 14:29:53,072 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to release Nic[738-202-6c395753-87a8-492f-ae56-deda1cb6f970-212.70.6.205]
  1402. 2013-01-29 14:29:53,072 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to release Nic[738-202-6c395753-87a8-492f-ae56-deda1cb6f970-212.70.6.205]
  1403. 2013-01-29 14:29:53,072 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to release Nic[738-202-6c395753-87a8-492f-ae56-deda1cb6f970-212.70.6.205]
  1404. 2013-01-29 14:29:53,072 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to release Nic[738-202-6c395753-87a8-492f-ae56-deda1cb6f970-212.70.6.205]
  1405. 2013-01-29 14:29:53,072 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to release Nic[738-202-6c395753-87a8-492f-ae56-deda1cb6f970-212.70.6.205]
  1406. 2013-01-29 14:29:53,172 DEBUG [network.guru.ControlNetworkGuru] (secstorage-1:null) Released nic: NicProfile[739-202-null-null-null
  1407. 2013-01-29 14:29:53,222 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to release Nic[739-202-6c395753-87a8-492f-ae56-deda1cb6f970-null]
  1408. 2013-01-29 14:29:53,222 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to release Nic[739-202-6c395753-87a8-492f-ae56-deda1cb6f970-null]
  1409. 2013-01-29 14:29:53,222 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to release Nic[739-202-6c395753-87a8-492f-ae56-deda1cb6f970-null]
  1410. 2013-01-29 14:29:53,222 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to release Nic[739-202-6c395753-87a8-492f-ae56-deda1cb6f970-null]
  1411. 2013-01-29 14:29:53,223 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to release Nic[739-202-6c395753-87a8-492f-ae56-deda1cb6f970-null]
  1412. 2013-01-29 14:29:53,223 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to release Nic[739-202-6c395753-87a8-492f-ae56-deda1cb6f970-null]
  1413. 2013-01-29 14:29:53,223 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to release Nic[739-202-6c395753-87a8-492f-ae56-deda1cb6f970-null]
  1414. 2013-01-29 14:29:53,266 DEBUG [dc.dao.DataCenterIpAddressDaoImpl] (secstorage-1:null) Releasing ip address for reservationId=6c395753-87a8-492f-ae56-deda1cb6f970, instance=740
  1415. 2013-01-29 14:29:53,307 DEBUG [network.guru.PodBasedNetworkGuru] (secstorage-1:null) Released nic: NicProfile[740-202-null-null-null
  1416. 2013-01-29 14:29:53,357 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to release Nic[740-202-6c395753-87a8-492f-ae56-deda1cb6f970-null]
  1417. 2013-01-29 14:29:53,357 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to release Nic[740-202-6c395753-87a8-492f-ae56-deda1cb6f970-null]
  1418. 2013-01-29 14:29:53,357 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to release Nic[740-202-6c395753-87a8-492f-ae56-deda1cb6f970-null]
  1419. 2013-01-29 14:29:53,357 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to release Nic[740-202-6c395753-87a8-492f-ae56-deda1cb6f970-null]
  1420. 2013-01-29 14:29:53,357 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to release Nic[740-202-6c395753-87a8-492f-ae56-deda1cb6f970-null]
  1421. 2013-01-29 14:29:53,357 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to release Nic[740-202-6c395753-87a8-492f-ae56-deda1cb6f970-null]
  1422. 2013-01-29 14:29:53,357 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to release Nic[740-202-6c395753-87a8-492f-ae56-deda1cb6f970-null]
  1423. 2013-01-29 14:29:53,401 DEBUG [dc.dao.DataCenterIpAddressDaoImpl] (secstorage-1:null) Releasing ip address for reservationId=6c395753-87a8-492f-ae56-deda1cb6f970, instance=741
  1424. 2013-01-29 14:29:53,448 DEBUG [network.guru.PodBasedNetworkGuru] (secstorage-1:null) Released nic: NicProfile[741-202-null-null-null
  1425. 2013-01-29 14:29:53,491 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to release Nic[741-202-6c395753-87a8-492f-ae56-deda1cb6f970-null]
  1426. 2013-01-29 14:29:53,491 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to release Nic[741-202-6c395753-87a8-492f-ae56-deda1cb6f970-null]
  1427. 2013-01-29 14:29:53,491 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to release Nic[741-202-6c395753-87a8-492f-ae56-deda1cb6f970-null]
  1428. 2013-01-29 14:29:53,491 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to release Nic[741-202-6c395753-87a8-492f-ae56-deda1cb6f970-null]
  1429. 2013-01-29 14:29:53,491 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to release Nic[741-202-6c395753-87a8-492f-ae56-deda1cb6f970-null]
  1430. 2013-01-29 14:29:53,491 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to release Nic[741-202-6c395753-87a8-492f-ae56-deda1cb6f970-null]
  1431. 2013-01-29 14:29:53,491 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to release Nic[741-202-6c395753-87a8-492f-ae56-deda1cb6f970-null]
  1432. 2013-01-29 14:29:53,491 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Successfully released network resources for the vm VM[SecondaryStorageVm|s-202-VM]
  1433. 2013-01-29 14:29:53,491 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Successfully cleanued up resources for the vm VM[SecondaryStorageVm|s-202-VM] in Starting state
  1434. 2013-01-29 14:29:53,575 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: 7
  1435. 2013-01-29 14:29:53,577 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) Hosts's actual total CPU: 12004 and CPU after applying overprovisioning: 12004
  1436. 2013-01-29 14:29:53,577 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) release cpu from host: 7, old used: 500,reserved: 0, actual total: 12004, total with overprovisioning: 12004; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  1437. 2013-01-29 14:29:53,577 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) release mem from host: 7, old used: 268435456,reserved: 0, total: 8269606912; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  1438. 2013-01-29 14:29:53,641 WARN [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Exception while trying to start secondary storage vm
  1439. com.cloud.exception.AgentUnavailableException: Resource [Host:7] is unreachable: Host 7: Unable to start instance due to com.cloud.agent.api.Answer cannot be cast to com.cloud.agent.api.storage.PrimaryStorageDownloadAnswer
  1440. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:847)
  1441. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:472)
  1442. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:465)
  1443. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.startSecStorageVm(SecondaryStorageManagerImpl.java:257)
  1444. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.allocCapacity(SecondaryStorageManagerImpl.java:684)
  1445. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.expandPool(SecondaryStorageManagerImpl.java:1310)
  1446. at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:119)
  1447. at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:50)
  1448. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:106)
  1449. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:34)
  1450. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:83)
  1451. at com.cloud.vm.SystemVmLoadScanner$1.run(SystemVmLoadScanner.java:73)
  1452. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  1453. at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351)
  1454. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178)
  1455. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165)
  1456. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267)
  1457. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
  1458. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
  1459. at java.lang.Thread.run(Thread.java:679)
  1460. Caused by: java.lang.ClassCastException: com.cloud.agent.api.Answer cannot be cast to com.cloud.agent.api.storage.PrimaryStorageDownloadAnswer
  1461. at com.cloud.template.TemplateManagerImpl.prepareTemplateForCreate(TemplateManagerImpl.java:663)
  1462. at com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34)
  1463. at com.cloud.storage.StorageManagerImpl.createVolume(StorageManagerImpl.java:3442)
  1464. at com.cloud.storage.StorageManagerImpl.prepare(StorageManagerImpl.java:3351)
  1465. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:754)
  1466. ... 20 more
  1467. 2013-01-29 14:29:53,642 INFO [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Unable to start secondary storage vm for standby capacity, secStorageVm vm Id : 202, will recycle it and start a new one
  1468. 2013-01-29 14:29:53,643 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) VM is already stopped: VM[SecondaryStorageVm|s-202-VM]
  1469. 2013-01-29 14:29:53,692 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) VM state transitted from :Stopped to Expunging with event: ExpungeOperationvm's original host id: null new host id: null host id before state transition: null
  1470. 2013-01-29 14:29:53,693 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Destroying vm VM[SecondaryStorageVm|s-202-VM]
  1471. 2013-01-29 14:29:53,693 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Cleaning up NICS
  1472. 2013-01-29 14:29:53,693 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Cleaning network for vm: 202
  1473. 2013-01-29 14:29:53,751 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Service SecurityGroup is not supported in the network id=222
  1474. 2013-01-29 14:29:53,752 DEBUG [network.guru.DirectNetworkGuru] (secstorage-1:null) Deallocate network: networkId: 222, ip: 212.70.6.205
  1475. 2013-01-29 14:29:53,909 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Removed nic id=738
  1476. 2013-01-29 14:29:54,009 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Removed nic id=739
  1477. 2013-01-29 14:29:54,117 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Removed nic id=740
  1478. 2013-01-29 14:29:54,234 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Removed nic id=741
  1479. 2013-01-29 14:29:54,234 DEBUG [cloud.storage.StorageManagerImpl] (secstorage-1:null) Cleaning storage for vm: 202
  1480. 2013-01-29 14:29:54,284 DEBUG [cloud.storage.StorageManagerImpl] (secstorage-1:null) Expunging Vol[204|vm=202|ROOT]
  1481. 2013-01-29 14:29:54,286 DEBUG [cloud.storage.StorageManagerImpl] (secstorage-1:null) Marking volume that was never created as destroyed: Vol[204|vm=202|ROOT]
  1482. 2013-01-29 14:29:54,376 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Expunged VM[SecondaryStorageVm|s-202-VM]
  1483. 2013-01-29 14:29:54,438 INFO [cloud.secstorage.PremiumSecondaryStorageManagerImpl] (secstorage-1:null) Primary secondary storage is not even started, wait until next turn
  1484. 2013-01-29 14:29:55,162 DEBUG [cloud.server.StatsCollector] (StatsCollector-2:null) VmStatsCollector is running...
  1485. 2013-01-29 14:29:55,198 DEBUG [agent.transport.Request] (StatsCollector-2:null) Seq 1-89030382: Received: { Ans: , MgmtId: 60908668245, via: 1, Ver: v1, Flags: 10, { GetVmStatsAnswer } }
  1486. 2013-01-29 14:29:55,218 DEBUG [agent.transport.Request] (StatsCollector-2:null) Seq 4-220941130: Received: { Ans: , MgmtId: 60908668245, via: 4, Ver: v1, Flags: 10, { GetVmStatsAnswer } }
  1487. 2013-01-29 14:30:03,198 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-7:null) Ping from 1
  1488. 2013-01-29 14:30:04,555 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-1:null) Ping from 4
  1489. 2013-01-29 14:30:05,044 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-5:null) Ping from 3
  1490. 2013-01-29 14:30:05,341 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-6:null) Ping from 5
  1491. 2013-01-29 14:30:15,334 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-3:null) Ping from 7
  1492. 2013-01-29 14:30:15,898 DEBUG [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Zone 1 is ready to launch secondary storage VM
  1493. 2013-01-29 14:30:15,905 DEBUG [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Zone 3 is ready to launch secondary storage VM
  1494. 2013-01-29 14:30:15,907 INFO [cloud.secstorage.PremiumSecondaryStorageManagerImpl] (secstorage-1:null) No running secondary storage vms found in datacenter id=3, starting one
  1495. 2013-01-29 14:30:15,910 INFO [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) No stopped secondary storage vm is available, need to allocate a new secondary storage vm
  1496. 2013-01-29 14:30:15,911 DEBUG [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Assign secondary storage vm from a newly started instance for request from data center : 3
  1497. 2013-01-29 14:30:15,983 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Found existing network configuration for offering [Network Offering [7-Guest-DefaultSharedNetworkOffering]: Ntwk[222|Guest|7]
  1498. 2013-01-29 14:30:15,983 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Releasing lock for Acct[1-system]
  1499. 2013-01-29 14:30:15,984 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Found existing network configuration for offering [Network Offering [3-Control-System-Control-Network]: Ntwk[220|Control|3]
  1500. 2013-01-29 14:30:15,984 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Releasing lock for Acct[1-system]
  1501. 2013-01-29 14:30:15,986 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Found existing network configuration for offering [Network Offering [2-Management-System-Management-Network]: Ntwk[219|Management|2]
  1502. 2013-01-29 14:30:15,986 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Releasing lock for Acct[1-system]
  1503. 2013-01-29 14:30:15,987 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Found existing network configuration for offering [Network Offering [4-Storage-System-Storage-Network]: Ntwk[221|Storage|4]
  1504. 2013-01-29 14:30:15,987 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Releasing lock for Acct[1-system]
  1505. 2013-01-29 14:30:15,989 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Allocating entries for VM: VM[SecondaryStorageVm|s-203-VM]
  1506. 2013-01-29 14:30:15,991 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Allocating nics for VM[SecondaryStorageVm|s-203-VM]
  1507. 2013-01-29 14:30:15,992 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Allocating nic for vm VM[SecondaryStorageVm|s-203-VM] in network Ntwk[222|Guest|7] with requested profile NicProfile[0-0-null-null-null
  1508. 2013-01-29 14:30:16,002 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Service SecurityGroup is not supported in the network id=222
  1509. 2013-01-29 14:30:16,003 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Allocating nic for vm VM[SecondaryStorageVm|s-203-VM] in network Ntwk[220|Control|3] with requested profile null
  1510. 2013-01-29 14:30:16,007 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Allocating nic for vm VM[SecondaryStorageVm|s-203-VM] in network Ntwk[219|Management|2] with requested profile null
  1511. 2013-01-29 14:30:16,011 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Allocating nic for vm VM[SecondaryStorageVm|s-203-VM] in network Ntwk[221|Storage|4] with requested profile null
  1512. 2013-01-29 14:30:16,016 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Allocaing disks for VM[SecondaryStorageVm|s-203-VM]
  1513. 2013-01-29 14:30:16,017 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl] (consoleproxy-1:null) Zone 1 is ready to launch console proxy
  1514. 2013-01-29 14:30:16,020 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl] (consoleproxy-1:null) Zone 3 is ready to launch console proxy
  1515. 2013-01-29 14:30:16,020 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl] (consoleproxy-1:null) Expand console proxy standby capacity for zone Mira
  1516. 2013-01-29 14:30:16,022 INFO [cloud.consoleproxy.ConsoleProxyManagerImpl] (consoleproxy-1:null) Found a stopped console proxy, bring it up to running pool. proxy vm id : 32
  1517. 2013-01-29 14:30:16,026 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
  1518. 2013-01-29 14:30:16,026 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Successfully transitioned to start state for VM[ConsoleProxy|v-32-VM] reservation id = 938697c7-a4c8-406e-8dda-2627d892f21c
  1519. 2013-01-29 14:30:16,081 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Allocation completed for VM: VM[SecondaryStorageVm|s-203-VM]
  1520. 2013-01-29 14:30:16,084 DEBUG [cloud.alert.SecondaryStorageVmAlertAdapter] (secstorage-1:null) received secondary storage vm alert
  1521. 2013-01-29 14:30:16,084 DEBUG [cloud.alert.SecondaryStorageVmAlertAdapter] (secstorage-1:null) New secondary storage vm created, zone: Mira, secStorageVm: s-203-VM, public IP: null, private IP: null
  1522. 2013-01-29 14:30:16,088 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
  1523. 2013-01-29 14:30:16,088 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Successfully transitioned to start state for VM[SecondaryStorageVm|s-203-VM] reservation id = 5384ec7c-4014-4829-a256-d77e3db5d4d3
  1524. 2013-01-29 14:30:16,140 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Trying to deploy VM, vm has dcId: 3 and podId: 3
  1525. 2013-01-29 14:30:16,141 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Deploy avoids pods: null, clusters: null, hosts: null
  1526. 2013-01-29 14:30:16,142 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) DeploymentPlanner allocation algorithm: random
  1527. 2013-01-29 14:30:16,142 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Trying to allocate a host and storage pools from dc:3, pod:3,cluster:null, requested cpu: 500, requested ram: 1073741824
  1528. 2013-01-29 14:30:16,142 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Is ROOT volume READY (pool already allocated)?: No
  1529. 2013-01-29 14:30:16,142 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Searching resources only under specified Pod: 3
  1530. 2013-01-29 14:30:16,142 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Pod: 3
  1531. 2013-01-29 14:30:16,143 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) CPUOverprovisioningFactor considered: 1.0
  1532. 2013-01-29 14:30:16,146 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Checking resources in Cluster: 3 under Pod: 3
  1533. 2013-01-29 14:30:16,147 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Calling HostAllocators to find suitable hosts
  1534. 2013-01-29 14:30:16,147 DEBUG [allocator.impl.FirstFitAllocator] (consoleproxy-1:FirstFitRoutingAllocator) Looking for hosts in dc: 3 pod:3 cluster:3
  1535. 2013-01-29 14:30:16,147 DEBUG [allocator.impl.FirstFitAllocator] (consoleproxy-1:FirstFitRoutingAllocator) FirstFitAllocator has 1 hosts to check for allocation: [Host[-7-Routing]]
  1536. 2013-01-29 14:30:16,148 DEBUG [allocator.impl.FirstFitAllocator] (consoleproxy-1:FirstFitRoutingAllocator) Found 1 hosts for allocation after prioritization: [Host[-7-Routing]]
  1537. 2013-01-29 14:30:16,148 DEBUG [allocator.impl.FirstFitAllocator] (consoleproxy-1:FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=1024
  1538. 2013-01-29 14:30:16,149 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) Checking if host: 7 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  1539. 2013-01-29 14:30:16,150 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) Hosts's actual total CPU: 12004 and CPU after applying overprovisioning: 12004
  1540. 2013-01-29 14:30:16,150 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) Free CPU: 12004 , Requested CPU: 500
  1541. 2013-01-29 14:30:16,151 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) Free RAM: 8269606912 , Requested RAM: 1073741824
  1542. 2013-01-29 14:30:16,151 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) Host has enough CPU and RAM available
  1543. 2013-01-29 14:30:16,151 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 7, used: 0, reserved: 0, actual total: 12004, total with overprovisioning: 12004; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1544. 2013-01-29 14:30:16,151 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 7, used: 0, reserved: 0, total: 8269606912; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1545. 2013-01-29 14:30:16,151 DEBUG [allocator.impl.FirstFitAllocator] (consoleproxy-1:FirstFitRoutingAllocator) Found a suitable host, adding to list: 7
  1546. 2013-01-29 14:30:16,151 DEBUG [allocator.impl.FirstFitAllocator] (consoleproxy-1:FirstFitRoutingAllocator) Host Allocator returning 1 suitable hosts
  1547. 2013-01-29 14:30:16,151 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Checking suitable pools for volume (Id, Type): (34,ROOT)
  1548. 2013-01-29 14:30:16,152 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) We need to allocate new storagepool for this volume
  1549. 2013-01-29 14:30:16,152 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Calling StoragePoolAllocators to find suitable pools
  1550. 2013-01-29 14:30:16,152 DEBUG [storage.allocator.FirstFitStoragePoolAllocator] (consoleproxy-1:null) Looking for pools in dc: 3 pod:3 cluster:3
  1551. 2013-01-29 14:30:16,153 DEBUG [storage.allocator.FirstFitStoragePoolAllocator] (consoleproxy-1:null) FirstFitStoragePoolAllocator has 1 pools to check for allocation
  1552. 2013-01-29 14:30:16,153 DEBUG [storage.allocator.AbstractStoragePoolAllocator] (consoleproxy-1:null) Checking if storage pool is suitable, name: DRDB10 ,poolId: 204
  1553. 2013-01-29 14:30:16,153 DEBUG [storage.allocator.AbstractStoragePoolAllocator] (consoleproxy-1:null) Is localStorageAllocationNeeded? false
  1554. 2013-01-29 14:30:16,153 DEBUG [storage.allocator.AbstractStoragePoolAllocator] (consoleproxy-1:null) Is storage pool shared? true
  1555. 2013-01-29 14:30:16,154 DEBUG [cloud.storage.StorageManagerImpl] (consoleproxy-1:null) Checking pool 204 for storage, totalSize: 1968949690368, usedBytes: 204734464, usedPct: 1.039815618456634E-4, disable threshold: 0.85
  1556. 2013-01-29 14:30:16,156 DEBUG [cloud.storage.StorageManagerImpl] (consoleproxy-1:null) Checking pool: 204 for volume allocation [Vol[34|vm=32|ROOT]], maxSize : 3937899380736, totalAllocatedSize : 0, askingSize : 0, allocated disable threshold: 0.85
  1557. 2013-01-29 14:30:16,156 DEBUG [storage.allocator.FirstFitStoragePoolAllocator] (consoleproxy-1:null) FirstFitStoragePoolAllocator returning 1 suitable storage pools
  1558. 2013-01-29 14:30:16,156 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Trying to find a potenial host and associated storage pools from the suitable host/pool lists for this VM
  1559. 2013-01-29 14:30:16,156 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Checking if host: 7 can access any suitable storage pool for volume: ROOT
  1560. 2013-01-29 14:30:16,156 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Host: 7 can access pool: 204
  1561. 2013-01-29 14:30:16,156 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Found a potential host id: 7 name: mc1 and associated storage pools for this VM
  1562. 2013-01-29 14:30:16,157 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Returning Deployment Destination: Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(3)-Pod(3)-Cluster(3)-Host(7)-Storage(Volume(34|ROOT-->Pool(204))]
  1563. 2013-01-29 14:30:16,157 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Deployment found - P0=VM[ConsoleProxy|v-32-VM], P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(3)-Pod(3)-Cluster(3)-Host(7)-Storage(Volume(34|ROOT-->Pool(204))]
  1564. 2013-01-29 14:30:16,182 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Trying to deploy VM, vm has dcId: 3 and podId: null
  1565. 2013-01-29 14:30:16,183 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Deploy avoids pods: null, clusters: null, hosts: null
  1566. 2013-01-29 14:30:16,184 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) DeploymentPlanner allocation algorithm: random
  1567. 2013-01-29 14:30:16,184 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Trying to allocate a host and storage pools from dc:3, pod:null,cluster:null, requested cpu: 500, requested ram: 268435456
  1568. 2013-01-29 14:30:16,184 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Is ROOT volume READY (pool already allocated)?: No
  1569. 2013-01-29 14:30:16,184 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Searching all possible resources under this Zone: 3
  1570. 2013-01-29 14:30:16,185 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 3
  1571. 2013-01-29 14:30:16,185 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) CPUOverprovisioningFactor considered: 1.0
  1572. 2013-01-29 14:30:16,189 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Checking resources in Cluster: 3 under Pod: 3
  1573. 2013-01-29 14:30:16,189 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Calling HostAllocators to find suitable hosts
  1574. 2013-01-29 14:30:16,189 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) Looking for hosts in dc: 3 pod:3 cluster:3
  1575. 2013-01-29 14:30:16,190 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) FirstFitAllocator has 1 hosts to check for allocation: [Host[-7-Routing]]
  1576. 2013-01-29 14:30:16,191 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) Found 1 hosts for allocation after prioritization: [Host[-7-Routing]]
  1577. 2013-01-29 14:30:16,191 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=256
  1578. 2013-01-29 14:30:16,192 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) Checking if host: 7 has enough capacity for requested CPU: 500 and requested RAM: 268435456 , cpuOverprovisioningFactor: 1.0
  1579. 2013-01-29 14:30:16,193 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) Hosts's actual total CPU: 12004 and CPU after applying overprovisioning: 12004
  1580. 2013-01-29 14:30:16,193 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) Free CPU: 12004 , Requested CPU: 500
  1581. 2013-01-29 14:30:16,193 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) Free RAM: 8269606912 , Requested RAM: 268435456
  1582. 2013-01-29 14:30:16,193 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) Host has enough CPU and RAM available
  1583. 2013-01-29 14:30:16,193 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 7, used: 0, reserved: 0, actual total: 12004, total with overprovisioning: 12004; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1584. 2013-01-29 14:30:16,193 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 7, used: 0, reserved: 0, total: 8269606912; requested mem: 268435456,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1585. 2013-01-29 14:30:16,193 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) Found a suitable host, adding to list: 7
  1586. 2013-01-29 14:30:16,193 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) Host Allocator returning 1 suitable hosts
  1587. 2013-01-29 14:30:16,194 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Checking suitable pools for volume (Id, Type): (205,ROOT)
  1588. 2013-01-29 14:30:16,194 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) We need to allocate new storagepool for this volume
  1589. 2013-01-29 14:30:16,194 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Calling StoragePoolAllocators to find suitable pools
  1590. 2013-01-29 14:30:16,194 DEBUG [storage.allocator.FirstFitStoragePoolAllocator] (secstorage-1:null) Looking for pools in dc: 3 pod:3 cluster:3
  1591. 2013-01-29 14:30:16,195 DEBUG [storage.allocator.FirstFitStoragePoolAllocator] (secstorage-1:null) FirstFitStoragePoolAllocator has 1 pools to check for allocation
  1592. 2013-01-29 14:30:16,195 DEBUG [storage.allocator.AbstractStoragePoolAllocator] (secstorage-1:null) Checking if storage pool is suitable, name: DRDB10 ,poolId: 204
  1593. 2013-01-29 14:30:16,195 DEBUG [storage.allocator.AbstractStoragePoolAllocator] (secstorage-1:null) Is localStorageAllocationNeeded? false
  1594. 2013-01-29 14:30:16,195 DEBUG [storage.allocator.AbstractStoragePoolAllocator] (secstorage-1:null) Is storage pool shared? true
  1595. 2013-01-29 14:30:16,196 DEBUG [cloud.storage.StorageManagerImpl] (secstorage-1:null) Checking pool 204 for storage, totalSize: 1968949690368, usedBytes: 204734464, usedPct: 1.039815618456634E-4, disable threshold: 0.85
  1596. 2013-01-29 14:30:16,466 DEBUG [cloud.storage.StorageManagerImpl] (secstorage-1:null) Checking pool: 204 for volume allocation [Vol[205|vm=203|ROOT]], maxSize : 3937899380736, totalAllocatedSize : 0, askingSize : 0, allocated disable threshold: 0.85
  1597. 2013-01-29 14:30:16,466 DEBUG [storage.allocator.FirstFitStoragePoolAllocator] (secstorage-1:null) FirstFitStoragePoolAllocator returning 1 suitable storage pools
  1598. 2013-01-29 14:30:16,466 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Trying to find a potenial host and associated storage pools from the suitable host/pool lists for this VM
  1599. 2013-01-29 14:30:16,466 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Checking if host: 7 can access any suitable storage pool for volume: ROOT
  1600. 2013-01-29 14:30:16,467 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Host: 7 can access pool: 204
  1601. 2013-01-29 14:30:16,467 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Found a potential host id: 7 name: mc1 and associated storage pools for this VM
  1602. 2013-01-29 14:30:16,469 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Returning Deployment Destination: Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(3)-Pod(3)-Cluster(3)-Host(7)-Storage(Volume(205|ROOT-->Pool(204))]
  1603. 2013-01-29 14:30:16,469 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Deployment found - P0=VM[SecondaryStorageVm|s-203-VM], P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(3)-Pod(3)-Cluster(3)-Host(7)-Storage(Volume(205|ROOT-->Pool(204))]
  1604. 2013-01-29 14:30:16,469 DEBUG [network.router.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:null) Found 5 routers.
  1605. 2013-01-29 14:30:16,557 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) VM state transitted from :Starting to Starting with event: OperationRetryvm's original host id: null new host id: 7 host id before state transition: null
  1606. 2013-01-29 14:30:16,561 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) Hosts's actual total CPU: 12004 and CPU after applying overprovisioning: 12004
  1607. 2013-01-29 14:30:16,561 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) We are allocating VM, increasing the used capacity of this host:7
  1608. 2013-01-29 14:30:16,561 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) Current Used CPU: 0 , Free CPU:12004 ,Requested CPU: 500
  1609. 2013-01-29 14:30:16,561 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) Current Used RAM: 0 , Free RAM:8269606912 ,Requested RAM: 1073741824
  1610. 2013-01-29 14:30:16,561 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) CPU STATS after allocation: for host: 7, old used: 0, old reserved: 0, actual total: 12004, total with overprovisioning: 12004; new used:500, reserved:0; requested cpu:500,alloc_from_last:false
  1611. 2013-01-29 14:30:16,561 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) RAM STATS after allocation: for host: 7, old used: 0, old reserved: 0, total: 8269606912; new used: 1073741824, reserved: 0; requested mem: 1073741824,alloc_from_last:false
  1612. 2013-01-29 14:30:16,616 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) VM state transitted from :Starting to Starting with event: OperationRetryvm's original host id: null new host id: 7 host id before state transition: null
  1613. 2013-01-29 14:30:16,620 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) Hosts's actual total CPU: 12004 and CPU after applying overprovisioning: 12004
  1614. 2013-01-29 14:30:16,620 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) We are allocating VM, increasing the used capacity of this host:7
  1615. 2013-01-29 14:30:16,620 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) Current Used CPU: 500 , Free CPU:11504 ,Requested CPU: 500
  1616. 2013-01-29 14:30:16,620 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) Current Used RAM: 1073741824 , Free RAM:7195865088 ,Requested RAM: 268435456
  1617. 2013-01-29 14:30:16,620 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) CPU STATS after allocation: for host: 7, old used: 500, old reserved: 0, actual total: 12004, total with overprovisioning: 12004; new used:1000, reserved:0; requested cpu:500,alloc_from_last:false
  1618. 2013-01-29 14:30:16,620 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) RAM STATS after allocation: for host: 7, old used: 1073741824, old reserved: 0, total: 8269606912; new used: 1342177280, reserved: 0; requested mem: 268435456,alloc_from_last:false
  1619. 2013-01-29 14:30:16,658 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) VM is being created in podId: 3
  1620. 2013-01-29 14:30:16,660 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Lock is acquired for network id 222 as a part of network implement
  1621. 2013-01-29 14:30:16,660 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Network id=222 is already implemented
  1622. 2013-01-29 14:30:16,661 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Lock is released for network id 222 as a part of network implement
  1623. 2013-01-29 14:30:16,700 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) VM is being created in podId: 3
  1624. 2013-01-29 14:30:16,702 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is acquired for network id 222 as a part of network implement
  1625. 2013-01-29 14:30:16,702 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Network id=222 is already implemented
  1626. 2013-01-29 14:30:16,702 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is released for network id 222 as a part of network implement
  1627. 2013-01-29 14:30:16,749 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Service SecurityGroup is not supported in the network id=222
  1628. 2013-01-29 14:30:16,799 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Service SecurityGroup is not supported in the network id=222
  1629. 2013-01-29 14:30:16,849 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VirtualRouter to prepare for Nic[59-32-938697c7-a4c8-406e-8dda-2627d892f21c-212.70.6.202]
  1630. 2013-01-29 14:30:16,850 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking Ovs to prepare for Nic[59-32-938697c7-a4c8-406e-8dda-2627d892f21c-212.70.6.202]
  1631. 2013-01-29 14:30:16,850 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking ExternalDhcpServer to prepare for Nic[59-32-938697c7-a4c8-406e-8dda-2627d892f21c-212.70.6.202]
  1632. 2013-01-29 14:30:16,850 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking BareMetal to prepare for Nic[59-32-938697c7-a4c8-406e-8dda-2627d892f21c-212.70.6.202]
  1633. 2013-01-29 14:30:16,850 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking SecurityGroupProvider to prepare for Nic[59-32-938697c7-a4c8-406e-8dda-2627d892f21c-212.70.6.202]
  1634. 2013-01-29 14:30:16,850 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VpcVirtualRouter to prepare for Nic[59-32-938697c7-a4c8-406e-8dda-2627d892f21c-212.70.6.202]
  1635. 2013-01-29 14:30:16,850 WARN [network.element.VpcVirtualRouterElement] (consoleproxy-1:null) Network Ntwk[222|Guest|7] is not associated with any VPC
  1636. 2013-01-29 14:30:16,850 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking NiciraNvp to prepare for Nic[59-32-938697c7-a4c8-406e-8dda-2627d892f21c-212.70.6.202]
  1637. 2013-01-29 14:30:16,851 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Service SecurityGroup is not supported in the network id=222
  1638. 2013-01-29 14:30:16,852 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Lock is acquired for network id 220 as a part of network implement
  1639. 2013-01-29 14:30:16,852 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Network id=220 is already implemented
  1640. 2013-01-29 14:30:16,852 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Lock is released for network id 220 as a part of network implement
  1641. 2013-01-29 14:30:16,991 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to prepare for Nic[742-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-212.70.6.203]
  1642. 2013-01-29 14:30:16,992 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to prepare for Nic[742-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-212.70.6.203]
  1643. 2013-01-29 14:30:16,992 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to prepare for Nic[742-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-212.70.6.203]
  1644. 2013-01-29 14:30:16,992 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to prepare for Nic[742-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-212.70.6.203]
  1645. 2013-01-29 14:30:16,992 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to prepare for Nic[742-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-212.70.6.203]
  1646. 2013-01-29 14:30:16,992 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to prepare for Nic[742-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-212.70.6.203]
  1647. 2013-01-29 14:30:16,992 WARN [network.element.VpcVirtualRouterElement] (secstorage-1:null) Network Ntwk[222|Guest|7] is not associated with any VPC
  1648. 2013-01-29 14:30:16,993 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to prepare for Nic[742-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-212.70.6.203]
  1649. 2013-01-29 14:30:16,993 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Service SecurityGroup is not supported in the network id=222
  1650. 2013-01-29 14:30:16,994 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is acquired for network id 220 as a part of network implement
  1651. 2013-01-29 14:30:16,994 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Network id=220 is already implemented
  1652. 2013-01-29 14:30:16,994 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is released for network id 220 as a part of network implement
  1653. 2013-01-29 14:30:17,167 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VirtualRouter to prepare for Nic[60-32-938697c7-a4c8-406e-8dda-2627d892f21c-169.254.0.184]
  1654. 2013-01-29 14:30:17,167 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking Ovs to prepare for Nic[60-32-938697c7-a4c8-406e-8dda-2627d892f21c-169.254.0.184]
  1655. 2013-01-29 14:30:17,167 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking ExternalDhcpServer to prepare for Nic[60-32-938697c7-a4c8-406e-8dda-2627d892f21c-169.254.0.184]
  1656. 2013-01-29 14:30:17,167 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking BareMetal to prepare for Nic[60-32-938697c7-a4c8-406e-8dda-2627d892f21c-169.254.0.184]
  1657. 2013-01-29 14:30:17,167 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking SecurityGroupProvider to prepare for Nic[60-32-938697c7-a4c8-406e-8dda-2627d892f21c-169.254.0.184]
  1658. 2013-01-29 14:30:17,167 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VpcVirtualRouter to prepare for Nic[60-32-938697c7-a4c8-406e-8dda-2627d892f21c-169.254.0.184]
  1659. 2013-01-29 14:30:17,167 WARN [network.element.VpcVirtualRouterElement] (consoleproxy-1:null) Network Ntwk[220|Control|3] is not associated with any VPC
  1660. 2013-01-29 14:30:17,167 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking NiciraNvp to prepare for Nic[60-32-938697c7-a4c8-406e-8dda-2627d892f21c-169.254.0.184]
  1661. 2013-01-29 14:30:17,168 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Lock is acquired for network id 219 as a part of network implement
  1662. 2013-01-29 14:30:17,168 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Network id=219 is already implemented
  1663. 2013-01-29 14:30:17,169 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Lock is released for network id 219 as a part of network implement
  1664. 2013-01-29 14:30:17,327 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to prepare for Nic[743-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-169.254.1.156]
  1665. 2013-01-29 14:30:17,327 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to prepare for Nic[743-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-169.254.1.156]
  1666. 2013-01-29 14:30:17,328 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to prepare for Nic[743-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-169.254.1.156]
  1667. 2013-01-29 14:30:17,328 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to prepare for Nic[743-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-169.254.1.156]
  1668. 2013-01-29 14:30:17,328 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to prepare for Nic[743-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-169.254.1.156]
  1669. 2013-01-29 14:30:17,328 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to prepare for Nic[743-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-169.254.1.156]
  1670. 2013-01-29 14:30:17,334 WARN [network.element.VpcVirtualRouterElement] (secstorage-1:null) Network Ntwk[220|Control|3] is not associated with any VPC
  1671. 2013-01-29 14:30:17,334 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to prepare for Nic[743-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-169.254.1.156]
  1672. 2013-01-29 14:30:17,335 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is acquired for network id 219 as a part of network implement
  1673. 2013-01-29 14:30:17,335 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Network id=219 is already implemented
  1674. 2013-01-29 14:30:17,335 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is released for network id 219 as a part of network implement
  1675. 2013-01-29 14:30:17,369 DEBUG [network.guru.PodBasedNetworkGuru] (consoleproxy-1:null) Allocated a nic NicProfile[61-32-938697c7-a4c8-406e-8dda-2627d892f21c-212.70.6.83-null for VM[ConsoleProxy|v-32-VM]
  1676. 2013-01-29 14:30:17,479 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VirtualRouter to prepare for Nic[61-32-938697c7-a4c8-406e-8dda-2627d892f21c-212.70.6.83]
  1677. 2013-01-29 14:30:17,479 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking Ovs to prepare for Nic[61-32-938697c7-a4c8-406e-8dda-2627d892f21c-212.70.6.83]
  1678. 2013-01-29 14:30:17,479 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking ExternalDhcpServer to prepare for Nic[61-32-938697c7-a4c8-406e-8dda-2627d892f21c-212.70.6.83]
  1679. 2013-01-29 14:30:17,479 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking BareMetal to prepare for Nic[61-32-938697c7-a4c8-406e-8dda-2627d892f21c-212.70.6.83]
  1680. 2013-01-29 14:30:17,479 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking SecurityGroupProvider to prepare for Nic[61-32-938697c7-a4c8-406e-8dda-2627d892f21c-212.70.6.83]
  1681. 2013-01-29 14:30:17,480 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VpcVirtualRouter to prepare for Nic[61-32-938697c7-a4c8-406e-8dda-2627d892f21c-212.70.6.83]
  1682. 2013-01-29 14:30:17,480 WARN [network.element.VpcVirtualRouterElement] (consoleproxy-1:null) Network Ntwk[219|Management|2] is not associated with any VPC
  1683. 2013-01-29 14:30:17,480 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking NiciraNvp to prepare for Nic[61-32-938697c7-a4c8-406e-8dda-2627d892f21c-212.70.6.83]
  1684. 2013-01-29 14:30:17,481 DEBUG [cloud.storage.StorageManagerImpl] (consoleproxy-1:null) Checking if we need to prepare 1 volumes for VM[ConsoleProxy|v-32-VM]
  1685. 2013-01-29 14:30:17,521 DEBUG [network.guru.PodBasedNetworkGuru] (secstorage-1:null) Allocated a nic NicProfile[744-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-212.70.6.75-null for VM[SecondaryStorageVm|s-203-VM]
  1686. 2013-01-29 14:30:17,579 DEBUG [cloud.storage.StorageManagerImpl] (consoleproxy-1:null) Creating volume: Vol[34|vm=32|ROOT]
  1687. 2013-01-29 14:30:17,580 DEBUG [cloud.storage.StorageManagerImpl] (consoleproxy-1:null) Trying to create in Pool[204|NetworkFilesystem]
  1688. 2013-01-29 14:30:17,621 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to prepare for Nic[744-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-212.70.6.75]
  1689. 2013-01-29 14:30:17,621 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to prepare for Nic[744-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-212.70.6.75]
  1690. 2013-01-29 14:30:17,622 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to prepare for Nic[744-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-212.70.6.75]
  1691. 2013-01-29 14:30:17,622 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to prepare for Nic[744-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-212.70.6.75]
  1692. 2013-01-29 14:30:17,622 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to prepare for Nic[744-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-212.70.6.75]
  1693. 2013-01-29 14:30:17,622 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to prepare for Nic[744-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-212.70.6.75]
  1694. 2013-01-29 14:30:17,622 WARN [network.element.VpcVirtualRouterElement] (secstorage-1:null) Network Ntwk[219|Management|2] is not associated with any VPC
  1695. 2013-01-29 14:30:17,622 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to prepare for Nic[744-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-212.70.6.75]
  1696. 2013-01-29 14:30:17,623 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is acquired for network id 221 as a part of network implement
  1697. 2013-01-29 14:30:17,623 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Network id=221 is already implemented
  1698. 2013-01-29 14:30:17,623 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is released for network id 221 as a part of network implement
  1699. 2013-01-29 14:30:17,774 DEBUG [cloud.template.TemplateManagerImpl] (consoleproxy-1:null) Downloading 3 via 7
  1700. 2013-01-29 14:30:17,776 DEBUG [agent.transport.Request] (consoleproxy-1:null) Seq 7-2090140043: Sending { Cmd , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 100111, [{"storage.PrimaryStorageDownloadCommand":{"localPath":"/mnt/99898908-d913-39c8-b61d-c7e6b6dbd8f0","poolUuid":"99898908-d913-39c8-b61d-c7e6b6dbd8f0","poolId":204,"secondaryStorageUrl":"nfs://cloudmanager.mira.dk/export/mirazone","primaryStorageUrl":"nfs://10.212.212.249/export/drbd10","url":"nfs://cloudmanager.mira.dk/export/mirazone/template/tmpl/1/3/","format":"QCOW2","accountId":1,"name":"routing-3","wait":10800}}] }
  1701. 2013-01-29 14:30:17,814 DEBUG [network.guru.PodBasedNetworkGuru] (secstorage-1:null) Allocated a nic NicProfile[745-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-212.70.6.67-null for VM[SecondaryStorageVm|s-203-VM]
  1702. 2013-01-29 14:30:17,914 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to prepare for Nic[745-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-212.70.6.67]
  1703. 2013-01-29 14:30:17,914 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to prepare for Nic[745-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-212.70.6.67]
  1704. 2013-01-29 14:30:17,914 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to prepare for Nic[745-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-212.70.6.67]
  1705. 2013-01-29 14:30:17,914 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to prepare for Nic[745-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-212.70.6.67]
  1706. 2013-01-29 14:30:17,914 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to prepare for Nic[745-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-212.70.6.67]
  1707. 2013-01-29 14:30:17,914 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to prepare for Nic[745-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-212.70.6.67]
  1708. 2013-01-29 14:30:17,914 WARN [network.element.VpcVirtualRouterElement] (secstorage-1:null) Network Ntwk[221|Storage|4] is not associated with any VPC
  1709. 2013-01-29 14:30:17,914 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to prepare for Nic[745-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-212.70.6.67]
  1710. 2013-01-29 14:30:17,915 DEBUG [cloud.storage.StorageManagerImpl] (secstorage-1:null) Checking if we need to prepare 1 volumes for VM[SecondaryStorageVm|s-203-VM]
  1711. 2013-01-29 14:30:17,973 DEBUG [cloud.storage.StorageManagerImpl] (secstorage-1:null) Creating volume: Vol[205|vm=203|ROOT]
  1712. 2013-01-29 14:30:17,973 DEBUG [cloud.storage.StorageManagerImpl] (secstorage-1:null) Trying to create in Pool[204|NetworkFilesystem]
  1713. 2013-01-29 14:30:18,012 DEBUG [agent.transport.Request] (AgentManager-Handler-14:null) Seq 7-2090140043: Processing: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, [{"Answer":{"result":false,"details":"java.lang.NullPointerException\n\tat com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.createStoragePool(LibvirtStorageAdaptor.java:462)\n\tat com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.getStoragePoolByURI(LibvirtStorageAdaptor.java:745)\n\tat com.cloud.hypervisor.kvm.storage.KVMStoragePoolManager.getStoragePoolByURI(KVMStoragePoolManager.java:52)\n\tat com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:2017)\n\tat com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1009)\n\tat com.cloud.agent.Agent.processRequest(Agent.java:518)\n\tat com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:831)\n\tat com.cloud.utils.nio.Task.run(Task.java:83)\n\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)\n\tat java.lang.Thread.run(Thread.java:679)\n","wait":0}}] }
  1714. 2013-01-29 14:30:18,012 DEBUG [agent.manager.AgentAttache] (AgentManager-Handler-14:null) Seq 7-2090140043: No more commands found
  1715. 2013-01-29 14:30:18,012 DEBUG [agent.transport.Request] (consoleproxy-1:null) Seq 7-2090140043: Received: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, { Answer } }
  1716. 2013-01-29 14:30:18,012 DEBUG [agent.manager.AgentManagerImpl] (consoleproxy-1:null) Details from executing class com.cloud.agent.api.storage.PrimaryStorageDownloadCommand: java.lang.NullPointerException
  1717. at com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.createStoragePool(LibvirtStorageAdaptor.java:462)
  1718. at com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.getStoragePoolByURI(LibvirtStorageAdaptor.java:745)
  1719. at com.cloud.hypervisor.kvm.storage.KVMStoragePoolManager.getStoragePoolByURI(KVMStoragePoolManager.java:52)
  1720. at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:2017)
  1721. at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1009)
  1722. at com.cloud.agent.Agent.processRequest(Agent.java:518)
  1723. at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:831)
  1724. at com.cloud.utils.nio.Task.run(Task.java:83)
  1725. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
  1726. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
  1727. at java.lang.Thread.run(Thread.java:679)
  1728.  
  1729. 2013-01-29 14:30:18,012 ERROR [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Failed to start instance VM[ConsoleProxy|v-32-VM]
  1730. java.lang.ClassCastException: com.cloud.agent.api.Answer cannot be cast to com.cloud.agent.api.storage.PrimaryStorageDownloadAnswer
  1731. at com.cloud.template.TemplateManagerImpl.prepareTemplateForCreate(TemplateManagerImpl.java:663)
  1732. at com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34)
  1733. at com.cloud.storage.StorageManagerImpl.createVolume(StorageManagerImpl.java:3442)
  1734. at com.cloud.storage.StorageManagerImpl.prepare(StorageManagerImpl.java:3351)
  1735. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:754)
  1736. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:472)
  1737. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:465)
  1738. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.startProxy(ConsoleProxyManagerImpl.java:627)
  1739. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.allocCapacity(ConsoleProxyManagerImpl.java:1164)
  1740. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:1981)
  1741. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:173)
  1742. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:113)
  1743. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:34)
  1744. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:83)
  1745. at com.cloud.vm.SystemVmLoadScanner$1.run(SystemVmLoadScanner.java:73)
  1746. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  1747. at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351)
  1748. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178)
  1749. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165)
  1750. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267)
  1751. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
  1752. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
  1753. at java.lang.Thread.run(Thread.java:679)
  1754. 2013-01-29 14:30:18,097 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Cleaning up resources for the vm VM[ConsoleProxy|v-32-VM] in Starting state
  1755. 2013-01-29 14:30:18,098 DEBUG [agent.transport.Request] (consoleproxy-1:null) Seq 7-2090140044: Sending { Cmd , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 100111, [{"StopCommand":{"isProxy":false,"vmName":"v-32-VM","wait":0}}] }
  1756. 2013-01-29 14:30:18,152 DEBUG [cloud.template.TemplateManagerImpl] (secstorage-1:null) Downloading 3 via 7
  1757. 2013-01-29 14:30:18,154 DEBUG [agent.transport.Request] (secstorage-1:null) Seq 7-2090140045: Waiting for Seq 2090140044 Scheduling: { Cmd , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 100111, [{"storage.PrimaryStorageDownloadCommand":{"localPath":"/mnt/99898908-d913-39c8-b61d-c7e6b6dbd8f0","poolUuid":"99898908-d913-39c8-b61d-c7e6b6dbd8f0","poolId":204,"secondaryStorageUrl":"nfs://cloudmanager.mira.dk/export/mirazone","primaryStorageUrl":"nfs://10.212.212.249/export/drbd10","url":"nfs://cloudmanager.mira.dk/export/mirazone/template/tmpl/1/3/","format":"QCOW2","accountId":1,"name":"routing-3","wait":10800}}] }
  1758. 2013-01-29 14:30:18,204 DEBUG [agent.transport.Request] (AgentManager-Handler-8:null) Seq 7-2090140044: Processing: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, [{"StopAnswer":{"vncPort":0,"result":true,"wait":0}}] }
  1759. 2013-01-29 14:30:18,204 DEBUG [agent.manager.AgentAttache] (AgentManager-Handler-8:null) Seq 7-2090140045: Sending now. is current sequence.
  1760. 2013-01-29 14:30:18,204 DEBUG [agent.transport.Request] (consoleproxy-1:null) Seq 7-2090140044: Received: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, { StopAnswer } }
  1761. 2013-01-29 14:30:18,257 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Service SecurityGroup is not supported in the network id=222
  1762. 2013-01-29 14:30:18,314 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VirtualRouter to release Nic[59-32-938697c7-a4c8-406e-8dda-2627d892f21c-212.70.6.202]
  1763. 2013-01-29 14:30:18,314 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking Ovs to release Nic[59-32-938697c7-a4c8-406e-8dda-2627d892f21c-212.70.6.202]
  1764. 2013-01-29 14:30:18,314 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking ExternalDhcpServer to release Nic[59-32-938697c7-a4c8-406e-8dda-2627d892f21c-212.70.6.202]
  1765. 2013-01-29 14:30:18,314 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking BareMetal to release Nic[59-32-938697c7-a4c8-406e-8dda-2627d892f21c-212.70.6.202]
  1766. 2013-01-29 14:30:18,314 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking SecurityGroupProvider to release Nic[59-32-938697c7-a4c8-406e-8dda-2627d892f21c-212.70.6.202]
  1767. 2013-01-29 14:30:18,314 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VpcVirtualRouter to release Nic[59-32-938697c7-a4c8-406e-8dda-2627d892f21c-212.70.6.202]
  1768. 2013-01-29 14:30:18,314 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking NiciraNvp to release Nic[59-32-938697c7-a4c8-406e-8dda-2627d892f21c-212.70.6.202]
  1769. 2013-01-29 14:30:18,416 DEBUG [network.guru.ControlNetworkGuru] (consoleproxy-1:null) Released nic: NicProfile[60-32-null-null-null
  1770. 2013-01-29 14:30:18,465 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VirtualRouter to release Nic[60-32-938697c7-a4c8-406e-8dda-2627d892f21c-null]
  1771. 2013-01-29 14:30:18,465 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking Ovs to release Nic[60-32-938697c7-a4c8-406e-8dda-2627d892f21c-null]
  1772. 2013-01-29 14:30:18,465 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking ExternalDhcpServer to release Nic[60-32-938697c7-a4c8-406e-8dda-2627d892f21c-null]
  1773. 2013-01-29 14:30:18,465 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking BareMetal to release Nic[60-32-938697c7-a4c8-406e-8dda-2627d892f21c-null]
  1774. 2013-01-29 14:30:18,465 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking SecurityGroupProvider to release Nic[60-32-938697c7-a4c8-406e-8dda-2627d892f21c-null]
  1775. 2013-01-29 14:30:18,465 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VpcVirtualRouter to release Nic[60-32-938697c7-a4c8-406e-8dda-2627d892f21c-null]
  1776. 2013-01-29 14:30:18,465 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking NiciraNvp to release Nic[60-32-938697c7-a4c8-406e-8dda-2627d892f21c-null]
  1777. 2013-01-29 14:30:18,507 DEBUG [dc.dao.DataCenterIpAddressDaoImpl] (consoleproxy-1:null) Releasing ip address for reservationId=938697c7-a4c8-406e-8dda-2627d892f21c, instance=61
  1778. 2013-01-29 14:30:18,565 DEBUG [network.guru.PodBasedNetworkGuru] (consoleproxy-1:null) Released nic: NicProfile[61-32-null-null-null
  1779. 2013-01-29 14:30:18,608 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VirtualRouter to release Nic[61-32-938697c7-a4c8-406e-8dda-2627d892f21c-null]
  1780. 2013-01-29 14:30:18,608 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking Ovs to release Nic[61-32-938697c7-a4c8-406e-8dda-2627d892f21c-null]
  1781. 2013-01-29 14:30:18,608 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking ExternalDhcpServer to release Nic[61-32-938697c7-a4c8-406e-8dda-2627d892f21c-null]
  1782. 2013-01-29 14:30:18,608 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking BareMetal to release Nic[61-32-938697c7-a4c8-406e-8dda-2627d892f21c-null]
  1783. 2013-01-29 14:30:18,608 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking SecurityGroupProvider to release Nic[61-32-938697c7-a4c8-406e-8dda-2627d892f21c-null]
  1784. 2013-01-29 14:30:18,608 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VpcVirtualRouter to release Nic[61-32-938697c7-a4c8-406e-8dda-2627d892f21c-null]
  1785. 2013-01-29 14:30:18,608 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking NiciraNvp to release Nic[61-32-938697c7-a4c8-406e-8dda-2627d892f21c-null]
  1786. 2013-01-29 14:30:18,608 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Successfully released network resources for the vm VM[ConsoleProxy|v-32-VM]
  1787. 2013-01-29 14:30:18,608 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Successfully cleanued up resources for the vm VM[ConsoleProxy|v-32-VM] in Starting state
  1788. 2013-01-29 14:30:18,707 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: 7
  1789. 2013-01-29 14:30:18,709 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) Hosts's actual total CPU: 12004 and CPU after applying overprovisioning: 12004
  1790. 2013-01-29 14:30:18,709 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) release cpu from host: 7, old used: 1000,reserved: 0, actual total: 12004, total with overprovisioning: 12004; new used: 500,reserved:0; movedfromreserved: false,moveToReserveredfalse
  1791. 2013-01-29 14:30:18,709 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) release mem from host: 7, old used: 1342177280,reserved: 0, total: 8269606912; new used: 268435456,reserved:0; movedfromreserved: false,moveToReserveredfalse
  1792. 2013-01-29 14:30:18,758 WARN [cloud.consoleproxy.ConsoleProxyManagerImpl] (consoleproxy-1:null) Exception while trying to start console proxy
  1793. com.cloud.exception.AgentUnavailableException: Resource [Host:7] is unreachable: Host 7: Unable to start instance due to com.cloud.agent.api.Answer cannot be cast to com.cloud.agent.api.storage.PrimaryStorageDownloadAnswer
  1794. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:847)
  1795. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:472)
  1796. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:465)
  1797. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.startProxy(ConsoleProxyManagerImpl.java:627)
  1798. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.allocCapacity(ConsoleProxyManagerImpl.java:1164)
  1799. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:1981)
  1800. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:173)
  1801. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:113)
  1802. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:34)
  1803. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:83)
  1804. at com.cloud.vm.SystemVmLoadScanner$1.run(SystemVmLoadScanner.java:73)
  1805. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  1806. at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351)
  1807. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178)
  1808. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165)
  1809. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267)
  1810. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
  1811. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
  1812. at java.lang.Thread.run(Thread.java:679)
  1813. Caused by: java.lang.ClassCastException: com.cloud.agent.api.Answer cannot be cast to com.cloud.agent.api.storage.PrimaryStorageDownloadAnswer
  1814. at com.cloud.template.TemplateManagerImpl.prepareTemplateForCreate(TemplateManagerImpl.java:663)
  1815. at com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34)
  1816. at com.cloud.storage.StorageManagerImpl.createVolume(StorageManagerImpl.java:3442)
  1817. at com.cloud.storage.StorageManagerImpl.prepare(StorageManagerImpl.java:3351)
  1818. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:754)
  1819. ... 19 more
  1820. 2013-01-29 14:30:19,488 DEBUG [agent.transport.Request] (AgentManager-Handler-2:null) Seq 7-2090140045: Processing: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, [{"Answer":{"result":false,"details":"java.lang.NullPointerException\n\tat com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.createStoragePool(LibvirtStorageAdaptor.java:462)\n\tat com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.getStoragePoolByURI(LibvirtStorageAdaptor.java:745)\n\tat com.cloud.hypervisor.kvm.storage.KVMStoragePoolManager.getStoragePoolByURI(KVMStoragePoolManager.java:52)\n\tat com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:2017)\n\tat com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1009)\n\tat com.cloud.agent.Agent.processRequest(Agent.java:518)\n\tat com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:831)\n\tat com.cloud.utils.nio.Task.run(Task.java:83)\n\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)\n\tat java.lang.Thread.run(Thread.java:679)\n","wait":0}}] }
  1821. 2013-01-29 14:30:19,488 DEBUG [agent.manager.AgentAttache] (AgentManager-Handler-2:null) Seq 7-2090140045: No more commands found
  1822. 2013-01-29 14:30:19,488 DEBUG [agent.transport.Request] (secstorage-1:null) Seq 7-2090140045: Received: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, { Answer } }
  1823. 2013-01-29 14:30:19,488 DEBUG [agent.manager.AgentManagerImpl] (secstorage-1:null) Details from executing class com.cloud.agent.api.storage.PrimaryStorageDownloadCommand: java.lang.NullPointerException
  1824. at com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.createStoragePool(LibvirtStorageAdaptor.java:462)
  1825. at com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.getStoragePoolByURI(LibvirtStorageAdaptor.java:745)
  1826. at com.cloud.hypervisor.kvm.storage.KVMStoragePoolManager.getStoragePoolByURI(KVMStoragePoolManager.java:52)
  1827. at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:2017)
  1828. at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1009)
  1829. at com.cloud.agent.Agent.processRequest(Agent.java:518)
  1830. at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:831)
  1831. at com.cloud.utils.nio.Task.run(Task.java:83)
  1832. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
  1833. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
  1834. at java.lang.Thread.run(Thread.java:679)
  1835.  
  1836. 2013-01-29 14:30:19,489 ERROR [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Failed to start instance VM[SecondaryStorageVm|s-203-VM]
  1837. java.lang.ClassCastException: com.cloud.agent.api.Answer cannot be cast to com.cloud.agent.api.storage.PrimaryStorageDownloadAnswer
  1838. at com.cloud.template.TemplateManagerImpl.prepareTemplateForCreate(TemplateManagerImpl.java:663)
  1839. at com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34)
  1840. at com.cloud.storage.StorageManagerImpl.createVolume(StorageManagerImpl.java:3442)
  1841. at com.cloud.storage.StorageManagerImpl.prepare(StorageManagerImpl.java:3351)
  1842. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:754)
  1843. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:472)
  1844. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:465)
  1845. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.startSecStorageVm(SecondaryStorageManagerImpl.java:257)
  1846. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.allocCapacity(SecondaryStorageManagerImpl.java:684)
  1847. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.expandPool(SecondaryStorageManagerImpl.java:1310)
  1848. at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:119)
  1849. at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:50)
  1850. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:106)
  1851. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:34)
  1852. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:83)
  1853. at com.cloud.vm.SystemVmLoadScanner$1.run(SystemVmLoadScanner.java:73)
  1854. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  1855. at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351)
  1856. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178)
  1857. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165)
  1858. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267)
  1859. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
  1860. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
  1861. at java.lang.Thread.run(Thread.java:679)
  1862. 2013-01-29 14:30:19,541 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Cleaning up resources for the vm VM[SecondaryStorageVm|s-203-VM] in Starting state
  1863. 2013-01-29 14:30:19,547 DEBUG [agent.transport.Request] (secstorage-1:null) Seq 7-2090140046: Sending { Cmd , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 100111, [{"StopCommand":{"isProxy":false,"vmName":"s-203-VM","wait":0}}] }
  1864. 2013-01-29 14:30:19,651 DEBUG [agent.transport.Request] (AgentManager-Handler-10:null) Seq 7-2090140046: Processing: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, [{"StopAnswer":{"vncPort":0,"result":true,"wait":0}}] }
  1865. 2013-01-29 14:30:19,651 DEBUG [agent.manager.AgentAttache] (AgentManager-Handler-10:null) Seq 7-2090140046: No more commands found
  1866. 2013-01-29 14:30:19,651 DEBUG [agent.transport.Request] (secstorage-1:null) Seq 7-2090140046: Received: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, { StopAnswer } }
  1867. 2013-01-29 14:30:19,693 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Service SecurityGroup is not supported in the network id=222
  1868. 2013-01-29 14:30:19,742 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to release Nic[742-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-212.70.6.203]
  1869. 2013-01-29 14:30:19,742 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to release Nic[742-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-212.70.6.203]
  1870. 2013-01-29 14:30:19,742 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to release Nic[742-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-212.70.6.203]
  1871. 2013-01-29 14:30:19,742 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to release Nic[742-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-212.70.6.203]
  1872. 2013-01-29 14:30:19,742 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to release Nic[742-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-212.70.6.203]
  1873. 2013-01-29 14:30:19,742 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to release Nic[742-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-212.70.6.203]
  1874. 2013-01-29 14:30:19,742 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to release Nic[742-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-212.70.6.203]
  1875. 2013-01-29 14:30:19,842 DEBUG [network.guru.ControlNetworkGuru] (secstorage-1:null) Released nic: NicProfile[743-203-null-null-null
  1876. 2013-01-29 14:30:19,892 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to release Nic[743-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-null]
  1877. 2013-01-29 14:30:19,892 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to release Nic[743-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-null]
  1878. 2013-01-29 14:30:19,892 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to release Nic[743-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-null]
  1879. 2013-01-29 14:30:19,892 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to release Nic[743-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-null]
  1880. 2013-01-29 14:30:19,892 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to release Nic[743-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-null]
  1881. 2013-01-29 14:30:19,892 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to release Nic[743-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-null]
  1882. 2013-01-29 14:30:19,892 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to release Nic[743-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-null]
  1883. 2013-01-29 14:30:19,943 DEBUG [dc.dao.DataCenterIpAddressDaoImpl] (secstorage-1:null) Releasing ip address for reservationId=5384ec7c-4014-4829-a256-d77e3db5d4d3, instance=744
  1884. 2013-01-29 14:30:19,995 DEBUG [network.guru.PodBasedNetworkGuru] (secstorage-1:null) Released nic: NicProfile[744-203-null-null-null
  1885. 2013-01-29 14:30:20,037 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to release Nic[744-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-null]
  1886. 2013-01-29 14:30:20,037 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to release Nic[744-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-null]
  1887. 2013-01-29 14:30:20,037 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to release Nic[744-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-null]
  1888. 2013-01-29 14:30:20,037 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to release Nic[744-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-null]
  1889. 2013-01-29 14:30:20,037 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to release Nic[744-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-null]
  1890. 2013-01-29 14:30:20,037 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to release Nic[744-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-null]
  1891. 2013-01-29 14:30:20,037 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to release Nic[744-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-null]
  1892. 2013-01-29 14:30:20,080 DEBUG [dc.dao.DataCenterIpAddressDaoImpl] (secstorage-1:null) Releasing ip address for reservationId=5384ec7c-4014-4829-a256-d77e3db5d4d3, instance=745
  1893. 2013-01-29 14:30:20,126 DEBUG [network.guru.PodBasedNetworkGuru] (secstorage-1:null) Released nic: NicProfile[745-203-null-null-null
  1894. 2013-01-29 14:30:20,177 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to release Nic[745-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-null]
  1895. 2013-01-29 14:30:20,177 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to release Nic[745-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-null]
  1896. 2013-01-29 14:30:20,177 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to release Nic[745-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-null]
  1897. 2013-01-29 14:30:20,177 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to release Nic[745-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-null]
  1898. 2013-01-29 14:30:20,177 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to release Nic[745-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-null]
  1899. 2013-01-29 14:30:20,177 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to release Nic[745-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-null]
  1900. 2013-01-29 14:30:20,177 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to release Nic[745-203-5384ec7c-4014-4829-a256-d77e3db5d4d3-null]
  1901. 2013-01-29 14:30:20,177 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Successfully released network resources for the vm VM[SecondaryStorageVm|s-203-VM]
  1902. 2013-01-29 14:30:20,177 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Successfully cleanued up resources for the vm VM[SecondaryStorageVm|s-203-VM] in Starting state
  1903. 2013-01-29 14:30:20,287 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: 7
  1904. 2013-01-29 14:30:20,289 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) Hosts's actual total CPU: 12004 and CPU after applying overprovisioning: 12004
  1905. 2013-01-29 14:30:20,289 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) release cpu from host: 7, old used: 500,reserved: 0, actual total: 12004, total with overprovisioning: 12004; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  1906. 2013-01-29 14:30:20,289 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) release mem from host: 7, old used: 268435456,reserved: 0, total: 8269606912; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  1907. 2013-01-29 14:30:20,330 WARN [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Exception while trying to start secondary storage vm
  1908. com.cloud.exception.AgentUnavailableException: Resource [Host:7] is unreachable: Host 7: Unable to start instance due to com.cloud.agent.api.Answer cannot be cast to com.cloud.agent.api.storage.PrimaryStorageDownloadAnswer
  1909. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:847)
  1910. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:472)
  1911. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:465)
  1912. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.startSecStorageVm(SecondaryStorageManagerImpl.java:257)
  1913. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.allocCapacity(SecondaryStorageManagerImpl.java:684)
  1914. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.expandPool(SecondaryStorageManagerImpl.java:1310)
  1915. at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:119)
  1916. at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:50)
  1917. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:106)
  1918. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:34)
  1919. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:83)
  1920. at com.cloud.vm.SystemVmLoadScanner$1.run(SystemVmLoadScanner.java:73)
  1921. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  1922. at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351)
  1923. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178)
  1924. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165)
  1925. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267)
  1926. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
  1927. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
  1928. at java.lang.Thread.run(Thread.java:679)
  1929. Caused by: java.lang.ClassCastException: com.cloud.agent.api.Answer cannot be cast to com.cloud.agent.api.storage.PrimaryStorageDownloadAnswer
  1930. at com.cloud.template.TemplateManagerImpl.prepareTemplateForCreate(TemplateManagerImpl.java:663)
  1931. at com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34)
  1932. at com.cloud.storage.StorageManagerImpl.createVolume(StorageManagerImpl.java:3442)
  1933. at com.cloud.storage.StorageManagerImpl.prepare(StorageManagerImpl.java:3351)
  1934. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:754)
  1935. ... 20 more
  1936. 2013-01-29 14:30:20,330 INFO [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Unable to start secondary storage vm for standby capacity, secStorageVm vm Id : 203, will recycle it and start a new one
  1937. 2013-01-29 14:30:20,330 INFO [cloud.secstorage.PremiumSecondaryStorageManagerImpl] (secstorage-1:null) Primary secondary storage is not even started, wait until next turn
  1938. 2013-01-29 14:30:32,060 DEBUG [cloud.server.StatsCollector] (StatsCollector-3:null) HostStatsCollector is running...
  1939. 2013-01-29 14:30:32,688 DEBUG [agent.transport.Request] (StatsCollector-3:null) Seq 1-89030383: Received: { Ans: , MgmtId: 60908668245, via: 1, Ver: v1, Flags: 10, { GetHostStatsAnswer } }
  1940. 2013-01-29 14:30:33,304 DEBUG [agent.transport.Request] (StatsCollector-3:null) Seq 4-220941131: Received: { Ans: , MgmtId: 60908668245, via: 4, Ver: v1, Flags: 10, { GetHostStatsAnswer } }
  1941. 2013-01-29 14:30:33,859 DEBUG [agent.transport.Request] (StatsCollector-3:null) Seq 7-2090140047: Received: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 10, { GetHostStatsAnswer } }
  1942. 2013-01-29 14:30:45,898 DEBUG [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Zone 1 is ready to launch secondary storage VM
  1943. 2013-01-29 14:30:45,911 DEBUG [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Zone 3 is ready to launch secondary storage VM
  1944. 2013-01-29 14:30:45,914 INFO [cloud.secstorage.PremiumSecondaryStorageManagerImpl] (secstorage-1:null) No running secondary storage vms found in datacenter id=3, starting one
  1945. 2013-01-29 14:30:45,918 INFO [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Found a stopped secondary storage vm, bring it up to running pool. secStorageVm vm id : 203
  1946. 2013-01-29 14:30:45,922 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
  1947. 2013-01-29 14:30:45,922 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Successfully transitioned to start state for VM[SecondaryStorageVm|s-203-VM] reservation id = 80c38d74-3c06-426a-a9cc-fc9f6df6a4ee
  1948. 2013-01-29 14:30:45,984 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Trying to deploy VM, vm has dcId: 3 and podId: 3
  1949. 2013-01-29 14:30:45,984 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Deploy avoids pods: null, clusters: null, hosts: null
  1950. 2013-01-29 14:30:45,985 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) DeploymentPlanner allocation algorithm: random
  1951. 2013-01-29 14:30:45,985 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Trying to allocate a host and storage pools from dc:3, pod:3,cluster:null, requested cpu: 500, requested ram: 268435456
  1952. 2013-01-29 14:30:45,985 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Is ROOT volume READY (pool already allocated)?: No
  1953. 2013-01-29 14:30:45,985 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Searching resources only under specified Pod: 3
  1954. 2013-01-29 14:30:45,986 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Pod: 3
  1955. 2013-01-29 14:30:45,986 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) CPUOverprovisioningFactor considered: 1.0
  1956. 2013-01-29 14:30:45,990 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Checking resources in Cluster: 3 under Pod: 3
  1957. 2013-01-29 14:30:45,990 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Calling HostAllocators to find suitable hosts
  1958. 2013-01-29 14:30:45,990 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) Looking for hosts in dc: 3 pod:3 cluster:3
  1959. 2013-01-29 14:30:45,991 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) FirstFitAllocator has 1 hosts to check for allocation: [Host[-7-Routing]]
  1960. 2013-01-29 14:30:45,992 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) Found 1 hosts for allocation after prioritization: [Host[-7-Routing]]
  1961. 2013-01-29 14:30:45,992 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=256
  1962. 2013-01-29 14:30:45,992 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) Checking if host: 7 has enough capacity for requested CPU: 500 and requested RAM: 268435456 , cpuOverprovisioningFactor: 1.0
  1963. 2013-01-29 14:30:45,993 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) Hosts's actual total CPU: 12004 and CPU after applying overprovisioning: 12004
  1964. 2013-01-29 14:30:45,993 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) Free CPU: 12004 , Requested CPU: 500
  1965. 2013-01-29 14:30:45,993 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) Free RAM: 8269606912 , Requested RAM: 268435456
  1966. 2013-01-29 14:30:45,993 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) Host has enough CPU and RAM available
  1967. 2013-01-29 14:30:45,993 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 7, used: 0, reserved: 0, actual total: 12004, total with overprovisioning: 12004; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1968. 2013-01-29 14:30:45,994 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 7, used: 0, reserved: 0, total: 8269606912; requested mem: 268435456,alloc_from_last_host?:false ,considerReservedCapacity?: true
  1969. 2013-01-29 14:30:45,994 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) Found a suitable host, adding to list: 7
  1970. 2013-01-29 14:30:45,994 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) Host Allocator returning 1 suitable hosts
  1971. 2013-01-29 14:30:45,994 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Checking suitable pools for volume (Id, Type): (205,ROOT)
  1972. 2013-01-29 14:30:45,994 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) We need to allocate new storagepool for this volume
  1973. 2013-01-29 14:30:45,994 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Calling StoragePoolAllocators to find suitable pools
  1974. 2013-01-29 14:30:45,995 DEBUG [storage.allocator.FirstFitStoragePoolAllocator] (secstorage-1:null) Looking for pools in dc: 3 pod:3 cluster:3
  1975. 2013-01-29 14:30:45,995 DEBUG [storage.allocator.FirstFitStoragePoolAllocator] (secstorage-1:null) FirstFitStoragePoolAllocator has 1 pools to check for allocation
  1976. 2013-01-29 14:30:45,995 DEBUG [storage.allocator.AbstractStoragePoolAllocator] (secstorage-1:null) Checking if storage pool is suitable, name: DRDB10 ,poolId: 204
  1977. 2013-01-29 14:30:45,995 DEBUG [storage.allocator.AbstractStoragePoolAllocator] (secstorage-1:null) Is localStorageAllocationNeeded? false
  1978. 2013-01-29 14:30:45,995 DEBUG [storage.allocator.AbstractStoragePoolAllocator] (secstorage-1:null) Is storage pool shared? true
  1979. 2013-01-29 14:30:45,996 DEBUG [cloud.storage.StorageManagerImpl] (secstorage-1:null) Checking pool 204 for storage, totalSize: 1968949690368, usedBytes: 204734464, usedPct: 1.039815618456634E-4, disable threshold: 0.85
  1980. 2013-01-29 14:30:45,998 DEBUG [cloud.storage.StorageManagerImpl] (secstorage-1:null) Checking pool: 204 for volume allocation [Vol[205|vm=203|ROOT]], maxSize : 3937899380736, totalAllocatedSize : 0, askingSize : 0, allocated disable threshold: 0.85
  1981. 2013-01-29 14:30:45,998 DEBUG [storage.allocator.FirstFitStoragePoolAllocator] (secstorage-1:null) FirstFitStoragePoolAllocator returning 1 suitable storage pools
  1982. 2013-01-29 14:30:45,998 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Trying to find a potenial host and associated storage pools from the suitable host/pool lists for this VM
  1983. 2013-01-29 14:30:45,998 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Checking if host: 7 can access any suitable storage pool for volume: ROOT
  1984. 2013-01-29 14:30:45,999 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Host: 7 can access pool: 204
  1985. 2013-01-29 14:30:45,999 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Found a potential host id: 7 name: mc1 and associated storage pools for this VM
  1986. 2013-01-29 14:30:45,999 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Returning Deployment Destination: Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(3)-Pod(3)-Cluster(3)-Host(7)-Storage(Volume(205|ROOT-->Pool(204))]
  1987. 2013-01-29 14:30:45,999 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Deployment found - P0=VM[SecondaryStorageVm|s-203-VM], P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(3)-Pod(3)-Cluster(3)-Host(7)-Storage(Volume(205|ROOT-->Pool(204))]
  1988. 2013-01-29 14:30:46,015 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl] (consoleproxy-1:null) Zone 1 is ready to launch console proxy
  1989. 2013-01-29 14:30:46,018 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl] (consoleproxy-1:null) Zone 3 is ready to launch console proxy
  1990. 2013-01-29 14:30:46,018 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl] (consoleproxy-1:null) Expand console proxy standby capacity for zone Mira
  1991. 2013-01-29 14:30:46,022 INFO [cloud.consoleproxy.ConsoleProxyManagerImpl] (consoleproxy-1:null) Found a stopped console proxy, bring it up to running pool. proxy vm id : 32
  1992. 2013-01-29 14:30:46,026 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
  1993. 2013-01-29 14:30:46,026 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Successfully transitioned to start state for VM[ConsoleProxy|v-32-VM] reservation id = 5308ad64-36d0-4947-a02c-521899824bac
  1994. 2013-01-29 14:30:46,085 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Trying to deploy VM, vm has dcId: 3 and podId: 3
  1995. 2013-01-29 14:30:46,085 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Deploy avoids pods: null, clusters: null, hosts: null
  1996. 2013-01-29 14:30:46,086 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) DeploymentPlanner allocation algorithm: random
  1997. 2013-01-29 14:30:46,086 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Trying to allocate a host and storage pools from dc:3, pod:3,cluster:null, requested cpu: 500, requested ram: 1073741824
  1998. 2013-01-29 14:30:46,086 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Is ROOT volume READY (pool already allocated)?: No
  1999. 2013-01-29 14:30:46,086 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Searching resources only under specified Pod: 3
  2000. 2013-01-29 14:30:46,087 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Pod: 3
  2001. 2013-01-29 14:30:46,087 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) CPUOverprovisioningFactor considered: 1.0
  2002. 2013-01-29 14:30:46,090 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Checking resources in Cluster: 3 under Pod: 3
  2003. 2013-01-29 14:30:46,090 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Calling HostAllocators to find suitable hosts
  2004. 2013-01-29 14:30:46,090 DEBUG [allocator.impl.FirstFitAllocator] (consoleproxy-1:FirstFitRoutingAllocator) Looking for hosts in dc: 3 pod:3 cluster:3
  2005. 2013-01-29 14:30:46,091 DEBUG [allocator.impl.FirstFitAllocator] (consoleproxy-1:FirstFitRoutingAllocator) FirstFitAllocator has 1 hosts to check for allocation: [Host[-7-Routing]]
  2006. 2013-01-29 14:30:46,092 DEBUG [allocator.impl.FirstFitAllocator] (consoleproxy-1:FirstFitRoutingAllocator) Found 1 hosts for allocation after prioritization: [Host[-7-Routing]]
  2007. 2013-01-29 14:30:46,092 DEBUG [allocator.impl.FirstFitAllocator] (consoleproxy-1:FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=1024
  2008. 2013-01-29 14:30:46,093 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) Checking if host: 7 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  2009. 2013-01-29 14:30:46,094 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) Hosts's actual total CPU: 12004 and CPU after applying overprovisioning: 12004
  2010. 2013-01-29 14:30:46,094 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) Free CPU: 12004 , Requested CPU: 500
  2011. 2013-01-29 14:30:46,094 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) Free RAM: 8269606912 , Requested RAM: 1073741824
  2012. 2013-01-29 14:30:46,094 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) Host has enough CPU and RAM available
  2013. 2013-01-29 14:30:46,094 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 7, used: 0, reserved: 0, actual total: 12004, total with overprovisioning: 12004; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  2014. 2013-01-29 14:30:46,094 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 7, used: 0, reserved: 0, total: 8269606912; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  2015. 2013-01-29 14:30:46,094 DEBUG [allocator.impl.FirstFitAllocator] (consoleproxy-1:FirstFitRoutingAllocator) Found a suitable host, adding to list: 7
  2016. 2013-01-29 14:30:46,094 DEBUG [allocator.impl.FirstFitAllocator] (consoleproxy-1:FirstFitRoutingAllocator) Host Allocator returning 1 suitable hosts
  2017. 2013-01-29 14:30:46,095 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Checking suitable pools for volume (Id, Type): (34,ROOT)
  2018. 2013-01-29 14:30:46,095 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) We need to allocate new storagepool for this volume
  2019. 2013-01-29 14:30:46,095 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Calling StoragePoolAllocators to find suitable pools
  2020. 2013-01-29 14:30:46,095 DEBUG [storage.allocator.FirstFitStoragePoolAllocator] (consoleproxy-1:null) Looking for pools in dc: 3 pod:3 cluster:3
  2021. 2013-01-29 14:30:46,096 DEBUG [storage.allocator.FirstFitStoragePoolAllocator] (consoleproxy-1:null) FirstFitStoragePoolAllocator has 1 pools to check for allocation
  2022. 2013-01-29 14:30:46,096 DEBUG [storage.allocator.AbstractStoragePoolAllocator] (consoleproxy-1:null) Checking if storage pool is suitable, name: DRDB10 ,poolId: 204
  2023. 2013-01-29 14:30:46,096 DEBUG [storage.allocator.AbstractStoragePoolAllocator] (consoleproxy-1:null) Is localStorageAllocationNeeded? false
  2024. 2013-01-29 14:30:46,096 DEBUG [storage.allocator.AbstractStoragePoolAllocator] (consoleproxy-1:null) Is storage pool shared? true
  2025. 2013-01-29 14:30:46,097 DEBUG [cloud.storage.StorageManagerImpl] (consoleproxy-1:null) Checking pool 204 for storage, totalSize: 1968949690368, usedBytes: 204734464, usedPct: 1.039815618456634E-4, disable threshold: 0.85
  2026. 2013-01-29 14:30:46,098 DEBUG [cloud.storage.StorageManagerImpl] (consoleproxy-1:null) Checking pool: 204 for volume allocation [Vol[34|vm=32|ROOT]], maxSize : 3937899380736, totalAllocatedSize : 0, askingSize : 0, allocated disable threshold: 0.85
  2027. 2013-01-29 14:30:46,098 DEBUG [storage.allocator.FirstFitStoragePoolAllocator] (consoleproxy-1:null) FirstFitStoragePoolAllocator returning 1 suitable storage pools
  2028. 2013-01-29 14:30:46,098 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Trying to find a potenial host and associated storage pools from the suitable host/pool lists for this VM
  2029. 2013-01-29 14:30:46,098 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Checking if host: 7 can access any suitable storage pool for volume: ROOT
  2030. 2013-01-29 14:30:46,099 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Host: 7 can access pool: 204
  2031. 2013-01-29 14:30:46,099 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Found a potential host id: 7 name: mc1 and associated storage pools for this VM
  2032. 2013-01-29 14:30:46,100 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Returning Deployment Destination: Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(3)-Pod(3)-Cluster(3)-Host(7)-Storage(Volume(34|ROOT-->Pool(204))]
  2033. 2013-01-29 14:30:46,100 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Deployment found - P0=VM[ConsoleProxy|v-32-VM], P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(3)-Pod(3)-Cluster(3)-Host(7)-Storage(Volume(34|ROOT-->Pool(204))]
  2034. 2013-01-29 14:30:46,141 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) VM state transitted from :Starting to Starting with event: OperationRetryvm's original host id: null new host id: 7 host id before state transition: null
  2035. 2013-01-29 14:30:46,151 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) Hosts's actual total CPU: 12004 and CPU after applying overprovisioning: 12004
  2036. 2013-01-29 14:30:46,151 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) We are allocating VM, increasing the used capacity of this host:7
  2037. 2013-01-29 14:30:46,151 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) Current Used CPU: 0 , Free CPU:12004 ,Requested CPU: 500
  2038. 2013-01-29 14:30:46,151 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) Current Used RAM: 0 , Free RAM:8269606912 ,Requested RAM: 268435456
  2039. 2013-01-29 14:30:46,151 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) CPU STATS after allocation: for host: 7, old used: 0, old reserved: 0, actual total: 12004, total with overprovisioning: 12004; new used:500, reserved:0; requested cpu:500,alloc_from_last:false
  2040. 2013-01-29 14:30:46,151 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) RAM STATS after allocation: for host: 7, old used: 0, old reserved: 0, total: 8269606912; new used: 268435456, reserved: 0; requested mem: 268435456,alloc_from_last:false
  2041. 2013-01-29 14:30:46,249 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) VM is being created in podId: 3
  2042. 2013-01-29 14:30:46,251 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is acquired for network id 222 as a part of network implement
  2043. 2013-01-29 14:30:46,252 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Network id=222 is already implemented
  2044. 2013-01-29 14:30:46,252 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is released for network id 222 as a part of network implement
  2045. 2013-01-29 14:30:46,294 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) VM state transitted from :Starting to Starting with event: OperationRetryvm's original host id: null new host id: 7 host id before state transition: null
  2046. 2013-01-29 14:30:46,298 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) Hosts's actual total CPU: 12004 and CPU after applying overprovisioning: 12004
  2047. 2013-01-29 14:30:46,298 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) We are allocating VM, increasing the used capacity of this host:7
  2048. 2013-01-29 14:30:46,298 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) Current Used CPU: 500 , Free CPU:11504 ,Requested CPU: 500
  2049. 2013-01-29 14:30:46,298 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) Current Used RAM: 268435456 , Free RAM:8001171456 ,Requested RAM: 1073741824
  2050. 2013-01-29 14:30:46,298 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) CPU STATS after allocation: for host: 7, old used: 500, old reserved: 0, actual total: 12004, total with overprovisioning: 12004; new used:1000, reserved:0; requested cpu:500,alloc_from_last:false
  2051. 2013-01-29 14:30:46,298 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) RAM STATS after allocation: for host: 7, old used: 268435456, old reserved: 0, total: 8269606912; new used: 1342177280, reserved: 0; requested mem: 1073741824,alloc_from_last:false
  2052. 2013-01-29 14:30:46,336 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Service SecurityGroup is not supported in the network id=222
  2053. 2013-01-29 14:30:46,385 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) VM is being created in podId: 3
  2054. 2013-01-29 14:30:46,387 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Lock is acquired for network id 222 as a part of network implement
  2055. 2013-01-29 14:30:46,387 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Network id=222 is already implemented
  2056. 2013-01-29 14:30:46,387 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Lock is released for network id 222 as a part of network implement
  2057. 2013-01-29 14:30:46,428 DEBUG [network.router.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:null) Found 5 routers.
  2058. 2013-01-29 14:30:46,452 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to prepare for Nic[742-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-212.70.6.203]
  2059. 2013-01-29 14:30:46,452 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to prepare for Nic[742-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-212.70.6.203]
  2060. 2013-01-29 14:30:46,452 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to prepare for Nic[742-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-212.70.6.203]
  2061. 2013-01-29 14:30:46,452 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to prepare for Nic[742-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-212.70.6.203]
  2062. 2013-01-29 14:30:46,452 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to prepare for Nic[742-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-212.70.6.203]
  2063. 2013-01-29 14:30:46,452 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to prepare for Nic[742-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-212.70.6.203]
  2064. 2013-01-29 14:30:46,452 WARN [network.element.VpcVirtualRouterElement] (secstorage-1:null) Network Ntwk[222|Guest|7] is not associated with any VPC
  2065. 2013-01-29 14:30:46,453 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to prepare for Nic[742-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-212.70.6.203]
  2066. 2013-01-29 14:30:46,453 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Service SecurityGroup is not supported in the network id=222
  2067. 2013-01-29 14:30:46,454 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is acquired for network id 220 as a part of network implement
  2068. 2013-01-29 14:30:46,454 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Network id=220 is already implemented
  2069. 2013-01-29 14:30:46,454 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is released for network id 220 as a part of network implement
  2070. 2013-01-29 14:30:46,503 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Service SecurityGroup is not supported in the network id=222
  2071. 2013-01-29 14:30:46,612 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VirtualRouter to prepare for Nic[59-32-5308ad64-36d0-4947-a02c-521899824bac-212.70.6.202]
  2072. 2013-01-29 14:30:46,612 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking Ovs to prepare for Nic[59-32-5308ad64-36d0-4947-a02c-521899824bac-212.70.6.202]
  2073. 2013-01-29 14:30:46,612 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking ExternalDhcpServer to prepare for Nic[59-32-5308ad64-36d0-4947-a02c-521899824bac-212.70.6.202]
  2074. 2013-01-29 14:30:46,612 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking BareMetal to prepare for Nic[59-32-5308ad64-36d0-4947-a02c-521899824bac-212.70.6.202]
  2075. 2013-01-29 14:30:46,612 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking SecurityGroupProvider to prepare for Nic[59-32-5308ad64-36d0-4947-a02c-521899824bac-212.70.6.202]
  2076. 2013-01-29 14:30:46,612 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VpcVirtualRouter to prepare for Nic[59-32-5308ad64-36d0-4947-a02c-521899824bac-212.70.6.202]
  2077. 2013-01-29 14:30:46,612 WARN [network.element.VpcVirtualRouterElement] (consoleproxy-1:null) Network Ntwk[222|Guest|7] is not associated with any VPC
  2078. 2013-01-29 14:30:46,612 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking NiciraNvp to prepare for Nic[59-32-5308ad64-36d0-4947-a02c-521899824bac-212.70.6.202]
  2079. 2013-01-29 14:30:46,612 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Service SecurityGroup is not supported in the network id=222
  2080. 2013-01-29 14:30:46,613 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Lock is acquired for network id 220 as a part of network implement
  2081. 2013-01-29 14:30:46,614 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Network id=220 is already implemented
  2082. 2013-01-29 14:30:46,614 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Lock is released for network id 220 as a part of network implement
  2083. 2013-01-29 14:30:46,753 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to prepare for Nic[743-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-169.254.3.195]
  2084. 2013-01-29 14:30:46,753 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to prepare for Nic[743-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-169.254.3.195]
  2085. 2013-01-29 14:30:46,753 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to prepare for Nic[743-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-169.254.3.195]
  2086. 2013-01-29 14:30:46,753 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to prepare for Nic[743-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-169.254.3.195]
  2087. 2013-01-29 14:30:46,753 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to prepare for Nic[743-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-169.254.3.195]
  2088. 2013-01-29 14:30:46,753 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to prepare for Nic[743-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-169.254.3.195]
  2089. 2013-01-29 14:30:46,753 WARN [network.element.VpcVirtualRouterElement] (secstorage-1:null) Network Ntwk[220|Control|3] is not associated with any VPC
  2090. 2013-01-29 14:30:46,753 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to prepare for Nic[743-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-169.254.3.195]
  2091. 2013-01-29 14:30:46,754 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is acquired for network id 219 as a part of network implement
  2092. 2013-01-29 14:30:46,754 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Network id=219 is already implemented
  2093. 2013-01-29 14:30:46,754 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is released for network id 219 as a part of network implement
  2094. 2013-01-29 14:30:46,878 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VirtualRouter to prepare for Nic[60-32-5308ad64-36d0-4947-a02c-521899824bac-169.254.2.52]
  2095. 2013-01-29 14:30:46,879 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking Ovs to prepare for Nic[60-32-5308ad64-36d0-4947-a02c-521899824bac-169.254.2.52]
  2096. 2013-01-29 14:30:46,879 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking ExternalDhcpServer to prepare for Nic[60-32-5308ad64-36d0-4947-a02c-521899824bac-169.254.2.52]
  2097. 2013-01-29 14:30:46,879 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking BareMetal to prepare for Nic[60-32-5308ad64-36d0-4947-a02c-521899824bac-169.254.2.52]
  2098. 2013-01-29 14:30:46,879 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking SecurityGroupProvider to prepare for Nic[60-32-5308ad64-36d0-4947-a02c-521899824bac-169.254.2.52]
  2099. 2013-01-29 14:30:46,879 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VpcVirtualRouter to prepare for Nic[60-32-5308ad64-36d0-4947-a02c-521899824bac-169.254.2.52]
  2100. 2013-01-29 14:30:46,879 WARN [network.element.VpcVirtualRouterElement] (consoleproxy-1:null) Network Ntwk[220|Control|3] is not associated with any VPC
  2101. 2013-01-29 14:30:46,879 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking NiciraNvp to prepare for Nic[60-32-5308ad64-36d0-4947-a02c-521899824bac-169.254.2.52]
  2102. 2013-01-29 14:30:46,880 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Lock is acquired for network id 219 as a part of network implement
  2103. 2013-01-29 14:30:46,880 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Network id=219 is already implemented
  2104. 2013-01-29 14:30:46,880 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Lock is released for network id 219 as a part of network implement
  2105. 2013-01-29 14:30:46,930 DEBUG [network.guru.PodBasedNetworkGuru] (secstorage-1:null) Allocated a nic NicProfile[744-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-212.70.6.85-null for VM[SecondaryStorageVm|s-203-VM]
  2106. 2013-01-29 14:30:47,037 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to prepare for Nic[744-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-212.70.6.85]
  2107. 2013-01-29 14:30:47,037 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to prepare for Nic[744-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-212.70.6.85]
  2108. 2013-01-29 14:30:47,037 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to prepare for Nic[744-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-212.70.6.85]
  2109. 2013-01-29 14:30:47,037 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to prepare for Nic[744-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-212.70.6.85]
  2110. 2013-01-29 14:30:47,038 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to prepare for Nic[744-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-212.70.6.85]
  2111. 2013-01-29 14:30:47,038 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to prepare for Nic[744-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-212.70.6.85]
  2112. 2013-01-29 14:30:47,038 WARN [network.element.VpcVirtualRouterElement] (secstorage-1:null) Network Ntwk[219|Management|2] is not associated with any VPC
  2113. 2013-01-29 14:30:47,038 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to prepare for Nic[744-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-212.70.6.85]
  2114. 2013-01-29 14:30:47,039 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is acquired for network id 221 as a part of network implement
  2115. 2013-01-29 14:30:47,039 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Network id=221 is already implemented
  2116. 2013-01-29 14:30:47,039 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is released for network id 221 as a part of network implement
  2117. 2013-01-29 14:30:47,079 DEBUG [network.guru.PodBasedNetworkGuru] (consoleproxy-1:null) Allocated a nic NicProfile[61-32-5308ad64-36d0-4947-a02c-521899824bac-212.70.6.74-null for VM[ConsoleProxy|v-32-VM]
  2118. 2013-01-29 14:30:47,163 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VirtualRouter to prepare for Nic[61-32-5308ad64-36d0-4947-a02c-521899824bac-212.70.6.74]
  2119. 2013-01-29 14:30:47,163 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking Ovs to prepare for Nic[61-32-5308ad64-36d0-4947-a02c-521899824bac-212.70.6.74]
  2120. 2013-01-29 14:30:47,163 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking ExternalDhcpServer to prepare for Nic[61-32-5308ad64-36d0-4947-a02c-521899824bac-212.70.6.74]
  2121. 2013-01-29 14:30:47,163 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking BareMetal to prepare for Nic[61-32-5308ad64-36d0-4947-a02c-521899824bac-212.70.6.74]
  2122. 2013-01-29 14:30:47,163 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking SecurityGroupProvider to prepare for Nic[61-32-5308ad64-36d0-4947-a02c-521899824bac-212.70.6.74]
  2123. 2013-01-29 14:30:47,163 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VpcVirtualRouter to prepare for Nic[61-32-5308ad64-36d0-4947-a02c-521899824bac-212.70.6.74]
  2124. 2013-01-29 14:30:47,163 WARN [network.element.VpcVirtualRouterElement] (consoleproxy-1:null) Network Ntwk[219|Management|2] is not associated with any VPC
  2125. 2013-01-29 14:30:47,163 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking NiciraNvp to prepare for Nic[61-32-5308ad64-36d0-4947-a02c-521899824bac-212.70.6.74]
  2126. 2013-01-29 14:30:47,164 DEBUG [cloud.storage.StorageManagerImpl] (consoleproxy-1:null) Checking if we need to prepare 1 volumes for VM[ConsoleProxy|v-32-VM]
  2127. 2013-01-29 14:30:47,213 DEBUG [network.guru.PodBasedNetworkGuru] (secstorage-1:null) Allocated a nic NicProfile[745-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-212.70.6.70-null for VM[SecondaryStorageVm|s-203-VM]
  2128. 2013-01-29 14:30:47,264 DEBUG [cloud.storage.StorageManagerImpl] (consoleproxy-1:null) Creating volume: Vol[34|vm=32|ROOT]
  2129. 2013-01-29 14:30:47,265 DEBUG [cloud.storage.StorageManagerImpl] (consoleproxy-1:null) Trying to create in Pool[204|NetworkFilesystem]
  2130. 2013-01-29 14:30:47,305 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to prepare for Nic[745-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-212.70.6.70]
  2131. 2013-01-29 14:30:47,306 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to prepare for Nic[745-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-212.70.6.70]
  2132. 2013-01-29 14:30:47,306 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to prepare for Nic[745-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-212.70.6.70]
  2133. 2013-01-29 14:30:47,306 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to prepare for Nic[745-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-212.70.6.70]
  2134. 2013-01-29 14:30:47,306 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to prepare for Nic[745-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-212.70.6.70]
  2135. 2013-01-29 14:30:47,306 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to prepare for Nic[745-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-212.70.6.70]
  2136. 2013-01-29 14:30:47,306 WARN [network.element.VpcVirtualRouterElement] (secstorage-1:null) Network Ntwk[221|Storage|4] is not associated with any VPC
  2137. 2013-01-29 14:30:47,306 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to prepare for Nic[745-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-212.70.6.70]
  2138. 2013-01-29 14:30:47,307 DEBUG [cloud.storage.StorageManagerImpl] (secstorage-1:null) Checking if we need to prepare 1 volumes for VM[SecondaryStorageVm|s-203-VM]
  2139. 2013-01-29 14:30:47,414 DEBUG [cloud.storage.StorageManagerImpl] (secstorage-1:null) Creating volume: Vol[205|vm=203|ROOT]
  2140. 2013-01-29 14:30:47,414 DEBUG [cloud.storage.StorageManagerImpl] (secstorage-1:null) Trying to create in Pool[204|NetworkFilesystem]
  2141. 2013-01-29 14:30:47,468 DEBUG [cloud.template.TemplateManagerImpl] (consoleproxy-1:null) Downloading 3 via 7
  2142. 2013-01-29 14:30:47,470 DEBUG [agent.transport.Request] (consoleproxy-1:null) Seq 7-2090140048: Sending { Cmd , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 100111, [{"storage.PrimaryStorageDownloadCommand":{"localPath":"/mnt/99898908-d913-39c8-b61d-c7e6b6dbd8f0","poolUuid":"99898908-d913-39c8-b61d-c7e6b6dbd8f0","poolId":204,"secondaryStorageUrl":"nfs://cloudmanager.mira.dk/export/mirazone","primaryStorageUrl":"nfs://10.212.212.249/export/drbd10","url":"nfs://cloudmanager.mira.dk/export/mirazone/template/tmpl/1/3/","format":"QCOW2","accountId":1,"name":"routing-3","wait":10800}}] }
  2143. 2013-01-29 14:30:47,611 DEBUG [agent.transport.Request] (AgentManager-Handler-4:null) Seq 7-2090140048: Processing: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, [{"Answer":{"result":false,"details":"java.lang.NullPointerException\n\tat com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.createStoragePool(LibvirtStorageAdaptor.java:462)\n\tat com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.getStoragePoolByURI(LibvirtStorageAdaptor.java:745)\n\tat com.cloud.hypervisor.kvm.storage.KVMStoragePoolManager.getStoragePoolByURI(KVMStoragePoolManager.java:52)\n\tat com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:2017)\n\tat com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1009)\n\tat com.cloud.agent.Agent.processRequest(Agent.java:518)\n\tat com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:831)\n\tat com.cloud.utils.nio.Task.run(Task.java:83)\n\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)\n\tat java.lang.Thread.run(Thread.java:679)\n","wait":0}}] }
  2144. 2013-01-29 14:30:47,611 DEBUG [agent.manager.AgentAttache] (AgentManager-Handler-4:null) Seq 7-2090140048: No more commands found
  2145. 2013-01-29 14:30:47,611 DEBUG [agent.transport.Request] (consoleproxy-1:null) Seq 7-2090140048: Received: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, { Answer } }
  2146. 2013-01-29 14:30:47,611 DEBUG [agent.manager.AgentManagerImpl] (consoleproxy-1:null) Details from executing class com.cloud.agent.api.storage.PrimaryStorageDownloadCommand: java.lang.NullPointerException
  2147. at com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.createStoragePool(LibvirtStorageAdaptor.java:462)
  2148. at com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.getStoragePoolByURI(LibvirtStorageAdaptor.java:745)
  2149. at com.cloud.hypervisor.kvm.storage.KVMStoragePoolManager.getStoragePoolByURI(KVMStoragePoolManager.java:52)
  2150. at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:2017)
  2151. at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1009)
  2152. at com.cloud.agent.Agent.processRequest(Agent.java:518)
  2153. at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:831)
  2154. at com.cloud.utils.nio.Task.run(Task.java:83)
  2155. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
  2156. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
  2157. at java.lang.Thread.run(Thread.java:679)
  2158.  
  2159. 2013-01-29 14:30:47,611 ERROR [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Failed to start instance VM[ConsoleProxy|v-32-VM]
  2160. java.lang.ClassCastException: com.cloud.agent.api.Answer cannot be cast to com.cloud.agent.api.storage.PrimaryStorageDownloadAnswer
  2161. at com.cloud.template.TemplateManagerImpl.prepareTemplateForCreate(TemplateManagerImpl.java:663)
  2162. at com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34)
  2163. at com.cloud.storage.StorageManagerImpl.createVolume(StorageManagerImpl.java:3442)
  2164. at com.cloud.storage.StorageManagerImpl.prepare(StorageManagerImpl.java:3351)
  2165. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:754)
  2166. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:472)
  2167. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:465)
  2168. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.startProxy(ConsoleProxyManagerImpl.java:627)
  2169. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.allocCapacity(ConsoleProxyManagerImpl.java:1164)
  2170. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:1981)
  2171. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:173)
  2172. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:113)
  2173. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:34)
  2174. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:83)
  2175. at com.cloud.vm.SystemVmLoadScanner$1.run(SystemVmLoadScanner.java:73)
  2176. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  2177. at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351)
  2178. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178)
  2179. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165)
  2180. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267)
  2181. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
  2182. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
  2183. at java.lang.Thread.run(Thread.java:679)
  2184. 2013-01-29 14:30:47,656 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Cleaning up resources for the vm VM[ConsoleProxy|v-32-VM] in Starting state
  2185. 2013-01-29 14:30:47,657 DEBUG [agent.transport.Request] (consoleproxy-1:null) Seq 7-2090140049: Sending { Cmd , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 100111, [{"StopCommand":{"isProxy":false,"vmName":"v-32-VM","wait":0}}] }
  2186. 2013-01-29 14:30:47,762 DEBUG [agent.transport.Request] (AgentManager-Handler-11:null) Seq 7-2090140049: Processing: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, [{"StopAnswer":{"vncPort":0,"result":true,"wait":0}}] }
  2187. 2013-01-29 14:30:47,762 DEBUG [agent.manager.AgentAttache] (AgentManager-Handler-11:null) Seq 7-2090140049: No more commands found
  2188. 2013-01-29 14:30:47,762 DEBUG [agent.transport.Request] (consoleproxy-1:null) Seq 7-2090140049: Received: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, { StopAnswer } }
  2189. 2013-01-29 14:30:47,815 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Service SecurityGroup is not supported in the network id=222
  2190. 2013-01-29 14:30:47,923 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VirtualRouter to release Nic[59-32-5308ad64-36d0-4947-a02c-521899824bac-212.70.6.202]
  2191. 2013-01-29 14:30:47,924 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking Ovs to release Nic[59-32-5308ad64-36d0-4947-a02c-521899824bac-212.70.6.202]
  2192. 2013-01-29 14:30:47,924 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking ExternalDhcpServer to release Nic[59-32-5308ad64-36d0-4947-a02c-521899824bac-212.70.6.202]
  2193. 2013-01-29 14:30:47,924 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking BareMetal to release Nic[59-32-5308ad64-36d0-4947-a02c-521899824bac-212.70.6.202]
  2194. 2013-01-29 14:30:47,924 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking SecurityGroupProvider to release Nic[59-32-5308ad64-36d0-4947-a02c-521899824bac-212.70.6.202]
  2195. 2013-01-29 14:30:47,924 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VpcVirtualRouter to release Nic[59-32-5308ad64-36d0-4947-a02c-521899824bac-212.70.6.202]
  2196. 2013-01-29 14:30:47,924 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking NiciraNvp to release Nic[59-32-5308ad64-36d0-4947-a02c-521899824bac-212.70.6.202]
  2197. 2013-01-29 14:30:48,015 DEBUG [network.guru.ControlNetworkGuru] (consoleproxy-1:null) Released nic: NicProfile[60-32-null-null-null
  2198. 2013-01-29 14:30:48,066 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VirtualRouter to release Nic[60-32-5308ad64-36d0-4947-a02c-521899824bac-null]
  2199. 2013-01-29 14:30:48,066 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking Ovs to release Nic[60-32-5308ad64-36d0-4947-a02c-521899824bac-null]
  2200. 2013-01-29 14:30:48,066 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking ExternalDhcpServer to release Nic[60-32-5308ad64-36d0-4947-a02c-521899824bac-null]
  2201. 2013-01-29 14:30:48,066 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking BareMetal to release Nic[60-32-5308ad64-36d0-4947-a02c-521899824bac-null]
  2202. 2013-01-29 14:30:48,066 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking SecurityGroupProvider to release Nic[60-32-5308ad64-36d0-4947-a02c-521899824bac-null]
  2203. 2013-01-29 14:30:48,066 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VpcVirtualRouter to release Nic[60-32-5308ad64-36d0-4947-a02c-521899824bac-null]
  2204. 2013-01-29 14:30:48,066 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking NiciraNvp to release Nic[60-32-5308ad64-36d0-4947-a02c-521899824bac-null]
  2205. 2013-01-29 14:30:48,117 DEBUG [dc.dao.DataCenterIpAddressDaoImpl] (consoleproxy-1:null) Releasing ip address for reservationId=5308ad64-36d0-4947-a02c-521899824bac, instance=61
  2206. 2013-01-29 14:30:48,159 DEBUG [network.guru.PodBasedNetworkGuru] (consoleproxy-1:null) Released nic: NicProfile[61-32-null-null-null
  2207. 2013-01-29 14:30:48,202 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VirtualRouter to release Nic[61-32-5308ad64-36d0-4947-a02c-521899824bac-null]
  2208. 2013-01-29 14:30:48,202 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking Ovs to release Nic[61-32-5308ad64-36d0-4947-a02c-521899824bac-null]
  2209. 2013-01-29 14:30:48,202 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking ExternalDhcpServer to release Nic[61-32-5308ad64-36d0-4947-a02c-521899824bac-null]
  2210. 2013-01-29 14:30:48,202 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking BareMetal to release Nic[61-32-5308ad64-36d0-4947-a02c-521899824bac-null]
  2211. 2013-01-29 14:30:48,202 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking SecurityGroupProvider to release Nic[61-32-5308ad64-36d0-4947-a02c-521899824bac-null]
  2212. 2013-01-29 14:30:48,202 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VpcVirtualRouter to release Nic[61-32-5308ad64-36d0-4947-a02c-521899824bac-null]
  2213. 2013-01-29 14:30:48,202 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking NiciraNvp to release Nic[61-32-5308ad64-36d0-4947-a02c-521899824bac-null]
  2214. 2013-01-29 14:30:48,202 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Successfully released network resources for the vm VM[ConsoleProxy|v-32-VM]
  2215. 2013-01-29 14:30:48,202 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Successfully cleanued up resources for the vm VM[ConsoleProxy|v-32-VM] in Starting state
  2216. 2013-01-29 14:30:48,294 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: 7
  2217. 2013-01-29 14:30:48,296 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) Hosts's actual total CPU: 12004 and CPU after applying overprovisioning: 12004
  2218. 2013-01-29 14:30:48,296 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) release cpu from host: 7, old used: 1000,reserved: 0, actual total: 12004, total with overprovisioning: 12004; new used: 500,reserved:0; movedfromreserved: false,moveToReserveredfalse
  2219. 2013-01-29 14:30:48,296 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) release mem from host: 7, old used: 1342177280,reserved: 0, total: 8269606912; new used: 268435456,reserved:0; movedfromreserved: false,moveToReserveredfalse
  2220. 2013-01-29 14:30:48,367 WARN [cloud.consoleproxy.ConsoleProxyManagerImpl] (consoleproxy-1:null) Exception while trying to start console proxy
  2221. com.cloud.exception.AgentUnavailableException: Resource [Host:7] is unreachable: Host 7: Unable to start instance due to com.cloud.agent.api.Answer cannot be cast to com.cloud.agent.api.storage.PrimaryStorageDownloadAnswer
  2222. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:847)
  2223. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:472)
  2224. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:465)
  2225. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.startProxy(ConsoleProxyManagerImpl.java:627)
  2226. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.allocCapacity(ConsoleProxyManagerImpl.java:1164)
  2227. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:1981)
  2228. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:173)
  2229. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:113)
  2230. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:34)
  2231. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:83)
  2232. at com.cloud.vm.SystemVmLoadScanner$1.run(SystemVmLoadScanner.java:73)
  2233. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  2234. at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351)
  2235. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178)
  2236. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165)
  2237. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267)
  2238. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
  2239. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
  2240. at java.lang.Thread.run(Thread.java:679)
  2241. Caused by: java.lang.ClassCastException: com.cloud.agent.api.Answer cannot be cast to com.cloud.agent.api.storage.PrimaryStorageDownloadAnswer
  2242. at com.cloud.template.TemplateManagerImpl.prepareTemplateForCreate(TemplateManagerImpl.java:663)
  2243. at com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34)
  2244. at com.cloud.storage.StorageManagerImpl.createVolume(StorageManagerImpl.java:3442)
  2245. at com.cloud.storage.StorageManagerImpl.prepare(StorageManagerImpl.java:3351)
  2246. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:754)
  2247. ... 19 more
  2248. 2013-01-29 14:30:51,409 DEBUG [cloud.server.StatsCollector] (StatsCollector-3:null) StorageCollector is running...
  2249. 2013-01-29 14:30:51,468 DEBUG [agent.transport.Request] (StatsCollector-3:null) Seq 5-632235897: Received: { Ans: , MgmtId: 60908668245, via: 5, Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
  2250. 2013-01-29 14:30:51,469 DEBUG [cloud.server.StatsCollector] (StatsCollector-3:null) There is no secondary storage VM for secondary storage host nfs://cloudmanager.mira.dk/export/mirazone
  2251. 2013-01-29 14:30:51,512 DEBUG [agent.transport.Request] (StatsCollector-3:null) Seq 1-89030384: Received: { Ans: , MgmtId: 60908668245, via: 1, Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
  2252. 2013-01-29 14:30:51,532 DEBUG [agent.transport.Request] (StatsCollector-3:null) Seq 7-2090140050: Received: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
  2253. 2013-01-29 14:30:52,561 DEBUG [cloud.template.TemplateManagerImpl] (secstorage-1:null) Downloading 3 via 7
  2254. 2013-01-29 14:30:52,563 DEBUG [agent.transport.Request] (secstorage-1:null) Seq 7-2090140051: Sending { Cmd , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 100111, [{"storage.PrimaryStorageDownloadCommand":{"localPath":"/mnt/99898908-d913-39c8-b61d-c7e6b6dbd8f0","poolUuid":"99898908-d913-39c8-b61d-c7e6b6dbd8f0","poolId":204,"secondaryStorageUrl":"nfs://cloudmanager.mira.dk/export/mirazone","primaryStorageUrl":"nfs://10.212.212.249/export/drbd10","url":"nfs://cloudmanager.mira.dk/export/mirazone/template/tmpl/1/3/","format":"QCOW2","accountId":1,"name":"routing-3","wait":10800}}] }
  2255. 2013-01-29 14:30:52,815 DEBUG [agent.transport.Request] (AgentManager-Handler-5:null) Seq 7-2090140051: Processing: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, [{"Answer":{"result":false,"details":"java.lang.NullPointerException\n\tat com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.createStoragePool(LibvirtStorageAdaptor.java:462)\n\tat com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.getStoragePoolByURI(LibvirtStorageAdaptor.java:745)\n\tat com.cloud.hypervisor.kvm.storage.KVMStoragePoolManager.getStoragePoolByURI(KVMStoragePoolManager.java:52)\n\tat com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:2017)\n\tat com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1009)\n\tat com.cloud.agent.Agent.processRequest(Agent.java:518)\n\tat com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:831)\n\tat com.cloud.utils.nio.Task.run(Task.java:83)\n\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)\n\tat java.lang.Thread.run(Thread.java:679)\n","wait":0}}] }
  2256. 2013-01-29 14:30:52,815 DEBUG [agent.manager.AgentAttache] (AgentManager-Handler-5:null) Seq 7-2090140051: No more commands found
  2257. 2013-01-29 14:30:52,815 DEBUG [agent.transport.Request] (secstorage-1:null) Seq 7-2090140051: Received: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, { Answer } }
  2258. 2013-01-29 14:30:52,815 DEBUG [agent.manager.AgentManagerImpl] (secstorage-1:null) Details from executing class com.cloud.agent.api.storage.PrimaryStorageDownloadCommand: java.lang.NullPointerException
  2259. at com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.createStoragePool(LibvirtStorageAdaptor.java:462)
  2260. at com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.getStoragePoolByURI(LibvirtStorageAdaptor.java:745)
  2261. at com.cloud.hypervisor.kvm.storage.KVMStoragePoolManager.getStoragePoolByURI(KVMStoragePoolManager.java:52)
  2262. at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:2017)
  2263. at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1009)
  2264. at com.cloud.agent.Agent.processRequest(Agent.java:518)
  2265. at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:831)
  2266. at com.cloud.utils.nio.Task.run(Task.java:83)
  2267. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
  2268. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
  2269. at java.lang.Thread.run(Thread.java:679)
  2270.  
  2271. 2013-01-29 14:30:52,815 ERROR [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Failed to start instance VM[SecondaryStorageVm|s-203-VM]
  2272. java.lang.ClassCastException: com.cloud.agent.api.Answer cannot be cast to com.cloud.agent.api.storage.PrimaryStorageDownloadAnswer
  2273. at com.cloud.template.TemplateManagerImpl.prepareTemplateForCreate(TemplateManagerImpl.java:663)
  2274. at com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34)
  2275. at com.cloud.storage.StorageManagerImpl.createVolume(StorageManagerImpl.java:3442)
  2276. at com.cloud.storage.StorageManagerImpl.prepare(StorageManagerImpl.java:3351)
  2277. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:754)
  2278. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:472)
  2279. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:465)
  2280. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.startSecStorageVm(SecondaryStorageManagerImpl.java:257)
  2281. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.allocCapacity(SecondaryStorageManagerImpl.java:684)
  2282. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.expandPool(SecondaryStorageManagerImpl.java:1310)
  2283. at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:119)
  2284. at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:50)
  2285. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:106)
  2286. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:34)
  2287. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:83)
  2288. at com.cloud.vm.SystemVmLoadScanner$1.run(SystemVmLoadScanner.java:73)
  2289. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  2290. at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351)
  2291. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178)
  2292. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165)
  2293. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267)
  2294. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
  2295. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
  2296. at java.lang.Thread.run(Thread.java:679)
  2297. 2013-01-29 14:30:52,887 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Cleaning up resources for the vm VM[SecondaryStorageVm|s-203-VM] in Starting state
  2298. 2013-01-29 14:30:52,887 DEBUG [agent.transport.Request] (secstorage-1:null) Seq 7-2090140052: Sending { Cmd , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 100111, [{"StopCommand":{"isProxy":false,"vmName":"s-203-VM","wait":0}}] }
  2299. 2013-01-29 14:30:52,983 DEBUG [agent.transport.Request] (AgentManager-Handler-6:null) Seq 7-2090140052: Processing: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, [{"StopAnswer":{"vncPort":0,"result":true,"wait":0}}] }
  2300. 2013-01-29 14:30:52,983 DEBUG [agent.manager.AgentAttache] (AgentManager-Handler-6:null) Seq 7-2090140052: No more commands found
  2301. 2013-01-29 14:30:52,983 DEBUG [agent.transport.Request] (secstorage-1:null) Seq 7-2090140052: Received: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, { StopAnswer } }
  2302. 2013-01-29 14:30:53,029 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Service SecurityGroup is not supported in the network id=222
  2303. 2013-01-29 14:30:53,077 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to release Nic[742-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-212.70.6.203]
  2304. 2013-01-29 14:30:53,078 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to release Nic[742-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-212.70.6.203]
  2305. 2013-01-29 14:30:53,078 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to release Nic[742-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-212.70.6.203]
  2306. 2013-01-29 14:30:53,078 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to release Nic[742-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-212.70.6.203]
  2307. 2013-01-29 14:30:53,078 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to release Nic[742-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-212.70.6.203]
  2308. 2013-01-29 14:30:53,078 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to release Nic[742-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-212.70.6.203]
  2309. 2013-01-29 14:30:53,078 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to release Nic[742-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-212.70.6.203]
  2310. 2013-01-29 14:30:53,186 DEBUG [network.guru.ControlNetworkGuru] (secstorage-1:null) Released nic: NicProfile[743-203-null-null-null
  2311. 2013-01-29 14:30:53,228 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to release Nic[743-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-null]
  2312. 2013-01-29 14:30:53,228 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to release Nic[743-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-null]
  2313. 2013-01-29 14:30:53,228 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to release Nic[743-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-null]
  2314. 2013-01-29 14:30:53,228 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to release Nic[743-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-null]
  2315. 2013-01-29 14:30:53,228 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to release Nic[743-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-null]
  2316. 2013-01-29 14:30:53,228 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to release Nic[743-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-null]
  2317. 2013-01-29 14:30:53,228 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to release Nic[743-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-null]
  2318. 2013-01-29 14:30:53,279 DEBUG [dc.dao.DataCenterIpAddressDaoImpl] (secstorage-1:null) Releasing ip address for reservationId=80c38d74-3c06-426a-a9cc-fc9f6df6a4ee, instance=744
  2319. 2013-01-29 14:30:53,328 DEBUG [network.guru.PodBasedNetworkGuru] (secstorage-1:null) Released nic: NicProfile[744-203-null-null-null
  2320. 2013-01-29 14:30:53,395 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to release Nic[744-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-null]
  2321. 2013-01-29 14:30:53,395 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to release Nic[744-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-null]
  2322. 2013-01-29 14:30:53,395 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to release Nic[744-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-null]
  2323. 2013-01-29 14:30:53,395 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to release Nic[744-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-null]
  2324. 2013-01-29 14:30:53,395 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to release Nic[744-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-null]
  2325. 2013-01-29 14:30:53,395 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to release Nic[744-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-null]
  2326. 2013-01-29 14:30:53,395 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to release Nic[744-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-null]
  2327. 2013-01-29 14:30:53,447 DEBUG [dc.dao.DataCenterIpAddressDaoImpl] (secstorage-1:null) Releasing ip address for reservationId=80c38d74-3c06-426a-a9cc-fc9f6df6a4ee, instance=745
  2328. 2013-01-29 14:30:53,504 DEBUG [network.guru.PodBasedNetworkGuru] (secstorage-1:null) Released nic: NicProfile[745-203-null-null-null
  2329. 2013-01-29 14:30:53,554 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to release Nic[745-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-null]
  2330. 2013-01-29 14:30:53,554 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to release Nic[745-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-null]
  2331. 2013-01-29 14:30:53,554 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to release Nic[745-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-null]
  2332. 2013-01-29 14:30:53,554 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to release Nic[745-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-null]
  2333. 2013-01-29 14:30:53,554 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to release Nic[745-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-null]
  2334. 2013-01-29 14:30:53,554 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to release Nic[745-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-null]
  2335. 2013-01-29 14:30:53,554 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to release Nic[745-203-80c38d74-3c06-426a-a9cc-fc9f6df6a4ee-null]
  2336. 2013-01-29 14:30:53,554 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Successfully released network resources for the vm VM[SecondaryStorageVm|s-203-VM]
  2337. 2013-01-29 14:30:53,554 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Successfully cleanued up resources for the vm VM[SecondaryStorageVm|s-203-VM] in Starting state
  2338. 2013-01-29 14:30:53,639 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: 7
  2339. 2013-01-29 14:30:53,641 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) Hosts's actual total CPU: 12004 and CPU after applying overprovisioning: 12004
  2340. 2013-01-29 14:30:53,641 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) release cpu from host: 7, old used: 500,reserved: 0, actual total: 12004, total with overprovisioning: 12004; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  2341. 2013-01-29 14:30:53,641 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) release mem from host: 7, old used: 268435456,reserved: 0, total: 8269606912; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  2342. 2013-01-29 14:30:53,688 WARN [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Exception while trying to start secondary storage vm
  2343. com.cloud.exception.AgentUnavailableException: Resource [Host:7] is unreachable: Host 7: Unable to start instance due to com.cloud.agent.api.Answer cannot be cast to com.cloud.agent.api.storage.PrimaryStorageDownloadAnswer
  2344. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:847)
  2345. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:472)
  2346. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:465)
  2347. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.startSecStorageVm(SecondaryStorageManagerImpl.java:257)
  2348. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.allocCapacity(SecondaryStorageManagerImpl.java:684)
  2349. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.expandPool(SecondaryStorageManagerImpl.java:1310)
  2350. at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:119)
  2351. at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:50)
  2352. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:106)
  2353. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:34)
  2354. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:83)
  2355. at com.cloud.vm.SystemVmLoadScanner$1.run(SystemVmLoadScanner.java:73)
  2356. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  2357. at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351)
  2358. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178)
  2359. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165)
  2360. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267)
  2361. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
  2362. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
  2363. at java.lang.Thread.run(Thread.java:679)
  2364. Caused by: java.lang.ClassCastException: com.cloud.agent.api.Answer cannot be cast to com.cloud.agent.api.storage.PrimaryStorageDownloadAnswer
  2365. at com.cloud.template.TemplateManagerImpl.prepareTemplateForCreate(TemplateManagerImpl.java:663)
  2366. at com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34)
  2367. at com.cloud.storage.StorageManagerImpl.createVolume(StorageManagerImpl.java:3442)
  2368. at com.cloud.storage.StorageManagerImpl.prepare(StorageManagerImpl.java:3351)
  2369. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:754)
  2370. ... 20 more
  2371. 2013-01-29 14:30:53,689 INFO [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Unable to start secondary storage vm for standby capacity, secStorageVm vm Id : 203, will recycle it and start a new one
  2372. 2013-01-29 14:30:53,690 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) VM is already stopped: VM[SecondaryStorageVm|s-203-VM]
  2373. 2013-01-29 14:30:53,747 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) VM state transitted from :Stopped to Expunging with event: ExpungeOperationvm's original host id: null new host id: null host id before state transition: null
  2374. 2013-01-29 14:30:53,748 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Destroying vm VM[SecondaryStorageVm|s-203-VM]
  2375. 2013-01-29 14:30:53,748 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Cleaning up NICS
  2376. 2013-01-29 14:30:53,748 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Cleaning network for vm: 203
  2377. 2013-01-29 14:30:53,806 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Service SecurityGroup is not supported in the network id=222
  2378. 2013-01-29 14:30:53,807 DEBUG [network.guru.DirectNetworkGuru] (secstorage-1:null) Deallocate network: networkId: 222, ip: 212.70.6.203
  2379. 2013-01-29 14:30:53,956 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Removed nic id=742
  2380. 2013-01-29 14:30:54,064 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Removed nic id=743
  2381. 2013-01-29 14:30:54,149 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Removed nic id=744
  2382. 2013-01-29 14:30:54,265 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Removed nic id=745
  2383. 2013-01-29 14:30:54,265 DEBUG [cloud.storage.StorageManagerImpl] (secstorage-1:null) Cleaning storage for vm: 203
  2384. 2013-01-29 14:30:54,323 DEBUG [cloud.storage.StorageManagerImpl] (secstorage-1:null) Expunging Vol[205|vm=203|ROOT]
  2385. 2013-01-29 14:30:54,325 DEBUG [cloud.storage.StorageManagerImpl] (secstorage-1:null) Marking volume that was never created as destroyed: Vol[205|vm=203|ROOT]
  2386. 2013-01-29 14:30:54,408 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Expunged VM[SecondaryStorageVm|s-203-VM]
  2387. 2013-01-29 14:30:54,475 INFO [cloud.secstorage.PremiumSecondaryStorageManagerImpl] (secstorage-1:null) Primary secondary storage is not even started, wait until next turn
  2388. 2013-01-29 14:30:55,219 DEBUG [cloud.server.StatsCollector] (StatsCollector-3:null) VmStatsCollector is running...
  2389. 2013-01-29 14:30:55,248 DEBUG [agent.transport.Request] (StatsCollector-3:null) Seq 1-89030385: Received: { Ans: , MgmtId: 60908668245, via: 1, Ver: v1, Flags: 10, { GetVmStatsAnswer } }
  2390. 2013-01-29 14:30:55,268 DEBUG [agent.transport.Request] (StatsCollector-3:null) Seq 4-220941132: Received: { Ans: , MgmtId: 60908668245, via: 4, Ver: v1, Flags: 10, { GetVmStatsAnswer } }
  2391. 2013-01-29 14:31:03,196 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-8:null) Ping from 1
  2392. 2013-01-29 14:31:04,561 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-2:null) Ping from 4
  2393. 2013-01-29 14:31:05,040 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-10:null) Ping from 3
  2394. 2013-01-29 14:31:05,340 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-12:null) Ping from 5
  2395. 2013-01-29 14:31:15,331 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-13:null) Ping from 7
  2396. 2013-01-29 14:31:15,898 DEBUG [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Zone 1 is ready to launch secondary storage VM
  2397. 2013-01-29 14:31:15,910 DEBUG [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Zone 3 is ready to launch secondary storage VM
  2398. 2013-01-29 14:31:15,912 INFO [cloud.secstorage.PremiumSecondaryStorageManagerImpl] (secstorage-1:null) No running secondary storage vms found in datacenter id=3, starting one
  2399. 2013-01-29 14:31:15,914 INFO [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) No stopped secondary storage vm is available, need to allocate a new secondary storage vm
  2400. 2013-01-29 14:31:15,915 DEBUG [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Assign secondary storage vm from a newly started instance for request from data center : 3
  2401. 2013-01-29 14:31:16,014 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Found existing network configuration for offering [Network Offering [7-Guest-DefaultSharedNetworkOffering]: Ntwk[222|Guest|7]
  2402. 2013-01-29 14:31:16,014 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Releasing lock for Acct[1-system]
  2403. 2013-01-29 14:31:16,015 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Found existing network configuration for offering [Network Offering [3-Control-System-Control-Network]: Ntwk[220|Control|3]
  2404. 2013-01-29 14:31:16,015 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Releasing lock for Acct[1-system]
  2405. 2013-01-29 14:31:16,016 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl] (consoleproxy-1:null) Zone 1 is ready to launch console proxy
  2406. 2013-01-29 14:31:16,017 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Found existing network configuration for offering [Network Offering [2-Management-System-Management-Network]: Ntwk[219|Management|2]
  2407. 2013-01-29 14:31:16,017 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Releasing lock for Acct[1-system]
  2408. 2013-01-29 14:31:16,018 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Found existing network configuration for offering [Network Offering [4-Storage-System-Storage-Network]: Ntwk[221|Storage|4]
  2409. 2013-01-29 14:31:16,018 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Releasing lock for Acct[1-system]
  2410. 2013-01-29 14:31:16,018 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl] (consoleproxy-1:null) Zone 3 is ready to launch console proxy
  2411. 2013-01-29 14:31:16,019 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl] (consoleproxy-1:null) Expand console proxy standby capacity for zone Mira
  2412. 2013-01-29 14:31:16,020 INFO [cloud.consoleproxy.ConsoleProxyManagerImpl] (consoleproxy-1:null) Found a stopped console proxy, bring it up to running pool. proxy vm id : 32
  2413. 2013-01-29 14:31:16,021 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Allocating entries for VM: VM[SecondaryStorageVm|s-204-VM]
  2414. 2013-01-29 14:31:16,024 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Allocating nics for VM[SecondaryStorageVm|s-204-VM]
  2415. 2013-01-29 14:31:16,025 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Allocating nic for vm VM[SecondaryStorageVm|s-204-VM] in network Ntwk[222|Guest|7] with requested profile NicProfile[0-0-null-null-null
  2416. 2013-01-29 14:31:16,025 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
  2417. 2013-01-29 14:31:16,025 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Successfully transitioned to start state for VM[ConsoleProxy|v-32-VM] reservation id = 0bb05af1-b944-480e-a86b-df0c36a30fe7
  2418. 2013-01-29 14:31:16,028 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Service SecurityGroup is not supported in the network id=222
  2419. 2013-01-29 14:31:16,029 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Allocating nic for vm VM[SecondaryStorageVm|s-204-VM] in network Ntwk[220|Control|3] with requested profile null
  2420. 2013-01-29 14:31:16,032 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Allocating nic for vm VM[SecondaryStorageVm|s-204-VM] in network Ntwk[219|Management|2] with requested profile null
  2421. 2013-01-29 14:31:16,041 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Allocating nic for vm VM[SecondaryStorageVm|s-204-VM] in network Ntwk[221|Storage|4] with requested profile null
  2422. 2013-01-29 14:31:16,046 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Allocaing disks for VM[SecondaryStorageVm|s-204-VM]
  2423. 2013-01-29 14:31:16,105 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Trying to deploy VM, vm has dcId: 3 and podId: 3
  2424. 2013-01-29 14:31:16,105 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Deploy avoids pods: null, clusters: null, hosts: null
  2425. 2013-01-29 14:31:16,106 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) DeploymentPlanner allocation algorithm: random
  2426. 2013-01-29 14:31:16,106 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Trying to allocate a host and storage pools from dc:3, pod:3,cluster:null, requested cpu: 500, requested ram: 1073741824
  2427. 2013-01-29 14:31:16,106 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Is ROOT volume READY (pool already allocated)?: No
  2428. 2013-01-29 14:31:16,106 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Searching resources only under specified Pod: 3
  2429. 2013-01-29 14:31:16,107 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Pod: 3
  2430. 2013-01-29 14:31:16,107 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) CPUOverprovisioningFactor considered: 1.0
  2431. 2013-01-29 14:31:16,111 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Checking resources in Cluster: 3 under Pod: 3
  2432. 2013-01-29 14:31:16,111 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Calling HostAllocators to find suitable hosts
  2433. 2013-01-29 14:31:16,111 DEBUG [allocator.impl.FirstFitAllocator] (consoleproxy-1:FirstFitRoutingAllocator) Looking for hosts in dc: 3 pod:3 cluster:3
  2434. 2013-01-29 14:31:16,112 DEBUG [allocator.impl.FirstFitAllocator] (consoleproxy-1:FirstFitRoutingAllocator) FirstFitAllocator has 1 hosts to check for allocation: [Host[-7-Routing]]
  2435. 2013-01-29 14:31:16,113 DEBUG [allocator.impl.FirstFitAllocator] (consoleproxy-1:FirstFitRoutingAllocator) Found 1 hosts for allocation after prioritization: [Host[-7-Routing]]
  2436. 2013-01-29 14:31:16,113 DEBUG [allocator.impl.FirstFitAllocator] (consoleproxy-1:FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=1024
  2437. 2013-01-29 14:31:16,113 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) Checking if host: 7 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  2438. 2013-01-29 14:31:16,114 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) Hosts's actual total CPU: 12004 and CPU after applying overprovisioning: 12004
  2439. 2013-01-29 14:31:16,114 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) Free CPU: 12004 , Requested CPU: 500
  2440. 2013-01-29 14:31:16,114 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) Free RAM: 8269606912 , Requested RAM: 1073741824
  2441. 2013-01-29 14:31:16,114 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) Host has enough CPU and RAM available
  2442. 2013-01-29 14:31:16,115 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 7, used: 0, reserved: 0, actual total: 12004, total with overprovisioning: 12004; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  2443. 2013-01-29 14:31:16,115 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 7, used: 0, reserved: 0, total: 8269606912; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  2444. 2013-01-29 14:31:16,115 DEBUG [allocator.impl.FirstFitAllocator] (consoleproxy-1:FirstFitRoutingAllocator) Found a suitable host, adding to list: 7
  2445. 2013-01-29 14:31:16,115 DEBUG [allocator.impl.FirstFitAllocator] (consoleproxy-1:FirstFitRoutingAllocator) Host Allocator returning 1 suitable hosts
  2446. 2013-01-29 14:31:16,115 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Checking suitable pools for volume (Id, Type): (34,ROOT)
  2447. 2013-01-29 14:31:16,115 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) We need to allocate new storagepool for this volume
  2448. 2013-01-29 14:31:16,115 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Calling StoragePoolAllocators to find suitable pools
  2449. 2013-01-29 14:31:16,116 DEBUG [storage.allocator.FirstFitStoragePoolAllocator] (consoleproxy-1:null) Looking for pools in dc: 3 pod:3 cluster:3
  2450. 2013-01-29 14:31:16,116 DEBUG [storage.allocator.FirstFitStoragePoolAllocator] (consoleproxy-1:null) FirstFitStoragePoolAllocator has 1 pools to check for allocation
  2451. 2013-01-29 14:31:16,116 DEBUG [storage.allocator.AbstractStoragePoolAllocator] (consoleproxy-1:null) Checking if storage pool is suitable, name: DRDB10 ,poolId: 204
  2452. 2013-01-29 14:31:16,116 DEBUG [storage.allocator.AbstractStoragePoolAllocator] (consoleproxy-1:null) Is localStorageAllocationNeeded? false
  2453. 2013-01-29 14:31:16,116 DEBUG [storage.allocator.AbstractStoragePoolAllocator] (consoleproxy-1:null) Is storage pool shared? true
  2454. 2013-01-29 14:31:16,117 DEBUG [cloud.storage.StorageManagerImpl] (consoleproxy-1:null) Checking pool 204 for storage, totalSize: 1968949690368, usedBytes: 204734464, usedPct: 1.039815618456634E-4, disable threshold: 0.85
  2455. 2013-01-29 14:31:16,119 DEBUG [cloud.storage.StorageManagerImpl] (consoleproxy-1:null) Checking pool: 204 for volume allocation [Vol[34|vm=32|ROOT]], maxSize : 3937899380736, totalAllocatedSize : 0, askingSize : 0, allocated disable threshold: 0.85
  2456. 2013-01-29 14:31:16,119 DEBUG [storage.allocator.FirstFitStoragePoolAllocator] (consoleproxy-1:null) FirstFitStoragePoolAllocator returning 1 suitable storage pools
  2457. 2013-01-29 14:31:16,119 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Trying to find a potenial host and associated storage pools from the suitable host/pool lists for this VM
  2458. 2013-01-29 14:31:16,119 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Checking if host: 7 can access any suitable storage pool for volume: ROOT
  2459. 2013-01-29 14:31:16,120 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Host: 7 can access pool: 204
  2460. 2013-01-29 14:31:16,120 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Found a potential host id: 7 name: mc1 and associated storage pools for this VM
  2461. 2013-01-29 14:31:16,120 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Returning Deployment Destination: Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(3)-Pod(3)-Cluster(3)-Host(7)-Storage(Volume(34|ROOT-->Pool(204))]
  2462. 2013-01-29 14:31:16,121 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Deployment found - P0=VM[ConsoleProxy|v-32-VM], P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(3)-Pod(3)-Cluster(3)-Host(7)-Storage(Volume(34|ROOT-->Pool(204))]
  2463. 2013-01-29 14:31:16,186 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Allocation completed for VM: VM[SecondaryStorageVm|s-204-VM]
  2464. 2013-01-29 14:31:16,187 DEBUG [cloud.alert.SecondaryStorageVmAlertAdapter] (secstorage-1:null) received secondary storage vm alert
  2465. 2013-01-29 14:31:16,187 DEBUG [cloud.alert.SecondaryStorageVmAlertAdapter] (secstorage-1:null) New secondary storage vm created, zone: Mira, secStorageVm: s-204-VM, public IP: null, private IP: null
  2466. 2013-01-29 14:31:16,190 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
  2467. 2013-01-29 14:31:16,190 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Successfully transitioned to start state for VM[SecondaryStorageVm|s-204-VM] reservation id = 32b73696-3ba9-4ffe-88ff-2580f06340d6
  2468. 2013-01-29 14:31:16,281 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Trying to deploy VM, vm has dcId: 3 and podId: null
  2469. 2013-01-29 14:31:16,281 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Deploy avoids pods: null, clusters: null, hosts: null
  2470. 2013-01-29 14:31:16,282 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) DeploymentPlanner allocation algorithm: random
  2471. 2013-01-29 14:31:16,282 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Trying to allocate a host and storage pools from dc:3, pod:null,cluster:null, requested cpu: 500, requested ram: 268435456
  2472. 2013-01-29 14:31:16,282 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Is ROOT volume READY (pool already allocated)?: No
  2473. 2013-01-29 14:31:16,282 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Searching all possible resources under this Zone: 3
  2474. 2013-01-29 14:31:16,283 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 3
  2475. 2013-01-29 14:31:16,283 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) CPUOverprovisioningFactor considered: 1.0
  2476. 2013-01-29 14:31:16,286 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Checking resources in Cluster: 3 under Pod: 3
  2477. 2013-01-29 14:31:16,286 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Calling HostAllocators to find suitable hosts
  2478. 2013-01-29 14:31:16,286 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) Looking for hosts in dc: 3 pod:3 cluster:3
  2479. 2013-01-29 14:31:16,287 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) FirstFitAllocator has 1 hosts to check for allocation: [Host[-7-Routing]]
  2480. 2013-01-29 14:31:16,288 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) Found 1 hosts for allocation after prioritization: [Host[-7-Routing]]
  2481. 2013-01-29 14:31:16,288 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=256
  2482. 2013-01-29 14:31:16,289 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) Checking if host: 7 has enough capacity for requested CPU: 500 and requested RAM: 268435456 , cpuOverprovisioningFactor: 1.0
  2483. 2013-01-29 14:31:16,290 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) Hosts's actual total CPU: 12004 and CPU after applying overprovisioning: 12004
  2484. 2013-01-29 14:31:16,290 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) Free CPU: 12004 , Requested CPU: 500
  2485. 2013-01-29 14:31:16,290 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) Free RAM: 8269606912 , Requested RAM: 268435456
  2486. 2013-01-29 14:31:16,290 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) Host has enough CPU and RAM available
  2487. 2013-01-29 14:31:16,290 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 7, used: 0, reserved: 0, actual total: 12004, total with overprovisioning: 12004; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  2488. 2013-01-29 14:31:16,290 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 7, used: 0, reserved: 0, total: 8269606912; requested mem: 268435456,alloc_from_last_host?:false ,considerReservedCapacity?: true
  2489. 2013-01-29 14:31:16,291 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) Found a suitable host, adding to list: 7
  2490. 2013-01-29 14:31:16,291 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) Host Allocator returning 1 suitable hosts
  2491. 2013-01-29 14:31:16,291 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Checking suitable pools for volume (Id, Type): (206,ROOT)
  2492. 2013-01-29 14:31:16,291 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) We need to allocate new storagepool for this volume
  2493. 2013-01-29 14:31:16,291 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Calling StoragePoolAllocators to find suitable pools
  2494. 2013-01-29 14:31:16,292 DEBUG [storage.allocator.FirstFitStoragePoolAllocator] (secstorage-1:null) Looking for pools in dc: 3 pod:3 cluster:3
  2495. 2013-01-29 14:31:16,292 DEBUG [storage.allocator.FirstFitStoragePoolAllocator] (secstorage-1:null) FirstFitStoragePoolAllocator has 1 pools to check for allocation
  2496. 2013-01-29 14:31:16,292 DEBUG [storage.allocator.AbstractStoragePoolAllocator] (secstorage-1:null) Checking if storage pool is suitable, name: DRDB10 ,poolId: 204
  2497. 2013-01-29 14:31:16,292 DEBUG [storage.allocator.AbstractStoragePoolAllocator] (secstorage-1:null) Is localStorageAllocationNeeded? false
  2498. 2013-01-29 14:31:16,292 DEBUG [storage.allocator.AbstractStoragePoolAllocator] (secstorage-1:null) Is storage pool shared? true
  2499. 2013-01-29 14:31:16,294 DEBUG [cloud.storage.StorageManagerImpl] (secstorage-1:null) Checking pool 204 for storage, totalSize: 1968949690368, usedBytes: 204734464, usedPct: 1.039815618456634E-4, disable threshold: 0.85
  2500. 2013-01-29 14:31:16,295 DEBUG [cloud.storage.StorageManagerImpl] (secstorage-1:null) Checking pool: 204 for volume allocation [Vol[206|vm=204|ROOT]], maxSize : 3937899380736, totalAllocatedSize : 0, askingSize : 0, allocated disable threshold: 0.85
  2501. 2013-01-29 14:31:16,295 DEBUG [storage.allocator.FirstFitStoragePoolAllocator] (secstorage-1:null) FirstFitStoragePoolAllocator returning 1 suitable storage pools
  2502. 2013-01-29 14:31:16,295 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Trying to find a potenial host and associated storage pools from the suitable host/pool lists for this VM
  2503. 2013-01-29 14:31:16,296 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Checking if host: 7 can access any suitable storage pool for volume: ROOT
  2504. 2013-01-29 14:31:16,296 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Host: 7 can access pool: 204
  2505. 2013-01-29 14:31:16,296 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Found a potential host id: 7 name: mc1 and associated storage pools for this VM
  2506. 2013-01-29 14:31:16,297 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Returning Deployment Destination: Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(3)-Pod(3)-Cluster(3)-Host(7)-Storage(Volume(206|ROOT-->Pool(204))]
  2507. 2013-01-29 14:31:16,297 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Deployment found - P0=VM[SecondaryStorageVm|s-204-VM], P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(3)-Pod(3)-Cluster(3)-Host(7)-Storage(Volume(206|ROOT-->Pool(204))]
  2508. 2013-01-29 14:31:16,338 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) VM state transitted from :Starting to Starting with event: OperationRetryvm's original host id: null new host id: 7 host id before state transition: null
  2509. 2013-01-29 14:31:16,341 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) Hosts's actual total CPU: 12004 and CPU after applying overprovisioning: 12004
  2510. 2013-01-29 14:31:16,341 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) We are allocating VM, increasing the used capacity of this host:7
  2511. 2013-01-29 14:31:16,341 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) Current Used CPU: 0 , Free CPU:12004 ,Requested CPU: 500
  2512. 2013-01-29 14:31:16,341 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) Current Used RAM: 0 , Free RAM:8269606912 ,Requested RAM: 1073741824
  2513. 2013-01-29 14:31:16,341 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) CPU STATS after allocation: for host: 7, old used: 0, old reserved: 0, actual total: 12004, total with overprovisioning: 12004; new used:500, reserved:0; requested cpu:500,alloc_from_last:false
  2514. 2013-01-29 14:31:16,341 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) RAM STATS after allocation: for host: 7, old used: 0, old reserved: 0, total: 8269606912; new used: 1073741824, reserved: 0; requested mem: 1073741824,alloc_from_last:false
  2515. 2013-01-29 14:31:16,434 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) VM is being created in podId: 3
  2516. 2013-01-29 14:31:16,434 DEBUG [network.router.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:null) Found 5 routers.
  2517. 2013-01-29 14:31:16,436 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Lock is acquired for network id 222 as a part of network implement
  2518. 2013-01-29 14:31:16,436 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Network id=222 is already implemented
  2519. 2013-01-29 14:31:16,436 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Lock is released for network id 222 as a part of network implement
  2520. 2013-01-29 14:31:16,473 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) VM state transitted from :Starting to Starting with event: OperationRetryvm's original host id: null new host id: 7 host id before state transition: null
  2521. 2013-01-29 14:31:16,477 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) Hosts's actual total CPU: 12004 and CPU after applying overprovisioning: 12004
  2522. 2013-01-29 14:31:16,477 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) We are allocating VM, increasing the used capacity of this host:7
  2523. 2013-01-29 14:31:16,477 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) Current Used CPU: 500 , Free CPU:11504 ,Requested CPU: 500
  2524. 2013-01-29 14:31:16,477 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) Current Used RAM: 1073741824 , Free RAM:7195865088 ,Requested RAM: 268435456
  2525. 2013-01-29 14:31:16,477 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) CPU STATS after allocation: for host: 7, old used: 500, old reserved: 0, actual total: 12004, total with overprovisioning: 12004; new used:1000, reserved:0; requested cpu:500,alloc_from_last:false
  2526. 2013-01-29 14:31:16,477 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) RAM STATS after allocation: for host: 7, old used: 1073741824, old reserved: 0, total: 8269606912; new used: 1342177280, reserved: 0; requested mem: 268435456,alloc_from_last:false
  2527. 2013-01-29 14:31:16,515 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Service SecurityGroup is not supported in the network id=222
  2528. 2013-01-29 14:31:16,565 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) VM is being created in podId: 3
  2529. 2013-01-29 14:31:16,567 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is acquired for network id 222 as a part of network implement
  2530. 2013-01-29 14:31:16,567 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Network id=222 is already implemented
  2531. 2013-01-29 14:31:16,567 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is released for network id 222 as a part of network implement
  2532. 2013-01-29 14:31:16,614 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VirtualRouter to prepare for Nic[59-32-0bb05af1-b944-480e-a86b-df0c36a30fe7-212.70.6.202]
  2533. 2013-01-29 14:31:16,615 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking Ovs to prepare for Nic[59-32-0bb05af1-b944-480e-a86b-df0c36a30fe7-212.70.6.202]
  2534. 2013-01-29 14:31:16,615 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking ExternalDhcpServer to prepare for Nic[59-32-0bb05af1-b944-480e-a86b-df0c36a30fe7-212.70.6.202]
  2535. 2013-01-29 14:31:16,615 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking BareMetal to prepare for Nic[59-32-0bb05af1-b944-480e-a86b-df0c36a30fe7-212.70.6.202]
  2536. 2013-01-29 14:31:16,615 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking SecurityGroupProvider to prepare for Nic[59-32-0bb05af1-b944-480e-a86b-df0c36a30fe7-212.70.6.202]
  2537. 2013-01-29 14:31:16,615 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VpcVirtualRouter to prepare for Nic[59-32-0bb05af1-b944-480e-a86b-df0c36a30fe7-212.70.6.202]
  2538. 2013-01-29 14:31:16,615 WARN [network.element.VpcVirtualRouterElement] (consoleproxy-1:null) Network Ntwk[222|Guest|7] is not associated with any VPC
  2539. 2013-01-29 14:31:16,615 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking NiciraNvp to prepare for Nic[59-32-0bb05af1-b944-480e-a86b-df0c36a30fe7-212.70.6.202]
  2540. 2013-01-29 14:31:16,615 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Service SecurityGroup is not supported in the network id=222
  2541. 2013-01-29 14:31:16,616 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Lock is acquired for network id 220 as a part of network implement
  2542. 2013-01-29 14:31:16,616 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Network id=220 is already implemented
  2543. 2013-01-29 14:31:16,616 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Lock is released for network id 220 as a part of network implement
  2544. 2013-01-29 14:31:16,666 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Service SecurityGroup is not supported in the network id=222
  2545. 2013-01-29 14:31:16,873 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to prepare for Nic[746-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-212.70.6.205]
  2546. 2013-01-29 14:31:16,873 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to prepare for Nic[746-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-212.70.6.205]
  2547. 2013-01-29 14:31:16,873 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to prepare for Nic[746-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-212.70.6.205]
  2548. 2013-01-29 14:31:16,873 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to prepare for Nic[746-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-212.70.6.205]
  2549. 2013-01-29 14:31:16,873 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to prepare for Nic[746-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-212.70.6.205]
  2550. 2013-01-29 14:31:16,873 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to prepare for Nic[746-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-212.70.6.205]
  2551. 2013-01-29 14:31:16,873 WARN [network.element.VpcVirtualRouterElement] (secstorage-1:null) Network Ntwk[222|Guest|7] is not associated with any VPC
  2552. 2013-01-29 14:31:16,873 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to prepare for Nic[746-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-212.70.6.205]
  2553. 2013-01-29 14:31:16,874 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Service SecurityGroup is not supported in the network id=222
  2554. 2013-01-29 14:31:16,875 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is acquired for network id 220 as a part of network implement
  2555. 2013-01-29 14:31:16,875 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Network id=220 is already implemented
  2556. 2013-01-29 14:31:16,875 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is released for network id 220 as a part of network implement
  2557. 2013-01-29 14:31:16,924 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VirtualRouter to prepare for Nic[60-32-0bb05af1-b944-480e-a86b-df0c36a30fe7-169.254.1.110]
  2558. 2013-01-29 14:31:16,925 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking Ovs to prepare for Nic[60-32-0bb05af1-b944-480e-a86b-df0c36a30fe7-169.254.1.110]
  2559. 2013-01-29 14:31:16,925 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking ExternalDhcpServer to prepare for Nic[60-32-0bb05af1-b944-480e-a86b-df0c36a30fe7-169.254.1.110]
  2560. 2013-01-29 14:31:16,925 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking BareMetal to prepare for Nic[60-32-0bb05af1-b944-480e-a86b-df0c36a30fe7-169.254.1.110]
  2561. 2013-01-29 14:31:16,925 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking SecurityGroupProvider to prepare for Nic[60-32-0bb05af1-b944-480e-a86b-df0c36a30fe7-169.254.1.110]
  2562. 2013-01-29 14:31:16,925 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VpcVirtualRouter to prepare for Nic[60-32-0bb05af1-b944-480e-a86b-df0c36a30fe7-169.254.1.110]
  2563. 2013-01-29 14:31:16,925 WARN [network.element.VpcVirtualRouterElement] (consoleproxy-1:null) Network Ntwk[220|Control|3] is not associated with any VPC
  2564. 2013-01-29 14:31:16,925 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking NiciraNvp to prepare for Nic[60-32-0bb05af1-b944-480e-a86b-df0c36a30fe7-169.254.1.110]
  2565. 2013-01-29 14:31:16,926 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Lock is acquired for network id 219 as a part of network implement
  2566. 2013-01-29 14:31:16,926 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Network id=219 is already implemented
  2567. 2013-01-29 14:31:16,926 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Lock is released for network id 219 as a part of network implement
  2568. 2013-01-29 14:31:17,118 DEBUG [network.guru.PodBasedNetworkGuru] (consoleproxy-1:null) Allocated a nic NicProfile[61-32-0bb05af1-b944-480e-a86b-df0c36a30fe7-212.70.6.89-null for VM[ConsoleProxy|v-32-VM]
  2569. 2013-01-29 14:31:17,183 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to prepare for Nic[747-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-169.254.1.185]
  2570. 2013-01-29 14:31:17,183 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to prepare for Nic[747-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-169.254.1.185]
  2571. 2013-01-29 14:31:17,183 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to prepare for Nic[747-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-169.254.1.185]
  2572. 2013-01-29 14:31:17,183 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to prepare for Nic[747-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-169.254.1.185]
  2573. 2013-01-29 14:31:17,183 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to prepare for Nic[747-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-169.254.1.185]
  2574. 2013-01-29 14:31:17,183 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to prepare for Nic[747-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-169.254.1.185]
  2575. 2013-01-29 14:31:17,183 WARN [network.element.VpcVirtualRouterElement] (secstorage-1:null) Network Ntwk[220|Control|3] is not associated with any VPC
  2576. 2013-01-29 14:31:17,184 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to prepare for Nic[747-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-169.254.1.185]
  2577. 2013-01-29 14:31:17,184 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is acquired for network id 219 as a part of network implement
  2578. 2013-01-29 14:31:17,184 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Network id=219 is already implemented
  2579. 2013-01-29 14:31:17,185 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is released for network id 219 as a part of network implement
  2580. 2013-01-29 14:31:17,227 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VirtualRouter to prepare for Nic[61-32-0bb05af1-b944-480e-a86b-df0c36a30fe7-212.70.6.89]
  2581. 2013-01-29 14:31:17,228 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking Ovs to prepare for Nic[61-32-0bb05af1-b944-480e-a86b-df0c36a30fe7-212.70.6.89]
  2582. 2013-01-29 14:31:17,228 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking ExternalDhcpServer to prepare for Nic[61-32-0bb05af1-b944-480e-a86b-df0c36a30fe7-212.70.6.89]
  2583. 2013-01-29 14:31:17,228 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking BareMetal to prepare for Nic[61-32-0bb05af1-b944-480e-a86b-df0c36a30fe7-212.70.6.89]
  2584. 2013-01-29 14:31:17,228 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking SecurityGroupProvider to prepare for Nic[61-32-0bb05af1-b944-480e-a86b-df0c36a30fe7-212.70.6.89]
  2585. 2013-01-29 14:31:17,228 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VpcVirtualRouter to prepare for Nic[61-32-0bb05af1-b944-480e-a86b-df0c36a30fe7-212.70.6.89]
  2586. 2013-01-29 14:31:17,228 WARN [network.element.VpcVirtualRouterElement] (consoleproxy-1:null) Network Ntwk[219|Management|2] is not associated with any VPC
  2587. 2013-01-29 14:31:17,228 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking NiciraNvp to prepare for Nic[61-32-0bb05af1-b944-480e-a86b-df0c36a30fe7-212.70.6.89]
  2588. 2013-01-29 14:31:17,229 DEBUG [cloud.storage.StorageManagerImpl] (consoleproxy-1:null) Checking if we need to prepare 1 volumes for VM[ConsoleProxy|v-32-VM]
  2589. 2013-01-29 14:31:17,350 DEBUG [cloud.storage.StorageManagerImpl] (consoleproxy-1:null) Creating volume: Vol[34|vm=32|ROOT]
  2590. 2013-01-29 14:31:17,350 DEBUG [cloud.storage.StorageManagerImpl] (consoleproxy-1:null) Trying to create in Pool[204|NetworkFilesystem]
  2591. 2013-01-29 14:31:17,408 DEBUG [network.guru.PodBasedNetworkGuru] (secstorage-1:null) Allocated a nic NicProfile[748-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-212.70.6.84-null for VM[SecondaryStorageVm|s-204-VM]
  2592. 2013-01-29 14:31:17,525 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to prepare for Nic[748-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-212.70.6.84]
  2593. 2013-01-29 14:31:17,525 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to prepare for Nic[748-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-212.70.6.84]
  2594. 2013-01-29 14:31:17,525 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to prepare for Nic[748-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-212.70.6.84]
  2595. 2013-01-29 14:31:17,525 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to prepare for Nic[748-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-212.70.6.84]
  2596. 2013-01-29 14:31:17,526 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to prepare for Nic[748-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-212.70.6.84]
  2597. 2013-01-29 14:31:17,526 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to prepare for Nic[748-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-212.70.6.84]
  2598. 2013-01-29 14:31:17,526 WARN [network.element.VpcVirtualRouterElement] (secstorage-1:null) Network Ntwk[219|Management|2] is not associated with any VPC
  2599. 2013-01-29 14:31:17,526 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to prepare for Nic[748-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-212.70.6.84]
  2600. 2013-01-29 14:31:17,527 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is acquired for network id 221 as a part of network implement
  2601. 2013-01-29 14:31:17,527 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Network id=221 is already implemented
  2602. 2013-01-29 14:31:17,527 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is released for network id 221 as a part of network implement
  2603. 2013-01-29 14:31:17,579 DEBUG [cloud.template.TemplateManagerImpl] (consoleproxy-1:null) Downloading 3 via 7
  2604. 2013-01-29 14:31:17,580 DEBUG [agent.transport.Request] (consoleproxy-1:null) Seq 7-2090140053: Sending { Cmd , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 100111, [{"storage.PrimaryStorageDownloadCommand":{"localPath":"/mnt/99898908-d913-39c8-b61d-c7e6b6dbd8f0","poolUuid":"99898908-d913-39c8-b61d-c7e6b6dbd8f0","poolId":204,"secondaryStorageUrl":"nfs://cloudmanager.mira.dk/export/mirazone","primaryStorageUrl":"nfs://10.212.212.249/export/drbd10","url":"nfs://cloudmanager.mira.dk/export/mirazone/template/tmpl/1/3/","format":"QCOW2","accountId":1,"name":"routing-3","wait":10800}}] }
  2605. 2013-01-29 14:31:17,670 DEBUG [network.guru.PodBasedNetworkGuru] (secstorage-1:null) Allocated a nic NicProfile[749-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-212.70.6.79-null for VM[SecondaryStorageVm|s-204-VM]
  2606. 2013-01-29 14:31:17,712 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to prepare for Nic[749-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-212.70.6.79]
  2607. 2013-01-29 14:31:17,712 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to prepare for Nic[749-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-212.70.6.79]
  2608. 2013-01-29 14:31:17,712 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to prepare for Nic[749-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-212.70.6.79]
  2609. 2013-01-29 14:31:17,712 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to prepare for Nic[749-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-212.70.6.79]
  2610. 2013-01-29 14:31:17,712 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to prepare for Nic[749-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-212.70.6.79]
  2611. 2013-01-29 14:31:17,712 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to prepare for Nic[749-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-212.70.6.79]
  2612. 2013-01-29 14:31:17,712 WARN [network.element.VpcVirtualRouterElement] (secstorage-1:null) Network Ntwk[221|Storage|4] is not associated with any VPC
  2613. 2013-01-29 14:31:17,712 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to prepare for Nic[749-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-212.70.6.79]
  2614. 2013-01-29 14:31:17,713 DEBUG [cloud.storage.StorageManagerImpl] (secstorage-1:null) Checking if we need to prepare 1 volumes for VM[SecondaryStorageVm|s-204-VM]
  2615. 2013-01-29 14:31:17,762 DEBUG [cloud.storage.StorageManagerImpl] (secstorage-1:null) Creating volume: Vol[206|vm=204|ROOT]
  2616. 2013-01-29 14:31:17,762 DEBUG [cloud.storage.StorageManagerImpl] (secstorage-1:null) Trying to create in Pool[204|NetworkFilesystem]
  2617. 2013-01-29 14:31:17,880 DEBUG [agent.transport.Request] (AgentManager-Handler-9:null) Seq 7-2090140053: Processing: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, [{"Answer":{"result":false,"details":"java.lang.NullPointerException\n\tat com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.createStoragePool(LibvirtStorageAdaptor.java:462)\n\tat com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.getStoragePoolByURI(LibvirtStorageAdaptor.java:745)\n\tat com.cloud.hypervisor.kvm.storage.KVMStoragePoolManager.getStoragePoolByURI(KVMStoragePoolManager.java:52)\n\tat com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:2017)\n\tat com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1009)\n\tat com.cloud.agent.Agent.processRequest(Agent.java:518)\n\tat com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:831)\n\tat com.cloud.utils.nio.Task.run(Task.java:83)\n\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)\n\tat java.lang.Thread.run(Thread.java:679)\n","wait":0}}] }
  2618. 2013-01-29 14:31:17,880 DEBUG [agent.manager.AgentAttache] (AgentManager-Handler-9:null) Seq 7-2090140053: No more commands found
  2619. 2013-01-29 14:31:17,880 DEBUG [agent.transport.Request] (consoleproxy-1:null) Seq 7-2090140053: Received: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, { Answer } }
  2620. 2013-01-29 14:31:17,880 DEBUG [agent.manager.AgentManagerImpl] (consoleproxy-1:null) Details from executing class com.cloud.agent.api.storage.PrimaryStorageDownloadCommand: java.lang.NullPointerException
  2621. at com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.createStoragePool(LibvirtStorageAdaptor.java:462)
  2622. at com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.getStoragePoolByURI(LibvirtStorageAdaptor.java:745)
  2623. at com.cloud.hypervisor.kvm.storage.KVMStoragePoolManager.getStoragePoolByURI(KVMStoragePoolManager.java:52)
  2624. at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:2017)
  2625. at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1009)
  2626. at com.cloud.agent.Agent.processRequest(Agent.java:518)
  2627. at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:831)
  2628. at com.cloud.utils.nio.Task.run(Task.java:83)
  2629. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
  2630. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
  2631. at java.lang.Thread.run(Thread.java:679)
  2632.  
  2633. 2013-01-29 14:31:17,880 ERROR [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Failed to start instance VM[ConsoleProxy|v-32-VM]
  2634. java.lang.ClassCastException: com.cloud.agent.api.Answer cannot be cast to com.cloud.agent.api.storage.PrimaryStorageDownloadAnswer
  2635. at com.cloud.template.TemplateManagerImpl.prepareTemplateForCreate(TemplateManagerImpl.java:663)
  2636. at com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34)
  2637. at com.cloud.storage.StorageManagerImpl.createVolume(StorageManagerImpl.java:3442)
  2638. at com.cloud.storage.StorageManagerImpl.prepare(StorageManagerImpl.java:3351)
  2639. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:754)
  2640. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:472)
  2641. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:465)
  2642. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.startProxy(ConsoleProxyManagerImpl.java:627)
  2643. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.allocCapacity(ConsoleProxyManagerImpl.java:1164)
  2644. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:1981)
  2645. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:173)
  2646. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:113)
  2647. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:34)
  2648. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:83)
  2649. at com.cloud.vm.SystemVmLoadScanner$1.run(SystemVmLoadScanner.java:73)
  2650. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  2651. at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351)
  2652. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178)
  2653. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165)
  2654. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267)
  2655. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
  2656. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
  2657. at java.lang.Thread.run(Thread.java:679)
  2658. 2013-01-29 14:31:17,908 DEBUG [cloud.template.TemplateManagerImpl] (secstorage-1:null) Downloading 3 via 7
  2659. 2013-01-29 14:31:17,909 DEBUG [agent.transport.Request] (secstorage-1:null) Seq 7-2090140054: Sending { Cmd , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 100111, [{"storage.PrimaryStorageDownloadCommand":{"localPath":"/mnt/99898908-d913-39c8-b61d-c7e6b6dbd8f0","poolUuid":"99898908-d913-39c8-b61d-c7e6b6dbd8f0","poolId":204,"secondaryStorageUrl":"nfs://cloudmanager.mira.dk/export/mirazone","primaryStorageUrl":"nfs://10.212.212.249/export/drbd10","url":"nfs://cloudmanager.mira.dk/export/mirazone/template/tmpl/1/3/","format":"QCOW2","accountId":1,"name":"routing-3","wait":10800}}] }
  2660. 2013-01-29 14:31:17,955 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Cleaning up resources for the vm VM[ConsoleProxy|v-32-VM] in Starting state
  2661. 2013-01-29 14:31:17,955 DEBUG [agent.transport.Request] (consoleproxy-1:null) Seq 7-2090140055: Waiting for Seq 2090140054 Scheduling: { Cmd , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 100111, [{"StopCommand":{"isProxy":false,"vmName":"v-32-VM","wait":0}}] }
  2662. 2013-01-29 14:31:19,392 DEBUG [agent.transport.Request] (AgentManager-Handler-4:null) Seq 7-2090140054: Processing: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, [{"Answer":{"result":false,"details":"java.lang.NullPointerException\n\tat com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.createStoragePool(LibvirtStorageAdaptor.java:462)\n\tat com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.getStoragePoolByURI(LibvirtStorageAdaptor.java:745)\n\tat com.cloud.hypervisor.kvm.storage.KVMStoragePoolManager.getStoragePoolByURI(KVMStoragePoolManager.java:52)\n\tat com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:2017)\n\tat com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1009)\n\tat com.cloud.agent.Agent.processRequest(Agent.java:518)\n\tat com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:831)\n\tat com.cloud.utils.nio.Task.run(Task.java:83)\n\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)\n\tat java.lang.Thread.run(Thread.java:679)\n","wait":0}}] }
  2663. 2013-01-29 14:31:19,392 DEBUG [agent.manager.AgentAttache] (AgentManager-Handler-4:null) Seq 7-2090140055: Sending now. is current sequence.
  2664. 2013-01-29 14:31:19,392 DEBUG [agent.transport.Request] (secstorage-1:null) Seq 7-2090140054: Received: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, { Answer } }
  2665. 2013-01-29 14:31:19,392 DEBUG [agent.manager.AgentManagerImpl] (secstorage-1:null) Details from executing class com.cloud.agent.api.storage.PrimaryStorageDownloadCommand: java.lang.NullPointerException
  2666. at com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.createStoragePool(LibvirtStorageAdaptor.java:462)
  2667. at com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.getStoragePoolByURI(LibvirtStorageAdaptor.java:745)
  2668. at com.cloud.hypervisor.kvm.storage.KVMStoragePoolManager.getStoragePoolByURI(KVMStoragePoolManager.java:52)
  2669. at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:2017)
  2670. at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1009)
  2671. at com.cloud.agent.Agent.processRequest(Agent.java:518)
  2672. at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:831)
  2673. at com.cloud.utils.nio.Task.run(Task.java:83)
  2674. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
  2675. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
  2676. at java.lang.Thread.run(Thread.java:679)
  2677.  
  2678. 2013-01-29 14:31:19,393 ERROR [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Failed to start instance VM[SecondaryStorageVm|s-204-VM]
  2679. java.lang.ClassCastException: com.cloud.agent.api.Answer cannot be cast to com.cloud.agent.api.storage.PrimaryStorageDownloadAnswer
  2680. at com.cloud.template.TemplateManagerImpl.prepareTemplateForCreate(TemplateManagerImpl.java:663)
  2681. at com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34)
  2682. at com.cloud.storage.StorageManagerImpl.createVolume(StorageManagerImpl.java:3442)
  2683. at com.cloud.storage.StorageManagerImpl.prepare(StorageManagerImpl.java:3351)
  2684. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:754)
  2685. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:472)
  2686. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:465)
  2687. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.startSecStorageVm(SecondaryStorageManagerImpl.java:257)
  2688. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.allocCapacity(SecondaryStorageManagerImpl.java:684)
  2689. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.expandPool(SecondaryStorageManagerImpl.java:1310)
  2690. at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:119)
  2691. at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:50)
  2692. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:106)
  2693. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:34)
  2694. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:83)
  2695. at com.cloud.vm.SystemVmLoadScanner$1.run(SystemVmLoadScanner.java:73)
  2696. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  2697. at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351)
  2698. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178)
  2699. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165)
  2700. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267)
  2701. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
  2702. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
  2703. at java.lang.Thread.run(Thread.java:679)
  2704. 2013-01-29 14:31:19,454 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Cleaning up resources for the vm VM[SecondaryStorageVm|s-204-VM] in Starting state
  2705. 2013-01-29 14:31:19,455 DEBUG [agent.transport.Request] (secstorage-1:null) Seq 7-2090140056: Waiting for Seq 2090140055 Scheduling: { Cmd , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 100111, [{"StopCommand":{"isProxy":false,"vmName":"s-204-VM","wait":0}}] }
  2706. 2013-01-29 14:31:19,540 DEBUG [agent.transport.Request] (AgentManager-Handler-11:null) Seq 7-2090140055: Processing: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, [{"StopAnswer":{"vncPort":0,"result":true,"wait":0}}] }
  2707. 2013-01-29 14:31:19,540 DEBUG [agent.manager.AgentAttache] (AgentManager-Handler-11:null) Seq 7-2090140056: Sending now. is current sequence.
  2708. 2013-01-29 14:31:19,540 DEBUG [agent.transport.Request] (consoleproxy-1:null) Seq 7-2090140055: Received: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, { StopAnswer } }
  2709. 2013-01-29 14:31:19,596 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Service SecurityGroup is not supported in the network id=222
  2710. 2013-01-29 14:31:19,647 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VirtualRouter to release Nic[59-32-0bb05af1-b944-480e-a86b-df0c36a30fe7-212.70.6.202]
  2711. 2013-01-29 14:31:19,647 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking Ovs to release Nic[59-32-0bb05af1-b944-480e-a86b-df0c36a30fe7-212.70.6.202]
  2712. 2013-01-29 14:31:19,647 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking ExternalDhcpServer to release Nic[59-32-0bb05af1-b944-480e-a86b-df0c36a30fe7-212.70.6.202]
  2713. 2013-01-29 14:31:19,647 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking BareMetal to release Nic[59-32-0bb05af1-b944-480e-a86b-df0c36a30fe7-212.70.6.202]
  2714. 2013-01-29 14:31:19,647 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking SecurityGroupProvider to release Nic[59-32-0bb05af1-b944-480e-a86b-df0c36a30fe7-212.70.6.202]
  2715. 2013-01-29 14:31:19,647 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VpcVirtualRouter to release Nic[59-32-0bb05af1-b944-480e-a86b-df0c36a30fe7-212.70.6.202]
  2716. 2013-01-29 14:31:19,647 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking NiciraNvp to release Nic[59-32-0bb05af1-b944-480e-a86b-df0c36a30fe7-212.70.6.202]
  2717. 2013-01-29 14:31:19,672 DEBUG [agent.transport.Request] (AgentManager-Handler-15:null) Seq 7-2090140056: Processing: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, [{"StopAnswer":{"vncPort":0,"result":true,"wait":0}}] }
  2718. 2013-01-29 14:31:19,672 DEBUG [agent.manager.AgentAttache] (AgentManager-Handler-15:null) Seq 7-2090140056: No more commands found
  2719. 2013-01-29 14:31:19,672 DEBUG [agent.transport.Request] (secstorage-1:null) Seq 7-2090140056: Received: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, { StopAnswer } }
  2720. 2013-01-29 14:31:19,740 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Service SecurityGroup is not supported in the network id=222
  2721. 2013-01-29 14:31:19,788 DEBUG [network.guru.ControlNetworkGuru] (consoleproxy-1:null) Released nic: NicProfile[60-32-null-null-null
  2722. 2013-01-29 14:31:19,840 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to release Nic[746-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-212.70.6.205]
  2723. 2013-01-29 14:31:19,840 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to release Nic[746-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-212.70.6.205]
  2724. 2013-01-29 14:31:19,840 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to release Nic[746-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-212.70.6.205]
  2725. 2013-01-29 14:31:19,840 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to release Nic[746-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-212.70.6.205]
  2726. 2013-01-29 14:31:19,840 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to release Nic[746-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-212.70.6.205]
  2727. 2013-01-29 14:31:19,840 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to release Nic[746-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-212.70.6.205]
  2728. 2013-01-29 14:31:19,840 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to release Nic[746-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-212.70.6.205]
  2729. 2013-01-29 14:31:19,881 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VirtualRouter to release Nic[60-32-0bb05af1-b944-480e-a86b-df0c36a30fe7-null]
  2730. 2013-01-29 14:31:19,881 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking Ovs to release Nic[60-32-0bb05af1-b944-480e-a86b-df0c36a30fe7-null]
  2731. 2013-01-29 14:31:19,882 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking ExternalDhcpServer to release Nic[60-32-0bb05af1-b944-480e-a86b-df0c36a30fe7-null]
  2732. 2013-01-29 14:31:19,882 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking BareMetal to release Nic[60-32-0bb05af1-b944-480e-a86b-df0c36a30fe7-null]
  2733. 2013-01-29 14:31:19,882 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking SecurityGroupProvider to release Nic[60-32-0bb05af1-b944-480e-a86b-df0c36a30fe7-null]
  2734. 2013-01-29 14:31:19,882 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VpcVirtualRouter to release Nic[60-32-0bb05af1-b944-480e-a86b-df0c36a30fe7-null]
  2735. 2013-01-29 14:31:19,882 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking NiciraNvp to release Nic[60-32-0bb05af1-b944-480e-a86b-df0c36a30fe7-null]
  2736. 2013-01-29 14:31:19,983 DEBUG [dc.dao.DataCenterIpAddressDaoImpl] (consoleproxy-1:null) Releasing ip address for reservationId=0bb05af1-b944-480e-a86b-df0c36a30fe7, instance=61
  2737. 2013-01-29 14:31:20,032 DEBUG [network.guru.ControlNetworkGuru] (secstorage-1:null) Released nic: NicProfile[747-204-null-null-null
  2738. 2013-01-29 14:31:20,090 DEBUG [network.guru.PodBasedNetworkGuru] (consoleproxy-1:null) Released nic: NicProfile[61-32-null-null-null
  2739. 2013-01-29 14:31:20,139 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to release Nic[747-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-null]
  2740. 2013-01-29 14:31:20,139 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to release Nic[747-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-null]
  2741. 2013-01-29 14:31:20,139 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to release Nic[747-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-null]
  2742. 2013-01-29 14:31:20,139 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to release Nic[747-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-null]
  2743. 2013-01-29 14:31:20,140 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to release Nic[747-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-null]
  2744. 2013-01-29 14:31:20,140 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to release Nic[747-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-null]
  2745. 2013-01-29 14:31:20,140 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to release Nic[747-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-null]
  2746. 2013-01-29 14:31:20,191 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VirtualRouter to release Nic[61-32-0bb05af1-b944-480e-a86b-df0c36a30fe7-null]
  2747. 2013-01-29 14:31:20,191 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking Ovs to release Nic[61-32-0bb05af1-b944-480e-a86b-df0c36a30fe7-null]
  2748. 2013-01-29 14:31:20,192 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking ExternalDhcpServer to release Nic[61-32-0bb05af1-b944-480e-a86b-df0c36a30fe7-null]
  2749. 2013-01-29 14:31:20,192 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking BareMetal to release Nic[61-32-0bb05af1-b944-480e-a86b-df0c36a30fe7-null]
  2750. 2013-01-29 14:31:20,192 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking SecurityGroupProvider to release Nic[61-32-0bb05af1-b944-480e-a86b-df0c36a30fe7-null]
  2751. 2013-01-29 14:31:20,192 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VpcVirtualRouter to release Nic[61-32-0bb05af1-b944-480e-a86b-df0c36a30fe7-null]
  2752. 2013-01-29 14:31:20,192 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking NiciraNvp to release Nic[61-32-0bb05af1-b944-480e-a86b-df0c36a30fe7-null]
  2753. 2013-01-29 14:31:20,192 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Successfully released network resources for the vm VM[ConsoleProxy|v-32-VM]
  2754. 2013-01-29 14:31:20,192 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Successfully cleanued up resources for the vm VM[ConsoleProxy|v-32-VM] in Starting state
  2755. 2013-01-29 14:31:20,242 DEBUG [dc.dao.DataCenterIpAddressDaoImpl] (secstorage-1:null) Releasing ip address for reservationId=32b73696-3ba9-4ffe-88ff-2580f06340d6, instance=748
  2756. 2013-01-29 14:31:20,348 DEBUG [network.guru.PodBasedNetworkGuru] (secstorage-1:null) Released nic: NicProfile[748-204-null-null-null
  2757. 2013-01-29 14:31:20,400 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: 7
  2758. 2013-01-29 14:31:20,402 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) Hosts's actual total CPU: 12004 and CPU after applying overprovisioning: 12004
  2759. 2013-01-29 14:31:20,402 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) release cpu from host: 7, old used: 1000,reserved: 0, actual total: 12004, total with overprovisioning: 12004; new used: 500,reserved:0; movedfromreserved: false,moveToReserveredfalse
  2760. 2013-01-29 14:31:20,402 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) release mem from host: 7, old used: 1342177280,reserved: 0, total: 8269606912; new used: 268435456,reserved:0; movedfromreserved: false,moveToReserveredfalse
  2761. 2013-01-29 14:31:20,449 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to release Nic[748-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-null]
  2762. 2013-01-29 14:31:20,450 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to release Nic[748-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-null]
  2763. 2013-01-29 14:31:20,450 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to release Nic[748-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-null]
  2764. 2013-01-29 14:31:20,450 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to release Nic[748-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-null]
  2765. 2013-01-29 14:31:20,450 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to release Nic[748-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-null]
  2766. 2013-01-29 14:31:20,450 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to release Nic[748-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-null]
  2767. 2013-01-29 14:31:20,450 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to release Nic[748-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-null]
  2768. 2013-01-29 14:31:20,534 WARN [cloud.consoleproxy.ConsoleProxyManagerImpl] (consoleproxy-1:null) Exception while trying to start console proxy
  2769. com.cloud.exception.AgentUnavailableException: Resource [Host:7] is unreachable: Host 7: Unable to start instance due to com.cloud.agent.api.Answer cannot be cast to com.cloud.agent.api.storage.PrimaryStorageDownloadAnswer
  2770. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:847)
  2771. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:472)
  2772. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:465)
  2773. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.startProxy(ConsoleProxyManagerImpl.java:627)
  2774. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.allocCapacity(ConsoleProxyManagerImpl.java:1164)
  2775. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:1981)
  2776. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:173)
  2777. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:113)
  2778. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:34)
  2779. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:83)
  2780. at com.cloud.vm.SystemVmLoadScanner$1.run(SystemVmLoadScanner.java:73)
  2781. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  2782. at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351)
  2783. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178)
  2784. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165)
  2785. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267)
  2786. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
  2787. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
  2788. at java.lang.Thread.run(Thread.java:679)
  2789. Caused by: java.lang.ClassCastException: com.cloud.agent.api.Answer cannot be cast to com.cloud.agent.api.storage.PrimaryStorageDownloadAnswer
  2790. at com.cloud.template.TemplateManagerImpl.prepareTemplateForCreate(TemplateManagerImpl.java:663)
  2791. at com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34)
  2792. at com.cloud.storage.StorageManagerImpl.createVolume(StorageManagerImpl.java:3442)
  2793. at com.cloud.storage.StorageManagerImpl.prepare(StorageManagerImpl.java:3351)
  2794. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:754)
  2795. ... 19 more
  2796. 2013-01-29 14:31:20,584 DEBUG [dc.dao.DataCenterIpAddressDaoImpl] (secstorage-1:null) Releasing ip address for reservationId=32b73696-3ba9-4ffe-88ff-2580f06340d6, instance=749
  2797. 2013-01-29 14:31:20,651 DEBUG [network.guru.PodBasedNetworkGuru] (secstorage-1:null) Released nic: NicProfile[749-204-null-null-null
  2798. 2013-01-29 14:31:20,691 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to release Nic[749-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-null]
  2799. 2013-01-29 14:31:20,691 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to release Nic[749-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-null]
  2800. 2013-01-29 14:31:20,691 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to release Nic[749-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-null]
  2801. 2013-01-29 14:31:20,691 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to release Nic[749-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-null]
  2802. 2013-01-29 14:31:20,691 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to release Nic[749-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-null]
  2803. 2013-01-29 14:31:20,692 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to release Nic[749-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-null]
  2804. 2013-01-29 14:31:20,692 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to release Nic[749-204-32b73696-3ba9-4ffe-88ff-2580f06340d6-null]
  2805. 2013-01-29 14:31:20,692 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Successfully released network resources for the vm VM[SecondaryStorageVm|s-204-VM]
  2806. 2013-01-29 14:31:20,692 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Successfully cleanued up resources for the vm VM[SecondaryStorageVm|s-204-VM] in Starting state
  2807. 2013-01-29 14:31:20,800 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: 7
  2808. 2013-01-29 14:31:20,802 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) Hosts's actual total CPU: 12004 and CPU after applying overprovisioning: 12004
  2809. 2013-01-29 14:31:20,802 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) release cpu from host: 7, old used: 500,reserved: 0, actual total: 12004, total with overprovisioning: 12004; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  2810. 2013-01-29 14:31:20,802 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) release mem from host: 7, old used: 268435456,reserved: 0, total: 8269606912; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  2811. 2013-01-29 14:31:20,900 WARN [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Exception while trying to start secondary storage vm
  2812. com.cloud.exception.AgentUnavailableException: Resource [Host:7] is unreachable: Host 7: Unable to start instance due to com.cloud.agent.api.Answer cannot be cast to com.cloud.agent.api.storage.PrimaryStorageDownloadAnswer
  2813. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:847)
  2814. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:472)
  2815. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:465)
  2816. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.startSecStorageVm(SecondaryStorageManagerImpl.java:257)
  2817. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.allocCapacity(SecondaryStorageManagerImpl.java:684)
  2818. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.expandPool(SecondaryStorageManagerImpl.java:1310)
  2819. at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:119)
  2820. at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:50)
  2821. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:106)
  2822. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:34)
  2823. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:83)
  2824. at com.cloud.vm.SystemVmLoadScanner$1.run(SystemVmLoadScanner.java:73)
  2825. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  2826. at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351)
  2827. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178)
  2828. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165)
  2829. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267)
  2830. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
  2831. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
  2832. at java.lang.Thread.run(Thread.java:679)
  2833. Caused by: java.lang.ClassCastException: com.cloud.agent.api.Answer cannot be cast to com.cloud.agent.api.storage.PrimaryStorageDownloadAnswer
  2834. at com.cloud.template.TemplateManagerImpl.prepareTemplateForCreate(TemplateManagerImpl.java:663)
  2835. at com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34)
  2836. at com.cloud.storage.StorageManagerImpl.createVolume(StorageManagerImpl.java:3442)
  2837. at com.cloud.storage.StorageManagerImpl.prepare(StorageManagerImpl.java:3351)
  2838. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:754)
  2839. ... 20 more
  2840. 2013-01-29 14:31:20,901 INFO [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Unable to start secondary storage vm for standby capacity, secStorageVm vm Id : 204, will recycle it and start a new one
  2841. 2013-01-29 14:31:20,901 INFO [cloud.secstorage.PremiumSecondaryStorageManagerImpl] (secstorage-1:null) Primary secondary storage is not even started, wait until next turn
  2842. 2013-01-29 14:31:33,859 DEBUG [cloud.server.StatsCollector] (StatsCollector-3:null) HostStatsCollector is running...
  2843. 2013-01-29 14:31:34,488 DEBUG [agent.transport.Request] (StatsCollector-3:null) Seq 1-89030386: Received: { Ans: , MgmtId: 60908668245, via: 1, Ver: v1, Flags: 10, { GetHostStatsAnswer } }
  2844. 2013-01-29 14:31:35,106 DEBUG [agent.transport.Request] (StatsCollector-3:null) Seq 4-220941133: Received: { Ans: , MgmtId: 60908668245, via: 4, Ver: v1, Flags: 10, { GetHostStatsAnswer } }
  2845. 2013-01-29 14:31:35,662 DEBUG [agent.transport.Request] (StatsCollector-3:null) Seq 7-2090140057: Received: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 10, { GetHostStatsAnswer } }
  2846. 2013-01-29 14:31:45,898 DEBUG [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Zone 1 is ready to launch secondary storage VM
  2847. 2013-01-29 14:31:45,905 DEBUG [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Zone 3 is ready to launch secondary storage VM
  2848. 2013-01-29 14:31:45,907 INFO [cloud.secstorage.PremiumSecondaryStorageManagerImpl] (secstorage-1:null) No running secondary storage vms found in datacenter id=3, starting one
  2849. 2013-01-29 14:31:45,912 INFO [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Found a stopped secondary storage vm, bring it up to running pool. secStorageVm vm id : 204
  2850. 2013-01-29 14:31:45,916 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
  2851. 2013-01-29 14:31:45,916 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Successfully transitioned to start state for VM[SecondaryStorageVm|s-204-VM] reservation id = 0ebf9ce7-2e7a-4e17-a6ca-3087a947343b
  2852. 2013-01-29 14:31:45,989 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Trying to deploy VM, vm has dcId: 3 and podId: 3
  2853. 2013-01-29 14:31:45,989 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Deploy avoids pods: null, clusters: null, hosts: null
  2854. 2013-01-29 14:31:45,990 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) DeploymentPlanner allocation algorithm: random
  2855. 2013-01-29 14:31:45,990 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Trying to allocate a host and storage pools from dc:3, pod:3,cluster:null, requested cpu: 500, requested ram: 268435456
  2856. 2013-01-29 14:31:45,990 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Is ROOT volume READY (pool already allocated)?: No
  2857. 2013-01-29 14:31:45,990 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Searching resources only under specified Pod: 3
  2858. 2013-01-29 14:31:45,991 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Pod: 3
  2859. 2013-01-29 14:31:45,991 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) CPUOverprovisioningFactor considered: 1.0
  2860. 2013-01-29 14:31:45,995 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Checking resources in Cluster: 3 under Pod: 3
  2861. 2013-01-29 14:31:45,995 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Calling HostAllocators to find suitable hosts
  2862. 2013-01-29 14:31:45,995 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) Looking for hosts in dc: 3 pod:3 cluster:3
  2863. 2013-01-29 14:31:45,995 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) FirstFitAllocator has 1 hosts to check for allocation: [Host[-7-Routing]]
  2864. 2013-01-29 14:31:45,996 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) Found 1 hosts for allocation after prioritization: [Host[-7-Routing]]
  2865. 2013-01-29 14:31:45,996 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=256
  2866. 2013-01-29 14:31:45,997 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) Checking if host: 7 has enough capacity for requested CPU: 500 and requested RAM: 268435456 , cpuOverprovisioningFactor: 1.0
  2867. 2013-01-29 14:31:45,998 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) Hosts's actual total CPU: 12004 and CPU after applying overprovisioning: 12004
  2868. 2013-01-29 14:31:45,998 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) Free CPU: 12004 , Requested CPU: 500
  2869. 2013-01-29 14:31:45,998 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) Free RAM: 8269606912 , Requested RAM: 268435456
  2870. 2013-01-29 14:31:45,998 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) Host has enough CPU and RAM available
  2871. 2013-01-29 14:31:45,998 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 7, used: 0, reserved: 0, actual total: 12004, total with overprovisioning: 12004; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  2872. 2013-01-29 14:31:45,998 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 7, used: 0, reserved: 0, total: 8269606912; requested mem: 268435456,alloc_from_last_host?:false ,considerReservedCapacity?: true
  2873. 2013-01-29 14:31:45,998 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) Found a suitable host, adding to list: 7
  2874. 2013-01-29 14:31:45,998 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) Host Allocator returning 1 suitable hosts
  2875. 2013-01-29 14:31:45,999 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Checking suitable pools for volume (Id, Type): (206,ROOT)
  2876. 2013-01-29 14:31:45,999 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) We need to allocate new storagepool for this volume
  2877. 2013-01-29 14:31:45,999 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Calling StoragePoolAllocators to find suitable pools
  2878. 2013-01-29 14:31:46,001 DEBUG [storage.allocator.FirstFitStoragePoolAllocator] (secstorage-1:null) Looking for pools in dc: 3 pod:3 cluster:3
  2879. 2013-01-29 14:31:46,002 DEBUG [storage.allocator.FirstFitStoragePoolAllocator] (secstorage-1:null) FirstFitStoragePoolAllocator has 1 pools to check for allocation
  2880. 2013-01-29 14:31:46,002 DEBUG [storage.allocator.AbstractStoragePoolAllocator] (secstorage-1:null) Checking if storage pool is suitable, name: DRDB10 ,poolId: 204
  2881. 2013-01-29 14:31:46,002 DEBUG [storage.allocator.AbstractStoragePoolAllocator] (secstorage-1:null) Is localStorageAllocationNeeded? false
  2882. 2013-01-29 14:31:46,002 DEBUG [storage.allocator.AbstractStoragePoolAllocator] (secstorage-1:null) Is storage pool shared? true
  2883. 2013-01-29 14:31:46,003 DEBUG [cloud.storage.StorageManagerImpl] (secstorage-1:null) Checking pool 204 for storage, totalSize: 1968949690368, usedBytes: 204734464, usedPct: 1.039815618456634E-4, disable threshold: 0.85
  2884. 2013-01-29 14:31:46,005 DEBUG [cloud.storage.StorageManagerImpl] (secstorage-1:null) Checking pool: 204 for volume allocation [Vol[206|vm=204|ROOT]], maxSize : 3937899380736, totalAllocatedSize : 0, askingSize : 0, allocated disable threshold: 0.85
  2885. 2013-01-29 14:31:46,005 DEBUG [storage.allocator.FirstFitStoragePoolAllocator] (secstorage-1:null) FirstFitStoragePoolAllocator returning 1 suitable storage pools
  2886. 2013-01-29 14:31:46,005 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Trying to find a potenial host and associated storage pools from the suitable host/pool lists for this VM
  2887. 2013-01-29 14:31:46,005 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Checking if host: 7 can access any suitable storage pool for volume: ROOT
  2888. 2013-01-29 14:31:46,006 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Host: 7 can access pool: 204
  2889. 2013-01-29 14:31:46,006 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Found a potential host id: 7 name: mc1 and associated storage pools for this VM
  2890. 2013-01-29 14:31:46,006 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Returning Deployment Destination: Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(3)-Pod(3)-Cluster(3)-Host(7)-Storage(Volume(206|ROOT-->Pool(204))]
  2891. 2013-01-29 14:31:46,006 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Deployment found - P0=VM[SecondaryStorageVm|s-204-VM], P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(3)-Pod(3)-Cluster(3)-Host(7)-Storage(Volume(206|ROOT-->Pool(204))]
  2892. 2013-01-29 14:31:46,022 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl] (consoleproxy-1:null) Zone 1 is ready to launch console proxy
  2893. 2013-01-29 14:31:46,024 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl] (consoleproxy-1:null) Zone 3 is ready to launch console proxy
  2894. 2013-01-29 14:31:46,024 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl] (consoleproxy-1:null) Expand console proxy standby capacity for zone Mira
  2895. 2013-01-29 14:31:46,026 INFO [cloud.consoleproxy.ConsoleProxyManagerImpl] (consoleproxy-1:null) Found a stopped console proxy, bring it up to running pool. proxy vm id : 32
  2896. 2013-01-29 14:31:46,030 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
  2897. 2013-01-29 14:31:46,030 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Successfully transitioned to start state for VM[ConsoleProxy|v-32-VM] reservation id = 51f64354-9fbf-4626-a437-b49c4dce36fa
  2898. 2013-01-29 14:31:46,115 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Trying to deploy VM, vm has dcId: 3 and podId: 3
  2899. 2013-01-29 14:31:46,115 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Deploy avoids pods: null, clusters: null, hosts: null
  2900. 2013-01-29 14:31:46,116 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) DeploymentPlanner allocation algorithm: random
  2901. 2013-01-29 14:31:46,116 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Trying to allocate a host and storage pools from dc:3, pod:3,cluster:null, requested cpu: 500, requested ram: 1073741824
  2902. 2013-01-29 14:31:46,116 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Is ROOT volume READY (pool already allocated)?: No
  2903. 2013-01-29 14:31:46,116 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Searching resources only under specified Pod: 3
  2904. 2013-01-29 14:31:46,116 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Pod: 3
  2905. 2013-01-29 14:31:46,117 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) CPUOverprovisioningFactor considered: 1.0
  2906. 2013-01-29 14:31:46,120 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Checking resources in Cluster: 3 under Pod: 3
  2907. 2013-01-29 14:31:46,120 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Calling HostAllocators to find suitable hosts
  2908. 2013-01-29 14:31:46,120 DEBUG [allocator.impl.FirstFitAllocator] (consoleproxy-1:FirstFitRoutingAllocator) Looking for hosts in dc: 3 pod:3 cluster:3
  2909. 2013-01-29 14:31:46,121 DEBUG [allocator.impl.FirstFitAllocator] (consoleproxy-1:FirstFitRoutingAllocator) FirstFitAllocator has 1 hosts to check for allocation: [Host[-7-Routing]]
  2910. 2013-01-29 14:31:46,122 DEBUG [allocator.impl.FirstFitAllocator] (consoleproxy-1:FirstFitRoutingAllocator) Found 1 hosts for allocation after prioritization: [Host[-7-Routing]]
  2911. 2013-01-29 14:31:46,122 DEBUG [allocator.impl.FirstFitAllocator] (consoleproxy-1:FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=1024
  2912. 2013-01-29 14:31:46,123 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) Checking if host: 7 has enough capacity for requested CPU: 500 and requested RAM: 1073741824 , cpuOverprovisioningFactor: 1.0
  2913. 2013-01-29 14:31:46,124 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) Hosts's actual total CPU: 12004 and CPU after applying overprovisioning: 12004
  2914. 2013-01-29 14:31:46,124 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) Free CPU: 12004 , Requested CPU: 500
  2915. 2013-01-29 14:31:46,124 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) Free RAM: 8269606912 , Requested RAM: 1073741824
  2916. 2013-01-29 14:31:46,124 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) Host has enough CPU and RAM available
  2917. 2013-01-29 14:31:46,124 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 7, used: 0, reserved: 0, actual total: 12004, total with overprovisioning: 12004; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  2918. 2013-01-29 14:31:46,124 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 7, used: 0, reserved: 0, total: 8269606912; requested mem: 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
  2919. 2013-01-29 14:31:46,124 DEBUG [allocator.impl.FirstFitAllocator] (consoleproxy-1:FirstFitRoutingAllocator) Found a suitable host, adding to list: 7
  2920. 2013-01-29 14:31:46,124 DEBUG [allocator.impl.FirstFitAllocator] (consoleproxy-1:FirstFitRoutingAllocator) Host Allocator returning 1 suitable hosts
  2921. 2013-01-29 14:31:46,125 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Checking suitable pools for volume (Id, Type): (34,ROOT)
  2922. 2013-01-29 14:31:46,125 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) We need to allocate new storagepool for this volume
  2923. 2013-01-29 14:31:46,125 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Calling StoragePoolAllocators to find suitable pools
  2924. 2013-01-29 14:31:46,126 DEBUG [storage.allocator.FirstFitStoragePoolAllocator] (consoleproxy-1:null) Looking for pools in dc: 3 pod:3 cluster:3
  2925. 2013-01-29 14:31:46,126 DEBUG [storage.allocator.FirstFitStoragePoolAllocator] (consoleproxy-1:null) FirstFitStoragePoolAllocator has 1 pools to check for allocation
  2926. 2013-01-29 14:31:46,126 DEBUG [storage.allocator.AbstractStoragePoolAllocator] (consoleproxy-1:null) Checking if storage pool is suitable, name: DRDB10 ,poolId: 204
  2927. 2013-01-29 14:31:46,126 DEBUG [storage.allocator.AbstractStoragePoolAllocator] (consoleproxy-1:null) Is localStorageAllocationNeeded? false
  2928. 2013-01-29 14:31:46,126 DEBUG [storage.allocator.AbstractStoragePoolAllocator] (consoleproxy-1:null) Is storage pool shared? true
  2929. 2013-01-29 14:31:46,127 DEBUG [cloud.storage.StorageManagerImpl] (consoleproxy-1:null) Checking pool 204 for storage, totalSize: 1968949690368, usedBytes: 204734464, usedPct: 1.039815618456634E-4, disable threshold: 0.85
  2930. 2013-01-29 14:31:46,129 DEBUG [cloud.storage.StorageManagerImpl] (consoleproxy-1:null) Checking pool: 204 for volume allocation [Vol[34|vm=32|ROOT]], maxSize : 3937899380736, totalAllocatedSize : 0, askingSize : 0, allocated disable threshold: 0.85
  2931. 2013-01-29 14:31:46,129 DEBUG [storage.allocator.FirstFitStoragePoolAllocator] (consoleproxy-1:null) FirstFitStoragePoolAllocator returning 1 suitable storage pools
  2932. 2013-01-29 14:31:46,129 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Trying to find a potenial host and associated storage pools from the suitable host/pool lists for this VM
  2933. 2013-01-29 14:31:46,129 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Checking if host: 7 can access any suitable storage pool for volume: ROOT
  2934. 2013-01-29 14:31:46,129 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Host: 7 can access pool: 204
  2935. 2013-01-29 14:31:46,129 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Found a potential host id: 7 name: mc1 and associated storage pools for this VM
  2936. 2013-01-29 14:31:46,130 DEBUG [cloud.deploy.FirstFitPlanner] (consoleproxy-1:null) Returning Deployment Destination: Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(3)-Pod(3)-Cluster(3)-Host(7)-Storage(Volume(34|ROOT-->Pool(204))]
  2937. 2013-01-29 14:31:46,130 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Deployment found - P0=VM[ConsoleProxy|v-32-VM], P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(3)-Pod(3)-Cluster(3)-Host(7)-Storage(Volume(34|ROOT-->Pool(204))]
  2938. 2013-01-29 14:31:46,164 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) VM state transitted from :Starting to Starting with event: OperationRetryvm's original host id: null new host id: 7 host id before state transition: null
  2939. 2013-01-29 14:31:46,168 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) Hosts's actual total CPU: 12004 and CPU after applying overprovisioning: 12004
  2940. 2013-01-29 14:31:46,168 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) We are allocating VM, increasing the used capacity of this host:7
  2941. 2013-01-29 14:31:46,168 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) Current Used CPU: 0 , Free CPU:12004 ,Requested CPU: 500
  2942. 2013-01-29 14:31:46,168 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) Current Used RAM: 0 , Free RAM:8269606912 ,Requested RAM: 268435456
  2943. 2013-01-29 14:31:46,168 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) CPU STATS after allocation: for host: 7, old used: 0, old reserved: 0, actual total: 12004, total with overprovisioning: 12004; new used:500, reserved:0; requested cpu:500,alloc_from_last:false
  2944. 2013-01-29 14:31:46,168 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) RAM STATS after allocation: for host: 7, old used: 0, old reserved: 0, total: 8269606912; new used: 268435456, reserved: 0; requested mem: 268435456,alloc_from_last:false
  2945. 2013-01-29 14:31:46,257 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) VM is being created in podId: 3
  2946. 2013-01-29 14:31:46,259 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is acquired for network id 222 as a part of network implement
  2947. 2013-01-29 14:31:46,259 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Network id=222 is already implemented
  2948. 2013-01-29 14:31:46,259 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is released for network id 222 as a part of network implement
  2949. 2013-01-29 14:31:46,308 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) VM state transitted from :Starting to Starting with event: OperationRetryvm's original host id: null new host id: 7 host id before state transition: null
  2950. 2013-01-29 14:31:46,312 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) Hosts's actual total CPU: 12004 and CPU after applying overprovisioning: 12004
  2951. 2013-01-29 14:31:46,312 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) We are allocating VM, increasing the used capacity of this host:7
  2952. 2013-01-29 14:31:46,312 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) Current Used CPU: 500 , Free CPU:11504 ,Requested CPU: 500
  2953. 2013-01-29 14:31:46,312 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) Current Used RAM: 268435456 , Free RAM:8001171456 ,Requested RAM: 1073741824
  2954. 2013-01-29 14:31:46,312 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) CPU STATS after allocation: for host: 7, old used: 500, old reserved: 0, actual total: 12004, total with overprovisioning: 12004; new used:1000, reserved:0; requested cpu:500,alloc_from_last:false
  2955. 2013-01-29 14:31:46,312 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) RAM STATS after allocation: for host: 7, old used: 268435456, old reserved: 0, total: 8269606912; new used: 1342177280, reserved: 0; requested mem: 1073741824,alloc_from_last:false
  2956. 2013-01-29 14:31:46,348 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Service SecurityGroup is not supported in the network id=222
  2957. 2013-01-29 14:31:46,398 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) VM is being created in podId: 3
  2958. 2013-01-29 14:31:46,407 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Lock is acquired for network id 222 as a part of network implement
  2959. 2013-01-29 14:31:46,407 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Network id=222 is already implemented
  2960. 2013-01-29 14:31:46,407 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Lock is released for network id 222 as a part of network implement
  2961. 2013-01-29 14:31:46,428 DEBUG [network.router.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:null) Found 5 routers.
  2962. 2013-01-29 14:31:46,443 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to prepare for Nic[746-204-0ebf9ce7-2e7a-4e17-a6ca-3087a947343b-212.70.6.205]
  2963. 2013-01-29 14:31:46,443 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to prepare for Nic[746-204-0ebf9ce7-2e7a-4e17-a6ca-3087a947343b-212.70.6.205]
  2964. 2013-01-29 14:31:46,443 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to prepare for Nic[746-204-0ebf9ce7-2e7a-4e17-a6ca-3087a947343b-212.70.6.205]
  2965. 2013-01-29 14:31:46,443 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to prepare for Nic[746-204-0ebf9ce7-2e7a-4e17-a6ca-3087a947343b-212.70.6.205]
  2966. 2013-01-29 14:31:46,443 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to prepare for Nic[746-204-0ebf9ce7-2e7a-4e17-a6ca-3087a947343b-212.70.6.205]
  2967. 2013-01-29 14:31:46,443 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to prepare for Nic[746-204-0ebf9ce7-2e7a-4e17-a6ca-3087a947343b-212.70.6.205]
  2968. 2013-01-29 14:31:46,444 WARN [network.element.VpcVirtualRouterElement] (secstorage-1:null) Network Ntwk[222|Guest|7] is not associated with any VPC
  2969. 2013-01-29 14:31:46,444 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to prepare for Nic[746-204-0ebf9ce7-2e7a-4e17-a6ca-3087a947343b-212.70.6.205]
  2970. 2013-01-29 14:31:46,444 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Service SecurityGroup is not supported in the network id=222
  2971. 2013-01-29 14:31:46,445 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is acquired for network id 220 as a part of network implement
  2972. 2013-01-29 14:31:46,445 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Network id=220 is already implemented
  2973. 2013-01-29 14:31:46,445 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is released for network id 220 as a part of network implement
  2974. 2013-01-29 14:31:46,485 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Service SecurityGroup is not supported in the network id=222
  2975. 2013-01-29 14:31:46,593 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VirtualRouter to prepare for Nic[59-32-51f64354-9fbf-4626-a437-b49c4dce36fa-212.70.6.202]
  2976. 2013-01-29 14:31:46,593 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking Ovs to prepare for Nic[59-32-51f64354-9fbf-4626-a437-b49c4dce36fa-212.70.6.202]
  2977. 2013-01-29 14:31:46,593 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking ExternalDhcpServer to prepare for Nic[59-32-51f64354-9fbf-4626-a437-b49c4dce36fa-212.70.6.202]
  2978. 2013-01-29 14:31:46,593 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking BareMetal to prepare for Nic[59-32-51f64354-9fbf-4626-a437-b49c4dce36fa-212.70.6.202]
  2979. 2013-01-29 14:31:46,593 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking SecurityGroupProvider to prepare for Nic[59-32-51f64354-9fbf-4626-a437-b49c4dce36fa-212.70.6.202]
  2980. 2013-01-29 14:31:46,593 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VpcVirtualRouter to prepare for Nic[59-32-51f64354-9fbf-4626-a437-b49c4dce36fa-212.70.6.202]
  2981. 2013-01-29 14:31:46,593 WARN [network.element.VpcVirtualRouterElement] (consoleproxy-1:null) Network Ntwk[222|Guest|7] is not associated with any VPC
  2982. 2013-01-29 14:31:46,593 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking NiciraNvp to prepare for Nic[59-32-51f64354-9fbf-4626-a437-b49c4dce36fa-212.70.6.202]
  2983. 2013-01-29 14:31:46,594 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Service SecurityGroup is not supported in the network id=222
  2984. 2013-01-29 14:31:46,595 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Lock is acquired for network id 220 as a part of network implement
  2985. 2013-01-29 14:31:46,595 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Network id=220 is already implemented
  2986. 2013-01-29 14:31:46,595 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Lock is released for network id 220 as a part of network implement
  2987. 2013-01-29 14:31:46,744 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to prepare for Nic[747-204-0ebf9ce7-2e7a-4e17-a6ca-3087a947343b-169.254.2.248]
  2988. 2013-01-29 14:31:46,744 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to prepare for Nic[747-204-0ebf9ce7-2e7a-4e17-a6ca-3087a947343b-169.254.2.248]
  2989. 2013-01-29 14:31:46,744 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to prepare for Nic[747-204-0ebf9ce7-2e7a-4e17-a6ca-3087a947343b-169.254.2.248]
  2990. 2013-01-29 14:31:46,744 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to prepare for Nic[747-204-0ebf9ce7-2e7a-4e17-a6ca-3087a947343b-169.254.2.248]
  2991. 2013-01-29 14:31:46,744 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to prepare for Nic[747-204-0ebf9ce7-2e7a-4e17-a6ca-3087a947343b-169.254.2.248]
  2992. 2013-01-29 14:31:46,744 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to prepare for Nic[747-204-0ebf9ce7-2e7a-4e17-a6ca-3087a947343b-169.254.2.248]
  2993. 2013-01-29 14:31:46,744 WARN [network.element.VpcVirtualRouterElement] (secstorage-1:null) Network Ntwk[220|Control|3] is not associated with any VPC
  2994. 2013-01-29 14:31:46,744 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to prepare for Nic[747-204-0ebf9ce7-2e7a-4e17-a6ca-3087a947343b-169.254.2.248]
  2995. 2013-01-29 14:31:46,745 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is acquired for network id 219 as a part of network implement
  2996. 2013-01-29 14:31:46,745 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Network id=219 is already implemented
  2997. 2013-01-29 14:31:46,745 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is released for network id 219 as a part of network implement
  2998. 2013-01-29 14:31:46,891 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VirtualRouter to prepare for Nic[60-32-51f64354-9fbf-4626-a437-b49c4dce36fa-169.254.2.39]
  2999. 2013-01-29 14:31:46,892 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking Ovs to prepare for Nic[60-32-51f64354-9fbf-4626-a437-b49c4dce36fa-169.254.2.39]
  3000. 2013-01-29 14:31:46,892 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking ExternalDhcpServer to prepare for Nic[60-32-51f64354-9fbf-4626-a437-b49c4dce36fa-169.254.2.39]
  3001. 2013-01-29 14:31:46,892 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking BareMetal to prepare for Nic[60-32-51f64354-9fbf-4626-a437-b49c4dce36fa-169.254.2.39]
  3002. 2013-01-29 14:31:46,892 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking SecurityGroupProvider to prepare for Nic[60-32-51f64354-9fbf-4626-a437-b49c4dce36fa-169.254.2.39]
  3003. 2013-01-29 14:31:46,892 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VpcVirtualRouter to prepare for Nic[60-32-51f64354-9fbf-4626-a437-b49c4dce36fa-169.254.2.39]
  3004. 2013-01-29 14:31:46,892 WARN [network.element.VpcVirtualRouterElement] (consoleproxy-1:null) Network Ntwk[220|Control|3] is not associated with any VPC
  3005. 2013-01-29 14:31:46,892 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking NiciraNvp to prepare for Nic[60-32-51f64354-9fbf-4626-a437-b49c4dce36fa-169.254.2.39]
  3006. 2013-01-29 14:31:46,893 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Lock is acquired for network id 219 as a part of network implement
  3007. 2013-01-29 14:31:46,893 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Network id=219 is already implemented
  3008. 2013-01-29 14:31:46,893 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Lock is released for network id 219 as a part of network implement
  3009. 2013-01-29 14:31:46,943 DEBUG [network.guru.PodBasedNetworkGuru] (secstorage-1:null) Allocated a nic NicProfile[748-204-0ebf9ce7-2e7a-4e17-a6ca-3087a947343b-212.70.6.62-null for VM[SecondaryStorageVm|s-204-VM]
  3010. 2013-01-29 14:31:47,053 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to prepare for Nic[748-204-0ebf9ce7-2e7a-4e17-a6ca-3087a947343b-212.70.6.62]
  3011. 2013-01-29 14:31:47,054 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to prepare for Nic[748-204-0ebf9ce7-2e7a-4e17-a6ca-3087a947343b-212.70.6.62]
  3012. 2013-01-29 14:31:47,054 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to prepare for Nic[748-204-0ebf9ce7-2e7a-4e17-a6ca-3087a947343b-212.70.6.62]
  3013. 2013-01-29 14:31:47,054 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to prepare for Nic[748-204-0ebf9ce7-2e7a-4e17-a6ca-3087a947343b-212.70.6.62]
  3014. 2013-01-29 14:31:47,054 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to prepare for Nic[748-204-0ebf9ce7-2e7a-4e17-a6ca-3087a947343b-212.70.6.62]
  3015. 2013-01-29 14:31:47,054 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to prepare for Nic[748-204-0ebf9ce7-2e7a-4e17-a6ca-3087a947343b-212.70.6.62]
  3016. 2013-01-29 14:31:47,054 WARN [network.element.VpcVirtualRouterElement] (secstorage-1:null) Network Ntwk[219|Management|2] is not associated with any VPC
  3017. 2013-01-29 14:31:47,054 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to prepare for Nic[748-204-0ebf9ce7-2e7a-4e17-a6ca-3087a947343b-212.70.6.62]
  3018. 2013-01-29 14:31:47,055 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is acquired for network id 221 as a part of network implement
  3019. 2013-01-29 14:31:47,056 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Network id=221 is already implemented
  3020. 2013-01-29 14:31:47,056 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Lock is released for network id 221 as a part of network implement
  3021. 2013-01-29 14:31:47,104 DEBUG [network.guru.PodBasedNetworkGuru] (consoleproxy-1:null) Allocated a nic NicProfile[61-32-51f64354-9fbf-4626-a437-b49c4dce36fa-212.70.6.82-null for VM[ConsoleProxy|v-32-VM]
  3022. 2013-01-29 14:31:47,212 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VirtualRouter to prepare for Nic[61-32-51f64354-9fbf-4626-a437-b49c4dce36fa-212.70.6.82]
  3023. 2013-01-29 14:31:47,212 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking Ovs to prepare for Nic[61-32-51f64354-9fbf-4626-a437-b49c4dce36fa-212.70.6.82]
  3024. 2013-01-29 14:31:47,212 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking ExternalDhcpServer to prepare for Nic[61-32-51f64354-9fbf-4626-a437-b49c4dce36fa-212.70.6.82]
  3025. 2013-01-29 14:31:47,212 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking BareMetal to prepare for Nic[61-32-51f64354-9fbf-4626-a437-b49c4dce36fa-212.70.6.82]
  3026. 2013-01-29 14:31:47,212 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking SecurityGroupProvider to prepare for Nic[61-32-51f64354-9fbf-4626-a437-b49c4dce36fa-212.70.6.82]
  3027. 2013-01-29 14:31:47,212 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VpcVirtualRouter to prepare for Nic[61-32-51f64354-9fbf-4626-a437-b49c4dce36fa-212.70.6.82]
  3028. 2013-01-29 14:31:47,212 WARN [network.element.VpcVirtualRouterElement] (consoleproxy-1:null) Network Ntwk[219|Management|2] is not associated with any VPC
  3029. 2013-01-29 14:31:47,212 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking NiciraNvp to prepare for Nic[61-32-51f64354-9fbf-4626-a437-b49c4dce36fa-212.70.6.82]
  3030. 2013-01-29 14:31:47,213 DEBUG [cloud.storage.StorageManagerImpl] (consoleproxy-1:null) Checking if we need to prepare 1 volumes for VM[ConsoleProxy|v-32-VM]
  3031. 2013-01-29 14:31:47,261 DEBUG [network.guru.PodBasedNetworkGuru] (secstorage-1:null) Allocated a nic NicProfile[749-204-0ebf9ce7-2e7a-4e17-a6ca-3087a947343b-212.70.6.78-null for VM[SecondaryStorageVm|s-204-VM]
  3032. 2013-01-29 14:31:47,321 DEBUG [cloud.storage.StorageManagerImpl] (consoleproxy-1:null) Creating volume: Vol[34|vm=32|ROOT]
  3033. 2013-01-29 14:31:47,322 DEBUG [cloud.storage.StorageManagerImpl] (consoleproxy-1:null) Trying to create in Pool[204|NetworkFilesystem]
  3034. 2013-01-29 14:31:47,371 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to prepare for Nic[749-204-0ebf9ce7-2e7a-4e17-a6ca-3087a947343b-212.70.6.78]
  3035. 2013-01-29 14:31:47,372 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to prepare for Nic[749-204-0ebf9ce7-2e7a-4e17-a6ca-3087a947343b-212.70.6.78]
  3036. 2013-01-29 14:31:47,372 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to prepare for Nic[749-204-0ebf9ce7-2e7a-4e17-a6ca-3087a947343b-212.70.6.78]
  3037. 2013-01-29 14:31:47,372 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to prepare for Nic[749-204-0ebf9ce7-2e7a-4e17-a6ca-3087a947343b-212.70.6.78]
  3038. 2013-01-29 14:31:47,372 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to prepare for Nic[749-204-0ebf9ce7-2e7a-4e17-a6ca-3087a947343b-212.70.6.78]
  3039. 2013-01-29 14:31:47,372 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to prepare for Nic[749-204-0ebf9ce7-2e7a-4e17-a6ca-3087a947343b-212.70.6.78]
  3040. 2013-01-29 14:31:47,372 WARN [network.element.VpcVirtualRouterElement] (secstorage-1:null) Network Ntwk[221|Storage|4] is not associated with any VPC
  3041. 2013-01-29 14:31:47,372 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to prepare for Nic[749-204-0ebf9ce7-2e7a-4e17-a6ca-3087a947343b-212.70.6.78]
  3042. 2013-01-29 14:31:47,373 DEBUG [cloud.storage.StorageManagerImpl] (secstorage-1:null) Checking if we need to prepare 1 volumes for VM[SecondaryStorageVm|s-204-VM]
  3043. 2013-01-29 14:31:47,479 DEBUG [cloud.storage.StorageManagerImpl] (secstorage-1:null) Creating volume: Vol[206|vm=204|ROOT]
  3044. 2013-01-29 14:31:47,479 DEBUG [cloud.storage.StorageManagerImpl] (secstorage-1:null) Trying to create in Pool[204|NetworkFilesystem]
  3045. 2013-01-29 14:31:47,533 DEBUG [cloud.template.TemplateManagerImpl] (consoleproxy-1:null) Downloading 3 via 7
  3046. 2013-01-29 14:31:47,535 DEBUG [agent.transport.Request] (consoleproxy-1:null) Seq 7-2090140058: Sending { Cmd , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 100111, [{"storage.PrimaryStorageDownloadCommand":{"localPath":"/mnt/99898908-d913-39c8-b61d-c7e6b6dbd8f0","poolUuid":"99898908-d913-39c8-b61d-c7e6b6dbd8f0","poolId":204,"secondaryStorageUrl":"nfs://cloudmanager.mira.dk/export/mirazone","primaryStorageUrl":"nfs://10.212.212.249/export/drbd10","url":"nfs://cloudmanager.mira.dk/export/mirazone/template/tmpl/1/3/","format":"QCOW2","accountId":1,"name":"routing-3","wait":10800}}] }
  3047. 2013-01-29 14:31:47,764 DEBUG [agent.transport.Request] (AgentManager-Handler-6:null) Seq 7-2090140058: Processing: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, [{"Answer":{"result":false,"details":"java.lang.NullPointerException\n\tat com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.createStoragePool(LibvirtStorageAdaptor.java:462)\n\tat com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.getStoragePoolByURI(LibvirtStorageAdaptor.java:745)\n\tat com.cloud.hypervisor.kvm.storage.KVMStoragePoolManager.getStoragePoolByURI(KVMStoragePoolManager.java:52)\n\tat com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:2017)\n\tat com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1009)\n\tat com.cloud.agent.Agent.processRequest(Agent.java:518)\n\tat com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:831)\n\tat com.cloud.utils.nio.Task.run(Task.java:83)\n\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)\n\tat java.lang.Thread.run(Thread.java:679)\n","wait":0}}] }
  3048. 2013-01-29 14:31:47,764 DEBUG [agent.manager.AgentAttache] (AgentManager-Handler-6:null) Seq 7-2090140058: No more commands found
  3049. 2013-01-29 14:31:47,764 DEBUG [agent.transport.Request] (consoleproxy-1:null) Seq 7-2090140058: Received: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, { Answer } }
  3050. 2013-01-29 14:31:47,764 DEBUG [agent.manager.AgentManagerImpl] (consoleproxy-1:null) Details from executing class com.cloud.agent.api.storage.PrimaryStorageDownloadCommand: java.lang.NullPointerException
  3051. at com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.createStoragePool(LibvirtStorageAdaptor.java:462)
  3052. at com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.getStoragePoolByURI(LibvirtStorageAdaptor.java:745)
  3053. at com.cloud.hypervisor.kvm.storage.KVMStoragePoolManager.getStoragePoolByURI(KVMStoragePoolManager.java:52)
  3054. at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:2017)
  3055. at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1009)
  3056. at com.cloud.agent.Agent.processRequest(Agent.java:518)
  3057. at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:831)
  3058. at com.cloud.utils.nio.Task.run(Task.java:83)
  3059. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
  3060. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
  3061. at java.lang.Thread.run(Thread.java:679)
  3062.  
  3063. 2013-01-29 14:31:47,764 ERROR [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Failed to start instance VM[ConsoleProxy|v-32-VM]
  3064. java.lang.ClassCastException: com.cloud.agent.api.Answer cannot be cast to com.cloud.agent.api.storage.PrimaryStorageDownloadAnswer
  3065. at com.cloud.template.TemplateManagerImpl.prepareTemplateForCreate(TemplateManagerImpl.java:663)
  3066. at com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34)
  3067. at com.cloud.storage.StorageManagerImpl.createVolume(StorageManagerImpl.java:3442)
  3068. at com.cloud.storage.StorageManagerImpl.prepare(StorageManagerImpl.java:3351)
  3069. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:754)
  3070. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:472)
  3071. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:465)
  3072. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.startProxy(ConsoleProxyManagerImpl.java:627)
  3073. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.allocCapacity(ConsoleProxyManagerImpl.java:1164)
  3074. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:1981)
  3075. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:173)
  3076. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:113)
  3077. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:34)
  3078. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:83)
  3079. at com.cloud.vm.SystemVmLoadScanner$1.run(SystemVmLoadScanner.java:73)
  3080. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  3081. at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351)
  3082. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178)
  3083. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165)
  3084. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267)
  3085. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
  3086. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
  3087. at java.lang.Thread.run(Thread.java:679)
  3088. 2013-01-29 14:31:47,822 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Cleaning up resources for the vm VM[ConsoleProxy|v-32-VM] in Starting state
  3089. 2013-01-29 14:31:47,823 DEBUG [agent.transport.Request] (consoleproxy-1:null) Seq 7-2090140059: Sending { Cmd , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 100111, [{"StopCommand":{"isProxy":false,"vmName":"v-32-VM","wait":0}}] }
  3090. 2013-01-29 14:31:47,933 DEBUG [agent.transport.Request] (AgentManager-Handler-3:null) Seq 7-2090140059: Processing: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, [{"StopAnswer":{"vncPort":0,"result":true,"wait":0}}] }
  3091. 2013-01-29 14:31:47,933 DEBUG [agent.manager.AgentAttache] (AgentManager-Handler-3:null) Seq 7-2090140059: No more commands found
  3092. 2013-01-29 14:31:47,933 DEBUG [agent.transport.Request] (consoleproxy-1:null) Seq 7-2090140059: Received: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 110, { StopAnswer } }
  3093. 2013-01-29 14:31:47,998 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Service SecurityGroup is not supported in the network id=222
  3094. 2013-01-29 14:31:48,046 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VirtualRouter to release Nic[59-32-51f64354-9fbf-4626-a437-b49c4dce36fa-212.70.6.202]
  3095. 2013-01-29 14:31:48,046 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking Ovs to release Nic[59-32-51f64354-9fbf-4626-a437-b49c4dce36fa-212.70.6.202]
  3096. 2013-01-29 14:31:48,046 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking ExternalDhcpServer to release Nic[59-32-51f64354-9fbf-4626-a437-b49c4dce36fa-212.70.6.202]
  3097. 2013-01-29 14:31:48,046 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking BareMetal to release Nic[59-32-51f64354-9fbf-4626-a437-b49c4dce36fa-212.70.6.202]
  3098. 2013-01-29 14:31:48,046 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking SecurityGroupProvider to release Nic[59-32-51f64354-9fbf-4626-a437-b49c4dce36fa-212.70.6.202]
  3099. 2013-01-29 14:31:48,047 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VpcVirtualRouter to release Nic[59-32-51f64354-9fbf-4626-a437-b49c4dce36fa-212.70.6.202]
  3100. 2013-01-29 14:31:48,047 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking NiciraNvp to release Nic[59-32-51f64354-9fbf-4626-a437-b49c4dce36fa-212.70.6.202]
  3101. 2013-01-29 14:31:48,155 DEBUG [network.guru.ControlNetworkGuru] (consoleproxy-1:null) Released nic: NicProfile[60-32-null-null-null
  3102. 2013-01-29 14:31:48,207 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VirtualRouter to release Nic[60-32-51f64354-9fbf-4626-a437-b49c4dce36fa-null]
  3103. 2013-01-29 14:31:48,207 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking Ovs to release Nic[60-32-51f64354-9fbf-4626-a437-b49c4dce36fa-null]
  3104. 2013-01-29 14:31:48,207 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking ExternalDhcpServer to release Nic[60-32-51f64354-9fbf-4626-a437-b49c4dce36fa-null]
  3105. 2013-01-29 14:31:48,207 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking BareMetal to release Nic[60-32-51f64354-9fbf-4626-a437-b49c4dce36fa-null]
  3106. 2013-01-29 14:31:48,207 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking SecurityGroupProvider to release Nic[60-32-51f64354-9fbf-4626-a437-b49c4dce36fa-null]
  3107. 2013-01-29 14:31:48,207 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VpcVirtualRouter to release Nic[60-32-51f64354-9fbf-4626-a437-b49c4dce36fa-null]
  3108. 2013-01-29 14:31:48,207 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking NiciraNvp to release Nic[60-32-51f64354-9fbf-4626-a437-b49c4dce36fa-null]
  3109. 2013-01-29 14:31:48,256 DEBUG [dc.dao.DataCenterIpAddressDaoImpl] (consoleproxy-1:null) Releasing ip address for reservationId=51f64354-9fbf-4626-a437-b49c4dce36fa, instance=61
  3110. 2013-01-29 14:31:48,306 DEBUG [network.guru.PodBasedNetworkGuru] (consoleproxy-1:null) Released nic: NicProfile[61-32-null-null-null
  3111. 2013-01-29 14:31:48,356 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VirtualRouter to release Nic[61-32-51f64354-9fbf-4626-a437-b49c4dce36fa-null]
  3112. 2013-01-29 14:31:48,356 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking Ovs to release Nic[61-32-51f64354-9fbf-4626-a437-b49c4dce36fa-null]
  3113. 2013-01-29 14:31:48,356 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking ExternalDhcpServer to release Nic[61-32-51f64354-9fbf-4626-a437-b49c4dce36fa-null]
  3114. 2013-01-29 14:31:48,356 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking BareMetal to release Nic[61-32-51f64354-9fbf-4626-a437-b49c4dce36fa-null]
  3115. 2013-01-29 14:31:48,356 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking SecurityGroupProvider to release Nic[61-32-51f64354-9fbf-4626-a437-b49c4dce36fa-null]
  3116. 2013-01-29 14:31:48,356 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking VpcVirtualRouter to release Nic[61-32-51f64354-9fbf-4626-a437-b49c4dce36fa-null]
  3117. 2013-01-29 14:31:48,356 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Asking NiciraNvp to release Nic[61-32-51f64354-9fbf-4626-a437-b49c4dce36fa-null]
  3118. 2013-01-29 14:31:48,356 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Successfully released network resources for the vm VM[ConsoleProxy|v-32-VM]
  3119. 2013-01-29 14:31:48,356 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Successfully cleanued up resources for the vm VM[ConsoleProxy|v-32-VM] in Starting state
  3120. 2013-01-29 14:31:48,448 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: 7
  3121. 2013-01-29 14:31:48,450 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) Hosts's actual total CPU: 12004 and CPU after applying overprovisioning: 12004
  3122. 2013-01-29 14:31:48,450 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) release cpu from host: 7, old used: 1000,reserved: 0, actual total: 12004, total with overprovisioning: 12004; new used: 500,reserved:0; movedfromreserved: false,moveToReserveredfalse
  3123. 2013-01-29 14:31:48,450 DEBUG [cloud.capacity.CapacityManagerImpl] (consoleproxy-1:null) release mem from host: 7, old used: 1342177280,reserved: 0, total: 8269606912; new used: 268435456,reserved:0; movedfromreserved: false,moveToReserveredfalse
  3124. 2013-01-29 14:31:48,499 WARN [cloud.consoleproxy.ConsoleProxyManagerImpl] (consoleproxy-1:null) Exception while trying to start console proxy
  3125. com.cloud.exception.AgentUnavailableException: Resource [Host:7] is unreachable: Host 7: Unable to start instance due to com.cloud.agent.api.Answer cannot be cast to com.cloud.agent.api.storage.PrimaryStorageDownloadAnswer
  3126. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:847)
  3127. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:472)
  3128. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:465)
  3129. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.startProxy(ConsoleProxyManagerImpl.java:627)
  3130. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.allocCapacity(ConsoleProxyManagerImpl.java:1164)
  3131. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:1981)
  3132. at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:173)
  3133. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:113)
  3134. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:34)
  3135. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:83)
  3136. at com.cloud.vm.SystemVmLoadScanner$1.run(SystemVmLoadScanner.java:73)
  3137. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  3138. at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351)
  3139. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178)
  3140. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165)
  3141. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267)
  3142. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
  3143. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
  3144. at java.lang.Thread.run(Thread.java:679)
  3145. Caused by: java.lang.ClassCastException: com.cloud.agent.api.Answer cannot be cast to com.cloud.agent.api.storage.PrimaryStorageDownloadAnswer
  3146. at com.cloud.template.TemplateManagerImpl.prepareTemplateForCreate(TemplateManagerImpl.java:663)
  3147. at com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34)
  3148. at com.cloud.storage.StorageManagerImpl.createVolume(StorageManagerImpl.java:3442)
  3149. at com.cloud.storage.StorageManagerImpl.prepare(StorageManagerImpl.java:3351)
  3150. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:754)
  3151. ... 19 more
  3152. 2013-01-29 14:31:51,533 DEBUG [cloud.server.StatsCollector] (StatsCollector-3:null) StorageCollector is running...
  3153. 2013-01-29 14:31:51,592 DEBUG [agent.transport.Request] (StatsCollector-3:null) Seq 5-632235898: Received: { Ans: , MgmtId: 60908668245, via: 5, Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
  3154. 2013-01-29 14:31:51,592 DEBUG [cloud.server.StatsCollector] (StatsCollector-3:null) There is no secondary storage VM for secondary storage host nfs://cloudmanager.mira.dk/export/mirazone
  3155. 2013-01-29 14:31:51,639 DEBUG [agent.transport.Request] (StatsCollector-3:null) Seq 4-220941134: Received: { Ans: , MgmtId: 60908668245, via: 4, Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
  3156. 2013-01-29 14:31:51,660 DEBUG [agent.transport.Request] (StatsCollector-3:null) Seq 7-2090140060: Received: { Ans: , MgmtId: 60908668245, via: 7, Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
Advertisement
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!