API tools faq
paste
Guest User

management server log

a guest
Apr 17th, 2015
257
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 142.91 KB | None | 0 0
raw download clone embed print report
  1. 2015-04-17 13:01:25,707 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-155:ctx-62101d22) Seq 3-944373850: Executing request
  2. 2015-04-17 13:01:25,907 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-155:ctx-62101d22) Seq 3-944373850: Response Received:
  3. 2015-04-17 13:01:25,907 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-155:ctx-62101d22) Seq 3-944373850: MgmtId 46618217624527: Resp: Routing to peer
  4. 2015-04-17 13:01:25,931 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-381:ctx-6905ed29) Seq 4-327286882: Executing request
  5. 2015-04-17 13:01:26,238 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-381:ctx-6905ed29) Seq 4-327286882: Response Received:
  6. 2015-04-17 13:01:26,238 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-381:ctx-6905ed29) Seq 4-327286882: MgmtId 46618217624527: Resp: Routing to peer
  7. 2015-04-17 13:01:26,266 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-57:ctx-1e8f11f0) Seq 5-634060904: Executing request
  8. 2015-04-17 13:01:26,565 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-57:ctx-1e8f11f0) Seq 5-634060904: Response Received:
  9. 2015-04-17 13:01:26,565 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-57:ctx-1e8f11f0) Seq 5-634060904: MgmtId 46618217624527: Resp: Routing to peer
  10. 2015-04-17 13:01:27,370 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-93:ctx-505bb8a7) Ping from 2(cloud-host10.cgg.gov.in)
  11. 2015-04-17 13:01:27,572 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-239:ctx-61fdd0fe) Ping from 3(cloud-host1.cgg.gov.in)
  12. 2015-04-17 13:01:27,770 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-35:ctx-a4c5a3be) Ping from 4(cloud-host9.cgg.gov.in)
  13. 2015-04-17 13:01:28,835 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-215:ctx-41683ab7) Ping from 5(cloud-host2.cgg.gov.in)
  14. 2015-04-17 13:01:28,941 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-12:ctx-38baddda) Seq 3-599130116: Executing request
  15. 2015-04-17 13:01:29,146 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-12:ctx-38baddda) Seq 3-599130116: Response Received:
  16. 2015-04-17 13:01:29,146 DEBUG [c.c.a.t.Request] (DirectAgent-12:ctx-38baddda) Seq 3-599130116: Processing: { Ans: , MgmtId: 50788518005399, via: 3, Ver: v1, Flags: 10, [{"com.cloud.agent.api.ClusterSyncAnswer":{"_clusterId":1,"_newStates":{},"_isExecuted":false,"result":true,"wait":0}}] }
  17. 2015-04-17 13:01:29,248 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-225:ctx-a57ff438) Seq 2-856817668: Executing request
  18. 2015-04-17 13:01:29,369 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-225:ctx-a57ff438) Seq 2-856817668: Response Received:
  19. 2015-04-17 13:01:29,369 DEBUG [c.c.a.t.Request] (DirectAgent-225:ctx-a57ff438) Seq 2-856817668: Processing: { Ans: , MgmtId: 50788518005399, via: 2, Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}}] }
  20. 2015-04-17 13:01:29,529 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-136:ctx-584d97a0) Seq 4-819986436: Executing request
  21. 2015-04-17 13:01:29,649 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-136:ctx-584d97a0) Seq 4-819986436: Response Received:
  22. 2015-04-17 13:01:29,649 DEBUG [c.c.a.t.Request] (DirectAgent-136:ctx-584d97a0) Seq 4-819986436: Processing: { Ans: , MgmtId: 50788518005399, via: 4, Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}}] }
  23. 2015-04-17 13:01:30,893 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-89:ctx-0a022848) Seq 5-1311506436: Executing request
  24. 2015-04-17 13:01:31,015 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-89:ctx-0a022848) Seq 5-1311506436: Response Received:
  25. 2015-04-17 13:01:31,015 DEBUG [c.c.a.t.Request] (DirectAgent-89:ctx-0a022848) Seq 5-1311506436: Processing: { Ans: , MgmtId: 50788518005399, via: 5, Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}}] }
  26. 2015-04-17 13:01:33,193 DEBUG [c.c.a.t.Request] (AgentManager-Handler-4:null) Seq 4-327286883: Executing: { Cmd , MgmtId: 46618217624527, via: 4, Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/1/","origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.3.4.40/ibm/CloudSecondary","_role":"Image"}},"name":"routing-1","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"CloudStore-1","id":1,"poolType":"PreSetup","host":"localhost","path":"/CloudStore-1","port":0,"url":"PreSetup://localhost//CloudStore-1/?ROLE=Primary&STOREUUID=CloudStore-1"}},"name":"routing-1","hypervisorType":"XenServer"}},"executeInSequence":false,"options":{},"wait":10800}}] }
  27. 2015-04-17 13:01:33,193 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-242:ctx-1e3312ef) Seq 4-327286883: Executing request
  28. 2015-04-17 13:01:35,124 DEBUG [c.c.s.StatsCollector] (StatsCollector-2:ctx-f2022436) VmStatsCollector is running...
  29. 2015-04-17 13:01:35,350 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-242:ctx-1e3312ef) destoryVDIbyNameLabel failed due to there are 0 VDIs with name cloud-1f626126-eada-4464-9de8-0f16740e582a
  30. 2015-04-17 13:01:35,350 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-242:ctx-1e3312ef) can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  31. 2015-04-17 13:01:35,350 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-242:ctx-1e3312ef) Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  32. com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  33. at com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copy_vhd_from_secondarystorage(XenServerStorageProcessor.java:848)
  34. at com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copyTemplateToPrimaryStorage(XenServerStorageProcessor.java:918)
  35. at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:75)
  36. at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:50)
  37. at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:609)
  38. at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59)
  39. at com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:106)
  40. at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216)
  41. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  42. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  43. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  44. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  45. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  46. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  47. at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  48. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
  49. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
  50. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  51. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  52. at java.lang.Thread.run(Thread.java:744)
  53. 2015-04-17 13:01:35,351 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-242:ctx-1e3312ef) Seq 4-327286883: Response Received:
  54. 2015-04-17 13:01:35,352 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-242:ctx-1e3312ef) Seq 4-327286883: MgmtId 46618217624527: Resp: Routing to peer
  55. 2015-04-17 13:01:35,397 DEBUG [c.c.a.t.Request] (AgentManager-Handler-5:null) Seq 4-327286884: Executing: { Cmd , MgmtId: 46618217624527, via: 4, Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"v-1-VM","wait":0}}] }
  56. 2015-04-17 13:01:35,398 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-234:ctx-e994b27e) Seq 4-327286884: Executing request
  57. 2015-04-17 13:01:35,507 INFO [c.c.h.x.r.CitrixResourceBase] (DirectAgent-234:ctx-e994b27e) VM does not exist on XenServer1d86cc04-ef64-48d9-b00c-734c21144945
  58. 2015-04-17 13:01:35,508 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-234:ctx-e994b27e) Seq 4-327286884: Response Received:
  59. 2015-04-17 13:01:35,508 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-234:ctx-e994b27e) Seq 4-327286884: MgmtId 46618217624527: Resp: Routing to peer
  60. 2015-04-17 13:01:36,174 DEBUG [c.c.a.t.Request] (AgentManager-Handler-6:null) Seq 2-34930784: Executing: { Cmd , MgmtId: 46618217624527, via: 2, Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/1/","origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.3.4.40/ibm/CloudSecondary","_role":"Image"}},"name":"routing-1","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"CloudStore-1","id":1,"poolType":"PreSetup","host":"localhost","path":"/CloudStore-1","port":0,"url":"PreSetup://localhost//CloudStore-1/?ROLE=Primary&STOREUUID=CloudStore-1"}},"name":"routing-1","hypervisorType":"XenServer"}},"executeInSequence":false,"options":{},"wait":10800}}] }
  61. 2015-04-17 13:01:36,174 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-235:ctx-93356ef7) Seq 2-34930784: Executing request
  62. 2015-04-17 13:01:38,346 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-235:ctx-93356ef7) destoryVDIbyNameLabel failed due to there are 0 VDIs with name cloud-7b7a20ad-d85c-4c5a-acfc-63bf12db0303
  63. 2015-04-17 13:01:38,346 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-235:ctx-93356ef7) can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  64. 2015-04-17 13:01:38,346 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-235:ctx-93356ef7) Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  65. com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  66. at com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copy_vhd_from_secondarystorage(XenServerStorageProcessor.java:848)
  67. at com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copyTemplateToPrimaryStorage(XenServerStorageProcessor.java:918)
  68. at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:75)
  69. at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:50)
  70. at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:609)
  71. at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59)
  72. at com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:106)
  73. at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216)
  74. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  75. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  76. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  77. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  78. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  79. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  80. at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  81. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
  82. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
  83. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  84. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  85. at java.lang.Thread.run(Thread.java:744)
  86. 2015-04-17 13:01:38,347 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-235:ctx-93356ef7) Seq 2-34930784: Response Received:
  87. 2015-04-17 13:01:38,347 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-235:ctx-93356ef7) Seq 2-34930784: MgmtId 46618217624527: Resp: Routing to peer
  88. 2015-04-17 13:01:38,415 DEBUG [c.c.a.t.Request] (AgentManager-Handler-7:null) Seq 1-171769952: Executing: { Cmd , MgmtId: 46618217624527, via: 1, Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"v-1-VM","wait":0}}] }
  89. 2015-04-17 13:01:38,415 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-58:ctx-773ee86d) Seq 1-171769952: Executing request
  90. 2015-04-17 13:01:38,439 DEBUG [c.c.a.t.Request] (AgentManager-Handler-8:null) Seq 3-944373851: Executing: { Cmd , MgmtId: 46618217624527, via: 3, Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"s-44-VM","wait":0}}] }
  91. 2015-04-17 13:01:38,440 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-237:ctx-52c43c37) Seq 3-944373851: Executing request
  92. 2015-04-17 13:01:38,524 INFO [c.c.h.x.r.CitrixResourceBase] (DirectAgent-237:ctx-52c43c37) VM does not exist on XenServer23e67e4d-e952-40f3-a646-3a4e782d2db1
  93. 2015-04-17 13:01:38,525 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-237:ctx-52c43c37) Seq 3-944373851: Response Received:
  94. 2015-04-17 13:01:38,525 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-237:ctx-52c43c37) Seq 3-944373851: MgmtId 46618217624527: Resp: Routing to peer
  95. 2015-04-17 13:01:38,529 INFO [c.c.h.x.r.CitrixResourceBase] (DirectAgent-58:ctx-773ee86d) VM does not exist on XenServer0083e31e-13d1-4e07-96a4-3594d789e1d8
  96. 2015-04-17 13:01:38,529 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-58:ctx-773ee86d) Seq 1-171769952: Response Received:
  97. 2015-04-17 13:01:38,529 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-58:ctx-773ee86d) Seq 1-171769952: MgmtId 46618217624527: Resp: Routing to peer
  98. 2015-04-17 13:01:39,132 DEBUG [c.c.a.t.Request] (AgentManager-Handler-9:null) Seq 3-944373852: Executing: { Cmd , MgmtId: 46618217624527, via: 3, Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/1/","origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.3.4.40/ibm/CloudSecondary","_role":"Image"}},"name":"routing-1","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"CloudStore-1","id":1,"poolType":"PreSetup","host":"localhost","path":"/CloudStore-1","port":0,"url":"PreSetup://localhost//CloudStore-1/?ROLE=Primary&STOREUUID=CloudStore-1"}},"name":"routing-1","hypervisorType":"XenServer"}},"executeInSequence":false,"options":{},"wait":10800}}] }
  99. 2015-04-17 13:01:39,132 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-354:ctx-347895c1) Seq 3-944373852: Executing request
  100. 2015-04-17 13:01:40,062 DEBUG [c.c.s.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-e2a60958) Zone 1 is ready to launch secondary storage VM
  101. 2015-04-17 13:01:40,073 INFO [c.c.s.PremiumSecondaryStorageManagerImpl] (secstorage-1:ctx-e2a60958) No running secondary storage vms found in datacenter id=1, starting one
  102. 2015-04-17 13:01:40,097 INFO [c.c.s.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-e2a60958) Found a stopped secondary storage vm, bring it up to running pool. secStorageVm vm id : 44
  103. 2015-04-17 13:01:40,129 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
  104. 2015-04-17 13:01:40,129 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-e2a60958) Successfully transitioned to start state for VM[SecondaryStorageVm|s-44-VM] reservation id = 6d208657-bc2f-4158-81b8-77fa8c141b07
  105. 2015-04-17 13:01:40,137 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-e2a60958) Trying to deploy VM, vm has dcId: 1 and podId: 1
  106. 2015-04-17 13:01:40,137 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-e2a60958) Deploy avoids pods: null, clusters: null, hosts: null
  107. 2015-04-17 13:01:40,146 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-e2a60958) Deploy avoids pods: null, clusters: null, hosts: null
  108. 2015-04-17 13:01:40,148 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-e2a60958) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@5ba591e2
  109. 2015-04-17 13:01:40,148 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-e2a60958) Trying to allocate a host and storage pools from dc:1, pod:1,cluster:null, requested cpu: 500, requested ram: 536870912
  110. 2015-04-17 13:01:40,148 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-e2a60958) Is ROOT volume READY (pool already allocated)?: No
  111. 2015-04-17 13:01:40,148 DEBUG [c.c.d.FirstFitPlanner] (secstorage-1:ctx-e2a60958) Searching resources only under specified Pod: 1
  112. 2015-04-17 13:01:40,149 DEBUG [c.c.d.FirstFitPlanner] (secstorage-1:ctx-e2a60958) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Pod: 1
  113. 2015-04-17 13:01:40,165 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-e2a60958) Checking resources in Cluster: 1 under Pod: 1
  114. 2015-04-17 13:01:40,165 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) Looking for hosts in dc: 1 pod:1 cluster:1
  115. 2015-04-17 13:01:40,173 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) FirstFitAllocator has 5 hosts to check for allocation: [Host[-5-Routing], Host[-2-Routing], Host[-3-Routing], Host[-4-Routing], Host[-1-Routing]]
  116. 2015-04-17 13:01:40,187 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) Found 5 hosts for allocation after prioritization: [Host[-5-Routing], Host[-2-Routing], Host[-3-Routing], Host[-4-Routing], Host[-1-Routing]]
  117. 2015-04-17 13:01:40,187 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=512
  118. 2015-04-17 13:01:40,201 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) Host: 5 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  119. 2015-04-17 13:01:40,201 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) Checking if host: 5 has enough capacity for requested CPU: 500 and requested RAM: 536870912 , cpuOverprovisioningFactor: 1.0
  120. 2015-04-17 13:01:40,205 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  121. 2015-04-17 13:01:40,206 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  122. 2015-04-17 13:01:40,206 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) Free RAM: 130926600192 , Requested RAM: 536870912
  123. 2015-04-17 13:01:40,206 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) Host has enough CPU and RAM available
  124. 2015-04-17 13:01:40,206 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 5, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  125. 2015-04-17 13:01:40,206 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 5, used: 0, reserved: 0, total: 130926600192; requested mem: 536870912,alloc_from_last_host?:false ,considerReservedCapacity?: true
  126. 2015-04-17 13:01:40,206 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) Found a suitable host, adding to list: 5
  127. 2015-04-17 13:01:40,219 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) Host: 2 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  128. 2015-04-17 13:01:40,219 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) Checking if host: 2 has enough capacity for requested CPU: 500 and requested RAM: 536870912 , cpuOverprovisioningFactor: 1.0
  129. 2015-04-17 13:01:40,224 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  130. 2015-04-17 13:01:40,224 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) Free CPU: 87500 , Requested CPU: 500
  131. 2015-04-17 13:01:40,224 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) Free RAM: 129852858368 , Requested RAM: 536870912
  132. 2015-04-17 13:01:40,224 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) Host has enough CPU and RAM available
  133. 2015-04-17 13:01:40,224 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 2, used: 500, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  134. 2015-04-17 13:01:40,224 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 2, used: 1073741824, reserved: 0, total: 130926600192; requested mem: 536870912,alloc_from_last_host?:false ,considerReservedCapacity?: true
  135. 2015-04-17 13:01:40,224 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) Found a suitable host, adding to list: 2
  136. 2015-04-17 13:01:40,246 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) Host: 3 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  137. 2015-04-17 13:01:40,246 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) Checking if host: 3 has enough capacity for requested CPU: 500 and requested RAM: 536870912 , cpuOverprovisioningFactor: 1.0
  138. 2015-04-17 13:01:40,251 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  139. 2015-04-17 13:01:40,251 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  140. 2015-04-17 13:01:40,251 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) Free RAM: 130926600192 , Requested RAM: 536870912
  141. 2015-04-17 13:01:40,251 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) Host has enough CPU and RAM available
  142. 2015-04-17 13:01:40,251 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 3, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  143. 2015-04-17 13:01:40,251 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 3, used: 0, reserved: 0, total: 130926600192; requested mem: 536870912,alloc_from_last_host?:false ,considerReservedCapacity?: true
  144. 2015-04-17 13:01:40,251 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) Found a suitable host, adding to list: 3
  145. 2015-04-17 13:01:40,265 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) Host: 4 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  146. 2015-04-17 13:01:40,265 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) Checking if host: 4 has enough capacity for requested CPU: 500 and requested RAM: 536870912 , cpuOverprovisioningFactor: 1.0
  147. 2015-04-17 13:01:40,271 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  148. 2015-04-17 13:01:40,271 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  149. 2015-04-17 13:01:40,271 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) Free RAM: 130926600192 , Requested RAM: 536870912
  150. 2015-04-17 13:01:40,271 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) Host has enough CPU and RAM available
  151. 2015-04-17 13:01:40,271 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 4, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  152. 2015-04-17 13:01:40,271 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 4, used: 0, reserved: 0, total: 130926600192; requested mem: 536870912,alloc_from_last_host?:false ,considerReservedCapacity?: true
  153. 2015-04-17 13:01:40,271 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) Found a suitable host, adding to list: 4
  154. 2015-04-17 13:01:40,286 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) Host: 1 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  155. 2015-04-17 13:01:40,286 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 536870912 , cpuOverprovisioningFactor: 1.0
  156. 2015-04-17 13:01:40,291 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  157. 2015-04-17 13:01:40,291 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  158. 2015-04-17 13:01:40,291 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) Free RAM: 130926600192 , Requested RAM: 536870912
  159. 2015-04-17 13:01:40,291 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) Host has enough CPU and RAM available
  160. 2015-04-17 13:01:40,291 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 1, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  161. 2015-04-17 13:01:40,291 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 1, used: 0, reserved: 0, total: 130926600192; requested mem: 536870912,alloc_from_last_host?:false ,considerReservedCapacity?: true
  162. 2015-04-17 13:01:40,291 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) Found a suitable host, adding to list: 1
  163. 2015-04-17 13:01:40,291 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-e2a60958 FirstFitRoutingAllocator) Host Allocator returning 5 suitable hosts
  164. 2015-04-17 13:01:40,294 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-e2a60958) Checking suitable pools for volume (Id, Type): (44,ROOT)
  165. 2015-04-17 13:01:40,294 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-e2a60958) We need to allocate new storagepool for this volume
  166. 2015-04-17 13:01:40,294 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-e2a60958) Calling StoragePoolAllocators to find suitable pools
  167. 2015-04-17 13:01:40,296 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (secstorage-1:ctx-e2a60958) LocalStoragePoolAllocator trying to find storage pool to fit the vm
  168. 2015-04-17 13:01:40,297 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (secstorage-1:ctx-e2a60958) ClusterScopeStoragePoolAllocator looking for storage pool
  169. 2015-04-17 13:01:40,297 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (secstorage-1:ctx-e2a60958) Looking for pools in dc: 1 pod:1 cluster:1
  170. 2015-04-17 13:01:40,299 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (secstorage-1:ctx-e2a60958) Found pools matching tags: [Pool[1|PreSetup]]
  171. 2015-04-17 13:01:40,302 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (secstorage-1:ctx-e2a60958) Removing pool Pool[1|PreSetup] from avoid set, must have been inserted when searching for another disk's tag
  172. 2015-04-17 13:01:40,304 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] (secstorage-1:ctx-e2a60958) Checking if storage pool is suitable, name: null ,poolId: 1
  173. 2015-04-17 13:01:40,312 DEBUG [c.c.s.StorageManagerImpl] (secstorage-1:ctx-e2a60958) Checking pool 1 for storage, totalSize: 1649254858752, usedBytes: 25165824, usedPct: 1.5258905478710012E-5, disable threshold: 0.85
  174. 2015-04-17 13:01:40,320 DEBUG [c.c.s.StorageManagerImpl] (secstorage-1:ctx-e2a60958) Checking pool: 1 for volume allocation [Vol[44|vm=44|ROOT]], maxSize : 1649254858752, totalAllocatedSize : 0, askingSize : 0, allocated disable threshold: 0.85
  175. 2015-04-17 13:01:40,321 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (secstorage-1:ctx-e2a60958) ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
  176. 2015-04-17 13:01:40,321 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-e2a60958) Trying to find a potenial host and associated storage pools from the suitable host/pool lists for this VM
  177. 2015-04-17 13:01:40,321 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-e2a60958) Checking if host: 5 can access any suitable storage pool for volume: ROOT
  178. 2015-04-17 13:01:40,322 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-e2a60958) Host: 5 can access pool: 1
  179. 2015-04-17 13:01:40,323 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-e2a60958) Found a potential host id: 5 name: cloud-host2.cgg.gov.in and associated storage pools for this VM
  180. 2015-04-17 13:01:40,324 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-e2a60958) Returning Deployment Destination: Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(5)-Storage(Volume(44|ROOT-->Pool(1))]
  181. 2015-04-17 13:01:40,324 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-e2a60958) Deployment found - P0=VM[SecondaryStorageVm|s-44-VM], P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(5)-Storage(Volume(44|ROOT-->Pool(1))]
  182. 2015-04-17 13:01:40,343 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958) VM state transitted from :Starting to Starting with event: OperationRetryvm's original host id: null new host id: 5 host id before state transition: null
  183. 2015-04-17 13:01:40,358 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  184. 2015-04-17 13:01:40,358 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958) We are allocating VM, increasing the used capacity of this host:5
  185. 2015-04-17 13:01:40,358 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958) Current Used CPU: 0 , Free CPU:88000 ,Requested CPU: 500
  186. 2015-04-17 13:01:40,358 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958) Current Used RAM: 0 , Free RAM:130926600192 ,Requested RAM: 536870912
  187. 2015-04-17 13:01:40,358 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958) CPU STATS after allocation: for host: 5, old used: 0, old reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used:500, reserved:0; requested cpu:500,alloc_from_last:false
  188. 2015-04-17 13:01:40,358 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958) RAM STATS after allocation: for host: 5, old used: 0, old reserved: 0, total: 130926600192; new used: 536870912, reserved: 0; requested mem: 536870912,alloc_from_last:false
  189. 2015-04-17 13:01:40,365 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-e2a60958) VM is being created in podId: 1
  190. 2015-04-17 13:01:40,374 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-e2a60958) Network id=200 is already implemented
  191. 2015-04-17 13:01:40,418 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-e2a60958) Network id=202 is already implemented
  192. 2015-04-17 13:01:40,474 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-e2a60958) Network id=201 is already implemented
  193. 2015-04-17 13:01:40,518 DEBUG [c.c.n.g.PodBasedNetworkGuru] (secstorage-1:ctx-e2a60958) Allocated a nic NicProfile[174-44-6d208657-bc2f-4158-81b8-77fa8c141b07-10.3.4.174-null for VM[SecondaryStorageVm|s-44-VM]
  194. 2015-04-17 13:01:40,533 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-e2a60958) Network id=203 is already implemented
  195. 2015-04-17 13:01:40,581 DEBUG [c.c.n.g.PodBasedNetworkGuru] (secstorage-1:ctx-e2a60958) Allocated a nic NicProfile[175-44-6d208657-bc2f-4158-81b8-77fa8c141b07-10.3.4.169-null for VM[SecondaryStorageVm|s-44-VM]
  196. 2015-04-17 13:01:40,593 DEBUG [o.a.c.e.o.VolumeOrchestrator] (secstorage-1:ctx-e2a60958) Checking if we need to prepare 1 volumes for VM[SecondaryStorageVm|s-44-VM]
  197. 2015-04-17 13:01:40,618 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (secstorage-1:ctx-e2a60958) template 1 is already in store:1, type:Image
  198. 2015-04-17 13:01:40,631 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (secstorage-1:ctx-e2a60958) template 1 is already in store:1, type:Primary
  199. 2015-04-17 13:01:40,634 DEBUG [o.a.c.s.v.VolumeServiceImpl] (secstorage-1:ctx-e2a60958) Found template routing-1 in storage pool 1 with VMTemplateStoragePool id: 258
  200. 2015-04-17 13:01:40,645 DEBUG [o.a.c.s.v.VolumeServiceImpl] (secstorage-1:ctx-e2a60958) Acquire lock on VMTemplateStoragePool 258 with timeout 3600 seconds
  201. 2015-04-17 13:01:41,331 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-354:ctx-347895c1) destoryVDIbyNameLabel failed due to there are 0 VDIs with name cloud-0170372b-9f29-43e1-892c-3ad40efc1073
  202. 2015-04-17 13:01:41,332 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-354:ctx-347895c1) can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  203. 2015-04-17 13:01:41,332 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-354:ctx-347895c1) Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  204. com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  205. at com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copy_vhd_from_secondarystorage(XenServerStorageProcessor.java:848)
  206. at com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copyTemplateToPrimaryStorage(XenServerStorageProcessor.java:918)
  207. at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:75)
  208. at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:50)
  209. at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:609)
  210. at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59)
  211. at com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:106)
  212. at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216)
  213. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  214. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  215. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  216. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  217. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  218. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  219. at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  220. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
  221. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
  222. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  223. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  224. at java.lang.Thread.run(Thread.java:744)
  225. 2015-04-17 13:01:41,333 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-354:ctx-347895c1) Seq 3-944373852: Response Received:
  226. 2015-04-17 13:01:41,333 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-354:ctx-347895c1) Seq 3-944373852: MgmtId 46618217624527: Resp: Routing to peer
  227. 2015-04-17 13:01:41,379 DEBUG [c.c.a.t.Request] (AgentManager-Handler-10:null) Seq 2-34930785: Executing: { Cmd , MgmtId: 46618217624527, via: 2, Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"v-1-VM","wait":0}}] }
  228. 2015-04-17 13:01:41,380 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-97:ctx-2992215f) Seq 2-34930785: Executing request
  229. 2015-04-17 13:01:41,492 INFO [c.c.h.x.r.CitrixResourceBase] (DirectAgent-97:ctx-2992215f) VM does not exist on XenServer34da61e1-04e7-40e2-b8f4-40c0157dca28
  230. 2015-04-17 13:01:41,492 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-97:ctx-2992215f) Seq 2-34930785: Response Received:
  231. 2015-04-17 13:01:41,492 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-97:ctx-2992215f) Seq 2-34930785: MgmtId 46618217624527: Resp: Routing to peer
  232. 2015-04-17 13:01:42,098 DEBUG [c.c.a.t.Request] (AgentManager-Handler-11:null) Seq 2-34930786: Executing: { Cmd , MgmtId: 46618217624527, via: 2, Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/1/","origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.3.4.40/ibm/CloudSecondary","_role":"Image"}},"name":"routing-1","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"CloudStore-1","id":1,"poolType":"PreSetup","host":"localhost","path":"/CloudStore-1","port":0,"url":"PreSetup://localhost//CloudStore-1/?ROLE=Primary&STOREUUID=CloudStore-1"}},"name":"routing-1","hypervisorType":"XenServer"}},"executeInSequence":false,"options":{},"wait":10800}}] }
  233. 2015-04-17 13:01:42,098 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-226:ctx-62a7e2d0) Seq 2-34930786: Executing request
  234. 2015-04-17 13:01:42,565 DEBUG [c.c.u.d.DbUtil] (consoleproxy-1:ctx-562b675f) GET_LOCK() timed out on lock : consoleproxy.scan.lock
  235. 2015-04-17 13:01:44,262 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-226:ctx-62a7e2d0) destoryVDIbyNameLabel failed due to there are 0 VDIs with name cloud-c4eaee97-f2cb-4a42-bb50-f6f76d10b419
  236. 2015-04-17 13:01:44,262 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-226:ctx-62a7e2d0) can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  237. 2015-04-17 13:01:44,262 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-226:ctx-62a7e2d0) Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  238. com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  239. at com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copy_vhd_from_secondarystorage(XenServerStorageProcessor.java:848)
  240. at com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copyTemplateToPrimaryStorage(XenServerStorageProcessor.java:918)
  241. at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:75)
  242. at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:50)
  243. at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:609)
  244. at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59)
  245. at com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:106)
  246. at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216)
  247. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  248. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  249. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  250. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  251. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  252. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  253. at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  254. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
  255. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
  256. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  257. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  258. at java.lang.Thread.run(Thread.java:744)
  259. 2015-04-17 13:01:44,263 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-226:ctx-62a7e2d0) Seq 2-34930786: Response Received:
  260. 2015-04-17 13:01:44,264 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-226:ctx-62a7e2d0) Seq 2-34930786: MgmtId 46618217624527: Resp: Routing to peer
  261. 2015-04-17 13:01:44,313 DEBUG [c.c.a.t.Request] (AgentManager-Handler-12:null) Seq 5-634060905: Executing: { Cmd , MgmtId: 46618217624527, via: 5, Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"v-1-VM","wait":0}}] }
  262. 2015-04-17 13:01:44,313 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-218:ctx-3ab547b9) Seq 5-634060905: Executing request
  263. 2015-04-17 13:01:44,431 INFO [c.c.h.x.r.CitrixResourceBase] (DirectAgent-218:ctx-3ab547b9) VM does not exist on XenServer6b4ea60d-1501-446c-9507-86b9bd3dc8d6
  264. 2015-04-17 13:01:44,431 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-218:ctx-3ab547b9) Seq 5-634060905: Response Received:
  265. 2015-04-17 13:01:44,431 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-218:ctx-3ab547b9) Seq 5-634060905: MgmtId 46618217624527: Resp: Routing to peer
  266. 2015-04-17 13:01:45,011 DEBUG [c.c.a.t.Request] (AgentManager-Handler-13:null) Seq 3-944373853: Executing: { Cmd , MgmtId: 46618217624527, via: 3, Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/1/","origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.3.4.40/ibm/CloudSecondary","_role":"Image"}},"name":"routing-1","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"CloudStore-1","id":1,"poolType":"PreSetup","host":"localhost","path":"/CloudStore-1","port":0,"url":"PreSetup://localhost//CloudStore-1/?ROLE=Primary&STOREUUID=CloudStore-1"}},"name":"routing-1","hypervisorType":"XenServer"}},"executeInSequence":false,"options":{},"wait":10800}}] }
  267. 2015-04-17 13:01:45,012 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-245:ctx-9079bf19) Seq 3-944373853: Executing request
  268. 2015-04-17 13:01:45,652 INFO [o.a.c.s.v.VolumeServiceImpl] (secstorage-1:ctx-e2a60958) Unable to acquire lock on VMTemplateStoragePool 258
  269. 2015-04-17 13:01:45,655 ERROR [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-e2a60958) Failed to start instance VM[SecondaryStorageVm|s-44-VM]
  270. com.cloud.utils.exception.CloudRuntimeException: Unable to acquire lock on VMTemplateStoragePool: 258
  271. at org.apache.cloudstack.storage.volume.VolumeServiceImpl.createBaseImageAsync(VolumeServiceImpl.java:460)
  272. at org.apache.cloudstack.storage.volume.VolumeServiceImpl.createVolumeFromTemplateAsync(VolumeServiceImpl.java:604)
  273. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.recreateVolume(VolumeOrchestrator.java:1192)
  274. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.prepare(VolumeOrchestrator.java:1256)
  275. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:963)
  276. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761)
  277. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:745)
  278. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.startSecStorageVm(SecondaryStorageManagerImpl.java:261)
  279. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.allocCapacity(SecondaryStorageManagerImpl.java:694)
  280. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.expandPool(SecondaryStorageManagerImpl.java:1278)
  281. at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:123)
  282. at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:50)
  283. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:111)
  284. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:35)
  285. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:88)
  286. at com.cloud.vm.SystemVmLoadScanner$1.runInContext(SystemVmLoadScanner.java:79)
  287. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  288. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  289. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  290. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  291. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  292. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  293. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
  294. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
  295. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
  296. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  297. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  298. at java.lang.Thread.run(Thread.java:744)
  299. 2015-04-17 13:01:45,664 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-e2a60958) Cleaning up resources for the vm VM[SecondaryStorageVm|s-44-VM] in Starting state
  300. 2015-04-17 13:01:45,669 DEBUG [c.c.a.t.Request] (secstorage-1:ctx-e2a60958) Seq 5-1311506519: Sending { Cmd , MgmtId: 50788518005399, via: 5(cloud-host2.cgg.gov.in), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"s-44-VM","wait":0}}] }
  301. 2015-04-17 13:01:45,669 DEBUG [c.c.a.t.Request] (secstorage-1:ctx-e2a60958) Seq 5-1311506519: Executing: { Cmd , MgmtId: 50788518005399, via: 5(cloud-host2.cgg.gov.in), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"s-44-VM","wait":0}}] }
  302. 2015-04-17 13:01:45,669 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-246:ctx-7aeda456) Seq 5-1311506519: Executing request
  303. 2015-04-17 13:01:45,775 INFO [c.c.h.x.r.CitrixResourceBase] (DirectAgent-246:ctx-7aeda456) VM does not exist on XenServer6b4ea60d-1501-446c-9507-86b9bd3dc8d6
  304. 2015-04-17 13:01:45,775 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-246:ctx-7aeda456) Seq 5-1311506519: Response Received:
  305. 2015-04-17 13:01:45,775 DEBUG [c.c.a.t.Request] (DirectAgent-246:ctx-7aeda456) Seq 5-1311506519: Processing: { Ans: , MgmtId: 50788518005399, via: 5, Ver: v1, Flags: 10, [{"com.cloud.agent.api.StopAnswer":{"result":true,"details":"VM does not exist","wait":0}}] }
  306. 2015-04-17 13:01:45,775 DEBUG [c.c.a.t.Request] (secstorage-1:ctx-e2a60958) Seq 5-1311506519: Received: { Ans: , MgmtId: 50788518005399, via: 5, Ver: v1, Flags: 10, { StopAnswer } }
  307. 2015-04-17 13:01:45,797 DEBUG [c.c.n.g.ControlNetworkGuru] (secstorage-1:ctx-e2a60958) Released nic: NicProfile[173-44-null-null-null
  308. 2015-04-17 13:01:45,817 DEBUG [c.c.d.d.DataCenterIpAddressDaoImpl] (secstorage-1:ctx-e2a60958) Releasing ip address for reservationId=6d208657-bc2f-4158-81b8-77fa8c141b07, instance=174
  309. 2015-04-17 13:01:45,818 DEBUG [c.c.n.g.PodBasedNetworkGuru] (secstorage-1:ctx-e2a60958) Released nic: NicProfile[174-44-null-null-null
  310. 2015-04-17 13:01:45,839 DEBUG [c.c.d.d.DataCenterIpAddressDaoImpl] (secstorage-1:ctx-e2a60958) Releasing ip address for reservationId=6d208657-bc2f-4158-81b8-77fa8c141b07, instance=175
  311. 2015-04-17 13:01:45,840 DEBUG [c.c.n.g.PodBasedNetworkGuru] (secstorage-1:ctx-e2a60958) Released nic: NicProfile[175-44-null-null-null
  312. 2015-04-17 13:01:45,850 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-e2a60958) Successfully released network resources for the vm VM[SecondaryStorageVm|s-44-VM]
  313. 2015-04-17 13:01:45,850 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-e2a60958) Successfully cleanued up resources for the vm VM[SecondaryStorageVm|s-44-VM] in Starting state
  314. 2015-04-17 13:01:45,868 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: 5
  315. 2015-04-17 13:01:45,881 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  316. 2015-04-17 13:01:45,881 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958) Hosts's actual total RAM: 130926604032 and RAM after applying overprovisioning: 130926600192
  317. 2015-04-17 13:01:45,881 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958) release cpu from host: 5, old used: 500,reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  318. 2015-04-17 13:01:45,881 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958) release mem from host: 5, old used: 536870912,reserved: 0, total: 130926600192; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
  319. 2015-04-17 13:01:45,888 WARN [c.c.s.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-e2a60958) Exception while trying to start secondary storage vm
  320. com.cloud.exception.AgentUnavailableException: Resource [Host:5] is unreachable: Host 5: Unable to start instance due to Unable to acquire lock on VMTemplateStoragePool: 258
  321. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1073)
  322. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761)
  323. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:745)
  324. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.startSecStorageVm(SecondaryStorageManagerImpl.java:261)
  325. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.allocCapacity(SecondaryStorageManagerImpl.java:694)
  326. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.expandPool(SecondaryStorageManagerImpl.java:1278)
  327. at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:123)
  328. at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:50)
  329. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:111)
  330. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:35)
  331. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:88)
  332. at com.cloud.vm.SystemVmLoadScanner$1.runInContext(SystemVmLoadScanner.java:79)
  333. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  334. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  335. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  336. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  337. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  338. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  339. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
  340. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
  341. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
  342. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  343. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  344. at java.lang.Thread.run(Thread.java:744)
  345. Caused by: com.cloud.utils.exception.CloudRuntimeException: Unable to acquire lock on VMTemplateStoragePool: 258
  346. at org.apache.cloudstack.storage.volume.VolumeServiceImpl.createBaseImageAsync(VolumeServiceImpl.java:460)
  347. at org.apache.cloudstack.storage.volume.VolumeServiceImpl.createVolumeFromTemplateAsync(VolumeServiceImpl.java:604)
  348. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.recreateVolume(VolumeOrchestrator.java:1192)
  349. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.prepare(VolumeOrchestrator.java:1256)
  350. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:963)
  351. ... 23 more
  352. 2015-04-17 13:01:45,891 INFO [c.c.s.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-e2a60958) Unable to start secondary storage vm for standby capacity, secStorageVm vm Id : 44, will recycle it and start a new one
  353. 2015-04-17 13:01:45,918 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-e2a60958) VM is already stopped: VM[SecondaryStorageVm|s-44-VM]
  354. 2015-04-17 13:01:45,934 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-e2a60958) VM state transitted from :Stopped to Expunging with event: ExpungeOperationvm's original host id: null new host id: null host id before state transition: null
  355. 2015-04-17 13:01:45,935 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-e2a60958) Destroying vm VM[SecondaryStorageVm|s-44-VM]
  356. 2015-04-17 13:01:45,935 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-e2a60958) Cleaning up NICS
  357. 2015-04-17 13:01:45,935 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-e2a60958) Cleaning network for vm: 44
  358. 2015-04-17 13:01:45,958 DEBUG [c.c.n.g.PublicNetworkGuru] (secstorage-1:ctx-e2a60958) public network deallocate network: networkId: 200, ip: 10.3.1.6
  359. 2015-04-17 13:01:45,970 DEBUG [c.c.n.g.PublicNetworkGuru] (secstorage-1:ctx-e2a60958) Deallocated nic: NicProfile[172-44-null-null-null
  360. 2015-04-17 13:01:45,978 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-e2a60958) Removed nic id=172
  361. 2015-04-17 13:01:45,981 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-e2a60958) Revoving nic secondary ip entry ...
  362. 2015-04-17 13:01:45,997 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-e2a60958) Removed nic id=173
  363. 2015-04-17 13:01:46,000 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-e2a60958) Revoving nic secondary ip entry ...
  364. 2015-04-17 13:01:46,028 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-e2a60958) Removed nic id=174
  365. 2015-04-17 13:01:46,030 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-e2a60958) Revoving nic secondary ip entry ...
  366. 2015-04-17 13:01:46,095 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-e2a60958) Removed nic id=175
  367. 2015-04-17 13:01:46,097 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-e2a60958) Revoving nic secondary ip entry ...
  368. 2015-04-17 13:01:46,098 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-e2a60958) Cleaning up hypervisor data structures (ex. SRs in XenServer) for managed storage
  369. 2015-04-17 13:01:46,101 DEBUG [o.a.c.e.o.VolumeOrchestrator] (secstorage-1:ctx-e2a60958) Cleaning storage for vm: 44
  370. 2015-04-17 13:01:46,133 INFO [o.a.c.s.v.VolumeServiceImpl] (secstorage-1:ctx-e2a60958) Expunge volume with no data store specified
  371. 2015-04-17 13:01:46,138 INFO [o.a.c.s.v.VolumeServiceImpl] (secstorage-1:ctx-e2a60958) Volume 44 is not referred anywhere, remove it from volumes table
  372. 2015-04-17 13:01:46,164 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-e2a60958) Expunged VM[SecondaryStorageVm|s-44-VM]
  373. 2015-04-17 13:01:46,176 INFO [c.c.s.PremiumSecondaryStorageManagerImpl] (secstorage-1:ctx-e2a60958) Primary secondary storage is not even started, wait until next turn
  374. 2015-04-17 13:01:47,147 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-245:ctx-9079bf19) destoryVDIbyNameLabel failed due to there are 0 VDIs with name cloud-4b376c14-1866-43f3-9fa4-76ce5671695c
  375. 2015-04-17 13:01:47,148 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-245:ctx-9079bf19) can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  376. 2015-04-17 13:01:47,148 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-245:ctx-9079bf19) Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  377. com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  378. at com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copy_vhd_from_secondarystorage(XenServerStorageProcessor.java:848)
  379. at com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copyTemplateToPrimaryStorage(XenServerStorageProcessor.java:918)
  380. at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:75)
  381. at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:50)
  382. at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:609)
  383. at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59)
  384. at com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:106)
  385. at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216)
  386. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  387. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  388. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  389. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  390. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  391. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  392. at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  393. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
  394. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
  395. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  396. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  397. at java.lang.Thread.run(Thread.java:744)
  398. 2015-04-17 13:01:47,149 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-245:ctx-9079bf19) Seq 3-944373853: Response Received:
  399. 2015-04-17 13:01:47,149 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-245:ctx-9079bf19) Seq 3-944373853: MgmtId 46618217624527: Resp: Routing to peer
  400. 2015-04-17 13:01:47,201 DEBUG [c.c.a.t.Request] (AgentManager-Handler-14:null) Seq 3-944373854: Executing: { Cmd , MgmtId: 46618217624527, via: 3, Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"v-1-VM","wait":0}}] }
  401. 2015-04-17 13:01:47,202 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-150:ctx-09be65da) Seq 3-944373854: Executing request
  402. 2015-04-17 13:01:47,273 INFO [c.c.h.x.r.CitrixResourceBase] (DirectAgent-150:ctx-09be65da) VM does not exist on XenServer23e67e4d-e952-40f3-a646-3a4e782d2db1
  403. 2015-04-17 13:01:47,273 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-150:ctx-09be65da) Seq 3-944373854: Response Received:
  404. 2015-04-17 13:01:47,273 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-150:ctx-09be65da) Seq 3-944373854: MgmtId 46618217624527: Resp: Routing to peer
  405. 2015-04-17 13:01:49,533 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-4ed0b943) Found 0 routers to update status.
  406. 2015-04-17 13:01:49,536 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-4ed0b943) Found 0 networks to update RvR status.
  407. 2015-04-17 13:01:50,839 DEBUG [c.c.s.StatsCollector] (StatsCollector-3:ctx-64185389) StorageCollector is running...
  408. 2015-04-17 13:01:50,848 DEBUG [c.c.s.StatsCollector] (StatsCollector-3:ctx-64185389) There is no secondary storage VM for secondary storage host secStorage
  409. 2015-04-17 13:01:50,854 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-386:ctx-74bc4b7d) Seq 1-847970389: Executing request
  410. 2015-04-17 13:01:51,470 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-386:ctx-74bc4b7d) Seq 1-847970389: Response Received:
  411. 2015-04-17 13:01:51,470 DEBUG [c.c.a.t.Request] (StatsCollector-3:ctx-64185389) Seq 1-847970389: Received: { Ans: , MgmtId: 50788518005399, via: 1, Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
  412. 2015-04-17 13:02:03,150 DEBUG [c.c.a.t.Request] (AgentManager-Handler-15:null) Seq 2-34930787: Executing: { Cmd , MgmtId: 46618217624527, via: 2, Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/1/","origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.3.4.40/ibm/CloudSecondary","_role":"Image"}},"name":"routing-1","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"CloudStore-1","id":1,"poolType":"PreSetup","host":"localhost","path":"/CloudStore-1","port":0,"url":"PreSetup://localhost//CloudStore-1/?ROLE=Primary&STOREUUID=CloudStore-1"}},"name":"routing-1","hypervisorType":"XenServer"}},"executeInSequence":false,"options":{},"wait":10800}}] }
  413. 2015-04-17 13:02:03,151 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-92:ctx-5163c66a) Seq 2-34930787: Executing request
  414. 2015-04-17 13:02:05,326 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-92:ctx-5163c66a) destoryVDIbyNameLabel failed due to there are 0 VDIs with name cloud-dee945ab-784a-473e-a23d-344d0eff67db
  415. 2015-04-17 13:02:05,326 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-92:ctx-5163c66a) can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  416. 2015-04-17 13:02:05,326 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-92:ctx-5163c66a) Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  417. com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  418. at com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copy_vhd_from_secondarystorage(XenServerStorageProcessor.java:848)
  419. at com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copyTemplateToPrimaryStorage(XenServerStorageProcessor.java:918)
  420. at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:75)
  421. at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:50)
  422. at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:609)
  423. at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59)
  424. at com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:106)
  425. at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216)
  426. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  427. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  428. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  429. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  430. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  431. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  432. at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  433. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
  434. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
  435. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  436. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  437. at java.lang.Thread.run(Thread.java:744)
  438. 2015-04-17 13:02:05,327 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-92:ctx-5163c66a) Seq 2-34930787: Response Received:
  439. 2015-04-17 13:02:05,328 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-92:ctx-5163c66a) Seq 2-34930787: MgmtId 46618217624527: Resp: Routing to peer
  440. 2015-04-17 13:02:05,374 DEBUG [c.c.a.t.Request] (AgentManager-Handler-1:null) Seq 5-634060906: Executing: { Cmd , MgmtId: 46618217624527, via: 5, Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"v-1-VM","wait":0}}] }
  441. 2015-04-17 13:02:05,375 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-147:ctx-63ddacad) Seq 5-634060906: Executing request
  442. 2015-04-17 13:02:05,481 INFO [c.c.h.x.r.CitrixResourceBase] (DirectAgent-147:ctx-63ddacad) VM does not exist on XenServer6b4ea60d-1501-446c-9507-86b9bd3dc8d6
  443. 2015-04-17 13:02:05,481 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-147:ctx-63ddacad) Seq 5-634060906: Response Received:
  444. 2015-04-17 13:02:05,481 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-147:ctx-63ddacad) Seq 5-634060906: MgmtId 46618217624527: Resp: Routing to peer
  445. 2015-04-17 13:02:06,077 DEBUG [c.c.a.t.Request] (AgentManager-Handler-2:null) Seq 1-171769953: Executing: { Cmd , MgmtId: 46618217624527, via: 1, Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/1/","origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.3.4.40/ibm/CloudSecondary","_role":"Image"}},"name":"routing-1","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"CloudStore-1","id":1,"poolType":"PreSetup","host":"localhost","path":"/CloudStore-1","port":0,"url":"PreSetup://localhost//CloudStore-1/?ROLE=Primary&STOREUUID=CloudStore-1"}},"name":"routing-1","hypervisorType":"XenServer"}},"executeInSequence":false,"options":{},"wait":10800}}] }
  446. 2015-04-17 13:02:06,077 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-151:ctx-73a7a8b2) Seq 1-171769953: Executing request
  447. 2015-04-17 13:02:08,246 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-151:ctx-73a7a8b2) destoryVDIbyNameLabel failed due to there are 0 VDIs with name cloud-8ed9690b-4fc4-4ed0-bfad-2ce84aaf0113
  448. 2015-04-17 13:02:08,246 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-151:ctx-73a7a8b2) can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  449. 2015-04-17 13:02:08,246 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-151:ctx-73a7a8b2) Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  450. com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  451. at com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copy_vhd_from_secondarystorage(XenServerStorageProcessor.java:848)
  452. at com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copyTemplateToPrimaryStorage(XenServerStorageProcessor.java:918)
  453. at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:75)
  454. at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:50)
  455. at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:609)
  456. at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59)
  457. at com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:106)
  458. at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216)
  459. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  460. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  461. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  462. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  463. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  464. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  465. at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  466. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
  467. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
  468. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  469. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  470. at java.lang.Thread.run(Thread.java:744)
  471. 2015-04-17 13:02:08,247 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-151:ctx-73a7a8b2) Seq 1-171769953: Response Received:
  472. 2015-04-17 13:02:08,247 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-151:ctx-73a7a8b2) Seq 1-171769953: MgmtId 46618217624527: Resp: Routing to peer
  473. 2015-04-17 13:02:08,292 DEBUG [c.c.a.t.Request] (AgentManager-Handler-3:null) Seq 2-34930788: Executing: { Cmd , MgmtId: 46618217624527, via: 2, Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"v-1-VM","wait":0}}] }
  474. 2015-04-17 13:02:08,293 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-100:ctx-47a9ea5d) Seq 2-34930788: Executing request
  475. 2015-04-17 13:02:08,343 DEBUG [c.c.a.t.Request] (AgentManager-Handler-4:null) Seq 1-171769954: Executing: { Cmd , MgmtId: 46618217624527, via: 1, Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"s-45-VM","wait":0}}] }
  476. 2015-04-17 13:02:08,343 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-163:ctx-10241df7) Seq 1-171769954: Executing request
  477. 2015-04-17 13:02:08,404 INFO [c.c.h.x.r.CitrixResourceBase] (DirectAgent-100:ctx-47a9ea5d) VM does not exist on XenServer34da61e1-04e7-40e2-b8f4-40c0157dca28
  478. 2015-04-17 13:02:08,404 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-100:ctx-47a9ea5d) Seq 2-34930788: Response Received:
  479. 2015-04-17 13:02:08,405 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-100:ctx-47a9ea5d) Seq 2-34930788: MgmtId 46618217624527: Resp: Routing to peer
  480. 2015-04-17 13:02:08,473 INFO [c.c.h.x.r.CitrixResourceBase] (DirectAgent-163:ctx-10241df7) VM does not exist on XenServer0083e31e-13d1-4e07-96a4-3594d789e1d8
  481. 2015-04-17 13:02:08,473 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-163:ctx-10241df7) Seq 1-171769954: Response Received:
  482. 2015-04-17 13:02:08,473 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-163:ctx-10241df7) Seq 1-171769954: MgmtId 46618217624527: Resp: Routing to peer
  483. 2015-04-17 13:02:08,657 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-9:ctx-cf3b8bba) Seq 4-327286885: Executing request
  484. 2015-04-17 13:02:08,980 DEBUG [c.c.a.t.Request] (AgentManager-Handler-6:null) Seq 2-34930789: Executing: { Cmd , MgmtId: 46618217624527, via: 2, Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/1/","origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.3.4.40/ibm/CloudSecondary","_role":"Image"}},"name":"routing-1","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"CloudStore-1","id":1,"poolType":"PreSetup","host":"localhost","path":"/CloudStore-1","port":0,"url":"PreSetup://localhost//CloudStore-1/?ROLE=Primary&STOREUUID=CloudStore-1"}},"name":"routing-1","hypervisorType":"XenServer"}},"executeInSequence":false,"options":{},"wait":10800}}] }
  485. 2015-04-17 13:02:08,980 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-106:ctx-7ad7ae69) Seq 2-34930789: Executing request
  486. 2015-04-17 13:02:09,252 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-9:ctx-cf3b8bba) Seq 4-327286885: Response Received:
  487. 2015-04-17 13:02:09,252 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-9:ctx-cf3b8bba) Seq 4-327286885: MgmtId 46618217624527: Resp: Routing to peer
  488. 2015-04-17 13:02:09,464 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-385:ctx-395c9f12) Ping from 1(cloud-host3.cgg.gov.in)
  489. 2015-04-17 13:02:10,070 DEBUG [c.c.s.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-1b0c075f) Zone 1 is ready to launch secondary storage VM
  490. 2015-04-17 13:02:10,081 INFO [c.c.s.PremiumSecondaryStorageManagerImpl] (secstorage-1:ctx-1b0c075f) No running secondary storage vms found in datacenter id=1, starting one
  491. 2015-04-17 13:02:10,110 INFO [c.c.s.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-1b0c075f) Found a stopped secondary storage vm, bring it up to running pool. secStorageVm vm id : 45
  492. 2015-04-17 13:02:10,139 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
  493. 2015-04-17 13:02:10,139 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-1b0c075f) Successfully transitioned to start state for VM[SecondaryStorageVm|s-45-VM] reservation id = 7696e2db-252b-4226-bf70-d9dffd01f134
  494. 2015-04-17 13:02:10,146 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-1b0c075f) Trying to deploy VM, vm has dcId: 1 and podId: 1
  495. 2015-04-17 13:02:10,146 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-1b0c075f) Deploy avoids pods: null, clusters: null, hosts: null
  496. 2015-04-17 13:02:10,154 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-1b0c075f) Deploy avoids pods: null, clusters: null, hosts: null
  497. 2015-04-17 13:02:10,156 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-1b0c075f) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner@5ba591e2
  498. 2015-04-17 13:02:10,156 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-1b0c075f) Trying to allocate a host and storage pools from dc:1, pod:1,cluster:null, requested cpu: 500, requested ram: 536870912
  499. 2015-04-17 13:02:10,156 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-1b0c075f) Is ROOT volume READY (pool already allocated)?: No
  500. 2015-04-17 13:02:10,156 DEBUG [c.c.d.FirstFitPlanner] (secstorage-1:ctx-1b0c075f) Searching resources only under specified Pod: 1
  501. 2015-04-17 13:02:10,156 DEBUG [c.c.d.FirstFitPlanner] (secstorage-1:ctx-1b0c075f) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Pod: 1
  502. 2015-04-17 13:02:10,173 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-1b0c075f) Checking resources in Cluster: 1 under Pod: 1
  503. 2015-04-17 13:02:10,173 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) Looking for hosts in dc: 1 pod:1 cluster:1
  504. 2015-04-17 13:02:10,180 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) FirstFitAllocator has 5 hosts to check for allocation: [Host[-4-Routing], Host[-5-Routing], Host[-3-Routing], Host[-2-Routing], Host[-1-Routing]]
  505. 2015-04-17 13:02:10,195 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) Found 5 hosts for allocation after prioritization: [Host[-4-Routing], Host[-5-Routing], Host[-3-Routing], Host[-2-Routing], Host[-1-Routing]]
  506. 2015-04-17 13:02:10,195 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=512
  507. 2015-04-17 13:02:10,209 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) Host: 4 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  508. 2015-04-17 13:02:10,210 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) Checking if host: 4 has enough capacity for requested CPU: 500 and requested RAM: 536870912 , cpuOverprovisioningFactor: 1.0
  509. 2015-04-17 13:02:10,214 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  510. 2015-04-17 13:02:10,214 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  511. 2015-04-17 13:02:10,214 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) Free RAM: 130926600192 , Requested RAM: 536870912
  512. 2015-04-17 13:02:10,214 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) Host has enough CPU and RAM available
  513. 2015-04-17 13:02:10,215 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 4, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  514. 2015-04-17 13:02:10,215 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 4, used: 0, reserved: 0, total: 130926600192; requested mem: 536870912,alloc_from_last_host?:false ,considerReservedCapacity?: true
  515. 2015-04-17 13:02:10,215 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) Found a suitable host, adding to list: 4
  516. 2015-04-17 13:02:10,228 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) Host: 5 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  517. 2015-04-17 13:02:10,228 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) Checking if host: 5 has enough capacity for requested CPU: 500 and requested RAM: 536870912 , cpuOverprovisioningFactor: 1.0
  518. 2015-04-17 13:02:10,233 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  519. 2015-04-17 13:02:10,233 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  520. 2015-04-17 13:02:10,233 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) Free RAM: 130926600192 , Requested RAM: 536870912
  521. 2015-04-17 13:02:10,233 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) Host has enough CPU and RAM available
  522. 2015-04-17 13:02:10,233 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 5, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  523. 2015-04-17 13:02:10,233 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 5, used: 0, reserved: 0, total: 130926600192; requested mem: 536870912,alloc_from_last_host?:false ,considerReservedCapacity?: true
  524. 2015-04-17 13:02:10,233 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) Found a suitable host, adding to list: 5
  525. 2015-04-17 13:02:10,247 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) Host: 3 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  526. 2015-04-17 13:02:10,247 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) Checking if host: 3 has enough capacity for requested CPU: 500 and requested RAM: 536870912 , cpuOverprovisioningFactor: 1.0
  527. 2015-04-17 13:02:10,252 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  528. 2015-04-17 13:02:10,252 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  529. 2015-04-17 13:02:10,252 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) Free RAM: 130926600192 , Requested RAM: 536870912
  530. 2015-04-17 13:02:10,252 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) Host has enough CPU and RAM available
  531. 2015-04-17 13:02:10,252 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 3, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  532. 2015-04-17 13:02:10,252 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 3, used: 0, reserved: 0, total: 130926600192; requested mem: 536870912,alloc_from_last_host?:false ,considerReservedCapacity?: true
  533. 2015-04-17 13:02:10,252 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) Found a suitable host, adding to list: 3
  534. 2015-04-17 13:02:10,267 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) Host: 2 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  535. 2015-04-17 13:02:10,267 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) Checking if host: 2 has enough capacity for requested CPU: 500 and requested RAM: 536870912 , cpuOverprovisioningFactor: 1.0
  536. 2015-04-17 13:02:10,272 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  537. 2015-04-17 13:02:10,272 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) Free CPU: 88000 , Requested CPU: 500
  538. 2015-04-17 13:02:10,272 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) Free RAM: 130926600192 , Requested RAM: 536870912
  539. 2015-04-17 13:02:10,272 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) Host has enough CPU and RAM available
  540. 2015-04-17 13:02:10,272 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 2, used: 0, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  541. 2015-04-17 13:02:10,272 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 2, used: 0, reserved: 0, total: 130926600192; requested mem: 536870912,alloc_from_last_host?:false ,considerReservedCapacity?: true
  542. 2015-04-17 13:02:10,272 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) Found a suitable host, adding to list: 2
  543. 2015-04-17 13:02:10,288 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) Host: 1 has cpu capability (cpu:40, speed:2200) to support requested CPU: 1 and requested speed: 500
  544. 2015-04-17 13:02:10,288 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) Checking if host: 1 has enough capacity for requested CPU: 500 and requested RAM: 536870912 , cpuOverprovisioningFactor: 1.0
  545. 2015-04-17 13:02:10,293 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  546. 2015-04-17 13:02:10,293 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) Free CPU: 87500 , Requested CPU: 500
  547. 2015-04-17 13:02:10,293 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) Free RAM: 129852858368 , Requested RAM: 536870912
  548. 2015-04-17 13:02:10,293 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) Host has enough CPU and RAM available
  549. 2015-04-17 13:02:10,293 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 1, used: 500, reserved: 0, actual total: 88000, total with overprovisioning: 88000; requested cpu:500,alloc_from_last_host?:false ,considerReservedCapacity?: true
  550. 2015-04-17 13:02:10,293 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 1, used: 1073741824, reserved: 0, total: 130926600192; requested mem: 536870912,alloc_from_last_host?:false ,considerReservedCapacity?: true
  551. 2015-04-17 13:02:10,293 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) Found a suitable host, adding to list: 1
  552. 2015-04-17 13:02:10,293 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (secstorage-1:ctx-1b0c075f FirstFitRoutingAllocator) Host Allocator returning 5 suitable hosts
  553. 2015-04-17 13:02:10,296 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-1b0c075f) Checking suitable pools for volume (Id, Type): (45,ROOT)
  554. 2015-04-17 13:02:10,296 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-1b0c075f) We need to allocate new storagepool for this volume
  555. 2015-04-17 13:02:10,296 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-1b0c075f) Calling StoragePoolAllocators to find suitable pools
  556. 2015-04-17 13:02:10,298 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (secstorage-1:ctx-1b0c075f) LocalStoragePoolAllocator trying to find storage pool to fit the vm
  557. 2015-04-17 13:02:10,298 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (secstorage-1:ctx-1b0c075f) ClusterScopeStoragePoolAllocator looking for storage pool
  558. 2015-04-17 13:02:10,298 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (secstorage-1:ctx-1b0c075f) Looking for pools in dc: 1 pod:1 cluster:1
  559. 2015-04-17 13:02:10,301 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (secstorage-1:ctx-1b0c075f) Found pools matching tags: [Pool[1|PreSetup]]
  560. 2015-04-17 13:02:10,303 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (secstorage-1:ctx-1b0c075f) Removing pool Pool[1|PreSetup] from avoid set, must have been inserted when searching for another disk's tag
  561. 2015-04-17 13:02:10,306 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator] (secstorage-1:ctx-1b0c075f) Checking if storage pool is suitable, name: null ,poolId: 1
  562. 2015-04-17 13:02:10,314 DEBUG [c.c.s.StorageManagerImpl] (secstorage-1:ctx-1b0c075f) Checking pool 1 for storage, totalSize: 1649254858752, usedBytes: 25165824, usedPct: 1.5258905478710012E-5, disable threshold: 0.85
  563. 2015-04-17 13:02:10,322 DEBUG [c.c.s.StorageManagerImpl] (secstorage-1:ctx-1b0c075f) Checking pool: 1 for volume allocation [Vol[45|vm=45|ROOT]], maxSize : 1649254858752, totalAllocatedSize : 0, askingSize : 0, allocated disable threshold: 0.85
  564. 2015-04-17 13:02:10,322 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (secstorage-1:ctx-1b0c075f) ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
  565. 2015-04-17 13:02:10,322 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-1b0c075f) Trying to find a potenial host and associated storage pools from the suitable host/pool lists for this VM
  566. 2015-04-17 13:02:10,322 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-1b0c075f) Checking if host: 4 can access any suitable storage pool for volume: ROOT
  567. 2015-04-17 13:02:10,323 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-1b0c075f) Host: 4 can access pool: 1
  568. 2015-04-17 13:02:10,324 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-1b0c075f) Found a potential host id: 4 name: cloud-host9.cgg.gov.in and associated storage pools for this VM
  569. 2015-04-17 13:02:10,326 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (secstorage-1:ctx-1b0c075f) Returning Deployment Destination: Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(4)-Storage(Volume(45|ROOT-->Pool(1))]
  570. 2015-04-17 13:02:10,327 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-1b0c075f) Deployment found - P0=VM[SecondaryStorageVm|s-45-VM], P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(4)-Storage(Volume(45|ROOT-->Pool(1))]
  571. 2015-04-17 13:02:10,345 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f) VM state transitted from :Starting to Starting with event: OperationRetryvm's original host id: null new host id: 4 host id before state transition: null
  572. 2015-04-17 13:02:10,360 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  573. 2015-04-17 13:02:10,360 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f) We are allocating VM, increasing the used capacity of this host:4
  574. 2015-04-17 13:02:10,360 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f) Current Used CPU: 0 , Free CPU:88000 ,Requested CPU: 500
  575. 2015-04-17 13:02:10,360 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f) Current Used RAM: 0 , Free RAM:130926600192 ,Requested RAM: 536870912
  576. 2015-04-17 13:02:10,361 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f) CPU STATS after allocation: for host: 4, old used: 0, old reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used:500, reserved:0; requested cpu:500,alloc_from_last:false
  577. 2015-04-17 13:02:10,361 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f) RAM STATS after allocation: for host: 4, old used: 0, old reserved: 0, total: 130926600192; new used: 536870912, reserved: 0; requested mem: 536870912,alloc_from_last:false
  578. 2015-04-17 13:02:10,367 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-1b0c075f) VM is being created in podId: 1
  579. 2015-04-17 13:02:10,376 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1b0c075f) Network id=200 is already implemented
  580. 2015-04-17 13:02:10,420 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1b0c075f) Network id=202 is already implemented
  581. 2015-04-17 13:02:10,475 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1b0c075f) Network id=201 is already implemented
  582. 2015-04-17 13:02:10,494 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-166:ctx-cff20bfa) Seq 1-847970307: Executing request
  583. 2015-04-17 13:02:10,526 DEBUG [c.c.n.g.PodBasedNetworkGuru] (secstorage-1:ctx-1b0c075f) Allocated a nic NicProfile[178-45-7696e2db-252b-4226-bf70-d9dffd01f134-10.3.4.191-null for VM[SecondaryStorageVm|s-45-VM]
  584. 2015-04-17 13:02:10,541 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1b0c075f) Network id=203 is already implemented
  585. 2015-04-17 13:02:10,588 DEBUG [c.c.n.g.PodBasedNetworkGuru] (secstorage-1:ctx-1b0c075f) Allocated a nic NicProfile[179-45-7696e2db-252b-4226-bf70-d9dffd01f134-10.3.4.164-null for VM[SecondaryStorageVm|s-45-VM]
  586. 2015-04-17 13:02:10,603 DEBUG [o.a.c.e.o.VolumeOrchestrator] (secstorage-1:ctx-1b0c075f) Checking if we need to prepare 1 volumes for VM[SecondaryStorageVm|s-45-VM]
  587. 2015-04-17 13:02:10,608 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-166:ctx-cff20bfa) Seq 1-847970307: Response Received:
  588. 2015-04-17 13:02:10,609 DEBUG [c.c.a.t.Request] (DirectAgent-166:ctx-cff20bfa) Seq 1-847970307: Processing: { Ans: , MgmtId: 50788518005399, via: 1, Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}}] }
  589. 2015-04-17 13:02:10,631 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (secstorage-1:ctx-1b0c075f) template 1 is already in store:1, type:Image
  590. 2015-04-17 13:02:10,643 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (secstorage-1:ctx-1b0c075f) template 1 is already in store:1, type:Primary
  591. 2015-04-17 13:02:10,645 DEBUG [o.a.c.s.v.VolumeServiceImpl] (secstorage-1:ctx-1b0c075f) Found template routing-1 in storage pool 1 with VMTemplateStoragePool id: 263
  592. 2015-04-17 13:02:10,656 DEBUG [o.a.c.s.v.VolumeServiceImpl] (secstorage-1:ctx-1b0c075f) Acquire lock on VMTemplateStoragePool 263 with timeout 3600 seconds
  593. 2015-04-17 13:02:11,140 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-106:ctx-7ad7ae69) destoryVDIbyNameLabel failed due to there are 0 VDIs with name cloud-29526b68-e6c2-482a-8142-f1f3937d3a6a
  594. 2015-04-17 13:02:11,140 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-106:ctx-7ad7ae69) can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  595. 2015-04-17 13:02:11,140 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-106:ctx-7ad7ae69) Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  596. com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  597. at com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copy_vhd_from_secondarystorage(XenServerStorageProcessor.java:848)
  598. at com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copyTemplateToPrimaryStorage(XenServerStorageProcessor.java:918)
  599. at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:75)
  600. at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:50)
  601. at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:609)
  602. at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59)
  603. at com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:106)
  604. at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216)
  605. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  606. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  607. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  608. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  609. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  610. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  611. at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  612. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
  613. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
  614. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  615. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  616. at java.lang.Thread.run(Thread.java:744)
  617. 2015-04-17 13:02:11,141 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-106:ctx-7ad7ae69) Seq 2-34930789: Response Received:
  618. 2015-04-17 13:02:11,141 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-106:ctx-7ad7ae69) Seq 2-34930789: MgmtId 46618217624527: Resp: Routing to peer
  619. 2015-04-17 13:02:11,198 DEBUG [c.c.a.t.Request] (AgentManager-Handler-7:null) Seq 1-171769955: Executing: { Cmd , MgmtId: 46618217624527, via: 1, Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"v-1-VM","wait":0}}] }
  620. 2015-04-17 13:02:11,198 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-103:ctx-2a98fc62) Seq 1-171769955: Executing request
  621. 2015-04-17 13:02:11,305 INFO [c.c.h.x.r.CitrixResourceBase] (DirectAgent-103:ctx-2a98fc62) VM does not exist on XenServer0083e31e-13d1-4e07-96a4-3594d789e1d8
  622. 2015-04-17 13:02:11,305 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-103:ctx-2a98fc62) Seq 1-171769955: Response Received:
  623. 2015-04-17 13:02:11,306 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-103:ctx-2a98fc62) Seq 1-171769955: MgmtId 46618217624527: Resp: Routing to peer
  624. 2015-04-17 13:02:11,856 DEBUG [c.c.a.t.Request] (AgentManager-Handler-8:null) Seq 5-634060907: Executing: { Cmd , MgmtId: 46618217624527, via: 5, Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/1/","origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.3.4.40/ibm/CloudSecondary","_role":"Image"}},"name":"routing-1","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"CloudStore-1","id":1,"poolType":"PreSetup","host":"localhost","path":"/CloudStore-1","port":0,"url":"PreSetup://localhost//CloudStore-1/?ROLE=Primary&STOREUUID=CloudStore-1"}},"name":"routing-1","hypervisorType":"XenServer"}},"executeInSequence":false,"options":{},"wait":10800}}] }
  625. 2015-04-17 13:02:11,857 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-62:ctx-e8153e47) Seq 5-634060907: Executing request
  626. 2015-04-17 13:02:12,565 DEBUG [c.c.u.d.DbUtil] (consoleproxy-1:ctx-e4b7f9c8) GET_LOCK() timed out on lock : consoleproxy.scan.lock
  627. 2015-04-17 13:02:14,014 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-62:ctx-e8153e47) destoryVDIbyNameLabel failed due to there are 0 VDIs with name cloud-c53f45f0-e902-4d2f-8294-3ef2098b18d2
  628. 2015-04-17 13:02:14,014 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-62:ctx-e8153e47) can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  629. 2015-04-17 13:02:14,015 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-62:ctx-e8153e47) Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  630. com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  631. at com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copy_vhd_from_secondarystorage(XenServerStorageProcessor.java:848)
  632. at com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copyTemplateToPrimaryStorage(XenServerStorageProcessor.java:918)
  633. at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:75)
  634. at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:50)
  635. at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:609)
  636. at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59)
  637. at com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:106)
  638. at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216)
  639. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  640. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  641. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  642. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  643. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  644. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  645. at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  646. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
  647. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
  648. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  649. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  650. at java.lang.Thread.run(Thread.java:744)
  651. 2015-04-17 13:02:14,015 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-62:ctx-e8153e47) Seq 5-634060907: Response Received:
  652. 2015-04-17 13:02:14,016 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-62:ctx-e8153e47) Seq 5-634060907: MgmtId 46618217624527: Resp: Routing to peer
  653. 2015-04-17 13:02:14,063 DEBUG [c.c.a.t.Request] (AgentManager-Handler-9:null) Seq 3-944373855: Executing: { Cmd , MgmtId: 46618217624527, via: 3, Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"v-1-VM","wait":0}}] }
  654. 2015-04-17 13:02:14,063 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-374:ctx-9e76542f) Seq 3-944373855: Executing request
  655. 2015-04-17 13:02:14,148 INFO [c.c.h.x.r.CitrixResourceBase] (DirectAgent-374:ctx-9e76542f) VM does not exist on XenServer23e67e4d-e952-40f3-a646-3a4e782d2db1
  656. 2015-04-17 13:02:14,148 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-374:ctx-9e76542f) Seq 3-944373855: Response Received:
  657. 2015-04-17 13:02:14,149 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-374:ctx-9e76542f) Seq 3-944373855: MgmtId 46618217624527: Resp: Routing to peer
  658. 2015-04-17 13:02:14,780 DEBUG [c.c.a.t.Request] (AgentManager-Handler-10:null) Seq 1-171769956: Executing: { Cmd , MgmtId: 46618217624527, via: 1, Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/1/","origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.3.4.40/ibm/CloudSecondary","_role":"Image"}},"name":"routing-1","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"CloudStore-1","id":1,"poolType":"PreSetup","host":"localhost","path":"/CloudStore-1","port":0,"url":"PreSetup://localhost//CloudStore-1/?ROLE=Primary&STOREUUID=CloudStore-1"}},"name":"routing-1","hypervisorType":"XenServer"}},"executeInSequence":false,"options":{},"wait":10800}}] }
  659. 2015-04-17 13:02:14,780 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-415:ctx-5358d21e) Seq 1-171769956: Executing request
  660. 2015-04-17 13:02:15,664 INFO [o.a.c.s.v.VolumeServiceImpl] (secstorage-1:ctx-1b0c075f) Unable to acquire lock on VMTemplateStoragePool 263
  661. 2015-04-17 13:02:15,667 ERROR [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-1b0c075f) Failed to start instance VM[SecondaryStorageVm|s-45-VM]
  662. com.cloud.utils.exception.CloudRuntimeException: Unable to acquire lock on VMTemplateStoragePool: 263
  663. at org.apache.cloudstack.storage.volume.VolumeServiceImpl.createBaseImageAsync(VolumeServiceImpl.java:460)
  664. at org.apache.cloudstack.storage.volume.VolumeServiceImpl.createVolumeFromTemplateAsync(VolumeServiceImpl.java:604)
  665. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.recreateVolume(VolumeOrchestrator.java:1192)
  666. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.prepare(VolumeOrchestrator.java:1256)
  667. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:963)
  668. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761)
  669. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:745)
  670. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.startSecStorageVm(SecondaryStorageManagerImpl.java:261)
  671. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.allocCapacity(SecondaryStorageManagerImpl.java:694)
  672. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.expandPool(SecondaryStorageManagerImpl.java:1278)
  673. at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:123)
  674. at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:50)
  675. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:111)
  676. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:35)
  677. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:88)
  678. at com.cloud.vm.SystemVmLoadScanner$1.runInContext(SystemVmLoadScanner.java:79)
  679. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  680. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  681. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  682. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  683. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  684. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  685. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
  686. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
  687. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
  688. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  689. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  690. at java.lang.Thread.run(Thread.java:744)
  691. 2015-04-17 13:02:15,675 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-1b0c075f) Cleaning up resources for the vm VM[SecondaryStorageVm|s-45-VM] in Starting state
  692. 2015-04-17 13:02:15,681 DEBUG [c.c.a.t.Request] (secstorage-1:ctx-1b0c075f) Seq 4-819986514: Sending { Cmd , MgmtId: 50788518005399, via: 4(cloud-host9.cgg.gov.in), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"s-45-VM","wait":0}}] }
  693. 2015-04-17 13:02:15,682 DEBUG [c.c.a.t.Request] (secstorage-1:ctx-1b0c075f) Seq 4-819986514: Executing: { Cmd , MgmtId: 50788518005399, via: 4(cloud-host9.cgg.gov.in), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"s-45-VM","wait":0}}] }
  694. 2015-04-17 13:02:15,682 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-90:ctx-ec5761ef) Seq 4-819986514: Executing request
  695. 2015-04-17 13:02:15,788 INFO [c.c.h.x.r.CitrixResourceBase] (DirectAgent-90:ctx-ec5761ef) VM does not exist on XenServer1d86cc04-ef64-48d9-b00c-734c21144945
  696. 2015-04-17 13:02:15,788 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-90:ctx-ec5761ef) Seq 4-819986514: Response Received:
  697. 2015-04-17 13:02:15,788 DEBUG [c.c.a.t.Request] (DirectAgent-90:ctx-ec5761ef) Seq 4-819986514: Processing: { Ans: , MgmtId: 50788518005399, via: 4, Ver: v1, Flags: 10, [{"com.cloud.agent.api.StopAnswer":{"result":true,"details":"VM does not exist","wait":0}}] }
  698. 2015-04-17 13:02:15,788 DEBUG [c.c.a.t.Request] (secstorage-1:ctx-1b0c075f) Seq 4-819986514: Received: { Ans: , MgmtId: 50788518005399, via: 4, Ver: v1, Flags: 10, { StopAnswer } }
  699. 2015-04-17 13:02:15,811 DEBUG [c.c.n.g.ControlNetworkGuru] (secstorage-1:ctx-1b0c075f) Released nic: NicProfile[177-45-null-null-null
  700. 2015-04-17 13:02:15,830 DEBUG [c.c.d.d.DataCenterIpAddressDaoImpl] (secstorage-1:ctx-1b0c075f) Releasing ip address for reservationId=7696e2db-252b-4226-bf70-d9dffd01f134, instance=178
  701. 2015-04-17 13:02:15,831 DEBUG [c.c.n.g.PodBasedNetworkGuru] (secstorage-1:ctx-1b0c075f) Released nic: NicProfile[178-45-null-null-null
  702. 2015-04-17 13:02:15,852 DEBUG [c.c.d.d.DataCenterIpAddressDaoImpl] (secstorage-1:ctx-1b0c075f) Releasing ip address for reservationId=7696e2db-252b-4226-bf70-d9dffd01f134, instance=179
  703. 2015-04-17 13:02:15,853 DEBUG [c.c.n.g.PodBasedNetworkGuru] (secstorage-1:ctx-1b0c075f) Released nic: NicProfile[179-45-null-null-null
  704. 2015-04-17 13:02:15,864 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-1b0c075f) Successfully released network resources for the vm VM[SecondaryStorageVm|s-45-VM]
  705. 2015-04-17 13:02:15,864 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-1b0c075f) Successfully cleanued up resources for the vm VM[SecondaryStorageVm|s-45-VM] in Starting state
  706. 2015-04-17 13:02:15,884 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: 4
  707. 2015-04-17 13:02:15,897 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f) Hosts's actual total CPU: 88000 and CPU after applying overprovisioning: 88000
  708. 2015-04-17 13:02:15,897 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f) Hosts's actual total RAM: 130926604032 and RAM after applying overprovisioning: 130926600192
  709. 2015-04-17 13:02:15,898 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f) release cpu from host: 4, old used: 1000,reserved: 0, actual total: 88000, total with overprovisioning: 88000; new used: 500,reserved:0; movedfromreserved: false,moveToReserveredfalse
  710. 2015-04-17 13:02:15,898 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f) release mem from host: 4, old used: 1610612736,reserved: 0, total: 130926600192; new used: 1073741824,reserved:0; movedfromreserved: false,moveToReserveredfalse
  711. 2015-04-17 13:02:15,905 WARN [c.c.s.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-1b0c075f) Exception while trying to start secondary storage vm
  712. com.cloud.exception.AgentUnavailableException: Resource [Host:4] is unreachable: Host 4: Unable to start instance due to Unable to acquire lock on VMTemplateStoragePool: 263
  713. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1073)
  714. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761)
  715. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:745)
  716. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.startSecStorageVm(SecondaryStorageManagerImpl.java:261)
  717. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.allocCapacity(SecondaryStorageManagerImpl.java:694)
  718. at com.cloud.storage.secondary.SecondaryStorageManagerImpl.expandPool(SecondaryStorageManagerImpl.java:1278)
  719. at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:123)
  720. at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:50)
  721. at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:111)
  722. at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:35)
  723. at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:88)
  724. at com.cloud.vm.SystemVmLoadScanner$1.runInContext(SystemVmLoadScanner.java:79)
  725. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  726. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  727. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  728. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  729. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  730. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  731. at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
  732. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
  733. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
  734. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  735. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  736. at java.lang.Thread.run(Thread.java:744)
  737. Caused by: com.cloud.utils.exception.CloudRuntimeException: Unable to acquire lock on VMTemplateStoragePool: 263
  738. at org.apache.cloudstack.storage.volume.VolumeServiceImpl.createBaseImageAsync(VolumeServiceImpl.java:460)
  739. at org.apache.cloudstack.storage.volume.VolumeServiceImpl.createVolumeFromTemplateAsync(VolumeServiceImpl.java:604)
  740. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.recreateVolume(VolumeOrchestrator.java:1192)
  741. at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.prepare(VolumeOrchestrator.java:1256)
  742. at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:963)
  743. ... 23 more
  744. 2015-04-17 13:02:15,907 INFO [c.c.s.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-1b0c075f) Unable to start secondary storage vm for standby capacity, secStorageVm vm Id : 45, will recycle it and start a new one
  745. 2015-04-17 13:02:15,941 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-1b0c075f) VM is already stopped: VM[SecondaryStorageVm|s-45-VM]
  746. 2015-04-17 13:02:15,963 DEBUG [c.c.c.CapacityManagerImpl] (secstorage-1:ctx-1b0c075f) VM state transitted from :Stopped to Expunging with event: ExpungeOperationvm's original host id: null new host id: null host id before state transition: null
  747. 2015-04-17 13:02:15,963 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-1b0c075f) Destroying vm VM[SecondaryStorageVm|s-45-VM]
  748. 2015-04-17 13:02:15,963 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-1b0c075f) Cleaning up NICS
  749. 2015-04-17 13:02:15,963 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1b0c075f) Cleaning network for vm: 45
  750. 2015-04-17 13:02:15,986 DEBUG [c.c.n.g.PublicNetworkGuru] (secstorage-1:ctx-1b0c075f) public network deallocate network: networkId: 200, ip: 10.3.1.6
  751. 2015-04-17 13:02:15,998 DEBUG [c.c.n.g.PublicNetworkGuru] (secstorage-1:ctx-1b0c075f) Deallocated nic: NicProfile[176-45-null-null-null
  752. 2015-04-17 13:02:16,006 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1b0c075f) Removed nic id=176
  753. 2015-04-17 13:02:16,010 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1b0c075f) Revoving nic secondary ip entry ...
  754. 2015-04-17 13:02:16,026 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1b0c075f) Removed nic id=177
  755. 2015-04-17 13:02:16,028 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1b0c075f) Revoving nic secondary ip entry ...
  756. 2015-04-17 13:02:16,056 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1b0c075f) Removed nic id=178
  757. 2015-04-17 13:02:16,058 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1b0c075f) Revoving nic secondary ip entry ...
  758. 2015-04-17 13:02:16,082 DEBUG [c.c.s.StatsCollector] (StatsCollector-1:ctx-7335c244) HostStatsCollector is running...
  759. 2015-04-17 13:02:16,087 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1b0c075f) Removed nic id=179
  760. 2015-04-17 13:02:16,090 DEBUG [o.a.c.e.o.NetworkOrchestrator] (secstorage-1:ctx-1b0c075f) Revoving nic secondary ip entry ...
  761. 2015-04-17 13:02:16,092 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-1b0c075f) Cleaning up hypervisor data structures (ex. SRs in XenServer) for managed storage
  762. 2015-04-17 13:02:16,096 DEBUG [o.a.c.e.o.VolumeOrchestrator] (secstorage-1:ctx-1b0c075f) Cleaning storage for vm: 45
  763. 2015-04-17 13:02:16,099 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-159:ctx-da3de641) Seq 1-847970390: Executing request
  764. 2015-04-17 13:02:16,126 INFO [o.a.c.s.v.VolumeServiceImpl] (secstorage-1:ctx-1b0c075f) Expunge volume with no data store specified
  765. 2015-04-17 13:02:16,131 INFO [o.a.c.s.v.VolumeServiceImpl] (secstorage-1:ctx-1b0c075f) Volume 45 is not referred anywhere, remove it from volumes table
  766. 2015-04-17 13:02:16,156 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-1b0c075f) Expunged VM[SecondaryStorageVm|s-45-VM]
  767. 2015-04-17 13:02:16,169 INFO [c.c.s.PremiumSecondaryStorageManagerImpl] (secstorage-1:ctx-1b0c075f) Primary secondary storage is not even started, wait until next turn
  768. 2015-04-17 13:02:16,406 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-159:ctx-da3de641) Seq 1-847970390: Response Received:
  769. 2015-04-17 13:02:16,406 DEBUG [c.c.a.t.Request] (StatsCollector-1:ctx-7335c244) Seq 1-847970390: Received: { Ans: , MgmtId: 50788518005399, via: 1, Ver: v1, Flags: 10, { GetHostStatsAnswer } }
  770. 2015-04-17 13:02:16,419 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-91:ctx-178d3380) Seq 2-856817751: Executing request
  771. 2015-04-17 13:02:16,721 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-91:ctx-178d3380) Seq 2-856817751: Response Received:
  772. 2015-04-17 13:02:16,721 DEBUG [c.c.a.t.Request] (StatsCollector-1:ctx-7335c244) Seq 2-856817751: Received: { Ans: , MgmtId: 50788518005399, via: 2, Ver: v1, Flags: 10, { GetHostStatsAnswer } }
  773. 2015-04-17 13:02:16,735 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-148:ctx-059cafe6) Seq 3-599130196: Executing request
  774. 2015-04-17 13:02:16,939 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-148:ctx-059cafe6) Seq 3-599130196: Response Received:
  775. 2015-04-17 13:02:16,939 DEBUG [c.c.a.t.Request] (StatsCollector-1:ctx-7335c244) Seq 3-599130196: Received: { Ans: , MgmtId: 50788518005399, via: 3, Ver: v1, Flags: 10, { GetHostStatsAnswer } }
  776. 2015-04-17 13:02:16,957 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-96:ctx-129a61d9) Seq 4-819986515: Executing request
  777. 2015-04-17 13:02:16,958 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-415:ctx-5358d21e) destoryVDIbyNameLabel failed due to there are 0 VDIs with name cloud-b8479457-5fd8-4b71-9a3d-9b1614304220
  778. 2015-04-17 13:02:16,958 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-415:ctx-5358d21e) can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  779. 2015-04-17 13:02:16,958 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-415:ctx-5358d21e) Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  780. com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  781. at com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copy_vhd_from_secondarystorage(XenServerStorageProcessor.java:848)
  782. at com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copyTemplateToPrimaryStorage(XenServerStorageProcessor.java:918)
  783. at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:75)
  784. at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:50)
  785. at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:609)
  786. at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59)
  787. at com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:106)
  788. at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216)
  789. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  790. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  791. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  792. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  793. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  794. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  795. at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  796. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
  797. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
  798. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  799. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  800. at java.lang.Thread.run(Thread.java:744)
  801. 2015-04-17 13:02:16,960 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-415:ctx-5358d21e) Seq 1-171769956: Response Received:
  802. 2015-04-17 13:02:16,961 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-415:ctx-5358d21e) Seq 1-171769956: MgmtId 46618217624527: Resp: Routing to peer
  803. 2015-04-17 13:02:17,016 DEBUG [c.c.a.t.Request] (AgentManager-Handler-11:null) Seq 4-327286886: Executing: { Cmd , MgmtId: 46618217624527, via: 4, Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"v-1-VM","wait":0}}] }
  804. 2015-04-17 13:02:17,016 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-104:ctx-aca515e6) Seq 4-327286886: Executing request
  805. 2015-04-17 13:02:17,151 INFO [c.c.h.x.r.CitrixResourceBase] (DirectAgent-104:ctx-aca515e6) VM does not exist on XenServer1d86cc04-ef64-48d9-b00c-734c21144945
  806. 2015-04-17 13:02:17,151 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-104:ctx-aca515e6) Seq 4-327286886: Response Received:
  807. 2015-04-17 13:02:17,151 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-104:ctx-aca515e6) Seq 4-327286886: MgmtId 46618217624527: Resp: Routing to peer
  808. 2015-04-17 13:02:17,262 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-96:ctx-129a61d9) Seq 4-819986515: Response Received:
  809. 2015-04-17 13:02:17,263 DEBUG [c.c.a.t.Request] (StatsCollector-1:ctx-7335c244) Seq 4-819986515: Received: { Ans: , MgmtId: 50788518005399, via: 4, Ver: v1, Flags: 10, { GetHostStatsAnswer } }
  810. 2015-04-17 13:02:17,275 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-250:ctx-0310abd0) Seq 5-1311506520: Executing request
  811. 2015-04-17 13:02:17,572 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-250:ctx-0310abd0) Seq 5-1311506520: Response Received:
  812. 2015-04-17 13:02:17,573 DEBUG [c.c.a.t.Request] (StatsCollector-1:ctx-7335c244) Seq 5-1311506520: Received: { Ans: , MgmtId: 50788518005399, via: 5, Ver: v1, Flags: 10, { GetHostStatsAnswer } }
  813. 2015-04-17 13:02:19,384 DEBUG [c.c.n.ExternalDeviceUsageManagerImpl] (ExternalNetworkMonitor-1:ctx-be08365f) External devices stats collector is running...
  814. 2015-04-17 13:02:19,411 DEBUG [c.c.s.s.SnapshotSchedulerImpl] (SnapshotPollTask:ctx-807b6023) Snapshot scheduler.poll is being called at 2015-04-17 07:32:19 GMT
  815. 2015-04-17 13:02:19,414 DEBUG [c.c.s.s.SnapshotSchedulerImpl] (SnapshotPollTask:ctx-807b6023) Got 0 snapshots to be executed at 2015-04-17 07:32:19 GMT
  816. 2015-04-17 13:02:19,526 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterMonitor-1:ctx-da8a3994) Found 0 running routers.
  817. 2015-04-17 13:02:19,533 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-fdf33d4a) Found 0 routers to update status.
  818. 2015-04-17 13:02:19,538 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-fdf33d4a) Found 0 networks to update RvR status.
  819. 2015-04-17 13:02:19,555 INFO [c.c.h.HighAvailabilityManagerImpl] (HA-1:ctx-07e51808) checking health of usage server
  820. 2015-04-17 13:02:19,574 INFO [c.c.n.v.VpcManagerImpl] (VpcChecker-1:ctx-cb8869f7) Found 0 removed VPCs to cleanup
  821. 2015-04-17 13:02:19,623 DEBUG [c.c.h.HighAvailabilityManagerImpl] (HA-1:ctx-07e51808) usage server running? false, heartbeat: null
  822. 2015-04-17 13:02:19,624 WARN [o.a.c.alerts] (HA-1:ctx-07e51808) alertType:: 13 // dataCenterId:: 0 // podId:: 0 // clusterId:: null // message:: No usage server process running
  823. 2015-04-17 13:02:19,629 DEBUG [c.c.a.AlertManagerImpl] (HA-1:ctx-07e51808) Have already sent: 1 emails for alert type '13' -- skipping send email
  824. 2015-04-17 13:02:24,410 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-c612b8bd) Resetting hosts suitable for reconnect
  825. 2015-04-17 13:02:24,413 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-c612b8bd) Completed resetting hosts suitable for reconnect
  826. 2015-04-17 13:02:24,413 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-c612b8bd) Acquiring hosts for clusters already owned by this management server
  827. 2015-04-17 13:02:24,416 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-c612b8bd) Completed acquiring hosts for clusters already owned by this management server
  828. 2015-04-17 13:02:24,416 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-c612b8bd) Acquiring hosts for clusters not owned by any management server
  829. 2015-04-17 13:02:24,417 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-c612b8bd) Completed acquiring hosts for clusters not owned by any management server
  830. 2015-04-17 13:02:26,600 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-165:ctx-f429a3f7) Seq 1-171769957: Executing request
  831. 2015-04-17 13:02:26,910 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-165:ctx-f429a3f7) Seq 1-171769957: Response Received:
  832. 2015-04-17 13:02:26,910 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-165:ctx-f429a3f7) Seq 1-171769957: MgmtId 46618217624527: Resp: Routing to peer
  833. 2015-04-17 13:02:26,939 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-152:ctx-bd3c77c7) Seq 2-34930790: Executing request
  834. 2015-04-17 13:02:27,240 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-152:ctx-bd3c77c7) Seq 2-34930790: Response Received:
  835. 2015-04-17 13:02:27,241 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-152:ctx-bd3c77c7) Seq 2-34930790: MgmtId 46618217624527: Resp: Routing to peer
  836. 2015-04-17 13:02:27,267 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-14:ctx-a931ba6b) Seq 3-944373856: Executing request
  837. 2015-04-17 13:02:27,367 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-383:ctx-0d3cfc5b) Ping from 2(cloud-host10.cgg.gov.in)
  838. 2015-04-17 13:02:27,550 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-14:ctx-a931ba6b) Seq 3-944373856: Response Received:
  839. 2015-04-17 13:02:27,550 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-14:ctx-a931ba6b) Seq 3-944373856: MgmtId 46618217624527: Resp: Routing to peer
  840. 2015-04-17 13:02:27,565 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-162:ctx-ec13f72a) Ping from 3(cloud-host1.cgg.gov.in)
  841. 2015-04-17 13:02:27,571 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-402:ctx-f39c3709) Seq 4-327286887: Executing request
  842. 2015-04-17 13:02:27,759 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-410:ctx-b4514f4e) Ping from 4(cloud-host9.cgg.gov.in)
  843. 2015-04-17 13:02:27,955 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-402:ctx-f39c3709) Seq 4-327286887: Response Received:
  844. 2015-04-17 13:02:27,955 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-402:ctx-f39c3709) Seq 4-327286887: MgmtId 46618217624527: Resp: Routing to peer
  845. 2015-04-17 13:02:27,981 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-413:ctx-6120217c) Seq 5-634060908: Executing request
  846. 2015-04-17 13:02:28,299 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-413:ctx-6120217c) Seq 5-634060908: Response Received:
  847. 2015-04-17 13:02:28,299 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-413:ctx-6120217c) Seq 5-634060908: MgmtId 46618217624527: Resp: Routing to peer
  848. 2015-04-17 13:02:28,833 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-45:ctx-e743f542) Ping from 5(cloud-host2.cgg.gov.in)
  849. 2015-04-17 13:02:28,941 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-263:ctx-1eb9caed) Seq 3-599130116: Executing request
  850. 2015-04-17 13:02:29,144 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-263:ctx-1eb9caed) Seq 3-599130116: Response Received:
  851. 2015-04-17 13:02:29,145 DEBUG [c.c.a.t.Request] (DirectAgent-263:ctx-1eb9caed) Seq 3-599130116: Processing: { Ans: , MgmtId: 50788518005399, via: 3, Ver: v1, Flags: 10, [{"com.cloud.agent.api.ClusterSyncAnswer":{"_clusterId":1,"_newStates":{},"_isExecuted":false,"result":true,"wait":0}}] }
  852. 2015-04-17 13:02:29,248 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-414:ctx-5afc6b36) Seq 2-856817668: Executing request
  853. 2015-04-17 13:02:29,368 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-414:ctx-5afc6b36) Seq 2-856817668: Response Received:
  854. 2015-04-17 13:02:29,368 DEBUG [c.c.a.t.Request] (DirectAgent-414:ctx-5afc6b36) Seq 2-856817668: Processing: { Ans: , MgmtId: 50788518005399, via: 2, Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}}] }
  855. 2015-04-17 13:02:29,529 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-101:ctx-63671cd2) Seq 4-819986436: Executing request
  856. 2015-04-17 13:02:29,572 DEBUG [c.c.n.l.LBHealthCheckManagerImpl] (LBHealthCheck-1:ctx-f678eab7) LB HealthCheck Manager is running and getting the updates from LB providers and updating service status
  857. 2015-04-17 13:02:29,595 DEBUG [c.c.n.l.LBHealthCheckManagerImpl] (LBHealthCheck-1:ctx-f678eab7) LB HealthCheck Manager is running and getting the updates from LB providers and updating service status
  858. 2015-04-17 13:02:29,645 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-101:ctx-63671cd2) Seq 4-819986436: Response Received:
  859. 2015-04-17 13:02:29,646 DEBUG [c.c.a.t.Request] (DirectAgent-101:ctx-63671cd2) Seq 4-819986436: Processing: { Ans: , MgmtId: 50788518005399, via: 4, Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}}] }
  860. 2015-04-17 13:02:30,893 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-262:ctx-af08d962) Seq 5-1311506436: Executing request
  861. 2015-04-17 13:02:31,016 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-262:ctx-af08d962) Seq 5-1311506436: Response Received:
  862. 2015-04-17 13:02:31,016 DEBUG [c.c.a.t.Request] (DirectAgent-262:ctx-af08d962) Seq 5-1311506436: Processing: { Ans: , MgmtId: 50788518005399, via: 5, Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}}] }
  863. 2015-04-17 13:02:33,160 DEBUG [c.c.a.t.Request] (AgentManager-Handler-2:null) Seq 1-171769958: Executing: { Cmd , MgmtId: 46618217624527, via: 1, Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/1/","origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.3.4.40/ibm/CloudSecondary","_role":"Image"}},"name":"routing-1","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"CloudStore-1","id":1,"poolType":"PreSetup","host":"localhost","path":"/CloudStore-1","port":0,"url":"PreSetup://localhost//CloudStore-1/?ROLE=Primary&STOREUUID=CloudStore-1"}},"name":"routing-1","hypervisorType":"XenServer"}},"executeInSequence":false,"options":{},"wait":10800}}] }
  864. 2015-04-17 13:02:33,161 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-403:ctx-1720425d) Seq 1-171769958: Executing request
  865. 2015-04-17 13:02:35,141 DEBUG [c.c.s.StatsCollector] (StatsCollector-2:ctx-293e80a8) VmStatsCollector is running...
  866. 2015-04-17 13:02:35,328 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-403:ctx-1720425d) destoryVDIbyNameLabel failed due to there are 0 VDIs with name cloud-f8864f12-0bd2-4a12-ba80-e04363877ab5
  867. 2015-04-17 13:02:35,328 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-403:ctx-1720425d) can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  868. 2015-04-17 13:02:35,328 WARN [c.c.h.x.r.XenServerStorageProcessor] (DirectAgent-403:ctx-1720425d) Catch Exception com.cloud.utils.exception.CloudRuntimeException for template + due to com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  869. com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr 30d8270b-b490-28e7-af7e-35875f0a1d31
  870. at com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copy_vhd_from_secondarystorage(XenServerStorageProcessor.java:848)
  871. at com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.copyTemplateToPrimaryStorage(XenServerStorageProcessor.java:918)
  872. at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:75)
  873. at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:50)
  874. at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:609)
  875. at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59)
  876. at com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:106)
  877. at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216)
  878. at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  879. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  880. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  881. at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  882. at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  883. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  884. at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  885. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
  886. at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
  887. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  888. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  889. at java.lang.Thread.run(Thread.java:744)
  890. 2015-04-17 13:02:35,329 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-403:ctx-1720425d) Seq 1-171769958: Response Received:
  891. 2015-04-17 13:02:35,329 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-403:ctx-1720425d) Seq 1-171769958: MgmtId 46618217624527: Resp: Routing to peer
  892. 2015-04-17 13:02:35,382 DEBUG [c.c.a.t.Request] (AgentManager-Handler-3:null) Seq 3-944373857: Executing: { Cmd , MgmtId: 46618217624527, via: 3, Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"v-1-VM","wait":0}}] }
  893. 2015-04-17 13:02:35,383 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-408:ctx-404192fb) Seq 3-944373857: Executing request
  894. 2015-04-17 13:02:35,456 INFO [c.c.h.x.r.CitrixResourceBase] (DirectAgent-408:ctx-404192fb) VM does not exist on XenServer23e67e4d-e952-40f3-a646-3a4e782d2db1
  895. 2015-04-17 13:02:35,456 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-408:ctx-404192fb) Seq 3-944373857: Response Received:
  896. 2015-04-17 13:02:35,456 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-408:ctx-404192fb) Seq 3-944373857: MgmtId 46618217624527: Resp: Routing to peer
  897. 2015-04-17 13:02:36,066 DEBUG [c.c.a.t.Request] (AgentManager-Handler-4:null) Seq 1-171769959: Executing: { Cmd , MgmtId: 46618217624527, via: 1, Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/1/","origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.3.4.40/ibm/CloudSecondary","_role":"Image"}},"name":"routing-1","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-xen.vhd.bz2","uuid":"297f8c6c-e439-11e4-b2f4-8e87d1b74cef","id":1,"format":"VHD","accountId":1,"checksum":"74b92f031cc5c2089ee89efb81344dcf","hvm":false,"displayText":"SystemVM Template (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"CloudStore-1","id":1,"poolType":"PreSetup","host":"localhost","path":"/CloudStore-1","port":0,"url":"PreSetup://localhost//CloudStore-1/?ROLE=Primary&STOREUUID=CloudStore-1"}},"name":"routing-1","hypervisorType":"XenServer"}},"executeInSequence":false,"options":{},"wait":10800}}] }
  898. 2015-04-17 13:02:36,067 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-4:ctx-f75073e6) Seq 1-171769959: Executing request
Advertisement
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!