API tools faq
paste
kentj

Virtual Router non-startup issue

kentj
Aug 21st, 2013
386
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 13.93 KB | None | 0 0
raw download clone embed print report
  1. 2013-08-21 16:05:21,841 DEBUG [cloud.api.ApiServlet] (catalina-exec-21:null) ===START=== <next IP Address> -- GET command=queryAsyncJobResult&jobId=d01f5602-770a-4c19-a259-b732fcded54d&response=json&sessionkey=yKlWrKiGzXmCxku6A7HnB3H1oTk%3D&_=1377122771993
  2. 2013-08-21 16:05:21,910 DEBUG [cloud.api.ApiServlet] (catalina-exec-21:null) ===END=== <next IP Address> -- GET command=queryAsyncJobResult&jobId=d01f5602-770a-4c19-a259-b732fcded54d&response=json&sessionkey=yKlWrKiGzXmCxku6A7HnB3H1oTk%3D&_=1377122771993
  3. 2013-08-21 16:05:22,748 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-13:null) SeqA 4-9593: Processing Seq 4-9593: { Cmd , MgmtId: -1, via: 4, Ver: v1, Flags: 11, [{"ConsoleProxyLoadReportCommand":{"_proxyVmId":2,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
  4. 2013-08-21 16:05:22,792 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-13:null) SeqA 4-9593: Sending Seq 4-9593: { Ans: , MgmtId: 166316981724, via: 4, Ver: v1, Flags: 100010, [{"AgentControlAnswer":{"result":true,"wait":0}}] }
  5. 2013-08-21 16:05:23,667 DEBUG [xen.resource.CitrixResourceBase] (DirectAgent-12:null) 10. The VM r-4-VM is in Stopped state
  6. 2013-08-21 16:05:23,667 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-12:null) Seq 1-283705360: Response Received:
  7. 2013-08-21 16:05:23,667 DEBUG [agent.transport.Request] (DirectAgent-12:null) Seq 1-283705360: Processing: { Ans: , MgmtId: 166316981724, via: 1, Ver: v1, Flags: 110, [{"StopAnswer":{"vncPort":0,"result":true,"details":"Stop VM r-4-VM Succeed","wait":0}}] }
  8. 2013-08-21 16:05:23,667 DEBUG [agent.manager.AgentAttache] (DirectAgent-12:null) Seq 1-283705360: No more commands found
  9. 2013-08-21 16:05:23,668 DEBUG [agent.transport.Request] (Job-Executor-1:job-1) Seq 1-283705360: Received: { Ans: , MgmtId: 166316981724, via: 1, Ver: v1, Flags: 110, { StopAnswer } }
  10. 2013-08-21 16:05:23,668 DEBUG [agent.manager.AgentManagerImpl] (Job-Executor-1:job-1) Details from executing class com.cloud.agent.api.StopCommand: Stop VM r-4-VM Succeed
  11. 2013-08-21 16:05:23,669 ERROR [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-1:job-1) Failed to start instance VM[DomainRouter|r-4-VM]
  12. com.cloud.utils.exception.ExecutionException: Unable to start VM[DomainRouter|r-4-VM] due to error in finalizeStart, not retrying
  13. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:808)
  14. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:471)
  15. at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.start(VirtualNetworkApplianceManagerImpl.java:2616)
  16. at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.startVirtualRouter(VirtualNetworkApplianceManagerImpl.java:1824)
  17. at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.startRouter(VirtualNetworkApplianceManagerImpl.java:2874)
  18. at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.startRouter(VirtualNetworkApplianceManagerImpl.java:2824)
  19. at com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
  20. at org.apache.cloudstack.api.command.admin.router.StartRouterCmd.execute(StartRouterCmd.java:103)
  21. at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:162)
  22. at com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:437)
  23. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  24. at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
  25. at java.util.concurrent.FutureTask.run(FutureTask.java:166)
  26. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
  27. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  28. at java.lang.Thread.run(Thread.java:679)
  29. 2013-08-21 16:05:23,731 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-1:job-1) Cleaning up resources for the vm VM[DomainRouter|r-4-VM] in Starting state
  30. 2013-08-21 16:05:23,735 DEBUG [agent.transport.Request] (Job-Executor-1:job-1) Seq 1-283705361: Sending { Cmd , MgmtId: 166316981724, via: 1, Ver: v1, Flags: 100111, [{"StopCommand":{"isProxy":false,"vmName":"r-4-VM","wait":0}}] }
  31. 2013-08-21 16:05:23,735 DEBUG [agent.transport.Request] (Job-Executor-1:job-1) Seq 1-283705361: Executing: { Cmd , MgmtId: 166316981724, via: 1, Ver: v1, Flags: 100111, [{"StopCommand":{"isProxy":false,"vmName":"r-4-VM","wait":0}}] }
  32. 2013-08-21 16:05:23,735 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-18:null) Seq 1-283705361: Executing request
  33. 2013-08-21 16:05:23,815 INFO [xen.resource.CitrixResourceBase] (DirectAgent-18:null) VM does not exist on XenServer322ab8aa-0302-49b2-9f32-f068f7f2f8f8
  34. 2013-08-21 16:05:23,815 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-18:null) Seq 1-283705361: Response Received:
  35. 2013-08-21 16:05:23,816 DEBUG [agent.transport.Request] (DirectAgent-18:null) Seq 1-283705361: Processing: { Ans: , MgmtId: 166316981724, via: 1, Ver: v1, Flags: 110, [{"StopAnswer":{"vncPort":0,"result":true,"details":"VM does not exist","wait":0}}] }
  36. 2013-08-21 16:05:23,816 DEBUG [agent.manager.AgentAttache] (DirectAgent-18:null) Seq 1-283705361: No more commands found
  37. 2013-08-21 16:05:23,816 DEBUG [agent.transport.Request] (Job-Executor-1:job-1) Seq 1-283705361: Received: { Ans: , MgmtId: 166316981724, via: 1, Ver: v1, Flags: 110, { StopAnswer } }
  38. 2013-08-21 16:05:23,828 DEBUG [network.router.VirtualNetworkApplianceManagerImpl] (Job-Executor-1:job-1) Successfully updated user statistics as a part of domR VM[DomainRouter|r-4-VM] reboot/stop
  39. 2013-08-21 16:05:23,900 DEBUG [cloud.network.NetworkManagerImpl] (Job-Executor-1:job-1) Asking NiciraNvp to release Nic[9-4-9758c809-f094-41a3-a938-1f62fb9ea70e-<vmIP>]
  40. 2013-08-21 16:05:23,900 DEBUG [network.element.NiciraNvpElement] (Job-Executor-1:job-1) Checking if NiciraNvpElement can handle service Connectivity on network defaultGuestNetwork
  41. 2013-08-21 16:05:23,900 DEBUG [cloud.network.NetworkManagerImpl] (Job-Executor-1:job-1) Asking JuniperSRX to release Nic[9-4-9758c809-f094-41a3-a938-1f62fb9ea70e-<vmIP>]
  42. 2013-08-21 16:05:23,900 DEBUG [cloud.network.NetworkManagerImpl] (Job-Executor-1:job-1) Asking Netscaler to release Nic[9-4-9758c809-f094-41a3-a938-1f62fb9ea70e-<vmIP>]
  43. 2013-08-21 16:05:23,900 DEBUG [cloud.network.NetworkManagerImpl] (Job-Executor-1:job-1) Asking F5BigIP to release Nic[9-4-9758c809-f094-41a3-a938-1f62fb9ea70e-<vmIP>]
  44. 2013-08-21 16:05:23,900 DEBUG [cloud.network.NetworkManagerImpl] (Job-Executor-1:job-1) Asking CiscoNexus1000vVSM to release Nic[9-4-9758c809-f094-41a3-a938-1f62fb9ea70e-<vmIP>]
  45. 2013-08-21 16:05:23,900 DEBUG [cloud.network.NetworkManagerImpl] (Job-Executor-1:job-1) Asking BigSwitchVnsElement to release Nic[9-4-9758c809-f094-41a3-a938-1f62fb9ea70e-<vmIP>]
  46. 2013-08-21 16:05:23,900 DEBUG [network.element.BigSwitchVnsElement] (Job-Executor-1:job-1) Checking if BigSwitchVnsElement can handle service Connectivity on network defaultGuestNetwork
  47. 2013-08-21 16:05:23,900 DEBUG [cloud.network.NetworkManagerImpl] (Job-Executor-1:job-1) Asking VirtualRouter to release Nic[9-4-9758c809-f094-41a3-a938-1f62fb9ea70e-<vmIP>]
  48. 2013-08-21 16:05:23,900 DEBUG [cloud.network.NetworkManagerImpl] (Job-Executor-1:job-1) Asking Ovs to release Nic[9-4-9758c809-f094-41a3-a938-1f62fb9ea70e-<vmIP>]
  49. 2013-08-21 16:05:23,901 DEBUG [cloud.network.NetworkManagerImpl] (Job-Executor-1:job-1) Asking SecurityGroupProvider to release Nic[9-4-9758c809-f094-41a3-a938-1f62fb9ea70e-<vmIP>]
  50. 2013-08-21 16:05:23,901 DEBUG [cloud.network.NetworkManagerImpl] (Job-Executor-1:job-1) Asking VpcVirtualRouter to release Nic[9-4-9758c809-f094-41a3-a938-1f62fb9ea70e-<vmIP>]
  51. 2013-08-21 16:05:23,906 DEBUG [network.guru.ControlNetworkGuru] (Job-Executor-1:job-1) Released nic: NicProfile[10-4-null-null-null
  52. 2013-08-21 16:05:23,948 DEBUG [cloud.network.NetworkManagerImpl] (Job-Executor-1:job-1) Asking NiciraNvp to release Nic[10-4-9758c809-f094-41a3-a938-1f62fb9ea70e-null]
  53. 2013-08-21 16:05:23,948 DEBUG [network.element.NiciraNvpElement] (Job-Executor-1:job-1) Checking if NiciraNvpElement can handle service Connectivity on network null
  54. 2013-08-21 16:05:23,948 DEBUG [cloud.network.NetworkManagerImpl] (Job-Executor-1:job-1) Asking JuniperSRX to release Nic[10-4-9758c809-f094-41a3-a938-1f62fb9ea70e-null]
  55. 2013-08-21 16:05:23,948 DEBUG [cloud.network.NetworkManagerImpl] (Job-Executor-1:job-1) Asking Netscaler to release Nic[10-4-9758c809-f094-41a3-a938-1f62fb9ea70e-null]
  56. 2013-08-21 16:05:23,948 DEBUG [cloud.network.NetworkManagerImpl] (Job-Executor-1:job-1) Asking F5BigIP to release Nic[10-4-9758c809-f094-41a3-a938-1f62fb9ea70e-null]
  57. 2013-08-21 16:05:23,948 DEBUG [cloud.network.NetworkManagerImpl] (Job-Executor-1:job-1) Asking CiscoNexus1000vVSM to release Nic[10-4-9758c809-f094-41a3-a938-1f62fb9ea70e-null]
  58. 2013-08-21 16:05:23,948 DEBUG [cloud.network.NetworkManagerImpl] (Job-Executor-1:job-1) Asking BigSwitchVnsElement to release Nic[10-4-9758c809-f094-41a3-a938-1f62fb9ea70e-null]
  59. 2013-08-21 16:05:23,948 DEBUG [network.element.BigSwitchVnsElement] (Job-Executor-1:job-1) Checking if BigSwitchVnsElement can handle service Connectivity on network null
  60. 2013-08-21 16:05:23,948 DEBUG [cloud.network.NetworkManagerImpl] (Job-Executor-1:job-1) Asking VirtualRouter to release Nic[10-4-9758c809-f094-41a3-a938-1f62fb9ea70e-null]
  61. 2013-08-21 16:05:23,948 DEBUG [cloud.network.NetworkManagerImpl] (Job-Executor-1:job-1) Asking Ovs to release Nic[10-4-9758c809-f094-41a3-a938-1f62fb9ea70e-null]
  62. 2013-08-21 16:05:23,948 DEBUG [cloud.network.NetworkManagerImpl] (Job-Executor-1:job-1) Asking SecurityGroupProvider to release Nic[10-4-9758c809-f094-41a3-a938-1f62fb9ea70e-null]
  63. 2013-08-21 16:05:23,948 DEBUG [cloud.network.NetworkManagerImpl] (Job-Executor-1:job-1) Asking VpcVirtualRouter to release Nic[10-4-9758c809-f094-41a3-a938-1f62fb9ea70e-null]
  64. 2013-08-21 16:05:23,948 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-1:job-1) Successfully released network resources for the vm VM[DomainRouter|r-4-VM]
  65. 2013-08-21 16:05:23,949 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-1:job-1) Successfully cleanued up resources for the vm VM[DomainRouter|r-4-VM] in Starting state
  66. 2013-08-21 16:05:24,020 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-1:job-1) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: 1
  67. 2013-08-21 16:05:24,028 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-1:job-1) Hosts's actual total CPU: 18088 and CPU after applying overprovisioning: 18088
  68. 2013-08-21 16:05:24,028 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-1:job-1) release cpu from host: 1, old used: 1500,reserved: 0, actual total: 18088, total with overprovisioning: 18088; new used: 1000,reserved:0; movedfromreserved: false,moveToReserveredfalse
  69. 2013-08-21 16:05:24,028 DEBUG [cloud.capacity.CapacityManagerImpl] (Job-Executor-1:job-1) release mem from host: 1, old used: 1476395008,reserved: 0, total: 132245701056; new used: 1342177280,reserved:0; movedfromreserved: false,moveToReserveredfalse
  70. 2013-08-21 16:05:24,110 ERROR [cloud.async.AsyncJobManagerImpl] (Job-Executor-1:job-1) Unexpected exception while executing org.apache.cloudstack.api.command.admin.router.StartRouterCmd
  71. com.cloud.exception.AgentUnavailableException: Resource [Host:1] is unreachable: Host 1: Unable to start instance due to Unable to start VM[DomainRouter|r-4-VM] due to error in finalizeStart, not retrying
  72. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:841)
  73. at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:471)
  74. at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.start(VirtualNetworkApplianceManagerImpl.java:2616)
  75. at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.startVirtualRouter(VirtualNetworkApplianceManagerImpl.java:1824)
  76. at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.startRouter(VirtualNetworkApplianceManagerImpl.java:2874)
  77. at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.startRouter(VirtualNetworkApplianceManagerImpl.java:2824)
  78. at com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
  79. at org.apache.cloudstack.api.command.admin.router.StartRouterCmd.execute(StartRouterCmd.java:103)
  80. at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:162)
  81. at com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:437)
  82. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  83. at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
  84. at java.util.concurrent.FutureTask.run(FutureTask.java:166)
  85. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
  86. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  87. at java.lang.Thread.run(Thread.java:679)
  88. Caused by: com.cloud.utils.exception.ExecutionException: Unable to start VM[DomainRouter|r-4-VM] due to error in finalizeStart, not retrying
  89. at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:808)
  90. ... 19 more
  91. 2013-08-21 16:05:24,111 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-1:job-1) Complete async job-1, jobStatus: 2, resultCode: 530, result: Error Code: 530 Error text: Resource [Host:1] is unreachable: Host 1: Unable to start instance due to Unable to start VM[DomainRouter|r-4-VM] due to error in finalizeStart, not retrying
  92. 2013-08-21 16:05:24,842 DEBUG [cloud.api.ApiServlet] (catalina-exec-22:null) ===START=== <next IP Address> -- GET command=queryAsyncJobResult&jobId=d01f5602-770a-4c19-a259-b732fcded54d&response=json&sessionkey=yKlWrKiGzXmCxku6A7HnB3H1oTk%3D&_=1377122774994
  93. 2013-08-21 16:05:24,862 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-22:null) Async job-1 completed
  94. 2013-08-21 16:05:24,872 DEBUG [cloud.api.ApiServlet] (catalina-exec-22:null) ===END=== <next IP Address> -- GET command=queryAsyncJobResult&jobId=d01f5602-770a-4c19-a259-b732fcded54d&response=json&sessionkey=yKlWrKiGzXmCxku6A7HnB3H1oTk%3D&_=1377122774994
Advertisement
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!