Advertisement
Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- 2016-05-30 07:51:42,427 DEBUG [tomcat-http--7] [c.h.a.s.s.s.i.NodeManagerInnerService:3039] Hostname is: poolr-594702427. Name is poolr-1464594702427
- 2016-05-30 07:51:42,510 DEBUG [tomcat-http--7] [c.h.s.SSHClient:141] connect to [192.168.11.125] using password
- 2016-05-30 07:51:42,565 DEBUG [tomcat-http--7] [c.h.s.SSHClient:114] Connected in [137]
- 2016-05-30 07:51:42,609 DEBUG [tomcat-http--7] [c.h.s.SSHClient:373] [ ! -f '/etc/sysconfig/vz-scripts/ve-jelastic.conf-sample' ] || [ `md5sum '/etc/sysconfig/vz-scripts/ve-jelastic.conf-sample' | awk '{print $1}'` != '1091b1dc1f2be05a0700dc61814364e3' ] && wget -q -O '/etc/sysconfig/vz-scripts/ve-jelastic.conf-sample' 'http://1c57d83a4c5f3a21ec25c050d4c5e37b.app.jelastic.com/xssu/cross/download/RDYYHARgAFEOVgtPNQw7EUJBDRRUSxVKD0FsHn0kJgJDF0ZXDwIBQmNTTEBI';
- 2016-05-30 07:51:42,764 DEBUG [tomcat-http--7] [c.h.s.SSHClient:400] Exit status: 127
- 2016-05-30 07:51:42,766 DEBUG [tomcat-http--7] [c.h.s.SSHClient:411] Stderr : bash: wget: command not found
- 2016-05-30 07:51:42,767 DEBUG [tomcat-http--7] [c.h.s.SSHClient:453] Operation [[ ! -f '/etc/sysconfig/vz-scripts/ve-jelastic.conf-sample' ] || [ `md5sum '/etc/sysconfig/vz-scripts/ve-jelastic.conf-sample' | awk '{print $1}'` != '1091b1dc1f2be05a0700dc61814364e3' ] && wget -q -O '/etc/sysconfig/vz-scripts/ve-jelastic.conf-sample' 'http://1c57d83a4c5f3a21ec25c050d4c5e37b.app.jelastic.com/xssu/cross/download/RDYYHARgAFEOVgtPNQw7EUJBDRRUSxVKD0FsHn0kJgJDF0ZXDwIBQmNTTEBI';
- ] completed in [339]
- 2016-05-30 07:51:42,787 DEBUG [tomcat-http--7] [c.h.a.s.c.a.EndPointProxy:159] ----login to [http://192.168.11.125:8080]
- 2016-05-30 07:51:43,738 DEBUG [tomcat-http--7] [c.h.a.s.s.s.i.NodeManagerInnerService:3054] OS: windows_2012_dc, config: exchange-2007
- 2016-05-30 07:51:43,740 DEBUG [tomcat-http--7] [c.h.a.s.s.s.i.NodeManagerInnerService:3055] creating MSSQL 2012 node on windows2012-1 hardnode from RPMs
- 2016-05-30 07:51:53,082 DEBUG [tomcat-http--18] [c.h.a.s.s.s.i.IpPoolManagerInnerService:182] --ip address[192.168.13.67] released: true
- 2016-05-30 07:53:14,670 DEBUG [tomcat-http--7] [c.h.a.s.c.a.EndPointProxy:222] setLock:02dabf81-e1f4-431d-80e7-5aea08230706_ct_lock_lock, status: OK
- 2016-05-30 07:53:14,672 DEBUG [tomcat-http--7] [c.h.a.s.c.a.EndPointProxy:95] no existing lock. set lock for invoke. container #02dabf81-e1f4-431d-80e7-5aea08230706
- 2016-05-30 07:53:14,688 DEBUG [tomcat-http--7] [c.h.a.s.c.a.EndPointProxy:159] ----login to [http://192.168.11.125:8080]
- 2016-05-30 07:53:16,943 DEBUG [tomcat-http--7] [c.h.a.s.c.a.EndPointProxy:102] invoke already finished. release lock. container #02dabf81-e1f4-431d-80e7-5aea08230706
- 2016-05-30 07:53:16,946 DEBUG [tomcat-http--7] [c.h.a.s.c.a.EndPointProxy:237] releaseLock:02dabf81-e1f4-431d-80e7-5aea08230706_ct_lock_lock, status: OK
- 2016-05-30 07:53:16,977 DEBUG [tomcat-http--7] [c.h.a.s.s.s.i.NodeManagerInnerService:3182] starting container...
- 2016-05-30 07:53:16,979 DEBUG [tomcat-http--7] [c.h.a.s.c.a.EndPointProxy:222] setLock:02dabf81-e1f4-431d-80e7-5aea08230706_ct_lock_lock, status: OK
- 2016-05-30 07:53:16,980 DEBUG [tomcat-http--7] [c.h.a.s.c.a.EndPointProxy:95] no existing lock. set lock for invoke. container #02dabf81-e1f4-431d-80e7-5aea08230706
- 2016-05-30 08:23:16,974 ERROR [tomcat-http--7] [c.h.a.s.c.a.EndPointProxy:193] Exception in node manager.
- 2016-05-30 08:23:16,975 ERROR [tomcat-http--7] [c.h.a.s.c.a.EndPointProxy:194] method:[start] exc: Message processing was terminated because timeout was reached waiting for a response
- 2016-05-30 08:23:16,975 ERROR [tomcat-http--7] [c.h.a.s.c.a.EndPointProxy:195] args:[02dabf81-e1f4-431d-80e7-5aea08230706]
- 2016-05-30 08:23:16,976 ERROR [tomcat-http--7] [c.h.a.s.c.a.EndPointProxy:196] -----debug---
- ----------not invocation
- entry=[ns1:error: null]
- node=[ns1:error: null]
- ========= error string=[307]
- node=[ns1:error: null]
- ========= error string=[Message processing was terminated because timeout was reached waiting for a response]
- node=[ns1:error: null]
- ========= error string=[
- ]
- fault string=
- -----debug---
- cause=null
- 2016-05-30 08:23:16,976 DEBUG [tomcat-http--7] [c.h.a.s.c.a.EndPointProxy:102] invoke already finished. release lock. container #02dabf81-e1f4-431d-80e7-5aea08230706
- 2016-05-30 08:23:16,978 DEBUG [tomcat-http--7] [c.h.a.s.c.a.EndPointProxy:237] releaseLock:02dabf81-e1f4-431d-80e7-5aea08230706_ct_lock_lock, status: OK
- 2016-05-30 08:23:16,979 DEBUG [tomcat-http--7] [c.h.a.s.s.s.i.NodeManagerInnerService:502] ---delete node from hd...02dabf81-e1f4-431d-80e7-5aea08230706@http://192.168.11.125:8080
- 2016-05-30 08:23:16,987 ERROR [tomcat-http--7] [c.h.a.s.c.s.CommonServiceProxyWithRemoteAPI:105] Error occurred during invoke method:
- java.lang.RuntimeException: javax.xml.ws.soap.SOAPFaultException: VZAgent responded with error
- at com.hivext.api.server.system.service.inner.NodeManagerInnerService.createTemplate(NodeManagerInnerService.java:2826) ~[jelastic-common-services-4.6.2.jar:4.6.2]
- at com.hivext.api.server.system.service.inner.NodeManagerInnerService.createTemplate(NodeManagerInnerService.java:2663) ~[jelastic-common-services-4.6.2.jar:4.6.2]
- at com.hivext.api.server.system.service.inner.NodeManagerInnerService$$FastClassByCGLIB$$647e9c3c.invoke(<generated>) ~[cglib-2.2.2.jar:4.6.2]
- at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204) ~[cglib-2.2.2.jar:na]
- at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:618) ~[spring-aop-3.1.0.RELEASE.jar:3.1.0.RELEASE]
- at com.hivext.api.server.system.service.inner.NodeManagerInnerService$$EnhancerByCGLIB$$b0504d75.createTemplate(<generated>) ~[cglib-2.2.2.jar:4.6.2]
- at com.hivext.api.server.system.service.inner.HardNodePoolManager.recycleTemplate(HardNodePoolManager.java:107) ~[HardNodePoolManager.class:4.6.2]
- at com.hivext.api.server.system.service.inner.HardNodePoolManager.getFromPool(HardNodePoolManager.java:91) ~[HardNodePoolManager.class:4.6.2]
- at com.hivext.api.server.system.service.inner.HardNodePoolManager.getFromPool(HardNodePoolManager.java:70) ~[HardNodePoolManager.class:4.6.2]
- at com.hivext.api.server.system.service.inner.PoolesManagerInnerService.getFromPool(PoolesManagerInnerService.java:81) ~[PoolesManagerInnerService.class:4.6.2]
- at com.hivext.api.server.pool.service.NodePoolService.Get(NodePoolService.java:53) ~[NodePoolService.class:na]
- at com.hivext.api.server.pool.service.NodePoolService$$FastClassByCGLIB$$2ab485ee.invoke(<generated>) ~[cglib-2.2.2.jar:na]
- at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204) ~[cglib-2.2.2.jar:na]
- at org.springframework.aop.framework.Cglib2AopProxy$CglibMethodInvocation.invokeJoinpoint(Cglib2AopProxy.java:689) ~[spring-aop-3.1.0.RELEASE.jar:3.1.0.RELEASE]
- at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150) ~[spring-aop-3.1.0.RELEASE.jar:3.1.0.RELEASE]
- at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:80) ~[spring-aop-3.1.0.RELEASE.jar:3.1.0.RELEASE]
- at com.hivext.monitoring.collector.ServicesAuditorAspect.auditMethod(ServicesAuditorAspect.java:51) ~[jmonitoring-collector-4.6.2.jar:4.6.2]
- at sun.reflect.GeneratedMethodAccessor57.invoke(Unknown Source) ~[na:na]
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.7.0_40]
- at java.lang.reflect.Method.invoke(Method.java:606) ~[na:1.7.0_40]
- at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:621) ~[spring-aop-3.1.0.RELEASE.jar:3.1.0.RELEASE]
- at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:610) ~[spring-aop-3.1.0.RELEASE.jar:3.1.0.RELEASE]
- at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:65) ~[spring-aop-3.1.0.RELEASE.jar:3.1.0.RELEASE]
- at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161) ~[spring-aop-3.1.0.RELEASE.jar:3.1.0.RELEASE]
- at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:90) ~[spring-aop-3.1.0.RELEASE.jar:3.1.0.RELEASE]
- at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) ~[spring-aop-3.1.0.RELEASE.jar:3.1.0.RELEASE]
- at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:622) ~[spring-aop-3.1.0.RELEASE.jar:3.1.0.RELEASE]
- at com.hivext.api.server.pool.service.NodePoolService$$EnhancerByCGLIB$$b3fbdd0b.Get(<generated>) ~[cglib-2.2.2.jar:na]
- at sun.reflect.GeneratedMethodAccessor132.invoke(Unknown Source) ~[na:na]
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.7.0_40]
- at java.lang.reflect.Method.invoke(Method.java:606) ~[na:1.7.0_40]
- at com.hivext.api.server.core.service.SimpleServiceProxy.invokeMethod(SimpleServiceProxy.java:94) [hivext-general-classes-4.6.2.jar:na]
- at com.hivext.api.server.core.service.CommonServiceProxyWithRemoteAPI.invokeMethod(CommonServiceProxyWithRemoteAPI.java:99) ~[CommonServiceProxyWithRemoteAPI.class:na]
- at com.hivext.api.server.core.service.SimpleServiceProxy.invoke(SimpleServiceProxy.java:67) [hivext-general-classes-4.6.2.jar:na]
- at com.sun.proxy.$Proxy77.Get(Unknown Source) [na:na]
- at com.hivext.api.server.core.controller.pool.NodePoolServiceController.Get(NodePoolServiceController.java) [NodePoolServiceController.class:na]
- at sun.reflect.GeneratedMethodAccessor131.invoke(Unknown Source) ~[na:na]
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.7.0_40]
- at java.lang.reflect.Method.invoke(Method.java:606) ~[na:1.7.0_40]
- at org.springframework.web.bind.annotation.support.HandlerMethodInvoker.invokeHandlerMethod(HandlerMethodInvoker.java:176) [spring-web-3.1.0.RELEASE.jar:3.1.0.RELEASE]
- at org.springframework.web.servlet.mvc.annotation.AnnotationMethodHandlerAdapter.invokeHandlerMethod(AnnotationMethodHandlerAdapter.java:436) [spring-webmvc-3.1.0.RELEASE.jar:3.1.0.RELEASE]
- at org.springframework.web.servlet.mvc.annotation.AnnotationMethodHandlerAdapter.handle(AnnotationMethodHandlerAdapter.java:424) [spring-webmvc-3.1.0.RELEASE.jar:3.1.0.RELEASE]
- at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:900) [spring-webmvc-3.1.0.RELEASE.jar:3.1.0.RELEASE]
- at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:827) [spring-webmvc-3.1.0.RELEASE.jar:3.1.0.RELEASE]
- at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882) [spring-webmvc-3.1.0.RELEASE.jar:3.1.0.RELEASE]
- at org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:778) [spring-webmvc-3.1.0.RELEASE.jar:3.1.0.RELEASE]
- at javax.servlet.http.HttpServlet.service(HttpServlet.java:617) [servlet-api.jar:na]
- at javax.servlet.http.HttpServlet.service(HttpServlet.java:717) [servlet-api.jar:na]
- at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) [catalina.jar:6.0.29.C]
- at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) [catalina.jar:6.0.29.C]
- at net.bull.javamelody.MonitoringFilter.doFilter(MonitoringFilter.java:197) [javamelody-core-1.37.0.jar:1.37.0]
- at net.bull.javamelody.MonitoringFilter.doFilter(MonitoringFilter.java:171) [javamelody-core-1.37.0.jar:1.37.0]
- at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) [catalina.jar:6.0.29.C]
- at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) [catalina.jar:6.0.29.C]
- at com.hivext.api.server.core.filter.CaseInsensitiveRequestFilter.doFilterInternal(CaseInsensitiveRequestFilter.java:25) [hivext-general-classes-4.6.2.jar:4.6.2]
- at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:76) [spring-web-3.1.0.RELEASE.jar:3.1.0.RELEASE]
- at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) [catalina.jar:6.0.29.C]
- at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) [catalina.jar:6.0.29.C]
- at com.hivext.api.server.core.filter.CrossRequestFilter.doFilter(CrossRequestFilter.java:85) [hivext-general-classes-4.6.2.jar:4.6.2]
- at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) [catalina.jar:6.0.29.C]
- at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) [catalina.jar:6.0.29.C]
- at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) [catalina.jar:6.0.29.C]
- at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) [catalina.jar:6.0.29.C]
- at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:470) [catalina.jar:6.0.29.C]
- at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) [catalina.jar:6.0.29.C]
- at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) [catalina.jar:6.0.29.C]
- at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) [catalina.jar:6.0.29.C]
- at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298) [catalina.jar:6.0.29.C]
- at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857) [tomcat-coyote.jar:6.0.29.C]
- at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588) [tomcat-coyote.jar:6.0.29.C]
- at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:409) [tomcat-coyote.jar:6.0.29.C]
- at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1115) [na:na]
- at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:586) [na:na]
- at java.lang.Thread.run(Thread.java:724) [na:1.7.0_40]
- Caused by: javax.xml.ws.soap.SOAPFaultException: VZAgent responded with error
- at com.sun.xml.ws.fault.SOAP11Fault.getProtocolException(SOAP11Fault.java:189) ~[webservices-rt-2.1-b16.jar:2.1-b16]
- at com.sun.xml.ws.fault.SOAPFaultBuilder.createException(SOAPFaultBuilder.java:130) ~[webservices-rt-2.1-b16.jar:2.1-b16]
- at com.sun.xml.ws.client.sei.SyncMethodHandler.invoke(SyncMethodHandler.java:119) ~[webservices-rt-2.1-b16.jar:2.1-b16]
- at com.sun.xml.ws.client.sei.SyncMethodHandler.invoke(SyncMethodHandler.java:89) ~[webservices-rt-2.1-b16.jar:2.1-b16]
- at com.sun.xml.ws.client.sei.SEIStub.invoke(SEIStub.java:140) ~[webservices-rt-2.1-b16.jar:2.1-b16]
- at com.sun.proxy.$Proxy116.start(Unknown Source) ~[na:na]
- at sun.reflect.GeneratedMethodAccessor137.invoke(Unknown Source) ~[na:na]
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.7.0_40]
- at java.lang.reflect.Method.invoke(Method.java:606) ~[na:1.7.0_40]
- at com.hivext.api.system.containermanager.adapter.EndPointProxy.attemptToInvoke(EndPointProxy.java:129) ~[jnode-manager-4.6.2.jar:4.6.2]
- at com.hivext.api.system.containermanager.adapter.EndPointProxy.invoke(EndPointProxy.java:98) ~[jnode-manager-4.6.2.jar:4.6.2]
- at com.sun.proxy.$Proxy116.start(Unknown Source) ~[na:na]
- at com.hivext.api.system.containermanager.adapter.VZAEnvmServiceAdapter.startContainer(VZAEnvmServiceAdapter.java:71) ~[jnode-manager-4.6.2.jar:4.6.2]
- at com.hivext.api.server.system.service.inner.NodeManagerInnerService.startContainer(NodeManagerInnerService.java:3183) ~[jelastic-common-services-4.6.2.jar:4.6.2]
- at com.hivext.api.server.system.service.inner.NodeManagerInnerService.createTemplate(NodeManagerInnerService.java:2689) ~[jelastic-common-services-4.6.2.jar:4.6.2]
- ... 73 common frames omitted
- 2016-05-30 08:23:16,992 ERROR [tomcat-http--7] [c.h.a.s.c.s.SimpleServiceProxy:70]
- java.lang.RuntimeException: javax.xml.ws.soap.SOAPFaultException: VZAgent responded with error
- at com.hivext.api.server.system.service.inner.NodeManagerInnerService.createTemplate(NodeManagerInnerService.java:2826) ~[jelastic-common-services-4.6.2.jar:4.6.2]
- at com.hivext.api.server.system.service.inner.NodeManagerInnerService.createTemplate(NodeManagerInnerService.java:2663) ~[jelastic-common-services-4.6.2.jar:4.6.2]
- at com.hivext.api.server.system.service.inner.NodeManagerInnerService$$FastClassByCGLIB$$647e9c3c.invoke(<generated>) ~[cglib-2.2.2.jar:4.6.2]
- at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204) ~[cglib-2.2.2.jar:na]
- at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:618) ~[spring-aop-3.1.0.RELEASE.jar:3.1.0.RELEASE]
- at com.hivext.api.server.system.service.inner.NodeManagerInnerService$$EnhancerByCGLIB$$b0504d75.createTemplate(<generated>) ~[cglib-2.2.2.jar:4.6.2]
- at com.hivext.api.server.system.service.inner.HardNodePoolManager.recycleTemplate(HardNodePoolManager.java:107) ~[HardNodePoolManager.class:4.6.2]
- at com.hivext.api.server.system.service.inner.HardNodePoolManager.getFromPool(HardNodePoolManager.java:91) ~[HardNodePoolManager.class:4.6.2]
- at com.hivext.api.server.system.service.inner.HardNodePoolManager.getFromPool(HardNodePoolManager.java:70) ~[HardNodePoolManager.class:4.6.2]
- at com.hivext.api.server.system.service.inner.PoolesManagerInnerService.getFromPool(PoolesManagerInnerService.java:81) ~[PoolesManagerInnerService.class:4.6.2]
- at com.hivext.api.server.pool.service.NodePoolService.Get(NodePoolService.java:53) ~[NodePoolService.class:na]
- at com.hivext.api.server.pool.service.NodePoolService$$FastClassByCGLIB$$2ab485ee.invoke(<generated>) ~[cglib-2.2.2.jar:na]
- at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204) ~[cglib-2.2.2.jar:na]
- at org.springframework.aop.framework.Cglib2AopProxy$CglibMethodInvocation.invokeJoinpoint(Cglib2AopProxy.java:689) ~[spring-aop-3.1.0.RELEASE.jar:3.1.0.RELEASE]
- at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150) ~[spring-aop-3.1.0.RELEASE.jar:3.1.0.RELEASE]
- at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:80) ~[spring-aop-3.1.0.RELEASE.jar:3.1.0.RELEASE]
- at com.hivext.monitoring.collector.ServicesAuditorAspect.auditMethod(ServicesAuditorAspect.java:51) ~[jmonitoring-collector-4.6.2.jar:4.6.2]
- at sun.reflect.GeneratedMethodAccessor57.invoke(Unknown Source) ~[na:na]
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.7.0_40]
- at java.lang.reflect.Method.invoke(Method.java:606) ~[na:1.7.0_40]
- at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:621) ~[spring-aop-3.1.0.RELEASE.jar:3.1.0.RELEASE]
- at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:610) ~[spring-aop-3.1.0.RELEASE.jar:3.1.0.RELEASE]
- at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:65) ~[spring-aop-3.1.0.RELEASE.jar:3.1.0.RELEASE]
- at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161) ~[spring-aop-3.1.0.RELEASE.jar:3.1.0.RELEASE]
- at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:90) ~[spring-aop-3.1.0.RELEASE.jar:3.1.0.RELEASE]
- at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) ~[spring-aop-3.1.0.RELEASE.jar:3.1.0.RELEASE]
- at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:622) ~[spring-aop-3.1.0.RELEASE.jar:3.1.0.RELEASE]
- at com.hivext.api.server.pool.service.NodePoolService$$EnhancerByCGLIB$$b3fbdd0b.Get(<generated>) ~[cglib-2.2.2.jar:na]
- at sun.reflect.GeneratedMethodAccessor132.invoke(Unknown Source) ~[na:na]
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.7.0_40]
- at java.lang.reflect.Method.invoke(Method.java:606) ~[na:1.7.0_40]
- at com.hivext.api.server.core.service.SimpleServiceProxy.invokeMethod(SimpleServiceProxy.java:94) ~[hivext-general-classes-4.6.2.jar:na]
- at com.hivext.api.server.core.service.CommonServiceProxyWithRemoteAPI.invokeMethod(CommonServiceProxyWithRemoteAPI.java:99) ~[CommonServiceProxyWithRemoteAPI.class:na]
- at com.hivext.api.server.core.service.SimpleServiceProxy.invoke(SimpleServiceProxy.java:67) ~[hivext-general-classes-4.6.2.jar:na]
- at com.sun.proxy.$Proxy77.Get(Unknown Source) [na:na]
- at com.hivext.api.server.core.controller.pool.NodePoolServiceController.Get(NodePoolServiceController.java) [NodePoolServiceController.class:na]
- at sun.reflect.GeneratedMethodAccessor131.invoke(Unknown Source) ~[na:na]
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.7.0_40]
- at java.lang.reflect.Method.invoke(Method.java:606) ~[na:1.7.0_40]
- at org.springframework.web.bind.annotation.support.HandlerMethodInvoker.invokeHandlerMethod(HandlerMethodInvoker.java:176) [spring-web-3.1.0.RELEASE.jar:3.1.0.RELEASE]
- at org.springframework.web.servlet.mvc.annotation.AnnotationMethodHandlerAdapter.invokeHandlerMethod(AnnotationMethodHandlerAdapter.java:436) [spring-webmvc-3.1.0.RELEASE.jar:3.1.0.RELEASE]
- at org.springframework.web.servlet.mvc.annotation.AnnotationMethodHandlerAdapter.handle(AnnotationMethodHandlerAdapter.java:424) [spring-webmvc-3.1.0.RELEASE.jar:3.1.0.RELEASE]
- at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:900) [spring-webmvc-3.1.0.RELEASE.jar:3.1.0.RELEASE]
- at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:827) [spring-webmvc-3.1.0.RELEASE.jar:3.1.0.RELEASE]
- at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882) [spring-webmvc-3.1.0.RELEASE.jar:3.1.0.RELEASE]
- at org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:778) [spring-webmvc-3.1.0.RELEASE.jar:3.1.0.RELEASE]
- at javax.servlet.http.HttpServlet.service(HttpServlet.java:617) [servlet-api.jar:na]
- at javax.servlet.http.HttpServlet.service(HttpServlet.java:717) [servlet-api.jar:na]
- at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) [catalina.jar:6.0.29.C]
- at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) [catalina.jar:6.0.29.C]
- at net.bull.javamelody.MonitoringFilter.doFilter(MonitoringFilter.java:197) [javamelody-core-1.37.0.jar:1.37.0]
- at net.bull.javamelody.MonitoringFilter.doFilter(MonitoringFilter.java:171) [javamelody-core-1.37.0.jar:1.37.0]
- at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) [catalina.jar:6.0.29.C]
- at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) [catalina.jar:6.0.29.C]
- at com.hivext.api.server.core.filter.CaseInsensitiveRequestFilter.doFilterInternal(CaseInsensitiveRequestFilter.java:25) [hivext-general-classes-4.6.2.jar:4.6.2]
- at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:76) [spring-web-3.1.0.RELEASE.jar:3.1.0.RELEASE]
- at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) [catalina.jar:6.0.29.C]
- at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) [catalina.jar:6.0.29.C]
- at com.hivext.api.server.core.filter.CrossRequestFilter.doFilter(CrossRequestFilter.java:85) [hivext-general-classes-4.6.2.jar:4.6.2]
- at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) [catalina.jar:6.0.29.C]
- at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) [catalina.jar:6.0.29.C]
- at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) [catalina.jar:6.0.29.C]
- at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) [catalina.jar:6.0.29.C]
- at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:470) [catalina.jar:6.0.29.C]
- at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) [catalina.jar:6.0.29.C]
- at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) [catalina.jar:6.0.29.C]
- at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) [catalina.jar:6.0.29.C]
- at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298) [catalina.jar:6.0.29.C]
- at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857) [tomcat-coyote.jar:6.0.29.C]
- at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588) [tomcat-coyote.jar:6.0.29.C]
- at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:409) [tomcat-coyote.jar:6.0.29.C]
- at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1115) [na:na]
- at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:586) [na:na]
- at java.lang.Thread.run(Thread.java:724) [na:1.7.0_40]
- Caused by: javax.xml.ws.soap.SOAPFaultException: VZAgent responded with error
- at com.sun.xml.ws.fault.SOAP11Fault.getProtocolException(SOAP11Fault.java:189) ~[webservices-rt-2.1-b16.jar:2.1-b16]
- at com.sun.xml.ws.fault.SOAPFaultBuilder.createException(SOAPFaultBuilder.java:130) ~[webservices-rt-2.1-b16.jar:2.1-b16]
- at com.sun.xml.ws.client.sei.SyncMethodHandler.invoke(SyncMethodHandler.java:119) ~[webservices-rt-2.1-b16.jar:2.1-b16]
- at com.sun.xml.ws.client.sei.SyncMethodHandler.invoke(SyncMethodHandler.java:89) ~[webservices-rt-2.1-b16.jar:2.1-b16]
- at com.sun.xml.ws.client.sei.SEIStub.invoke(SEIStub.java:140) ~[webservices-rt-2.1-b16.jar:2.1-b16]
- at com.sun.proxy.$Proxy116.start(Unknown Source) ~[na:na]
- at sun.reflect.GeneratedMethodAccessor137.invoke(Unknown Source) ~[na:na]
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.7.0_40]
- at java.lang.reflect.Method.invoke(Method.java:606) ~[na:1.7.0_40]
- at com.hivext.api.system.containermanager.adapter.EndPointProxy.attemptToInvoke(EndPointProxy.java:129) ~[jnode-manager-4.6.2.jar:4.6.2]
- at com.hivext.api.system.containermanager.adapter.EndPointProxy.invoke(EndPointProxy.java:98) ~[jnode-manager-4.6.2.jar:4.6.2]
- at com.sun.proxy.$Proxy116.start(Unknown Source) ~[na:na]
- at com.hivext.api.system.containermanager.adapter.VZAEnvmServiceAdapter.startContainer(VZAEnvmServiceAdapter.java:71) ~[jnode-manager-4.6.2.jar:4.6.2]
- at com.hivext.api.server.system.service.inner.NodeManagerInnerService.startContainer(NodeManagerInnerService.java:3183) ~[jelastic-common-services-4.6.2.jar:4.6.2]
- at com.hivext.api.server.system.service.inner.NodeManagerInnerService.createTemplate(NodeManagerInnerService.java:2689) ~[jelastic-common-services-4.6.2.jar:4.6.2]
- ... 73 common frames omitted
- 2016-05-30 08:23:17,001 DEBUG [pool-4-thread-64] [c.h.a.s.c.a.EndPointProxy:159] ----login to [http://192.168.11.125:8080]
- 2016-05-30 08:23:17,308 DEBUG [tomcat-http--7] [c.h.a.s.s.s.i.IpPoolManagerInnerService:182] --ip address[192.168.13.69] released: true
- 2016-05-30 08:23:19,457 DEBUG [tomcat-http--7] [c.h.a.s.p.s.IpPoolService:48] Selected IP: 192.168.13.68 : true
- 2016-05-30 08:23:19,493 DEBUG [tomcat-http--7] [c.h.a.s.p.s.NodePoolService:35] try to get mssql instance from [49] hn
- 2016-05-30 08:23:19,556 DEBUG [tomcat-http--7] [c.h.a.s.c.a.EndPointProxy:159] ----login to [http://192.168.11.165:8080]
- 2016-05-30 08:23:19,637 DEBUG [pool-4-thread-64] [c.h.a.s.s.s.i.NodeManagerInnerService:528] ---stop container : 02dabf81-e1f4-431d-80e7-5aea08230706
- 2016-05-30 08:23:19,638 DEBUG [pool-4-thread-64] [c.h.a.s.c.a.EndPointProxy:222] setLock:02dabf81-e1f4-431d-80e7-5aea08230706_ct_lock_lock, status: OK
- 2016-05-30 08:23:19,639 DEBUG [pool-4-thread-64] [c.h.a.s.c.a.EndPointProxy:95] no existing lock. set lock for invoke. container #02dabf81-e1f4-431d-80e7-5aea08230706
- 2016-05-30 08:23:20,221 DEBUG [tomcat-http--7] [c.h.a.s.s.s.i.HardNodePoolManager:322] Calculation nodes count... mssql
- 2016-05-30 08:23:20,222 DEBUG [tomcat-http--7] [c.h.a.s.s.s.i.HardNodePoolManager:328] Collection is not empty size is: 2 mssql
- 2016-05-30 08:23:20,223 DEBUG [Thread-38606] [c.h.a.s.s.s.i.u.NodeGenerator:52] --try to get access by thread=[Thread[Thread-38606,5,main]] from ***HardNode*** semaphore
- 2016-05-30 08:23:20,224 DEBUG [Thread-38606] [c.h.a.s.s.s.i.u.NodeGenerator:58] --try to get access by thread=[Thread[Thread-38606,5,main]] from ###PoolType### semaphore
- 2016-05-30 08:23:20,225 DEBUG [Thread-38606] [c.h.a.s.s.s.i.u.NodeGenerator:63] --access is allowed for thread=[Thread[Thread-38606,5,main]]
- 2016-05-30 08:23:20,254 INFO [Thread-38606] [c.h.a.s.s.s.i.NodeManagerInnerService:699] Hardnode windows2012-5. Starting offline cloning
- 2016-05-30 08:23:20,255 DEBUG [Thread-38606] [c.h.a.s.c.a.EndPointProxy:222] setLock:e7c415db-bc3d-4dad-bfd5-a584ada903cc_ct_lock_lock, status: OK
- 2016-05-30 08:23:20,256 DEBUG [Thread-38606] [c.h.a.s.c.a.EndPointProxy:95] no existing lock. set lock for invoke. container #e7c415db-bc3d-4dad-bfd5-a584ada903cc
- 2016-05-30 08:23:24,671 ERROR [pool-4-thread-64] [c.h.a.s.c.a.EndPointProxy:193] Exception in node manager.
- 2016-05-30 08:23:24,672 ERROR [pool-4-thread-64] [c.h.a.s.c.a.EndPointProxy:194] method:[stop] exc: Error invoking external utility:
- ERROR:Container 26238 is already locked
- 2016-05-30 08:23:24,672 ERROR [pool-4-thread-64] [c.h.a.s.c.a.EndPointProxy:195] args:[02dabf81-e1f4-431d-80e7-5aea08230706,]
- 2016-05-30 08:23:24,672 ERROR [pool-4-thread-64] [c.h.a.s.c.a.EndPointProxy:196] -----debug---
- ----------not invocation
- entry=[ns1:error: null]
- node=[ns1:error: null]
- ========= error string=[3802]
- node=[ns1:error: null]
- ========= error string=[Error invoking external utility:
- ERROR:Container 26238 is already locked
- ]
- node=[ns1:error: null]
- ========= error string=[
- ]
- fault string=
- -----debug---
- cause=null
- 2016-05-30 08:23:24,673 DEBUG [pool-4-thread-64] [c.h.a.s.c.a.EndPointProxy:102] invoke already finished. release lock. container #02dabf81-e1f4-431d-80e7-5aea08230706
- 2016-05-30 08:23:24,675 DEBUG [pool-4-thread-64] [c.h.a.s.c.a.EndPointProxy:237] releaseLock:02dabf81-e1f4-431d-80e7-5aea08230706_ct_lock_lock, status: OK
- 2016-05-30 08:23:24,677 ERROR [pool-4-thread-64] [c.h.a.s.s.s.i.NodeManagerInnerService:540] Container default not destroy
- javax.xml.ws.soap.SOAPFaultException: VZAgent responded with error
- at com.sun.xml.ws.fault.SOAP11Fault.getProtocolException(SOAP11Fault.java:189) ~[webservices-rt-2.1-b16.jar:2.1-b16]
- at com.sun.xml.ws.fault.SOAPFaultBuilder.createException(SOAPFaultBuilder.java:130) ~[webservices-rt-2.1-b16.jar:2.1-b16]
- at com.sun.xml.ws.client.sei.SyncMethodHandler.invoke(SyncMethodHandler.java:119) ~[webservices-rt-2.1-b16.jar:2.1-b16]
- at com.sun.xml.ws.client.sei.SyncMethodHandler.invoke(SyncMethodHandler.java:89) ~[webservices-rt-2.1-b16.jar:2.1-b16]
- at com.sun.xml.ws.client.sei.SEIStub.invoke(SEIStub.java:140) ~[webservices-rt-2.1-b16.jar:2.1-b16]
- at com.sun.proxy.$Proxy116.stop(Unknown Source) ~[na:na]
- at sun.reflect.GeneratedMethodAccessor140.invoke(Unknown Source) ~[na:na]
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.7.0_40]
- at java.lang.reflect.Method.invoke(Method.java:606) ~[na:1.7.0_40]
- at com.hivext.api.system.containermanager.adapter.EndPointProxy.attemptToInvoke(EndPointProxy.java:129) ~[jnode-manager-4.6.2.jar:4.6.2]
- at com.hivext.api.system.containermanager.adapter.EndPointProxy.invoke(EndPointProxy.java:98) ~[jnode-manager-4.6.2.jar:4.6.2]
- at com.sun.proxy.$Proxy116.stop(Unknown Source) ~[na:na]
- at com.hivext.api.system.containermanager.adapter.VZAEnvmServiceAdapter.stopContainer(VZAEnvmServiceAdapter.java:53) ~[jnode-manager-4.6.2.jar:4.6.2]
- at com.hivext.api.server.system.service.inner.NodeManagerInnerService$1.run(NodeManagerInnerService.java:529) ~[jelastic-common-services-4.6.2.jar:4.6.2]
- at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1115) [na:na]
- at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:586) [na:na]
- at java.lang.Thread.run(Thread.java:724) [na:1.7.0_40]
- 2016-05-30 08:23:24,732 ERROR [pool-4-thread-64] [c.h.a.s.s.s.i.NodeManagerInnerService:561] Container not destroy
- javax.xml.ws.soap.SOAPFaultException: VZAgent responded with error
- at com.sun.xml.ws.fault.SOAP11Fault.getProtocolException(SOAP11Fault.java:189) ~[webservices-rt-2.1-b16.jar:2.1-b16]
- at com.sun.xml.ws.fault.SOAPFaultBuilder.createException(SOAPFaultBuilder.java:130) ~[webservices-rt-2.1-b16.jar:2.1-b16]
- at com.sun.xml.ws.client.sei.SyncMethodHandler.invoke(SyncMethodHandler.java:119) ~[webservices-rt-2.1-b16.jar:2.1-b16]
- at com.sun.xml.ws.client.sei.SyncMethodHandler.invoke(SyncMethodHandler.java:89) ~[webservices-rt-2.1-b16.jar:2.1-b16]
- at com.sun.xml.ws.client.sei.SEIStub.invoke(SEIStub.java:140) ~[webservices-rt-2.1-b16.jar:2.1-b16]
- at com.sun.proxy.$Proxy116.stop(Unknown Source) ~[na:na]
- at sun.reflect.GeneratedMethodAccessor140.invoke(Unknown Source) ~[na:na]
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.7.0_40]
- at java.lang.reflect.Method.invoke(Method.java:606) ~[na:1.7.0_40]
- at com.hivext.api.system.containermanager.adapter.EndPointProxy.attemptToInvoke(EndPointProxy.java:129) ~[jnode-manager-4.6.2.jar:4.6.2]
- at com.hivext.api.system.containermanager.adapter.EndPointProxy.invoke(EndPointProxy.java:98) ~[jnode-manager-4.6.2.jar:4.6.2]
- at com.sun.proxy.$Proxy116.stop(Unknown Source) ~[na:na]
- at com.hivext.api.system.containermanager.adapter.VZAEnvmServiceAdapter.stopContainer(VZAEnvmServiceAdapter.java:53) ~[jnode-manager-4.6.2.jar:4.6.2]
- at com.hivext.api.server.system.service.inner.NodeManagerInnerService$1.run(NodeManagerInnerService.java:529) ~[jelastic-common-services-4.6.2.jar:4.6.2]
- at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1115) [na:na]
- at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:586) [na:na]
- at java.lang.Thread.run(Thread.java:724) [na:1.7.0_40]
- 2016-05-30 08:23:24,764 DEBUG [pool-4-thread-64] [c.h.a.s.c.u.e.EmailMultiPartSender:240] Email 'Container delete windows2012-1@192.168.11.125failed!' sent to engineering@eng.jelastic.com
- 2016-05-30 08:25:34,347 DEBUG [tomcat-http--39] [c.h.a.s.p.s.IpPoolService:48] Selected IP: 192.168.13.138 : true
- 2016-05-30 08:25:34,395 DEBUG [tomcat-http--39] [c.h.a.s.p.s.NodePoolService:35] try to get mssql instance from [43] hn
- 2016-05-30 08:25:34,464 DEBUG [tomcat-http--39] [c.h.a.s.c.a.EndPointProxy:159] ----login to [http://192.168.11.135:8080]
- 2016-05-30 08:25:35,201 DEBUG [tomcat-http--39] [c.h.a.s.s.s.i.HardNodePoolManager:322] Calculation nodes count... mssql
- 2016-05-30 08:25:35,202 DEBUG [tomcat-http--39] [c.h.a.s.s.s.i.HardNodePoolManager:328] Collection is not empty size is: 2 mssql
- 2016-05-30 08:25:35,203 DEBUG [Thread-38622] [c.h.a.s.s.s.i.u.NodeGenerator:52] --try to get access by thread=[Thread[Thread-38622,5,main]] from ***HardNode*** semaphore
- 2016-05-30 08:25:35,204 DEBUG [Thread-38622] [c.h.a.s.s.s.i.u.NodeGenerator:58] --try to get access by thread=[Thread[Thread-38622,5,main]] from ###PoolType### semaphore
- 2016-05-30 08:25:35,205 DEBUG [Thread-38622] [c.h.a.s.s.s.i.u.NodeGenerator:63] --access is allowed for thread=[Thread[Thread-38622,5,main]]
- 2016-05-30 08:25:35,244 INFO [Thread-38622] [c.h.a.s.s.s.i.NodeManagerInnerService:699] Hardnode windows2012-4. Starting offline cloning
- 2016-05-30 08:25:35,245 DEBUG [Thread-38622] [c.h.a.s.c.a.EndPointProxy:222] setLock:811b0215-6e79-46f2-ae6f-cf16974773
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement