Aug 31, 2018 6:16:15 PM org.apache.ignite.logger.java.JavaLogger error SEVERE: Runtime error caught during grid runnable execution: Socket reader [id=105, name=tcp-disco-sock-reader-#13, nodeId=83e986dc-9fc1-433c-8953-2a11460376a0] java.lang.OutOfMemoryError: Java heap space at java.io.BufferedOutputStream.(BufferedOutputStream.java:76) at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.socketStream(TcpDiscoverySpi.java:1424) at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.writeToSocket(TcpDiscoverySpi.java:1534) at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:5860) at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62) Exception in thread "tcp-disco-sock-reader-#13" java.lang.OutOfMemoryError: Java heap space at java.io.BufferedOutputStream.(BufferedOutputStream.java:76) at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.socketStream(TcpDiscoverySpi.java:1424) at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.writeToSocket(TcpDiscoverySpi.java:1534) at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:5860) at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62) Aug 31, 2018 6:17:15 PM org.apache.ignite.logger.java.JavaLogger error SEVERE: Runtime error caught during grid runnable execution: Socket reader [id=104, name=tcp-disco-sock-reader-#12, nodeId=83e986dc-9fc1-433c-8953-2a11460376a0] java.lang.OutOfMemoryError: Java heap space at java.io.BufferedOutputStream.(BufferedOutputStream.java:76) at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.socketStream(TcpDiscoverySpi.java:1424) at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.writeToSocket(TcpDiscoverySpi.java:1534) at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:5860) at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62) Exception in thread "tcp-disco-sock-reader-#12" java.lang.OutOfMemoryError: Java heap space at java.io.BufferedOutputStream.(BufferedOutputStream.java:76) at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.socketStream(TcpDiscoverySpi.java:1424) at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.writeToSocket(TcpDiscoverySpi.java:1534) at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:5860) at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62) Aug 31, 2018 6:17:21 PM org.apache.ignite.logger.java.JavaLogger error SEVERE: Runtime error caught during grid runnable execution: Socket reader [id=110, name=tcp-disco-sock-reader-#16, nodeId=null] java.lang.OutOfMemoryError: GC overhead limit exceeded at java.io.BufferedInputStream.(BufferedInputStream.java:203) at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:5763) at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62) Exception in thread "tcp-disco-sock-reader-#16" java.lang.OutOfMemoryError: GC overhead limit exceeded at java.io.BufferedInputStream.(BufferedInputStream.java:203) at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:5763) at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62) Aug 31, 2018 6:17:47 PM org.apache.ignite.logger.java.JavaLogger error SEVERE: Runtime error caught during grid runnable execution: Socket reader [id=109, name=tcp-disco-sock-reader-#15, nodeId=83e986dc-9fc1-433c-8953-2a11460376a0] java.lang.OutOfMemoryError: Java heap space at java.io.BufferedOutputStream.(BufferedOutputStream.java:76) at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.socketStream(TcpDiscoverySpi.java:1424) at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.writeToSocket(TcpDiscoverySpi.java:1534) at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:5860) at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62) Exception in thread "tcp-disco-sock-reader-#15" java.lang.OutOfMemoryError: Java heap space at java.io.BufferedOutputStream.(BufferedOutputStream.java:76) at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.socketStream(TcpDiscoverySpi.java:1424) at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.writeToSocket(TcpDiscoverySpi.java:1534) at org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:5860) at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62) Aug 31, 2018 6:18:11 PM org.apache.ignite.logger.java.JavaLogger error SEVERE: TcpDiscoverSpi's message worker thread failed abnormally. Stopping the node in order to prevent cluster wide instability. java.lang.OutOfMemoryError: GC overhead limit exceeded Aug 31, 2018 6:18:29 PM org.apache.ignite.logger.java.JavaLogger error SEVERE: Caught unhandled exception in NIO worker thread (restart the node). java.lang.OutOfMemoryError: GC overhead limit exceeded Aug 31, 2018 6:19:28 PM org.apache.ignite.logger.java.JavaLogger error SEVERE: Runtime error caught during grid runnable execution: Socket reader [id=112, name=tcp-disco-sock-reader-#18, nodeId=null] java.lang.OutOfMemoryError: Java heap space Exception in thread "tcp-disco-sock-reader-#18" Exception in thread "grid-nio-worker-tcp-comm-0-#25" java.lang.OutOfMemoryError: GC overhead limit exceeded java.lang.OutOfMemoryError: Java heap space Aug 31, 2018 6:20:36 PM org.apache.ignite.logger.java.JavaLogger error SEVERE: Runtime error caught during grid runnable execution: IgniteSpiThread [name=tcp-disco-msg-worker-#2] java.lang.OutOfMemoryError: GC overhead limit exceeded Exception in thread "tcp-disco-msg-worker-#2" java.lang.OutOfMemoryError: GC overhead limit exceeded Aug 31, 2018 6:19:47 PM org.apache.ignite.logger.java.JavaLogger error SEVERE: Error when executing timeout callback: GridSpiTimeoutObject [obj=SocketTimeoutObject [id=a2ef9809561-270f54e4-5da7-4492-aaaf-0888c553104b, sock=Socket[addr=/127.0.0.1,port=38329,localport=47501], endTime=1535728765485, done=true]] java.lang.OutOfMemoryError: GC overhead limit exceeded Aug 31, 2018 6:21:05 PM org.apache.ignite.logger.java.JavaLogger error SEVERE: Runtime error caught during grid runnable execution: Socket reader [id=111, name=tcp-disco-sock-reader-#17, nodeId=null] java.lang.OutOfMemoryError: GC overhead limit exceeded Exception in thread "tcp-disco-sock-reader-#17" java.lang.OutOfMemoryError: GC overhead limit exceeded Aug 31, 2018 6:21:23 PM org.apache.ignite.logger.java.JavaLogger error SEVERE: Runtime error caught during grid runnable execution: GridWorker [name=grid-timeout-worker, igniteInstanceName=null, finished=false, hashCode=797684532, interrupted=false, runner=grid-timeout-worker-#23] java.lang.OutOfMemoryError: GC overhead limit exceeded Exception in thread "grid-timeout-worker-#23" java.lang.OutOfMemoryError: GC overhead limit exceeded Aug 31, 2018 6:22:31 PM org.apache.ignite.logger.java.JavaLogger error SEVERE: Runtime error caught during grid runnable execution: Socket reader [id=121, name=tcp-disco-sock-reader-#21, nodeId=null] java.lang.OutOfMemoryError: Java heap space Exception in thread "tcp-disco-sock-reader-#21" java.lang.OutOfMemoryError: Java heap space Aug 31, 2018 6:23:02 PM org.apache.ignite.logger.java.JavaLogger error SEVERE: Runtime error caught during grid runnable execution: Socket reader [id=122, name=tcp-disco-sock-reader-#22, nodeId=null] java.lang.OutOfMemoryError: GC overhead limit exceeded Exception in thread "tcp-disco-sock-reader-#22" java.lang.OutOfMemoryError: GC overhead limit exceeded Aug 31, 2018 6:23:19 PM org.apache.ignite.logger.java.JavaLogger error SEVERE: Runtime error caught during grid runnable execution: Socket reader [id=123, name=tcp-disco-sock-reader-#23, nodeId=null] java.lang.OutOfMemoryError: GC overhead limit exceeded Exception in thread "tcp-disco-sock-reader-#23" java.lang.OutOfMemoryError: GC overhead limit exceeded Aug 31, 2018 6:23:43 PM org.apache.ignite.logger.java.JavaLogger error SEVERE: Runtime error caught during grid runnable execution: GridWorker [name=ttl-cleanup-worker, igniteInstanceName=null, finished=false, hashCode=30111142, interrupted=false, runner=ttl-cleanup-worker-#43] java.lang.OutOfMemoryError: GC overhead limit exceeded Exception in thread "ttl-cleanup-worker-#43" java.lang.OutOfMemoryError: GC overhead limit exceeded Aug 31, 2018 6:24:11 PM org.apache.ignite.logger.java.JavaLogger error SEVERE: Runtime error caught during grid runnable execution: IgniteSpiThread [name=tcp-comm-worker-#1] java.lang.OutOfMemoryError: GC overhead limit exceeded Exception in thread "tcp-comm-worker-#1" java.lang.OutOfMemoryError: GC overhead limit exceeded Aug 31, 2018 6:24:36 PM org.apache.ignite.logger.java.JavaLogger error SEVERE: Runtime error caught during grid runnable execution: IgniteSpiThread [name=tcp-disco-srvr-#3] java.lang.OutOfMemoryError: GC overhead limit exceeded Exception in thread "tcp-disco-srvr-#3" java.lang.OutOfMemoryError: GC overhead limit exceeded