Guest User

Untitled

a guest
Dec 8th, 2018
346
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 5.90 KB | None | 0 0
  1. 18/12/02 19:07:08 INFO master.BspServiceMaster: aggregateWorkerStats: Aggregation found (vtx=27769,finVtx=0,edges=704570,msgCount=704570,msgBytesCount=6123199529,haltComputation=false, checkpointStatus=NONE) on superstep = 1
  2. 18/12/02 19:07:08 INFO master.BspServiceMaster: coordinateSuperstep: Cleaning up old Superstep /_hadoopBsp/giraph_yarn_application_1543771982625_0037/_applicationAttemptsDir/0/_superstepDir/0
  3. 18/12/02 19:07:08 INFO server.PrepRequestProcessor: Got user-level KeeperException when processing sessionid:0x167705038550000 type:delete cxid:0x1bb zxid:0xa2 txntype:-1 reqpath:n/a Error Path:/_hadoopBsp/giraph_yarn_application_1543771982625_0037/_applicationAttemptsDir/0/_superstepDir/0 Error:KeeperErrorCode = Directory not empty for /_hadoopBsp/giraph_yarn_application_1543771982625_0037/_applicationAttemptsDir/0/_superstepDir/0
  4.  
  5. 18/12/02 19:07:08 INFO server.PrepRequestProcessor: Got user-level KeeperException when processing sessionid:0x167705038550000 type:create cxid:0x1eb zxid:0xde txntype:-1 reqpath:n/a Error Path:/_hadoopBsp/giraph_yarn_application_1543771982625_0037/_applicationAttemptsDir/0/_superstepDir/2/_workerUnhealthyDir Error:KeeperErrorCode = NodeExists for /_hadoopBsp/giraph_yarn_application_1543771982625_0037/_applicationAttemptsDir/0/_superstepDir/2/_workerUnhealthyDir
  6. 18/12/02 19:07:08 INFO yarn.GiraphYarnTask: [STATUS: task-0] MASTER_ZOOKEEPER_ONLY checkWorkers: Done - Found 8 responses of 8 needed to start superstep 2
  7. 18/12/02 19:07:08 INFO netty.NettyClient: connectAllAddresses: Successfully added 0 connections, (0 total connected) 0 failed, 0 failures total.
  8. 18/12/02 19:07:08 INFO partition.PartitionBalancer: balancePartitionsAcrossWorkers: Using algorithm static
  9. 18/12/02 19:07:08 INFO partition.PartitionUtils: analyzePartitionStats: Vertices - Mean: 3471, Min: Worker(hostname=ip-172-31-19-22 hostOrIp=ip-172-31-19-22, MRtaskID=7, port=30007) - 3470, Max: Worker(hostname=ip-172-31-20-236 hostOrIp=ip-172-31-20-236, MRtaskID=1, port=30001) - 3472
  10. 18/12/02 19:07:08 INFO partition.PartitionUtils: analyzePartitionStats: Edges - Mean: 88071, Min: Worker(hostname=ip-172-31-20-236 hostOrIp=ip-172-31-20-236, MRtaskID=5, port=30005) - 85093, Max: Worker(hostname=ip-172-31-28-148 hostOrIp=ip-172-31-28-148, MRtaskID=6, port=30006) - 90619
  11. 18/12/02 19:07:08 INFO yarn.GiraphYarnTask: [STATUS: task-0] MASTER_ZOOKEEPER_ONLY - 0 finished out of 8 on superstep 2
  12. 18/12/02 19:07:08 INFO master.BspServiceMaster: barrierOnWorkerList: 0 out of 8 workers finished on superstep 2 on path /_hadoopBsp/giraph_yarn_application_1543771982625_0037/_applicationAttemptsDir/0/_superstepDir/2/_workerFinishedDir
  13. 18/12/02 19:07:08 INFO master.BspServiceMaster: barrierOnWorkerList: Waiting on [ip-172-31-20-236_1, ip-172-31-19-22_7, ip-172-31-25-172_8, ip-172-31-19-22_3, ip-172-31-20-236_5, ip-172-31-28-148_6, ip-172-31-25-172_4, ip-172-31-28-148_2]
  14. 18/12/02 19:07:08 INFO yarn.GiraphYarnTask: [STATUS: task-0] MASTER_ZOOKEEPER_ONLY - 0 finished out of 8 on superstep 2
  15. 18/12/02 19:07:16 WARN server.NIOServerCnxn: caught end of stream exception
  16. EndOfStreamException: Unable to read additional data from client sessionid 0x167705038550004, likely client has closed socket
  17. at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
  18. at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
  19. at java.lang.Thread.run(Thread.java:748)
  20. 18/12/02 19:07:16 INFO server.NIOServerCnxn: Closed socket connection for client /172.31.19.22:50108 which had sessionid 0x167705038550004
  21. 18/12/02 19:07:18 WARN server.NIOServerCnxn: caught end of stream exception
  22. EndOfStreamException: Unable to read additional data from client sessionid 0x167705038550001, likely client has closed socket
  23. at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
  24. at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
  25. at java.lang.Thread.run(Thread.java:748)
  26. 18/12/02 19:07:18 INFO server.NIOServerCnxn: Closed socket connection for client /172.31.20.236:37618 which had sessionid 0x167705038550001
  27. 18/12/02 19:07:38 INFO master.BspServiceMaster: barrierOnWorkerList: 0 out of 8 workers finished on superstep 2 on path /_hadoopBsp/giraph_yarn_application_1543771982625_0037/_applicationAttemptsDir/0/_superstepDir/2/_workerFinishedDir
  28. 18/12/02 19:07:38 INFO master.BspServiceMaster: barrierOnWorkerList: Waiting on [ip-172-31-20-236_1, ip-172-31-19-22_7, ip-172-31-25-172_8, ip-172-31-19-22_3, ip-172-31-20-236_5, ip-172-31-28-148_6, ip-172-31-25-172_4, ip-172-31-28-148_2]
  29. 18/12/02 19:08:08 INFO master.BspServiceMaster: barrierOnWorkerList: 0 out of 8 workers finished on superstep 2 on path /_hadoopBsp/giraph_yarn_application_1543771982625_0037/_applicationAttemptsDir/0/_superstepDir/2/_workerFinishedDir
  30. 18/12/02 19:08:08 INFO master.BspServiceMaster: barrierOnWorkerList: Waiting on [ip-172-31-20-236_1, ip-172-31-19-22_7, ip-172-31-25-172_8, ip-172-31-19-22_3, ip-172-31-20-236_5, ip-172-31-28-148_6, ip-172-31-25-172_4, ip-172-31-28-148_2]
  31. 18/12/02 19:08:38 INFO master.BspServiceMaster: barrierOnWorkerList: 0 out of 8 workers finished on superstep 2 on path /_hadoopBsp/giraph_yarn_application_1543771982625_0037/_applicationAttemptsDir/0/_superstepDir/2/_workerFinishedDir
  32. 18/12/02 19:08:38 INFO master.BspServiceMaster: barrierOnWorkerList: Waiting on [ip-172-31-20-236_1, ip-172-31-19-22_7, ip-172-31-25-172_8, ip-172-31-19-22_3, ip-172-31-20-236_5, ip-172-31-28-148_6, ip-172-31-25-172_4, ip-172-31-28-148_2]
  33. 18/12/02 19:09:08 INFO master.BspServiceMaster: barrierOnWorkerList: 0 out of 8 workers finished on superstep 2 on path /_hadoopBsp/giraph_yarn_application_1543771982625_0037/_applicationAttemptsDir/0/_superstepDir/2/_workerFinishedDir
  34. 18/12/02 19:09:08 INFO master.BspServiceMaster: barrierOnWorkerList: Waiting on [ip-172-31-20-236_1, ip-172-31-19-22_7, ip-172-31-25-172_8, ip-172-31-19-22_3, ip-172-31-20-236_5, ip-172-31-28-148_6, ip-172-31-25-172_4, ip-172-31-28-148_2]
Advertisement
Add Comment
Please, Sign In to add comment