API tools faq
paste
Guest User

datanode_log

a guest
Dec 10th, 2015
250
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 7.63 KB | None | 0 0
raw download clone embed print report
  1. 2015-12-11 04:01:47,302 ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: DataNode{data=FSDataset{dirpath='[/home/ubuntu/storage/hdfs/hdfs_dn_dir_2_4/current]'}, localName='anmol-vm1-new:50010', datanodeUuid='de50473c-777b-4d20-b39c-7c00e409892e', xmitsInProgress=0}:Exception transfering block BP-760877211-10.0.1.190-1449803585291:blk_1073741897_1073 to mirror 10.0.1.192:50010: org.apache.hadoop.net.ConnectTimeoutException: 65000 millis timeout while waiting for channel to be ready for connect. ch : java.nio.channels.SocketChannel[connection-pending remote=/10.0.1.192:50010]
  2. 2015-12-11 04:01:47,302 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: opWriteBlock BP-760877211-10.0.1.190-1449803585291:blk_1073741897_1073 received exception org.apache.hadoop.net.ConnectTimeoutException: 65000 millis timeout while waiting for channel to be ready for connect. ch : java.nio.channels.SocketChannel[connection-pending remote=/10.0.1.192:50010]
  3. 2015-12-11 04:01:47,306 ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: anmol-vm1-new:50010:DataXceiver error processing WRITE_BLOCK operation src: /10.0.1.193:57002 dst: /10.0.1.190:50010
  4. org.apache.hadoop.net.ConnectTimeoutException: 65000 millis timeout while waiting for channel to be ready for connect. ch : java.nio.channels.SocketChannel[connection-pending remote=/10.0.1.192:50010]
  5. at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:532)
  6. at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:493)
  7. at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:650)
  8. at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:124)
  9. at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:71)
  10. at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:232)
  11. at java.lang.Thread.run(Thread.java:745)
  12. 2015-12-11 04:01:47,380 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Receiving BP-760877211-10.0.1.190-1449803585291:blk_1073741903_1079 src: /10.0.1.191:36044 dest: /10.0.1.190:50010
  13. 2015-12-11 04:01:59,526 INFO org.apache.hadoop.hdfs.server.datanode.DataNode.clienttrace: src: /10.0.1.193:57023, dest: /10.0.1.190:50010, bytes: 268435456, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-527741067_1, offset: 0, srvID: de50473c-777b-4d20-b39c-7c00e409892e, blockid: BP-760877211-10.0.1.190-1449803585291:blk_1073741901_1077, duration: 20135903553
  14. 2015-12-11 04:01:59,528 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: PacketResponder: BP-760877211-10.0.1.190-1449803585291:blk_1073741901_1077, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
  15. 2015-12-11 04:01:59,576 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Receiving BP-760877211-10.0.1.190-1449803585291:blk_1073741904_1080 src: /10.0.1.191:36045 dest: /10.0.1.190:50010
  16. 2015-12-11 04:02:15,333 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Receiving BP-760877211-10.0.1.190-1449803585291:blk_1073741905_1081 src: /10.0.1.193:57040 dest: /10.0.1.190:50010
  17. 2015-12-11 04:02:17,036 INFO org.apache.hadoop.hdfs.server.datanode.DataNode.clienttrace: src: /10.0.1.193:57027, dest: /10.0.1.190:50010, bytes: 268435456, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1428623754_1, offset: 0, srvID: de50473c-777b-4d20-b39c-7c00e409892e, blockid: BP-760877211-10.0.1.190-1449803585291:blk_1073741902_1078, duration: 30412020249
  18. 2015-12-11 04:02:17,036 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: PacketResponder: BP-760877211-10.0.1.190-1449803585291:blk_1073741902_1078, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
  19. 2015-12-11 04:02:17,087 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Receiving BP-760877211-10.0.1.190-1449803585291:blk_1073741906_1082 src: /10.0.1.193:57043 dest: /10.0.1.190:50010
  20. 2015-12-11 04:02:31,748 INFO org.apache.hadoop.hdfs.server.datanode.DataNode.clienttrace: src: /10.0.1.191:36044, dest: /10.0.1.190:50010, bytes: 268435456, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-950705833_1, offset: 0, srvID: de50473c-777b-4d20-b39c-7c00e409892e, blockid: BP-760877211-10.0.1.190-1449803585291:blk_1073741903_1079, duration: 44365290884
  21. 2015-12-11 04:02:31,748 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: PacketResponder: BP-760877211-10.0.1.190-1449803585291:blk_1073741903_1079, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
  22. 2015-12-11 04:02:31,798 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Receiving BP-760877211-10.0.1.190-1449803585291:blk_1073741907_1083 src: /10.0.1.191:36047 dest: /10.0.1.190:50010
  23. 2015-12-11 04:02:54,067 INFO org.apache.hadoop.hdfs.server.datanode.DataNode.clienttrace: src: /10.0.1.191:36045, dest: /10.0.1.190:50010, bytes: 268435456, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-527741067_1, offset: 0, srvID: de50473c-777b-4d20-b39c-7c00e409892e, blockid: BP-760877211-10.0.1.190-1449803585291:blk_1073741904_1080, duration: 54488073628
  24. 2015-12-11 04:02:54,068 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: PacketResponder: BP-760877211-10.0.1.190-1449803585291:blk_1073741904_1080, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
  25. 2015-12-11 04:02:55,721 INFO org.apache.hadoop.hdfs.server.datanode.DataNode.clienttrace: src: /10.0.1.193:57043, dest: /10.0.1.190:50010, bytes: 268435456, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1428623754_1, offset: 0, srvID: de50473c-777b-4d20-b39c-7c00e409892e, blockid: BP-760877211-10.0.1.190-1449803585291:blk_1073741906_1082, duration: 38627070101
  26. 2015-12-11 04:02:55,721 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: PacketResponder: BP-760877211-10.0.1.190-1449803585291:blk_1073741906_1082, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
  27. 2015-12-11 04:02:55,853 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Receiving BP-760877211-10.0.1.190-1449803585291:blk_1073741908_1084 src: /10.0.1.191:36049 dest: /10.0.1.190:50010
  28. 2015-12-11 04:02:56,210 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Receiving BP-760877211-10.0.1.190-1449803585291:blk_1073741909_1085 src: /10.0.1.191:36050 dest: /10.0.1.190:50010
  29. 2015-12-11 04:02:56,480 INFO org.apache.hadoop.hdfs.server.datanode.DataNode.clienttrace: src: /10.0.1.193:57040, dest: /10.0.1.190:50010, bytes: 268435456, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1894583087_1, offset: 0, srvID: de50473c-777b-4d20-b39c-7c00e409892e, blockid: BP-760877211-10.0.1.190-1449803585291:blk_1073741905_1081, duration: 41133297959
  30. 2015-12-11 04:02:56,480 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: PacketResponder: BP-760877211-10.0.1.190-1449803585291:blk_1073741905_1081, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
  31. 2015-12-11 04:02:56,738 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Receiving BP-760877211-10.0.1.190-1449803585291:blk_1073741910_1086 src: /10.0.1.193:57060 dest: /10.0.1.190:50010
  32. 2015-12-11 04:03:11,263 INFO org.apache.hadoop.hdfs.server.datanode.DataNode.clienttrace: src: /10.0.1.191:36047, dest: /10.0.1.190:50010, bytes: 268435456, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-950705833_1, offset: 0, srvID: de50473c-777b-4d20-b39c-7c00e409892e, blockid: BP-760877211-10.0.1.190-1449803585291:blk_1073741907_1083, duration: 39459559034
  33. 2015-12-11 04:03:11,304 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: PacketResponder: BP-760877211-10.0.1.190-1449803585291:blk_1073741907_1083, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
  34. 2015-12-11 04:03:11,346 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Receiving BP-760877211-10.0.1.190-1449803585291:blk_1073741911_1087 src: /10.0.1.193:57064 dest: /10.0.1.190:50010
  35. 2015-12-11 04:03:21,558 INFO org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner: Verification succeeded for BP-760877211-10.0.1.190-1449803585291:blk_1073741867_1043
Advertisement
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!