API tools faq
paste
Advertisement
Guest User

RS crash va-p-hbase

a guest
May 22nd, 2013
142
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 36.44 KB | None | 0 0
raw download clone embed print report
  1. 2013-05-22 14:58:43,802 INFO org.apache.hadoop.hbase.replication.regionserver.ReplicationSource: Getting 1 rs from peer cluster # 1
  2. 2013-05-22 14:58:43,803 INFO org.apache.hadoop.hbase.replication.regionserver.ReplicationSource: Choosing peer CA-P-HBase-03-b.private.mtlink.biz,60020,1369249119927
  3. 2013-05-22 14:58:43,803 INFO org.apache.hadoop.hbase.replication.regionserver.ReplicationSource: Getting 1 rs from peer cluster # 1
  4. 2013-05-22 14:58:43,803 INFO org.apache.hadoop.hbase.replication.regionserver.ReplicationSource: Choosing peer CA-P-HBase-01-b.private.mtlink.biz,60020,1369249119729
  5. 2013-05-22 14:58:43,803 INFO org.apache.hadoop.hbase.replication.regionserver.ReplicationSource: Getting 1 rs from peer cluster # 1
  6. 2013-05-22 14:58:43,803 INFO org.apache.hadoop.hbase.replication.regionserver.ReplicationSource: Choosing peer CA-P-HBase-02-c.private.mtlink.biz,60020,1369249119155
  7. 2013-05-22 14:58:43,803 INFO org.apache.hadoop.hbase.replication.regionserver.ReplicationSource: Getting 1 rs from peer cluster # 1
  8. 2013-05-22 14:58:43,803 INFO org.apache.hadoop.hbase.replication.regionserver.ReplicationSource: Choosing peer CA-P-HBase-02-b.private.mtlink.biz,60020,1369249119310
  9. 2013-05-22 14:58:43,803 INFO org.apache.hadoop.hbase.replication.regionserver.ReplicationSource: Getting 1 rs from peer cluster # 1
  10. 2013-05-22 14:58:43,803 INFO org.apache.hadoop.hbase.replication.regionserver.ReplicationSource: Choosing peer CA-P-HBase-02-b.private.mtlink.biz,60020,1369249119310
  11. 2013-05-22 14:58:43,802 INFO org.apache.hadoop.hbase.replication.regionserver.ReplicationSource: Getting 1 rs from peer cluster # 1
  12. 2013-05-22 14:58:43,808 INFO org.apache.hadoop.hbase.replication.regionserver.ReplicationSource: Choosing peer CA-P-HBase-01-c.private.mtlink.biz,60020,1369249119538
  13. 2013-05-22 14:58:43,803 INFO org.apache.hadoop.hbase.replication.regionserver.ReplicationSource: Getting 1 rs from peer cluster # 1
  14. 2013-05-22 14:58:43,808 INFO org.apache.hadoop.hbase.replication.regionserver.ReplicationSource: Choosing peer CA-P-HBase-02-c.private.mtlink.biz,60020,1369249119155
  15. 2013-05-22 14:58:44,968 INFO org.apache.hadoop.hbase.replication.regionserver.ReplicationSource: Replicating 8b11c86d-1ae8-419b-a492-ced43b65290d -> 2b509cc1-433d-41f6-98a2-6b8e7a9b2d32
  16. 2013-05-22 14:58:44,968 INFO org.apache.hadoop.hbase.replication.regionserver.ReplicationSource: Replicating 8b11c86d-1ae8-419b-a492-ced43b65290d -> 2b509cc1-433d-41f6-98a2-6b8e7a9b2d32
  17. 2013-05-22 14:58:44,968 INFO org.apache.hadoop.hbase.replication.regionserver.ReplicationSource: Replicating 8b11c86d-1ae8-419b-a492-ced43b65290d -> 2b509cc1-433d-41f6-98a2-6b8e7a9b2d32
  18. 2013-05-22 14:58:44,969 INFO org.apache.hadoop.hbase.replication.regionserver.ReplicationSource: Replicating 8b11c86d-1ae8-419b-a492-ced43b65290d -> 2b509cc1-433d-41f6-98a2-6b8e7a9b2d32
  19. 2013-05-22 14:58:44,969 INFO org.apache.hadoop.hbase.replication.regionserver.ReplicationSource: Replicating 8b11c86d-1ae8-419b-a492-ced43b65290d -> 2b509cc1-433d-41f6-98a2-6b8e7a9b2d32
  20. 2013-05-22 14:58:44,974 INFO org.apache.hadoop.hbase.replication.regionserver.ReplicationSource: Replicating 8b11c86d-1ae8-419b-a492-ced43b65290d -> 2b509cc1-433d-41f6-98a2-6b8e7a9b2d32
  21. 2013-05-22 14:58:44,974 INFO org.apache.hadoop.hbase.replication.regionserver.ReplicationSource: Replicating 8b11c86d-1ae8-419b-a492-ced43b65290d -> 2b509cc1-433d-41f6-98a2-6b8e7a9b2d32
  22. 2013-05-22 14:58:58,923 FATAL org.apache.hadoop.hbase.regionserver.HRegionServer: ABORTING region server va-p-hbase-01-c,60020,1369233253404: Writing replication status
  23. org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /hbase/replication/rs/va-p-hbase-01-c,60020,1369233253404/1-va-p-hbase-01-c,60020,1369042378287-va-p-hbase-02-c,60020,1369042377731/va-p-hbase-01-c%2C60020%2C1369042378287.1369220050719
  24. at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
  25. at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
  26. at org.apache.zookeeper.ZooKeeper.setData(ZooKeeper.java:1266)
  27. at org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.setData(RecoverableZooKeeper.java:354)
  28. at org.apache.hadoop.hbase.zookeeper.ZKUtil.setData(ZKUtil.java:846)
  29. at org.apache.hadoop.hbase.zookeeper.ZKUtil.setData(ZKUtil.java:898)
  30. at org.apache.hadoop.hbase.zookeeper.ZKUtil.setData(ZKUtil.java:892)
  31. at org.apache.hadoop.hbase.replication.ReplicationZookeeper.writeReplicationStatus(ReplicationZookeeper.java:558)
  32. at org.apache.hadoop.hbase.replication.regionserver.ReplicationSourceManager.logPositionAndCleanOldLogs(ReplicationSourceManager.java:154)
  33. at org.apache.hadoop.hbase.replication.regionserver.ReplicationSource.shipEdits(ReplicationSource.java:638)
  34. at org.apache.hadoop.hbase.replication.regionserver.ReplicationSource.run(ReplicationSource.java:387)
  35. 2013-05-22 14:58:58,924 FATAL org.apache.hadoop.hbase.regionserver.HRegionServer: RegionServer abort: loaded coprocessors are: []
  36. 2013-05-22 14:58:58,925 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: Dump of metrics: requestsPerSecond=7857, numberOfOnlineRegions=15, numberOfStores=15, numberOfStorefiles=33, storefileIndexSizeMB=0, rootIndexSizeKB=546, totalStaticIndexSizeKB=94015, totalStaticBloomSizeKB=323442, memstoreSizeMB=587, mbInMemoryWithoutWAL=0, numberOfPutsWithoutWAL=0, readRequestsCount=131530861, writeRequestsCount=898282, compactionQueueSize=0, flushQueueSize=0, usedHeapMB=3934, maxHeapMB=10206, blockCacheSizeMB=3162.65, blockCacheFreeMB=920.05, blockCacheCount=156058, blockCacheHitCount=15560223, blockCacheMissCount=866595, blockCacheEvictedCount=114008, blockCacheHitRatio=94%, blockCacheHitCachingRatio=98%, hdfsBlocksLocalityIndex=82, slowHLogAppendCount=0, fsReadLatencyHistogramMean=11352837.85, fsReadLatencyHistogramCount=150535, fsReadLatencyHistogramMedian=15792923.5, fsReadLatencyHistogram75th=27689739, fsReadLatencyHistogram95th=55369093.35, fsReadLatencyHistogram99th=84359355.27, fsReadLatencyHistogram999th=265203845.78, fsPreadLatencyHistogramMean=18719771.63, fsPreadLatencyHistogramCount=157696, fsPreadLatencyHistogramMedian=16555973.5, fsPreadLatencyHistogram75th=26702544.25, fsPreadLatencyHistogram95th=48872564.95, fsPreadLatencyHistogram99th=75124553.2, fsPreadLatencyHistogram999th=106742459.73, fsWriteLatencyHistogramMean=133980.88, fsWriteLatencyHistogramCount=45041, fsWriteLatencyHistogramMedian=44310, fsWriteLatencyHistogram75th=58548, fsWriteLatencyHistogram95th=215355.55, fsWriteLatencyHistogram99th=1382357.27, fsWriteLatencyHistogram999th=31824693.83
  37. 2013-05-22 14:58:58,961 ERROR org.apache.hadoop.hbase.regionserver.HRegionServer:
  38. org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server va-p-hbase-01-c,60020,1369233253404 not running, aborting
  39. at org.apache.hadoop.hbase.regionserver.HRegionServer.checkOpen(HRegionServer.java:3245)
  40. at org.apache.hadoop.hbase.regionserver.HRegionServer.close(HRegionServer.java:2495)
  41. at sun.reflect.GeneratedMethodAccessor24.invoke(Unknown Source)
  42. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  43. at java.lang.reflect.Method.invoke(Method.java:601)
  44. at org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:364)
  45. at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1400)
  46. 2013-05-22 14:58:58,961 ERROR org.apache.hadoop.hbase.regionserver.HRegionServer:
  47. org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server va-p-hbase-01-c,60020,1369233253404 not running, aborting
  48. at org.apache.hadoop.hbase.regionserver.HRegionServer.checkOpen(HRegionServer.java:3245)
  49. at org.apache.hadoop.hbase.regionserver.HRegionServer.close(HRegionServer.java:2495)
  50. at sun.reflect.GeneratedMethodAccessor24.invoke(Unknown Source)
  51. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  52. at java.lang.reflect.Method.invoke(Method.java:601)
  53. at org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:364)
  54. at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1400)
  55. 2013-05-22 14:58:58,987 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: STOPPED: Writing replication status
  56. 2013-05-22 14:58:58,989 INFO org.apache.hadoop.ipc.HBaseServer: Stopping server on 60020
  57. 2013-05-22 14:58:58,990 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 0 on 60020: exiting
  58. 2013-05-22 14:58:58,991 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 2 on 60020: exiting
  59. 2013-05-22 14:58:58,991 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 3 on 60020: exiting
  60. 2013-05-22 14:58:58,991 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 1 on 60020: exiting
  61. 2013-05-22 14:58:58,991 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 4 on 60020: exiting
  62. 2013-05-22 14:58:58,991 INFO org.apache.hadoop.ipc.HBaseServer: PRI IPC Server handler 2 on 60020: exiting
  63. 2013-05-22 14:58:58,991 INFO org.apache.hadoop.ipc.HBaseServer: REPL IPC Server handler 2 on 60020: exiting
  64. 2013-05-22 14:58:58,991 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 13 on 60020: exiting
  65. 2013-05-22 14:58:58,992 INFO org.apache.hadoop.ipc.HBaseServer: PRI IPC Server handler 1 on 60020: exiting
  66. 2013-05-22 14:58:58,992 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 21 on 60020: exiting
  67. 2013-05-22 14:58:58,992 INFO org.apache.hadoop.ipc.HBaseServer: PRI IPC Server handler 0 on 60020: exiting
  68. 2013-05-22 14:58:58,992 INFO org.apache.hadoop.ipc.HBaseServer: PRI IPC Server handler 5 on 60020: exiting
  69. 2013-05-22 14:58:58,992 INFO org.apache.hadoop.ipc.HBaseServer: PRI IPC Server handler 8 on 60020: exiting
  70. 2013-05-22 14:58:58,992 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 5 on 60020: exiting
  71. 2013-05-22 14:58:58,992 INFO org.apache.hadoop.ipc.HBaseServer: REPL IPC Server handler 0 on 60020: exiting
  72. 2013-05-22 14:58:58,992 INFO org.apache.hadoop.ipc.HBaseServer: PRI IPC Server handler 7 on 60020: exiting
  73. 2013-05-22 14:58:58,992 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 49 on 60020: exiting
  74. 2013-05-22 14:58:58,992 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 11 on 60020: exiting
  75. 2013-05-22 14:58:58,992 INFO org.apache.hadoop.ipc.HBaseServer: Stopping IPC Server Responder
  76. 2013-05-22 14:58:58,992 INFO org.apache.hadoop.ipc.HBaseServer: Stopping IPC Server Responder
  77. 2013-05-22 14:58:58,993 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 19 on 60020: exiting
  78. 2013-05-22 14:58:58,992 INFO org.apache.hadoop.ipc.HBaseServer: Stopping IPC Server listener on 60020
  79. 2013-05-22 14:58:58,993 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 22 on 60020: exiting
  80. 2013-05-22 14:58:58,992 INFO org.apache.hadoop.ipc.HBaseServer: PRI IPC Server handler 3 on 60020: exiting
  81. 2013-05-22 14:58:58,992 INFO org.apache.hadoop.ipc.HBaseServer: REPL IPC Server handler 1 on 60020: exiting
  82. 2013-05-22 14:58:58,993 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 24 on 60020: exiting
  83. 2013-05-22 14:58:58,993 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 18 on 60020: exiting
  84. 2013-05-22 14:58:58,993 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 14 on 60020: exiting
  85. 2013-05-22 14:58:58,993 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 12 on 60020: exiting
  86. 2013-05-22 14:58:58,993 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 23 on 60020: exiting
  87. 2013-05-22 14:58:58,993 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 30 on 60020: exiting
  88. 2013-05-22 14:58:58,993 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 34 on 60020: exiting
  89. 2013-05-22 14:58:58,993 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 32 on 60020: exiting
  90. 2013-05-22 14:58:58,993 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 9 on 60020: exiting
  91. 2013-05-22 14:58:58,992 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 10 on 60020: exiting
  92. 2013-05-22 14:58:58,992 INFO org.apache.hadoop.ipc.HBaseServer: PRI IPC Server handler 9 on 60020: exiting
  93. 2013-05-22 14:58:58,992 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 6 on 60020: exiting
  94. 2013-05-22 14:58:58,997 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 43 on 60020: exiting
  95. 2013-05-22 14:58:58,992 INFO org.apache.hadoop.ipc.HBaseServer: PRI IPC Server handler 6 on 60020: exiting
  96. 2013-05-22 14:58:58,992 INFO org.apache.hadoop.ipc.HBaseServer: PRI IPC Server handler 4 on 60020: exiting
  97. 2013-05-22 14:58:58,997 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 39 on 60020: exiting
  98. 2013-05-22 14:58:58,997 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 40 on 60020: exiting
  99. 2013-05-22 14:58:58,997 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 46 on 60020: exiting
  100. 2013-05-22 14:58:58,997 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 15 on 60020: exiting
  101. 2013-05-22 14:58:58,997 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 47 on 60020: exiting
  102. 2013-05-22 14:58:58,998 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 28 on 60020: exiting
  103. 2013-05-22 14:58:58,997 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 44 on 60020: exiting
  104. 2013-05-22 14:58:58,997 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 48 on 60020: exiting
  105. 2013-05-22 14:58:58,997 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 41 on 60020: exiting
  106. 2013-05-22 14:58:58,997 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 42 on 60020: exiting
  107. 2013-05-22 14:58:58,997 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 45 on 60020: exiting
  108. 2013-05-22 14:58:58,996 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 36 on 60020: exiting
  109. 2013-05-22 14:58:58,992 INFO org.apache.hadoop.hbase.regionserver.SplitLogWorker: Sending interrupt to stop the worker thread
  110. 2013-05-22 14:58:58,998 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: Stopping infoServer
  111. 2013-05-22 14:58:58,993 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 37 on 60020: exiting
  112. 2013-05-22 14:58:58,993 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 35 on 60020: exiting
  113. 2013-05-22 14:58:58,993 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 33 on 60020: exiting
  114. 2013-05-22 14:58:59,005 INFO org.apache.hadoop.hbase.regionserver.SplitLogWorker: SplitLogWorker interrupted while waiting for task, exiting: java.lang.InterruptedException
  115. 2013-05-22 14:58:58,993 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 20 on 60020: exiting
  116. 2013-05-22 14:58:58,993 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 31 on 60020: exiting
  117. 2013-05-22 14:58:58,993 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 16 on 60020: exiting
  118. 2013-05-22 14:58:59,006 INFO org.apache.hadoop.hbase.regionserver.SplitLogWorker: SplitLogWorker va-p-hbase-01-c,60020,1369233253404 exiting
  119. 2013-05-22 14:58:58,998 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 29 on 60020: exiting
  120. 2013-05-22 14:58:58,997 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 27 on 60020: exiting
  121. 2013-05-22 14:58:58,997 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 8 on 60020: exiting
  122. 2013-05-22 14:58:58,997 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 17 on 60020: exiting
  123. 2013-05-22 14:58:58,997 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 7 on 60020: exiting
  124. 2013-05-22 14:58:59,016 WARN org.apache.hadoop.ipc.HBaseServer: IPC Server Responder, call get([B@53973d5e, {"timeRange":[0,9223372036854775807],"totalColumns":1,"cacheBlocks":true,"families":{"u":["m"]},"maxVersions":1,"row":"\\x02\\x11\\xF2\\xC7D\\xD4S\\x84U\\x1Cl \\x06,f\\x98\\x7F\\xFF\\xFCD\\xD3r,\\x1F"}), rpc version=1, client version=29, methodsFingerPrint=-1368823753 from 172.16.16.200:45346: output error
  125. 2013-05-22 14:58:59,016 WARN org.apache.hadoop.ipc.HBaseServer: IPC Server Responder, call openScanner([B@73322c12, {"timeRange":[0,9223372036854775807],"batch":-1,"startRow":"\\x9F\\xC4\\xAC\\x00\\xCD|-\\xD5\\x14\\x97,ZO$\\x1B\\x18\\x7F\\xFF\\xFCD\\xD3r,\\x1F","stopRow":"\\x9F\\xC4\\xAC\\x00\\xCD|-\\xD5\\x14\\x97,ZO$\\x1B\\x18\\x7F\\xFF\\xFE\\xC1\\xCC\\xE2\\xFE\\xD5\\xFE","totalColumns":0,"cacheBlocks":true,"families":{},"maxVersions":1,"caching":100}), rpc version=1, client version=29, methodsFingerPrint=-1368823753 from 172.16.24.200:48806: output error
  126. 2013-05-22 14:58:59,017 WARN org.apache.hadoop.ipc.HBaseServer: IPC Server handler 38 on 60020 caught a ClosedChannelException, this means that the server was processing a request but the client went away. The error message was: null
  127. 2013-05-22 14:58:59,017 WARN org.apache.hadoop.ipc.HBaseServer: IPC Server handler 26 on 60020 caught a ClosedChannelException, this means that the server was processing a request but the client went away. The error message was: null
  128. 2013-05-22 14:58:59,018 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 26 on 60020: exiting
  129. 2013-05-22 14:58:59,017 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 38 on 60020: exiting
  130. 2013-05-22 14:58:59,019 WARN org.apache.hadoop.ipc.HBaseServer: IPC Server Responder, call get([B@237d3d09, {"timeRange":[0,9223372036854775807],"totalColumns":1,"cacheBlocks":true,"families":{"u":["m"]},"maxVersions":1,"row":"\\xA2\\x1A[\\xA6wN\\xD2\\xAC\\x90\\x93\\x10H\\x93\\x11\\xB5\\x96\\x7F\\xFF\\xFCD\\xD3r,\\x1F"}), rpc version=1, client version=29, methodsFingerPrint=-1368823753 from 172.16.24.200:48806: output error
  131. 2013-05-22 14:58:59,019 WARN org.apache.hadoop.ipc.HBaseServer: IPC Server handler 25 on 60020 caught a ClosedChannelException, this means that the server was processing a request but the client went away. The error message was: null
  132. 2013-05-22 14:58:59,019 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 25 on 60020: exiting
  133. 2013-05-22 14:58:59,044 INFO org.mortbay.log: Stopped SelectChannelConnector@0.0.0.0:60030
  134. 2013-05-22 14:58:59,045 INFO org.apache.hadoop.hbase.regionserver.MemStoreFlusher: regionserver60020.cacheFlusher exiting
  135. 2013-05-22 14:58:59,046 INFO org.apache.hadoop.hbase.regionserver.snapshot.RegionServerSnapshotManager: Stopping RegionServerSnapshotManager abruptly.
  136. 2013-05-22 14:58:59,046 INFO org.apache.hadoop.hbase.regionserver.LogRoller: LogRoller exiting.
  137. 2013-05-22 14:58:59,046 INFO org.apache.hadoop.hbase.regionserver.HRegionServer$CompactionChecker: regionserver60020.compactionChecker exiting
  138. 2013-05-22 14:58:59,054 INFO org.apache.zookeeper.ZooKeeper: Session: 0x33e84fb7dcc0121 closed
  139. 2013-05-22 14:58:59,054 INFO org.apache.zookeeper.ClientCnxn: EventThread shut down
  140. 2013-05-22 14:58:59,058 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: aborting server va-p-hbase-01-c,60020,1369233253404
  141. 2013-05-22 14:58:59,059 INFO org.apache.hadoop.hbase.regionserver.snapshot.RegionServerSnapshotManager: Stopping RegionServerSnapshotManager abruptly.
  142. 2013-05-22 14:58:59,059 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: Waiting on 15 regions to close
  143. 2013-05-22 14:58:59,112 INFO org.apache.hadoop.hbase.regionserver.Store: Closed info
  144. 2013-05-22 14:58:59,112 INFO org.apache.hadoop.hbase.regionserver.HRegion: Closed -ROOT-,,0.70236052
  145. 2013-05-22 14:58:59,114 INFO org.apache.hadoop.hbase.regionserver.Store: Closed m
  146. 2013-05-22 14:58:59,115 INFO org.apache.hadoop.hbase.regionserver.HRegion: Closed x,\x15@\x00\x00,1363541667782.3ef27c7fad63ecb087890bf79b0d1553.
  147. 2013-05-22 14:58:59,161 INFO org.apache.hadoop.hbase.regionserver.Store: Closed m
  148. 2013-05-22 14:58:59,161 INFO org.apache.hadoop.hbase.regionserver.HRegion: Closed x,\x94\xC0\x00\x00,1366787449573.9bd74e2e8d225374249fe03d9761a4bb.
  149. 2013-05-22 14:58:59,162 INFO org.apache.hadoop.hbase.regionserver.Store: Closed u
  150. 2013-05-22 14:58:59,162 INFO org.apache.hadoop.hbase.regionserver.HRegion: Closed t,T\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFC,1365676551323.877df3f346db7508323b5169f80c74f9.
  151. 2013-05-22 14:58:59,192 INFO org.apache.hadoop.hbase.regionserver.Store: Closed u
  152. 2013-05-22 14:58:59,192 INFO org.apache.hadoop.hbase.regionserver.HRegion: Closed t,\x91+\xBB\xB9?\x07\x8F5j%\xCE\xE4\xFB\xB8\x03\xF5\x7F\xFF\xFE\xC2<\xE9e\xA2,1365678702133.004cd73ae42ccb7939221962ad9f0683.
  153. 2013-05-22 14:58:59,195 INFO org.apache.hadoop.hbase.regionserver.Store: Closed u
  154. 2013-05-22 14:58:59,196 INFO org.apache.hadoop.hbase.regionserver.HRegion: Closed t,c*\xAA\xAA\xAA\xAA\xAA\xAA\xAA\xAA\xAA\xAA\xAA\xAA\xAA\xA6,1365673449134.1e393bfc6f2ffc5854fd45dc7343491a.
  155. 2013-05-22 14:58:59,300 INFO org.apache.hadoop.hbase.regionserver.Store: Closed u
  156. 2013-05-22 14:58:59,300 INFO org.apache.hadoop.hbase.regionserver.HRegion: Closed t,\x9Fa\xE9\x8C\x92\xD7<l\xA1]B\xDC\x15hE\x92\x7F\xFF\xFE\xC2cE\x08\xF9,1365665841269.a225b5eb580a064e6e9bbaf4e707fdcd.
  157. 2013-05-22 14:58:59,309 INFO org.apache.hadoop.hbase.regionserver.Store: Closed u
  158. 2013-05-22 14:58:59,309 INFO org.apache.hadoop.hbase.regionserver.HRegion: Closed t,\xB4\xA2\xC0n\x8A\x95\xF2\x83\xCC\xF7X\xCFv\x166\xBD\x7F\xFF\xFCD\xD3r,\x1F,1365679577226.307e5da004a9e527ec368acfd727741c.
  159. 2013-05-22 14:58:59,329 INFO org.apache.hadoop.hbase.regionserver.Store: Closed u
  160. 2013-05-22 14:58:59,330 INFO org.apache.hadoop.hbase.regionserver.HRegion: Closed t,CJ6K\xFE\xFA;`Xn\x1E\x0F\"\xD9\x1B\x7F\xFF\xFCD\xD3r,\x1F,1365680880843.6c86914244889b033d248e0628f28dcd.
  161. 2013-05-22 14:58:59,350 INFO org.apache.hadoop.hbase.regionserver.Store: Closed u
  162. 2013-05-22 14:58:59,350 INFO org.apache.hadoop.hbase.regionserver.HRegion: Closed t,\xD4\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xF6,1365671116522.7f464acf4e552ce69504e0ad6d6b7a53.
  163. 2013-05-22 14:58:59,368 INFO org.apache.hadoop.hbase.regionserver.Store: Closed u
  164. 2013-05-22 14:58:59,368 INFO org.apache.hadoop.hbase.regionserver.HRegion: Closed t,8\xAA\xAA\xAA\xAA\xAA\xAA\xAA\xAA\xAA\xAA\xAA\xAA\xAA\xAA\xA8,1365679187847.393033b405ffee6303683cbfa0273884.
  165. 2013-05-22 14:58:59,375 INFO org.apache.hadoop.hbase.regionserver.Store: Closed m
  166. 2013-05-22 14:58:59,375 INFO org.apache.hadoop.hbase.regionserver.HRegion: Closed x,?\xC0\x00\x00,1363541667783.4b0b58047668240ac9bb4d85fdf45c4a.
  167. 2013-05-22 14:58:59,387 INFO org.apache.hadoop.hbase.regionserver.Store: Closed u
  168. 2013-05-22 14:58:59,387 INFO org.apache.hadoop.hbase.regionserver.HRegion: Closed t,\x9B\xD5UUUUUUUUUUUUUN,1365665841269.d96a05b56ecc8e9ce0bd743b41a4ce44.
  169. 2013-05-22 14:58:59,387 INFO org.apache.hadoop.hbase.regionserver.Store: Closed u
  170. 2013-05-22 14:58:59,388 INFO org.apache.hadoop.hbase.regionserver.HRegion: Closed t,,1365678423110.b92c72c086066be1de695d4df5876102.
  171. 2013-05-22 14:58:59,400 INFO org.apache.hadoop.hbase.regionserver.Store: Closed u
  172. 2013-05-22 14:58:59,400 INFO org.apache.hadoop.hbase.regionserver.HRegion: Closed t,\xC6UUUUUUUUUUUUUUL,1365674741137.b7dc6ebbebc1fca27d231266521a360f.
  173. 2013-05-22 14:58:59,482 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: stopping server va-p-hbase-01-c,60020,1369233253404; all regions closed.
  174. 2013-05-22 14:58:59,482 INFO org.apache.hadoop.hbase.regionserver.wal.HLog: regionserver60020.logSyncer exiting
  175. 2013-05-22 14:58:59,539 ERROR org.apache.hadoop.hbase.regionserver.HRegionServer: Close and delete failed
  176. org.apache.hadoop.hdfs.server.namenode.LeaseExpiredException: No lease on /hbase/.logs/va-p-hbase-01-c,60020,1369233253404/va-p-hbase-01-c%2C60020%2C1369233253404.1369247658466 File does not exist. Holder DFSClient_NONMAPREDUCE_-267969281_42 does not have any open files.
  177. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkLease(FSNamesystem.java:2396)
  178. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkLease(FSNamesystem.java:2387)
  179. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.completeFileInternal(FSNamesystem.java:2454)
  180. at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.completeFile(FSNamesystem.java:2431)
  181. at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.complete(NameNodeRpcServer.java:536)
  182. at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.complete(ClientNamenodeProtocolServerSideTranslatorPB.java:335)
  183. at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java:44084)
  184. at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:453)
  185. at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1002)
  186. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1695)
  187. at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1691)
  188. at java.security.AccessController.doPrivileged(Native Method)
  189. at javax.security.auth.Subject.doAs(Subject.java:415)
  190. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
  191. at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1689)
  192.  
  193. at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
  194. at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
  195. at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
  196. at java.lang.reflect.Constructor.newInstance(Constructor.java:525)
  197. at org.apache.hadoop.hbase.RemoteExceptionHandler.decodeRemoteException(RemoteExceptionHandler.java:96)
  198. at org.apache.hadoop.hbase.RemoteExceptionHandler.checkThrowable(RemoteExceptionHandler.java:48)
  199. at org.apache.hadoop.hbase.regionserver.HRegionServer.closeWAL(HRegionServer.java:976)
  200. at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:831)
  201. at java.lang.Thread.run(Thread.java:722)
  202. 2013-05-22 14:58:59,540 INFO org.apache.hadoop.hbase.regionserver.Leases: regionserver60020 closing leases
  203. 2013-05-22 14:58:59,540 INFO org.apache.hadoop.hbase.regionserver.Leases: regionserver60020 closed leases
  204. 2013-05-22 14:58:59,540 INFO org.apache.hadoop.hbase.replication.regionserver.ReplicationSource: Closing source 1 because: Region server is closing
  205. 2013-05-22 14:58:59,547 WARN org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper exception: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /hbase/rs/va-p-hbase-01-c,60020,1369233253404
  206. 2013-05-22 14:58:59,547 INFO org.apache.hadoop.hbase.util.RetryCounter: Sleeping 2000ms before retry #1...
  207. 2013-05-22 14:59:00,160 WARN org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper exception: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /hbase/replication/rs/va-p-hbase-01-c,60020,1369233253404/1-va-p-hbase-02-e,60020,1369042377129-va-p-hbase-02-c,60020,1369042377731/va-p-hbase-02-e%2C60020%2C1369042377129.1369220274620
  208. 2013-05-22 14:59:00,160 INFO org.apache.hadoop.hbase.util.RetryCounter: Sleeping 2000ms before retry #1...
  209. 2013-05-22 14:59:00,216 WARN org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper exception: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /hbase/replication/rs/va-p-hbase-01-c,60020,1369233253404/1-va-p-hbase-01-d,60020,1369042382584-va-p-hbase-02-c,60020,1369042377731/va-p-hbase-01-d%2C60020%2C1369042382584.1369218841412
  210. 2013-05-22 14:59:00,216 INFO org.apache.hadoop.hbase.util.RetryCounter: Sleeping 2000ms before retry #1...
  211. 2013-05-22 14:59:00,322 WARN org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper exception: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /hbase/replication/rs/va-p-hbase-01-c,60020,1369233253404/1-va-p-hbase-02-c,60020,1369042377731/va-p-hbase-02-c%2C60020%2C1369042377731.1369219439591
  212. 2013-05-22 14:59:00,322 INFO org.apache.hadoop.hbase.util.RetryCounter: Sleeping 2000ms before retry #1...
  213. 2013-05-22 14:59:00,523 WARN org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper exception: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /hbase/replication/rs/va-p-hbase-01-c,60020,1369233253404/1-va-p-hbase-01-e,60020,1369042368595-va-p-hbase-02-c,60020,1369042377731/va-p-hbase-01-e%2C60020%2C1369042368595.1369222061686
  214. 2013-05-22 14:59:00,523 INFO org.apache.hadoop.hbase.util.RetryCounter: Sleeping 2000ms before retry #1...
  215. 2013-05-22 14:59:01,547 WARN org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper exception: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /hbase/rs/va-p-hbase-01-c,60020,1369233253404
  216. 2013-05-22 14:59:01,548 INFO org.apache.hadoop.hbase.util.RetryCounter: Sleeping 4000ms before retry #2...
  217. 2013-05-22 14:59:02,160 WARN org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper exception: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /hbase/replication/rs/va-p-hbase-01-c,60020,1369233253404/1-va-p-hbase-02-e,60020,1369042377129-va-p-hbase-02-c,60020,1369042377731/va-p-hbase-02-e%2C60020%2C1369042377129.1369220274620
  218. 2013-05-22 14:59:02,161 INFO org.apache.hadoop.hbase.util.RetryCounter: Sleeping 4000ms before retry #2...
  219. 2013-05-22 14:59:02,216 WARN org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper exception: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /hbase/replication/rs/va-p-hbase-01-c,60020,1369233253404/1-va-p-hbase-01-d,60020,1369042382584-va-p-hbase-02-c,60020,1369042377731/va-p-hbase-01-d%2C60020%2C1369042382584.1369218841412
  220. 2013-05-22 14:59:02,216 INFO org.apache.hadoop.hbase.util.RetryCounter: Sleeping 4000ms before retry #2...
  221. 2013-05-22 14:59:02,323 WARN org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper exception: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /hbase/replication/rs/va-p-hbase-01-c,60020,1369233253404/1-va-p-hbase-02-c,60020,1369042377731/va-p-hbase-02-c%2C60020%2C1369042377731.1369219439591
  222. 2013-05-22 14:59:02,323 INFO org.apache.hadoop.hbase.util.RetryCounter: Sleeping 4000ms before retry #2...
  223. 2013-05-22 14:59:02,523 WARN org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper exception: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /hbase/replication/rs/va-p-hbase-01-c,60020,1369233253404/1-va-p-hbase-01-e,60020,1369042368595-va-p-hbase-02-c,60020,1369042377731/va-p-hbase-01-e%2C60020%2C1369042368595.1369222061686
  224. 2013-05-22 14:59:02,523 INFO org.apache.hadoop.hbase.util.RetryCounter: Sleeping 4000ms before retry #2...
  225. 2013-05-22 14:59:03,296 WARN org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper exception: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /hbase/replication/rs/va-p-hbase-01-c,60020,1369233253404/1-va-p-hbase-02-d,60020,1369042368330-va-p-hbase-02-c,60020,1369042377731/va-p-hbase-02-d%2C60020%2C1369042368330.1369221844342
  226. 2013-05-22 14:59:03,296 INFO org.apache.hadoop.hbase.util.RetryCounter: Sleeping 2000ms before retry #1...
  227. 2013-05-22 14:59:04,042 INFO org.apache.hadoop.hbase.regionserver.Leases: regionserver60020.leaseChecker closing leases
  228. 2013-05-22 14:59:04,043 INFO org.apache.hadoop.hbase.regionserver.Leases: regionserver60020.leaseChecker closed leases
  229. 2013-05-22 14:59:05,296 WARN org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper exception: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /hbase/replication/rs/va-p-hbase-01-c,60020,1369233253404/1-va-p-hbase-02-d,60020,1369042368330-va-p-hbase-02-c,60020,1369042377731/va-p-hbase-02-d%2C60020%2C1369042368330.1369221844342
  230. 2013-05-22 14:59:05,296 INFO org.apache.hadoop.hbase.util.RetryCounter: Sleeping 4000ms before retry #2...
  231. 2013-05-22 14:59:05,548 WARN org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper exception: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /hbase/rs/va-p-hbase-01-c,60020,1369233253404
  232. 2013-05-22 14:59:05,548 INFO org.apache.hadoop.hbase.util.RetryCounter: Sleeping 8000ms before retry #3...
  233. 2013-05-22 14:59:06,161 WARN org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper exception: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /hbase/replication/rs/va-p-hbase-01-c,60020,1369233253404/1-va-p-hbase-02-e,60020,1369042377129-va-p-hbase-02-c,60020,1369042377731/va-p-hbase-02-e%2C60020%2C1369042377129.1369220274620
  234. 2013-05-22 14:59:06,161 INFO org.apache.hadoop.hbase.util.RetryCounter: Sleeping 8000ms before retry #3...
  235. 2013-05-22 14:59:06,217 WARN org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper exception: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /hbase/replication/rs/va-p-hbase-01-c,60020,1369233253404/1-va-p-hbase-01-d,60020,1369042382584-va-p-hbase-02-c,60020,1369042377731/va-p-hbase-01-d%2C60020%2C1369042382584.1369218841412
  236. 2013-05-22 14:59:06,217 INFO org.apache.hadoop.hbase.util.RetryCounter: Sleeping 8000ms before retry #3...
  237. 2013-05-22 14:59:06,323 WARN org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper exception: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /hbase/replication/rs/va-p-hbase-01-c,60020,1369233253404/1-va-p-hbase-02-c,60020,1369042377731/va-p-hbase-02-c%2C60020%2C1369042377731.1369219439591
  238. 2013-05-22 14:59:06,323 INFO org.apache.hadoop.hbase.util.RetryCounter: Sleeping 8000ms before retry #3...
  239. 2013-05-22 14:59:06,523 WARN org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper exception: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /hbase/replication/rs/va-p-hbase-01-c,60020,1369233253404/1-va-p-hbase-01-e,60020,1369042368595-va-p-hbase-02-c,60020,1369042377731/va-p-hbase-01-e%2C60020%2C1369042368595.1369222061686
  240. 2013-05-22 14:59:06,523 INFO org.apache.hadoop.hbase.util.RetryCounter: Sleeping 8000ms before retry #3...
  241. 2013-05-22 14:59:09,296 WARN org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper exception: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /hbase/replication/rs/va-p-hbase-01-c,60020,1369233253404/1-va-p-hbase-02-d,60020,1369042368330-va-p-hbase-02-c,60020,1369042377731/va-p-hbase-02-d%2C60020%2C1369042368330.1369221844342
  242. 2013-05-22 14:59:09,297 INFO org.apache.hadoop.hbase.util.RetryCounter: Sleeping 8000ms before retry #3...
  243. 2013-05-22 14:59:13,548 WARN org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper exception: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /hbase/rs/va-p-hbase-01-c,60020,1369233253404
  244. 2013-05-22 14:59:13,549 ERROR org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper: ZooKeeper delete failed after 3 retries
  245. 2013-05-22 14:59:13,549 WARN org.apache.hadoop.hbase.regionserver.HRegionServer: Failed deleting my ephemeral node
  246. org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /hbase/rs/va-p-hbase-01-c,60020,1369233253404
  247. at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
  248. at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
  249. at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
  250. at org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.delete(RecoverableZooKeeper.java:137)
  251. at org.apache.hadoop.hbase.zookeeper.ZKUtil.deleteNode(ZKUtil.java:1215)
  252. at org.apache.hadoop.hbase.zookeeper.ZKUtil.deleteNode(ZKUtil.java:1204)
  253. at org.apache.hadoop.hbase.regionserver.HRegionServer.deleteMyEphemeralNode(HRegionServer.java:1068)
  254. at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:846)
  255. at java.lang.Thread.run(Thread.java:722)
  256. 2013-05-22 14:59:13,549 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: stopping server va-p-hbase-01-c,60020,1369233253404; zookeeper connection closed.
  257. 2013-05-22 14:59:13,549 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: regionserver60020 exiting
  258. 2013-05-22 14:59:13,593 INFO org.apache.hadoop.hbase.regionserver.ShutdownHook: Shutdown hook starting; hbase.shutdown.hook=true; fsShutdownHook=org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@753e9fe4
  259. 2013-05-22 14:59:13,593 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: STOPPED: Shutdown hook
  260. 2013-05-22 14:59:13,593 INFO org.apache.hadoop.hbase.regionserver.ShutdownHook: Starting fs shutdown hook thread.
  261. 2013-05-22 14:59:13,593 INFO org.apache.hadoop.hbase.regionserver.ShutdownHook: Shutdown hook finished.
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!