Advertisement
RuralHunter

dump of rs

Jul 10th, 2014
90
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 247.35 KB | None | 0 0
  1. Master status for slave2,60020,1397552649456 as of Thu Jul 10 16:28:39 CST 2014
  2.  
  3.  
  4. Version Info:
  5. ===========================================================
  6. HBase 0.96.2-hadoop2
  7. Subversion git://ruralhunter-ubt/home/ruralhunter/dev/hbase -r a1609de241144811f1a552381e11051f8c53d000
  8. Compiled by ruralhunter on Fri Apr 4 09:56:23 CST 2014
  9. Hadoop 2.2.0
  10. Subversion Unknown -r Unknown
  11. Compiled by ruralhunter on 2013-12-13T02:53Z
  12.  
  13.  
  14. Tasks:
  15. ===========================================================
  16. Task: RpcServer.handler=0,port=60020
  17. Status: WAITING:Waiting for a call
  18. Running for 7428259s
  19.  
  20. Task: RpcServer.handler=1,port=60020
  21. Status: WAITING:Waiting for a call
  22. Running for 7428259s
  23.  
  24. Task: RpcServer.handler=2,port=60020
  25. Status: WAITING:Waiting for a call
  26. Running for 7428259s
  27.  
  28. Task: RpcServer.handler=3,port=60020
  29. Status: WAITING:Waiting for a call
  30. Running for 7428259s
  31.  
  32. Task: RpcServer.handler=4,port=60020
  33. Status: WAITING:Waiting for a call
  34. Running for 7428259s
  35.  
  36. Task: RpcServer.handler=5,port=60020
  37. Status: WAITING:Waiting for a call
  38. Running for 7428259s
  39.  
  40. Task: RpcServer.handler=6,port=60020
  41. Status: WAITING:Waiting for a call
  42. Running for 7428259s
  43.  
  44. Task: RpcServer.handler=7,port=60020
  45. Status: WAITING:Waiting for a call
  46. Running for 7428259s
  47.  
  48. Task: RpcServer.handler=8,port=60020
  49. Status: WAITING:Waiting for a call
  50. Running for 7428259s
  51.  
  52. Task: RpcServer.handler=9,port=60020
  53. Status: WAITING:Waiting for a call
  54. Running for 7428259s
  55.  
  56. Task: RpcServer.handler=10,port=60020
  57. Status: WAITING:Waiting for a call
  58. Running for 7428259s
  59.  
  60. Task: RpcServer.handler=11,port=60020
  61. Status: WAITING:Waiting for a call
  62. Running for 7428259s
  63.  
  64. Task: RpcServer.handler=12,port=60020
  65. Status: WAITING:Waiting for a call
  66. Running for 7428259s
  67.  
  68. Task: RpcServer.handler=13,port=60020
  69. Status: WAITING:Waiting for a call
  70. Running for 7428259s
  71.  
  72. Task: RpcServer.handler=14,port=60020
  73. Status: RUNNING:Servicing call from 123.183.217.195:53157: Get
  74. Running for 7428259s
  75.  
  76. Task: RpcServer.handler=15,port=60020
  77. Status: WAITING:Waiting for a call
  78. Running for 7428259s
  79.  
  80. Task: RpcServer.handler=16,port=60020
  81. Status: WAITING:Waiting for a call
  82. Running for 7428259s
  83.  
  84. Task: RpcServer.handler=17,port=60020
  85. Status: WAITING:Waiting for a call
  86. Running for 7428259s
  87.  
  88. Task: RpcServer.handler=18,port=60020
  89. Status: WAITING:Waiting for a call
  90. Running for 7428259s
  91.  
  92. Task: RpcServer.handler=19,port=60020
  93. Status: WAITING:Waiting for a call
  94. Running for 7428259s
  95.  
  96. Task: RpcServer.handler=20,port=60020
  97. Status: WAITING:Waiting for a call
  98. Running for 7428259s
  99.  
  100. Task: RpcServer.handler=21,port=60020
  101. Status: WAITING:Waiting for a call
  102. Running for 7428259s
  103.  
  104. Task: RpcServer.handler=22,port=60020
  105. Status: WAITING:Waiting for a call
  106. Running for 7428259s
  107.  
  108. Task: RpcServer.handler=23,port=60020
  109. Status: WAITING:Waiting for a call
  110. Running for 7428259s
  111.  
  112. Task: RpcServer.handler=24,port=60020
  113. Status: WAITING:Waiting for a call
  114. Running for 7428259s
  115.  
  116. Task: RpcServer.handler=25,port=60020
  117. Status: WAITING:Waiting for a call
  118. Running for 7428259s
  119.  
  120. Task: RpcServer.handler=26,port=60020
  121. Status: WAITING:Waiting for a call
  122. Running for 7428259s
  123.  
  124. Task: RpcServer.handler=27,port=60020
  125. Status: WAITING:Waiting for a call
  126. Running for 7428259s
  127.  
  128. Task: RpcServer.handler=28,port=60020
  129. Status: WAITING:Waiting for a call
  130. Running for 7428259s
  131.  
  132. Task: RpcServer.handler=29,port=60020
  133. Status: WAITING:Waiting for a call
  134. Running for 7428259s
  135.  
  136. Task: Priority.RpcServer.handler=0,port=60020
  137. Status: WAITING:Waiting for a call
  138. Running for 7428259s
  139.  
  140. Task: Priority.RpcServer.handler=1,port=60020
  141. Status: WAITING:Waiting for a call
  142. Running for 7428259s
  143.  
  144. Task: Priority.RpcServer.handler=2,port=60020
  145. Status: WAITING:Waiting for a call
  146. Running for 7428259s
  147.  
  148. Task: Priority.RpcServer.handler=3,port=60020
  149. Status: WAITING:Waiting for a call
  150. Running for 7428259s
  151.  
  152. Task: Priority.RpcServer.handler=4,port=60020
  153. Status: WAITING:Waiting for a call
  154. Running for 7428259s
  155.  
  156. Task: Priority.RpcServer.handler=5,port=60020
  157. Status: WAITING:Waiting for a call
  158. Running for 7428259s
  159.  
  160. Task: Priority.RpcServer.handler=6,port=60020
  161. Status: WAITING:Waiting for a call
  162. Running for 7428259s
  163.  
  164. Task: Priority.RpcServer.handler=7,port=60020
  165. Status: WAITING:Waiting for a call
  166. Running for 7428259s
  167.  
  168. Task: Priority.RpcServer.handler=8,port=60020
  169. Status: WAITING:Waiting for a call
  170. Running for 7428259s
  171.  
  172. Task: Priority.RpcServer.handler=9,port=60020
  173. Status: WAITING:Waiting for a call
  174. Running for 7428259s
  175.  
  176. Task: Replication.RpcServer.handler=0,port=60020
  177. Status: WAITING:Waiting for a call
  178. Running for 7428259s
  179.  
  180. Task: Replication.RpcServer.handler=1,port=60020
  181. Status: WAITING:Waiting for a call
  182. Running for 7428259s
  183.  
  184. Task: Replication.RpcServer.handler=2,port=60020
  185. Status: WAITING:Waiting for a call
  186. Running for 7428259s
  187.  
  188.  
  189.  
  190. Executors:
  191. ===========================================================
  192. Status for executor: Executor-3-RS_CLOSE_REGION-slave2:60020
  193. =======================================
  194. 0 events queued, 0 running
  195. Status for executor: Executor-2-RS_OPEN_META-slave2:60020
  196. =======================================
  197. 0 events queued, 0 running
  198. Status for executor: Executor-5-RS_LOG_REPLAY_OPS-slave2:60020
  199. =======================================
  200. 0 events queued, 0 running
  201. Status for executor: Executor-4-RS_CLOSE_META-slave2:60020
  202. =======================================
  203. 0 events queued, 0 running
  204. Status for executor: Executor-1-RS_OPEN_REGION-slave2:60020
  205. =======================================
  206. 0 events queued, 0 running
  207.  
  208.  
  209. Stacks:
  210. ===========================================================
  211. Process Thread Dump:
  212. 101 active threads
  213. Thread 428291 (524695464@qtp-1922766448-9):
  214. State: TIMED_WAITING
  215. Blocked count: 0
  216. Waited count: 1
  217. Stack:
  218. java.lang.Object.wait(Native Method)
  219. org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:626)
  220. Thread 428290 (501028910@qtp-1922766448-8):
  221. State: TIMED_WAITING
  222. Blocked count: 0
  223. Waited count: 1
  224. Stack:
  225. java.lang.Object.wait(Native Method)
  226. org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:626)
  227. Thread 428289 (610366995@qtp-1922766448-7):
  228. State: RUNNABLE
  229. Blocked count: 378
  230. Waited count: 378
  231. Stack:
  232. sun.management.ThreadImpl.getThreadInfo0(Native Method)
  233. sun.management.ThreadImpl.getThreadInfo(ThreadImpl.java:165)
  234. sun.management.ThreadImpl.getThreadInfo(ThreadImpl.java:141)
  235. org.apache.hadoop.util.ReflectionUtils.printThreadInfo(ReflectionUtils.java:165)
  236. org.apache.hadoop.hbase.regionserver.RSDumpServlet.doGet(RSDumpServlet.java:81)
  237. javax.servlet.http.HttpServlet.service(HttpServlet.java:735)
  238. javax.servlet.http.HttpServlet.service(HttpServlet.java:848)
  239. org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)
  240. org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1221)
  241. org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter.doFilter(StaticUserWebFilter.java:109)
  242. org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
  243. org.apache.hadoop.http.HttpServer$QuotingInputFilter.doFilter(HttpServer.java:1081)
  244. org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
  245. org.apache.hadoop.http.NoCacheFilter.doFilter(NoCacheFilter.java:45)
  246. org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
  247. org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
  248. org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
  249. org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
  250. org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
  251. org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
  252. Thread 428237 (ResponseProcessor for block BP-1698879265-127.0.1.1-1386142874396:blk_1074217274_476453):
  253. State: RUNNABLE
  254. Blocked count: 3
  255. Waited count: 0
  256. Stack:
  257. sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  258. sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
  259. sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:83)
  260. sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  261. sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  262. org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335)
  263. org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157)
  264. org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161)
  265. org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131)
  266. org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:118)
  267. java.io.FilterInputStream.read(FilterInputStream.java:83)
  268. java.io.FilterInputStream.read(FilterInputStream.java:83)
  269. org.apache.hadoop.hdfs.protocolPB.PBHelper.vintPrefixed(PBHelper.java:1490)
  270. org.apache.hadoop.hdfs.protocol.datatransfer.PipelineAck.readFields(PipelineAck.java:116)
  271. org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer$ResponseProcessor.run(DFSOutputStream.java:721)
  272. Thread 428236 (DataStreamer for file /hbase/WALs/slave2,60020,1397552649456/slave2%2C60020%2C1397552649456.1404979553888 block BP-1698879265-127.0.1.1-1386142874396:blk_1074217274_476453):
  273. State: TIMED_WAITING
  274. Blocked count: 80521
  275. Waited count: 80520
  276. Stack:
  277. java.lang.Object.wait(Native Method)
  278. org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:491)
  279. Thread 11736 (regionserver60020-largeCompactions-1397752186457):
  280. State: WAITING
  281. Blocked count: 9123
  282. Waited count: 8140
  283. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@298a3176
  284. Stack:
  285. sun.misc.Unsafe.park(Native Method)
  286. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  287. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  288. java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:248)
  289. java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1069)
  290. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1131)
  291. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  292. java.lang.Thread.run(Thread.java:701)
  293. Thread 331 (ReplicationExecutor-0):
  294. State: WAITING
  295. Blocked count: 1
  296. Waited count: 3
  297. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@28681870
  298. Stack:
  299. sun.misc.Unsafe.park(Native Method)
  300. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  301. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  302. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  303. java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1069)
  304. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1131)
  305. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  306. java.lang.Thread.run(Thread.java:701)
  307. Thread 286 (RS_CLOSE_REGION-slave2:60020-2):
  308. State: WAITING
  309. Blocked count: 207
  310. Waited count: 341
  311. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@12790522
  312. Stack:
  313. sun.misc.Unsafe.park(Native Method)
  314. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  315. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  316. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  317. java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1069)
  318. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1131)
  319. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  320. java.lang.Thread.run(Thread.java:701)
  321. Thread 285 (RS_CLOSE_REGION-slave2:60020-1):
  322. State: WAITING
  323. Blocked count: 282
  324. Waited count: 478
  325. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@12790522
  326. Stack:
  327. sun.misc.Unsafe.park(Native Method)
  328. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  329. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  330. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  331. java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1069)
  332. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1131)
  333. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  334. java.lang.Thread.run(Thread.java:701)
  335. Thread 283 (RS_CLOSE_REGION-slave2:60020-0):
  336. State: WAITING
  337. Blocked count: 280
  338. Waited count: 461
  339. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@12790522
  340. Stack:
  341. sun.misc.Unsafe.park(Native Method)
  342. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  343. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  344. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  345. java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1069)
  346. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1131)
  347. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  348. java.lang.Thread.run(Thread.java:701)
  349. Thread 281 (1268931815@qtp-1922766448-5):
  350. State: TIMED_WAITING
  351. Blocked count: 135
  352. Waited count: 123934
  353. Stack:
  354. java.lang.Object.wait(Native Method)
  355. org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:626)
  356. Thread 172 (IPC Parameter Sending Thread #1):
  357. State: TIMED_WAITING
  358. Blocked count: 1313
  359. Waited count: 1797065
  360. Stack:
  361. sun.misc.Unsafe.park(Native Method)
  362. java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
  363. java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:453)
  364. java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:352)
  365. java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:903)
  366. java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1069)
  367. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1131)
  368. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  369. java.lang.Thread.run(Thread.java:701)
  370. Thread 119 (regionserver60020-smallCompactions-1397552664633):
  371. State: WAITING
  372. Blocked count: 909191
  373. Waited count: 1593306
  374. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@1d7daa45
  375. Stack:
  376. sun.misc.Unsafe.park(Native Method)
  377. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  378. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  379. java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:248)
  380. java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1069)
  381. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1131)
  382. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  383. java.lang.Thread.run(Thread.java:701)
  384. Thread 109 (RS_OPEN_REGION-slave2:60020-2):
  385. State: WAITING
  386. Blocked count: 161
  387. Waited count: 203
  388. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@656ffdea
  389. Stack:
  390. sun.misc.Unsafe.park(Native Method)
  391. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  392. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  393. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  394. java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1069)
  395. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1131)
  396. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  397. java.lang.Thread.run(Thread.java:701)
  398. Thread 108 (RS_OPEN_REGION-slave2:60020-1):
  399. State: WAITING
  400. Blocked count: 165
  401. Waited count: 210
  402. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@656ffdea
  403. Stack:
  404. sun.misc.Unsafe.park(Native Method)
  405. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  406. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  407. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  408. java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1069)
  409. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1131)
  410. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  411. java.lang.Thread.run(Thread.java:701)
  412. Thread 107 (RS_OPEN_REGION-slave2:60020-0):
  413. State: WAITING
  414. Blocked count: 188
  415. Waited count: 244
  416. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@656ffdea
  417. Stack:
  418. sun.misc.Unsafe.park(Native Method)
  419. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  420. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  421. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  422. java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1069)
  423. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1131)
  424. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  425. java.lang.Thread.run(Thread.java:701)
  426. Thread 106 (FileInputStreamCache Cleaner):
  427. State: TIMED_WAITING
  428. Blocked count: 83
  429. Waited count: 107413244
  430. Stack:
  431. sun.misc.Unsafe.park(Native Method)
  432. java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
  433. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2081)
  434. java.util.concurrent.DelayQueue.take(DelayQueue.java:193)
  435. java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:688)
  436. java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:681)
  437. java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1069)
  438. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1131)
  439. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  440. java.lang.Thread.run(Thread.java:701)
  441. Thread 105 (org.apache.hadoop.hdfs.PeerCache@378feca1):
  442. State: TIMED_WAITING
  443. Blocked count: 2
  444. Waited count: 61901
  445. Stack:
  446. java.lang.Thread.sleep(Native Method)
  447. org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:252)
  448. org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:39)
  449. org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:135)
  450. java.lang.Thread.run(Thread.java:701)
  451. Thread 104 (SplitLogWorker-slave2,60020,1397552649456):
  452. State: TIMED_WAITING
  453. Blocked count: 2
  454. Waited count: 1485491
  455. Stack:
  456. java.lang.Object.wait(Native Method)
  457. org.apache.hadoop.hbase.regionserver.SplitLogWorker.taskLoop(SplitLogWorker.java:265)
  458. org.apache.hadoop.hbase.regionserver.SplitLogWorker.run(SplitLogWorker.java:209)
  459. java.lang.Thread.run(Thread.java:701)
  460. Thread 103 (Replication.RpcServer.handler=2,port=60020):
  461. State: WAITING
  462. Blocked count: 0
  463. Waited count: 1
  464. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@1f360e8
  465. Stack:
  466. sun.misc.Unsafe.park(Native Method)
  467. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  468. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  469. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  470. org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1858)
  471. Thread 102 (Replication.RpcServer.handler=1,port=60020):
  472. State: WAITING
  473. Blocked count: 0
  474. Waited count: 1
  475. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@1f360e8
  476. Stack:
  477. sun.misc.Unsafe.park(Native Method)
  478. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  479. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  480. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  481. org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1858)
  482. Thread 101 (Replication.RpcServer.handler=0,port=60020):
  483. State: WAITING
  484. Blocked count: 0
  485. Waited count: 1
  486. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@1f360e8
  487. Stack:
  488. sun.misc.Unsafe.park(Native Method)
  489. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  490. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  491. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  492. org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1858)
  493. Thread 100 (Priority.RpcServer.handler=9,port=60020):
  494. State: WAITING
  495. Blocked count: 1
  496. Waited count: 6
  497. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@4f65d04f
  498. Stack:
  499. sun.misc.Unsafe.park(Native Method)
  500. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  501. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  502. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  503. org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1858)
  504. Thread 99 (Priority.RpcServer.handler=8,port=60020):
  505. State: WAITING
  506. Blocked count: 2
  507. Waited count: 7
  508. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@4f65d04f
  509. Stack:
  510. sun.misc.Unsafe.park(Native Method)
  511. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  512. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  513. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  514. org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1858)
  515. Thread 98 (Priority.RpcServer.handler=7,port=60020):
  516. State: WAITING
  517. Blocked count: 2
  518. Waited count: 7
  519. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@4f65d04f
  520. Stack:
  521. sun.misc.Unsafe.park(Native Method)
  522. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  523. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  524. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  525. org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1858)
  526. Thread 97 (Priority.RpcServer.handler=6,port=60020):
  527. State: WAITING
  528. Blocked count: 4
  529. Waited count: 7
  530. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@4f65d04f
  531. Stack:
  532. sun.misc.Unsafe.park(Native Method)
  533. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  534. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  535. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  536. org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1858)
  537. Thread 96 (Priority.RpcServer.handler=5,port=60020):
  538. State: WAITING
  539. Blocked count: 4
  540. Waited count: 7
  541. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@4f65d04f
  542. Stack:
  543. sun.misc.Unsafe.park(Native Method)
  544. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  545. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  546. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  547. org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1858)
  548. Thread 95 (Priority.RpcServer.handler=4,port=60020):
  549. State: WAITING
  550. Blocked count: 5
  551. Waited count: 7
  552. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@4f65d04f
  553. Stack:
  554. sun.misc.Unsafe.park(Native Method)
  555. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  556. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  557. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  558. org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1858)
  559. Thread 94 (Priority.RpcServer.handler=3,port=60020):
  560. State: WAITING
  561. Blocked count: 10
  562. Waited count: 19
  563. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@4f65d04f
  564. Stack:
  565. sun.misc.Unsafe.park(Native Method)
  566. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  567. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  568. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  569. org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1858)
  570. Thread 93 (Priority.RpcServer.handler=2,port=60020):
  571. State: WAITING
  572. Blocked count: 2
  573. Waited count: 7
  574. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@4f65d04f
  575. Stack:
  576. sun.misc.Unsafe.park(Native Method)
  577. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  578. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  579. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  580. org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1858)
  581. Thread 92 (Priority.RpcServer.handler=1,port=60020):
  582. State: WAITING
  583. Blocked count: 2
  584. Waited count: 7
  585. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@4f65d04f
  586. Stack:
  587. sun.misc.Unsafe.park(Native Method)
  588. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  589. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  590. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  591. org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1858)
  592. Thread 91 (Priority.RpcServer.handler=0,port=60020):
  593. State: WAITING
  594. Blocked count: 3
  595. Waited count: 7
  596. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@4f65d04f
  597. Stack:
  598. sun.misc.Unsafe.park(Native Method)
  599. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  600. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  601. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  602. org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1858)
  603. Thread 90 (RpcServer.handler=29,port=60020):
  604. State: WAITING
  605. Blocked count: 84271043
  606. Waited count: 273126718
  607. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@b4f554c
  608. Stack:
  609. sun.misc.Unsafe.park(Native Method)
  610. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  611. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  612. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  613. org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1858)
  614. Thread 89 (RpcServer.handler=28,port=60020):
  615. State: RUNNABLE
  616. Blocked count: 84236070
  617. Waited count: 273097329
  618. Stack:
  619. org.apache.hadoop.hbase.io.hfile.HFileReaderV2$ScannerV2.blockSeek(HFileReaderV2.java:872)
  620. org.apache.hadoop.hbase.io.hfile.HFileReaderV2$ScannerV2.loadBlockAndSeekToKey(HFileReaderV2.java:765)
  621. org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.seekTo(HFileReaderV2.java:481)
  622. org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.reseekTo(HFileReaderV2.java:522)
  623. org.apache.hadoop.hbase.regionserver.StoreFileScanner.reseekAtOrAfter(StoreFileScanner.java:245)
  624. org.apache.hadoop.hbase.regionserver.StoreFileScanner.reseek(StoreFileScanner.java:166)
  625. org.apache.hadoop.hbase.regionserver.StoreFileScanner.enforceSeek(StoreFileScanner.java:361)
  626. org.apache.hadoop.hbase.regionserver.KeyValueHeap.pollRealKV(KeyValueHeap.java:336)
  627. org.apache.hadoop.hbase.regionserver.KeyValueHeap.generalizedSeek(KeyValueHeap.java:293)
  628. org.apache.hadoop.hbase.regionserver.KeyValueHeap.requestSeek(KeyValueHeap.java:258)
  629. org.apache.hadoop.hbase.regionserver.StoreScanner.reseek(StoreScanner.java:632)
  630. org.apache.hadoop.hbase.regionserver.StoreScanner.next(StoreScanner.java:495)
  631. org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:129)
  632. org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.populateResult(HRegion.java:3647)
  633. org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:3727)
  634. org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:3592)
  635. org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.next(HRegion.java:3574)
  636. org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.next(HRegion.java:3557)
  637. org.apache.hadoop.hbase.regionserver.HRegion.get(HRegion.java:4541)
  638. org.apache.hadoop.hbase.regionserver.HRegion.get(HRegion.java:4515)
  639. Thread 88 (RpcServer.handler=27,port=60020):
  640. State: WAITING
  641. Blocked count: 84236717
  642. Waited count: 273099074
  643. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@b4f554c
  644. Stack:
  645. sun.misc.Unsafe.park(Native Method)
  646. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  647. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  648. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  649. org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1858)
  650. Thread 87 (RpcServer.handler=26,port=60020):
  651. State: WAITING
  652. Blocked count: 84199789
  653. Waited count: 273069353
  654. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@b4f554c
  655. Stack:
  656. sun.misc.Unsafe.park(Native Method)
  657. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  658. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  659. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  660. org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1858)
  661. Thread 86 (RpcServer.handler=25,port=60020):
  662. State: WAITING
  663. Blocked count: 84288895
  664. Waited count: 273150255
  665. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@b4f554c
  666. Stack:
  667. sun.misc.Unsafe.park(Native Method)
  668. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  669. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  670. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  671. org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1858)
  672. Thread 85 (RpcServer.handler=24,port=60020):
  673. State: WAITING
  674. Blocked count: 84283314
  675. Waited count: 273142245
  676. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@b4f554c
  677. Stack:
  678. sun.misc.Unsafe.park(Native Method)
  679. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  680. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  681. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  682. org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1858)
  683. Thread 84 (RpcServer.handler=23,port=60020):
  684. State: WAITING
  685. Blocked count: 84251640
  686. Waited count: 273117292
  687. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@b4f554c
  688. Stack:
  689. sun.misc.Unsafe.park(Native Method)
  690. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  691. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  692. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  693. org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1858)
  694. Thread 83 (RpcServer.handler=22,port=60020):
  695. State: WAITING
  696. Blocked count: 84274996
  697. Waited count: 273140156
  698. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@b4f554c
  699. Stack:
  700. sun.misc.Unsafe.park(Native Method)
  701. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  702. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  703. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  704. org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1858)
  705. Thread 82 (RpcServer.handler=21,port=60020):
  706. State: WAITING
  707. Blocked count: 84253561
  708. Waited count: 273121889
  709. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@b4f554c
  710. Stack:
  711. sun.misc.Unsafe.park(Native Method)
  712. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  713. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  714. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  715. org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1858)
  716. Thread 81 (RpcServer.handler=20,port=60020):
  717. State: WAITING
  718. Blocked count: 84268315
  719. Waited count: 273134493
  720. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@b4f554c
  721. Stack:
  722. sun.misc.Unsafe.park(Native Method)
  723. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  724. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  725. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  726. org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1858)
  727. Thread 80 (RpcServer.handler=19,port=60020):
  728. State: WAITING
  729. Blocked count: 84242346
  730. Waited count: 273110972
  731. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@b4f554c
  732. Stack:
  733. sun.misc.Unsafe.park(Native Method)
  734. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  735. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  736. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  737. org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1858)
  738. Thread 79 (RpcServer.handler=18,port=60020):
  739. State: WAITING
  740. Blocked count: 84278948
  741. Waited count: 273146128
  742. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@b4f554c
  743. Stack:
  744. sun.misc.Unsafe.park(Native Method)
  745. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  746. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  747. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  748. org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1858)
  749. Thread 78 (RpcServer.handler=17,port=60020):
  750. State: WAITING
  751. Blocked count: 84252249
  752. Waited count: 273123444
  753. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@b4f554c
  754. Stack:
  755. sun.misc.Unsafe.park(Native Method)
  756. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  757. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  758. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  759. org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1858)
  760. Thread 77 (RpcServer.handler=16,port=60020):
  761. State: WAITING
  762. Blocked count: 84251496
  763. Waited count: 273118194
  764. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@b4f554c
  765. Stack:
  766. sun.misc.Unsafe.park(Native Method)
  767. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  768. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  769. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  770. org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1858)
  771. Thread 76 (RpcServer.handler=15,port=60020):
  772. State: WAITING
  773. Blocked count: 84242909
  774. Waited count: 273105339
  775. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@b4f554c
  776. Stack:
  777. sun.misc.Unsafe.park(Native Method)
  778. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  779. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  780. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  781. org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1858)
  782. Thread 75 (RpcServer.handler=14,port=60020):
  783. State: WAITING
  784. Blocked count: 84249449
  785. Waited count: 273115795
  786. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@b4f554c
  787. Stack:
  788. sun.misc.Unsafe.park(Native Method)
  789. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  790. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  791. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  792. org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1858)
  793. Thread 74 (RpcServer.handler=13,port=60020):
  794. State: WAITING
  795. Blocked count: 84280051
  796. Waited count: 273150479
  797. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@b4f554c
  798. Stack:
  799. sun.misc.Unsafe.park(Native Method)
  800. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  801. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  802. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  803. org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1858)
  804. Thread 73 (RpcServer.handler=12,port=60020):
  805. State: WAITING
  806. Blocked count: 84267742
  807. Waited count: 273132588
  808. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@b4f554c
  809. Stack:
  810. sun.misc.Unsafe.park(Native Method)
  811. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  812. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  813. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  814. org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1858)
  815. Thread 72 (RpcServer.handler=11,port=60020):
  816. State: WAITING
  817. Blocked count: 84285131
  818. Waited count: 273151637
  819. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@b4f554c
  820. Stack:
  821. sun.misc.Unsafe.park(Native Method)
  822. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  823. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  824. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  825. org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1858)
  826. Thread 71 (RpcServer.handler=10,port=60020):
  827. State: WAITING
  828. Blocked count: 84287850
  829. Waited count: 273151757
  830. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@b4f554c
  831. Stack:
  832. sun.misc.Unsafe.park(Native Method)
  833. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  834. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  835. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  836. org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1858)
  837. Thread 70 (RpcServer.handler=9,port=60020):
  838. State: WAITING
  839. Blocked count: 84247807
  840. Waited count: 273114644
  841. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@b4f554c
  842. Stack:
  843. sun.misc.Unsafe.park(Native Method)
  844. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  845. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  846. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  847. org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1858)
  848. Thread 69 (RpcServer.handler=8,port=60020):
  849. State: WAITING
  850. Blocked count: 84286830
  851. Waited count: 273148550
  852. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@b4f554c
  853. Stack:
  854. sun.misc.Unsafe.park(Native Method)
  855. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  856. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  857. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  858. org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1858)
  859. Thread 68 (RpcServer.handler=7,port=60020):
  860. State: WAITING
  861. Blocked count: 84281548
  862. Waited count: 273147117
  863. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@b4f554c
  864. Stack:
  865. sun.misc.Unsafe.park(Native Method)
  866. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  867. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  868. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  869. org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1858)
  870. Thread 67 (RpcServer.handler=6,port=60020):
  871. State: WAITING
  872. Blocked count: 84247421
  873. Waited count: 273112739
  874. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@b4f554c
  875. Stack:
  876. sun.misc.Unsafe.park(Native Method)
  877. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  878. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  879. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  880. org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1858)
  881. Thread 66 (RpcServer.handler=5,port=60020):
  882. State: WAITING
  883. Blocked count: 84227433
  884. Waited count: 273100732
  885. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@b4f554c
  886. Stack:
  887. sun.misc.Unsafe.park(Native Method)
  888. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  889. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  890. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  891. org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1858)
  892. Thread 65 (RpcServer.handler=4,port=60020):
  893. State: WAITING
  894. Blocked count: 84215546
  895. Waited count: 273084005
  896. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@b4f554c
  897. Stack:
  898. sun.misc.Unsafe.park(Native Method)
  899. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  900. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  901. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  902. org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1858)
  903. Thread 64 (RpcServer.handler=3,port=60020):
  904. State: WAITING
  905. Blocked count: 84195448
  906. Waited count: 273064032
  907. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@b4f554c
  908. Stack:
  909. sun.misc.Unsafe.park(Native Method)
  910. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  911. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  912. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  913. org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1858)
  914. Thread 63 (RpcServer.handler=2,port=60020):
  915. State: WAITING
  916. Blocked count: 84205929
  917. Waited count: 273071865
  918. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@b4f554c
  919. Stack:
  920. sun.misc.Unsafe.park(Native Method)
  921. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  922. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  923. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  924. org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1858)
  925. Thread 62 (RpcServer.handler=1,port=60020):
  926. State: WAITING
  927. Blocked count: 84219629
  928. Waited count: 273085824
  929. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@b4f554c
  930. Stack:
  931. sun.misc.Unsafe.park(Native Method)
  932. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  933. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  934. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  935. org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1858)
  936. Thread 61 (RpcServer.handler=0,port=60020):
  937. State: WAITING
  938. Blocked count: 84276907
  939. Waited count: 273141187
  940. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@b4f554c
  941. Stack:
  942. sun.misc.Unsafe.park(Native Method)
  943. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  944. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  945. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  946. org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1858)
  947. Thread 12 (RpcServer.listener,port=60020):
  948. State: BLOCKED
  949. Blocked count: 123264191
  950. Waited count: 0
  951. Blocked on org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader@77f87716
  952. Blocked by 14 (RpcServer.reader=1,port=60020)
  953. Stack:
  954. org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.registerChannel(RpcServer.java:598)
  955. org.apache.hadoop.hbase.ipc.RpcServer$Listener.doAccept(RpcServer.java:755)
  956. org.apache.hadoop.hbase.ipc.RpcServer$Listener.run(RpcServer.java:673)
  957. Thread 24 (RpcServer.responder):
  958. State: RUNNABLE
  959. Blocked count: 18731
  960. Waited count: 14442
  961. Stack:
  962. sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  963. sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
  964. sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:83)
  965. sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  966. sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  967. org.apache.hadoop.hbase.ipc.RpcServer$Responder.doRunLoop(RpcServer.java:857)
  968. org.apache.hadoop.hbase.ipc.RpcServer$Responder.run(RpcServer.java:840)
  969. Thread 60 (slave2:60020Replication Statistics #0):
  970. State: TIMED_WAITING
  971. Blocked count: 0
  972. Waited count: 24847
  973. Stack:
  974. sun.misc.Unsafe.park(Native Method)
  975. java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
  976. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2081)
  977. java.util.concurrent.DelayQueue.take(DelayQueue.java:193)
  978. java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:688)
  979. java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:681)
  980. java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1069)
  981. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1131)
  982. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  983. java.lang.Thread.run(Thread.java:701)
  984. Thread 58 (regionserver60020-EventThread):
  985. State: WAITING
  986. Blocked count: 0
  987. Waited count: 3
  988. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@6c6dcb8c
  989. Stack:
  990. sun.misc.Unsafe.park(Native Method)
  991. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  992. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  993. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  994. org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  995. Thread 57 (regionserver60020-SendThread(slave2:2181)):
  996. State: RUNNABLE
  997. Blocked count: 0
  998. Waited count: 0
  999. Stack:
  1000. sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  1001. sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
  1002. sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:83)
  1003. sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  1004. sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  1005. org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
  1006. org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  1007. Thread 42 (regionserver60020.leaseChecker):
  1008. State: TIMED_WAITING
  1009. Blocked count: 0
  1010. Waited count: 742775
  1011. Stack:
  1012. java.lang.Thread.sleep(Native Method)
  1013. org.apache.hadoop.hbase.regionserver.Leases.run(Leases.java:95)
  1014. java.lang.Thread.run(Thread.java:701)
  1015. Thread 41 (regionserver60020.periodicFlusher):
  1016. State: TIMED_WAITING
  1017. Blocked count: 0
  1018. Waited count: 742848
  1019. Stack:
  1020. java.lang.Object.wait(Native Method)
  1021. org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:92)
  1022. org.apache.hadoop.hbase.Chore.run(Chore.java:88)
  1023. java.lang.Thread.run(Thread.java:701)
  1024. Thread 40 (regionserver60020.compactionChecker):
  1025. State: TIMED_WAITING
  1026. Blocked count: 0
  1027. Waited count: 743270
  1028. Stack:
  1029. java.lang.Object.wait(Native Method)
  1030. org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:92)
  1031. org.apache.hadoop.hbase.Chore.run(Chore.java:88)
  1032. java.lang.Thread.run(Thread.java:701)
  1033. Thread 54 (MemStoreFlusher.0):
  1034. State: TIMED_WAITING
  1035. Blocked count: 1057882
  1036. Waited count: 2605436
  1037. Stack:
  1038. sun.misc.Unsafe.park(Native Method)
  1039. java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
  1040. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2081)
  1041. java.util.concurrent.DelayQueue.poll(DelayQueue.java:230)
  1042. java.util.concurrent.DelayQueue.poll(DelayQueue.java:68)
  1043. org.apache.hadoop.hbase.regionserver.MemStoreFlusher$FlushHandler.run(MemStoreFlusher.java:233)
  1044. java.lang.Thread.run(Thread.java:701)
  1045. Thread 48 (regionserver60020.logRoller):
  1046. State: TIMED_WAITING
  1047. Blocked count: 37990
  1048. Waited count: 800163
  1049. Stack:
  1050. java.lang.Object.wait(Native Method)
  1051. org.apache.hadoop.hbase.regionserver.LogRoller.run(LogRoller.java:78)
  1052. java.lang.Thread.run(Thread.java:701)
  1053. Thread 53 (HBase-Metrics2-1):
  1054. State: TIMED_WAITING
  1055. Blocked count: 506
  1056. Waited count: 2141254
  1057. Stack:
  1058. sun.misc.Unsafe.park(Native Method)
  1059. java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
  1060. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2081)
  1061. java.util.concurrent.DelayQueue.take(DelayQueue.java:193)
  1062. java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:688)
  1063. java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:681)
  1064. java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1069)
  1065. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1131)
  1066. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  1067. java.lang.Thread.run(Thread.java:701)
  1068. Thread 49 (regionserver60020.logSyncer):
  1069. State: TIMED_WAITING
  1070. Blocked count: 1247358
  1071. Waited count: 8645724
  1072. Stack:
  1073. java.lang.Object.wait(Native Method)
  1074. org.apache.hadoop.hbase.regionserver.wal.FSHLog$LogSyncer.run(FSHLog.java:985)
  1075. java.lang.Thread.run(Thread.java:701)
  1076. Thread 51 (LeaseRenewer:hadoop@master:9000):
  1077. State: TIMED_WAITING
  1078. Blocked count: 246624
  1079. Waited count: 7916334
  1080. Stack:
  1081. java.lang.Thread.sleep(Native Method)
  1082. org.apache.hadoop.hdfs.LeaseRenewer.run(LeaseRenewer.java:438)
  1083. org.apache.hadoop.hdfs.LeaseRenewer.access$700(LeaseRenewer.java:71)
  1084. org.apache.hadoop.hdfs.LeaseRenewer$1.run(LeaseRenewer.java:298)
  1085. java.lang.Thread.run(Thread.java:701)
  1086. Thread 45 (IPC Client (1506367663) connection to master/192.168.2.86:60000 from hadoop):
  1087. State: TIMED_WAITING
  1088. Blocked count: 2476819
  1089. Waited count: 2472881
  1090. Stack:
  1091. java.lang.Object.wait(Native Method)
  1092. org.apache.hadoop.hbase.ipc.RpcClient$Connection.waitForWork(RpcClient.java:675)
  1093. org.apache.hadoop.hbase.ipc.RpcClient$Connection.run(RpcClient.java:721)
  1094. Thread 44 (JvmPauseMonitor):
  1095. State: TIMED_WAITING
  1096. Blocked count: 10
  1097. Waited count: 14839303
  1098. Stack:
  1099. java.lang.Thread.sleep(Native Method)
  1100. org.apache.hadoop.hbase.util.JvmPauseMonitor$Monitor.run(JvmPauseMonitor.java:159)
  1101. java.lang.Thread.run(Thread.java:701)
  1102. Thread 39 (regionserver60020-EventThread):
  1103. State: WAITING
  1104. Blocked count: 0
  1105. Waited count: 3
  1106. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@79d25421
  1107. Stack:
  1108. sun.misc.Unsafe.park(Native Method)
  1109. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  1110. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  1111. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  1112. org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  1113. Thread 38 (regionserver60020-SendThread(slave3:2181)):
  1114. State: RUNNABLE
  1115. Blocked count: 1
  1116. Waited count: 0
  1117. Stack:
  1118. sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  1119. sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
  1120. sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:83)
  1121. sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  1122. sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  1123. org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
  1124. org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  1125. Thread 34 (regionserver60020-EventThread):
  1126. State: WAITING
  1127. Blocked count: 17
  1128. Waited count: 25
  1129. Waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@562a5d9e
  1130. Stack:
  1131. sun.misc.Unsafe.park(Native Method)
  1132. java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  1133. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  1134. java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
  1135. org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  1136. Thread 33 (regionserver60020-SendThread(slave3:2181)):
  1137. State: RUNNABLE
  1138. Blocked count: 20
  1139. Waited count: 17
  1140. Stack:
  1141. sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  1142. sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
  1143. sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:83)
  1144. sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  1145. sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  1146. org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
  1147. org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  1148. Thread 32 (regionserver60020):
  1149. State: TIMED_WAITING
  1150. Blocked count: 2472967
  1151. Waited count: 4946173
  1152. Stack:
  1153. java.lang.Object.wait(Native Method)
  1154. org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:92)
  1155. org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:56)
  1156. org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:851)
  1157. java.lang.Thread.run(Thread.java:701)
  1158. Thread 31 (Timer-0):
  1159. State: TIMED_WAITING
  1160. Blocked count: 0
  1161. Waited count: 247605
  1162. Stack:
  1163. java.lang.Object.wait(Native Method)
  1164. java.util.TimerThread.mainLoop(Timer.java:531)
  1165. java.util.TimerThread.run(Timer.java:484)
  1166. Thread 30 (1621366179@qtp-1922766448-1 - Acceptor0 SelectChannelConnector@0.0.0.0:60030):
  1167. State: RUNNABLE
  1168. Blocked count: 12
  1169. Waited count: 4
  1170. Stack:
  1171. sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  1172. sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
  1173. sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:83)
  1174. sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  1175. sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  1176. org.mortbay.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:498)
  1177. org.mortbay.io.nio.SelectorManager.doSelect(SelectorManager.java:192)
  1178. org.mortbay.jetty.nio.SelectChannelConnector.accept(SelectChannelConnector.java:124)
  1179. org.mortbay.jetty.AbstractConnector$Acceptor.run(AbstractConnector.java:708)
  1180. org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
  1181. Thread 27 (LruStats #0):
  1182. State: TIMED_WAITING
  1183. Blocked count: 0
  1184. Waited count: 24847
  1185. Stack:
  1186. sun.misc.Unsafe.park(Native Method)
  1187. java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
  1188. java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2081)
  1189. java.util.concurrent.DelayQueue.take(DelayQueue.java:193)
  1190. java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:688)
  1191. java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:681)
  1192. java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1069)
  1193. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1131)
  1194. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  1195. java.lang.Thread.run(Thread.java:701)
  1196. Thread 25 (main.LruBlockCache.EvictionThread):
  1197. State: WAITING
  1198. Blocked count: 1625925
  1199. Waited count: 1625875
  1200. Waiting on org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread@4ff66cbc
  1201. Stack:
  1202. java.lang.Object.wait(Native Method)
  1203. java.lang.Object.wait(Object.java:502)
  1204. org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:666)
  1205. java.lang.Thread.run(Thread.java:701)
  1206. Thread 23 (Timer for 'HBase' metrics system):
  1207. State: TIMED_WAITING
  1208. Blocked count: 1
  1209. Waited count: 742829
  1210. Stack:
  1211. java.lang.Object.wait(Native Method)
  1212. java.util.TimerThread.mainLoop(Timer.java:531)
  1213. java.util.TimerThread.run(Timer.java:484)
  1214. Thread 22 (RpcServer.reader=9,port=60020):
  1215. State: RUNNABLE
  1216. Blocked count: 12512800
  1217. Waited count: 12830539
  1218. Stack:
  1219. sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  1220. sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
  1221. sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:83)
  1222. sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  1223. sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  1224. sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102)
  1225. org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:557)
  1226. org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:543)
  1227. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
  1228. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  1229. java.lang.Thread.run(Thread.java:701)
  1230. Thread 21 (RpcServer.reader=8,port=60020):
  1231. State: RUNNABLE
  1232. Blocked count: 12517530
  1233. Waited count: 12857056
  1234. Stack:
  1235. sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  1236. sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
  1237. sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:83)
  1238. sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  1239. sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  1240. sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102)
  1241. org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:557)
  1242. org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:543)
  1243. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
  1244. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  1245. java.lang.Thread.run(Thread.java:701)
  1246. Thread 20 (RpcServer.reader=7,port=60020):
  1247. State: RUNNABLE
  1248. Blocked count: 12510673
  1249. Waited count: 12904831
  1250. Stack:
  1251. sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  1252. sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
  1253. sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:83)
  1254. sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  1255. sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  1256. sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102)
  1257. org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:557)
  1258. org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:543)
  1259. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
  1260. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  1261. java.lang.Thread.run(Thread.java:701)
  1262. Thread 19 (RpcServer.reader=6,port=60020):
  1263. State: RUNNABLE
  1264. Blocked count: 12507371
  1265. Waited count: 12851928
  1266. Stack:
  1267. sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  1268. sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
  1269. sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:83)
  1270. sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  1271. sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  1272. sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102)
  1273. org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:557)
  1274. org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:543)
  1275. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
  1276. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  1277. java.lang.Thread.run(Thread.java:701)
  1278. Thread 18 (RpcServer.reader=5,port=60020):
  1279. State: RUNNABLE
  1280. Blocked count: 12502241
  1281. Waited count: 12898142
  1282. Stack:
  1283. sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  1284. sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
  1285. sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:83)
  1286. sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  1287. sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  1288. sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102)
  1289. org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:557)
  1290. org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:543)
  1291. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
  1292. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  1293. java.lang.Thread.run(Thread.java:701)
  1294. Thread 17 (RpcServer.reader=4,port=60020):
  1295. State: RUNNABLE
  1296. Blocked count: 12496015
  1297. Waited count: 12906015
  1298. Stack:
  1299. sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  1300. sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
  1301. sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:83)
  1302. sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  1303. sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  1304. sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102)
  1305. org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:557)
  1306. org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:543)
  1307. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
  1308. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  1309. java.lang.Thread.run(Thread.java:701)
  1310. Thread 16 (RpcServer.reader=3,port=60020):
  1311. State: RUNNABLE
  1312. Blocked count: 12500159
  1313. Waited count: 12832412
  1314. Stack:
  1315. sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  1316. sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
  1317. sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:83)
  1318. sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  1319. sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  1320. sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102)
  1321. org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:557)
  1322. org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:543)
  1323. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
  1324. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  1325. java.lang.Thread.run(Thread.java:701)
  1326. Thread 15 (RpcServer.reader=2,port=60020):
  1327. State: RUNNABLE
  1328. Blocked count: 12510789
  1329. Waited count: 12920782
  1330. Stack:
  1331. sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  1332. sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
  1333. sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:83)
  1334. sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  1335. sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  1336. sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102)
  1337. org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:557)
  1338. org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:543)
  1339. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
  1340. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  1341. java.lang.Thread.run(Thread.java:701)
  1342. Thread 14 (RpcServer.reader=1,port=60020):
  1343. State: RUNNABLE
  1344. Blocked count: 12510492
  1345. Waited count: 12826560
  1346. Stack:
  1347. sun.nio.ch.FileDispatcher.read0(Native Method)
  1348. sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
  1349. sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:251)
  1350. sun.nio.ch.IOUtil.read(IOUtil.java:224)
  1351. sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:254)
  1352. org.apache.hadoop.hbase.ipc.RpcServer.channelIO(RpcServer.java:2438)
  1353. org.apache.hadoop.hbase.ipc.RpcServer.channelRead(RpcServer.java:2404)
  1354. org.apache.hadoop.hbase.ipc.RpcServer$Connection.readAndProcess(RpcServer.java:1498)
  1355. org.apache.hadoop.hbase.ipc.RpcServer$Listener.doRead(RpcServer.java:780)
  1356. org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:568)
  1357. org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:543)
  1358. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
  1359. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  1360. java.lang.Thread.run(Thread.java:701)
  1361. Thread 13 (RpcServer.reader=0,port=60020):
  1362. State: RUNNABLE
  1363. Blocked count: 12503741
  1364. Waited count: 12841613
  1365. Stack:
  1366. sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  1367. sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
  1368. sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:83)
  1369. sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  1370. sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  1371. sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102)
  1372. org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:557)
  1373. org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:543)
  1374. java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
  1375. java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  1376. java.lang.Thread.run(Thread.java:701)
  1377. Thread 5 (Signal Dispatcher):
  1378. State: RUNNABLE
  1379. Blocked count: 0
  1380. Waited count: 0
  1381. Stack:
  1382. Thread 3 (Finalizer):
  1383. State: WAITING
  1384. Blocked count: 1383051
  1385. Waited count: 317356
  1386. Waiting on java.lang.ref.ReferenceQueue$Lock@64e265d0
  1387. Stack:
  1388. java.lang.Object.wait(Native Method)
  1389. java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:133)
  1390. java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:149)
  1391. java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:189)
  1392. Thread 2 (Reference Handler):
  1393. State: WAITING
  1394. Blocked count: 13402069
  1395. Waited count: 13265130
  1396. Waiting on java.lang.ref.Reference$Lock@4b8a6e6e
  1397. Stack:
  1398. java.lang.Object.wait(Native Method)
  1399. java.lang.Object.wait(Object.java:502)
  1400. java.lang.ref.Reference$ReferenceHandler.run(Reference.java:133)
  1401. Thread 1 (main):
  1402. State: WAITING
  1403. Blocked count: 44
  1404. Waited count: 3
  1405. Waiting on java.lang.Thread@2f9e8a44
  1406. Stack:
  1407. java.lang.Object.wait(Native Method)
  1408. java.lang.Thread.join(Thread.java:1225)
  1409. java.lang.Thread.join(Thread.java:1278)
  1410. org.apache.hadoop.hbase.regionserver.HRegionServerCommandLine.start(HRegionServerCommandLine.java:64)
  1411. org.apache.hadoop.hbase.regionserver.HRegionServerCommandLine.run(HRegionServerCommandLine.java:85)
  1412. org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
  1413. org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:126)
  1414. org.apache.hadoop.hbase.regionserver.HRegionServer.main(HRegionServer.java:2340)
  1415.  
  1416.  
  1417. RS Configuration:
  1418. ===========================================================
  1419. <?xml version="1.0" encoding="UTF-8" standalone="no"?><configuration>
  1420. <property><name>dfs.journalnode.rpc-address</name><value>0.0.0.0:8485</value><source>hdfs-default.xml</source></property>
  1421. <property><name>io.storefile.bloom.block.size</name><value>131072</value><source>hbase-default.xml</source></property>
  1422. <property><name>yarn.ipc.rpc.class</name><value>org.apache.hadoop.yarn.ipc.HadoopYarnProtoRPC</value><source>yarn-default.xml</source></property>
  1423. <property><name>mapreduce.job.maxtaskfailures.per.tracker</name><value>3</value><source>mapred-default.xml</source></property>
  1424. <property><name>hbase.rest.threads.min</name><value>2</value><source>hbase-default.xml</source></property>
  1425. <property><name>ha.health-monitor.connect-retry-interval.ms</name><value>1000</value><source>core-default.xml</source></property>
  1426. <property><name>hbase.rs.cacheblocksonwrite</name><value>false</value><source>hbase-default.xml</source></property>
  1427. <property><name>mapreduce.reduce.markreset.buffer.percent</name><value>0.0</value><source>mapred-default.xml</source></property>
  1428. <property><name>dfs.datanode.data.dir</name><value>file://${hadoop.tmp.dir}/dfs/data</value><source>hdfs-default.xml</source></property>
  1429. <property><name>mapreduce.jobhistory.max-age-ms</name><value>604800000</value><source>mapred-default.xml</source></property>
  1430. <property><name>mapreduce.job.ubertask.enable</name><value>false</value><source>mapred-default.xml</source></property>
  1431. <property><name>dfs.namenode.delegation.token.renew-interval</name><value>86400000</value><source>hdfs-default.xml</source></property>
  1432. <property><name>yarn.nodemanager.log-aggregation.compression-type</name><value>none</value><source>yarn-default.xml</source></property>
  1433. <property><name>dfs.namenode.replication.considerLoad</name><value>true</value><source>hdfs-default.xml</source></property>
  1434. <property><name>mapreduce.job.complete.cancel.delegation.tokens</name><value>true</value><source>mapred-default.xml</source></property>
  1435. <property><name>mapreduce.jobhistory.datestring.cache.size</name><value>200000</value><source>mapred-default.xml</source></property>
  1436. <property><name>hbase.status.multicast.address.ip</name><value>226.1.1.3</value><source>hbase-default.xml</source></property>
  1437. <property><name>dfs.namenode.retrycache.heap.percent</name><value>0.03f</value><source>hdfs-default.xml</source></property>
  1438. <property><name>yarn.resourcemanager.scheduler.address</name><value>${yarn.resourcemanager.hostname}:8030</value><source>yarn-default.xml</source></property>
  1439. <property><name>dfs.namenode.logging.level</name><value>info</value><source>hdfs-default.xml</source></property>
  1440. <property><name>dfs.client.file-block-storage-locations.num-threads</name><value>10</value><source>hdfs-default.xml</source></property>
  1441. <property><name>dfs.datanode.balance.bandwidthPerSec</name><value>1048576</value><source>hdfs-default.xml</source></property>
  1442. <property><name>io.mapfile.bloom.error.rate</name><value>0.005</value><source>core-default.xml</source></property>
  1443. <property><name>yarn.resourcemanager.nodemanagers.heartbeat-interval-ms</name><value>1000</value><source>yarn-default.xml</source></property>
  1444. <property><name>dfs.secondary.namenode.kerberos.internal.spnego.principal</name><value>${dfs.web.authentication.kerberos.principal}</value><source>hdfs-default.xml</source></property>
  1445. <property><name>yarn.nodemanager.delete.debug-delay-sec</name><value>0</value><source>yarn-default.xml</source></property>
  1446. <property><name>yarn.scheduler.maximum-allocation-vcores</name><value>32</value><source>yarn-default.xml</source></property>
  1447. <property><name>dfs.image.transfer.bandwidthPerSec</name><value>0</value><source>hdfs-default.xml</source></property>
  1448. <property><name>hbase.zookeeper.quorum</name><value>master,slave1,slave2,slave3</value><source>hbase-site.xml</source></property>
  1449. <property><name>hfile.block.bloom.cacheonwrite</name><value>false</value><source>hbase-default.xml</source></property>
  1450. <property><name>mapreduce.job.hdfs-servers</name><value>${fs.defaultFS}</value><source>yarn-default.xml</source></property>
  1451. <property><name>hbase.zookeeper.property.syncLimit</name><value>5</value><source>hbase-default.xml</source></property>
  1452. <property><name>dfs.namenode.fs-limits.min-block-size</name><value>1048576</value><source>hdfs-default.xml</source></property>
  1453. <property><name>ftp.stream-buffer-size</name><value>4096</value><source>core-default.xml</source></property>
  1454. <property><name>dfs.datanode.directoryscan.threads</name><value>1</value><source>hdfs-default.xml</source></property>
  1455. <property><name>mapreduce.job.split.metainfo.maxsize</name><value>10000000</value><source>mapred-default.xml</source></property>
  1456. <property><name>dfs.namenode.edits.noeditlogchannelflush</name><value>false</value><source>hdfs-default.xml</source></property>
  1457. <property><name>s3native.bytes-per-checksum</name><value>512</value><source>core-default.xml</source></property>
  1458. <property><name>hbase.rest.filter.classes</name><value>org.apache.hadoop.hbase.rest.filter.GzipFilter</value><source>hbase-default.xml</source></property>
  1459. <property><name>mapreduce.tasktracker.tasks.sleeptimebeforesigkill</name><value>5000</value><source>mapred-default.xml</source></property>
  1460. <property><name>hadoop.http.authentication.type</name><value>simple</value><source>core-default.xml</source></property>
  1461. <property><name>mapreduce.local.clientfactory.class.name</name><value>org.apache.hadoop.mapred.LocalClientFactory</value><source>mapred-default.xml</source></property>
  1462. <property><name>ipc.client.connection.maxidletime</name><value>10000</value><source>core-default.xml</source></property>
  1463. <property><name>dfs.namenode.safemode.threshold-pct</name><value>0.999f</value><source>hdfs-default.xml</source></property>
  1464. <property><name>hfile.block.cache.size</name><value>0.4</value><source>hbase-default.xml</source></property>
  1465. <property><name>dfs.namenode.num.checkpoints.retained</name><value>2</value><source>hdfs-default.xml</source></property>
  1466. <property><name>hbase.hregion.memstore.mslab.enabled</name><value>true</value><source>hbase-default.xml</source></property>
  1467. <property><name>mapreduce.job.ubertask.maxmaps</name><value>9</value><source>mapred-default.xml</source></property>
  1468. <property><name>dfs.namenode.stale.datanode.interval</name><value>30000</value><source>hdfs-default.xml</source></property>
  1469. <property><name>mapreduce.tasktracker.http.address</name><value>0.0.0.0:50060</value><source>mapred-default.xml</source></property>
  1470. <property><name>mapreduce.ifile.readahead.bytes</name><value>4194304</value><source>mapred-default.xml</source></property>
  1471. <property><name>s3.client-write-packet-size</name><value>65536</value><source>core-default.xml</source></property>
  1472. <property><name>hbase.master.port</name><value>60000</value><source>hbase-default.xml</source></property>
  1473. <property><name>dfs.block.access.token.lifetime</name><value>600</value><source>hdfs-default.xml</source></property>
  1474. <property><name>yarn.app.mapreduce.am.resource.cpu-vcores</name><value>1</value><source>mapred-default.xml</source></property>
  1475. <property><name>hbase.regionserver.checksum.verify</name><value>true</value><source>hbase-default.xml</source></property>
  1476. <property><name>dfs.namenode.num.extra.edits.retained</name><value>1000000</value><source>hdfs-default.xml</source></property>
  1477. <property><name>mapreduce.reduce.shuffle.input.buffer.percent</name><value>0.70</value><source>mapred-default.xml</source></property>
  1478. <property><name>hadoop.http.staticuser.user</name><value>dr.who</value><source>core-default.xml</source></property>
  1479. <property><name>mapreduce.reduce.maxattempts</name><value>4</value><source>mapred-default.xml</source></property>
  1480. <property><name>hadoop.security.group.mapping.ldap.search.filter.user</name><value>(&amp;(objectClass=user)(sAMAccountName={0}))</value><source>core-default.xml</source></property>
  1481. <property><name>mapreduce.map.maxattempts</name><value>4</value><source>mapred-default.xml</source></property>
  1482. <property><name>mapreduce.jobhistory.cleaner.interval-ms</name><value>86400000</value><source>mapred-default.xml</source></property>
  1483. <property><name>dfs.datanode.drop.cache.behind.reads</name><value>false</value><source>hdfs-default.xml</source></property>
  1484. <property><name>dfs.permissions.superusergroup</name><value>supergroup</value><source>hdfs-default.xml</source></property>
  1485. <property><name>hbase.server.versionfile.writeattempts</name><value>3</value><source>hbase-default.xml</source></property>
  1486. <property><name>yarn.application.classpath</name><value>$HADOOP_CONF_DIR,$HADOOP_COMMON_HOME/share/hadoop/common/*,$HADOOP_COMMON_HOME/share/hadoop/common/lib/*,$HADOOP_HDFS_HOME/share/hadoop/hdfs/*,$HADOOP_HDFS_HOME/share/hadoop/hdfs/lib/*,$HADOOP_YARN_HOME/share/hadoop/yarn/*,$HADOOP_YARN_HOME/share/hadoop/yarn/lib/*</value><source>yarn-default.xml</source></property>
  1487. <property><name>hbase.zookeeper.useMulti</name><value>false</value><source>hbase-default.xml</source></property>
  1488. <property><name>fs.s3n.block.size</name><value>67108864</value><source>core-default.xml</source></property>
  1489. <property><name>hbase.zookeeper.leaderport</name><value>3888</value><source>hbase-default.xml</source></property>
  1490. <property><name>hbase.master.info.port</name><value>60010</value><source>hbase-default.xml</source></property>
  1491. <property><name>dfs.namenode.fs-limits.max-blocks-per-file</name><value>1048576</value><source>hdfs-default.xml</source></property>
  1492. <property><name>yarn.nodemanager.vmem-check-enabled</name><value>true</value><source>yarn-default.xml</source></property>
  1493. <property><name>hadoop.security.authentication</name><value>simple</value><source>core-default.xml</source></property>
  1494. <property><name>mapreduce.reduce.cpu.vcores</name><value>1</value><source>mapred-default.xml</source></property>
  1495. <property><name>net.topology.node.switch.mapping.impl</name><value>org.apache.hadoop.net.ScriptBasedMapping</value><source>core-default.xml</source></property>
  1496. <property><name>fs.s3.sleepTimeSeconds</name><value>10</value><source>core-default.xml</source></property>
  1497. <property><name>yarn.resourcemanager.keytab</name><value>/etc/krb5.keytab</value><source>yarn-default.xml</source></property>
  1498. <property><name>yarn.resourcemanager.container.liveness-monitor.interval-ms</name><value>600000</value><source>yarn-default.xml</source></property>
  1499. <property><name>mapreduce.jobtracker.heartbeats.in.second</name><value>100</value><source>mapred-default.xml</source></property>
  1500. <property><name>yarn.app.mapreduce.am.scheduler.heartbeat.interval-ms</name><value>1000</value><source>mapred-default.xml</source></property>
  1501. <property><name>yarn.nodemanager.linux-container-executor.cgroups.hierarchy</name><value>/hadoop-yarn</value><source>yarn-default.xml</source></property>
  1502. <property><name>s3.bytes-per-checksum</name><value>512</value><source>core-default.xml</source></property>
  1503. <property><name>hbase.regionserver.dns.nameserver</name><value>default</value><source>hbase-default.xml</source></property>
  1504. <property><name>hadoop.ssl.require.client.cert</name><value>false</value><source>core-default.xml</source></property>
  1505. <property><name>mapreduce.output.fileoutputformat.compress</name><value>false</value><source>mapred-default.xml</source></property>
  1506. <property><name>dfs.journalnode.http-address</name><value>0.0.0.0:8480</value><source>hdfs-default.xml</source></property>
  1507. <property><name>fs.default.name</name><value>hdfs://master:9000/hbase</value><source>programatically</source></property>
  1508. <property><name>dfs.ha.automatic-failover.enabled</name><value>false</value><source>hdfs-default.xml</source></property>
  1509. <property><name>hbase.cluster.distributed</name><value>true</value><source>hbase-site.xml</source></property>
  1510. <property><name>hbase.rootdir</name><value>hdfs://master:9000/hbase</value><source>programatically</source></property>
  1511. <property><name>s3native.client-write-packet-size</name><value>65536</value><source>core-default.xml</source></property>
  1512. <property><name>dfs.namenode.invalidate.work.pct.per.iteration</name><value>0.32f</value><source>hdfs-default.xml</source></property>
  1513. <property><name>dfs.client.block.write.replace-datanode-on-failure.policy</name><value>DEFAULT</value><source>hdfs-default.xml</source></property>
  1514. <property><name>mapreduce.client.submit.file.replication</name><value>10</value><source>mapred-default.xml</source></property>
  1515. <property><name>yarn.app.mapreduce.am.job.committer.commit-window</name><value>10000</value><source>mapred-default.xml</source></property>
  1516. <property><name>yarn.nodemanager.sleep-delay-before-sigkill.ms</name><value>250</value><source>yarn-default.xml</source></property>
  1517. <property><name>yarn.nodemanager.env-whitelist</name><value>JAVA_HOME,HADOOP_COMMON_HOME,HADOOP_HDFS_HOME,HADOOP_CONF_DIR,HADOOP_YARN_HOME</value><source>yarn-default.xml</source></property>
  1518. <property><name>dfs.namenode.secondary.http-address</name><value>0.0.0.0:50090</value><source>hdfs-default.xml</source></property>
  1519. <property><name>mapreduce.map.speculative</name><value>true</value><source>mapred-default.xml</source></property>
  1520. <property><name>mapreduce.job.speculative.slowtaskthreshold</name><value>1.0</value><source>mapred-default.xml</source></property>
  1521. <property><name>mapreduce.task.tmp.dir</name><value>./tmp</value><source>mapred-default.xml</source></property>
  1522. <property><name>yarn.nodemanager.linux-container-executor.cgroups.mount</name><value>false</value><source>yarn-default.xml</source></property>
  1523. <property><name>hbase.regionserver.msginterval</name><value>3000</value><source>hbase-default.xml</source></property>
  1524. <property><name>mapreduce.tasktracker.http.threads</name><value>40</value><source>mapred-default.xml</source></property>
  1525. <property><name>hbase.auth.token.max.lifetime</name><value>604800000</value><source>hbase-default.xml</source></property>
  1526. <property><name>mapreduce.jobhistory.http.policy</name><value>HTTP_ONLY</value><source>mapred-default.xml</source></property>
  1527. <property><name>hbase.ipc.client.fallback-to-simple-auth-allowed</name><value>false</value><source>hbase-default.xml</source></property>
  1528. <property><name>hbase.rest.threads.max</name><value>100</value><source>hbase-default.xml</source></property>
  1529. <property><name>fs.s3.buffer.dir</name><value>${hadoop.tmp.dir}/s3</value><source>core-default.xml</source></property>
  1530. <property><name>hbase.snapshot.enabled</name><value>true</value><source>hbase-default.xml</source></property>
  1531. <property><name>hbase.dynamic.jars.dir</name><value>${hbase.rootdir}/lib</value><source>hbase-default.xml</source></property>
  1532. <property><name>hbase.defaults.for.version</name><value>0.96.2-hadoop2</value><source>hbase-default.xml</source></property>
  1533. <property><name>io.native.lib.available</name><value>true</value><source>core-default.xml</source></property>
  1534. <property><name>mapreduce.jobhistory.done-dir</name><value>${yarn.app.mapreduce.am.staging-dir}/history/done</value><source>mapred-default.xml</source></property>
  1535. <property><name>hbase.regions.slop</name><value>0.2</value><source>hbase-default.xml</source></property>
  1536. <property><name>dfs.namenode.avoid.write.stale.datanode</name><value>false</value><source>hdfs-default.xml</source></property>
  1537. <property><name>dfs.namenode.checkpoint.txns</name><value>1000000</value><source>hdfs-default.xml</source></property>
  1538. <property><name>hadoop.ssl.hostname.verifier</name><value>DEFAULT</value><source>core-default.xml</source></property>
  1539. <property><name>mapreduce.task.timeout</name><value>600000</value><source>mapred-default.xml</source></property>
  1540. <property><name>zookeeper.znode.rootserver</name><value>root-region-server</value><source>hbase-default.xml</source></property>
  1541. <property><name>hbase.client.max.perserver.tasks</name><value>5</value><source>hbase-default.xml</source></property>
  1542. <property><name>yarn.nodemanager.disk-health-checker.interval-ms</name><value>120000</value><source>yarn-default.xml</source></property>
  1543. <property><name>hadoop.security.groups.cache.secs</name><value>300</value><source>core-default.xml</source></property>
  1544. <property><name>mapreduce.input.fileinputformat.split.minsize</name><value>0</value><source>mapred-default.xml</source></property>
  1545. <property><name>dfs.datanode.sync.behind.writes</name><value>false</value><source>hdfs-default.xml</source></property>
  1546. <property><name>zookeeper.session.timeout</name><value>90000</value><source>hbase-default.xml</source></property>
  1547. <property><name>ipc.server.tcpnodelay</name><value>false</value><source>core-default.xml</source></property>
  1548. <property><name>mapreduce.shuffle.port</name><value>13562</value><source>mapred-default.xml</source></property>
  1549. <property><name>hadoop.rpc.protection</name><value>authentication</value><source>core-default.xml</source></property>
  1550. <property><name>dfs.client.https.keystore.resource</name><value>ssl-client.xml</value><source>hdfs-default.xml</source></property>
  1551. <property><name>mapreduce.jobtracker.retiredjobs.cache.size</name><value>1000</value><source>mapred-default.xml</source></property>
  1552. <property><name>hbase.balancer.period</name><value>300000</value><source>hbase-default.xml</source></property>
  1553. <property><name>yarn.nodemanager.resourcemanager.connect.retry_interval.secs</name><value>30</value><source>yarn-default.xml</source></property>
  1554. <property><name>ipc.client.tcpnodelay</name><value>false</value><source>core-default.xml</source></property>
  1555. <property><name>fs.s3.maxRetries</name><value>4</value><source>core-default.xml</source></property>
  1556. <property><name>dfs.datanode.drop.cache.behind.writes</name><value>false</value><source>hdfs-default.xml</source></property>
  1557. <property><name>dfs.ha.tail-edits.period</name><value>60</value><source>hdfs-default.xml</source></property>
  1558. <property><name>mapreduce.jobtracker.address</name><value>local</value><source>mapred-default.xml</source></property>
  1559. <property><name>hadoop.http.authentication.kerberos.principal</name><value>HTTP/_HOST@LOCALHOST</value><source>core-default.xml</source></property>
  1560. <property><name>yarn.resourcemanager.webapp.address</name><value>${yarn.resourcemanager.hostname}:8088</value><source>yarn-default.xml</source></property>
  1561. <property><name>mapreduce.task.profile.reduces</name><value>0-2</value><source>mapred-default.xml</source></property>
  1562. <property><name>yarn.resourcemanager.am.max-attempts</name><value>2</value><source>yarn-default.xml</source></property>
  1563. <property><name>hbase.hstore.blockingWaitTime</name><value>90000</value><source>hbase-default.xml</source></property>
  1564. <property><name>hbase.client.pause</name><value>100</value><source>hbase-default.xml</source></property>
  1565. <property><name>hbase.client.write.buffer</name><value>2097152</value><source>hbase-default.xml</source></property>
  1566. <property><name>dfs.bytes-per-checksum</name><value>512</value><source>hdfs-default.xml</source></property>
  1567. <property><name>mapreduce.job.end-notification.max.retry.interval</name><value>5000</value><source>mapred-default.xml</source></property>
  1568. <property><name>yarn.app.mapreduce.am.command-opts</name><value>-Xmx1024m</value><source>mapred-default.xml</source></property>
  1569. <property><name>yarn.nodemanager.process-kill-wait.ms</name><value>2000</value><source>yarn-default.xml</source></property>
  1570. <property><name>hbase.rpc.timeout</name><value>60000</value><source>hbase-default.xml</source></property>
  1571. <property><name>hbase.metrics.exposeOperationTimes</name><value>true</value><source>hbase-default.xml</source></property>
  1572. <property><name>dfs.namenode.safemode.min.datanodes</name><value>0</value><source>hdfs-default.xml</source></property>
  1573. <property><name>hbase.thrift.maxWorkerThreads</name><value>1000</value><source>hbase-default.xml</source></property>
  1574. <property><name>dfs.namenode.write.stale.datanode.ratio</name><value>0.5f</value><source>hdfs-default.xml</source></property>
  1575. <property><name>hadoop.jetty.logs.serve.aliases</name><value>true</value><source>core-default.xml</source></property>
  1576. <property><name>hbase.regionserver.global.memstore.upperLimit</name><value>0.4</value><source>hbase-default.xml</source></property>
  1577. <property><name>mapreduce.tasktracker.dns.nameserver</name><value>default</value><source>mapred-default.xml</source></property>
  1578. <property><name>hbase.master.catalog.timeout</name><value>600000</value><source>hbase-default.xml</source></property>
  1579. <property><name>mapreduce.task.merge.progress.records</name><value>10000</value><source>mapred-default.xml</source></property>
  1580. <property><name>dfs.webhdfs.enabled</name><value>false</value><source>hdfs-default.xml</source></property>
  1581. <property><name>hadoop.ssl.client.conf</name><value>ssl-client.xml</value><source>core-default.xml</source></property>
  1582. <property><name>mapreduce.job.counters.max</name><value>120</value><source>mapred-default.xml</source></property>
  1583. <property><name>yarn.nodemanager.localizer.fetch.thread-count</name><value>4</value><source>yarn-default.xml</source></property>
  1584. <property><name>io.mapfile.bloom.size</name><value>1048576</value><source>core-default.xml</source></property>
  1585. <property><name>yarn.nodemanager.localizer.client.thread-count</name><value>5</value><source>yarn-default.xml</source></property>
  1586. <property><name>fs.automatic.close</name><value>true</value><source>core-default.xml</source></property>
  1587. <property><name>mapreduce.task.profile</name><value>false</value><source>mapred-default.xml</source></property>
  1588. <property><name>mapreduce.shuffle.ssl.file.buffer.size</name><value>65536</value><source>mapred-default.xml</source></property>
  1589. <property><name>hbase.hstore.bytes.per.checksum</name><value>16384</value><source>hbase-default.xml</source></property>
  1590. <property><name>yarn.ipc.serializer.type</name><value>protocolbuffers</value><source>yarn-default.xml</source></property>
  1591. <property><name>dfs.datanode.available-space-volume-choosing-policy.balanced-space-preference-fraction</name><value>0.75f</value><source>hdfs-default.xml</source></property>
  1592. <property><name>dfs.namenode.backup.address</name><value>0.0.0.0:50100</value><source>hdfs-default.xml</source></property>
  1593. <property><name>dfs.client.https.need-auth</name><value>false</value><source>hdfs-default.xml</source></property>
  1594. <property><name>yarn.nodemanager.keytab</name><value>/etc/krb5.keytab</value><source>yarn-default.xml</source></property>
  1595. <property><name>dfs.client.write.exclude.nodes.cache.expiry.interval.millis</name><value>600000</value><source>hdfs-default.xml</source></property>
  1596. <property><name>mapreduce.jobtracker.restart.recover</name><value>false</value><source>mapred-default.xml</source></property>
  1597. <property><name>mapreduce.map.skip.proc.count.autoincr</name><value>true</value><source>mapred-default.xml</source></property>
  1598. <property><name>hadoop.security.instrumentation.requires.admin</name><value>false</value><source>core-default.xml</source></property>
  1599. <property><name>io.compression.codec.bzip2.library</name><value>system-native</value><source>core-default.xml</source></property>
  1600. <property><name>dfs.namenode.name.dir.restore</name><value>false</value><source>hdfs-default.xml</source></property>
  1601. <property><name>hbase.client.retries.number</name><value>350</value><source>programatically</source></property>
  1602. <property><name>hadoop.ssl.keystores.factory.class</name><value>org.apache.hadoop.security.ssl.FileBasedKeyStoresFactory</value><source>core-default.xml</source></property>
  1603. <property><name>hbase.status.multicast.address.port</name><value>60100</value><source>hbase-default.xml</source></property>
  1604. <property><name>fs.ftp.host</name><value>0.0.0.0</value><source>core-default.xml</source></property>
  1605. <property><name>hbase.hstore.checksum.algorithm</name><value>CRC32</value><source>hbase-default.xml</source></property>
  1606. <property><name>s3.blocksize</name><value>67108864</value><source>core-default.xml</source></property>
  1607. <property><name>s3native.stream-buffer-size</name><value>4096</value><source>core-default.xml</source></property>
  1608. <property><name>mapreduce.jobtracker.taskscheduler</name><value>org.apache.hadoop.mapred.JobQueueTaskScheduler</value><source>mapred-default.xml</source></property>
  1609. <property><name>dfs.datanode.dns.nameserver</name><value>default</value><source>hdfs-default.xml</source></property>
  1610. <property><name>yarn.nodemanager.resource.memory-mb</name><value>8192</value><source>yarn-default.xml</source></property>
  1611. <property><name>mapreduce.task.userlog.limit.kb</name><value>0</value><source>mapred-default.xml</source></property>
  1612. <property><name>mapreduce.reduce.speculative</name><value>true</value><source>mapred-default.xml</source></property>
  1613. <property><name>yarn.nodemanager.container-monitor.interval-ms</name><value>3000</value><source>yarn-default.xml</source></property>
  1614. <property><name>dfs.replication.max</name><value>512</value><source>hdfs-default.xml</source></property>
  1615. <property><name>dfs.replication</name><value>2</value><source>hbase-site.xml</source></property>
  1616. <property><name>dfs.client.socket-timeout</name><value>10000</value><source>hbase-site.xml</source></property>
  1617. <property><name>yarn.nodemanager.resource.cpu-vcores</name><value>8</value><source>yarn-default.xml</source></property>
  1618. <property><name>hbase.server.thread.wakefrequency</name><value>10000</value><source>hbase-default.xml</source></property>
  1619. <property><name>hbase.lease.recovery.timeout</name><value>900000</value><source>hbase-default.xml</source></property>
  1620. <property><name>mapreduce.reduce.shuffle.memory.limit.percent</name><value>0.25</value><source>mapred-default.xml</source></property>
  1621. <property><name>file.replication</name><value>1</value><source>core-default.xml</source></property>
  1622. <property><name>mapreduce.job.reduce.shuffle.consumer.plugin.class</name><value>org.apache.hadoop.mapreduce.task.reduce.Shuffle</value><source>mapred-default.xml</source></property>
  1623. <property><name>hfile.format.version</name><value>2</value><source>hbase-default.xml</source></property>
  1624. <property><name>mapreduce.job.jvm.numtasks</name><value>1</value><source>mapred-default.xml</source></property>
  1625. <property><name>mapreduce.am.max-attempts</name><value>2</value><source>mapred-default.xml</source></property>
  1626. <property><name>hadoop.fuse.timer.period</name><value>5</value><source>hdfs-default.xml</source></property>
  1627. <property><name>mapreduce.job.reduces</name><value>1</value><source>mapred-default.xml</source></property>
  1628. <property><name>hbase.thrift.minWorkerThreads</name><value>16</value><source>hbase-default.xml</source></property>
  1629. <property><name>hbase.zookeeper.dns.interface</name><value>default</value><source>hbase-default.xml</source></property>
  1630. <property><name>yarn.app.mapreduce.am.job.task.listener.thread-count</name><value>30</value><source>mapred-default.xml</source></property>
  1631. <property><name>yarn.resourcemanager.store.class</name><value>org.apache.hadoop.yarn.server.resourcemanager.recovery.FileSystemRMStateStore</value><source>yarn-default.xml</source></property>
  1632. <property><name>mapreduce.job.speculative.slownodethreshold</name><value>1.0</value><source>mapred-default.xml</source></property>
  1633. <property><name>s3native.replication</name><value>3</value><source>core-default.xml</source></property>
  1634. <property><name>mapreduce.tasktracker.reduce.tasks.maximum</name><value>2</value><source>mapred-default.xml</source></property>
  1635. <property><name>hbase.snapshot.restore.failsafe.name</name><value>hbase-failsafe-{snapshot.name}-{restore.timestamp}</value><source>hbase-default.xml</source></property>
  1636. <property><name>fs.permissions.umask-mode</name><value>022</value><source>core-default.xml</source></property>
  1637. <property><name>mapreduce.cluster.local.dir</name><value>${hadoop.tmp.dir}/mapred/local</value><source>mapred-default.xml</source></property>
  1638. <property><name>mapreduce.client.output.filter</name><value>FAILED</value><source>mapred-default.xml</source></property>
  1639. <property><name>yarn.nodemanager.pmem-check-enabled</name><value>true</value><source>yarn-default.xml</source></property>
  1640. <property><name>dfs.client.failover.connection.retries.on.timeouts</name><value>0</value><source>hdfs-default.xml</source></property>
  1641. <property><name>mapreduce.jobtracker.instrumentation</name><value>org.apache.hadoop.mapred.JobTrackerMetricsInst</value><source>mapred-default.xml</source></property>
  1642. <property><name>ftp.replication</name><value>3</value><source>core-default.xml</source></property>
  1643. <property><name>hbase.hstore.blockingStoreFiles</name><value>10</value><source>hbase-default.xml</source></property>
  1644. <property><name>hadoop.security.group.mapping.ldap.search.attr.member</name><value>member</value><source>core-default.xml</source></property>
  1645. <property><name>hbase.regionserver.hlog.reader.impl</name><value>org.apache.hadoop.hbase.regionserver.wal.ProtobufLogReader</value><source>hbase-default.xml</source></property>
  1646. <property><name>dfs.namenode.replication.work.multiplier.per.iteration</name><value>2</value><source>hdfs-default.xml</source></property>
  1647. <property><name>yarn.resourcemanager.resource-tracker.address</name><value>${yarn.resourcemanager.hostname}:8031</value><source>yarn-default.xml</source></property>
  1648. <property><name>mapreduce.tasktracker.outofband.heartbeat</name><value>false</value><source>mapred-default.xml</source></property>
  1649. <property><name>hbase.master.info.bindAddress</name><value>0.0.0.0</value><source>hbase-default.xml</source></property>
  1650. <property><name>dfs.namenode.edits.dir</name><value>${dfs.namenode.name.dir}</value><source>hdfs-default.xml</source></property>
  1651. <property><name>yarn.resourcemanager.scheduler.monitor.enable</name><value>false</value><source>yarn-default.xml</source></property>
  1652. <property><name>fs.trash.checkpoint.interval</name><value>0</value><source>core-default.xml</source></property>
  1653. <property><name>s3.stream-buffer-size</name><value>4096</value><source>core-default.xml</source></property>
  1654. <property><name>file.client-write-packet-size</name><value>65536</value><source>core-default.xml</source></property>
  1655. <property><name>mapreduce.tasktracker.healthchecker.script.timeout</name><value>600000</value><source>mapred-default.xml</source></property>
  1656. <property><name>hbase.status.listener.class</name><value>org.apache.hadoop.hbase.client.ClusterStatusListener$MulticastListener</value><source>hbase-default.xml</source></property>
  1657. <property><name>dfs.namenode.fs-limits.max-directory-items</name><value>0</value><source>hdfs-default.xml</source></property>
  1658. <property><name>mapreduce.tasktracker.taskcontroller</name><value>org.apache.hadoop.mapred.DefaultTaskController</value><source>mapred-default.xml</source></property>
  1659. <property><name>nfs3.server.port</name><value>2049</value><source>core-default.xml</source></property>
  1660. <property><name>dfs.namenode.checkpoint.dir</name><value>file://${hadoop.tmp.dir}/dfs/namesecondary</value><source>hdfs-default.xml</source></property>
  1661. <property><name>yarn.nodemanager.remote-app-log-dir</name><value>/tmp/logs</value><source>yarn-default.xml</source></property>
  1662. <property><name>mapreduce.reduce.shuffle.retry-delay.max.ms</name><value>60000</value><source>mapred-default.xml</source></property>
  1663. <property><name>hbase.regionserver.dns.interface</name><value>default</value><source>hbase-default.xml</source></property>
  1664. <property><name>io.map.index.interval</name><value>128</value><source>core-default.xml</source></property>
  1665. <property><name>dfs.client.block.write.replace-datanode-on-failure.enable</name><value>true</value><source>hdfs-default.xml</source></property>
  1666. <property><name>dfs.namenode.replication.interval</name><value>3</value><source>hdfs-default.xml</source></property>
  1667. <property><name>mapreduce.admin.user.env</name><value>LD_LIBRARY_PATH=$HADOOP_COMMON_HOME/lib/native</value><source>mapred-default.xml</source></property>
  1668. <property><name>hbase.rest.port</name><value>8080</value><source>hbase-default.xml</source></property>
  1669. <property><name>hbase.regionserver.handler.count</name><value>30</value><source>hbase-default.xml</source></property>
  1670. <property><name>hadoop.ssl.server.conf</name><value>ssl-server.xml</value><source>core-default.xml</source></property>
  1671. <property><name>hadoop.rpc.socket.factory.class.default</name><value>org.apache.hadoop.net.StandardSocketFactory</value><source>core-default.xml</source></property>
  1672. <property><name>yarn.app.mapreduce.client.max-retries</name><value>3</value><source>mapred-default.xml</source></property>
  1673. <property><name>yarn.nodemanager.address</name><value>${yarn.nodemanager.hostname}:0</value><source>yarn-default.xml</source></property>
  1674. <property><name>dfs.datanode.max.transfer.threads</name><value>4096</value><source>hdfs-default.xml</source></property>
  1675. <property><name>ha.failover-controller.graceful-fence.rpc-timeout.ms</name><value>5000</value><source>core-default.xml</source></property>
  1676. <property><name>dfs.datanode.ipc.address</name><value>0.0.0.0:50020</value><source>hdfs-default.xml</source></property>
  1677. <property><name>yarn.resourcemanager.delayed.delegation-token.removal-interval-ms</name><value>30000</value><source>yarn-default.xml</source></property>
  1678. <property><name>dfs.namenode.backup.http-address</name><value>0.0.0.0:50105</value><source>hdfs-default.xml</source></property>
  1679. <property><name>mapreduce.tasktracker.report.address</name><value>127.0.0.1:0</value><source>mapred-default.xml</source></property>
  1680. <property><name>dfs.namenode.checkpoint.period</name><value>3600</value><source>hdfs-default.xml</source></property>
  1681. <property><name>hbase.bulkload.retries.number</name><value>0</value><source>hbase-default.xml</source></property>
  1682. <property><name>mapreduce.task.attempt.id</name><value>hb_rs_slave2,60020,1397552649456</value><source>because mapred.task.id is deprecated</source></property>
  1683. <property><name>hbase.hregion.max.filesize</name><value>10737418240</value><source>hbase-default.xml</source></property>
  1684. <property><name>hbase.master.loadbalancer.class</name><value>org.apache.hadoop.hbase.master.balancer.StochasticLoadBalancer</value><source>hbase-default.xml</source></property>
  1685. <property><name>mapreduce.job.speculative.speculativecap</name><value>0.1</value><source>mapred-default.xml</source></property>
  1686. <property><name>dfs.namenode.support.allow.format</name><value>true</value><source>hdfs-default.xml</source></property>
  1687. <property><name>dfs.namenode.checkpoint.max-retries</name><value>3</value><source>hdfs-default.xml</source></property>
  1688. <property><name>zookeeper.znode.acl.parent</name><value>acl</value><source>hbase-default.xml</source></property>
  1689. <property><name>hbase.status.publisher.class</name><value>org.apache.hadoop.hbase.master.ClusterStatusPublisher$MulticastPublisher</value><source>hbase-default.xml</source></property>
  1690. <property><name>hbase.tmp.dir</name><value>${java.io.tmpdir}/hbase-${user.name}</value><source>hbase-default.xml</source></property>
  1691. <property><name>dfs.namenode.decommission.nodes.per.interval</name><value>5</value><source>hdfs-default.xml</source></property>
  1692. <property><name>mapreduce.job.committer.setup.cleanup.needed</name><value>true</value><source>mapred-default.xml</source></property>
  1693. <property><name>mapreduce.job.end-notification.retry.attempts</name><value>0</value><source>mapred-default.xml</source></property>
  1694. <property><name>mapreduce.map.output.compress</name><value>false</value><source>mapred-default.xml</source></property>
  1695. <property><name>hbase.client.localityCheck.threadPoolSize</name><value>2</value><source>hbase-default.xml</source></property>
  1696. <property><name>mapreduce.jobhistory.cleaner.enable</name><value>true</value><source>mapred-default.xml</source></property>
  1697. <property><name>io.seqfile.local.dir</name><value>${hadoop.tmp.dir}/io/local</value><source>core-default.xml</source></property>
  1698. <property><name>mapreduce.reduce.shuffle.read.timeout</name><value>180000</value><source>mapred-default.xml</source></property>
  1699. <property><name>mapreduce.job.queuename</name><value>default</value><source>mapred-default.xml</source></property>
  1700. <property><name>ipc.client.connect.max.retries</name><value>10</value><source>core-default.xml</source></property>
  1701. <property><name>io.seqfile.lazydecompress</name><value>true</value><source>core-default.xml</source></property>
  1702. <property><name>yarn.app.mapreduce.am.staging-dir</name><value>/tmp/hadoop-yarn/staging</value><source>mapred-default.xml</source></property>
  1703. <property><name>yarn.nodemanager.linux-container-executor.resources-handler.class</name><value>org.apache.hadoop.yarn.server.nodemanager.util.DefaultLCEResourcesHandler</value><source>yarn-default.xml</source></property>
  1704. <property><name>io.file.buffer.size</name><value>4096</value><source>core-default.xml</source></property>
  1705. <property><name>ha.zookeeper.parent-znode</name><value>/hadoop-ha</value><source>core-default.xml</source></property>
  1706. <property><name>mapreduce.tasktracker.indexcache.mb</name><value>10</value><source>mapred-default.xml</source></property>
  1707. <property><name>tfile.io.chunk.size</name><value>1048576</value><source>core-default.xml</source></property>
  1708. <property><name>yarn.acl.enable</name><value>true</value><source>yarn-default.xml</source></property>
  1709. <property><name>rpc.engine.org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolPB</name><value>org.apache.hadoop.ipc.ProtobufRpcEngine</value><source>programatically</source></property>
  1710. <property><name>hadoop.security.group.mapping.ldap.directory.search.timeout</name><value>10000</value><source>core-default.xml</source></property>
  1711. <property><name>hbase.regionserver.regionSplitLimit</name><value>2147483647</value><source>hbase-default.xml</source></property>
  1712. <property><name>yarn.nodemanager.resourcemanager.connect.wait.secs</name><value>900</value><source>yarn-default.xml</source></property>
  1713. <property><name>mapreduce.job.token.tracking.ids.enabled</name><value>false</value><source>mapred-default.xml</source></property>
  1714. <property><name>hbase.thrift.maxQueuedRequests</name><value>1000</value><source>hbase-default.xml</source></property>
  1715. <property><name>mapreduce.map.output.compress.codec</name><value>org.apache.hadoop.io.compress.DefaultCodec</value><source>mapred-default.xml</source></property>
  1716. <property><name>s3.replication</name><value>3</value><source>core-default.xml</source></property>
  1717. <property><name>tfile.fs.input.buffer.size</name><value>262144</value><source>core-default.xml</source></property>
  1718. <property><name>ha.failover-controller.graceful-fence.connection.retries</name><value>1</value><source>core-default.xml</source></property>
  1719. <property><name>net.topology.script.number.args</name><value>100</value><source>core-default.xml</source></property>
  1720. <property><name>hfile.block.index.cacheonwrite</name><value>false</value><source>hbase-default.xml</source></property>
  1721. <property><name>hadoop.ssl.enabled</name><value>false</value><source>core-default.xml</source></property>
  1722. <property><name>hbase.config.read.zookeeper.config</name><value>false</value><source>hbase-default.xml</source></property>
  1723. <property><name>dfs.client.read.shortcircuit.buffer.size</name><value>131072</value><source>hbase-site.xml</source></property>
  1724. <property><name>yarn.nodemanager.log.retain-seconds</name><value>10800</value><source>yarn-default.xml</source></property>
  1725. <property><name>yarn.resourcemanager.admin.address</name><value>${yarn.resourcemanager.hostname}:8033</value><source>yarn-default.xml</source></property>
  1726. <property><name>yarn.resourcemanager.recovery.enabled</name><value>false</value><source>yarn-default.xml</source></property>
  1727. <property><name>fs.AbstractFileSystem.viewfs.impl</name><value>org.apache.hadoop.fs.viewfs.ViewFs</value><source>core-default.xml</source></property>
  1728. <property><name>mapreduce.tasktracker.dns.interface</name><value>default</value><source>mapred-default.xml</source></property>
  1729. <property><name>hbase.offheapcache.percentage</name><value>0</value><source>hbase-default.xml</source></property>
  1730. <property><name>mapreduce.jobtracker.handler.count</name><value>10</value><source>mapred-default.xml</source></property>
  1731. <property><name>dfs.blockreport.initialDelay</name><value>0</value><source>hdfs-default.xml</source></property>
  1732. <property><name>fs.AbstractFileSystem.hdfs.impl</name><value>org.apache.hadoop.fs.Hdfs</value><source>core-default.xml</source></property>
  1733. <property><name>dfs.namenode.retrycache.expirytime.millis</name><value>600000</value><source>hdfs-default.xml</source></property>
  1734. <property><name>dfs.client.failover.sleep.max.millis</name><value>15000</value><source>hdfs-default.xml</source></property>
  1735. <property><name>mapred.task.id</name><value>hb_rs_slave2,60020,1397552649456</value><source>programatically</source></property>
  1736. <property><name>hbase.zookeeper.property.clientPort</name><value>2181</value><source>hbase-default.xml</source></property>
  1737. <property><name>yarn.resourcemanager.max-completed-applications</name><value>10000</value><source>yarn-default.xml</source></property>
  1738. <property><name>yarn.nodemanager.log-dirs</name><value>${yarn.log.dir}/userlogs</value><source>yarn-default.xml</source></property>
  1739. <property><name>dfs.client.failover.sleep.base.millis</name><value>500</value><source>hdfs-default.xml</source></property>
  1740. <property><name>hbase.rest.readonly</name><value>false</value><source>hbase-default.xml</source></property>
  1741. <property><name>dfs.default.chunk.view.size</name><value>32768</value><source>hdfs-default.xml</source></property>
  1742. <property><name>dfs.client.read.shortcircuit</name><value>true</value><source>hbase-site.xml</source></property>
  1743. <property><name>hbase.rpc.server.engine</name><value>org.apache.hadoop.hbase.ipc.ProtobufRpcServerEngine</value><source>hbase-default.xml</source></property>
  1744. <property><name>ftp.blocksize</name><value>67108864</value><source>core-default.xml</source></property>
  1745. <property><name>mapreduce.job.acl-modify-job</name><value> </value><source>mapred-default.xml</source></property>
  1746. <property><name>zookeeper.znode.parent</name><value>/hbase</value><source>hbase-default.xml</source></property>
  1747. <property><name>fs.defaultFS</name><value>hdfs://master:9000/hbase</value><source>because fs.default.name is deprecated</source></property>
  1748. <property><name>hbase.rpc.shortoperation.timeout</name><value>10000</value><source>hbase-default.xml</source></property>
  1749. <property><name>hadoop.http.filter.initializers</name><value>org.apache.hadoop.http.lib.StaticUserWebFilter</value><source>core-default.xml</source></property>
  1750. <property><name>yarn.resourcemanager.connect.max-wait.ms</name><value>900000</value><source>yarn-default.xml</source></property>
  1751. <property><name>hadoop.security.group.mapping.ldap.ssl</name><value>false</value><source>core-default.xml</source></property>
  1752. <property><name>dfs.namenode.max.extra.edits.segments.retained</name><value>10000</value><source>hdfs-default.xml</source></property>
  1753. <property><name>dfs.namenode.https-address</name><value>0.0.0.0:50470</value><source>hdfs-default.xml</source></property>
  1754. <property><name>yarn.resourcemanager.admin.client.thread-count</name><value>1</value><source>yarn-default.xml</source></property>
  1755. <property><name>ipc.client.kill.max</name><value>10</value><source>core-default.xml</source></property>
  1756. <property><name>hadoop.security.group.mapping.ldap.search.filter.group</name><value>(objectClass=group)</value><source>core-default.xml</source></property>
  1757. <property><name>fs.AbstractFileSystem.file.impl</name><value>org.apache.hadoop.fs.local.LocalFs</value><source>core-default.xml</source></property>
  1758. <property><name>hadoop.http.authentication.kerberos.keytab</name><value>${user.home}/hadoop.keytab</value><source>core-default.xml</source></property>
  1759. <property><name>mapreduce.job.map.output.collector.class</name><value>org.apache.hadoop.mapred.MapTask$MapOutputBuffer</value><source>mapred-default.xml</source></property>
  1760. <property><name>hadoop.security.uid.cache.secs</name><value>14400</value><source>core-default.xml</source></property>
  1761. <property><name>mapreduce.map.cpu.vcores</name><value>1</value><source>mapred-default.xml</source></property>
  1762. <property><name>yarn.log-aggregation.retain-check-interval-seconds</name><value>-1</value><source>yarn-default.xml</source></property>
  1763. <property><name>mapreduce.map.log.level</name><value>INFO</value><source>mapred-default.xml</source></property>
  1764. <property><name>mapred.child.java.opts</name><value>-Xmx200m</value><source>mapred-default.xml</source></property>
  1765. <property><name>hfile.index.block.max.size</name><value>131072</value><source>hbase-default.xml</source></property>
  1766. <property><name>hbase.client.scanner.timeout.period</name><value>60000</value><source>hbase-default.xml</source></property>
  1767. <property><name>yarn.nodemanager.local-cache.max-files-per-directory</name><value>8192</value><source>yarn-default.xml</source></property>
  1768. <property><name>dfs.https.server.keystore.resource</name><value>ssl-server.xml</value><source>hdfs-default.xml</source></property>
  1769. <property><name>mapreduce.jobtracker.taskcache.levels</name><value>2</value><source>mapred-default.xml</source></property>
  1770. <property><name>dfs.datanode.handler.count</name><value>10</value><source>hdfs-default.xml</source></property>
  1771. <property><name>s3native.blocksize</name><value>67108864</value><source>core-default.xml</source></property>
  1772. <property><name>yarn.resourcemanager.nm.liveness-monitor.interval-ms</name><value>1000</value><source>yarn-default.xml</source></property>
  1773. <property><name>mapreduce.client.completion.pollinterval</name><value>5000</value><source>mapred-default.xml</source></property>
  1774. <property><name>hbase.hstore.compactionThreshold</name><value>3</value><source>hbase-default.xml</source></property>
  1775. <property><name>dfs.stream-buffer-size</name><value>4096</value><source>hdfs-default.xml</source></property>
  1776. <property><name>dfs.namenode.delegation.key.update-interval</name><value>86400000</value><source>hdfs-default.xml</source></property>
  1777. <property><name>mapreduce.job.maps</name><value>2</value><source>mapred-default.xml</source></property>
  1778. <property><name>hbase.master.logcleaner.ttl</name><value>600000</value><source>hbase-default.xml</source></property>
  1779. <property><name>mapreduce.job.acl-view-job</name><value> </value><source>mapred-default.xml</source></property>
  1780. <property><name>dfs.namenode.enable.retrycache</name><value>true</value><source>hdfs-default.xml</source></property>
  1781. <property><name>yarn.resourcemanager.connect.retry-interval.ms</name><value>30000</value><source>yarn-default.xml</source></property>
  1782. <property><name>dfs.namenode.decommission.interval</name><value>30</value><source>hdfs-default.xml</source></property>
  1783. <property><name>hbase.hregion.majorcompaction</name><value>604800000</value><source>hbase-default.xml</source></property>
  1784. <property><name>mapreduce.shuffle.max.connections</name><value>0</value><source>mapred-default.xml</source></property>
  1785. <property><name>yarn.log-aggregation-enable</name><value>false</value><source>yarn-default.xml</source></property>
  1786. <property><name>dfs.client-write-packet-size</name><value>65536</value><source>hdfs-default.xml</source></property>
  1787. <property><name>mapreduce.jobtracker.expire.trackers.interval</name><value>600000</value><source>mapred-default.xml</source></property>
  1788. <property><name>dfs.client.block.write.retries</name><value>3</value><source>hdfs-default.xml</source></property>
  1789. <property><name>mapreduce.task.io.sort.factor</name><value>10</value><source>mapred-default.xml</source></property>
  1790. <property><name>ha.health-monitor.sleep-after-disconnect.ms</name><value>1000</value><source>core-default.xml</source></property>
  1791. <property><name>hbase.hregion.memstore.flush.size</name><value>134217728</value><source>hbase-default.xml</source></property>
  1792. <property><name>ha.zookeeper.session-timeout.ms</name><value>5000</value><source>core-default.xml</source></property>
  1793. <property><name>dfs.support.append</name><value>true</value><source>hdfs-default.xml</source></property>
  1794. <property><name>io.skip.checksum.errors</name><value>false</value><source>core-default.xml</source></property>
  1795. <property><name>hbase.regionserver.optionalcacheflushinterval</name><value>3600000</value><source>hbase-default.xml</source></property>
  1796. <property><name>hbase.ipc.client.tcpnodelay</name><value>true</value><source>hbase-default.xml</source></property>
  1797. <property><name>yarn.resourcemanager.scheduler.client.thread-count</name><value>50</value><source>yarn-default.xml</source></property>
  1798. <property><name>dfs.namenode.safemode.extension</name><value>30000</value><source>hdfs-default.xml</source></property>
  1799. <property><name>mapreduce.jobhistory.move.thread-count</name><value>3</value><source>mapred-default.xml</source></property>
  1800. <property><name>ipc.client.idlethreshold</name><value>4000</value><source>core-default.xml</source></property>
  1801. <property><name>hbase.regionserver.port</name><value>60020</value><source>hbase-default.xml</source></property>
  1802. <property><name>dfs.namenode.accesstime.precision</name><value>3600000</value><source>hdfs-default.xml</source></property>
  1803. <property><name>hbase.regionserver.logroll.errors.tolerated</name><value>2</value><source>hbase-default.xml</source></property>
  1804. <property><name>mapreduce.jobhistory.keytab</name><value>/etc/security/keytab/jhs.service.keytab</value><source>mapred-default.xml</source></property>
  1805. <property><name>hbase.hstore.compaction.max</name><value>10</value><source>hbase-default.xml</source></property>
  1806. <property><name>yarn.resourcemanager.amliveliness-monitor.interval-ms</name><value>1000</value><source>yarn-default.xml</source></property>
  1807. <property><name>yarn.scheduler.minimum-allocation-mb</name><value>1024</value><source>yarn-default.xml</source></property>
  1808. <property><name>yarn.resourcemanager.container-tokens.master-key-rolling-interval-secs</name><value>86400</value><source>yarn-default.xml</source></property>
  1809. <property><name>dfs.datanode.hdfs-blocks-metadata.enabled</name><value>false</value><source>hdfs-default.xml</source></property>
  1810. <property><name>dfs.datanode.directoryscan.interval</name><value>21600</value><source>hdfs-default.xml</source></property>
  1811. <property><name>hbase.zookeeper.property.initLimit</name><value>10</value><source>hbase-default.xml</source></property>
  1812. <property><name>yarn.resourcemanager.scheduler.monitor.policies</name><value>org.apache.hadoop.yarn.server.resourcemanager.monitor.capacity.ProportionalCapacityPreemptionPolicy</value><source>yarn-default.xml</source></property>
  1813. <property><name>ipc.server.listen.queue.size</name><value>128</value><source>core-default.xml</source></property>
  1814. <property><name>mapreduce.jobtracker.persist.jobstatus.dir</name><value>/jobtracker/jobsInfo</value><source>mapred-default.xml</source></property>
  1815. <property><name>dfs.domain.socket.path</name><value>/var/run/hadoop/dn_socket</value><source>hbase-site.xml</source></property>
  1816. <property><name>yarn.client.nodemanager-client-async.thread-pool-max-size</name><value>500</value><source>yarn-default.xml</source></property>
  1817. <property><name>hadoop.security.group.mapping</name><value>org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback</value><source>core-default.xml</source></property>
  1818. <property><name>dfs.namenode.name.dir</name><value>file://${hadoop.tmp.dir}/dfs/name</value><source>hdfs-default.xml</source></property>
  1819. <property><name>hbase.coprocessor.abortonerror</name><value>false</value><source>hbase-default.xml</source></property>
  1820. <property><name>yarn.am.liveness-monitor.expiry-interval-ms</name><value>600000</value><source>yarn-default.xml</source></property>
  1821. <property><name>yarn.nm.liveness-monitor.expiry-interval-ms</name><value>600000</value><source>yarn-default.xml</source></property>
  1822. <property><name>hbase.hregion.preclose.flush.size</name><value>5242880</value><source>hbase-default.xml</source></property>
  1823. <property><name>hbase.hstore.compaction.kv.max</name><value>10</value><source>hbase-default.xml</source></property>
  1824. <property><name>ftp.bytes-per-checksum</name><value>512</value><source>core-default.xml</source></property>
  1825. <property><name>dfs.namenode.max.objects</name><value>0</value><source>hdfs-default.xml</source></property>
  1826. <property><name>hbase.master.hfilecleaner.plugins</name><value>org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner</value><source>hbase-default.xml</source></property>
  1827. <property><name>hbase.metrics.showTableName</name><value>true</value><source>hbase-default.xml</source></property>
  1828. <property><name>dfs.namenode.edits.journal-plugin.qjournal</name><value>org.apache.hadoop.hdfs.qjournal.client.QuorumJournalManager</value><source>hdfs-default.xml</source></property>
  1829. <property><name>mapreduce.tasktracker.healthchecker.interval</name><value>60000</value><source>mapred-default.xml</source></property>
  1830. <property><name>hbase.lease.recovery.dfs.timeout</name><value>23000</value><source>hbase-site.xml</source></property>
  1831. <property><name>yarn.resourcemanager.address</name><value>${yarn.resourcemanager.hostname}:8032</value><source>yarn-default.xml</source></property>
  1832. <property><name>mapreduce.task.skip.start.attempts</name><value>2</value><source>mapred-default.xml</source></property>
  1833. <property><name>fail.fast.expired.active.master</name><value>false</value><source>hbase-default.xml</source></property>
  1834. <property><name>dfs.namenode.checkpoint.edits.dir</name><value>${dfs.namenode.checkpoint.dir}</value><source>hdfs-default.xml</source></property>
  1835. <property><name>hadoop.hdfs.configuration.version</name><value>1</value><source>hdfs-default.xml</source></property>
  1836. <property><name>mapreduce.map.skip.maxrecords</name><value>0</value><source>mapred-default.xml</source></property>
  1837. <property><name>dfs.datanode.available-space-volume-choosing-policy.balanced-space-threshold</name><value>10737418240</value><source>hdfs-default.xml</source></property>
  1838. <property><name>mapreduce.jobtracker.system.dir</name><value>${hadoop.tmp.dir}/mapred/system</value><source>mapred-default.xml</source></property>
  1839. <property><name>hbase.zookeeper.dns.nameserver</name><value>default</value><source>hbase-default.xml</source></property>
  1840. <property><name>hbase.master.dns.nameserver</name><value>default</value><source>hbase-default.xml</source></property>
  1841. <property><name>mapreduce.shuffle.ssl.enabled</name><value>false</value><source>mapred-default.xml</source></property>
  1842. <property><name>yarn.nodemanager.vmem-pmem-ratio</name><value>2.1</value><source>yarn-default.xml</source></property>
  1843. <property><name>yarn.nodemanager.container-manager.thread-count</name><value>20</value><source>yarn-default.xml</source></property>
  1844. <property><name>dfs.encrypt.data.transfer</name><value>false</value><source>hdfs-default.xml</source></property>
  1845. <property><name>dfs.block.access.key.update.interval</name><value>600</value><source>hdfs-default.xml</source></property>
  1846. <property><name>hadoop.tmp.dir</name><value>/tmp/hadoop-${user.name}</value><source>core-default.xml</source></property>
  1847. <property><name>dfs.namenode.audit.loggers</name><value>default</value><source>hdfs-default.xml</source></property>
  1848. <property><name>yarn.nodemanager.localizer.cache.target-size-mb</name><value>10240</value><source>yarn-default.xml</source></property>
  1849. <property><name>yarn.http.policy</name><value>HTTP_ONLY</value><source>yarn-default.xml</source></property>
  1850. <property><name>hbase.regionserver.logroll.period</name><value>3600000</value><source>hbase-default.xml</source></property>
  1851. <property><name>mapreduce.jobtracker.persist.jobstatus.hours</name><value>1</value><source>mapred-default.xml</source></property>
  1852. <property><name>tfile.fs.output.buffer.size</name><value>262144</value><source>core-default.xml</source></property>
  1853. <property><name>hbase.hregion.memstore.block.multiplier</name><value>2</value><source>hbase-default.xml</source></property>
  1854. <property><name>dfs.namenode.checkpoint.check.period</name><value>60</value><source>hdfs-default.xml</source></property>
  1855. <property><name>dfs.datanode.dns.interface</name><value>default</value><source>hdfs-default.xml</source></property>
  1856. <property><name>fs.ftp.host.port</name><value>21</value><source>core-default.xml</source></property>
  1857. <property><name>mapreduce.task.io.sort.mb</name><value>100</value><source>mapred-default.xml</source></property>
  1858. <property><name>hadoop.security.group.mapping.ldap.search.attr.group.name</name><value>cn</value><source>core-default.xml</source></property>
  1859. <property><name>mapreduce.output.fileoutputformat.compress.type</name><value>RECORD</value><source>mapred-default.xml</source></property>
  1860. <property><name>dfs.namenode.avoid.read.stale.datanode</name><value>false</value><source>hdfs-default.xml</source></property>
  1861. <property><name>hbase.storescanner.parallel.seek.enable</name><value>false</value><source>hbase-default.xml</source></property>
  1862. <property><name>mapreduce.reduce.skip.proc.count.autoincr</name><value>true</value><source>mapred-default.xml</source></property>
  1863. <property><name>hbase.dfs.client.read.shortcircuit.buffer.size</name><value>131072</value><source>hbase-default.xml</source></property>
  1864. <property><name>dfs.client.file-block-storage-locations.timeout</name><value>60</value><source>hdfs-default.xml</source></property>
  1865. <property><name>file.bytes-per-checksum</name><value>512</value><source>core-default.xml</source></property>
  1866. <property><name>mapreduce.job.userlog.retain.hours</name><value>24</value><source>mapred-default.xml</source></property>
  1867. <property><name>dfs.datanode.http.address</name><value>0.0.0.0:50075</value><source>hdfs-default.xml</source></property>
  1868. <property><name>dfs.image.compress</name><value>false</value><source>hdfs-default.xml</source></property>
  1869. <property><name>ha.health-monitor.check-interval.ms</name><value>1000</value><source>core-default.xml</source></property>
  1870. <property><name>dfs.permissions.enabled</name><value>true</value><source>hdfs-default.xml</source></property>
  1871. <property><name>hbase.thrift.htablepool.size.max</name><value>1000</value><source>hbase-default.xml</source></property>
  1872. <property><name>yarn.resourcemanager.resource-tracker.client.thread-count</name><value>50</value><source>yarn-default.xml</source></property>
  1873. <property><name>dfs.image.compression.codec</name><value>org.apache.hadoop.io.compress.DefaultCodec</value><source>hdfs-default.xml</source></property>
  1874. <property><name>dfs.datanode.address</name><value>0.0.0.0:50010</value><source>hdfs-default.xml</source></property>
  1875. <property><name>dfs.block.access.token.enable</name><value>false</value><source>hdfs-default.xml</source></property>
  1876. <property><name>mapreduce.reduce.input.buffer.percent</name><value>0.0</value><source>mapred-default.xml</source></property>
  1877. <property><name>hbase.client.scanner.caching</name><value>100</value><source>hbase-default.xml</source></property>
  1878. <property><name>mapreduce.tasktracker.local.dir.minspacestart</name><value>0</value><source>mapred-default.xml</source></property>
  1879. <property><name>dfs.blockreport.intervalMsec</name><value>21600000</value><source>hdfs-default.xml</source></property>
  1880. <property><name>hbase.snapshot.restore.take.failsafe.snapshot</name><value>true</value><source>hbase-default.xml</source></property>
  1881. <property><name>ha.health-monitor.rpc-timeout.ms</name><value>45000</value><source>core-default.xml</source></property>
  1882. <property><name>dfs.client.failover.connection.retries</name><value>0</value><source>hdfs-default.xml</source></property>
  1883. <property><name>dfs.namenode.kerberos.internal.spnego.principal</name><value>${dfs.web.authentication.kerberos.principal}</value><source>hdfs-default.xml</source></property>
  1884. <property><name>hadoop.policy.file</name><value>hbase-policy.xml</value><source>hbase-default.xml</source></property>
  1885. <property><name>yarn.scheduler.maximum-allocation-mb</name><value>8192</value><source>yarn-default.xml</source></property>
  1886. <property><name>mapreduce.task.files.preserve.failedtasks</name><value>false</value><source>mapred-default.xml</source></property>
  1887. <property><name>hbase.status.published</name><value>false</value><source>hbase-default.xml</source></property>
  1888. <property><name>yarn.nodemanager.delete.thread-count</name><value>4</value><source>yarn-default.xml</source></property>
  1889. <property><name>dfs.https.enable</name><value>false</value><source>hdfs-default.xml</source></property>
  1890. <property><name>mapreduce.output.fileoutputformat.compress.codec</name><value>org.apache.hadoop.io.compress.DefaultCodec</value><source>mapred-default.xml</source></property>
  1891. <property><name>map.sort.class</name><value>org.apache.hadoop.util.QuickSort</value><source>mapred-default.xml</source></property>
  1892. <property><name>mapreduce.job.classloader.system.classes</name><value>java.,javax.,org.apache.commons.logging.,org.apache.log4j.,org.apache.hadoop.</value><source>mapred-default.xml</source></property>
  1893. <property><name>mapreduce.job.classloader</name><value>false</value><source>mapred-default.xml</source></property>
  1894. <property><name>mapreduce.jobtracker.tasktracker.maxblacklists</name><value>4</value><source>mapred-default.xml</source></property>
  1895. <property><name>io.seqfile.compress.blocksize</name><value>1000000</value><source>core-default.xml</source></property>
  1896. <property><name>dfs.blocksize</name><value>134217728</value><source>hdfs-default.xml</source></property>
  1897. <property><name>mapreduce.task.profile.maps</name><value>0-2</value><source>mapred-default.xml</source></property>
  1898. <property><name>mapreduce.jobtracker.staging.root.dir</name><value>${hadoop.tmp.dir}/mapred/staging</value><source>mapred-default.xml</source></property>
  1899. <property><name>yarn.nodemanager.localizer.cache.cleanup.interval-ms</name><value>600000</value><source>yarn-default.xml</source></property>
  1900. <property><name>mapreduce.jobtracker.http.address</name><value>0.0.0.0:50030</value><source>mapred-default.xml</source></property>
  1901. <property><name>hbase.regionserver.info.bindAddress</name><value>0.0.0.0</value><source>hbase-default.xml</source></property>
  1902. <property><name>fs.client.resolve.remote.symlinks</name><value>true</value><source>core-default.xml</source></property>
  1903. <property><name>hbase.master.logcleaner.plugins</name><value>org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner</value><source>hbase-default.xml</source></property>
  1904. <property><name>hbase.data.umask.enable</name><value>false</value><source>hbase-default.xml</source></property>
  1905. <property><name>hbase.master.dns.interface</name><value>default</value><source>hbase-default.xml</source></property>
  1906. <property><name>mapreduce.tasktracker.local.dir.minspacekill</name><value>0</value><source>mapred-default.xml</source></property>
  1907. <property><name>yarn.nodemanager.disk-health-checker.min-healthy-disks</name><value>0.25</value><source>yarn-default.xml</source></property>
  1908. <property><name>mapreduce.tasktracker.taskmemorymanager.monitoringinterval</name><value>5000</value><source>mapred-default.xml</source></property>
  1909. <property><name>hbase.local.dir</name><value>${hbase.tmp.dir}/local/</value><source>hbase-default.xml</source></property>
  1910. <property><name>mapreduce.job.end-notification.retry.interval</name><value>1000</value><source>mapred-default.xml</source></property>
  1911. <property><name>mapreduce.jobhistory.loadedjobs.cache.size</name><value>5</value><source>mapred-default.xml</source></property>
  1912. <property><name>yarn.nodemanager.local-dirs</name><value>${hadoop.tmp.dir}/nm-local-dir</value><source>yarn-default.xml</source></property>
  1913. <property><name>hbase.table.lock.enable</name><value>true</value><source>hbase-default.xml</source></property>
  1914. <property><name>hbase.storescanner.parallel.seek.threads</name><value>10</value><source>hbase-default.xml</source></property>
  1915. <property><name>hbase.online.schema.update.enable</name><value>true</value><source>hbase-default.xml</source></property>
  1916. <property><name>mapreduce.jobhistory.address</name><value>0.0.0.0:10020</value><source>mapred-default.xml</source></property>
  1917. <property><name>mapreduce.jobtracker.persist.jobstatus.active</name><value>true</value><source>mapred-default.xml</source></property>
  1918. <property><name>file.blocksize</name><value>67108864</value><source>core-default.xml</source></property>
  1919. <property><name>dfs.datanode.readahead.bytes</name><value>4193404</value><source>hdfs-default.xml</source></property>
  1920. <property><name>hbase.zookeeper.property.dataDir</name><value>/data/hddata/zookeeper</value><source>hbase-site.xml</source></property>
  1921. <property><name>dfs.namenode.http-address</name><value>0.0.0.0:50070</value><source>hdfs-default.xml</source></property>
  1922. <property><name>hadoop.work.around.non.threadsafe.getpwuid</name><value>false</value><source>core-default.xml</source></property>
  1923. <property><name>yarn.resourcemanager.hostname</name><value>0.0.0.0</value><source>yarn-default.xml</source></property>
  1924. <property><name>dfs.namenode.fs-limits.max-component-length</name><value>0</value><source>hdfs-default.xml</source></property>
  1925. <property><name>ha.failover-controller.cli-check.rpc-timeout.ms</name><value>20000</value><source>core-default.xml</source></property>
  1926. <property><name>hbase.regionserver.info.port.auto</name><value>false</value><source>hbase-default.xml</source></property>
  1927. <property><name>hbase.auth.key.update.interval</name><value>86400000</value><source>hbase-default.xml</source></property>
  1928. <property><name>ftp.client-write-packet-size</name><value>65536</value><source>core-default.xml</source></property>
  1929. <property><name>mapreduce.reduce.shuffle.parallelcopies</name><value>5</value><source>mapred-default.xml</source></property>
  1930. <property><name>mapreduce.jobhistory.principal</name><value>jhs/_HOST@REALM.TLD</value><source>mapred-default.xml</source></property>
  1931. <property><name>hadoop.http.authentication.simple.anonymous.allowed</name><value>true</value><source>core-default.xml</source></property>
  1932. <property><name>yarn.log-aggregation.retain-seconds</name><value>-1</value><source>yarn-default.xml</source></property>
  1933. <property><name>hbase.zookeeper.property.maxClientCnxns</name><value>5000</value><source>hbase-site.xml</source></property>
  1934. <property><name>mapreduce.client.genericoptionsparser.used</name><value>true</value><source>programatically</source></property>
  1935. <property><name>mapreduce.job.ubertask.maxreduces</name><value>1</value><source>mapred-default.xml</source></property>
  1936. <property><name>yarn.nodemanager.health-checker.interval-ms</name><value>600000</value><source>yarn-default.xml</source></property>
  1937. <property><name>hbase.server.compactchecker.interval.multiplier</name><value>1000</value><source>hbase-default.xml</source></property>
  1938. <property><name>mapreduce.jobtracker.jobhistory.task.numberprogresssplits</name><value>12</value><source>mapred-default.xml</source></property>
  1939. <property><name>yarn.client.max-nodemanagers-proxies</name><value>500</value><source>yarn-default.xml</source></property>
  1940. <property><name>yarn.nodemanager.webapp.address</name><value>${yarn.nodemanager.hostname}:8042</value><source>yarn-default.xml</source></property>
  1941. <property><name>yarn.app.mapreduce.client-am.ipc.max-retries</name><value>3</value><source>mapred-default.xml</source></property>
  1942. <property><name>ha.failover-controller.new-active.rpc-timeout.ms</name><value>60000</value><source>core-default.xml</source></property>
  1943. <property><name>mapreduce.jobhistory.client.thread-count</name><value>10</value><source>mapred-default.xml</source></property>
  1944. <property><name>fs.trash.interval</name><value>0</value><source>core-default.xml</source></property>
  1945. <property><name>hbase.client.max.perregion.tasks</name><value>1</value><source>hbase-default.xml</source></property>
  1946. <property><name>mapreduce.reduce.skip.maxgroups</name><value>0</value><source>mapred-default.xml</source></property>
  1947. <property><name>yarn.nodemanager.health-checker.script.timeout-ms</name><value>1200000</value><source>yarn-default.xml</source></property>
  1948. <property><name>dfs.datanode.du.reserved</name><value>0</value><source>hdfs-default.xml</source></property>
  1949. <property><name>yarn.client.app-submission.poll-interval</name><value>1000</value><source>yarn-default.xml</source></property>
  1950. <property><name>mapreduce.client.progressmonitor.pollinterval</name><value>1000</value><source>mapred-default.xml</source></property>
  1951. <property><name>yarn.resourcemanager.application-tokens.master-key-rolling-interval-secs</name><value>86400</value><source>yarn-default.xml</source></property>
  1952. <property><name>yarn.nodemanager.hostname</name><value>0.0.0.0</value><source>yarn-default.xml</source></property>
  1953. <property><name>yarn.scheduler.minimum-allocation-vcores</name><value>1</value><source>yarn-default.xml</source></property>
  1954. <property><name>dfs.ha.log-roll.period</name><value>120</value><source>hdfs-default.xml</source></property>
  1955. <property><name>hadoop.http.authentication.signature.secret.file</name><value>${user.home}/hadoop-http-auth-signature-secret</value><source>core-default.xml</source></property>
  1956. <property><name>mapreduce.jobhistory.move.interval-ms</name><value>180000</value><source>mapred-default.xml</source></property>
  1957. <property><name>yarn.nodemanager.container-executor.class</name><value>org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor</value><source>yarn-default.xml</source></property>
  1958. <property><name>hadoop.security.authorization</name><value>false</value><source>core-default.xml</source></property>
  1959. <property><name>dfs.datanode.https.address</name><value>0.0.0.0:50475</value><source>hdfs-default.xml</source></property>
  1960. <property><name>yarn.nodemanager.localizer.address</name><value>${yarn.nodemanager.hostname}:8040</value><source>yarn-default.xml</source></property>
  1961. <property><name>dfs.namenode.replication.min</name><value>1</value><source>hdfs-default.xml</source></property>
  1962. <property><name>hadoop.common.configuration.version</name><value>0.23.0</value><source>core-default.xml</source></property>
  1963. <property><name>mapreduce.ifile.readahead</name><value>true</value><source>mapred-default.xml</source></property>
  1964. <property><name>mapreduce.jobhistory.joblist.cache.size</name><value>20000</value><source>mapred-default.xml</source></property>
  1965. <property><name>mapreduce.job.end-notification.max.attempts</name><value>5</value><source>mapred-default.xml</source></property>
  1966. <property><name>dfs.image.transfer.timeout</name><value>600000</value><source>hdfs-default.xml</source></property>
  1967. <property><name>hbase.regionserver.optionallogflushinterval</name><value>1000</value><source>hbase-default.xml</source></property>
  1968. <property><name>mapreduce.reduce.shuffle.connect.timeout</name><value>180000</value><source>mapred-default.xml</source></property>
  1969. <property><name>mapreduce.jobhistory.webapp.address</name><value>0.0.0.0:19888</value><source>mapred-default.xml</source></property>
  1970. <property><name>dfs.datanode.failed.volumes.tolerated</name><value>0</value><source>hdfs-default.xml</source></property>
  1971. <property><name>dfs.datanode.data.dir.perm</name><value>700</value><source>hdfs-default.xml</source></property>
  1972. <property><name>hadoop.http.authentication.token.validity</name><value>36000</value><source>core-default.xml</source></property>
  1973. <property><name>ipc.client.connect.max.retries.on.timeouts</name><value>45</value><source>core-default.xml</source></property>
  1974. <property><name>yarn.app.mapreduce.am.job.committer.cancel-timeout</name><value>60000</value><source>mapred-default.xml</source></property>
  1975. <property><name>dfs.ha.fencing.ssh.connect-timeout</name><value>30000</value><source>core-default.xml</source></property>
  1976. <property><name>hbase.data.umask</name><value>000</value><source>hbase-default.xml</source></property>
  1977. <property><name>mapreduce.reduce.log.level</name><value>INFO</value><source>mapred-default.xml</source></property>
  1978. <property><name>mapreduce.reduce.shuffle.merge.percent</name><value>0.66</value><source>mapred-default.xml</source></property>
  1979. <property><name>ipc.client.fallback-to-simple-auth-allowed</name><value>false</value><source>core-default.xml</source></property>
  1980. <property><name>io.serializations</name><value>org.apache.hadoop.io.serializer.WritableSerialization,org.apache.hadoop.io.serializer.avro.AvroSpecificSerialization,org.apache.hadoop.io.serializer.avro.AvroReflectSerialization</value><source>core-default.xml</source></property>
  1981. <property><name>fs.s3.block.size</name><value>67108864</value><source>core-default.xml</source></property>
  1982. <property><name>hbase.regionserver.hlog.writer.impl</name><value>org.apache.hadoop.hbase.regionserver.wal.ProtobufLogWriter</value><source>hbase-default.xml</source></property>
  1983. <property><name>hadoop.kerberos.kinit.command</name><value>kinit</value><source>core-default.xml</source></property>
  1984. <property><name>hbase.regionserver.global.memstore.lowerLimit</name><value>0.38</value><source>hbase-default.xml</source></property>
  1985. <property><name>yarn.resourcemanager.fs.state-store.uri</name><value>${hadoop.tmp.dir}/yarn/system/rmstore</value><source>yarn-default.xml</source></property>
  1986. <property><name>hbase.regionserver.region.split.policy</name><value>org.apache.hadoop.hbase.regionserver.IncreasingToUpperBoundRegionSplitPolicy</value><source>hbase-default.xml</source></property>
  1987. <property><name>yarn.admin.acl</name><value>*</value><source>yarn-default.xml</source></property>
  1988. <property><name>dfs.namenode.delegation.token.max-lifetime</name><value>604800000</value><source>hdfs-default.xml</source></property>
  1989. <property><name>mapreduce.reduce.merge.inmem.threshold</name><value>1000</value><source>mapred-default.xml</source></property>
  1990. <property><name>net.topology.impl</name><value>org.apache.hadoop.net.NetworkTopology</value><source>core-default.xml</source></property>
  1991. <property><name>dfs.datanode.use.datanode.hostname</name><value>false</value><source>hdfs-default.xml</source></property>
  1992. <property><name>dfs.heartbeat.interval</name><value>3</value><source>hdfs-default.xml</source></property>
  1993. <property><name>yarn.resourcemanager.scheduler.class</name><value>org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler</value><source>yarn-default.xml</source></property>
  1994. <property><name>io.map.index.skip</name><value>0</value><source>core-default.xml</source></property>
  1995. <property><name>yarn.resourcemanager.webapp.https.address</name><value>${yarn.resourcemanager.hostname}:8090</value><source>yarn-default.xml</source></property>
  1996. <property><name>dfs.namenode.handler.count</name><value>10</value><source>hdfs-default.xml</source></property>
  1997. <property><name>yarn.nodemanager.admin-env</name><value>MALLOC_ARENA_MAX=$MALLOC_ARENA_MAX</value><source>yarn-default.xml</source></property>
  1998. <property><name>hbase.client.max.total.tasks</name><value>100</value><source>hbase-default.xml</source></property>
  1999. <property><name>mapreduce.jobtracker.jobhistory.block.size</name><value>3145728</value><source>mapred-default.xml</source></property>
  2000. <property><name>hbase.zookeeper.peerport</name><value>2888</value><source>hbase-default.xml</source></property>
  2001. <property><name>yarn.nodemanager.aux-services.mapreduce_shuffle.class</name><value>org.apache.hadoop.mapred.ShuffleHandler</value><source>yarn-default.xml</source></property>
  2002. <property><name>mapreduce.cluster.acls.enabled</name><value>false</value><source>mapred-default.xml</source></property>
  2003. <property><name>hbase.regionserver.info.port</name><value>60030</value><source>hbase-default.xml</source></property>
  2004. <property><name>hbase.hregion.majorcompaction.jitter</name><value>0.50</value><source>hbase-default.xml</source></property>
  2005. <property><name>mapreduce.tasktracker.map.tasks.maximum</name><value>2</value><source>mapred-default.xml</source></property>
  2006. <property><name>ipc.client.connect.timeout</name><value>20000</value><source>core-default.xml</source></property>
  2007. <property><name>yarn.nodemanager.remote-app-log-dir-suffix</name><value>logs</value><source>yarn-default.xml</source></property>
  2008. <property><name>fs.df.interval</name><value>60000</value><source>core-default.xml</source></property>
  2009. <property><name>hadoop.util.hash.type</name><value>murmur</value><source>core-default.xml</source></property>
  2010. <property><name>mapreduce.jobhistory.minicluster.fixed.ports</name><value>false</value><source>mapred-default.xml</source></property>
  2011. <property><name>nfs3.mountd.port</name><value>4242</value><source>core-default.xml</source></property>
  2012. <property><name>mapreduce.jobtracker.jobhistory.lru.cache.size</name><value>5</value><source>mapred-default.xml</source></property>
  2013. <property><name>dfs.client.failover.max.attempts</name><value>15</value><source>hdfs-default.xml</source></property>
  2014. <property><name>dfs.client.use.datanode.hostname</name><value>false</value><source>hdfs-default.xml</source></property>
  2015. <property><name>ha.zookeeper.acl</name><value>world:anyone:rwcda</value><source>core-default.xml</source></property>
  2016. <property><name>mapreduce.jobtracker.maxtasks.perjob</name><value>-1</value><source>mapred-default.xml</source></property>
  2017. <property><name>mapreduce.map.sort.spill.percent</name><value>0.80</value><source>mapred-default.xml</source></property>
  2018. <property><name>file.stream-buffer-size</name><value>4096</value><source>core-default.xml</source></property>
  2019. <property><name>hbase.regionserver.catalog.timeout</name><value>600000</value><source>hbase-default.xml</source></property>
  2020. <property><name>hbase.security.authentication</name><value>simple</value><source>hbase-default.xml</source></property>
  2021. <property><name>hadoop.fuse.connection.timeout</name><value>300</value><source>hdfs-default.xml</source></property>
  2022. <property><name>hbase.client.keyvalue.maxsize</name><value>10485760</value><source>hbase-default.xml</source></property>
  2023. <property><name>mapreduce.tasktracker.instrumentation</name><value>org.apache.hadoop.mapred.TaskTrackerMetricsInst</value><source>mapred-default.xml</source></property>
  2024. <property><name>io.seqfile.sorter.recordlimit</name><value>1000000</value><source>core-default.xml</source></property>
  2025. <property><name>yarn.app.mapreduce.am.resource.mb</name><value>1536</value><source>mapred-default.xml</source></property>
  2026. <property><name>mapreduce.framework.name</name><value>local</value><source>mapred-default.xml</source></property>
  2027. <property><name>mapreduce.job.reduce.slowstart.completedmaps</name><value>0.05</value><source>mapred-default.xml</source></property>
  2028. <property><name>yarn.resourcemanager.client.thread-count</name><value>50</value><source>yarn-default.xml</source></property>
  2029. <property><name>mapreduce.cluster.temp.dir</name><value>${hadoop.tmp.dir}/mapred/temp</value><source>mapred-default.xml</source></property>
  2030. <property><name>mapreduce.jobhistory.intermediate-done-dir</name><value>${yarn.app.mapreduce.am.staging-dir}/history/done_intermediate</value><source>mapred-default.xml</source></property>
  2031. <property><name>hbase.defaults.for.version.skip</name><value>false</value><source>hbase-default.xml</source></property>
  2032. </configuration>
  2033.  
  2034. Logs
  2035. ===========================================================
  2036. +++++++++++++++++++++++++++++++
  2037. /opt/hbase/bin/../logs/hbase-hadoop-regionserver-slave2.log
  2038. +++++++++++++++++++++++++++++++
  2039. 2014-07-10 14:00:15,814 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HStore: Starting compaction of 3 file(s) in cf1 of visited_article,204644f25ca678a2fe64b28ade4f1b0c\x00\x0A\x1C\xDE,1388226171288.e5472d54066f93e8591fa51fe4f27541. into tmpdir=hdfs://master:9000/hbase/data/default/visited_article/e5472d54066f93e8591fa51fe4f27541/.tmp, totalSize=29.8 M
  2040. 2014-07-10 14:00:17,398 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HStore: Completed compaction of 3 file(s) in cf1 of visited_article,204644f25ca678a2fe64b28ade4f1b0c\x00\x0A\x1C\xDE,1388226171288.e5472d54066f93e8591fa51fe4f27541. into f1d0e314777a468ca8abf6a7abbd7747(size=29.7 M), total size for store is 2.3 G. This selection was in queue for 0sec, and took 1sec to execute.
  2041. 2014-07-10 14:00:17,398 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.CompactSplitThread: Completed compaction: Request = regionName=visited_article,204644f25ca678a2fe64b28ade4f1b0c\x00\x0A\x1C\xDE,1388226171288.e5472d54066f93e8591fa51fe4f27541., storeName=cf1, fileCount=3, fileSize=29.8 M, priority=6, time=47229488459725281; duration=1sec
  2042. 2014-07-10 14:05:03,294 WARN [RpcServer.handler=20,port=60020] ipc.RpcServer: RpcServer.respondercallId: 304 service: ClientService methodName: Multi size: 324 connection: 64.78.170.82:38536: output error
  2043. 2014-07-10 14:05:03,294 WARN [RpcServer.handler=20,port=60020] ipc.RpcServer: RpcServer.handler=20,port=60020: caught a ClosedChannelException, this means that the server was processing a request but the client went away. The error message was: null
  2044. 2014-07-10 14:05:53,687 INFO [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/WALs/slave2,60020,1397552649456/slave2%2C60020%2C1397552649456.1404968753563 with entries=129301, filesize=53.7 M; new WAL /hbase/WALs/slave2,60020,1397552649456/slave2%2C60020%2C1397552649456.1404972353650
  2045. 2014-07-10 14:05:53,688 INFO [regionserver60020.logRoller] wal.FSHLog: moving old hlog file /hbase/WALs/slave2,60020,1397552649456/slave2%2C60020%2C1397552649456.1404965153418 whose highest sequenceid is 1456814580 to /hbase/oldWALs/slave2%2C60020%2C1397552649456.1404965153418
  2046. 2014-07-10 14:13:49,614 WARN [RpcServer.reader=7,port=60020] ipc.RpcServer: RpcServer.listener,port=60020: count of bytes read: 0
  2047. java.io.IOException: Connection reset by peer
  2048. at sun.nio.ch.FileDispatcher.read0(Native Method)
  2049. at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
  2050. at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:251)
  2051. at sun.nio.ch.IOUtil.read(IOUtil.java:224)
  2052. at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:254)
  2053. at org.apache.hadoop.hbase.ipc.RpcServer.channelRead(RpcServer.java:2404)
  2054. at org.apache.hadoop.hbase.ipc.RpcServer$Connection.readAndProcess(RpcServer.java:1425)
  2055. at org.apache.hadoop.hbase.ipc.RpcServer$Listener.doRead(RpcServer.java:780)
  2056. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:568)
  2057. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:543)
  2058. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
  2059. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  2060. at java.lang.Thread.run(Thread.java:701)
  2061. 2014-07-10 14:16:12,261 WARN [RpcServer.handler=2,port=60020] ipc.RpcServer: RpcServer.respondercallId: 24752 service: ClientService methodName: Multi size: 235 connection: 64.78.165.82:42668: output error
  2062. 2014-07-10 14:16:12,261 WARN [RpcServer.handler=2,port=60020] ipc.RpcServer: RpcServer.handler=2,port=60020: caught a ClosedChannelException, this means that the server was processing a request but the client went away. The error message was: null
  2063. 2014-07-10 14:20:31,159 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region visited_article,600fcc228b36625c1904ba4f11e6207a\x00\x17o\xD8,1395813592646.b3a19a2f85e170275c4f141a18a08abf. after a delay of 19632
  2064. 2014-07-10 14:20:41,158 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region visited_article,600fcc228b36625c1904ba4f11e6207a\x00\x17o\xD8,1395813592646.b3a19a2f85e170275c4f141a18a08abf. after a delay of 18094
  2065. 2014-07-10 14:20:50,816 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1456973245, memsize=1.1 M, hasBloomFilter=true, into tmp file hdfs://master:9000/hbase/data/default/visited_article/b3a19a2f85e170275c4f141a18a08abf/.tmp/84ac91b188e9476eaab228aa0597ced7
  2066. 2014-07-10 14:20:50,830 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://master:9000/hbase/data/default/visited_article/b3a19a2f85e170275c4f141a18a08abf/cf1/84ac91b188e9476eaab228aa0597ced7, entries=5208, sequenceid=1456973245, filesize=167.5 K
  2067. 2014-07-10 14:20:50,830 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~1.1 M/1142688, currentsize=0/0 for region visited_article,600fcc228b36625c1904ba4f11e6207a\x00\x17o\xD8,1395813592646.b3a19a2f85e170275c4f141a18a08abf. in 38ms, sequenceid=1456973245, compaction requested=true
  2068. 2014-07-10 14:20:50,831 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HRegion: Starting compaction on cf1 in region visited_article,600fcc228b36625c1904ba4f11e6207a\x00\x17o\xD8,1395813592646.b3a19a2f85e170275c4f141a18a08abf.
  2069. 2014-07-10 14:20:50,831 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HStore: Starting compaction of 3 file(s) in cf1 of visited_article,600fcc228b36625c1904ba4f11e6207a\x00\x17o\xD8,1395813592646.b3a19a2f85e170275c4f141a18a08abf. into tmpdir=hdfs://master:9000/hbase/data/default/visited_article/b3a19a2f85e170275c4f141a18a08abf/.tmp, totalSize=24.7 M
  2070. 2014-07-10 14:20:52,233 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HStore: Completed compaction of 3 file(s) in cf1 of visited_article,600fcc228b36625c1904ba4f11e6207a\x00\x17o\xD8,1395813592646.b3a19a2f85e170275c4f141a18a08abf. into 506678d76dc449cd8e32b58f77b0b99e(size=24.7 M), total size for store is 1.1 G. This selection was in queue for 0sec, and took 1sec to execute.
  2071. 2014-07-10 14:20:52,233 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.CompactSplitThread: Completed compaction: Request = regionName=visited_article,600fcc228b36625c1904ba4f11e6207a\x00\x17o\xD8,1395813592646.b3a19a2f85e170275c4f141a18a08abf., storeName=cf1, fileCount=3, fileSize=24.7 M, priority=6, time=47230723476667924; duration=1sec
  2072. 2014-07-10 14:25:02,254 WARN [RpcServer.reader=6,port=60020] ipc.RpcServer: RpcServer.listener,port=60020: count of bytes read: 0
  2073. java.io.IOException: Connection reset by peer
  2074. at sun.nio.ch.FileDispatcher.read0(Native Method)
  2075. at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
  2076. at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:251)
  2077. at sun.nio.ch.IOUtil.read(IOUtil.java:224)
  2078. at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:254)
  2079. at org.apache.hadoop.hbase.ipc.RpcServer.channelRead(RpcServer.java:2404)
  2080. at org.apache.hadoop.hbase.ipc.RpcServer$Connection.readAndProcess(RpcServer.java:1425)
  2081. at org.apache.hadoop.hbase.ipc.RpcServer$Listener.doRead(RpcServer.java:780)
  2082. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:568)
  2083. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:543)
  2084. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
  2085. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  2086. at java.lang.Thread.run(Thread.java:701)
  2087. 2014-07-10 14:26:09,108 WARN [RpcServer.handler=25,port=60020] ipc.RpcServer: RpcServer.respondercallId: 5979 service: ClientService methodName: Get size: 160 connection: 64.78.164.178:37232: output error
  2088. 2014-07-10 14:26:09,108 WARN [RpcServer.handler=25,port=60020] ipc.RpcServer: RpcServer.handler=25,port=60020: caught a ClosedChannelException, this means that the server was processing a request but the client went away. The error message was: null
  2089. 2014-07-10 14:26:39,502 WARN [RpcServer.handler=2,port=60020] ipc.RpcServer: RpcServer.respondercallId: 124569 service: ClientService methodName: Get size: 161 connection: 64.78.164.242:35056: output error
  2090. 2014-07-10 14:26:39,502 WARN [RpcServer.handler=2,port=60020] ipc.RpcServer: RpcServer.handler=2,port=60020: caught a ClosedChannelException, this means that the server was processing a request but the client went away. The error message was: null
  2091. 2014-07-10 14:28:45,346 WARN [RpcServer.handler=4,port=60020] ipc.RpcServer: RpcServer.respondercallId: 939 service: ClientService methodName: Get size: 133 connection: 64.78.170.82:42675: output error
  2092. 2014-07-10 14:28:45,347 WARN [RpcServer.handler=4,port=60020] ipc.RpcServer: RpcServer.handler=4,port=60020: caught a ClosedChannelException, this means that the server was processing a request but the client went away. The error message was: null
  2093. 2014-07-10 14:28:50,529 WARN [RpcServer.handler=0,port=60020] ipc.RpcServer: RpcServer.respondercallId: 68838 service: ClientService methodName: Multi size: 292 connection: 64.78.164.242:35156: output error
  2094. 2014-07-10 14:28:50,530 WARN [RpcServer.handler=0,port=60020] ipc.RpcServer: RpcServer.handler=0,port=60020: caught a ClosedChannelException, this means that the server was processing a request but the client went away. The error message was: null
  2095. 2014-07-10 14:30:57,518 WARN [RpcServer.handler=29,port=60020] ipc.RpcServer: RpcServer.respondercallId: 68898 service: ClientService methodName: Get size: 134 connection: 64.78.164.242:35237: output error
  2096. 2014-07-10 14:30:57,518 WARN [RpcServer.handler=29,port=60020] ipc.RpcServer: RpcServer.handler=29,port=60020: caught a ClosedChannelException, this means that the server was processing a request but the client went away. The error message was: null
  2097. 2014-07-10 14:31:36,163 WARN [RpcServer.reader=7,port=60020] ipc.RpcServer: RpcServer.listener,port=60020: count of bytes read: 0
  2098. java.io.IOException: Connection reset by peer
  2099. at sun.nio.ch.FileDispatcher.read0(Native Method)
  2100. at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
  2101. at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:251)
  2102. at sun.nio.ch.IOUtil.read(IOUtil.java:224)
  2103. at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:254)
  2104. at org.apache.hadoop.hbase.ipc.RpcServer.channelRead(RpcServer.java:2404)
  2105. at org.apache.hadoop.hbase.ipc.RpcServer$Connection.readAndProcess(RpcServer.java:1425)
  2106. at org.apache.hadoop.hbase.ipc.RpcServer$Listener.doRead(RpcServer.java:780)
  2107. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:568)
  2108. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:543)
  2109. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
  2110. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  2111. at java.lang.Thread.run(Thread.java:701)
  2112. 2014-07-10 14:32:11,163 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region visited_article,,1390820890834.f7635647bcae9291971843131c4add0b. after a delay of 17487
  2113. 2014-07-10 14:32:21,163 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region url_guid,60208b,1387273200413.c73728f0c060569c44ade8188c6ea84f. after a delay of 7057
  2114. 2014-07-10 14:32:21,163 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region visited_article,,1390820890834.f7635647bcae9291971843131c4add0b. after a delay of 17006
  2115. 2014-07-10 14:32:28,251 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1456997231, memsize=832.1 K, hasBloomFilter=true, into tmp file hdfs://master:9000/hbase/data/default/url_guid/c73728f0c060569c44ade8188c6ea84f/.tmp/5b0252f92bee483997a39c4b706c7b07
  2116. 2014-07-10 14:32:28,267 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://master:9000/hbase/data/default/url_guid/c73728f0c060569c44ade8188c6ea84f/cf1/5b0252f92bee483997a39c4b706c7b07, entries=3842, sequenceid=1456997231, filesize=164.9 K
  2117. 2014-07-10 14:32:28,267 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~841.3 K/861480, currentsize=0/0 for region url_guid,60208b,1387273200413.c73728f0c060569c44ade8188c6ea84f. in 47ms, sequenceid=1456997231, compaction requested=true
  2118. 2014-07-10 14:32:28,677 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1456997242, memsize=1.2 M, hasBloomFilter=true, into tmp file hdfs://master:9000/hbase/data/default/visited_article/f7635647bcae9291971843131c4add0b/.tmp/cc40baa3c12a4d12b2b93eab74ef3c9a
  2119. 2014-07-10 14:32:28,699 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://master:9000/hbase/data/default/visited_article/f7635647bcae9291971843131c4add0b/cf1/cc40baa3c12a4d12b2b93eab74ef3c9a, entries=5682, sequenceid=1456997242, filesize=174.9 K
  2120. 2014-07-10 14:32:28,699 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~1.2 M/1240888, currentsize=0/0 for region visited_article,,1390820890834.f7635647bcae9291971843131c4add0b. in 47ms, sequenceid=1456997242, compaction requested=true
  2121. 2014-07-10 14:32:28,700 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HRegion: Starting compaction on cf1 in region visited_article,,1390820890834.f7635647bcae9291971843131c4add0b.
  2122. 2014-07-10 14:32:28,700 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HStore: Starting compaction of 3 file(s) in cf1 of visited_article,,1390820890834.f7635647bcae9291971843131c4add0b. into tmpdir=hdfs://master:9000/hbase/data/default/visited_article/f7635647bcae9291971843131c4add0b/.tmp, totalSize=8.1 M
  2123. 2014-07-10 14:32:29,640 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HStore: Completed compaction of 3 file(s) in cf1 of visited_article,,1390820890834.f7635647bcae9291971843131c4add0b. into f642c62ed6354fecb6d203da9b3ba4ea(size=8.1 M), total size for store is 1.1 G. This selection was in queue for 0sec, and took 0sec to execute.
  2124. 2014-07-10 14:32:29,641 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.CompactSplitThread: Completed compaction: Request = regionName=visited_article,,1390820890834.f7635647bcae9291971843131c4add0b., storeName=cf1, fileCount=3, fileSize=8.1 M, priority=6, time=47231421345869722; duration=0sec
  2125. 2014-07-10 14:39:59,592 WARN [RpcServer.reader=9,port=60020] ipc.RpcServer: RpcServer.listener,port=60020: count of bytes read: 0
  2126. java.io.IOException: Connection reset by peer
  2127. at sun.nio.ch.FileDispatcher.read0(Native Method)
  2128. at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
  2129. at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:251)
  2130. at sun.nio.ch.IOUtil.read(IOUtil.java:224)
  2131. at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:254)
  2132. at org.apache.hadoop.hbase.ipc.RpcServer.channelRead(RpcServer.java:2404)
  2133. at org.apache.hadoop.hbase.ipc.RpcServer$Connection.readAndProcess(RpcServer.java:1425)
  2134. at org.apache.hadoop.hbase.ipc.RpcServer$Listener.doRead(RpcServer.java:780)
  2135. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:568)
  2136. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:543)
  2137. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
  2138. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  2139. at java.lang.Thread.run(Thread.java:701)
  2140. 2014-07-10 14:47:31,172 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region url_guid,781e82be88ce94de7bb2dee9f3436e97,1392692827380.ded050ffeacd83613a0e3db7baaee4f0. after a delay of 18474
  2141. 2014-07-10 14:47:41,172 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region url_guid,781e82be88ce94de7bb2dee9f3436e97,1392692827380.ded050ffeacd83613a0e3db7baaee4f0. after a delay of 18086
  2142. 2014-07-10 14:47:49,675 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1457030873, memsize=420.1 K, hasBloomFilter=true, into tmp file hdfs://master:9000/hbase/data/default/url_guid/ded050ffeacd83613a0e3db7baaee4f0/.tmp/5538855e045d495bac7a9ebee3aa1a06
  2143. 2014-07-10 14:47:49,690 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://master:9000/hbase/data/default/url_guid/ded050ffeacd83613a0e3db7baaee4f0/cf1/5538855e045d495bac7a9ebee3aa1a06, entries=1930, sequenceid=1457030873, filesize=84.1 K
  2144. 2014-07-10 14:47:49,690 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~426.1 K/436368, currentsize=0/0 for region url_guid,781e82be88ce94de7bb2dee9f3436e97,1392692827380.ded050ffeacd83613a0e3db7baaee4f0. in 44ms, sequenceid=1457030873, compaction requested=true
  2145. 2014-07-10 14:47:49,691 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HRegion: Starting compaction on cf1 in region url_guid,781e82be88ce94de7bb2dee9f3436e97,1392692827380.ded050ffeacd83613a0e3db7baaee4f0.
  2146. 2014-07-10 14:47:49,691 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HStore: Starting compaction of 3 file(s) in cf1 of url_guid,781e82be88ce94de7bb2dee9f3436e97,1392692827380.ded050ffeacd83613a0e3db7baaee4f0. into tmpdir=hdfs://master:9000/hbase/data/default/url_guid/ded050ffeacd83613a0e3db7baaee4f0/.tmp, totalSize=12.8 M
  2147. 2014-07-10 14:47:50,371 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HStore: Completed compaction of 3 file(s) in cf1 of url_guid,781e82be88ce94de7bb2dee9f3436e97,1392692827380.ded050ffeacd83613a0e3db7baaee4f0. into 4c9b3e43f8584149aa8ba98dc06cf012(size=12.8 M), total size for store is 586.1 M. This selection was in queue for 0sec, and took 0sec to execute.
  2148. 2014-07-10 14:47:50,371 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.CompactSplitThread: Completed compaction: Request = regionName=url_guid,781e82be88ce94de7bb2dee9f3436e97,1392692827380.ded050ffeacd83613a0e3db7baaee4f0., storeName=cf1, fileCount=3, fileSize=12.8 M, priority=6, time=47232342336828226; duration=0sec
  2149. 2014-07-10 14:51:31,208 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region article,804d25f09ba3603572620c7c42869e60,1388454093837.96d761959641d2ccc69c224c06b52671. after a delay of 3513
  2150. 2014-07-10 14:51:35,116 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1457035499, memsize=5.3 M, hasBloomFilter=true, into tmp file hdfs://master:9000/hbase/data/default/article/96d761959641d2ccc69c224c06b52671/.tmp/277227473a134a3580503f4ffaf04ab8
  2151. 2014-07-10 14:51:35,747 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1457035499, memsize=13.9 M, hasBloomFilter=true, into tmp file hdfs://master:9000/hbase/data/default/article/96d761959641d2ccc69c224c06b52671/.tmp/188f08e23b8a4b279fb742173328c249
  2152. 2014-07-10 14:51:35,883 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://master:9000/hbase/data/default/article/96d761959641d2ccc69c224c06b52671/detail/277227473a134a3580503f4ffaf04ab8, entries=4551, sequenceid=1457035499, filesize=2.9 M
  2153. 2014-07-10 14:51:35,907 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://master:9000/hbase/data/default/article/96d761959641d2ccc69c224c06b52671/list/188f08e23b8a4b279fb742173328c249, entries=67837, sequenceid=1457035499, filesize=2.2 M
  2154. 2014-07-10 14:51:35,907 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~21.2 M/22181968, currentsize=832/832 for region article,804d25f09ba3603572620c7c42869e60,1388454093837.96d761959641d2ccc69c224c06b52671. in 1186ms, sequenceid=1457035499, compaction requested=true
  2155. 2014-07-10 14:51:35,907 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HRegion: Starting compaction on list in region article,804d25f09ba3603572620c7c42869e60,1388454093837.96d761959641d2ccc69c224c06b52671.
  2156. 2014-07-10 14:51:35,908 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HStore: Starting compaction of 3 file(s) in list of article,804d25f09ba3603572620c7c42869e60,1388454093837.96d761959641d2ccc69c224c06b52671. into tmpdir=hdfs://master:9000/hbase/data/default/article/96d761959641d2ccc69c224c06b52671/.tmp, totalSize=120.0 M
  2157. 2014-07-10 14:51:44,062 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.StoreFile$Reader: Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 956beae66c464c06bbd6e49fbe9b4efd
  2158. 2014-07-10 14:51:44,068 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.StoreFile$Reader: Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 956beae66c464c06bbd6e49fbe9b4efd
  2159. 2014-07-10 14:51:44,241 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HStore: Completed compaction of 3 file(s) in list of article,804d25f09ba3603572620c7c42869e60,1388454093837.96d761959641d2ccc69c224c06b52671. into 956beae66c464c06bbd6e49fbe9b4efd(size=118.1 M), total size for store is 4.9 G. This selection was in queue for 0sec, and took 8sec to execute.
  2160. 2014-07-10 14:51:44,241 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.CompactSplitThread: Completed compaction: Request = regionName=article,804d25f09ba3603572620c7c42869e60,1388454093837.96d761959641d2ccc69c224c06b52671., storeName=list, fileCount=3, fileSize=120.0 M, priority=6, time=47232568553543670; duration=8sec
  2161. 2014-07-10 14:53:21,209 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region article,,1392692828476.f6b3920b4bb1f63832b3a0529c639e6f. after a delay of 4104
  2162. 2014-07-10 14:53:25,373 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1457037179, memsize=2.7 M, hasBloomFilter=true, into tmp file hdfs://master:9000/hbase/data/default/article/f6b3920b4bb1f63832b3a0529c639e6f/.tmp/0eb4be043cc045cf886117015289b96a
  2163. 2014-07-10 14:53:25,450 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1457037179, memsize=6.7 M, hasBloomFilter=true, into tmp file hdfs://master:9000/hbase/data/default/article/f6b3920b4bb1f63832b3a0529c639e6f/.tmp/de2b30770a2e4d728ffc57f9d02b0ce8
  2164. 2014-07-10 14:53:25,476 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://master:9000/hbase/data/default/article/f6b3920b4bb1f63832b3a0529c639e6f/detail/0eb4be043cc045cf886117015289b96a, entries=2139, sequenceid=1457037179, filesize=1.4 M
  2165. 2014-07-10 14:53:25,489 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://master:9000/hbase/data/default/article/f6b3920b4bb1f63832b3a0529c639e6f/list/de2b30770a2e4d728ffc57f9d02b0ce8, entries=32485, sequenceid=1457037179, filesize=1.1 M
  2166. 2014-07-10 14:53:25,489 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~10.5 M/11009008, currentsize=0/0 for region article,,1392692828476.f6b3920b4bb1f63832b3a0529c639e6f. in 176ms, sequenceid=1457037179, compaction requested=true
  2167. 2014-07-10 14:53:25,489 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HRegion: Starting compaction on detail in region article,,1392692828476.f6b3920b4bb1f63832b3a0529c639e6f.
  2168. 2014-07-10 14:53:25,490 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HStore: Starting compaction of 3 file(s) in detail of article,,1392692828476.f6b3920b4bb1f63832b3a0529c639e6f. into tmpdir=hdfs://master:9000/hbase/data/default/article/f6b3920b4bb1f63832b3a0529c639e6f/.tmp, totalSize=18.0 M
  2169. 2014-07-10 14:53:28,857 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HStore: Completed compaction of 3 file(s) in detail of article,,1392692828476.f6b3920b4bb1f63832b3a0529c639e6f. into 73e2a422a7b249359092b7eb6c5934d8(size=18.0 M), total size for store is 4.9 G. This selection was in queue for 0sec, and took 3sec to execute.
  2170. 2014-07-10 14:53:28,857 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.CompactSplitThread: Completed compaction: Request = regionName=article,,1392692828476.f6b3920b4bb1f63832b3a0529c639e6f., storeName=detail, fileCount=3, fileSize=18.0 M, priority=6, time=47232678135742435; duration=3sec
  2171. 2014-07-10 14:53:28,858 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HRegion: Starting compaction on list in region article,,1392692828476.f6b3920b4bb1f63832b3a0529c639e6f.
  2172. 2014-07-10 14:53:28,858 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HStore: Starting compaction of 3 file(s) in list of article,,1392692828476.f6b3920b4bb1f63832b3a0529c639e6f. into tmpdir=hdfs://master:9000/hbase/data/default/article/f6b3920b4bb1f63832b3a0529c639e6f/.tmp, totalSize=16.6 M
  2173. 2014-07-10 14:53:29,680 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.StoreFile$Reader: Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b42824dc53fd4c7db0ec4246dbea32ce
  2174. 2014-07-10 14:53:29,695 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.StoreFile$Reader: Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b42824dc53fd4c7db0ec4246dbea32ce
  2175. 2014-07-10 14:53:30,045 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HStore: Completed compaction of 3 file(s) in list of article,,1392692828476.f6b3920b4bb1f63832b3a0529c639e6f. into b42824dc53fd4c7db0ec4246dbea32ce(size=15.7 M), total size for store is 2.4 G. This selection was in queue for 0sec, and took 1sec to execute.
  2176. 2014-07-10 14:53:30,045 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.CompactSplitThread: Completed compaction: Request = regionName=article,,1392692828476.f6b3920b4bb1f63832b3a0529c639e6f., storeName=list, fileCount=3, fileSize=16.6 M, priority=5, time=47232681503822099; duration=1sec
  2177. 2014-07-10 14:54:11,209 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region url_guid,e00998f7542fadc8e0b9c1f260780d16,1386609914459.b4275622def9b40e84be8b79ff61dfef. after a delay of 21254
  2178. 2014-07-10 14:54:21,209 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region url_guid,e00998f7542fadc8e0b9c1f260780d16,1386609914459.b4275622def9b40e84be8b79ff61dfef. after a delay of 22226
  2179. 2014-07-10 14:54:31,209 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region url_guid,e00998f7542fadc8e0b9c1f260780d16,1386609914459.b4275622def9b40e84be8b79ff61dfef. after a delay of 18198
  2180. 2014-07-10 14:54:32,493 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1457038009, memsize=1.5 M, hasBloomFilter=true, into tmp file hdfs://master:9000/hbase/data/default/url_guid/b4275622def9b40e84be8b79ff61dfef/.tmp/6d1d57bf74344adcaba41f358df5936b
  2181. 2014-07-10 14:54:32,506 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://master:9000/hbase/data/default/url_guid/b4275622def9b40e84be8b79ff61dfef/cf1/6d1d57bf74344adcaba41f358df5936b, entries=6956, sequenceid=1457038009, filesize=298.0 K
  2182. 2014-07-10 14:54:32,506 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~1.5 M/1563496, currentsize=0/0 for region url_guid,e00998f7542fadc8e0b9c1f260780d16,1386609914459.b4275622def9b40e84be8b79ff61dfef. in 42ms, sequenceid=1457038009, compaction requested=true
  2183. 2014-07-10 14:55:01,209 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region article,dffe0300a6722922f2c4c93b352c3c54,1394100183332.55f82857c8408b1af3d671dacfce0b9b. after a delay of 15730
  2184. 2014-07-10 14:55:01,210 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region article,3841557549dce31b0c552c81f0b4ad04,1395916557016.b3d7c510a7bbe6e2c0acb162f9ff68c7. after a delay of 16017
  2185. 2014-07-10 14:55:11,209 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region article,dffe0300a6722922f2c4c93b352c3c54,1394100183332.55f82857c8408b1af3d671dacfce0b9b. after a delay of 3006
  2186. 2014-07-10 14:55:11,209 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region article,3841557549dce31b0c552c81f0b4ad04,1395916557016.b3d7c510a7bbe6e2c0acb162f9ff68c7. after a delay of 21604
  2187. 2014-07-10 14:55:17,422 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1457038746, memsize=5.8 M, hasBloomFilter=true, into tmp file hdfs://master:9000/hbase/data/default/article/55f82857c8408b1af3d671dacfce0b9b/.tmp/6e0fd3afbe4f4b07b57cfd687d637e32
  2188. 2014-07-10 14:55:17,959 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1457038746, memsize=13.3 M, hasBloomFilter=true, into tmp file hdfs://master:9000/hbase/data/default/article/55f82857c8408b1af3d671dacfce0b9b/.tmp/f718c39a6e634694a98eefa485bba674
  2189. 2014-07-10 14:55:17,975 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://master:9000/hbase/data/default/article/55f82857c8408b1af3d671dacfce0b9b/detail/6e0fd3afbe4f4b07b57cfd687d637e32, entries=4340, sequenceid=1457038746, filesize=3.1 M
  2190. 2014-07-10 14:55:18,015 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://master:9000/hbase/data/default/article/55f82857c8408b1af3d671dacfce0b9b/list/f718c39a6e634694a98eefa485bba674, entries=64667, sequenceid=1457038746, filesize=2.1 M
  2191. 2014-07-10 14:55:18,016 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~21.1 M/22115280, currentsize=832/832 for region article,dffe0300a6722922f2c4c93b352c3c54,1394100183332.55f82857c8408b1af3d671dacfce0b9b. in 1077ms, sequenceid=1457038746, compaction requested=true
  2192. 2014-07-10 14:55:18,063 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1457038759, memsize=2.7 M, hasBloomFilter=true, into tmp file hdfs://master:9000/hbase/data/default/article/b3d7c510a7bbe6e2c0acb162f9ff68c7/.tmp/46b58807a66846b4848ab78e3c2939e1
  2193. 2014-07-10 14:55:18,148 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1457038759, memsize=6.7 M, hasBloomFilter=true, into tmp file hdfs://master:9000/hbase/data/default/article/b3d7c510a7bbe6e2c0acb162f9ff68c7/.tmp/f49aaf41d5164e32b0be88972b17ff34
  2194. 2014-07-10 14:55:18,161 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://master:9000/hbase/data/default/article/b3d7c510a7bbe6e2c0acb162f9ff68c7/detail/46b58807a66846b4848ab78e3c2939e1, entries=2188, sequenceid=1457038759, filesize=1.5 M
  2195. 2014-07-10 14:55:18,174 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://master:9000/hbase/data/default/article/b3d7c510a7bbe6e2c0acb162f9ff68c7/list/f49aaf41d5164e32b0be88972b17ff34, entries=32813, sequenceid=1457038759, filesize=1.1 M
  2196. 2014-07-10 14:55:18,174 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~10.5 M/11033216, currentsize=0/0 for region article,3841557549dce31b0c552c81f0b4ad04,1395916557016.b3d7c510a7bbe6e2c0acb162f9ff68c7. in 158ms, sequenceid=1457038759, compaction requested=true
  2197. 2014-07-10 14:55:18,174 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HRegion: Starting compaction on detail in region article,3841557549dce31b0c552c81f0b4ad04,1395916557016.b3d7c510a7bbe6e2c0acb162f9ff68c7.
  2198. 2014-07-10 14:55:18,175 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HStore: Starting compaction of 3 file(s) in detail of article,3841557549dce31b0c552c81f0b4ad04,1395916557016.b3d7c510a7bbe6e2c0acb162f9ff68c7. into tmpdir=hdfs://master:9000/hbase/data/default/article/b3d7c510a7bbe6e2c0acb162f9ff68c7/.tmp, totalSize=108.8 M
  2199. 2014-07-10 14:55:21,209 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region article,303b80a67cbf4b522043c1c9b8bc061f,1395916557016.9dedc8916c06fdaf2e3406106daa6d72. after a delay of 10239
  2200. 2014-07-10 14:55:21,447 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.StoreFile$Reader: Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dd7b118c391b4e68a6a31ef14c0b691e
  2201. 2014-07-10 14:55:21,455 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.StoreFile$Reader: Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dd7b118c391b4e68a6a31ef14c0b691e
  2202. 2014-07-10 14:55:21,484 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HStore: Completed compaction of 3 file(s) in detail of article,3841557549dce31b0c552c81f0b4ad04,1395916557016.b3d7c510a7bbe6e2c0acb162f9ff68c7. into dd7b118c391b4e68a6a31ef14c0b691e(size=108.7 M), total size for store is 4.9 G. This selection was in queue for 0sec, and took 3sec to execute.
  2203. 2014-07-10 14:55:21,484 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.CompactSplitThread: Completed compaction: Request = regionName=article,3841557549dce31b0c552c81f0b4ad04,1395916557016.b3d7c510a7bbe6e2c0acb162f9ff68c7., storeName=detail, fileCount=3, fileSize=108.8 M, priority=6, time=47232790820690538; duration=3sec
  2204. 2014-07-10 14:55:31,209 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region article,303b80a67cbf4b522043c1c9b8bc061f,1395916557016.9dedc8916c06fdaf2e3406106daa6d72. after a delay of 4605
  2205. 2014-07-10 14:55:31,501 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1457039043, memsize=2.6 M, hasBloomFilter=true, into tmp file hdfs://master:9000/hbase/data/default/article/9dedc8916c06fdaf2e3406106daa6d72/.tmp/29881c87979a401d868caa5eb3580ccd
  2206. 2014-07-10 14:55:31,603 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1457039043, memsize=6.7 M, hasBloomFilter=true, into tmp file hdfs://master:9000/hbase/data/default/article/9dedc8916c06fdaf2e3406106daa6d72/.tmp/fe96a073631449cc88b82cdeadd63ad9
  2207. 2014-07-10 14:55:31,617 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://master:9000/hbase/data/default/article/9dedc8916c06fdaf2e3406106daa6d72/detail/29881c87979a401d868caa5eb3580ccd, entries=2194, sequenceid=1457039043, filesize=1.4 M
  2208. 2014-07-10 14:55:31,802 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://master:9000/hbase/data/default/article/9dedc8916c06fdaf2e3406106daa6d72/list/fe96a073631449cc88b82cdeadd63ad9, entries=32411, sequenceid=1457039043, filesize=1.1 M
  2209. 2014-07-10 14:55:31,802 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~10.3 M/10763624, currentsize=0/0 for region article,303b80a67cbf4b522043c1c9b8bc061f,1395916557016.9dedc8916c06fdaf2e3406106daa6d72. in 354ms, sequenceid=1457039043, compaction requested=true
  2210. 2014-07-10 14:55:31,802 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HRegion: Starting compaction on detail in region article,303b80a67cbf4b522043c1c9b8bc061f,1395916557016.9dedc8916c06fdaf2e3406106daa6d72.
  2211. 2014-07-10 14:55:31,802 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HStore: Starting compaction of 3 file(s) in detail of article,303b80a67cbf4b522043c1c9b8bc061f,1395916557016.9dedc8916c06fdaf2e3406106daa6d72. into tmpdir=hdfs://master:9000/hbase/data/default/article/9dedc8916c06fdaf2e3406106daa6d72/.tmp, totalSize=106.7 M
  2212. 2014-07-10 14:55:35,297 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.StoreFile$Reader: Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 13ec7f7abec84657945550cca54f4aaf
  2213. 2014-07-10 14:55:35,303 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.StoreFile$Reader: Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 13ec7f7abec84657945550cca54f4aaf
  2214. 2014-07-10 14:55:35,330 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HStore: Completed compaction of 3 file(s) in detail of article,303b80a67cbf4b522043c1c9b8bc061f,1395916557016.9dedc8916c06fdaf2e3406106daa6d72. into 13ec7f7abec84657945550cca54f4aaf(size=106.7 M), total size for store is 4.9 G. This selection was in queue for 0sec, and took 3sec to execute.
  2215. 2014-07-10 14:55:35,330 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.CompactSplitThread: Completed compaction: Request = regionName=article,303b80a67cbf4b522043c1c9b8bc061f,1395916557016.9dedc8916c06fdaf2e3406106daa6d72., storeName=detail, fileCount=3, fileSize=106.7 M, priority=6, time=47232804448439173; duration=3sec
  2216. 2014-07-10 14:55:35,330 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HRegion: Starting compaction on list in region article,303b80a67cbf4b522043c1c9b8bc061f,1395916557016.9dedc8916c06fdaf2e3406106daa6d72.
  2217. 2014-07-10 14:55:35,330 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HStore: Starting compaction of 3 file(s) in list of article,303b80a67cbf4b522043c1c9b8bc061f,1395916557016.9dedc8916c06fdaf2e3406106daa6d72. into tmpdir=hdfs://master:9000/hbase/data/default/article/9dedc8916c06fdaf2e3406106daa6d72/.tmp, totalSize=85.7 M
  2218. 2014-07-10 14:55:39,952 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.StoreFile$Reader: Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3e05576b4d1941079839f13085d8ae75
  2219. 2014-07-10 14:55:39,960 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.StoreFile$Reader: Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3e05576b4d1941079839f13085d8ae75
  2220. 2014-07-10 14:55:39,990 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HStore: Completed compaction of 3 file(s) in list of article,303b80a67cbf4b522043c1c9b8bc061f,1395916557016.9dedc8916c06fdaf2e3406106daa6d72. into 3e05576b4d1941079839f13085d8ae75(size=84.8 M), total size for store is 2.4 G. This selection was in queue for 0sec, and took 4sec to execute.
  2221. 2014-07-10 14:55:39,990 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.CompactSplitThread: Completed compaction: Request = regionName=article,303b80a67cbf4b522043c1c9b8bc061f,1395916557016.9dedc8916c06fdaf2e3406106daa6d72., storeName=list, fileCount=3, fileSize=85.7 M, priority=6, time=47232807976380731; duration=4sec
  2222. 2014-07-10 14:56:01,210 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region article,684401e8f32d9e37972147a5a70e0de0,1397098375738.21f50e59624cda1b9cb00645f23a5c76. after a delay of 19287
  2223. 2014-07-10 14:56:11,210 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region article,684401e8f32d9e37972147a5a70e0de0,1397098375738.21f50e59624cda1b9cb00645f23a5c76. after a delay of 10573
  2224. 2014-07-10 14:56:20,525 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1457040268, memsize=1.4 M, hasBloomFilter=true, into tmp file hdfs://master:9000/hbase/data/default/article/21f50e59624cda1b9cb00645f23a5c76/.tmp/936b11800f71406e82273022ac390647
  2225. 2014-07-10 14:56:20,581 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1457040268, memsize=3.2 M, hasBloomFilter=true, into tmp file hdfs://master:9000/hbase/data/default/article/21f50e59624cda1b9cb00645f23a5c76/.tmp/8146003d2e834f4fae1c092d8941ff50
  2226. 2014-07-10 14:56:20,593 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://master:9000/hbase/data/default/article/21f50e59624cda1b9cb00645f23a5c76/detail/936b11800f71406e82273022ac390647, entries=1018, sequenceid=1457040268, filesize=779.4 K
  2227. 2014-07-10 14:56:20,602 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://master:9000/hbase/data/default/article/21f50e59624cda1b9cb00645f23a5c76/list/8146003d2e834f4fae1c092d8941ff50, entries=15519, sequenceid=1457040268, filesize=523.0 K
  2228. 2014-07-10 14:56:20,602 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~5.0 M/5223016, currentsize=208/208 for region article,684401e8f32d9e37972147a5a70e0de0,1397098375738.21f50e59624cda1b9cb00645f23a5c76. in 105ms, sequenceid=1457040268, compaction requested=true
  2229. 2014-07-10 14:58:31,211 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region visited_article,40484e9bddd7954f44c35bdf134e4dee\x00\x1D\x17\xE6,1389119155036.c6fdec019ff1dba3f2137ff724a191cb. after a delay of 14892
  2230. 2014-07-10 14:58:41,211 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region visited_article,40484e9bddd7954f44c35bdf134e4dee\x00\x1D\x17\xE6,1389119155036.c6fdec019ff1dba3f2137ff724a191cb. after a delay of 7076
  2231. 2014-07-10 14:58:46,140 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1457044469, memsize=1.8 M, hasBloomFilter=true, into tmp file hdfs://master:9000/hbase/data/default/visited_article/c6fdec019ff1dba3f2137ff724a191cb/.tmp/695e3b7487194a86a8d30b95a97df27c
  2232. 2014-07-10 14:58:46,165 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://master:9000/hbase/data/default/visited_article/c6fdec019ff1dba3f2137ff724a191cb/cf1/695e3b7487194a86a8d30b95a97df27c, entries=8715, sequenceid=1457044469, filesize=285.8 K
  2233. 2014-07-10 14:58:46,165 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~1.8 M/1917744, currentsize=0/0 for region visited_article,40484e9bddd7954f44c35bdf134e4dee\x00\x1D\x17\xE6,1389119155036.c6fdec019ff1dba3f2137ff724a191cb. in 60ms, sequenceid=1457044469, compaction requested=true
  2234. 2014-07-10 14:59:21,211 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region url_guid,a017c0ff6d49bef5fbdb34806fa09ee1,1386682300480.1af7ec7e41ac505904377d5ea9971c07. after a delay of 10247
  2235. 2014-07-10 14:59:31,211 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region url_guid,a017c0ff6d49bef5fbdb34806fa09ee1,1386682300480.1af7ec7e41ac505904377d5ea9971c07. after a delay of 4161
  2236. 2014-07-10 14:59:31,506 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1457046250, memsize=1.4 M, hasBloomFilter=true, into tmp file hdfs://master:9000/hbase/data/default/url_guid/1af7ec7e41ac505904377d5ea9971c07/.tmp/2fcdde1c390946029a1686bcb6c344fd
  2237. 2014-07-10 14:59:31,544 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://master:9000/hbase/data/default/url_guid/1af7ec7e41ac505904377d5ea9971c07/cf1/2fcdde1c390946029a1686bcb6c344fd, entries=6670, sequenceid=1457046250, filesize=282.2 K
  2238. 2014-07-10 14:59:31,544 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~1.4 M/1496928, currentsize=0/0 for region url_guid,a017c0ff6d49bef5fbdb34806fa09ee1,1386682300480.1af7ec7e41ac505904377d5ea9971c07. in 85ms, sequenceid=1457046250, compaction requested=true
  2239. 2014-07-10 14:59:31,545 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HRegion: Starting compaction on cf1 in region url_guid,a017c0ff6d49bef5fbdb34806fa09ee1,1386682300480.1af7ec7e41ac505904377d5ea9971c07.
  2240. 2014-07-10 14:59:31,545 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HStore: Starting compaction of 3 file(s) in cf1 of url_guid,a017c0ff6d49bef5fbdb34806fa09ee1,1386682300480.1af7ec7e41ac505904377d5ea9971c07. into tmpdir=hdfs://master:9000/hbase/data/default/url_guid/1af7ec7e41ac505904377d5ea9971c07/.tmp, totalSize=27.3 M
  2241. 2014-07-10 14:59:33,031 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HStore: Completed compaction of 3 file(s) in cf1 of url_guid,a017c0ff6d49bef5fbdb34806fa09ee1,1386682300480.1af7ec7e41ac505904377d5ea9971c07. into fa5fc00df27b4d92885916061d6e1bb1(size=27.3 M), total size for store is 2.3 G. This selection was in queue for 0sec, and took 1sec to execute.
  2242. 2014-07-10 14:59:33,031 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.CompactSplitThread: Completed compaction: Request = regionName=url_guid,a017c0ff6d49bef5fbdb34806fa09ee1,1386682300480.1af7ec7e41ac505904377d5ea9971c07., storeName=cf1, fileCount=3, fileSize=27.3 M, priority=6, time=47233044190876405; duration=1sec
  2243. 2014-07-10 15:00:21,211 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region visited_article,204644f25ca678a2fe64b28ade4f1b0c\x00\x0A\x1C\xDE,1388226171288.e5472d54066f93e8591fa51fe4f27541. after a delay of 17356
  2244. 2014-07-10 15:00:31,211 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region visited_article,204644f25ca678a2fe64b28ade4f1b0c\x00\x0A\x1C\xDE,1388226171288.e5472d54066f93e8591fa51fe4f27541. after a delay of 10501
  2245. 2014-07-10 15:00:38,597 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1457048992, memsize=1.8 M, hasBloomFilter=true, into tmp file hdfs://master:9000/hbase/data/default/visited_article/e5472d54066f93e8591fa51fe4f27541/.tmp/aa1095700a53401c90141f5a613e855d
  2246. 2014-07-10 15:00:38,608 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://master:9000/hbase/data/default/visited_article/e5472d54066f93e8591fa51fe4f27541/cf1/aa1095700a53401c90141f5a613e855d, entries=8618, sequenceid=1457048992, filesize=285.7 K
  2247. 2014-07-10 15:00:38,608 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~1.8 M/1903304, currentsize=0/0 for region visited_article,204644f25ca678a2fe64b28ade4f1b0c\x00\x0A\x1C\xDE,1388226171288.e5472d54066f93e8591fa51fe4f27541. in 40ms, sequenceid=1457048992, compaction requested=true
  2248. 2014-07-10 15:00:52,728 WARN [RpcServer.handler=6,port=60020] ipc.RpcServer: RpcServer.respondercallId: 126802 service: ClientService methodName: Get size: 161 connection: 64.78.164.242:38933: output error
  2249. 2014-07-10 15:00:52,729 WARN [RpcServer.handler=6,port=60020] ipc.RpcServer: RpcServer.handler=6,port=60020: caught a ClosedChannelException, this means that the server was processing a request but the client went away. The error message was: null
  2250. 2014-07-10 15:00:54,914 WARN [RpcServer.handler=22,port=60020] ipc.RpcServer: RpcServer.respondercallId: 72451 service: ClientService methodName: Get size: 134 connection: 64.78.164.242:38936: output error
  2251. 2014-07-10 15:00:54,915 WARN [RpcServer.handler=22,port=60020] ipc.RpcServer: RpcServer.handler=22,port=60020: caught a ClosedChannelException, this means that the server was processing a request but the client went away. The error message was: null
  2252. 2014-07-10 15:05:53,777 INFO [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/WALs/slave2,60020,1397552649456/slave2%2C60020%2C1397552649456.1404972353650 with entries=115617, filesize=51.3 M; new WAL /hbase/WALs/slave2,60020,1397552649456/slave2%2C60020%2C1397552649456.1404975953759
  2253. 2014-07-10 15:05:53,778 INFO [regionserver60020.logRoller] wal.FSHLog: moving old hlog file /hbase/WALs/slave2,60020,1397552649456/slave2%2C60020%2C1397552649456.1404968753563 whose highest sequenceid is 1456943895 to /hbase/oldWALs/slave2%2C60020%2C1397552649456.1404968753563
  2254. 2014-07-10 15:06:02,255 WARN [RpcServer.reader=7,port=60020] ipc.RpcServer: RpcServer.listener,port=60020: count of bytes read: 0
  2255. java.io.IOException: Connection reset by peer
  2256. at sun.nio.ch.FileDispatcher.read0(Native Method)
  2257. at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
  2258. at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:251)
  2259. at sun.nio.ch.IOUtil.read(IOUtil.java:224)
  2260. at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:254)
  2261. at org.apache.hadoop.hbase.ipc.RpcServer.channelRead(RpcServer.java:2404)
  2262. at org.apache.hadoop.hbase.ipc.RpcServer$Connection.readAndProcess(RpcServer.java:1425)
  2263. at org.apache.hadoop.hbase.ipc.RpcServer$Listener.doRead(RpcServer.java:780)
  2264. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:568)
  2265. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:543)
  2266. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
  2267. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  2268. at java.lang.Thread.run(Thread.java:701)
  2269. 2014-07-10 15:20:51,243 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region visited_article,600fcc228b36625c1904ba4f11e6207a\x00\x17o\xD8,1395813592646.b3a19a2f85e170275c4f141a18a08abf. after a delay of 14348
  2270. 2014-07-10 15:21:01,242 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region visited_article,600fcc228b36625c1904ba4f11e6207a\x00\x17o\xD8,1395813592646.b3a19a2f85e170275c4f141a18a08abf. after a delay of 14018
  2271. 2014-07-10 15:21:05,618 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1457092548, memsize=960.9 K, hasBloomFilter=true, into tmp file hdfs://master:9000/hbase/data/default/visited_article/b3a19a2f85e170275c4f141a18a08abf/.tmp/d51155ab6ccc483f86b8b3122d021692
  2272. 2014-07-10 15:21:05,637 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://master:9000/hbase/data/default/visited_article/b3a19a2f85e170275c4f141a18a08abf/cf1/d51155ab6ccc483f86b8b3122d021692, entries=4550, sequenceid=1457092548, filesize=151.1 K
  2273. 2014-07-10 15:21:05,637 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~980.1 K/1003672, currentsize=0/0 for region visited_article,600fcc228b36625c1904ba4f11e6207a\x00\x17o\xD8,1395813592646.b3a19a2f85e170275c4f141a18a08abf. in 46ms, sequenceid=1457092548, compaction requested=true
  2274. 2014-07-10 15:32:31,253 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region url_guid,60208b,1387273200413.c73728f0c060569c44ade8188c6ea84f. after a delay of 16240
  2275. 2014-07-10 15:32:31,253 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region visited_article,,1390820890834.f7635647bcae9291971843131c4add0b. after a delay of 3757
  2276. 2014-07-10 15:32:35,035 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1457119385, memsize=1.1 M, hasBloomFilter=true, into tmp file hdfs://master:9000/hbase/data/default/visited_article/f7635647bcae9291971843131c4add0b/.tmp/4ba07b292e334613ab8f8a55fe58ea8f
  2277. 2014-07-10 15:32:35,048 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://master:9000/hbase/data/default/visited_article/f7635647bcae9291971843131c4add0b/cf1/4ba07b292e334613ab8f8a55fe58ea8f, entries=5433, sequenceid=1457119385, filesize=166.9 K
  2278. 2014-07-10 15:32:35,048 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~1.1 M/1188280, currentsize=0/0 for region visited_article,,1390820890834.f7635647bcae9291971843131c4add0b. in 38ms, sequenceid=1457119385, compaction requested=true
  2279. 2014-07-10 15:32:41,253 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region url_guid,60208b,1387273200413.c73728f0c060569c44ade8188c6ea84f. after a delay of 19731
  2280. 2014-07-10 15:32:47,519 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1457119983, memsize=757.1 K, hasBloomFilter=true, into tmp file hdfs://master:9000/hbase/data/default/url_guid/c73728f0c060569c44ade8188c6ea84f/.tmp/5f50cae3bcb0439fb4603fa0ce351489
  2281. 2014-07-10 15:32:47,534 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://master:9000/hbase/data/default/url_guid/c73728f0c060569c44ade8188c6ea84f/cf1/5f50cae3bcb0439fb4603fa0ce351489, entries=3490, sequenceid=1457119983, filesize=150.3 K
  2282. 2014-07-10 15:32:47,534 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~765.8 K/784216, currentsize=0/0 for region url_guid,60208b,1387273200413.c73728f0c060569c44ade8188c6ea84f. in 41ms, sequenceid=1457119983, compaction requested=true
  2283. 2014-07-10 15:32:47,534 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HRegion: Starting compaction on cf1 in region url_guid,60208b,1387273200413.c73728f0c060569c44ade8188c6ea84f.
  2284. 2014-07-10 15:32:47,535 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HStore: Starting compaction of 3 file(s) in cf1 of url_guid,60208b,1387273200413.c73728f0c060569c44ade8188c6ea84f. into tmpdir=hdfs://master:9000/hbase/data/default/url_guid/c73728f0c060569c44ade8188c6ea84f/.tmp, totalSize=36.4 M
  2285. 2014-07-10 15:32:49,371 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HStore: Completed compaction of 3 file(s) in cf1 of url_guid,60208b,1387273200413.c73728f0c060569c44ade8188c6ea84f. into eab6662a2488456a8067be4041b459e3(size=36.4 M), total size for store is 1.1 G. This selection was in queue for 0sec, and took 1sec to execute.
  2286. 2014-07-10 15:32:49,371 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.CompactSplitThread: Completed compaction: Request = regionName=url_guid,60208b,1387273200413.c73728f0c060569c44ade8188c6ea84f., storeName=cf1, fileCount=3, fileSize=36.4 M, priority=6, time=47235040180666727; duration=1sec
  2287. 2014-07-10 15:42:04,976 WARN [RpcServer.reader=8,port=60020] ipc.RpcServer: RpcServer.listener,port=60020: count of bytes read: 0
  2288. java.io.IOException: Connection reset by peer
  2289. at sun.nio.ch.FileDispatcher.read0(Native Method)
  2290. at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
  2291. at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:251)
  2292. at sun.nio.ch.IOUtil.read(IOUtil.java:224)
  2293. at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:254)
  2294. at org.apache.hadoop.hbase.ipc.RpcServer.channelRead(RpcServer.java:2404)
  2295. at org.apache.hadoop.hbase.ipc.RpcServer$Connection.readAndProcess(RpcServer.java:1425)
  2296. at org.apache.hadoop.hbase.ipc.RpcServer$Listener.doRead(RpcServer.java:780)
  2297. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:568)
  2298. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:543)
  2299. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
  2300. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  2301. at java.lang.Thread.run(Thread.java:701)
  2302. 2014-07-10 15:47:51,269 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region url_guid,781e82be88ce94de7bb2dee9f3436e97,1392692827380.ded050ffeacd83613a0e3db7baaee4f0. after a delay of 18236
  2303. 2014-07-10 15:48:01,269 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region url_guid,781e82be88ce94de7bb2dee9f3436e97,1392692827380.ded050ffeacd83613a0e3db7baaee4f0. after a delay of 11890
  2304. 2014-07-10 15:48:09,531 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1457155785, memsize=402.3 K, hasBloomFilter=true, into tmp file hdfs://master:9000/hbase/data/default/url_guid/ded050ffeacd83613a0e3db7baaee4f0/.tmp/8a7cd3e192ce4e18aa6d21e50aa498b9
  2305. 2014-07-10 15:48:09,549 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://master:9000/hbase/data/default/url_guid/ded050ffeacd83613a0e3db7baaee4f0/cf1/8a7cd3e192ce4e18aa6d21e50aa498b9, entries=1866, sequenceid=1457155785, filesize=80.0 K
  2306. 2014-07-10 15:48:09,550 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~405.5 K/415280, currentsize=0/0 for region url_guid,781e82be88ce94de7bb2dee9f3436e97,1392692827380.ded050ffeacd83613a0e3db7baaee4f0. in 44ms, sequenceid=1457155785, compaction requested=true
  2307. 2014-07-10 15:51:34,707 WARN [RpcServer.reader=1,port=60020] ipc.RpcServer: RpcServer.listener,port=60020: count of bytes read: 0
  2308. java.io.IOException: Connection reset by peer
  2309. at sun.nio.ch.FileDispatcher.read0(Native Method)
  2310. at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
  2311. at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:251)
  2312. at sun.nio.ch.IOUtil.read(IOUtil.java:224)
  2313. at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:254)
  2314. at org.apache.hadoop.hbase.ipc.RpcServer.channelRead(RpcServer.java:2404)
  2315. at org.apache.hadoop.hbase.ipc.RpcServer$Connection.readAndProcess(RpcServer.java:1425)
  2316. at org.apache.hadoop.hbase.ipc.RpcServer$Listener.doRead(RpcServer.java:780)
  2317. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:568)
  2318. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:543)
  2319. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
  2320. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  2321. at java.lang.Thread.run(Thread.java:701)
  2322. 2014-07-10 15:51:41,279 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region article,804d25f09ba3603572620c7c42869e60,1388454093837.96d761959641d2ccc69c224c06b52671. after a delay of 14737
  2323. 2014-07-10 15:51:51,279 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region article,804d25f09ba3603572620c7c42869e60,1388454093837.96d761959641d2ccc69c224c06b52671. after a delay of 9302
  2324. 2014-07-10 15:51:56,503 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1457165032, memsize=5.5 M, hasBloomFilter=true, into tmp file hdfs://master:9000/hbase/data/default/article/96d761959641d2ccc69c224c06b52671/.tmp/182769ef00154654b0780f0404adb5dd
  2325. 2014-07-10 15:51:56,516 INFO [MemStoreFlusher.0] regionserver.StoreFile$Reader: Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 182769ef00154654b0780f0404adb5dd
  2326. 2014-07-10 15:51:56,662 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1457165032, memsize=16.4 M, hasBloomFilter=true, into tmp file hdfs://master:9000/hbase/data/default/article/96d761959641d2ccc69c224c06b52671/.tmp/159247950370406ea25ed8afe14014f7
  2327. 2014-07-10 15:51:56,690 INFO [MemStoreFlusher.0] regionserver.StoreFile$Reader: Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 159247950370406ea25ed8afe14014f7
  2328. 2014-07-10 15:51:56,696 INFO [MemStoreFlusher.0] regionserver.StoreFile$Reader: Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 182769ef00154654b0780f0404adb5dd
  2329. 2014-07-10 15:51:56,697 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://master:9000/hbase/data/default/article/96d761959641d2ccc69c224c06b52671/detail/182769ef00154654b0780f0404adb5dd, entries=5453, sequenceid=1457165032, filesize=3.0 M
  2330. 2014-07-10 15:51:56,704 INFO [MemStoreFlusher.0] regionserver.StoreFile$Reader: Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 159247950370406ea25ed8afe14014f7
  2331. 2014-07-10 15:51:56,704 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://master:9000/hbase/data/default/article/96d761959641d2ccc69c224c06b52671/list/159247950370406ea25ed8afe14014f7, entries=79594, sequenceid=1457165032, filesize=2.5 M
  2332. 2014-07-10 15:51:56,704 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~24.0 M/25116824, currentsize=2.2 K/2248 for region article,804d25f09ba3603572620c7c42869e60,1388454093837.96d761959641d2ccc69c224c06b52671. in 686ms, sequenceid=1457165032, compaction requested=true
  2333. 2014-07-10 15:51:56,704 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HRegion: Starting compaction on detail in region article,804d25f09ba3603572620c7c42869e60,1388454093837.96d761959641d2ccc69c224c06b52671.
  2334. 2014-07-10 15:51:56,705 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HStore: Starting compaction of 3 file(s) in detail of article,804d25f09ba3603572620c7c42869e60,1388454093837.96d761959641d2ccc69c224c06b52671. into tmpdir=hdfs://master:9000/hbase/data/default/article/96d761959641d2ccc69c224c06b52671/.tmp, totalSize=106.9 M
  2335. 2014-07-10 15:51:59,859 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.StoreFile$Reader: Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 80d487f5655647dc9e2d0ef776044968
  2336. 2014-07-10 15:51:59,865 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.StoreFile$Reader: Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 80d487f5655647dc9e2d0ef776044968
  2337. 2014-07-10 15:51:59,900 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HStore: Completed compaction of 3 file(s) in detail of article,804d25f09ba3603572620c7c42869e60,1388454093837.96d761959641d2ccc69c224c06b52671. into 80d487f5655647dc9e2d0ef776044968(size=106.9 M), total size for store is 9.8 G. This selection was in queue for 0sec, and took 3sec to execute.
  2338. 2014-07-10 15:51:59,900 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.CompactSplitThread: Completed compaction: Request = regionName=article,804d25f09ba3603572620c7c42869e60,1388454093837.96d761959641d2ccc69c224c06b52671., storeName=detail, fileCount=3, fileSize=106.9 M, priority=5, time=47236189350542636; duration=3sec
  2339. 2014-07-10 15:53:31,280 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region article,,1392692828476.f6b3920b4bb1f63832b3a0529c639e6f. after a delay of 7346
  2340. 2014-07-10 15:53:38,718 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1457169121, memsize=2.7 M, hasBloomFilter=true, into tmp file hdfs://master:9000/hbase/data/default/article/f6b3920b4bb1f63832b3a0529c639e6f/.tmp/ba363d6dc36c4ddeb7fc922290de10ab
  2341. 2014-07-10 15:53:38,728 INFO [MemStoreFlusher.0] regionserver.StoreFile$Reader: Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ba363d6dc36c4ddeb7fc922290de10ab
  2342. 2014-07-10 15:53:38,826 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1457169121, memsize=8.3 M, hasBloomFilter=true, into tmp file hdfs://master:9000/hbase/data/default/article/f6b3920b4bb1f63832b3a0529c639e6f/.tmp/7e9c2a389ce04e6684cfbae82817b392
  2343. 2014-07-10 15:53:38,832 INFO [MemStoreFlusher.0] regionserver.StoreFile$Reader: Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7e9c2a389ce04e6684cfbae82817b392
  2344. 2014-07-10 15:53:38,841 INFO [MemStoreFlusher.0] regionserver.StoreFile$Reader: Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ba363d6dc36c4ddeb7fc922290de10ab
  2345. 2014-07-10 15:53:38,841 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://master:9000/hbase/data/default/article/f6b3920b4bb1f63832b3a0529c639e6f/detail/ba363d6dc36c4ddeb7fc922290de10ab, entries=2722, sequenceid=1457169121, filesize=1.5 M
  2346. 2014-07-10 15:53:38,849 INFO [MemStoreFlusher.0] regionserver.StoreFile$Reader: Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7e9c2a389ce04e6684cfbae82817b392
  2347. 2014-07-10 15:53:38,849 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://master:9000/hbase/data/default/article/f6b3920b4bb1f63832b3a0529c639e6f/list/7e9c2a389ce04e6684cfbae82817b392, entries=40422, sequenceid=1457169121, filesize=1.3 M
  2348. 2014-07-10 15:53:38,849 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~12.2 M/12811664, currentsize=624/624 for region article,,1392692828476.f6b3920b4bb1f63832b3a0529c639e6f. in 223ms, sequenceid=1457169121, compaction requested=true
  2349. 2014-07-10 15:54:41,281 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region url_guid,e00998f7542fadc8e0b9c1f260780d16,1386609914459.b4275622def9b40e84be8b79ff61dfef. after a delay of 21215
  2350. 2014-07-10 15:54:51,281 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region url_guid,e00998f7542fadc8e0b9c1f260780d16,1386609914459.b4275622def9b40e84be8b79ff61dfef. after a delay of 7800
  2351. 2014-07-10 15:55:01,281 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region url_guid,e00998f7542fadc8e0b9c1f260780d16,1386609914459.b4275622def9b40e84be8b79ff61dfef. after a delay of 6192
  2352. 2014-07-10 15:55:02,556 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1457172299, memsize=1.7 M, hasBloomFilter=true, into tmp file hdfs://master:9000/hbase/data/default/url_guid/b4275622def9b40e84be8b79ff61dfef/.tmp/8bb9afeb81b04a23943a7e5b7d6d6cfa
  2353. 2014-07-10 15:55:02,570 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://master:9000/hbase/data/default/url_guid/b4275622def9b40e84be8b79ff61dfef/cf1/8bb9afeb81b04a23943a7e5b7d6d6cfa, entries=7902, sequenceid=1457172299, filesize=334.2 K
  2354. 2014-07-10 15:55:02,570 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~1.7 M/1756528, currentsize=0/0 for region url_guid,e00998f7542fadc8e0b9c1f260780d16,1386609914459.b4275622def9b40e84be8b79ff61dfef. in 74ms, sequenceid=1457172299, compaction requested=true
  2355. 2014-07-10 15:55:02,570 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HRegion: Starting compaction on cf1 in region url_guid,e00998f7542fadc8e0b9c1f260780d16,1386609914459.b4275622def9b40e84be8b79ff61dfef.
  2356. 2014-07-10 15:55:02,570 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HStore: Starting compaction of 3 file(s) in cf1 of url_guid,e00998f7542fadc8e0b9c1f260780d16,1386609914459.b4275622def9b40e84be8b79ff61dfef. into tmpdir=hdfs://master:9000/hbase/data/default/url_guid/b4275622def9b40e84be8b79ff61dfef/.tmp, totalSize=16.0 M
  2357. 2014-07-10 15:55:03,309 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HStore: Completed compaction of 3 file(s) in cf1 of url_guid,e00998f7542fadc8e0b9c1f260780d16,1386609914459.b4275622def9b40e84be8b79ff61dfef. into 566a5db923774655be2a597fca5e5ed9(size=16.0 M), total size for store is 2.3 G. This selection was in queue for 0sec, and took 0sec to execute.
  2358. 2014-07-10 15:55:03,309 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.CompactSplitThread: Completed compaction: Request = regionName=url_guid,e00998f7542fadc8e0b9c1f260780d16,1386609914459.b4275622def9b40e84be8b79ff61dfef., storeName=cf1, fileCount=3, fileSize=16.0 M, priority=6, time=47236375216512376; duration=0sec
  2359. 2014-07-10 15:55:21,282 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region article,dffe0300a6722922f2c4c93b352c3c54,1394100183332.55f82857c8408b1af3d671dacfce0b9b. after a delay of 19539
  2360. 2014-07-10 15:55:21,282 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region article,3841557549dce31b0c552c81f0b4ad04,1395916557016.b3d7c510a7bbe6e2c0acb162f9ff68c7. after a delay of 5632
  2361. 2014-07-10 15:55:27,369 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1457173222, memsize=2.6 M, hasBloomFilter=true, into tmp file hdfs://master:9000/hbase/data/default/article/b3d7c510a7bbe6e2c0acb162f9ff68c7/.tmp/8e6fd6f951db41389d93d41bfb0883d6
  2362. 2014-07-10 15:55:27,375 INFO [MemStoreFlusher.0] regionserver.StoreFile$Reader: Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8e6fd6f951db41389d93d41bfb0883d6
  2363. 2014-07-10 15:55:27,482 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1457173222, memsize=8.3 M, hasBloomFilter=true, into tmp file hdfs://master:9000/hbase/data/default/article/b3d7c510a7bbe6e2c0acb162f9ff68c7/.tmp/a3f3759828574900a9f71851696abdf6
  2364. 2014-07-10 15:55:27,490 INFO [MemStoreFlusher.0] regionserver.StoreFile$Reader: Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a3f3759828574900a9f71851696abdf6
  2365. 2014-07-10 15:55:27,497 INFO [MemStoreFlusher.0] regionserver.StoreFile$Reader: Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8e6fd6f951db41389d93d41bfb0883d6
  2366. 2014-07-10 15:55:27,497 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://master:9000/hbase/data/default/article/b3d7c510a7bbe6e2c0acb162f9ff68c7/detail/8e6fd6f951db41389d93d41bfb0883d6, entries=2701, sequenceid=1457173222, filesize=1.5 M
  2367. 2014-07-10 15:55:27,503 INFO [MemStoreFlusher.0] regionserver.StoreFile$Reader: Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a3f3759828574900a9f71851696abdf6
  2368. 2014-07-10 15:55:27,503 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://master:9000/hbase/data/default/article/b3d7c510a7bbe6e2c0acb162f9ff68c7/list/a3f3759828574900a9f71851696abdf6, entries=40275, sequenceid=1457173222, filesize=1.3 M
  2369. 2014-07-10 15:55:27,503 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~12.0 M/12566568, currentsize=208/208 for region article,3841557549dce31b0c552c81f0b4ad04,1395916557016.b3d7c510a7bbe6e2c0acb162f9ff68c7. in 589ms, sequenceid=1457173222, compaction requested=true
  2370. 2014-07-10 15:55:27,504 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HRegion: Starting compaction on list in region article,3841557549dce31b0c552c81f0b4ad04,1395916557016.b3d7c510a7bbe6e2c0acb162f9ff68c7.
  2371. 2014-07-10 15:55:27,504 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HStore: Starting compaction of 3 file(s) in list of article,3841557549dce31b0c552c81f0b4ad04,1395916557016.b3d7c510a7bbe6e2c0acb162f9ff68c7. into tmpdir=hdfs://master:9000/hbase/data/default/article/b3d7c510a7bbe6e2c0acb162f9ff68c7/.tmp, totalSize=60.2 M
  2372. 2014-07-10 15:55:30,884 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.StoreFile$Reader: Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d2ad08a15f2141d09c26c1dcadf24ba6
  2373. 2014-07-10 15:55:30,890 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.StoreFile$Reader: Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d2ad08a15f2141d09c26c1dcadf24ba6
  2374. 2014-07-10 15:55:30,918 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HStore: Completed compaction of 3 file(s) in list of article,3841557549dce31b0c552c81f0b4ad04,1395916557016.b3d7c510a7bbe6e2c0acb162f9ff68c7. into d2ad08a15f2141d09c26c1dcadf24ba6(size=59.3 M), total size for store is 2.4 G. This selection was in queue for 0sec, and took 3sec to execute.
  2375. 2014-07-10 15:55:30,918 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.CompactSplitThread: Completed compaction: Request = regionName=article,3841557549dce31b0c552c81f0b4ad04,1395916557016.b3d7c510a7bbe6e2c0acb162f9ff68c7., storeName=list, fileCount=3, fileSize=60.2 M, priority=6, time=47236400149832129; duration=3sec
  2376. 2014-07-10 15:55:31,281 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region article,dffe0300a6722922f2c4c93b352c3c54,1394100183332.55f82857c8408b1af3d671dacfce0b9b. after a delay of 14645
  2377. 2014-07-10 15:55:40,894 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1457173764, memsize=5.2 M, hasBloomFilter=true, into tmp file hdfs://master:9000/hbase/data/default/article/55f82857c8408b1af3d671dacfce0b9b/.tmp/656f372f76ff4e6aaff6e5b0db2a4c71
  2378. 2014-07-10 15:55:40,899 INFO [MemStoreFlusher.0] regionserver.StoreFile$Reader: Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 656f372f76ff4e6aaff6e5b0db2a4c71
  2379. 2014-07-10 15:55:41,052 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1457173764, memsize=16.5 M, hasBloomFilter=true, into tmp file hdfs://master:9000/hbase/data/default/article/55f82857c8408b1af3d671dacfce0b9b/.tmp/e8d3191731d64e9bbd964a9f907cda9a
  2380. 2014-07-10 15:55:41,057 INFO [MemStoreFlusher.0] regionserver.StoreFile$Reader: Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e8d3191731d64e9bbd964a9f907cda9a
  2381. 2014-07-10 15:55:41,092 INFO [MemStoreFlusher.0] regionserver.StoreFile$Reader: Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 656f372f76ff4e6aaff6e5b0db2a4c71
  2382. 2014-07-10 15:55:41,092 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://master:9000/hbase/data/default/article/55f82857c8408b1af3d671dacfce0b9b/detail/656f372f76ff4e6aaff6e5b0db2a4c71, entries=5439, sequenceid=1457173764, filesize=2.8 M
  2383. 2014-07-10 15:55:41,100 INFO [MemStoreFlusher.0] regionserver.StoreFile$Reader: Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e8d3191731d64e9bbd964a9f907cda9a
  2384. 2014-07-10 15:55:41,100 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://master:9000/hbase/data/default/article/55f82857c8408b1af3d671dacfce0b9b/list/e8d3191731d64e9bbd964a9f907cda9a, entries=80127, sequenceid=1457173764, filesize=2.6 M
  2385. 2014-07-10 15:55:41,100 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~23.9 M/25052640, currentsize=616/616 for region article,dffe0300a6722922f2c4c93b352c3c54,1394100183332.55f82857c8408b1af3d671dacfce0b9b. in 278ms, sequenceid=1457173764, compaction requested=true
  2386. 2014-07-10 15:55:41,100 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HRegion: Starting compaction on detail in region article,dffe0300a6722922f2c4c93b352c3c54,1394100183332.55f82857c8408b1af3d671dacfce0b9b.
  2387. 2014-07-10 15:55:41,100 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HStore: Starting compaction of 3 file(s) in detail of article,dffe0300a6722922f2c4c93b352c3c54,1394100183332.55f82857c8408b1af3d671dacfce0b9b. into tmpdir=hdfs://master:9000/hbase/data/default/article/55f82857c8408b1af3d671dacfce0b9b/.tmp, totalSize=44.8 M
  2388. 2014-07-10 15:55:41,281 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region article,303b80a67cbf4b522043c1c9b8bc061f,1395916557016.9dedc8916c06fdaf2e3406106daa6d72. after a delay of 10137
  2389. 2014-07-10 15:55:42,305 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.StoreFile$Reader: Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 82b457446c6b40ce90621dcc021c2825
  2390. 2014-07-10 15:55:42,312 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.StoreFile$Reader: Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 82b457446c6b40ce90621dcc021c2825
  2391. 2014-07-10 15:55:42,354 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HStore: Completed compaction of 3 file(s) in detail of article,dffe0300a6722922f2c4c93b352c3c54,1394100183332.55f82857c8408b1af3d671dacfce0b9b. into 82b457446c6b40ce90621dcc021c2825(size=44.7 M), total size for store is 9.8 G. This selection was in queue for 0sec, and took 1sec to execute.
  2392. 2014-07-10 15:55:42,354 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.CompactSplitThread: Completed compaction: Request = regionName=article,dffe0300a6722922f2c4c93b352c3c54,1394100183332.55f82857c8408b1af3d671dacfce0b9b., storeName=detail, fileCount=3, fileSize=44.8 M, priority=6, time=47236413746632964; duration=1sec
  2393. 2014-07-10 15:55:42,354 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HRegion: Starting compaction on list in region article,dffe0300a6722922f2c4c93b352c3c54,1394100183332.55f82857c8408b1af3d671dacfce0b9b.
  2394. 2014-07-10 15:55:42,354 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HStore: Starting compaction of 3 file(s) in list of article,dffe0300a6722922f2c4c93b352c3c54,1394100183332.55f82857c8408b1af3d671dacfce0b9b. into tmpdir=hdfs://master:9000/hbase/data/default/article/55f82857c8408b1af3d671dacfce0b9b/.tmp, totalSize=106.3 M
  2395. 2014-07-10 15:55:47,954 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.StoreFile$Reader: Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1617cdbfaf5e4e79b1dbfe3ed7f9e3cf
  2396. 2014-07-10 15:55:47,960 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.StoreFile$Reader: Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1617cdbfaf5e4e79b1dbfe3ed7f9e3cf
  2397. 2014-07-10 15:55:47,989 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HStore: Completed compaction of 3 file(s) in list of article,dffe0300a6722922f2c4c93b352c3c54,1394100183332.55f82857c8408b1af3d671dacfce0b9b. into 1617cdbfaf5e4e79b1dbfe3ed7f9e3cf(size=104.4 M), total size for store is 4.8 G. This selection was in queue for 0sec, and took 5sec to execute.
  2398. 2014-07-10 15:55:47,989 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.CompactSplitThread: Completed compaction: Request = regionName=article,dffe0300a6722922f2c4c93b352c3c54,1394100183332.55f82857c8408b1af3d671dacfce0b9b., storeName=list, fileCount=3, fileSize=106.3 M, priority=6, time=47236415000487291; duration=5sec
  2399. 2014-07-10 15:55:51,282 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region article,303b80a67cbf4b522043c1c9b8bc061f,1395916557016.9dedc8916c06fdaf2e3406106daa6d72. after a delay of 20524
  2400. 2014-07-10 15:55:51,473 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1457174217, memsize=2.6 M, hasBloomFilter=true, into tmp file hdfs://master:9000/hbase/data/default/article/9dedc8916c06fdaf2e3406106daa6d72/.tmp/14cde3aab9ed4529a1ce3e0f6957974e
  2401. 2014-07-10 15:55:51,508 INFO [MemStoreFlusher.0] regionserver.StoreFile$Reader: Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 14cde3aab9ed4529a1ce3e0f6957974e
  2402. 2014-07-10 15:55:51,589 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1457174217, memsize=8.3 M, hasBloomFilter=true, into tmp file hdfs://master:9000/hbase/data/default/article/9dedc8916c06fdaf2e3406106daa6d72/.tmp/e78f57fd6fbd4c929b48cc51b7ba08e6
  2403. 2014-07-10 15:55:51,593 INFO [MemStoreFlusher.0] regionserver.StoreFile$Reader: Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e78f57fd6fbd4c929b48cc51b7ba08e6
  2404. 2014-07-10 15:55:51,600 INFO [MemStoreFlusher.0] regionserver.StoreFile$Reader: Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 14cde3aab9ed4529a1ce3e0f6957974e
  2405. 2014-07-10 15:55:51,600 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://master:9000/hbase/data/default/article/9dedc8916c06fdaf2e3406106daa6d72/detail/14cde3aab9ed4529a1ce3e0f6957974e, entries=2765, sequenceid=1457174217, filesize=1.4 M
  2406. 2014-07-10 15:55:51,607 INFO [MemStoreFlusher.0] regionserver.StoreFile$Reader: Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e78f57fd6fbd4c929b48cc51b7ba08e6
  2407. 2014-07-10 15:55:51,608 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://master:9000/hbase/data/default/article/9dedc8916c06fdaf2e3406106daa6d72/list/e78f57fd6fbd4c929b48cc51b7ba08e6, entries=40382, sequenceid=1457174217, filesize=1.3 M
  2408. 2014-07-10 15:55:51,608 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~12.0 M/12534800, currentsize=0/0 for region article,303b80a67cbf4b522043c1c9b8bc061f,1395916557016.9dedc8916c06fdaf2e3406106daa6d72. in 190ms, sequenceid=1457174217, compaction requested=true
  2409. 2014-07-10 15:56:21,281 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region article,684401e8f32d9e37972147a5a70e0de0,1397098375738.21f50e59624cda1b9cb00645f23a5c76. after a delay of 21059
  2410. 2014-07-10 15:56:31,281 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region article,684401e8f32d9e37972147a5a70e0de0,1397098375738.21f50e59624cda1b9cb00645f23a5c76. after a delay of 17617
  2411. 2014-07-10 15:56:41,281 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region article,684401e8f32d9e37972147a5a70e0de0,1397098375738.21f50e59624cda1b9cb00645f23a5c76. after a delay of 17187
  2412. 2014-07-10 15:56:42,370 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1457176199, memsize=1.3 M, hasBloomFilter=true, into tmp file hdfs://master:9000/hbase/data/default/article/21f50e59624cda1b9cb00645f23a5c76/.tmp/76907471ecfe467da14efe19691269fe
  2413. 2014-07-10 15:56:42,376 INFO [MemStoreFlusher.0] regionserver.StoreFile$Reader: Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 76907471ecfe467da14efe19691269fe
  2414. 2014-07-10 15:56:42,442 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1457176199, memsize=4.2 M, hasBloomFilter=true, into tmp file hdfs://master:9000/hbase/data/default/article/21f50e59624cda1b9cb00645f23a5c76/.tmp/18f1dd75767a4fbfb5304e90bf7f22f0
  2415. 2014-07-10 15:56:42,447 INFO [MemStoreFlusher.0] regionserver.StoreFile$Reader: Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 18f1dd75767a4fbfb5304e90bf7f22f0
  2416. 2014-07-10 15:56:42,457 INFO [MemStoreFlusher.0] regionserver.StoreFile$Reader: Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 76907471ecfe467da14efe19691269fe
  2417. 2014-07-10 15:56:42,457 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://master:9000/hbase/data/default/article/21f50e59624cda1b9cb00645f23a5c76/detail/76907471ecfe467da14efe19691269fe, entries=1396, sequenceid=1457176199, filesize=786.7 K
  2418. 2014-07-10 15:56:42,465 INFO [MemStoreFlusher.0] regionserver.StoreFile$Reader: Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 18f1dd75767a4fbfb5304e90bf7f22f0
  2419. 2014-07-10 15:56:42,466 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://master:9000/hbase/data/default/article/21f50e59624cda1b9cb00645f23a5c76/list/18f1dd75767a4fbfb5304e90bf7f22f0, entries=20390, sequenceid=1457176199, filesize=672.9 K
  2420. 2014-07-10 15:56:42,466 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~6.1 M/6414424, currentsize=416/416 for region article,684401e8f32d9e37972147a5a70e0de0,1397098375738.21f50e59624cda1b9cb00645f23a5c76. in 126ms, sequenceid=1457176199, compaction requested=true
  2421. 2014-07-10 15:56:42,466 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HRegion: Starting compaction on detail in region article,684401e8f32d9e37972147a5a70e0de0,1397098375738.21f50e59624cda1b9cb00645f23a5c76.
  2422. 2014-07-10 15:56:42,466 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HStore: Starting compaction of 3 file(s) in detail of article,684401e8f32d9e37972147a5a70e0de0,1397098375738.21f50e59624cda1b9cb00645f23a5c76. into tmpdir=hdfs://master:9000/hbase/data/default/article/21f50e59624cda1b9cb00645f23a5c76/.tmp, totalSize=22.8 M
  2423. 2014-07-10 15:56:43,279 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.StoreFile$Reader: Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 551df2177b2b467c85cfa06f155ffd22
  2424. 2014-07-10 15:56:43,292 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.StoreFile$Reader: Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 551df2177b2b467c85cfa06f155ffd22
  2425. 2014-07-10 15:56:43,336 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HStore: Completed compaction of 3 file(s) in detail of article,684401e8f32d9e37972147a5a70e0de0,1397098375738.21f50e59624cda1b9cb00645f23a5c76. into 551df2177b2b467c85cfa06f155ffd22(size=22.8 M), total size for store is 2.4 G. This selection was in queue for 0sec, and took 0sec to execute.
  2426. 2014-07-10 15:56:43,336 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.CompactSplitThread: Completed compaction: Request = regionName=article,684401e8f32d9e37972147a5a70e0de0,1397098375738.21f50e59624cda1b9cb00645f23a5c76., storeName=detail, fileCount=3, fileSize=22.8 M, priority=6, time=47236475112373346; duration=0sec
  2427. 2014-07-10 15:56:43,336 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HRegion: Starting compaction on list in region article,684401e8f32d9e37972147a5a70e0de0,1397098375738.21f50e59624cda1b9cb00645f23a5c76.
  2428. 2014-07-10 15:56:43,337 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HStore: Starting compaction of 3 file(s) in list of article,684401e8f32d9e37972147a5a70e0de0,1397098375738.21f50e59624cda1b9cb00645f23a5c76. into tmpdir=hdfs://master:9000/hbase/data/default/article/21f50e59624cda1b9cb00645f23a5c76/.tmp, totalSize=26.8 M
  2429. 2014-07-10 15:56:44,726 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.StoreFile$Reader: Loaded Delete Family Bloom (CompoundBloomFilter) metadata for aebf489c984b41ea90543368d3c857c7
  2430. 2014-07-10 15:56:44,759 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.StoreFile$Reader: Loaded Delete Family Bloom (CompoundBloomFilter) metadata for aebf489c984b41ea90543368d3c857c7
  2431. 2014-07-10 15:56:44,787 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HStore: Completed compaction of 3 file(s) in list of article,684401e8f32d9e37972147a5a70e0de0,1397098375738.21f50e59624cda1b9cb00645f23a5c76. into aebf489c984b41ea90543368d3c857c7(size=26.3 M), total size for store is 1.2 G. This selection was in queue for 0sec, and took 1sec to execute.
  2432. 2014-07-10 15:56:44,788 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.CompactSplitThread: Completed compaction: Request = regionName=article,684401e8f32d9e37972147a5a70e0de0,1397098375738.21f50e59624cda1b9cb00645f23a5c76., storeName=list, fileCount=3, fileSize=26.8 M, priority=6, time=47236475982722733; duration=1sec
  2433. 2014-07-10 15:57:58,960 WARN [RpcServer.reader=4,port=60020] ipc.RpcServer: RpcServer.listener,port=60020: count of bytes read: 0
  2434. java.io.IOException: Connection reset by peer
  2435. at sun.nio.ch.FileDispatcher.read0(Native Method)
  2436. at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
  2437. at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:251)
  2438. at sun.nio.ch.IOUtil.read(IOUtil.java:224)
  2439. at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:254)
  2440. at org.apache.hadoop.hbase.ipc.RpcServer.channelRead(RpcServer.java:2404)
  2441. at org.apache.hadoop.hbase.ipc.RpcServer$Connection.readAndProcess(RpcServer.java:1425)
  2442. at org.apache.hadoop.hbase.ipc.RpcServer$Listener.doRead(RpcServer.java:780)
  2443. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:568)
  2444. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:543)
  2445. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
  2446. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  2447. at java.lang.Thread.run(Thread.java:701)
  2448. 2014-07-10 15:58:51,282 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region visited_article,40484e9bddd7954f44c35bdf134e4dee\x00\x1D\x17\xE6,1389119155036.c6fdec019ff1dba3f2137ff724a191cb. after a delay of 18967
  2449. 2014-07-10 15:59:01,282 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region visited_article,40484e9bddd7954f44c35bdf134e4dee\x00\x1D\x17\xE6,1389119155036.c6fdec019ff1dba3f2137ff724a191cb. after a delay of 9675
  2450. 2014-07-10 15:59:10,296 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1457181674, memsize=2.3 M, hasBloomFilter=true, into tmp file hdfs://master:9000/hbase/data/default/visited_article/c6fdec019ff1dba3f2137ff724a191cb/.tmp/66691e269b7840b6827b9c3a99462697
  2451. 2014-07-10 15:59:10,308 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://master:9000/hbase/data/default/visited_article/c6fdec019ff1dba3f2137ff724a191cb/cf1/66691e269b7840b6827b9c3a99462697, entries=11367, sequenceid=1457181674, filesize=367.8 K
  2452. 2014-07-10 15:59:10,308 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~2.4 M/2505536, currentsize=0/0 for region visited_article,40484e9bddd7954f44c35bdf134e4dee\x00\x1D\x17\xE6,1389119155036.c6fdec019ff1dba3f2137ff724a191cb. in 59ms, sequenceid=1457181674, compaction requested=true
  2453. 2014-07-10 15:59:10,309 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HRegion: Starting compaction on cf1 in region visited_article,40484e9bddd7954f44c35bdf134e4dee\x00\x1D\x17\xE6,1389119155036.c6fdec019ff1dba3f2137ff724a191cb.
  2454. 2014-07-10 15:59:10,309 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HStore: Starting compaction of 3 file(s) in cf1 of visited_article,40484e9bddd7954f44c35bdf134e4dee\x00\x1D\x17\xE6,1389119155036.c6fdec019ff1dba3f2137ff724a191cb. into tmpdir=hdfs://master:9000/hbase/data/default/visited_article/c6fdec019ff1dba3f2137ff724a191cb/.tmp, totalSize=30.7 M
  2455. 2014-07-10 15:59:11,974 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HStore: Completed compaction of 3 file(s) in cf1 of visited_article,40484e9bddd7954f44c35bdf134e4dee\x00\x1D\x17\xE6,1389119155036.c6fdec019ff1dba3f2137ff724a191cb. into 5e755b4870f64ec9b4e27368eb8c00ab(size=30.7 M), total size for store is 2.2 G. This selection was in queue for 0sec, and took 1sec to execute.
  2456. 2014-07-10 15:59:11,974 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.CompactSplitThread: Completed compaction: Request = regionName=visited_article,40484e9bddd7954f44c35bdf134e4dee\x00\x1D\x17\xE6,1389119155036.c6fdec019ff1dba3f2137ff724a191cb., storeName=cf1, fileCount=3, fileSize=30.7 M, priority=6, time=47236622954697274; duration=1sec
  2457. 2014-07-10 15:59:41,287 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region url_guid,a017c0ff6d49bef5fbdb34806fa09ee1,1386682300480.1af7ec7e41ac505904377d5ea9971c07. after a delay of 3239
  2458. 2014-07-10 15:59:44,559 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1457183158, memsize=1.7 M, hasBloomFilter=true, into tmp file hdfs://master:9000/hbase/data/default/url_guid/1af7ec7e41ac505904377d5ea9971c07/.tmp/ca06ce769ae24ad1909935ba2e6583bc
  2459. 2014-07-10 15:59:44,571 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://master:9000/hbase/data/default/url_guid/1af7ec7e41ac505904377d5ea9971c07/cf1/ca06ce769ae24ad1909935ba2e6583bc, entries=7846, sequenceid=1457183158, filesize=329.3 K
  2460. 2014-07-10 15:59:44,571 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~1.7 M/1745464, currentsize=0/0 for region url_guid,a017c0ff6d49bef5fbdb34806fa09ee1,1386682300480.1af7ec7e41ac505904377d5ea9971c07. in 45ms, sequenceid=1457183158, compaction requested=true
  2461. 2014-07-10 16:00:41,287 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region visited_article,204644f25ca678a2fe64b28ade4f1b0c\x00\x0A\x1C\xDE,1388226171288.e5472d54066f93e8591fa51fe4f27541. after a delay of 14287
  2462. 2014-07-10 16:00:51,287 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region visited_article,204644f25ca678a2fe64b28ade4f1b0c\x00\x0A\x1C\xDE,1388226171288.e5472d54066f93e8591fa51fe4f27541. after a delay of 21648
  2463. 2014-07-10 16:00:55,655 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1457186081, memsize=2.3 M, hasBloomFilter=true, into tmp file hdfs://master:9000/hbase/data/default/visited_article/e5472d54066f93e8591fa51fe4f27541/.tmp/8dea5d8039fa400ebd2aca5b3850ab69
  2464. 2014-07-10 16:00:55,669 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://master:9000/hbase/data/default/visited_article/e5472d54066f93e8591fa51fe4f27541/cf1/8dea5d8039fa400ebd2aca5b3850ab69, entries=11123, sequenceid=1457186081, filesize=366.9 K
  2465. 2014-07-10 16:00:55,670 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~2.3 M/2458784, currentsize=1.1 K/1096 for region visited_article,204644f25ca678a2fe64b28ade4f1b0c\x00\x0A\x1C\xDE,1388226171288.e5472d54066f93e8591fa51fe4f27541. in 94ms, sequenceid=1457186081, compaction requested=true
  2466. 2014-07-10 16:00:55,671 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HRegion: Starting compaction on cf1 in region visited_article,204644f25ca678a2fe64b28ade4f1b0c\x00\x0A\x1C\xDE,1388226171288.e5472d54066f93e8591fa51fe4f27541.
  2467. 2014-07-10 16:00:55,671 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HStore: Starting compaction of 3 file(s) in cf1 of visited_article,204644f25ca678a2fe64b28ade4f1b0c\x00\x0A\x1C\xDE,1388226171288.e5472d54066f93e8591fa51fe4f27541. into tmpdir=hdfs://master:9000/hbase/data/default/visited_article/e5472d54066f93e8591fa51fe4f27541/.tmp, totalSize=30.4 M
  2468. 2014-07-10 16:00:57,720 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HStore: Completed compaction of 3 file(s) in cf1 of visited_article,204644f25ca678a2fe64b28ade4f1b0c\x00\x0A\x1C\xDE,1388226171288.e5472d54066f93e8591fa51fe4f27541. into 83e456282f644383b81a4e6256ab377d(size=30.3 M), total size for store is 2.3 G. This selection was in queue for 0sec, and took 2sec to execute.
  2469. 2014-07-10 16:00:57,720 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.CompactSplitThread: Completed compaction: Request = regionName=visited_article,204644f25ca678a2fe64b28ade4f1b0c\x00\x0A\x1C\xDE,1388226171288.e5472d54066f93e8591fa51fe4f27541., storeName=cf1, fileCount=3, fileSize=30.4 M, priority=6, time=47236728316608787; duration=2sec
  2470. 2014-07-10 16:04:12,263 WARN [RpcServer.reader=5,port=60020] ipc.RpcServer: RpcServer.listener,port=60020: count of bytes read: 0
  2471. java.io.IOException: Connection reset by peer
  2472. at sun.nio.ch.FileDispatcher.read0(Native Method)
  2473. at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
  2474. at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:251)
  2475. at sun.nio.ch.IOUtil.read(IOUtil.java:224)
  2476. at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:254)
  2477. at org.apache.hadoop.hbase.ipc.RpcServer.channelRead(RpcServer.java:2404)
  2478. at org.apache.hadoop.hbase.ipc.RpcServer$Connection.readAndProcess(RpcServer.java:1425)
  2479. at org.apache.hadoop.hbase.ipc.RpcServer$Listener.doRead(RpcServer.java:780)
  2480. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:568)
  2481. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:543)
  2482. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
  2483. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  2484. at java.lang.Thread.run(Thread.java:701)
  2485. 2014-07-10 16:05:53,921 INFO [regionserver60020.logRoller] wal.FSHLog: Rolled WAL /hbase/WALs/slave2,60020,1397552649456/slave2%2C60020%2C1397552649456.1404975953759 with entries=137754, filesize=59.4 M; new WAL /hbase/WALs/slave2,60020,1397552649456/slave2%2C60020%2C1397552649456.1404979553888
  2486. 2014-07-10 16:05:53,922 INFO [regionserver60020.logRoller] wal.FSHLog: moving old hlog file /hbase/WALs/slave2,60020,1397552649456/slave2%2C60020%2C1397552649456.1404972353650 whose highest sequenceid is 1457059526 to /hbase/oldWALs/slave2%2C60020%2C1397552649456.1404972353650
  2487. 2014-07-10 16:21:21,343 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region visited_article,600fcc228b36625c1904ba4f11e6207a\x00\x17o\xD8,1395813592646.b3a19a2f85e170275c4f141a18a08abf. after a delay of 10416
  2488. 2014-07-10 16:21:31,344 INFO [regionserver60020.periodicFlusher] regionserver.HRegionServer: regionserver60020.periodicFlusher requesting flush for region visited_article,600fcc228b36625c1904ba4f11e6207a\x00\x17o\xD8,1395813592646.b3a19a2f85e170275c4f141a18a08abf. after a delay of 9385
  2489. 2014-07-10 16:21:31,804 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed, sequenceid=1457232652, memsize=1.2 M, hasBloomFilter=true, into tmp file hdfs://master:9000/hbase/data/default/visited_article/b3a19a2f85e170275c4f141a18a08abf/.tmp/b0935301a46142bc93512235695b8922
  2490. 2014-07-10 16:21:31,820 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://master:9000/hbase/data/default/visited_article/b3a19a2f85e170275c4f141a18a08abf/cf1/b0935301a46142bc93512235695b8922, entries=6009, sequenceid=1457232652, filesize=196.1 K
  2491. 2014-07-10 16:21:31,820 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush of ~1.3 M/1319152, currentsize=0/0 for region visited_article,600fcc228b36625c1904ba4f11e6207a\x00\x17o\xD8,1395813592646.b3a19a2f85e170275c4f141a18a08abf. in 60ms, sequenceid=1457232652, compaction requested=true
  2492. 2014-07-10 16:21:31,821 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HRegion: Starting compaction on cf1 in region visited_article,600fcc228b36625c1904ba4f11e6207a\x00\x17o\xD8,1395813592646.b3a19a2f85e170275c4f141a18a08abf.
  2493. 2014-07-10 16:21:31,821 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HStore: Starting compaction of 3 file(s) in cf1 of visited_article,600fcc228b36625c1904ba4f11e6207a\x00\x17o\xD8,1395813592646.b3a19a2f85e170275c4f141a18a08abf. into tmpdir=hdfs://master:9000/hbase/data/default/visited_article/b3a19a2f85e170275c4f141a18a08abf/.tmp, totalSize=25.0 M
  2494. 2014-07-10 16:21:33,691 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.HStore: Completed compaction of 3 file(s) in cf1 of visited_article,600fcc228b36625c1904ba4f11e6207a\x00\x17o\xD8,1395813592646.b3a19a2f85e170275c4f141a18a08abf. into 33de67666f654214813c4358093795f1(size=25.0 M), total size for store is 1.1 G. This selection was in queue for 0sec, and took 1sec to execute.
  2495. 2014-07-10 16:21:33,691 INFO [regionserver60020-smallCompactions-1397552664633] regionserver.CompactSplitThread: Completed compaction: Request = regionName=visited_article,600fcc228b36625c1904ba4f11e6207a\x00\x17o\xD8,1395813592646.b3a19a2f85e170275c4f141a18a08abf., storeName=cf1, fileCount=3, fileSize=25.0 M, priority=6, time=47237964467320480; duration=1sec
  2496. 2014-07-10 16:22:45,550 ERROR [RpcServer.handler=6,port=60020] ipc.RpcServer: Unexpected throwable object
  2497. java.lang.NullPointerException
  2498. 2014-07-10 16:24:43,604 ERROR [RpcServer.handler=11,port=60020] ipc.RpcServer: Unexpected throwable object
  2499. java.lang.NullPointerException
  2500. 2014-07-10 16:26:40,410 WARN [RpcServer.reader=2,port=60020] ipc.RpcServer: RpcServer.listener,port=60020: count of bytes read: 0
  2501. java.io.IOException: Connection reset by peer
  2502. at sun.nio.ch.FileDispatcher.read0(Native Method)
  2503. at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
  2504. at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:251)
  2505. at sun.nio.ch.IOUtil.read(IOUtil.java:224)
  2506. at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:254)
  2507. at org.apache.hadoop.hbase.ipc.RpcServer.channelRead(RpcServer.java:2404)
  2508. at org.apache.hadoop.hbase.ipc.RpcServer$Connection.readAndProcess(RpcServer.java:1425)
  2509. at org.apache.hadoop.hbase.ipc.RpcServer$Listener.doRead(RpcServer.java:780)
  2510. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:568)
  2511. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:543)
  2512. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
  2513. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  2514. at java.lang.Thread.run(Thread.java:701)
  2515. 2014-07-10 16:26:43,723 WARN [RpcServer.reader=5,port=60020] ipc.RpcServer: RpcServer.listener,port=60020: count of bytes read: 0
  2516. java.io.IOException: Connection reset by peer
  2517. at sun.nio.ch.FileDispatcher.read0(Native Method)
  2518. at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
  2519. at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:251)
  2520. at sun.nio.ch.IOUtil.read(IOUtil.java:224)
  2521. at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:254)
  2522. at org.apache.hadoop.hbase.ipc.RpcServer.channelRead(RpcServer.java:2404)
  2523. at org.apache.hadoop.hbase.ipc.RpcServer$Connection.readAndProcess(RpcServer.java:1425)
  2524. at org.apache.hadoop.hbase.ipc.RpcServer$Listener.doRead(RpcServer.java:780)
  2525. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:568)
  2526. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:543)
  2527. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
  2528. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  2529. at java.lang.Thread.run(Thread.java:701)
  2530. 2014-07-10 16:26:43,731 WARN [RpcServer.handler=0,port=60020] ipc.RpcServer: RpcServer.respondercallId: 740303 service: ClientService methodName: Get size: 161 connection: 115.238.188.210:58524: output error
  2531. 2014-07-10 16:26:43,731 WARN [RpcServer.handler=0,port=60020] ipc.RpcServer: RpcServer.handler=0,port=60020: caught a ClosedChannelException, this means that the server was processing a request but the client went away. The error message was: null
  2532. 2014-07-10 16:27:35,778 WARN [RpcServer.reader=6,port=60020] ipc.RpcServer: RpcServer.listener,port=60020: count of bytes read: 0
  2533. java.io.IOException: Connection reset by peer
  2534. at sun.nio.ch.FileDispatcher.read0(Native Method)
  2535. at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
  2536. at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:251)
  2537. at sun.nio.ch.IOUtil.read(IOUtil.java:224)
  2538. at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:254)
  2539. at org.apache.hadoop.hbase.ipc.RpcServer.channelRead(RpcServer.java:2404)
  2540. at org.apache.hadoop.hbase.ipc.RpcServer$Connection.readAndProcess(RpcServer.java:1425)
  2541. at org.apache.hadoop.hbase.ipc.RpcServer$Listener.doRead(RpcServer.java:780)
  2542. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:568)
  2543. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:543)
  2544. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
  2545. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  2546. at java.lang.Thread.run(Thread.java:701)
  2547. 2014-07-10 16:28:40,062 INFO [610366995@qtp-1922766448-7] Configuration.deprecation: fs.default.name is deprecated. Instead, use fs.defaultFS
  2548.  
  2549.  
  2550.  
  2551.  
  2552.  
  2553. RS Queue:
  2554. ===========================================================
  2555. Compaction/Split Queue summary: compaction_queue=(0:0), split_queue=0, merge_queue=0
  2556. Compaction/Split Queue dump:
  2557. LargeCompation Queue:
  2558.  
  2559. SmallCompation Queue:
  2560.  
  2561. Split Queue:
  2562.  
  2563. Region Merge Queue:
  2564.  
  2565.  
  2566. Flush Queue summary: flush_queue=0
  2567. Flush Queue Queue dump:
  2568. Flush Queue:
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement