Advertisement
Guest User

HBase Error log for slow start-up of zookeeper

a guest
Jan 14th, 2013
188
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
  1. hduser@sandrock:~/work$ ./hbaseStandalone.sh t a 8
  2. Loading workload...
  3. Starting test.
  4.  0 sec: 0 operations;  
  5. SLF4J: Class path contains multiple SLF4J bindings.
  6. SLF4J: Found binding in [jar:file:/home/hduser/slf4j-1.6.6/slf4j-simple-1.6.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
  7. SLF4J: Found binding in [jar:file:/home/hduser/work/YCSB/hbase/target/hbase-binding-0.1.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
  8. SLF4J: Found binding in [jar:file:/home/hduser/work/hbase-0.94.1/lib/slf4j-log4j12-1.4.3.jar!/org/slf4j/impl/StaticLoggerBinder.class]
  9. SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
  10. SLF4J: Actual binding is of type [org.slf4j.impl.SimpleLoggerFactory]
  11.  10 sec: 0 operations;  
  12. 10015 [Thread-5] INFO org.apache.zookeeper.ZooKeeper - Client environment:zookeeper.version=3.4.3-1240972, built on 02/06/2012 10:48 GMT
  13. 10015 [Thread-5] INFO org.apache.zookeeper.ZooKeeper - Client environment:host.name=XXX.XXX.XXX.233
  14. 10015 [Thread-5] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.version=1.6.0_24
  15. 10016 [Thread-5] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.vendor=Sun Microsystems Inc.
  16. 10016 [Thread-5] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.home=/usr/lib/jvm/java-6-openjdk-amd64/jre
  17. 10016 [Thread-5] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.class.path=/home/hduser/slf4j-1.6.6/slf4j-simple-1.6.6.jar:....
  18. 10016 [Thread-5] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.library.path=/usr/lib/jvm/java-6-openjdk-amd64/jre/lib/amd64/server:/usr/lib/jvm/java-6-openjdk-amd64/jre/lib/amd64:/usr/lib/jvm/java
  19. -6-openjdk-amd64/jre/../lib/amd64:/usr/java/packages/lib/amd64:/usr/lib/x86_64-linux-gnu/jni:/lib/x86_64-linux-gnu:/usr/lib/x86_64-linux-gnu:/usr/lib/jni:/lib:/usr/lib
  20. 10017 [Thread-5] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.io.tmpdir=/tmp
  21. 10017 [Thread-5] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.compiler=<NA>
  22. 10017 [Thread-5] INFO org.apache.zookeeper.ZooKeeper - Client environment:os.name=Linux
  23. 10017 [Thread-5] INFO org.apache.zookeeper.ZooKeeper - Client environment:os.arch=amd64
  24. 10017 [Thread-5] INFO org.apache.zookeeper.ZooKeeper - Client environment:os.version=3.2.0-33-generic
  25. 10018 [Thread-5] INFO org.apache.zookeeper.ZooKeeper - Client environment:user.name=hduser
  26. 10018 [Thread-5] INFO org.apache.zookeeper.ZooKeeper - Client environment:user.home=/home/hduser
  27. 10018 [Thread-5] INFO org.apache.zookeeper.ZooKeeper - Client environment:user.dir=/home/hduser/work/YCSB
  28. 10021 [Thread-5] INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=vm4:2181 sessionTimeout=180000 watcher=hconnection
  29. 10041 [Thread-5-SendThread()] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server /XXX.XXX.XXX.199:2181
  30. 10045 [Thread-5-SendThread(vm4.xxx.xx:2181)] INFO org.apache.zookeeper.client.ZooKeeperSaslClient - Client will not SASL-authenticate because the default JAAS configuration section 'Client' could not be found. If you are not using SASL, you may ignore this. On the other hand, if you expected SASL to work, please fix your JAAS configuration.
  31. 10051 [Thread-5-SendThread(vm4.xxx.xx:2181)] INFO org.apache.zookeeper.ClientCnxn - Socket connection established to vm4.xxx.xx/XXX.XXX.XXX.199:2181, initiating session
  32. 10071 [Thread-5-SendThread(vm4.xxx.xx:2181)] WARN org.apache.zookeeper.ClientCnxnSocket - Connected to an old server; r-o mode will be unavailable
  33. 10071 [Thread-5-SendThread(vm4.xxx.xx:2181)] INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server vm4.xxx.xx/XXX.XXX.XXX.199:2181, sessionid = 0x13c3aa6780c0017, negotiated timeout = 40000
  34. 13/01/14 17:39:10 ERROR zookeeper.ZooKeeperWatcher: ZK is null on connection event -- see stack trace for the stack trace when constructor was called on this zkw
  35. java.lang.Exception: ZKW CONSTRUCTOR STACK TRACE FOR DEBUGGING
  36.         at org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:142)
  37.         at org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:126)
  38.         at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:1322)
  39.         at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.ensureZookeeperTrackers(HConnectionManager.java:584)
  40.         at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:827)
  41.         at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:810)
  42.         at org.apache.hadoop.hbase.client.HTable.finishSetup(HTable.java:232)
  43.         at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:172)
  44.         at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:131)
  45.         at com.yahoo.ycsb.db.HBaseClient.getHTable(HBaseClient.java:155)
  46.         at com.yahoo.ycsb.db.HBaseClient.update(HBaseClient.java:384)
  47.         at com.yahoo.ycsb.DBWrapper.update(DBWrapper.java:126)
  48.         at com.yahoo.ycsb.workloads.CoreWorkload.doTransactionUpdate(CoreWorkload.java:628)
  49.         at com.yahoo.ycsb.workloads.CoreWorkload.doTransaction(CoreWorkload.java:483)
  50.         at com.yahoo.ycsb.ClientThread.run(Client.java:233)
  51. 12084 [Thread-5-EventThread] ERROR org.apache.zookeeper.ClientCnxn - Error while calling watcher
  52. java.lang.NullPointerException: ZK is null
  53.         at org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.connectionEvent(ZooKeeperWatcher.java:334)
  54.         at org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.process(ZooKeeperWatcher.java:271)
  55.         at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:521)
  56.         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:497)
  57. 13/01/14 17:39:13 INFO zookeeper.RecoverableZooKeeper: The identifier of this process is 4382@sandrock
  58.  20 sec: 0 operations;  
  59.  30 sec: 23 operations; 2.3 current ops/sec; [UPDATE AverageLatency(us)=7750956.1] [READ AverageLatency(us)=32312.33]
  60.  40 sec: 35 operations; 1.2 current ops/sec; [UPDATE AverageLatency(us)=440.57] [READ AverageLatency(us)=2024441.2]
  61.  50 sec: 42 operations; 0.7 current ops/sec; [UPDATE AverageLatency(us)=383.67] [READ AverageLatency(us)=20051301]
  62.  60 sec: 77 operations; 3.5 current ops/sec; [UPDATE AverageLatency(us)=433] [READ AverageLatency(us)=1811810.65]
  63.  70 sec: 134 operations; 5.7 current ops/sec; [UPDATE AverageLatency(us)=416.88] [READ AverageLatency(us)=1774955.65]
  64.  80 sec: 633 operations; 49.9 current ops/sec; [UPDATE AverageLatency(us)=385.61] [READ AverageLatency(us)=211696.33]
  65.  90 sec: 2519 operations; 188.58 current ops/sec; [UPDATE AverageLatency(us)=260.31] [READ AverageLatency(us)=77734.89]
  66.  100 sec: 6955 operations; 443.56 current ops/sec; [UPDATE AverageLatency(us)=187.33] [READ AverageLatency(us)=54961.92]
  67.  110 sec: 12873 operations; 591.74 current ops/sec; [UPDATE AverageLatency(us)=104.88] [READ AverageLatency(us)=47078.38]
  68.  120 sec: 19971 operations; 709.73 current ops/sec; [UPDATE AverageLatency(us)=51.54] [READ AverageLatency(us)=25890.88]
  69.  130 sec: 28854 operations; 888.21 current ops/sec; [UPDATE AverageLatency(us)=34.1] [READ AverageLatency(us)=27814.17]
  70.  140 sec: 38692 operations; 983.8 current ops/sec; [UPDATE AverageLatency(us)=19.48] [READ AverageLatency(us)=31602.32]
  71.  150 sec: 49581 operations; 1088.79 current ops/sec; [UPDATE AverageLatency(us)=19.97] [READ AverageLatency(us)=33967.55]
  72.  160 sec: 61235 operations; 1165.28 current ops/sec; [UPDATE AverageLatency(us)=20.87] [READ AverageLatency(us)=13502.78]
  73.  170 sec: 73546 operations; 1230.98 current ops/sec; [UPDATE AverageLatency(us)=22.4] [READ AverageLatency(us)=12910.14]
  74.  180 sec: 86100 operations; 1255.27 current ops/sec; [UPDATE AverageLatency(us)=22.26] [READ AverageLatency(us)=12892.04]
  75.  190 sec: 98618 operations; 1251.8 current ops/sec; [UPDATE AverageLatency(us)=22.02] [READ AverageLatency(us)=12795.87]
  76.  200 sec: 111143 operations; 1252.37 current ops/sec; [UPDATE AverageLatency(us)=20.81] [READ AverageLatency(us)=12864.2]
  77.  210 sec: 123479 operations; 1233.48 current ops/sec; [UPDATE AverageLatency(us)=21.68] [READ AverageLatency(us)=12673.99]
  78.  220 sec: 135933 operations; 1245.28 current ops/sec; [UPDATE AverageLatency(us)=21.71] [READ AverageLatency(us)=12866.15]
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement