josephxsxn

hbase offheap calcs

Aug 1st, 2019 (edited)
63
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!

50GB total for HBase

51200 (server ram for hbase)
20480 (hbase region server heap)
[50000-20480] = 30720 [direct memory for hbase]
recommended hfile read buffer [0.9* 0.8] = 0.7 (means write buffer is 0.1)
recommened amount for blockcache = 14336

new direct = 30720 - 4096 = 26624

   ./configs.py -a set -l localhost -n hbase_dev -c hbase-site -k hfile.block.cache.size -v 0.7
    ./configs.py -a set -l localhost -n hbase_dev -c hbase-site -k hbase.regionserver.global.memstore.upperLimit -v 0.1
    ./configs.py -a set -l localhost -n hbase_dev -c hbase-site -k hbase.regionserver.global.memstore.size -v 0.1
Add Comment
Please, Sign In to add comment