API tools faq
paste
Advertisement
Guest User

Untitled

a guest
May 25th, 2016
49
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 8.32 KB | None | 0 0
raw download clone embed print report
  1. $ ./bleve-blast -count 500000 -source ~/Documents/research/lucene/data/enwiki-20120502-lines-1k.txt -target forestdb-moss.bleve -config ../../configs/moss-forestdb.json
  2. Using Index Type: upside_down
  3. Using KV store: moss
  4. Using KV config: map[string]interface {}{"walThreshold":409600, "maxWriterLockProb":20, "compressDocumentBody":true, "durabilityOpt":"async", "mossDebug":1, "mossLowerLevelStoreName":"forestdb", "bufferCacheSize":4.073741824e+09}
  5. date,docs_indexed,plaintext_bytes_indexed,avg_mb_per_second,mb_per_second
  6. 2016-05-25T17:24:34-04:00,0,0,0.000000,0.000000
  7. 2016-05-25T17:24:39-04:00,15000,15229604,3.045305,3.045305
  8. 2016-05-25T17:24:44-04:00,29200,29608553,2.959991,2.874692
  9. 2016-05-25T17:24:49-04:00,41800,42339385,2.821642,2.544991
  10. 2016-05-25T17:24:54-04:00,55200,55920290,2.795283,2.716180
  11. 2016-05-25T17:24:59-04:00,67300,68203744,2.727579,2.456691
  12. 2016-05-25T17:25:04-04:00,81200,82324990,2.743420,2.822595
  13. 2016-05-25T17:25:09-04:00,93100,94370150,2.695326,2.406936
  14. 2016-05-25T17:25:14-04:00,104200,105612625,2.640141,2.252940
  15. 2016-05-25T17:25:19-04:00,116200,117786805,2.617180,2.433579
  16. 2016-05-25T17:25:24-04:00,127000,128734454,2.574426,2.189587
  17. 2016-05-25T17:25:29-04:00,140500,142422404,2.589253,2.737527
  18. 2016-05-25T17:25:34-04:00,153800,155929743,2.598603,2.701464
  19. 2016-05-25T17:25:39-04:00,162500,164793702,2.534731,1.769586
  20. 2016-05-25T17:25:44-04:00,175900,178353860,2.547796,2.718056
  21. 2016-05-25T17:25:49-04:00,187900,190557104,2.540669,2.440883
  22. 2016-05-25T17:25:54-04:00,201800,204680124,2.558338,2.823255
  23. 2016-05-25T17:25:59-04:00,215800,218929932,2.575487,2.849871
  24. 2016-05-25T17:26:04-04:00,221700,224914726,2.498913,1.197020
  25. 2016-05-25T17:26:09-04:00,233400,236787099,2.492397,2.375061
  26. 2016-05-25T17:26:14-04:00,246900,250441352,2.504388,2.732354
  27. 2016-05-25T17:26:19-04:00,259000,262722927,2.501924,2.452724
  28. 2016-05-25T17:26:24-04:00,270700,274604652,2.496366,2.379470
  29. 2016-05-25T17:26:29-04:00,283500,287584580,2.500497,2.591222
  30. 2016-05-25T17:26:34-04:00,294900,299144948,2.492776,2.314954
  31. 2016-05-25T17:26:39-04:00,307300,311738484,2.493233,2.504141
  32. 2016-05-25T17:26:44-04:00,318000,322588805,2.481308,2.181533
  33. 2016-05-25T17:26:49-04:00,330500,335284785,2.483494,2.540353
  34. 2016-05-25T17:26:54-04:00,343700,348650940,2.490358,2.675886
  35. 2016-05-25T17:26:59-04:00,354400,359456385,2.478888,2.158146
  36. 2016-05-25T17:27:04-04:00,363600,368782713,2.458522,1.867259
  37. 2016-05-25T17:27:09-04:00,369100,374383703,2.415237,1.118564
  38. 2016-05-25T17:27:14-04:00,381500,386965950,2.418326,2.514007
  39. 2016-05-25T17:27:19-04:00,392700,398337087,2.414128,2.279470
  40. 2016-05-25T17:27:24-04:00,405800,411600688,2.421127,2.652031
  41. 2016-05-25T17:27:29-04:00,417700,423651917,2.420801,2.409701
  42. 2016-05-25T17:27:34-04:00,429100,435218049,2.417748,2.311000
  43. 2016-05-25T17:27:39-04:00,439200,445483157,2.407974,2.055656
  44. 2016-05-25T17:27:44-04:00,450600,457058030,2.405433,2.311543
  45. 2016-05-25T17:27:49-04:00,461600,468320865,2.401513,2.252569
  46. 2016-05-25T17:27:54-04:00,475000,481931871,2.409630,2.726717
  47. 2016-05-25T17:27:59-04:00,487200,494314510,2.411287,2.477594
  48. 2016-05-25T17:28:04-04:00,493400,500575542,2.383662,1.251596
  49. 2016-05-25T17:28:09-04:00,495400,502574172,2.337517,0.399669
  50. 2016-05-25T17:28:14-04:00,500000,506937143,2.306343,0.909358
  51. 2016-05-25T17:28:14-04:00,500000,506937143,2.304227,0.000000
  52. 2016-05-25T17:28:19-04:00,500000,506937143,2.253021,0.000000
  53. 2016-05-25T17:28:24-04:00,500000,506937143,2.204042,0.000000
  54. 2016-05-25T17:28:29-04:00,500000,506937143,2.157146,0.000000
  55. 2016-05-25T17:28:34-04:00,500000,506937143,2.112205,0.000000
  56. 2016-05-25T17:28:39-04:00,500000,506937143,2.069097,0.000000
  57. 2016-05-25T17:28:44-04:00,500000,506937143,2.027715,0.000000
  58. 2016-05-25T17:28:49-04:00,500000,506937143,1.987955,0.000000
  59. 2016-05-25T17:28:54-04:00,500000,506937143,1.949724,0.000000
  60. 2016-05-25T17:28:59-04:00,500000,506937143,1.912937,0.000000
  61. 2016-05-25T17:29:04-04:00,500000,506937143,1.877542,0.000000
  62. 2016-05-25T17:29:09-04:00,500000,506937143,1.843392,0.000000
  63. 2016-05-25T17:29:14-04:00,500000,506937143,1.810456,0.000000
  64. 2016-05-25T17:29:19-04:00,500000,506937143,1.778695,0.000000
  65. 2016-05-25T17:29:24-04:00,500000,506937143,1.748027,0.000000
  66. 2016-05-25T17:29:29-04:00,500000,506937143,1.718400,0.000000
  67. 2016-05-25T17:29:34-04:00,500000,506937143,1.689784,0.000000
  68. 2016-05-25T17:29:39-04:00,500000,506937143,1.662086,0.000000
  69. 2016-05-25T17:29:44-04:00,500000,506937143,1.635266,0.000000
  70. 2016-05-25T17:29:49-04:00,500000,506937143,1.609272,0.000000
  71. 2016-05-25T17:29:54-04:00,500000,506937143,1.584128,0.000000
  72. 2016-05-25T17:29:59-04:00,500000,506937143,1.559764,0.000000
  73. 2016-05-25T17:30:04-04:00,500000,506937143,1.536126,0.000000
  74. $ du -sh forestdb-moss.bleve/
  75. 3.1G forestdb-moss.bleve/
  76. $ ./bleve-blast -count 500000 -source ~/Documents/research/lucene/data/enwiki-20120502-lines-1k.txt -target cellar-moss.bleve -config ../../configs/cellar-moss.json
  77. Using Index Type: upside_down
  78. Using KV store: moss
  79. Using KV config: map[string]interface {}{"mossDebug":1, "mossLowerLevelStoreName":"cellar"}
  80. 2016/05/25 17:30:42 setting automatic merge to: false
  81. date,docs_indexed,plaintext_bytes_indexed,avg_mb_per_second,mb_per_second
  82. 2016-05-25T17:30:42-04:00,0,0,0.000000,0.000000
  83. 2016-05-25T17:30:47-04:00,14500,14722447,2.942163,2.942163
  84. 2016-05-25T17:30:52-04:00,27500,27886431,2.787637,2.632978
  85. 2016-05-25T17:30:57-04:00,38800,39301461,2.619993,2.284381
  86. 2016-05-25T17:31:02-04:00,50500,51159332,2.557765,2.371111
  87. 2016-05-25T17:31:07-04:00,62700,63528643,2.540906,2.473475
  88. 2016-05-25T17:31:12-04:00,75300,76329103,2.542899,2.552838
  89. 2016-05-25T17:31:17-04:00,86900,88089227,2.516643,2.358578
  90. 2016-05-25T17:31:22-04:00,97600,98922150,2.472890,2.166599
  91. 2016-05-25T17:31:27-04:00,109700,111192249,2.470867,2.454675
  92. 2016-05-25T17:31:32-04:00,120000,121638246,2.432705,2.089228
  93. 2016-05-25T17:31:37-04:00,130300,132088651,2.401392,2.088499
  94. 2016-05-25T17:31:42-04:00,142500,144460107,2.407592,2.475838
  95. 2016-05-25T17:31:47-04:00,152700,154824278,2.381539,2.069413
  96. 2016-05-25T17:31:52-04:00,164000,166318795,2.375960,2.303276
  97. 2016-05-25T17:31:57-04:00,175000,177448935,2.365687,2.222119
  98. 2016-05-25T17:32:02-04:00,184300,186893728,2.336007,1.890411
  99. 2016-05-25T17:32:07-04:00,194300,197064033,2.318332,2.035335
  100. 2016-05-25T17:32:12-04:00,205100,208036501,2.311308,2.192026
  101. 2016-05-25T17:32:17-04:00,216700,219840946,2.314046,2.363391
  102. 2016-05-25T17:32:22-04:00,227000,230301423,2.302957,2.092249
  103. 2016-05-25T17:32:27-04:00,240400,243901175,2.322701,2.717175
  104. 2016-05-25T17:32:32-04:00,246800,250345328,2.275229,1.282871
  105. 2016-05-25T17:32:37-04:00,256600,260303393,2.263482,2.003437
  106. 2016-05-25T17:32:42-04:00,268500,272384649,2.269727,2.413187
  107. 2016-05-25T17:32:47-04:00,276400,280386221,2.242934,1.599976
  108. 2016-05-25T17:32:52-04:00,284400,288496267,2.219191,1.624626
  109. 2016-05-25T17:32:57-04:00,295200,299440966,2.218055,2.188518
  110. 2016-05-25T17:33:02-04:00,306600,311028908,2.221626,2.318079
  111. 2016-05-25T17:33:07-04:00,318200,322802691,2.226218,2.354783
  112. 2016-05-25T17:33:12-04:00,328000,332756884,2.218358,1.990466
  113. 2016-05-25T17:33:17-04:00,333400,338227281,2.182013,1.092863
  114. 2016-05-25T17:33:22-04:00,344900,349869368,2.186667,2.331117
  115. 2016-05-25T17:33:27-04:00,357500,362589605,2.197497,2.544062
  116. 2016-05-25T17:33:32-04:00,368300,373572693,2.197364,2.192974
  117. 2016-05-25T17:33:37-04:00,380200,385646180,2.203662,2.418127
  118. 2016-05-25T17:33:42-04:00,388500,394092483,2.189248,1.685784
  119. 2016-05-25T17:33:47-04:00,402600,408357868,2.207319,2.859354
  120. 2016-05-25T17:33:52-04:00,410300,416155584,2.190155,1.556355
  121. 2016-05-25T17:33:57-04:00,420200,426188341,2.185567,2.010845
  122. 2016-05-25T17:34:02-04:00,432100,438274667,2.191352,2.416933
  123. 2016-05-25T17:34:07-04:00,437100,443348225,2.162658,1.014792
  124. 2016-05-25T17:34:12-04:00,449800,456234924,2.172464,2.573999
  125. 2016-05-25T17:34:17-04:00,460000,466693014,2.170645,2.094167
  126. 2016-05-25T17:34:22-04:00,471000,477853106,2.172036,2.231862
  127. 2016-05-25T17:34:27-04:00,480900,487925692,2.168549,2.015038
  128. 2016-05-25T17:34:32-04:00,495200,502364706,2.184119,2.883828
  129. 2016-05-25T17:34:35-04:00,500000,506937143,2.174083,1.444705
  130. 2016-05-25T17:34:37-04:00,500000,506937143,2.157167,0.000000
  131. 2016-05-25T17:34:42-04:00,500000,506937143,2.112220,0.000000
  132. 2016-05-25T17:34:47-04:00,500000,506937143,2.069126,0.000000
  133. 2016-05-25T17:34:52-04:00,500000,506937143,2.027735,0.000000
  134. 2016-05-25T17:34:57-04:00,500000,506937143,1.987969,0.000000
  135. 2016-05-25T17:35:02-04:00,500000,506937143,1.949740,0.000000
  136. 2016-05-25T17:35:07-04:00,500000,506937143,1.912963,0.000000
  137. $ du -sh cellar-moss.bleve/
  138. 2.6G cellar-moss.bleve/
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!