Guest User

Untitled

a guest
Apr 22nd, 2018
90
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 4.12 KB | None | 0 0
  1. ## Cassandra Truncate stress
  2.  
  3. 1. workloads with tens of millions of keys.
  4.  
  5. ```
  6. -------------------------------------------------
  7. PERF TEST [10485760 keys, 3072 block size]
  8. SEQUENTIAL WRITE
  9. num_keys: 10485760
  10. time: 8445.95s
  11. payload: 30 GB
  12. bandwidth: 3.81393 MBps
  13. SEQUENTIAL READ KEY/VALUES
  14. key count: 10485760
  15. time: 1038.41s
  16. payload: 30GB
  17. bandwidth: 31.0206 MBps
  18. TRUNCATE TABLE
  19. time: 7.40911s
  20. payload: 30GB
  21. bandwidth: 4347 MBps
  22. ```
  23.  
  24.  
  25. ```
  26. build-opt/util/cassandra_store_stress --db_size=32212254720 --batch_size=30720
  27. -------------------------------------------------
  28. PERF TEST [1048576 keys, 30720 block size]
  29. SEQUENTIAL WRITE
  30. num_keys: 1048576
  31. time: 993.252s
  32. payload: 30 GB
  33. bandwidth: 32.4311 MBps
  34. SEQUENTIAL READ KEY/VALUES ----------> (Ignore this batch read key/values: one of the pages of the bulk read timedout)
  35. key count: 12000
  36. time: 30.4189s
  37. payload: 0.343323GB
  38. bandwidth: 12.1188 MBps
  39. SEQUENTIAL DELETES
  40. num_keys: 1048576
  41. time: 722.952s
  42. speed: 1450.41 Keys/s
  43. ```
  44.  
  45. ```
  46. build-opt/util/cassandra_store_stress --db_size=32212254720 --batch_size=30720
  47. -------------------------------------------------
  48. PERF TEST [1048576 keys, 30720 block size]
  49. SEQUENTIAL WRITE
  50. num_keys: 1048576
  51. time: 979.542s
  52. payload: 30 GB
  53. bandwidth: 32.885 MBps
  54. SEQUENTIAL READ KEY/VALUES ----------> (Ignore this batch read key/values: one of the pages of the bulk read timedout)
  55. key count: 1000
  56. time: 9.57564s
  57. payload: 0.0286102GB
  58. bandwidth: 3.20814 MBps
  59. TRUNCATE TABLE
  60. time: 11.9367s
  61. payload: 30GB
  62. bandwidth: 2698 MBps
  63. ```
  64.  
  65.  
  66. ```
  67. -------------------------------------------------
  68. PERF TEST [1048576 keys, 1024 block size]
  69. SEQUENTIAL WRITE
  70. num_keys: 1048576
  71. time: 515.004s
  72. payload: 1 GB
  73. bandwidth: 2.08492 MBps
  74. SEQUENTIAL READ KEY/VALUES
  75. key count: 1048576
  76. time: 16.4557s
  77. payload: 1GB
  78. bandwidth: 65.2504 MBps
  79. TRUNCATE TABLE
  80. time: 8.06971s
  81. payload: 1GB
  82. bandwidth: 133 MBps
  83. ```
  84. was not expected. num_rows per page fetch was
  85. ```
  86. -------------------------------------------------
  87. PERF TEST [16384 keys, 65536 block size]
  88. SEQUENTIAL WRITE
  89. num_keys: 16384
  90. time: 17.576s
  91. payload: 1 GB
  92. bandwidth: 61.0914 MBps
  93. SEQUENTIAL READ KEY/VALUES
  94. key count: 16384
  95. time: 8.47041s
  96. payload: 1GB
  97. bandwidth: 126.764 MBps
  98. TRUNCATE TABLE
  99. time: 6.04113s
  100. payload: 1GB
  101. bandwidth: 177 MBps
  102. ```
  103.  
  104.  
  105. ```
  106. build-opt/util/cassandra_store_stress --db_size=4294967296
  107. -------------------------------------------------
  108. PERF TEST [65536 keys, 65536 block size]
  109. SEQUENTIAL WRITE
  110. num_keys: 65536
  111. time: 85.7753s
  112. payload: 4 GB
  113. bandwidth: 50.0723 MBps
  114. SEQUENTIAL READ KEY/VALUES
  115. key count: 65536
  116. time: 97.595s
  117. payload: 4GB
  118. bandwidth: 44.0081 MBps
  119. TRUNCATE TABLE
  120. time: 5.90673s
  121. payload: 4GB
  122. bandwidth: 727 MBps
  123. ```
  124.  
  125. ```
  126. build-opt/util/cassandra_store_stress --db_size=4294967296 --batch_size=32768
  127. -------------------------------------------------
  128. PERF TEST [131072 keys, 32768 block size]
  129. SEQUENTIAL WRITE
  130. num_keys: 131072
  131. time: 117.035s
  132. payload: 4 GB
  133. bandwidth: 36.6982 MBps
  134. SEQUENTIAL READ KEY/VALUES
  135. key count: 131072
  136. time: 280.868s
  137. payload: 4GB
  138. bandwidth: 15.2918 MBps
  139. TRUNCATE TABLE
  140. time: 5.6176s
  141. payload: 4GB
  142. bandwidth: 764 MBps
  143. ```
  144.  
  145. ```
  146. build-opt/util/cassandra_store_stress --db_size=10737418240
  147. -------------------------------------------------
  148. PERF TEST [163840 keys, 65536 block size]
  149. SEQUENTIAL WRITE
  150. num_keys: 163840
  151. time: 231.645s
  152. payload: 10 GB
  153. bandwidth: 46.3529 MBps
  154. SEQUENTIAL READ KEY/VALUES
  155. key count: 163840
  156. time: 432.403s
  157. payload: 10GB
  158. bandwidth: 24.832 MBps
  159. TRUNCATE TABLE
  160. time: 3.26219s
  161. payload: 10GB
  162. bandwidth: 3291 MBps
  163. ```
  164.  
  165. ### Summary
  166. 1. These tests were done on a local dev workstation with one node cassandra cluster.
  167. 2. Bulk read seems to perform worse than even sequestial write when batch size is large. That was not expected? num_rows per page fetch was 500.
  168. 3. Truncate is independent of size of table. So indeed truncate is metadata change only.
Add Comment
Please, Sign In to add comment