API tools faq
paste
Advertisement
gmatht

Shingled: ext4 vs btrfs

gmatht
Aug 21st, 2015
1,238
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 16.74 KB | None | 0 0
raw download clone embed print report
  1. [[[[[ a_smartctl.txt ]]]]]
  2. smartctl 6.2 2013-07-26 r3841 [x86_64-linux-3.16.0-44-generic] (local build)
  3. Copyright (C) 2002-13, Bruce Allen, Christian Franke, www.smartmontools.org
  4.  
  5. === START OF INFORMATION SECTION ===
  6. Device Model: ST8000AS0002-1NA17Z
  7. Serial Number: Z8405ZWS
  8. LU WWN Device Id: 5 000c50 07b5c7b79
  9. Firmware Version: AR13
  10. User Capacity: 8,001,563,222,016 bytes [8.00 TB]
  11. Sector Sizes: 512 bytes logical, 4096 bytes physical
  12. Rotation Rate: 5980 rpm
  13. Device is: Not in smartctl database [for details use: -P showall]
  14. ATA Version is: ACS-2, ACS-3 T13/2161-D revision 3b
  15. SATA Version is: SATA 3.1, 6.0 Gb/s (current: 3.0 Gb/s)
  16. Local Time is: Tue Aug 25 08:11:04 2015 AWST
  17. SMART support is: Available - device has SMART capability.
  18. SMART support is: Enabled
  19.  
  20. === START OF READ SMART DATA SECTION ===
  21. SMART overall-health self-assessment test result: PASSED
  22.  
  23. General SMART Values:
  24. Offline data collection status: (0x82) Offline data collection activity
  25. was completed without error.
  26. Auto Offline Data Collection: Enabled.
  27. Self-test execution status: ( 0) The previous self-test routine completed
  28. without error or no self-test has ever
  29. been run.
  30. Total time to complete Offline
  31. data collection: ( 0) seconds.
  32. Offline data collection
  33. capabilities: (0x7b) SMART execute Offline immediate.
  34. Auto Offline data collection on/off support.
  35. Suspend Offline collection upon new
  36. command.
  37. Offline surface scan supported.
  38. Self-test supported.
  39. Conveyance Self-test supported.
  40. Selective Self-test supported.
  41. SMART capabilities: (0x0003) Saves SMART data before entering
  42. power-saving mode.
  43. Supports SMART auto save timer.
  44. Error logging capability: (0x01) Error logging supported.
  45. General Purpose Logging supported.
  46. Short self-test routine
  47. recommended polling time: ( 1) minutes.
  48. Extended self-test routine
  49. recommended polling time: ( 947) minutes.
  50. Conveyance self-test routine
  51. recommended polling time: ( 2) minutes.
  52. SCT capabilities: (0x30a5) SCT Status supported.
  53. SCT Data Table supported.
  54.  
  55. SMART Attributes Data Structure revision number: 10
  56. Vendor Specific SMART Attributes with Thresholds:
  57. ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE
  58. 1 Raw_Read_Error_Rate 0x000f 104 099 006 Pre-fail Always - 6946776
  59. 3 Spin_Up_Time 0x0003 092 092 000 Pre-fail Always - 0
  60. 4 Start_Stop_Count 0x0032 100 100 020 Old_age Always - 10
  61. 5 Reallocated_Sector_Ct 0x0033 100 100 010 Pre-fail Always - 0
  62. 7 Seek_Error_Rate 0x000f 075 060 030 Pre-fail Always - 4326115303
  63. 9 Power_On_Hours 0x0032 100 100 000 Old_age Always - 392
  64. 10 Spin_Retry_Count 0x0013 100 100 097 Pre-fail Always - 0
  65. 12 Power_Cycle_Count 0x0032 100 100 020 Old_age Always - 10
  66. 183 Runtime_Bad_Block 0x0032 100 100 000 Old_age Always - 0
  67. 184 End-to-End_Error 0x0032 100 100 099 Old_age Always - 0
  68. 187 Reported_Uncorrect 0x0032 100 100 000 Old_age Always - 0
  69. 188 Command_Timeout 0x0032 100 100 000 Old_age Always - 0
  70. 189 High_Fly_Writes 0x003a 100 100 000 Old_age Always - 0
  71. 190 Airflow_Temperature_Cel 0x0022 064 055 045 Old_age Always - 36 (Min/Max 34/45)
  72. 191 G-Sense_Error_Rate 0x0032 100 100 000 Old_age Always - 0
  73. 192 Power-Off_Retract_Count 0x0032 100 100 000 Old_age Always - 9
  74. 193 Load_Cycle_Count 0x0032 100 100 000 Old_age Always - 37
  75. 194 Temperature_Celsius 0x0022 036 045 000 Old_age Always - 36 (0 15 0 0 0)
  76. 195 Hardware_ECC_Recovered 0x001a 104 099 000 Old_age Always - 6946776
  77. 197 Current_Pending_Sector 0x0012 100 100 000 Old_age Always - 0
  78. 198 Offline_Uncorrectable 0x0010 100 100 000 Old_age Offline - 0
  79. 199 UDMA_CRC_Error_Count 0x003e 200 200 000 Old_age Always - 0
  80. 240 Head_Flying_Hours 0x0000 100 253 000 Old_age Offline - 199076029137041
  81. 241 Total_LBAs_Written 0x0000 100 253 000 Old_age Offline - 14881765408
  82. 242 Total_LBAs_Read 0x0000 100 253 000 Old_age Offline - 8998676683
  83.  
  84. SMART Error Log Version: 1
  85. No Errors Logged
  86.  
  87. SMART Self-test log structure revision number 1
  88. No self-tests have been logged. [To run self-tests, use: smartctl -t]
  89.  
  90.  
  91. SMART Selective self-test log data structure revision number 1
  92. SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS
  93. 1 0 0 Not_testing
  94. 2 0 0 Not_testing
  95. 3 0 0 Not_testing
  96. 4 0 0 Not_testing
  97. 5 0 0 Not_testing
  98. Selective self-test flags (0x0):
  99. After scanning selected spans, do NOT read-scan remainder of disk.
  100. If Selective self-test is pending on power-up, resume after 0 minute delay.
  101.  
  102.  
  103. [[[[[ my_fileserver.f ]]]]]
  104. load fileserver
  105. set $dir=/mnt/Benchmarks/
  106. set $meanfilesize=1310720
  107. #set $nfiles=<value> defaults to 10000
  108. set $nfiles=100000
  109. #set $nthreads=<value> defaults to 50
  110. #set $meanappendsize=<value> defaults to 16384
  111. #set $iosize=<size> defaults to 1048576
  112. #set $meandirwidth=<size> defaults to 20
  113. run 36000
  114.  
  115.  
  116. [[[[[ my_fileserver.fout.btrfs ]]]]]
  117. Filebench Version 1.4.9.1
  118. 5125: 0.000: Allocated 170MB of shared memory
  119. 5125: 0.018: File-server Version 3.0 personality successfully loaded
  120. 5125: 0.018: Creating/pre-allocating files and filesets
  121. 5125: 0.157: Fileset bigfileset: 100000 files, 0 leafdirs, avg dir width = 20, avg dir depth = 3.8, 125104.999MB
  122. 5125: 0.159: Removed any existing fileset bigfileset in 1 seconds
  123. 5125: 0.159: making tree for filset /mnt/Benchmarks//bigfileset
  124. 5125: 0.290: Creating fileset bigfileset...
  125. 5125: 549.170: Preallocated 80075 of 100000 of fileset bigfileset in 549 seconds
  126. 5125: 549.170: waiting for fileset pre-allocation to finish
  127. 5156: 549.175: Starting 1 filereader instances
  128. 5157: 549.234: Starting 50 filereaderthread threads
  129. 5125: 552.229: Running...
  130. 5125: 36555.945: Run took 36000 seconds...
  131. 5125: 36555.979: Per-Operation Breakdown
  132. statfile1 217101ops 6ops/s 0.0mb/s 1.7ms/op 339us/op-cpu [0ms - 8108ms]
  133. deletefile1 217101ops 6ops/s 0.0mb/s 177.8ms/op 1769us/op-cpu [0ms - 60990ms]
  134. closefile3 217101ops 6ops/s 0.0mb/s 0.0ms/op 59us/op-cpu [0ms - 29ms]
  135. readfile1 217101ops 6ops/s 8.7mb/s 3214.5ms/op 82283us/op-cpu [0ms - 67162ms]
  136. openfile2 217114ops 6ops/s 0.0mb/s 179.4ms/op 1347us/op-cpu [0ms - 60836ms]
  137. closefile2 217114ops 6ops/s 0.0mb/s 0.0ms/op 69us/op-cpu [0ms - 147ms]
  138. appendfilerand1 217114ops 6ops/s 0.0mb/s 1742.7ms/op 46742us/op-cpu [0ms - 26869ms]
  139. openfile1 217123ops 6ops/s 0.0mb/s 399.4ms/op 2371us/op-cpu [0ms - 59893ms]
  140. closefile1 217123ops 6ops/s 0.0mb/s 0.1ms/op 194us/op-cpu [0ms - 207ms]
  141. wrtfile1 217123ops 6ops/s 9.3mb/s 2541.0ms/op 94322us/op-cpu [0ms - 52414ms]
  142. createfile1 217151ops 6ops/s 0.0mb/s 4.0ms/op 422us/op-cpu [0ms - 19395ms]
  143. 5125: 36555.979: IO Summary: 2388266 ops, 66.334 ops/s, (6/12 r/w), 18.0mb/s, 3027us cpu/op, 2753.5ms latency
  144. 5125: 36555.979: Shutting down processes
  145.  
  146. [[[[[ my_fileserver.fout.ext4 ]]]]]
  147. Filebench Version 1.4.9.1
  148. 8943: 0.000: Allocated 170MB of shared memory
  149. 8943: 0.002: File-server Version 3.0 personality successfully loaded
  150. 8943: 0.002: Creating/pre-allocating files and filesets
  151. 8943: 0.141: Fileset bigfileset: 100000 files, 0 leafdirs, avg dir width = 20, avg dir depth = 3.8, 125104.999MB
  152. 8943: 1.505: Removed any existing fileset bigfileset in 2 seconds
  153. 8943: 1.505: making tree for filset /mnt/Benchmarks//bigfileset
  154. 8943: 1.661: Creating fileset bigfileset...
  155. 8943: 1532.233: Preallocated 80075 of 100000 of fileset bigfileset in 1531 seconds
  156. 8943: 1532.233: waiting for fileset pre-allocation to finish
  157. 9066: 1532.243: Starting 1 filereader instances
  158. 9067: 1532.281: Starting 50 filereaderthread threads
  159. 8943: 1533.329: Running...
  160. 8943: 37536.514: Run took 36000 seconds...
  161. 8943: 37536.531: Per-Operation Breakdown
  162. statfile1 160028ops 4ops/s 0.0mb/s 58.0ms/op 2568us/op-cpu [0ms - 15516ms]
  163. deletefile1 160028ops 4ops/s 0.0mb/s 1123.4ms/op 19994us/op-cpu [0ms - 24367ms]
  164. closefile3 160028ops 4ops/s 0.0mb/s 0.0ms/op 113us/op-cpu [0ms - 73ms]
  165. readfile1 160028ops 4ops/s 6.3mb/s 5819.9ms/op 117041us/op-cpu [0ms - 58675ms]
  166. openfile2 160050ops 4ops/s 0.0mb/s 179.0ms/op 3599us/op-cpu [0ms - 19527ms]
  167. closefile2 160050ops 4ops/s 0.0mb/s 0.0ms/op 254us/op-cpu [0ms - 113ms]
  168. appendfilerand1 160050ops 4ops/s 0.0mb/s 2002.9ms/op 32829us/op-cpu [0ms - 26387ms]
  169. openfile1 160055ops 4ops/s 0.0mb/s 80.6ms/op 2795us/op-cpu [0ms - 17497ms]
  170. closefile1 160055ops 4ops/s 0.0mb/s 0.1ms/op 1243us/op-cpu [0ms - 100ms]
  171. wrtfile1 160055ops 4ops/s 6.8mb/s 1836.6ms/op 63058us/op-cpu [0ms - 50959ms]
  172. createfile1 160078ops 4ops/s 0.0mb/s 121.4ms/op 5618us/op-cpu [0ms - 19876ms]
  173. 8943: 37536.531: IO Summary: 1760505 ops, 48.899 ops/s, (4/9 r/w), 13.2mb/s, 1888us cpu/op, 3740.5ms latency
  174. 8943: 37536.531: Shutting down processes
  175.  
  176. [[[[[ my_fileserver.fout.nilfs ]]]]]
  177. Filebench Version 1.4.9.1
  178. 5141: 0.000: Allocated 170MB of shared memory
  179. 5141: 0.001: File-server Version 3.0 personality successfully loaded
  180. 5141: 0.001: Creating/pre-allocating files and filesets
  181. 5141: 0.134: Fileset bigfileset: 100000 files, 0 leafdirs, avg dir width = 20, avg dir depth = 3.8, 125104.999MB
  182. 5141: 0.306: Removed any existing fileset bigfileset in 1 seconds
  183. 5141: 0.306: making tree for filset /mnt/Benchmarks//bigfileset
  184. 5141: 0.614: Creating fileset bigfileset...
  185. 5141: 1037.479: Preallocated 80075 of 100000 of fileset bigfileset in 1037 seconds
  186. 5141: 1037.479: waiting for fileset pre-allocation to finish
  187. 5191: 1037.492: Starting 1 filereader instances
  188. 5192: 1037.531: Starting 50 filereaderthread threads
  189. 5141: 1038.549: Running...
  190. 5141: 37041.817: Run took 36000 seconds...
  191. 5141: 37041.860: Per-Operation Breakdown
  192. statfile1 292163ops 8ops/s 0.0mb/s 102.2ms/op 14573us/op-cpu [0ms - 4668ms]
  193. deletefile1 292161ops 8ops/s 0.0mb/s 1453.6ms/op 100730us/op-cpu [0ms - 8356ms]
  194. closefile3 292169ops 8ops/s 0.0mb/s 0.0ms/op 76us/op-cpu [0ms - 10ms]
  195. readfile1 292170ops 8ops/s 11.9mb/s 988.2ms/op 47955us/op-cpu [0ms - 9368ms]
  196. openfile2 292175ops 8ops/s 0.0mb/s 145.8ms/op 12308us/op-cpu [0ms - 4007ms]
  197. closefile2 292175ops 8ops/s 0.0mb/s 0.0ms/op 2611us/op-cpu [0ms - 16ms]
  198. appendfilerand1 292176ops 8ops/s 0.1mb/s 1575.7ms/op 95884us/op-cpu [0ms - 7169ms]
  199. openfile1 292197ops 8ops/s 0.0mb/s 139.4ms/op 8328us/op-cpu [0ms - 4743ms]
  200. closefile1 292197ops 8ops/s 0.0mb/s 0.0ms/op 2312us/op-cpu [0ms - 16ms]
  201. wrtfile1 292197ops 8ops/s 12.5mb/s 1063.9ms/op 79805us/op-cpu [0ms - 13063ms]
  202. createfile1 292209ops 8ops/s 0.0mb/s 656.2ms/op 37793us/op-cpu [0ms - 5576ms]
  203. 5141: 37041.860: IO Summary: 3213989 ops, 89.269 ops/s, (8/16 r/w), 24.4mb/s, 4099us cpu/op, 2041.6ms latency
  204. 5141: 37041.860: Shutting down processes
  205.  
  206. [[[[[ z.sh ]]]]]
  207. for f in `ls | sort` `ls */attic_stats.txt | sort` `ls */attic_time1` `*/attic_time2`
  208. do
  209. [ -d $f ] || (
  210. echo
  211. echo [[[[[ $f ]]]]]
  212. cat $f
  213. )
  214. done | tee ~/all_benchmarks.txt
  215.  
  216. [[[[[ btrfs/attic_stats.txt ]]]]]
  217. ------------------------------------------------------------------------------
  218. Archive name: 1
  219. Archive fingerprint: 654f4911d4d53525a04481c6f7d431b3bb3fd70e608db4f743af6f7e9709e882
  220. Start time: Wed Aug 19 12:44:15 2015
  221. End time: Thu Aug 20 13:24:24 2015
  222. Duration: 1 days 40 minutes 8.93 seconds
  223. Number of files: 1
  224.  
  225. Original size Compressed size Deduplicated size
  226. This archive: 1.00 TB 639.69 GB 515.84 GB
  227. All archives: 901.92 GB 639.69 GB 515.84 GB
  228. ------------------------------------------------------------------------------
  229. ------------------------------------------------------------------------------
  230. Archive name: 2
  231. Archive fingerprint: 7fae44bdacfd08487b5a3f79194d383f16d2980873d905665aacffb25e8df259
  232. Start time: Thu Aug 20 13:24:25 2015
  233. End time: Thu Aug 20 17:52:52 2015
  234. Duration: 4 hours 28 minutes 27.05 seconds
  235. Number of files: 1
  236.  
  237. Original size Compressed size Deduplicated size
  238. This archive: 1.00 TB 639.69 GB 241.79 kB
  239. All archives: 1.80 TB 1.28 TB 515.84 GB
  240. ------------------------------------------------------------------------------
  241.  
  242. [[[[[ ext4/attic_stats.txt ]]]]]
  243. ------------------------------------------------------------------------------
  244. Archive name: 1
  245. Archive fingerprint: a1461dd53499f5f67f148b4e344666cb2341df7084d77dae14f88acb53024e3b
  246. Start time: Thu Aug 20 20:59:45 2015
  247. End time: Fri Aug 21 22:19:40 2015
  248. Duration: 1 days 1 hours 19 minutes 54.69 seconds
  249. Number of files: 1
  250.  
  251. Original size Compressed size Deduplicated size
  252. This archive: 1.00 TB 639.69 GB 515.84 GB
  253. All archives: 901.92 GB 639.69 GB 515.84 GB
  254. ------------------------------------------------------------------------------
  255. ------------------------------------------------------------------------------
  256. Archive name: 2
  257. Archive fingerprint: f1ac5de935c1b8f55b1cd4022fd4dde86f22e6041428e9b309d1c78ecb80b52d
  258. Start time: Fri Aug 21 22:19:42 2015
  259. End time: Sat Aug 22 02:48:25 2015
  260. Duration: 4 hours 28 minutes 43.45 seconds
  261. Number of files: 1
  262.  
  263. Original size Compressed size Deduplicated size
  264. This archive: 1.00 TB 639.69 GB 241.79 kB
  265. All archives: 1.80 TB 1.28 TB 515.84 GB
  266. ------------------------------------------------------------------------------
  267.  
  268. [[[[[ nilfs/attic_stats.txt ]]]]]
  269. ------------------------------------------------------------------------------
  270. Archive name: 1
  271. Archive fingerprint: 268d6bca039309e757ca1483253572286c6e2fab4582f95681c3d5fbf781a3d4
  272. Start time: Mon Aug 24 00:49:37 2015
  273. End time: Mon Aug 24 23:02:04 2015
  274. Duration: 22 hours 12 minutes 26.89 seconds
  275. Number of files: 1
  276.  
  277. Original size Compressed size Deduplicated size
  278. This archive: 1.00 TB 639.69 GB 515.84 GB
  279. All archives: 901.92 GB 639.69 GB 515.84 GB
  280. ------------------------------------------------------------------------------
  281. ------------------------------------------------------------------------------
  282. Archive name: 2
  283. Archive fingerprint: 445a2759c95666cda82e969dbda55c10098de9e3a97f42d14033be01f6d073bc
  284. Start time: Mon Aug 24 23:02:05 2015
  285. End time: Tue Aug 25 03:32:00 2015
  286. Duration: 4 hours 29 minutes 54.88 seconds
  287. Number of files: 1
  288.  
  289. Original size Compressed size Deduplicated size
  290. This archive: 1.00 TB 639.69 GB 9.39 MB
  291. All archives: 1.80 TB 1.28 TB 515.85 GB
  292. ------------------------------------------------------------------------------
  293.  
  294. [[[[[ btrfs/attic_time1 ]]]]]
  295. 40748.40user 2542.92system 24:40:10elapsed 48%CPU (0avgtext+0avgdata 4947084maxresident)k
  296. 1517258032inputs+1102664376outputs (70769major+2840061minor)pagefaults 0swaps
  297.  
  298. [[[[[ ext4/attic_time1 ]]]]]
  299. 41476.57user 1975.37system 25:19:55elapsed 47%CPU (0avgtext+0avgdata 4965488maxresident)k
  300. 1517265808inputs+1015560576outputs (64555major+2806698minor)pagefaults 0swaps
  301.  
  302. [[[[[ nilfs/attic_time1 ]]]]]
  303. 40692.35user 2031.46system 22:12:28elapsed 53%CPU (0avgtext+0avgdata 4861432maxresident)k
  304. 1517946064inputs+1036399704outputs (82056major+2870569minor)pagefaults 0swaps
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!