API tools faq
paste
Advertisement
Guest User

spinlock contention patches v3

a guest
Dec 10th, 2019
206
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 13.70 KB | None | 0 0
raw download clone embed print report
  1. Before
  2.  
  3. root@(none)$ fdisk -l | grep Disk | grep bytes
  4. Disk /dev/sdb: 3.7 TiB, 4000787030016 bytes, 7814037168 sectors
  5. Disk /dev/sdd: 279.5 GiB, 300069052416 bytes, 586072368 sectors
  6. Disk /dev/sda: 186.3 GiB, 200049647616 bytes, 390721968 sectors
  7. Disk /dev/sdc: 186.3 GiB, 200049647616 bytes, 390721968 sectors
  8. Disk /dev/sde: 186.3 GiB, 200049647616 bytes, 390721968 sectors
  9. Disk /dev/sdf: 186.3 GiB, 200049647616 bytes, 390721968 sectors
  10. Disk /dev/sdg: 186.3 GiB, 200049647616 bytes, 390721968 sectors
  11. Disk /dev/sdh: 186.3 GiB, 200049647616 bytes, 390721968 sectors
  12. root@(none)$ ./create_fio_task_cpu_liuyifan.sh 4k read 2048 1
  13. Creat 4k_read_depth2048_fiotest file sucessfully
  14. cp: can't create '/lib64/libaio.so.1': No such file or directory
  15. cp: can't create '/lib64/libaio.so.1.0.0': No such file or directory
  16. cp: can't create '/lib64/libaio.so.1.0.1': No such file or directory
  17. job1: (g=0): rw=read, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=2048
  18. job1: (g=0): rw=read, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=2048
  19. job1: (g=0): rw=read, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=2048
  20. job1: (g=0): rw=read, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=2048
  21. job1: (g=0): rw=read, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=2048
  22. job1: (g=0): rw=read, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=2048
  23. fio-2.1.2
  24. Starting 6 processes
  25. [ 48.941329] random: crng init done
  26. Jobs: 6 (f=6): [RRRRRR] [100.0% done] [3563MB/0KB/0KB /s] [912K/0/0 iops] [eta 00m:00s]
  27. job1: (groupid=0, jobs=6): err= 0: pid=598: Tue Dec 10 14:38:07 2019
  28. read : io=1041.5GB, bw=3553.2MB/s, iops=909612, runt=300022msec
  29. slat (usec): min=2, max=92169, avg= 3.86, stdev=19.47
  30. clat (msec): min=1, max=306, avg=13.49, stdev= 1.27
  31. lat (msec): min=1, max=306, avg=13.50, stdev= 1.27
  32. clat percentiles (usec):
  33. | 1.00th=[12480], 5.00th=[12736], 10.00th=[12864], 20.00th=[12992],
  34. | 30.00th=[13120], 40.00th=[13248], 50.00th=[13376], 60.00th=[13504],
  35. | 70.00th=[13632], 80.00th=[13760], 90.00th=[14016], 95.00th=[14400],
  36. | 99.00th=[18048], 99.50th=[20096], 99.90th=[23680], 99.95th=[24960],
  37. | 99.99th=[29056]
  38. bw (KB /s): min=225080, max=629392, per=16.67%, avg=606439.21, stdev=18049.55
  39. lat (msec) : 2=0.01%, 4=0.01%, 10=0.01%, 20=99.49%, 50=0.50%
  40. lat (msec) : 100=0.01%, 250=0.01%, 500=0.01%
  41. cpu : usr=30.67%, sys=68.70%, ctx=12116, majf=0, minf=3546
  42. IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
  43. submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  44. complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1%
  45. issued : total=r=272903734/w=0/d=0, short=r=0/w=0/d=0
  46.  
  47. Run status group 0 (all jobs):
  48. READ: io=1041.5GB, aggrb=3553.2MB/s, minb=3553.2MB/s, maxb=3553.2MB/s, mint=300022msec, maxt=300022msec
  49.  
  50. Disk stats (read/write):
  51. sda: ios=4438368/0, merge=40197581/0, ticks=20002001/0, in_queue=11031628, util=100.00%
  52. sdc: ios=3792211/0, merge=41158786/0, ticks=20661012/0, in_queue=13035536, util=100.00%
  53. sde: ios=3764137/0, merge=41208411/0, ticks=20670718/0, in_queue=13111596, util=100.00%
  54. sdf: ios=3978252/0, merge=41423479/0, ticks=20576155/0, in_queue=12480332, util=100.00%
  55. sdg: ios=4389289/0, merge=42013159/0, ticks=20149193/0, in_queue=11328040, util=100.00%
  56. sdh: ios=4337743/0, merge=42123631/0, ticks=20201717/0, in_queue=11469312, util=100.00%
  57. root@(none)$ ./create_fio_task_cpu_liuyifan.sh 4k read 2048 1
  58. Creat 4k_read_depth2048_fiotest file sucessfully
  59. cp: can't create '/lib64/libaio.so.1': No such file or directory
  60. cp: can't create '/lib64/libaio.so.1.0.0': No such file or directory
  61. cp: can't create '/lib64/libaio.so.1.0.1': No such file or directory
  62. job1: (g=0): rw=read, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=2048
  63. job1: (g=0): rw=read, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=2048
  64. job1: (g=0): rw=read, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=2048
  65. job1: (g=0): rw=read, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=2048
  66. job1: (g=0): rw=read, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=2048
  67. job1: (g=0): rw=read, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=2048
  68. fio-2.1.2
  69. Starting 6 processes
  70. Jobs: 6 (f=6): [RRRRRR] [100.0% done] [3584MB/0KB/0KB /s] [918K/0/0 iops] [eta 00m:00s]
  71. job1: (groupid=0, jobs=6): err= 0: pid=619: Tue Dec 10 14:43:48 2019
  72. read : io=1049.2GB, bw=3580.1MB/s, iops=916720, runt=300020msec
  73. slat (usec): min=2, max=131173, avg= 3.82, stdev=20.07
  74. clat (usec): min=67, max=355157, avg=13389.15, stdev=1349.92
  75. lat (usec): min=74, max=355236, avg=13393.43, stdev=1350.57
  76. clat percentiles (usec):
  77. | 1.00th=[12352], 5.00th=[12608], 10.00th=[12736], 20.00th=[12864],
  78. | 30.00th=[12992], 40.00th=[13120], 50.00th=[13248], 60.00th=[13376],
  79. | 70.00th=[13504], 80.00th=[13632], 90.00th=[13888], 95.00th=[14272],
  80. | 99.00th=[18304], 99.50th=[20096], 99.90th=[23936], 99.95th=[25728],
  81. | 99.99th=[38144]
  82. bw (KB /s): min=98936, max=633608, per=16.67%, avg=611171.75, stdev=22254.30
  83. lat (usec) : 100=0.01%, 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
  84. lat (msec) : 2=0.01%, 4=0.01%, 10=0.01%, 20=99.48%, 50=0.50%
  85. lat (msec) : 100=0.01%, 250=0.01%, 500=0.01%
  86. cpu : usr=30.68%, sys=68.47%, ctx=14319, majf=0, minf=3635
  87. IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
  88. submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  89. complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1%
  90. issued : total=r=275034546/w=0/d=0, short=r=0/w=0/d=0
  91.  
  92. Run status group 0 (all jobs):
  93. READ: io=1049.2GB, aggrb=3580.1MB/s, minb=3580.1MB/s, maxb=3580.1MB/s, mint=300020msec, maxt=300020msec
  94.  
  95. Disk stats (read/write):
  96. sda: ios=4146107/0, merge=41048885/0, ticks=20291027/0, in_queue=12015024, util=100.00%
  97. sdc: ios=3583936/0, merge=41549056/0, ticks=20879168/0, in_queue=13789552, util=100.00%
  98. sde: ios=3540114/0, merge=42740909/0, ticks=20976253/0, in_queue=13996832, util=100.00%
  99. sdf: ios=3732807/0, merge=42512263/0, ticks=20894046/0, in_queue=13496012, util=100.00%
  100. sdg: ios=4229105/0, merge=41054854/0, ticks=20184583/0, in_queue=11768796, util=100.00%
  101. sdh: ios=4005561/0, merge=42881431/0, ticks=20498673/0, in_queue=12455264, util=100.00%
  102.  
  103. root@(none)$ dmesg | grep Linux
  104. [ 0.000000] Booting Linux on physical CPU 0x0000010000 [0x410fd082]
  105. [ 0.000000] Linux version 5.5.0-rc1 (john@john-ThinkCentre-M93p) (gcc version 7.3.1 20180425 [linaro-7.3-2018.05-rc1 revision 38aec9a676236eaa42ca03ccb3a6c1dd0182c29f] (Linaro GCC 7.3-2018.05-rc1)) #737 SMP PREEMPT Tue Dec 10 14:25:06 GMT 2019
  106. [ 4.469452] ACPI: Added _OSI(Linux-Dell-Video)
  107. [ 4.473913] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio)
  108. [ 4.479247] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics)
  109. [ 6.579115] pps_core: LinuxPPS API ver. 1 registered
  110. [ 6.608966] Advanced Linux Sound Architecture Driver Initialized.
  111.  
  112.  
  113.  
  114. After
  115.  
  116.  
  117. root@(none)$ fdisk -l | grep Disk | grep bytes
  118. Disk /dev/sdb: 3.7 TiB, 4000787030016 bytes, 7814037168 sectors
  119. Disk /dev/sdd: 279.5 GiB, 300069052416 bytes, 586072368 sectors
  120. Disk /dev/sda: 186.3 GiB, 200049647616 bytes, 390721968 sectors
  121. Disk /dev/sdc: 186.3 GiB, 200049647616 bytes, 390721968 sectors
  122. Disk /dev/sde: 186.3 GiB, 200049647616 bytes, 390721968 sectors
  123. Disk /dev/sdf: 186.3 GiB, 200049647616 bytes, 390721968 sectors
  124. Disk /dev/sdg: 186.3 GiB, 200049647616 bytes, 390721968 sectors
  125. Disk /dev/sdh: 186.3 GiB, 200049647616 bytes, 390721968 sectors
  126. root@(none)$ ./create_fio_task_cpu_liuyifan.sh 4k read 2048 1
  127. Creat 4k_read_depth2048_fiotest file sucessfully
  128. cp: can't create '/lib64/libaio.so.1': No such file or directory
  129. cp: can't create '/lib64/libaio.so.1.0.0': No such file or directory
  130. cp: can't create '/lib64/libaio.so.1.0.1': No such file or directory
  131. job1: (g=0): rw=read, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=2048
  132. job1: (g=0): rw=read, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=2048
  133. job1: (g=0): rw=read, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=2048
  134. job1: (g=0): rw=read, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=2048
  135. job1: (g=0): rw=read, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=2048
  136. job1: (g=0): rw=read, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=2048
  137. fio-2.1.2
  138. Starting 6 processes
  139. Jobs: 6 (f=6): [RRRRRR] [100.0% done] [3601MB/0KB/0KB /s] [922K/0/0 iops] [eta 00m:00s]
  140. job1: (groupid=0, jobs=6): err= 0: pid=630: Tue Dec 10 14:22:51 2019
  141. read : io=1050.4GB, bw=3585.8MB/s, iops=917777, runt=300012msec
  142. slat (usec): min=2, max=76234, avg= 3.82, stdev=21.36
  143. clat (msec): min=1, max=313, avg=13.37, stdev= 1.40
  144. lat (msec): min=1, max=314, avg=13.38, stdev= 1.40
  145. clat percentiles (usec):
  146. | 1.00th=[12352], 5.00th=[12608], 10.00th=[12736], 20.00th=[12864],
  147. | 30.00th=[12992], 40.00th=[13120], 50.00th=[13248], 60.00th=[13376],
  148. | 70.00th=[13504], 80.00th=[13632], 90.00th=[13888], 95.00th=[14144],
  149. | 99.00th=[18048], 99.50th=[19840], 99.90th=[23680], 99.95th=[24960],
  150. | 99.99th=[29056]
  151. bw (KB /s): min=224920, max=634624, per=16.67%, avg=611861.02, stdev=17563.26
  152. lat (msec) : 2=0.01%, 4=0.01%, 10=0.01%, 20=99.53%, 50=0.46%
  153. lat (msec) : 100=0.01%, 250=0.01%, 500=0.01%
  154. cpu : usr=30.53%, sys=68.70%, ctx=15349, majf=0, minf=3539
  155. IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
  156. submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  157. complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1%
  158. issued : total=r=275344390/w=0/d=0, short=r=0/w=0/d=0
  159.  
  160. Run status group 0 (all jobs):
  161. READ: io=1050.4GB, aggrb=3585.8MB/s, minb=3585.8MB/s, maxb=3585.8MB/s, mint=300012msec, maxt=300012msec
  162.  
  163. Disk stats (read/write):
  164. sda: ios=4010988/0, merge=42336405/0, ticks=20482467/0, in_queue=12457284, util=100.00%
  165. sdc: ios=3554955/0, merge=42642712/0, ticks=20965331/0, in_queue=13948348, util=100.00%
  166. sde: ios=3523186/0, merge=42920566/0, ticks=21002045/0, in_queue=14054104, util=100.00%
  167. sdf: ios=3778581/0, merge=41652854/0, ticks=20797310/0, in_queue=13262296, util=100.00%
  168. sdg: ios=4248041/0, merge=41084147/0, ticks=20176185/0, in_queue=11696856, util=100.00%
  169. sdh: ios=4182179/0, merge=41342289/0, ticks=20255998/0, in_queue=11905736, util=100.00%
  170. root@(none)$ ./create_fio_task_cpu_liuyifan.sh 4k read 2048 1
  171. Creat 4k_read_depth2048_fiotest file sucessfully
  172. cp: can't create '/lib64/libaio.so.1': No such file or directory
  173. cp: can't create '/lib64/libaio.so.1.0.0': No such file or directory
  174. cp: can't create '/lib64/libaio.so.1.0.1': No such file or directory
  175. job1: (g=0): rw=read, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=2048
  176. job1: (g=0): rw=read, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=2048
  177. job1: (g=0): rw=read, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=2048
  178. job1: (g=0): rw=read, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=2048
  179. job1: (g=0): rw=read, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=2048
  180. job1: (g=0): rw=read, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=2048
  181. fio-2.1.2
  182. Starting 6 processes
  183. Jobs: 6 (f=6): [RRRRRR] [100.0% done] [3651MB/0KB/0KB /s] [935K/0/0 iops] [eta 00m:00s]
  184. job1: (groupid=0, jobs=6): err= 0: pid=649: Tue Dec 10 14:28:24 2019
  185. read : io=1063.6GB, bw=3629.2MB/s, iops=929278, runt=300020msec
  186. slat (usec): min=2, max=87466, avg= 3.75, stdev=21.61
  187. clat (msec): min=1, max=315, avg=13.21, stdev= 1.33
  188. lat (msec): min=1, max=316, avg=13.21, stdev= 1.33
  189. clat percentiles (usec):
  190. | 1.00th=[12224], 5.00th=[12480], 10.00th=[12608], 20.00th=[12736],
  191. | 30.00th=[12864], 40.00th=[12992], 50.00th=[13120], 60.00th=[13120],
  192. | 70.00th=[13248], 80.00th=[13376], 90.00th=[13632], 95.00th=[14016],
  193. | 99.00th=[18304], 99.50th=[19840], 99.90th=[23680], 99.95th=[24960],
  194. | 99.99th=[29056]
  195. bw (KB /s): min=217088, max=641320, per=16.67%, avg=619535.65, stdev=18134.85
  196. lat (msec) : 2=0.01%, 4=0.01%, 10=0.01%, 20=99.52%, 50=0.46%
  197. lat (msec) : 100=0.01%, 250=0.01%, 500=0.01%
  198. cpu : usr=31.08%, sys=68.02%, ctx=17692, majf=0, minf=3545
  199. IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
  200. submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  201. complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1%
  202. issued : total=r=278802143/w=0/d=0, short=r=0/w=0/d=0
  203.  
  204. Run status group 0 (all jobs):
  205. READ: io=1063.6GB, aggrb=3629.2MB/s, minb=3629.2MB/s, maxb=3629.2MB/s, mint=300020msec, maxt=300020msec
  206.  
  207. Disk stats (read/write):
  208. sda: ios=3903766/0, merge=42175122/0, ticks=20558629/0, in_queue=12732012, util=100.00%
  209. sdc: ios=3452491/0, merge=42665318/0, ticks=21057009/0, in_queue=14247440, util=100.00%
  210. sde: ios=3447729/0, merge=42393466/0, ticks=21053822/0, in_queue=14248080, util=100.00%
  211. sdf: ios=3557325/0, merge=43513667/0, ticks=21121124/0, in_queue=14143988, util=100.00%
  212. sdg: ios=3845282/0, merge=43479108/0, ticks=20680310/0, in_queue=12972796, util=100.00%
  213. sdh: ios=3939295/0, merge=42368213/0, ticks=20506520/0, in_queue=12591372, util=100.00%
  214.  
  215. root@(none)$ dmesg | grep Linux
  216. [ 0.000000] Booting Linux on physical CPU 0x0000010000 [0x410fd082]
  217. [ 0.000000] Linux version 5.5.0-rc1-00003-gbac559d649d7 (john@john-ThinkCentre-M93p) (gcc version 7.3.1 20180425 [linaro-7.3-2018.05-rc1 revision 38aec9a676236eaa42ca03ccb3a6c1dd0182c29f] (Linaro GCC 7.3-2018.05-rc1)) #736 SMP PREEMPT Tue Dec 10 14:11:05 GMT 2019
  218. [ 4.469351] ACPI: Added _OSI(Linux-Dell-Video)
  219. [ 4.473813] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio)
  220. [ 4.479146] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics)
  221. [ 6.588439] pps_core: LinuxPPS API ver. 1 registered
  222. [ 6.618406] Advanced Linux Sound Architecture Driver Initialized.
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!