API tools faq
paste
Advertisement
telbizov

bad-locks

telbizov
Sep 20th, 2014
254
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 283.55 KB | None | 0 0
raw download clone embed print report
  1. debug.lock.prof.stats:
  2. max wait_max total wait_total count avg wait_avg cnt_hold cnt_lock name
  3. 30859 0 34031 0 19059 1 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dbuf.c:130 (sx:h->hash_mutexes[i])
  4. 105079 0 105442 0 265 397 0 0 0 /usr/src/sys/netinet6/in6.c:2669 (rw:lle)
  5. 0 0 25 0 170 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dmu_zfetch.c:752 (sx:zf->zf_rwlock)
  6. 0 69 90 69 1062 0 0 0 1 /usr/src/sys/vm/vm_object.c:642 (rw:vm object)
  7. 428 188 14122 188 101 139 1 0 2 /usr/src/sys/dev/ixgbe/ixgbe.c:1420 (sleep mutex:ix0:tx(11))
  8. 472 0 20675 0 91 227 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:1420 (sleep mutex:ix1:tx(11))
  9. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_data_buf_2560)
  10. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_data_buf_118784)
  11. 1 0 168 0 809 0 0 0 0 /usr/src/sys/kern/tty_outq.c:244 (sleep mutex:ttymtx)
  12. 0 0 10 0 86 0 0 0 0 /usr/src/sys/kern/kern_descrip.c:1872 (sleep mutex:fdesc)
  13. 0 0 115 0 1292 0 0 0 0 /usr/src/sys/vm/swap_pager.c:226 (sleep mutex:ui_vmsize)
  14. 401766 191987 1857397 194162 179 10376 1084 0 2 /usr/src/sys/kern/kern_sysctl.c:1601 (sx:sysctl mem)
  15. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:16)
  16. 1 0 34 0 87 0 0 0 0 /usr/src/sys/kern/kern_ktrace.c:576 (sleep mutex:process lock)
  17. 0 0 49 0 662 0 0 0 0 /usr/src/sys/kern/kern_jail.c:2522 (sleep mutex:jail mutex)
  18. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:UMA Hash)
  19. 0 0 42 0 425 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dbuf.c:204 (sx:h->hash_mutexes[i])
  20. 5798 0 7059 0 4301 1 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c:1610 (sx:buf->b_evict_lock)
  21. 3 0 6369 0 30478 0 0 0 0 /usr/src/sys/vm/uma_core.c:2215 (sleep mutex:mbuf_jumbo_9k)
  22. 0 1 3 5 11 0 0 0 10 /usr/src/sys/vm/uma_core.c:2217 (sleep mutex:mbuf_jumbo_9k)
  23. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_buf_61440)
  24. 0 0 112 0 1199 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dnode.c:1268 (sx:os->os_lock)
  25. 3 0 77 0 551 0 0 0 0 /usr/src/sys/cam/cam_xpt.c:4456 (sleep mutex:CAM doneq)
  26. 3 0 102 0 64 1 0 0 0 /usr/src/sys/vm/vm_map.c:3425 (sx:vm map (user))
  27. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:NAMEI)
  28. 7242 0 7423 0 2758 2 0 0 1 /usr/src/sys/vm/swap_pager.c:307 (sleep mutex:ui_vmsize)
  29. 0 0 31 0 116 0 0 0 0 /usr/src/sys/vm/vm_map.c:3940 (sleep mutex:vm map (system))
  30. 1 0 95 0 551 0 0 0 0 /usr/src/sys/cam/cam_xpt.c:5201 (sleep mutex:CAM queue lock)
  31. 2 0 92 0 64 1 0 0 0 /usr/src/sys/kern/kern_exec.c:874 (lockmgr:zfs)
  32. 21055 0 47314 0 5541 8 0 0 0 /usr/src/sys/vm/vm_object.c:2264 (sleep mutex:vm page)
  33. 5 1 1380 18 18191 0 0 0 27 /usr/src/sys/vm/vm_page.c:2045 (sleep mutex:vm active pagequeue)
  34. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_data_buf_3072)
  35. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_data_buf_122880)
  36. 0 0 59 0 662 0 0 0 0 /usr/src/sys/kern/kern_jail.c:2621 (sleep mutex:jail mutex)
  37. 11005 0 19149 0 812 23 0 0 0 /usr/src/sys/cam/ata/ata_da.c:722 (sleep mutex:CAM device lock)
  38. 0 0 11 0 87 0 0 0 0 /usr/src/sys/kern/kern_jail.c:2630 (sleep mutex:jail mutex)
  39. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:12 Bucket)
  40. 29400 0 46533 0 92 505 0 0 0 /usr/src/sys/netinet/tcp_timer.c:191 (rw:tcpinp)
  41. 0 0 24 0 86 0 0 0 0 /usr/src/sys/kern/kern_jail.c:2641 (sleep mutex:jail mutex)
  42. 0 0 7 0 48 0 0 0 0 /usr/src/sys/vm/uma_core.c:2215 (sleep mutex:4096)
  43. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:Files)
  44. 13 18884 1478 18903 18358 0 1 0 29 /usr/src/sys/vm/vm_page.c:2086 (sleep mutex:vm active pagequeue)
  45. 24350 0 35810 0 20208 1 0 0 1 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dbuf.c:2062 (sx:db->db_mtx)
  46. 1 0 35 0 86 0 0 0 0 /usr/src/sys/netinet6/nd6.c:2230 (rw:if_afdata)
  47. 0 0 11 0 86 0 0 0 0 /usr/src/sys/kern/kern_descrip.c:2059 (sleep mutex:fdesc)
  48. 8 0 6295 0 28426 0 0 0 2 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_acl.c:2126 (sx:zp->z_acl_lock)
  49. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_buf_65536)
  50. 11 0 1184 0 13031 0 0 0 0 /usr/src/sys/vm/vm_page.c:1272 (sleep mutex:vm page)
  51. 0 0 2 0 9 0 0 0 0 /usr/src/sys/vm/uma_core.c:2725 (sleep mutex:2048)
  52. 0 0 30 0 86 0 0 0 0 /usr/src/sys/kern/subr_eventhandler.c:254 (sleep mutex:process_exit)
  53. 68 191 1493 193 12833 0 0 0 4 /usr/src/sys/amd64/amd64/pmap.c:4274 (rw:pmap pv list)
  54. 1 0 151 0 123 1 0 0 0 /usr/src/sys/vm/vm_fault.c:692 (rw:vm object)
  55. 9 0 556 0 125 4 0 0 0 /usr/src/sys/netinet/tcp_input.c:1826 (sleep mutex:so_rcv)
  56. 21022 0 60474 0 3380 17 0 0 0 /usr/src/sys/net/rtsock.c:1792 (rw:if_addr_lock)
  57. 42 72 1424 149 4351 0 0 0 6 /usr/src/sys/amd64/amd64/pmap.c:4296 (rw:pmap pv list)
  58. 17285 84 46724 170 5086 9 0 0 34 /usr/src/sys/vm/vm_fault.c:712 (rw:vm object)
  59. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:pipe)
  60. 0 0 168 0 2264 0 0 0 0 /usr/src/sys/kern/kern_sysctl.c:1506 (sx:sysctl lock)
  61. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_data_buf_3584)
  62. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_data_buf_126976)
  63. 12 0 29 0 25 1 0 0 0 /usr/src/sys/net/ieee8023ad_lacp.c:311 (sleep mutex:lacp mtx)
  64. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:Mountpoints)
  65. 6076 0 6109 0 54 113 0 0 0 /usr/src/sys/vm/vm_pageout.c:1617 (sleep mutex:vm page free queue)
  66. 29087 0 63739 0 54 1180 0 0 0 /usr/src/sys/kern/vfs_bio.c:2593 (sleep mutex:buffer daemon lock)
  67. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:ata_request)
  68. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:LTS VFS Cache)
  69. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_buf_69632)
  70. 7 6 105 6 87 1 0 0 1 /usr/src/sys/kern/kern_fork.c:571 (sx:proctree)
  71. 1 0 367 0 4638 0 0 0 0 /usr/src/sys/vm/vm_fault.c:826 (rw:vm object)
  72. 2 0 279 0 4505 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c:1912 (sx:buf->b_evict_lock)
  73. 16298 0 23405 0 2263 10 0 0 0 /usr/src/sys/kern/kern_sysctl.c:1609 (sx:sysctl lock)
  74. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:S VFS Cache)
  75. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:tcpcb)
  76. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_data_buf_4096)
  77. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_data_buf_131072)
  78. 1 0 94 0 87 1 0 0 0 /usr/src/sys/kern/kern_fork.c:395 (sleep mutex:process lock)
  79. 0 0 36 0 87 0 0 0 0 /usr/src/sys/kern/kern_fork.c:396 (sleep mutex:process lock)
  80. 8 1909 190 1909 87 2 21 0 1 /usr/src/sys/kern/kern_fork.c:895 (sx:allproc)
  81. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:KNOTE)
  82. 0 0 17 0 98 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dbuf.c:2313 (sx:db->db_mtx)
  83. 21064 207907 62556 249066 396 157 628 0 3 /usr/src/sys/kern/kern_sysctl.c:1499 (sleep mutex:Giant)
  84. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:16 Bucket)
  85. 196422 0 227711 0 493 461 0 0 0 /usr/src/sys/vm/vm_object.c:1102 (rw:vm object)
  86. 5134 0 5707 0 1566 3 0 0 0 /usr/src/sys/kern/kern_descrip.c:1798 (sx:filedesc structure)
  87. 12 0 209 0 579 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dbuf.c:2361 (sx:db->db_mtx)
  88. 4 0 229 0 87 2 0 0 0 /usr/src/sys/kern/kern_fork.c:462 (sleep mutex:process lock)
  89. 4 0 208 0 87 2 0 0 0 /usr/src/sys/kern/kern_fork.c:463 (sleep mutex:process lock)
  90. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:6 Bucket)
  91. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:udp_inpcb)
  92. 928 0 7708 0 18358 0 0 0 0 /usr/src/sys/vm/vm_fault.c:958 (rw:vm object)
  93. 3 0 51 0 87 0 0 0 0 /usr/src/sys/kern/kern_descrip.c:1828 (sx:filedesc structure)
  94. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:ipq)
  95. 6622 19147 15738 22037 3572 4 6 0 43 /usr/src/sys/kern/subr_taskqueue.c:235 (sleep mutex:taskqueue)
  96. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:rtentry)
  97. 0 0 98 0 790 0 0 0 0 /usr/src/sys/geom/geom_disk.c:327 (sleep mutex:g_disk_start)
  98. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_data_buf_5120)
  99. 6 0 61 0 87 0 0 0 0 /usr/src/sys/kern/kern_fork.c:572 (sleep mutex:process group)
  100. 18546 0 24931 0 286 87 0 0 0 /usr/src/sys/kern/kern_mutex.c:160 (sleep mutex:sellck)
  101. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:128)
  102. 7 0 194 0 492 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/trim_map.c:368 (sx:tm->tm_lock)
  103. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:taskq_zone)
  104. 39193 0 39723 0 150 264 0 0 0 /usr/src/sys/modules/dtrace/fasttrap/../../../cddl/contrib/opensolaris/uts/common/dtrace/fasttrap.c:733 (sleep mutex:process lock)
  105. 36 0 914 0 550 1 0 0 0 /usr/src/sys/cam/cam_xpt.c:3294 (sleep mutex:AHCI channel lock)
  106. 0 168 151 302 1633 0 0 0 10 /usr/src/sys/vm/vm_object.c:1219 (rw:vm object)
  107. 2 0 4486 0 30453 0 0 0 0 /usr/src/sys/vm/uma_core.c:2725 (sleep mutex:mbuf_jumbo_9k)
  108. 0 1 4 6 13 0 0 0 13 /usr/src/sys/vm/uma_core.c:2727 (sleep mutex:mbuf_jumbo_9k)
  109. 7 0 77 0 492 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/trim_map.c:410 (sx:tm->tm_lock)
  110. 0 0 9 0 120 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dsl_pool.c:496 (sx:dp->dp_lock)
  111. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_buf_73728)
  112. 2 0 123 0 1976 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c:1207 (sx:buf->b_freeze_lock)
  113. 7 0 791 0 9741 0 0 0 1 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dnode.c:1152 (sx:dn->dn_mtx)
  114. 7 0 97 0 87 1 0 0 0 /usr/src/sys/kern/kern_fork.c:573 (sleep mutex:process lock)
  115. 6 0 66 0 87 0 0 0 0 /usr/src/sys/kern/kern_fork.c:574 (sleep mutex:process lock)
  116. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:cpuset)
  117. 180611 0 513865 0 21756 23 0 0 0 /usr/src/sys/vm/vm_map.c:3940 (sx:vm map (user))
  118. 1 0 44 0 87 0 0 0 0 /usr/src/sys/kern/kern_descrip.c:1933 (sx:filedesc structure)
  119. 206 0 1795 0 692 2 0 0 0 /usr/src/sys/vm/vm_mmap.c:611 (sx:vm map (user))
  120. 3037240 0 4137696 0 96 43101 0 0 0 /usr/src/sys/dev/e1000/e1000_82571.c:656 (sleep mutex:&hw->dev_spec._82571.swflag_mutex)
  121. 0 13 122 27 1361 0 0 0 6 /usr/src/sys/vm/vm_object.c:1252 (rw:vm object)
  122. 18240 108 19862 169 3572 5 0 0 42 /usr/src/sys/kern/subr_taskqueue.c:344 (sleep mutex:taskqueue)
  123. 23 23 1878 46 16288 0 0 0 41 /usr/src/sys/vm/vm_page.c:2286 (sleep mutex:vm page free queue)
  124. 1 0 28 0 87 0 0 0 0 /usr/src/sys/kern/kern_descrip.c:1960 (sx:filedesc structure)
  125. 1 0 127 0 1079 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dnode.c:1196 (sx:dn->dn_mtx)
  126. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:ripcb)
  127. 115 0 696 0 2636 0 0 0 0 /usr/src/sys/vm/vm_fault.c:1105 (rw:vm object)
  128. 2 0 56 0 104 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/trim_map.c:472 (sx:tm->tm_lock)
  129. 1 13 32 13 58 0 0 0 1 /usr/src/sys/dev/usb/usb_device.c:2765 (sleep mutex:Giant)
  130. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_data_buf_6144)
  131. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:lz4_ctx)
  132. 190 189 982 237 2793 0 0 0 22 /usr/src/sys/vm/vm_fault.c:1112 (rw:vm object)
  133. 1 0 844 0 12977 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dnode.c:1214 (sx:dn->dn_mtx)
  134. 1912 59209 2019 59209 87 23 680 0 1 /usr/src/sys/kern/kern_fork.c:886 (sx:proctree)
  135. 12224 0 12401 0 359 34 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dbuf.c:2543 (sx:db->db_mtx)
  136. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:2725 (sleep mutex:zio_buf_5120)
  137. 11743 0 22673 0 180 125 0 0 0 /usr/src/sys/kern/kern_mutex.c:160 (sleep mutex:msgbuf lock)
  138. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:pf source nodes)
  139. 19 50 228 52 59 3 0 0 2 /usr/src/sys/dev/usb/usb_device.c:2790 (sleep mutex:Giant)
  140. 21046 0 61211 0 130 470 0 0 0 /usr/src/sys/net/rtsock.c:1788 (rw:ifnet_rw)
  141. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:pf table entries)
  142. 9 0 127 0 104 1 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/trim_map.c:513 (sx:tm->tm_lock)
  143. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:64)
  144. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:FPU_save_area)
  145. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:tcptw)
  146. 24901 0 25964 0 6344 4 0 0 0 /usr/src/sys/kern/kern_proc.c:309 (sx:allproc)
  147. 2 0 81 0 87 0 0 0 0 /usr/src/sys/kern/kern_fork.c:679 (sleep mutex:process lock)
  148. 9 0 212 0 87 2 0 0 0 /usr/src/sys/kern/kern_fork.c:680 (sleep mutex:process lock)
  149. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_buf_77824)
  150. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:256)
  151. 0 0 24 0 218 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dbuf.c:1826 (sx:dn->dn_dbufs_mtx)
  152. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:pf mtags)
  153. 0 0 13 0 86 0 0 0 0 /usr/src/sys/kern/kern_descrip.c:2063 (sx:filedesc structure)
  154. 13 0 178733 0 254193 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:4361 (sleep mutex:ix1:rx(0))
  155. 22 0 802028 0 1006690 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:4361 (sleep mutex:ix0:rx(0))
  156. 10 0 456 0 89 5 0 0 0 /usr/src/sys/dev/usb/controller/ehci.c:1486 (sleep mutex:ehci0)
  157. 3 0 138 0 1474 0 0 0 0 /usr/src/sys/kern/vfs_vnops.c:650 (sleep mutex:sleep mtxpool)
  158. 0 0 16 0 87 0 0 0 0 /usr/src/sys/kern/kern_fork.c:742 (sleep mutex:process lock)
  159. 12 0 509 0 359 1 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dbuf.c:2649 (sx:db->db_mtx)
  160. 74 0 7766 1 24192 0 0 0 2 /usr/src/sys/kern/vfs_cache.c:488 (rw:Name Cache)
  161. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:32 Bucket)
  162. 0 0 121 0 1474 0 0 0 0 /usr/src/sys/kern/vfs_vnops.c:682 (sleep mutex:sleep mtxpool)
  163. 0 0 8 0 64 0 0 0 0 /usr/src/sys/amd64/amd64/machdep.c:958 (sleep mutex:descriptor tables)
  164. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_data_buf_7168)
  165. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:dtrace_state_cache)
  166. 159278 0 159374 0 14 11383 0 0 0 /usr/src/sys/dev/usb/usb_hub.c:2209 (sleep mutex:ehci0)
  167. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:2725 (sleep mutex:zio_buf_6144)
  168. 8 0 482 0 1544 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:4420 (sleep mutex:ix0:rx(0))
  169. 2 0 499 0 2046 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:4420 (sleep mutex:ix1:rx(0))
  170. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:udpcb)
  171. 0 0 2 0 8 0 0 0 0 /usr/src/sys/netinet/tcp_usrreq.c:636 (rw:tcpinp)
  172. 0 0 59 0 208 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dsl_pool.c:729 (sx:dp->dp_lock)
  173. 205 0 2061 0 2445 0 0 0 0 /usr/src/sys/amd64/amd64/pmap.c:3596 (rw:pmap pv global)
  174. 25 85 225 85 1849 0 0 0 1 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/spa_misc.c:461 (sx:scl->scl_lock)
  175. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:MAC labels)
  176. 11 0 133 0 520 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dsl_pool.c:742 (sx:dp->dp_lock)
  177. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_buf_81920)
  178. 14 0 2037 0 1321 1 0 0 0 /usr/src/sys/kern/vfs_vnops.c:420 (lockmgr:zfs)
  179. 6382 0 6772 0 1849 3 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/spa_misc.c:488 (sx:scl->scl_lock)
  180. 2 0 31 0 64 0 0 0 0 /usr/src/sys/kern/kern_descrip.c:2187 (sx:filedesc structure)
  181. 13 0 167 0 812 0 0 0 0 /usr/src/sys/geom/geom_disk.c:270 (sleep mutex:g_disk_done)
  182. 497 0 235551 0 593620 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:833 (sleep mutex:ix0:tx(0))
  183. 504 0 217438 0 665055 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:833 (sleep mutex:ix1:tx(0))
  184. 11 0 45 0 178 0 0 0 0 /usr/src/sys/dev/usb/usb_hub.c:2304 (sleep mutex:ehci0)
  185. 1 0 117 0 169 0 0 0 0 /usr/src/sys/netinet/tcp_input.c:2692 (sleep mutex:so_snd)
  186. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:RADIX NODE)
  187. 0 0 8 0 21 0 0 0 0 /usr/src/sys/kern/kern_event.c:1952 (sleep mutex:so_rcv)
  188. 1 0 29 0 45 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/metaslab.c:811 (sx:mg->mg_lock)
  189. 36 0 978 0 276 3 0 0 0 /usr/src/sys/kern/imgact_elf.c:446 (sx:vm map (user))
  190. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:mbuf_jumbo_page)
  191. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_data_buf_8192)
  192. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:dmu_buf_impl_t)
  193. 1 0 118 0 516 0 0 0 0 /usr/src/sys/cam/cam_xpt.c:5280 (sleep mutex:CAM doneq)
  194. 5246 0 5943 0 3897 1 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c:2804 (sx:zp->z_lock)
  195. 2 0 10103 0 48599 0 0 0 0 /usr/src/sys/vm/uma_core.c:2215 (sleep mutex:mbuf)
  196. 0 0 2 0 8 0 0 0 0 /usr/src/sys/netinet/in_pcb.c:1293 (rw:tcpinp)
  197. 5 0 24 0 55 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c:5365 (sx:l2arc_dev_mtx)
  198. 0 1 17 13 40 0 0 0 31 /usr/src/sys/vm/uma_core.c:2217 (sleep mutex:mbuf)
  199. 0 0 0 0 5 0 0 0 0 /usr/src/sys/vm/uma_core.c:2725 (sleep mutex:zio_buf_7168)
  200. 7 0 178 0 1678 0 0 0 0 /usr/src/sys/kern/kern_descrip.c:799 (sleep mutex:process lock)
  201. 5 0 77 0 91 0 0 0 0 /usr/src/sys/netinet/tcp_timer.c:147 (rw:tcp)
  202. 5 0 19 0 55 0 0 0 0 /usr/src/sys/kern/kern_fork.c:912 (sleep mutex:process lock)
  203. 0 0 3 0 18 0 0 0 0 /usr/src/sys/netinet/in_pcb.c:1312 (rw:tcpinp)
  204. 1 0 138 0 384 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c:3600 (sx:buf_hash_table.ht_locks[i].ht_lock)
  205. 30 0 260 0 205 1 0 0 1 /usr/src/sys/netinet/tcp_usrreq.c:764 (rw:tcpinp)
  206. 0 0 33 0 107 0 0 0 1 /usr/src/sys/dev/ixgbe/ixgbe.c:906 (sleep mutex:ix0:tx(0))
  207. 1 486 62 1477 220 0 6 0 10 /usr/src/sys/dev/ixgbe/ixgbe.c:906 (sleep mutex:ix1:tx(0))
  208. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:vmem btag)
  209. 11242 0 17769 0 51 348 0 0 0 /usr/src/sys/kern/kern_mutex.c:160 (sleep mutex:if_lagg callout mutex)
  210. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:NCLNODE)
  211. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_buf_86016)
  212. 23 0 266 0 2084 0 0 0 1 /usr/src/sys/kern/vfs_subr.c:2347 (sleep mutex:vnode_free_list)
  213. 1 0 21 0 14 1 0 0 0 /usr/src/sys/dev/usb/usb_hub.c:2404 (sleep mutex:ehci0)
  214. 10 0 866287 0 1123494 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:4361 (sleep mutex:ix1:rx(1))
  215. 1 0 48 0 87 0 0 0 0 /usr/src/sys/kern/kern_sig.c:3470 (sleep mutex:sigacts)
  216. 110760 0 231122 0 235 983 0 0 0 /usr/src/sys/netinet/tcp_usrreq.c:811 (rw:tcpinp)
  217. 9433 8 9655 37 210 45 0 0 5 /usr/src/sys/kern/kern_mutex.c:160 (sleep mutex:USB device mutex)
  218. 5811 0 5990 0 548 10 0 0 0 /usr/src/sys/vm/uma_core.c:2969 (sleep mutex:pf states)
  219. 114478 0 200245 0 88821 2 0 0 0 /usr/src/sys/netpfil/pf/pf.c:1641 (sleep mutex:pf_idhash)
  220. 6 0 126 0 117 1 0 0 0 /usr/src/sys/kern/tty_pts.c:120 (sleep mutex:ttymtx)
  221. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_data_buf_10240)
  222. 0 0 201 0 2086 0 0 0 0 /usr/src/sys/kern/vfs_subr.c:2407 (sleep mutex:vnode_free_list)
  223. 12 0 291 0 637 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:4420 (sleep mutex:ix1:rx(1))
  224. 0 0 1 0 9 0 0 0 0 /usr/src/sys/vm/uma_core.c:2725 (sleep mutex:dnode_t)
  225. 240 0 4348 0 1105 3 0 0 0 /usr/src/sys/vm/vm_object.c:1700 (rw:vm object)
  226. 1 0 230 0 1328 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_rlock.c:444 (sx:zp->z_range_lock)
  227. 2 0 455 0 1757 0 0 0 0 /usr/src/sys/kern/vfs_cache.c:803 (rw:Name Cache)
  228. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:64 Bucket)
  229. 1 0 22 0 261 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dbuf.c:2554 (sx:dn->dn_mtx)
  230. 1 159286 69 159378 206 0 773 0 14 /usr/src/sys/kern/kern_mutex.c:160 (sleep mutex:ehci0)
  231. 1 0 47 0 65 0 0 0 0 /usr/src/sys/vm/vm_kern.c:451 (sx:vm map (user))
  232. 0 0 68 0 550 0 0 0 0 /usr/src/sys/cam/ata/ata_da.c:1671 (sleep mutex:CAM device lock)
  233. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_buf_90112)
  234. 11109 0 11124 0 54 206 0 0 0 /usr/src/sys/kern/vfs_bio.c:463 (sleep mutex:runningbufspace lock)
  235. 1 0 1 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:4 Bucket)
  236. 472 0 213110 0 563328 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:833 (sleep mutex:ix1:tx(1))
  237. 507 0 197344 0 560385 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:833 (sleep mutex:ix0:tx(1))
  238. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:DMAR_MAP_ENTRY)
  239. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:ttyinq)
  240. 86 0 469 0 65 7 0 0 0 /usr/src/sys/vm/vm_kern.c:482 (sx:vm map (user))
  241. 1 27 101 30 1257 0 0 0 2 /usr/src/sys/vm/vm_map.c:1218 (rw:vm object)
  242. 0 0 13 0 105 0 0 0 0 /usr/src/sys/vm/vm_object.c:1779 (rw:vm object)
  243. 37543 0 65062 0 550 118 0 0 0 /usr/src/sys/cam/ata/ata_da.c:1729 (sleep mutex:CAM device lock)
  244. 4 0 118 0 135 0 0 0 0 /usr/src/sys/kern/kern_exec.c:958 (rw:vm object)
  245. 2 0 45 0 491 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dnode.c:1722 (sx:dn->dn_mtx)
  246. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_data_buf_12288)
  247. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_data_buf_28672)
  248. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:arc_buf_t)
  249. 0 0 14 0 64 0 0 0 0 /usr/src/sys/vm/vm_map.c:3426 (sleep mutex:process lock)
  250. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:tcpreass)
  251. 4 0 255 0 1328 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_rlock.c:538 (sx:zp->z_range_lock)
  252. 24901 0 25786 0 6346 4 0 0 0 /usr/src/sys/kern/kern_proc.c:287 (sleep mutex:process lock)
  253. 0 0 10 0 40 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:906 (sleep mutex:ix1:tx(1))
  254. 0 448 33 449 144 0 3 0 3 /usr/src/sys/dev/ixgbe/ixgbe.c:906 (sleep mutex:ix0:tx(1))
  255. 0 0 9 0 63 0 0 0 0 /usr/src/sys/vm/vm_object.c:1831 (rw:vm object)
  256. 114400 0 124361 0 1016 122 0 0 0 /usr/src/sys/kern/vfs_vnops.c:759 (lockmgr:zfs)
  257. 12 0 1194300 0 15911035 0 0 0 0 /usr/src/sys/netinet/in.c:118 (rw:in_ifaddr_lock)
  258. 0 0 231 0 2566 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:3030 (sx:zio->io_lock)
  259. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:pf table counters)
  260. 27221 0 39900 0 51 782 0 0 0 /usr/src/sys/kern/kern_mutex.c:160 (sleep mutex:lacp mtx)
  261. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:DIRHASH)
  262. 13 0 706750 0 1083981 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:4361 (sleep mutex:ix1:rx(2))
  263. 2 0 640 0 1050 0 0 0 1 /usr/src/sys/kern/tty.c:161 (sleep mutex:ttymtx)
  264. 0 0 10 0 87 0 0 0 0 /usr/src/sys/kern/kern_fork.c:582 (sleep mutex:session)
  265. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_buf_94208)
  266. 3 0 462 0 944 0 0 0 0 /usr/src/sys/kern/kern_sig.c:666 (sleep mutex:process lock)
  267. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:TURNSTILE)
  268. 2 0 189 0 2307 0 0 0 0 /usr/src/sys/kern/vfs_mount.c:433 (sleep mutex:struct mount mtx)
  269. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:udplite_inpcb)
  270. 0 0 15 0 89 0 0 0 0 /usr/src/sys/kern/vfs_mount.c:443 (sleep mutex:struct mount mtx)
  271. 1965773 0 31586457 0 130 242972 0 0 0 /usr/src/sys/dev/usb/usb_device.c:2758 (sx:USB config SX lock)
  272. 12 0 1863 0 7120 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:4420 (sleep mutex:ix1:rx(2))
  273. 47 129 648 244 457 1 0 0 3 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/metaslab.c:2189 (sx:msp->ms_lock)
  274. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_data_buf_14336)
  275. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_data_buf_32768)
  276. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:mbuf_ext_refcnt)
  277. 0 0 0 0 1 0 0 0 0 /usr/src/sys/vm/uma_core.c:2215 (sleep mutex:zio_buf_24576)
  278. 0 0 121 0 357 0 0 0 0 /usr/src/sys/kern/tty_pts.c:396 (sleep mutex:ttymtx)
  279. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:taskq_zone)
  280. 7 6 72 6 25 2 0 0 1 /usr/src/sys/netinet/tcp_input.c:2911 (sleep mutex:so_rcv)
  281. 1 0 306 0 1292 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/sa.c:1457 (sx:hdl->sa_lock)
  282. 8589 6 22136 31 17783 1 0 0 18 /usr/src/sys/amd64/amd64/pmap.c:5379 (rw:pmap pv list)
  283. 12856 0 12994 0 271 47 0 0 0 /usr/src/sys/dev/random/live_entropy_sources.c:153 (sx:live_entropy_sources)
  284. 1 0 37 0 56 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/sa.c:1476 (sx:hdl->sa_lock)
  285. 3 0 113 0 274 0 0 0 0 /usr/src/sys/kern/kern_rwlock.c:147 (rw:pf rulesets)
  286. 13 0 90283 0 427975 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:833 (sleep mutex:ix1:tx(2))
  287. 394 0 171127 0 853089 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:833 (sleep mutex:ix0:tx(2))
  288. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_cache)
  289. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_buf_98304)
  290. 17 4 1121 6 16085 0 0 0 3 /usr/src/sys/amd64/amd64/trap.c:737 (sleep mutex:process lock)
  291. 11 0 953 0 16085 0 0 0 0 /usr/src/sys/amd64/amd64/trap.c:744 (sleep mutex:process lock)
  292. 4 0 126 0 1143 0 0 0 0 /usr/src/sys/vm/vm_mmap.c:310 (sleep mutex:process lock)
  293. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:128 Bucket)
  294. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:g_bio)
  295. 38581 0 61268 0 21833 2 0 0 0 /usr/src/sys/amd64/amd64/pmap.c:4179 (rw:pmap pv global)
  296. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_data_buf_16384)
  297. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_data_buf_36864)
  298. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zil_lwb_cache)
  299. 1 0 436 0 2937 0 0 0 0 /usr/src/sys/kern/kern_conf.c:72 (sleep mutex:cdev)
  300. 0 0 13 0 87 0 0 0 0 /usr/src/sys/kern/kern_event.c:1952 (sleep mutex:process lock)
  301. 30 87 2712 87 336 8 0 0 1 /usr/src/sys/netinet/in_pcb.c:1799 (rw:tcpinp)
  302. 0 0 7 0 48 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:906 (sleep mutex:ix1:tx(2))
  303. 0 0 7 0 40 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:906 (sleep mutex:ix0:tx(2))
  304. 3 0 7554 0 48554 0 0 0 0 /usr/src/sys/vm/uma_core.c:2725 (sleep mutex:mbuf)
  305. 0 0 12 17 46 0 0 0 33 /usr/src/sys/vm/uma_core.c:2727 (sleep mutex:mbuf)
  306. 205 0 2071 0 2445 0 0 0 0 /usr/src/sys/amd64/amd64/pmap.c:3597 (sleep mutex:pmap)
  307. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:8 Bucket)
  308. 9 0 783762 0 978058 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:4361 (sleep mutex:ix1:rx(3))
  309. 328 0 14534 0 121 120 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:1420 (sleep mutex:ix0:tx(0))
  310. 1 0 59 0 339 0 0 0 0 /usr/src/sys/vm/vm_object.c:2106 (rw:vm object)
  311. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_buf_512)
  312. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_buf_102400)
  313. 5 0 421 0 6748 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:3318 (sx:zio->io_lock)
  314. 0 0 13 0 65 0 0 0 0 /usr/src/sys/kern/kern_sx.c:167 (sx:zio->io_lock)
  315. 5 0 561 0 1551 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:3330 (sx:zio->io_lock)
  316. 0 0 421 0 4241 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c:1275 (sx:arc_mfu->arcs_locks[i].arcs_lock)
  317. 1 0 158 0 551 0 0 0 0 /usr/src/sys/cam/cam_xpt.c:2508 (sleep mutex:CAM queue lock)
  318. 4 0 402 0 1119 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:4420 (sleep mutex:ix1:rx(3))
  319. 2 0 39 0 327 0 0 0 0 /usr/src/sys/vm/vm_mmap.c:428 (sx:pmc-sx)
  320. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:VM OBJECT)
  321. 0 0 19 0 86 0 0 0 0 /usr/src/sys/kern/sysv_sem.c:1306 (sleep mutex:semu)
  322. 0 0 389 0 4358 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c:1310 (sx:arc_mfu->arcs_locks[i].arcs_lock)
  323. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_data_buf_20480)
  324. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_data_buf_40960)
  325. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zfs_znode_cache)
  326. 0 0 1 0 10 0 0 0 0 /usr/src/sys/kern/uipc_socket.c:897 (sleep mutex:so_rcv)
  327. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:SLEEPQUEUE)
  328. 0 0 3 0 18 0 0 0 0 /usr/src/sys/vm/uma_core.c:2725 (sleep mutex:zio_buf_16384)
  329. 298 0 8833 0 1423 6 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:1525 (sleep mutex:ix0:tx(0))
  330. 446 331 57883 640 2045 28 0 0 11 /usr/src/sys/dev/ixgbe/ixgbe.c:1525 (sleep mutex:ix1:tx(0))
  331. 40611 0 79300 0 122 650 0 0 0 /usr/src/sys/dev/usb/controller/ehci.c:1486 (sleep mutex:ehci1)
  332. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:pf frags)
  333. 6 0 402 0 2989 0 0 0 0 /usr/src/sys/kern/kern_sig.c:1007 (sleep mutex:process lock)
  334. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:1024)
  335. 21089 0 63680 0 116 548 0 0 0 /usr/src/sys/vm/vm_object.c:2233 (rw:vm object)
  336. 677 0 141689 0 464763 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:833 (sleep mutex:ix1:tx(3))
  337. 623 0 272956 0 719349 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:833 (sleep mutex:ix0:tx(3))
  338. 0 0 35 0 258 0 0 0 0 /usr/src/sys/kern/kern_exit.c:289 (sleep mutex:process_exit)
  339. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_buf_1024)
  340. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_buf_106496)
  341. 88 0 185 0 14 13 0 0 0 /usr/src/sys/dev/usb/usb_hub.c:2209 (sleep mutex:ehci1)
  342. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:2725 (sleep mutex:zio_link_cache)
  343. 0 0 84 0 247 0 0 0 0 /usr/src/sys/kern/uipc_socket.c:1185 (sleep mutex:so_snd)
  344. 0 0 91 0 516 0 0 0 0 /usr/src/sys/kern/kern_mutex.c:160 (sleep mutex:CAM doneq)
  345. 0 0 15 0 87 0 0 0 0 /usr/src/sys/amd64/amd64/vm_machdep.c:249 (sleep mutex:descriptor tables)
  346. 5 0 11 0 8 1 0 0 0 /usr/src/sys/netinet/tcp_usrreq.c:635 (rw:tcp)
  347. 0 0 16 0 128 0 0 0 0 /usr/src/sys/vm/vm_glue.c:252 (sleep mutex:vm page)
  348. 1 0 30 0 48 0 0 0 0 /usr/src/sys/dev/e1000/if_em.c:4437 (sleep mutex:em1:rx(0))
  349. 1 0 121 0 235 0 0 0 0 /usr/src/sys/kern/uipc_sockbuf.c:549 (sleep mutex:so_snd)
  350. 0 1 44 1 113 0 0 0 1 /usr/src/sys/dev/ixgbe/ixgbe.c:906 (sleep mutex:ix1:tx(3))
  351. 1 125 60 127 229 0 0 0 3 /usr/src/sys/dev/ixgbe/ixgbe.c:906 (sleep mutex:ix0:tx(3))
  352. 0 0 9 0 128 0 0 0 0 /usr/src/sys/vm/vm_glue.c:288 (sleep mutex:vm page)
  353. 27 0 3301 0 1193 2 0 0 0 /usr/src/sys/amd64/amd64/pmap.c:4446 (rw:pmap pv global)
  354. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_data_buf_24576)
  355. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_data_buf_45056)
  356. 1 0 4 0 6 0 0 0 0 /usr/src/sys/kern/subr_vmem.c:731 (sleep mutex:vmem list lock)
  357. 5869 13 7488 13 519 14 0 0 1 /usr/src/sys/dev/ahci/ahci.c:1562 (sleep mutex:AHCI channel lock)
  358. 0 0 18 0 128 0 0 0 0 /usr/src/sys/kern/kern_exec.c:1047 (sleep mutex:process_exec)
  359. 14 648 8856844 46296098 15513956 0 2 0 1467849 /usr/src/sys/net/route.c:439 (sleep mutex:rtentry)
  360. 0 0 0 0 2 0 0 0 0 /usr/src/sys/vm/uma_core.c:2725 (sleep mutex:zio_buf_20480)
  361. 0 0 13 0 86 0 0 0 0 /usr/src/sys/amd64/amd64/vm_machdep.c:307 (sleep mutex:descriptor tables)
  362. 1 0 9 0 10 0 0 0 0 /usr/src/sys/kern/uipc_syscalls.c:445 (sleep mutex:accept)
  363. 173184 0 365717 0 247 1480 0 0 0 /usr/src/sys/kern/uipc_sockbuf.c:148 (sx:so_snd_sx)
  364. 37 0 604 0 647 0 0 0 0 /usr/src/sys/amd64/amd64/pmap.c:5746 (rw:pmap pv list)
  365. 13 0 693227 0 863870 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:4361 (sleep mutex:ix0:rx(4))
  366. 9 0 689631 0 876979 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:4361 (sleep mutex:ix1:rx(4))
  367. 190 0 4895 0 137 35 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:1420 (sleep mutex:ix1:tx(1))
  368. 1 0 54 0 240 0 0 0 0 /usr/src/sys/dev/usb/usb_hub.c:2304 (sleep mutex:ehci1)
  369. 757964 0 4359336 0 97 44941 0 0 0 /usr/src/sys/kern/kern_proc.c:1322 (sx:allproc)
  370. 37591 0 70525 0 21133 3 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c:4676 (sx:zfsvfs->z_teardown_inactive_lock)
  371. 41 0 820 0 757 1 0 0 0 /usr/src/sys/amd64/amd64/pmap.c:3865 (sleep mutex:pmap)
  372. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:256 Bucket)
  373. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_buf_1536)
  374. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_buf_110592)
  375. 1 0 964 0 4024 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/sa.c:1877 (sx:hdl->sa_lock)
  376. 57 0 4529 0 1193 3 0 0 1 /usr/src/sys/vm/vm_map.c:1836 (rw:vm object)
  377. 13066 0 15439 0 1084 14 0 0 0 /usr/src/sys/kern/vfs_vnops.c:1322 (lockmgr:zfs)
  378. 3 0 320 0 849 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:4420 (sleep mutex:ix0:rx(4))
  379. 3 0 384 0 1269 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:4420 (sleep mutex:ix1:rx(4))
  380. 102991 0 131065 0 5671 23 0 0 0 /usr/src/sys/kern/vfs_lookup.c:519 (lockmgr:zfs)
  381. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:64 pcpu)
  382. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_data_buf_49152)
  383. 1 0 19 0 15 1 0 0 0 /usr/src/sys/dev/usb/usb_hub.c:2404 (sleep mutex:ehci1)
  384. 0 0 0 0 1 0 0 0 0 /usr/src/sys/vm/uma_core.c:2725 (sleep mutex:zio_buf_24576)
  385. 197881 10 213262 27 36618 5 0 0 32 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/rrwlock.c:165 (sx:rrl->rr_lock)
  386. 765 0 415893 0 961365 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:833 (sleep mutex:ix0:tx(4))
  387. 677 0 291737 0 773339 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:833 (sleep mutex:ix1:tx(4))
  388. 15 0 106 0 130 0 0 0 0 /usr/src/sys/dev/usb/usb_device.c:2759 (sx:USB suspend and resume SX lock)
  389. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:mt_zone)
  390. 61030 0 61430 0 2961 20 0 0 0 /usr/src/sys/kern/sys_generic.c:1603 (sleep mutex:select mtxpool)
  391. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:pf frag entries)
  392. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:KMAP ENTRY)
  393. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:umtx pi)
  394. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_buf_2048)
  395. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_buf_114688)
  396. 1965768 0 15793407 0 269 58711 0 0 0 /usr/src/sys/dev/usb/usb_device.c:2784 (sx:USB suspend and resume SX lock)
  397. 45819 33770 46839 33884 210 223 161 0 11 /usr/src/sys/kern/kern_condvar.c:145 (sleep mutex:Giant)
  398. 18 1 8874 9 36630 0 0 0 17 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/rrwlock.c:223 (sx:rrl->rr_lock)
  399. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:MAP ENTRY)
  400. 55243 0 72470 0 178 407 0 0 0 /usr/src/sys/kern/vfs_syscalls.c:4051 (lockmgr:zfs)
  401. 0 0 3 0 14 0 0 0 0 /usr/src/sys/dev/usb/controller/usb_controller.c:373 (sleep mutex:ehci0)
  402. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:ksiginfo)
  403. 1 375 87 549 251 0 2 0 6 /usr/src/sys/dev/ixgbe/ixgbe.c:906 (sleep mutex:ix0:tx(4))
  404. 12 404 120 1855 302 0 6 0 9 /usr/src/sys/dev/ixgbe/ixgbe.c:906 (sleep mutex:ix1:tx(4))
  405. 23816 0 24146 0 2962 8 0 0 0 /usr/src/sys/kern/sys_generic.c:1667 (sleep mutex:select mtxpool)
  406. 3 88 78 176 268 0 0 0 14 /usr/src/sys/kern/kern_mutex.c:160 (sleep mutex:ehci1)
  407. 1 370663 17 372573 86 0 4332 0 2 /usr/src/sys/kern/kern_exit.c:429 (sx:allproc)
  408. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_data_buf_53248)
  409. 1 0 11 0 15 0 0 0 0 /usr/src/sys/dev/usb/controller/usb_controller.c:407 (sleep mutex:ehci0)
  410. 12 0 768666 0 958143 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:4361 (sleep mutex:ix1:rx(5))
  411. 16 0 16 0 1 16 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:1420 (sleep mutex:ix1:tx(2))
  412. 10 0 10 0 1 10 0 0 0 /usr/src/sys/cam/scsi/scsi_enc.c:764 (sleep mutex:CAM device lock)
  413. 11425 0 11654 0 55 211 0 0 0 /usr/src/sys/kern/kern_sx.c:167 (sx:l2arc_feed_thr_lock)
  414. 13 0 821 0 311 2 0 0 0 /usr/src/sys/kern/sys_generic.c:1714 (sleep mutex:select mtxpool)
  415. 0 0 1 0 2 0 0 0 0 /usr/src/sys/cam/scsi/scsi_enc.c:791 (sleep mutex:CAM device lock)
  416. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:itimer)
  417. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_buf_2560)
  418. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_buf_118784)
  419. 9 0 1303 0 5035 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:4420 (sleep mutex:ix1:rx(5))
  420. 2054889 0 3545999 0 197626 17 0 0 0 /usr/src/sys/kern/uipc_sockbuf.c:148 (sx:so_rcv_sx)
  421. 23 156 616 211 2032 0 0 0 10 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_queue.c:775 (sx:vq->vq_lock)
  422. 12465 0 22667 0 21833 1 0 0 0 /usr/src/sys/amd64/amd64/pmap.c:4180 (sleep mutex:pmap)
  423. 1 0 149 0 508 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c:3589 (sx:buf->b_evict_lock)
  424. 0 0 3 0 10 0 0 0 0 /usr/src/sys/kern/uipc_syscalls.c:478 (sleep mutex:so_rcv)
  425. 2 0 63 0 132 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dnode_sync.c:390 (sx:dn->dn_mtx)
  426. 19351 56 22037 56 790 27 0 0 1 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_queue.c:801 (sx:vq->vq_lock)
  427. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:2048)
  428. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_data_buf_57344)
  429. 14 0 210 0 89 2 0 0 0 /usr/src/sys/dev/usb/usb_transfer.c:1769 (sleep mutex:ehci0)
  430. 94966 0 127839 0 2105 60 0 0 0 /usr/src/sys/amd64/amd64/pmap.c:4839 (rw:pmap pv global)
  431. 0 0 1 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:VNODE)
  432. 7 0 94 0 391 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_queue.c:815 (sx:vq->vq_lock)
  433. 12034 1 29797 2 21659 1 0 0 5 /usr/src/sys/kern/vfs_cache.c:669 (sleep mutex:vnode interlock)
  434. 30864 0 55287 0 6920 7 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dmu.c:146 (sx:dn->dn_struct_rwlock)
  435. 615 0 248059 0 711959 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:833 (sleep mutex:ix0:tx(5))
  436. 699 0 147484 0 470882 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:833 (sleep mutex:ix1:tx(5))
  437. 1 0 54 0 88 0 0 0 0 /usr/src/sys/kern/uipc_sockbuf.c:963 (sleep mutex:so_snd)
  438. 1 0 37 0 86 0 0 0 0 /usr/src/sys/kern/kern_exit.c:353 (sx:proctree)
  439. 13 1 12885 3 197635 0 0 0 4 /usr/src/sys/kern/uipc_socket.c:1453 (sleep mutex:so_rcv)
  440. 9 0 141 0 89 1 0 0 0 /usr/src/sys/dev/usb/usb_transfer.c:1823 (sleep mutex:ehci0)
  441. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_buf_3072)
  442. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_buf_122880)
  443. 0 0 20 0 354 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dmu_objset.c:1195 (sx:dn->dn_mtx)
  444. 0 0 38 0 103 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:906 (sleep mutex:ix1:tx(5))
  445. 0 230 72 238 262 0 0 0 6 /usr/src/sys/dev/ixgbe/ixgbe.c:906 (sleep mutex:ix0:tx(5))
  446. 1 14 177 14 1329 0 0 0 1 /usr/src/sys/vm/vnode_pager.c:113 (rw:vm object)
  447. 2 0 37 0 51 0 0 0 0 /usr/src/sys/dev/e1000/if_em.c:4437 (sleep mutex:em0:rx(0))
  448. 0 0 349 0 5300 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c:3710 (sx:buf->b_evict_lock)
  449. 12 0 1815121 0 15912026 0 0 0 0 /usr/src/sys/net/if_vlan.c:1171 (rw:vlan)
  450. 60 0 5158 0 843 6 0 0 0 /usr/src/sys/vm/vm_map.c:1420 (sx:vm map (user))
  451. 1 0 61 0 86 0 0 0 0 /usr/src/sys/kern/kern_exit.c:185 (sleep mutex:process lock)
  452. 27687 0 34814 0 2289 15 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_dir.c:223 (sx:zp->z_lock)
  453. 23 0 736000 0 817194 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:4361 (sleep mutex:ix0:rx(6))
  454. 10 0 715074 0 820276 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:4361 (sleep mutex:ix1:rx(6))
  455. 531 62 16807 63 119 141 0 0 2 /usr/src/sys/dev/ixgbe/ixgbe.c:1420 (sleep mutex:ix1:tx(3))
  456. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_data_buf_61440)
  457. 0 0 4 0 14 0 0 0 0 /usr/src/sys/dev/usb/controller/usb_controller.c:659 (sleep mutex:ehci0)
  458. 11 1 380 1 86 4 0 0 1 /usr/src/sys/kern/kern_exit.c:448 (sx:proctree)
  459. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:VMSPACE)
  460. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:32768)
  461. 20 0 57 0 192 0 0 0 0 /usr/src/sys/kern/vfs_subr.c:411 (sleep mutex:struct mount mtx)
  462. 315262 0 3870573 0 6439 601 0 0 0 /usr/src/sys/kern/kern_proc.c:1332 (sleep mutex:process lock)
  463. 6 0 1679 0 1214 1 0 0 0 /usr/src/sys/vm/vm_map.c:1467 (sx:vm map (user))
  464. 17 0 2397 0 790 3 0 0 0 /usr/src/sys/kern/tty_ttydisc.c:483 (sleep mutex:ttymtx)
  465. 0 0 228 0 854 0 0 0 0 /usr/src/sys/netinet/if_ether.c:646 (rw:if_addr_lock)
  466. 12 0 1187 0 2632 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:4420 (sleep mutex:ix0:rx(6))
  467. 3 0 567 0 1308 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:4420 (sleep mutex:ix1:rx(6))
  468. 8 0 118 0 99 1 0 0 0 /usr/src/sys/netinet6/in6.c:2256 (rw:if_addr_lock)
  469. 2 23 94 24 1045 0 0 0 2 /usr/src/sys/vm/vnode_pager.c:205 (rw:vm object)
  470. 1 0 26 0 179 0 0 0 0 /usr/src/sys/dev/usb/usb_transfer.c:1945 (sleep mutex:ehci0)
  471. 28 212 111 258 457 0 0 0 2 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/metaslab.c:2151 (sx:mg->mg_lock)
  472. 0 0 78 0 495 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dnode_sync.c:577 (sx:dn->dn_mtx)
  473. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_buf_3584)
  474. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_buf_126976)
  475. 0 0 30 0 192 0 0 0 0 /usr/src/sys/kern/vfs_subr.c:456 (sleep mutex:struct mount mtx)
  476. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:VNODEPOLL)
  477. 5 0 1125 0 4638 0 0 0 1 /usr/src/sys/vm/vm_fault.c:138 (sleep mutex:vm page)
  478. 2 0 288 0 944 0 0 0 0 /usr/src/sys/kern/kern_sig.c:668 (sleep mutex:sigacts)
  479. 1 0 27 0 87 0 0 0 0 /usr/src/sys/kern/subr_eventhandler.c:254 (sleep mutex:process_ctor)
  480. 0 0 14 0 86 0 0 0 0 /usr/src/sys/kern/kern_exit.c:295 (sleep mutex:process lock)
  481. 0 0 13 0 86 0 0 0 0 /usr/src/sys/kern/kern_exit.c:271 (sleep mutex:p_peers)
  482. 0 0 122 0 1292 0 0 0 0 /usr/src/sys/vm/swap_pager.c:209 (sleep mutex:swapdev)
  483. 5724 0 6581 0 2289 2 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_dir.c:341 (sx:zp->z_lock)
  484. 27 0 3297 0 1193 2 0 0 0 /usr/src/sys/amd64/amd64/pmap.c:4447 (sleep mutex:pmap)
  485. 5 0 68 0 551 0 0 0 0 /usr/src/sys/cam/cam_xpt.c:3298 (sleep mutex:CAM queue lock)
  486. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:32)
  487. 722 0 379045 0 814342 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:833 (sleep mutex:ix1:tx(6))
  488. 708 0 361461 0 815546 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:833 (sleep mutex:ix0:tx(6))
  489. 3 0 55 0 89 0 0 0 0 /usr/src/sys/kern/vfs_syscalls.c:379 (lockmgr:zfs)
  490. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_data_buf_65536)
  491. 1 0 1 0 1 1 0 0 0 /usr/src/sys/cam/cam_xpt.c:5238 (sleep mutex:CAM device lock)
  492. 12 1 3466259 7 15513816 0 0 0 15 /usr/src/sys/netinet/if_ether.c:328 (rw:if_afdata)
  493. 0 0 21 0 58 0 0 0 0 /usr/src/sys/fs/nfsserver/nfs_nfsdstate.c:1047 (sleep mutex:nfs_state_mutex)
  494. 171704 0 547662 0 51 10738 0 0 0 /usr/src/sys/kern/kern_mutex.c:160 (sleep mutex:ix0)
  495. 1 0 201 0 1045 0 0 0 0 /usr/src/sys/kern/vfs_subr.c:2135 (sleep mutex:vnode interlock)
  496. 23 0 110 0 799 0 0 0 0 /usr/src/sys/amd64/amd64/pmap.c:2871 (sleep mutex:pmap pv chunk list)
  497. 9 0 2386 0 899 2 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dmu.c:407 (sx:dn->dn_struct_rwlock)
  498. 1 0 102 0 235 0 0 0 0 /usr/src/sys/kern/uipc_socket.c:1679 (sleep mutex:so_rcv)
  499. 0 0 41 0 132 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dnode_sync.c:674 (sx:dn->dn_mtx)
  500. 178473 0 180015 0 22846 7 0 0 0 /usr/src/sys/kern/vfs_subr.c:2145 (sleep mutex:vnode interlock)
  501. 1 0 18 0 79 0 0 0 0 /usr/src/sys/netinet/tcp_output.c:1199 (sleep mutex:rtentry)
  502. 13050 0 25398 0 18408 1 0 0 1 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dbuf.c:133 (sx:db->db_mtx)
  503. 4 0 122 0 384 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c:909 (sx:buf_hash_table.ht_locks[i].ht_lock)
  504. 0 0 10 0 87 0 0 0 0 /usr/src/sys/kern/kern_ktrace.c:577 (sleep mutex:ktrace)
  505. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:UMA Kegs)
  506. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:pf state scrubs)
  507. 0 0 13 0 86 0 0 0 0 /usr/src/sys/kern/kern_exit.c:341 (sleep mutex:p_peers)
  508. 4 22 1242 24 14307 0 0 0 6 /usr/src/sys/kern/vfs_subr.c:2172 (sleep mutex:vnode interlock)
  509. 2 0 57 0 56 1 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c:4265 (sx:zp->z_lock)
  510. 6 0 86 1 288 0 0 0 2 /usr/src/sys/netinet/tcp_output.c:1237 (sleep mutex:rtentry)
  511. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_buf_4096)
  512. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_buf_131072)
  513. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:65536)
  514. 0 0 179 0 2758 0 0 0 1 /usr/src/sys/vm/swap_pager.c:301 (sleep mutex:swapdev)
  515. 3 426 111 637 318 0 2 0 3 /usr/src/sys/dev/ixgbe/ixgbe.c:906 (sleep mutex:ix0:tx(6))
  516. 1 124 82 245 243 0 1 0 9 /usr/src/sys/dev/ixgbe/ixgbe.c:906 (sleep mutex:ix1:tx(6))
  517. 5 0 44 0 109 0 0 0 0 /usr/src/sys/kern/kern_kthread.c:210 (sleep mutex:process lock)
  518. 12714 0 13203 0 6441 2 0 0 0 /usr/src/sys/kern/kern_proc.c:895 (sleep mutex:session)
  519. 0 0 64 0 802 0 0 0 0 /usr/src/sys/amd64/amd64/pmap.c:2947 (sleep mutex:pmap pv chunk list)
  520. 18 0 37 0 178 0 0 0 0 /usr/src/sys/vm/vm_reserv.c:868 (sleep mutex:vm page free queue)
  521. 102990 0 107987 2 37272 2 0 0 5 /usr/src/sys/kern/vfs_subr.c:2215 (sleep mutex:vnode interlock)
  522. 19195 5 26423 5 418 63 0 0 1 /usr/src/sys/dev/usb/usb_transfer.c:2197 (sleep mutex:USB device mutex)
  523. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:audit_record)
  524. 12 0 939575 0 1053660 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:4361 (sleep mutex:ix0:rx(7))
  525. 586 0 21564 0 105 205 0 0 1 /usr/src/sys/dev/ixgbe/ixgbe.c:1420 (sleep mutex:ix0:tx(4))
  526. 457 6 12706 6 106 119 0 0 1 /usr/src/sys/dev/ixgbe/ixgbe.c:1420 (sleep mutex:ix1:tx(4))
  527. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:mbuf_jumbo_9k)
  528. 1 0 163 0 274 0 0 0 0 /usr/src/sys/netpfil/pf/pf.c:1406 (rw:pf rulesets)
  529. 6 0 87 0 20 4 0 0 0 /usr/src/sys/netinet/in.c:1458 (rw:lle)
  530. 6 0 26 0 64 0 0 0 0 /usr/src/sys/kern/imgact_elf.c:895 (sleep mutex:process lock)
  531. 13 0 3105417 0 15513818 0 0 0 0 /usr/src/sys/netinet/in.c:1460 (rw:lle)
  532. 12 0 660 0 238 2 0 0 0 /usr/src/sys/kern/sys_generic.c:1723 (sleep mutex:sellck)
  533. 3 0 21 0 197 0 0 0 0 /usr/src/sys/kern/vfs_subr.c:2249 (sleep mutex:vnode interlock)
  534. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_data_buf_69632)
  535. 1 0 9 0 8 1 0 0 0 /usr/src/sys/kern/kern_exit.c:454 (sleep mutex:process lock)
  536. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:tcp_inpcb)
  537. 9 0 1330 0 20062 0 0 0 0 /usr/src/sys/kern/vfs_subr.c:2255 (sleep mutex:vnode interlock)
  538. 0 0 16 0 87 0 0 0 0 /usr/src/sys/kern/kern_proc.c:185 (sleep mutex:process_ctor)
  539. 7 0 549 0 1116 0 0 0 0 /usr/src/sys/kern/sys_generic.c:1757 (sleep mutex:sellck)
  540. 4 0 262 0 425 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:4420 (sleep mutex:ix0:rx(7))
  541. 2 0 64 0 86 0 0 0 0 /usr/src/sys/kern/kern_exit.c:489 (sleep mutex:process lock)
  542. 4 0 48 0 178 0 0 0 0 /usr/src/sys/dev/usb/usb_transfer.c:2198 (sleep mutex:ehci0)
  543. 2 0 190 0 346 0 0 0 0 /usr/src/sys/netinet/in_pcb.c:1792 (rw:pcbinfohash)
  544. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:MAP)
  545. 0 0 34 0 213 0 0 0 0 /usr/src/sys/kern/uipc_socket.c:1845 (sleep mutex:so_rcv)
  546. 0 0 10 0 65 0 0 0 0 /usr/src/sys/kern/kern_exec.c:376 (sleep mutex:process lock)
  547. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_buf_5120)
  548. 0 0 41 0 405 0 0 0 0 /usr/src/sys/kern/vfs_subr.c:2316 (sleep mutex:vnode interlock)
  549. 0 0 10 0 64 0 0 0 0 /usr/src/sys/amd64/amd64/../../kern/subr_syscall.c:202 (sleep mutex:process lock)
  550. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:4096)
  551. 8644 0 23718 0 144 164 0 0 0 /usr/src/sys/amd64/amd64/pmap.c:5298 (rw:pmap pv global)
  552. 39190 0 39536 0 86 459 0 0 0 /usr/src/sys/kern/kern_exit.c:540 (sleep mutex:process lock)
  553. 623 0 289925 0 701064 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:833 (sleep mutex:ix1:tx(7))
  554. 6 0 97848 0 352939 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:833 (sleep mutex:ix0:tx(7))
  555. 114353 0 139592 0 22693 6 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dbuf.c:616 (sx:dn->dn_struct_rwlock)
  556. 7 69 2481 69 10177 0 0 0 2 /usr/src/sys/vm/vm_fault.c:428 (sleep mutex:vm page)
  557. 1 0 51 0 442 0 0 0 0 /usr/src/sys/kern/vfs_subr.c:2368 (sleep mutex:vnode interlock)
  558. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:BUF TRIE)
  559. 1 0 13 0 31 0 0 0 0 /usr/src/sys/netinet/ip_input.c:593 (rw:if_addr_lock)
  560. 0 0 0 0 8 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dsl_dir.c:996 (sx:dd->dd_lock)
  561. 278658 26 982199 26 535 1835 0 0 1 /usr/src/sys/kern/kern_mutex.c:160 (sleep mutex:Giant)
  562. 1 0 117 0 116 1 0 0 0 /usr/src/sys/amd64/amd64/pmap.c:4728 (sleep mutex:pmap)
  563. 0 0 19 0 64 0 0 0 0 /usr/src/sys/kern/kern_sig.c:968 (sleep mutex:sigacts)
  564. 0 0 184 0 1922 0 0 0 0 /usr/src/sys/vm/vm_mmap.c:1524 (sleep mutex:process lock)
  565. 5 0 53 0 206 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dsl_dir.c:1045 (sx:dd->dd_lock)
  566. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:pf states)
  567. 1 0 14 0 42 0 0 0 1 /usr/src/sys/dev/ixgbe/ixgbe.c:906 (sleep mutex:ix0:tx(7))
  568. 2 303 41 545 178 0 3 0 7 /usr/src/sys/dev/ixgbe/ixgbe.c:906 (sleep mutex:ix1:tx(7))
  569. 3 0 130 0 178 0 0 0 0 /usr/src/sys/dev/usb/usb_transfer.c:2339 (sleep mutex:ehci0)
  570. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_buf_6144)
  571. 0 0 15 0 41 0 0 0 0 /usr/src/sys/vm/uma_core.c:2215 (sleep mutex:mbuf_jumbo_page)
  572. 0 0 59 0 724 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dmu.c:459 (sx:db->db_mtx)
  573. 14 0 856798 0 976904 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:4361 (sleep mutex:ix0:rx(8))
  574. 511 0 14068 0 116 121 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:1420 (sleep mutex:ix1:tx(5))
  575. 24938 0 47005 0 55 854 0 0 0 /usr/src/sys/kern/kern_sx.c:167 (sx:arc_reclaim_thr_lock)
  576. 2 0 78 0 118 0 0 0 0 /usr/src/sys/kern/sys_pipe.c:671 (sleep mutex:pipe mutex)
  577. 0 0 19 0 60 0 0 0 0 /usr/src/sys/kern/subr_unit.c:615 (sleep mutex:unit# allocation)
  578. 48 0 155 0 132 1 0 0 0 /usr/src/sys/vm/vm_map.c:1929 (sx:vm map (user))
  579. 9426 0 13733 0 1191 11 0 0 0 /usr/src/sys/amd64/amd64/pmap.c:4841 (sleep mutex:pmap)
  580. 9 1 4261 2 21184 0 0 0 2 /usr/src/sys/kern/vfs_subr.c:2498 (sleep mutex:vnode interlock)
  581. 9426 0 13559 0 1191 11 0 0 0 /usr/src/sys/amd64/amd64/pmap.c:4842 (sleep mutex:pmap)
  582. 94966 0 114210 0 914 124 0 0 0 /usr/src/sys/amd64/amd64/pmap.c:4844 (sleep mutex:pmap)
  583. 0 0 224 1 854 0 0 0 3 /usr/src/sys/netinet/if_ether.c:705 (rw:if_afdata)
  584. 94966 0 114234 0 914 124 0 0 0 /usr/src/sys/amd64/amd64/pmap.c:4845 (sleep mutex:pmap)
  585. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_data_buf_73728)
  586. 168 43224 4350 43239 10291 0 4 0 3 /usr/src/sys/vm/vm_object.c:753 (sleep mutex:vm page)
  587. 1 0 19 0 54 0 0 0 0 /usr/src/sys/kern/sys_pipe.c:708 (sleep mutex:pipe mutex)
  588. 3 0 543 0 980 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:4420 (sleep mutex:ix0:rx(8))
  589. 5808 0 7834 0 6439 1 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:462 (sx:zio->io_lock)
  590. 5808 0 6616 0 6439 1 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:463 (sx:zio->io_lock)
  591. 0 0 3 0 15 0 0 0 0 /usr/src/sys/dev/usb/controller/usb_controller.c:373 (sleep mutex:ehci1)
  592. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:SWAPMETA)
  593. 461401 0 1346337 0 51 26398 0 0 0 /usr/src/sys/kern/kern_mutex.c:160 (sleep mutex:em0)
  594. 9129 0 11071 0 6439 1 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:486 (sx:zio->io_lock)
  595. 9128 117 9904 117 6439 1 0 0 1 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:487 (sx:zio->io_lock)
  596. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_buf_7168)
  597. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:sa_cache)
  598. 5 0 96 0 64 1 0 0 0 /usr/src/sys/kern/kern_exec.c:634 (sleep mutex:process lock)
  599. 107060 0 107849 0 6441 16 0 0 0 /usr/src/sys/kern/kern_proc.c:841 (sleep mutex:sigacts)
  600. 28252 138 37948 138 43749 0 0 0 1 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:507 (sx:zio->io_lock)
  601. 2 0 23 0 54 0 0 0 0 /usr/src/sys/kern/vfs_bio.c:376 (sleep mutex:dirty buf lock)
  602. 37897 0 47177 0 7454 6 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:525 (sx:zio->io_lock)
  603. 202 0 1735 0 5235 0 0 0 0 /usr/src/sys/vm/vm_map.c:2885 (rw:vm object)
  604. 526 0 219572 0 490370 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:833 (sleep mutex:ix0:tx(8))
  605. 499 0 208206 0 486683 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:833 (sleep mutex:ix1:tx(8))
  606. 5 0 25 0 54 0 0 0 0 /usr/src/sys/vm/vm_pageout.c:979 (sleep mutex:vm inactive pagequeue)
  607. 1 0 96 0 854 0 0 0 0 /usr/src/sys/netinet/if_ether.c:808 (rw:if_afdata)
  608. 15538 0 16981 0 21133 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c:4687 (sx:zp->z_lock)
  609. 3037651 0 4434693 0 48 92389 0 0 0 /usr/src/sys/kern/kern_mutex.c:160 (sleep mutex:em1)
  610. 7 1 534 1 446 1 0 0 1 /usr/src/sys/kern/subr_eventhandler.c:251 (sleep mutex:eventhandler)
  611. 0 0 31 0 190 0 0 0 0 /usr/src/sys/kern/kern_descrip.c:929 (sleep mutex:sigio lock)
  612. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_data_buf_77824)
  613. 114351 0 116208 0 23720 4 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dbuf.c:622 (sx:db->db_mtx)
  614. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:THREAD)
  615. 196425 0 297738 0 493 603 0 0 0 /usr/src/sys/vm/vm_map.c:2098 (sx:vm map (user))
  616. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:rl_entry)
  617. 18234 0 50459 0 757 66 0 0 0 /usr/src/sys/netinet/tcp_output.c:301 (sleep mutex:so_snd)
  618. 0 0 27 0 87 0 0 0 0 /usr/src/sys/kern/kern_thread.c:1039 (rw:tidhash)
  619. 0 0 11 0 36 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:906 (sleep mutex:ix0:tx(8))
  620. 2 1 32 2 109 0 0 0 2 /usr/src/sys/dev/ixgbe/ixgbe.c:906 (sleep mutex:ix1:tx(8))
  621. 183761 172801 184387 181595 159 1159 1142 0 2 /usr/src/sys/kern/kern_exit.c:1134 (sx:proctree)
  622. 0 0 15 0 86 0 0 0 0 /usr/src/sys/kern/kern_thread.c:1047 (rw:tidhash)
  623. 21 0 621 0 209 2 0 0 0 /usr/src/sys/dev/usb/usb_request.c:544 (sleep mutex:USB device mutex)
  624. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_buf_8192)
  625. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:dnode_t)
  626. 0 0 43 0 570 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dsl_dir.c:1316 (sx:dd->dd_lock)
  627. 9 0 255 0 120 2 0 0 0 /usr/src/sys/dev/usb/usb_transfer.c:1769 (sleep mutex:ehci1)
  628. 10 0 661523 0 748483 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:4361 (sleep mutex:ix1:rx(9))
  629. 14 0 700349 0 790291 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:4361 (sleep mutex:ix0:rx(9))
  630. 479 0 15068 0 99 152 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:1420 (sleep mutex:ix0:tx(6))
  631. 574 0 13372 0 100 133 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:1420 (sleep mutex:ix1:tx(6))
  632. 50163 0 50440 0 428 117 0 0 0 /usr/src/sys/kern/kern_exit.c:913 (sleep mutex:process lock)
  633. 6 0 1553 0 5619 0 0 0 0 /usr/src/sys/kern/vfs_lookup.c:207 (sx:filedesc structure)
  634. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:procdesc)
  635. 1 0 41 0 29 1 0 0 0 /usr/src/sys/dev/usb/usb_request.c:493 (sleep mutex:ehci0)
  636. 0 0 31 0 91 0 0 0 0 /usr/src/sys/netinet6/frag6.c:736 (sleep mutex:ip6qlock)
  637. 1 0 249 0 2221 0 0 0 0 /usr/src/sys/kern/vfs_vnops.c:1641 (sleep mutex:struct mount mtx)
  638. 5 0 61 0 800 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dsl_dir.c:1354 (sx:dd->dd_lock)
  639. 1 0 21 0 60 0 0 0 0 /usr/src/sys/kern/subr_unit.c:870 (sleep mutex:unit# allocation)
  640. 17 0 182 0 120 1 0 0 0 /usr/src/sys/dev/usb/usb_transfer.c:1823 (sleep mutex:ehci1)
  641. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:PROC)
  642. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_data_buf_81920)
  643. 3 0 239 0 860 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:4420 (sleep mutex:ix1:rx(9))
  644. 12 0 1642 0 3891 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:4420 (sleep mutex:ix0:rx(9))
  645. 5828 0 6578 0 647 10 0 0 0 /usr/src/sys/amd64/amd64/pmap.c:5745 (rw:pmap pv global)
  646. 356704 0 357014 0 248 1439 0 0 0 /usr/src/sys/vm/vm_object.c:479 (lockmgr:zfs)
  647. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:8192)
  648. 0 0 190 0 2221 0 0 0 0 /usr/src/sys/kern/vfs_vnops.c:1723 (sleep mutex:struct mount mtx)
  649. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_buf_10240)
  650. 0 0 3 0 14 0 0 0 0 /usr/src/sys/dev/usb/controller/usb_controller.c:659 (sleep mutex:ehci1)
  651. 0 0 2 0 10 0 0 0 0 /usr/src/sys/kern/kern_descrip.c:1132 (sleep mutex:sigio lock)
  652. 2 73 183 147 2285 0 0 0 6 /usr/src/sys/vm/vm_object.c:257 (sleep mutex:vm object_list)
  653. 18198 0 18841 0 1981 9 0 0 0 /usr/src/sys/vm/vm_map.c:3125 (rw:vm object)
  654. 0 0 7 0 64 0 0 0 0 /usr/src/sys/kern/kern_exec.c:902 (sleep mutex:process lock)
  655. 666 0 285226 0 676528 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:833 (sleep mutex:ix0:tx(9))
  656. 625 0 397061 0 856693 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:833 (sleep mutex:ix1:tx(9))
  657. 7 38421 399 54007 1204 0 44 0 52 /usr/src/sys/kern/kern_mutex.c:160 (sleep mutex:taskqueue)
  658. 21094 0 64117 0 116 552 0 0 0 /usr/src/sys/vm/vm_map.c:2289 (sx:vm map (user))
  659. 6 0 2044 0 4301 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c:1616 (sx:buf_hash_table.ht_locks[i].ht_lock)
  660. 1 0 33 0 55 0 0 0 0 /usr/src/sys/kern/sys_pipe.c:1052 (sleep mutex:pipe mutex)
  661. 0 0 39 0 240 0 0 0 0 /usr/src/sys/dev/usb/usb_transfer.c:1945 (sleep mutex:ehci1)
  662. 3 0 13 0 17 0 0 0 0 /usr/src/sys/kern/kern_mutex.c:160 (sleep mutex:CAM device lock)
  663. 396299 8 1846843 16 22704 81 0 0 2 /usr/src/sys/kern/vfs_subr.c:2137 (lockmgr:zfs)
  664. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_data_buf_86016)
  665. 22 81 3739 83 18358 0 0 0 6 /usr/src/sys/vm/vm_fault.c:959 (sleep mutex:vm page)
  666. 1 0 1 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:UMA Zones)
  667. 22595 0 30264 0 5989 5 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zap_micro.c:491 (sx:zap->zap_rwlock)
  668. 196364 0 208253 0 6208 33 0 0 0 /usr/src/sys/vm/vm_object.c:1154 (sleep mutex:vm page)
  669. 3 417 77 936 247 0 3 0 4 /usr/src/sys/dev/ixgbe/ixgbe.c:906 (sleep mutex:ix1:tx(9))
  670. 5 241 87 257 245 0 1 0 6 /usr/src/sys/dev/ixgbe/ixgbe.c:906 (sleep mutex:ix0:tx(9))
  671. 5 0 66 0 492 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_cache.c:355 (sx:vc->vc_lock)
  672. 1 0 66 0 128 0 0 0 0 /usr/src/sys/vm/vm_glue.c:234 (rw:vm object)
  673. 0 0 88 0 342 0 0 0 0 /usr/src/sys/kern/kern_exit.c:1145 (sleep mutex:process lock)
  674. 396276 0 511519 0 2275 224 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_dir.c:221 (sx:zp->z_name_lock)
  675. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:mbuf_cluster)
  676. 21 0 815206 0 928518 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:4361 (sleep mutex:ix1:rx(10))
  677. 261 0 15441 0 128 120 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:1420 (sleep mutex:ix0:tx(7))
  678. 8965 0 14753 0 91 162 0 0 0 /usr/src/sys/netinet/igmp.c:2181 (sleep mutex:igmp_mtx)
  679. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_buf_12288)
  680. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_buf_28672)
  681. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:arc_buf_hdr_t)
  682. 1 0 29 0 28 1 0 0 0 /usr/src/sys/dev/usb/controller/ehci.c:3890 (sleep mutex:ehci0)
  683. 8644 0 23727 0 144 164 0 0 0 /usr/src/sys/amd64/amd64/pmap.c:5299 (sleep mutex:pmap)
  684. 74298 0 112769 0 494 228 0 0 0 /usr/src/sys/kern/kern_mutex.c:160 (sleep mutex:process lock)
  685. 2 0 9 0 14 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zil.c:1607 (sx:zilog->zl_lock)
  686. 15 958 13107581 252445472 15513486 0 16 0 9444644 /usr/src/sys/netinet/ip_fastfwd.c:593 (sleep mutex:rtentry)
  687. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:unpcb)
  688. 1 0 93 0 362 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dbuf.c:1241 (sx:dn->dn_struct_rwlock)
  689. 0 0 4 0 18 0 0 0 0 /usr/src/sys/kern/sys_socket.c:161 (sleep mutex:so_snd)
  690. 6 0 202 0 197 1 0 0 0 /usr/src/sys/kern/vfs_subr.c:2248 (lockmgr:zfs)
  691. 13 0 1301 0 3150 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:4420 (sleep mutex:ix1:rx(10))
  692. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_data_buf_90112)
  693. 5 0 110 0 55 2 0 0 0 /usr/src/sys/kern/sys_pipe.c:1208 (sleep mutex:pipe mutex)
  694. 5 0 25 0 89 0 0 0 0 /usr/src/sys/dev/usb/usb_transfer.c:2923 (sleep mutex:ehci0)
  695. 1 0 72 0 91 0 0 0 0 /usr/src/sys/netinet/ip_input.c:1162 (sleep mutex:ipqlock)
  696. 2 0 16 0 81 0 0 0 0 /usr/src/sys/vm/vm_map.c:3322 (rw:vm object)
  697. 5 0 32 0 54 0 0 0 0 /usr/src/sys/kern/kern_mutex.c:160 (sleep mutex:vm page free queue)
  698. 1 0 37 0 209 0 0 0 0 /usr/src/sys/dev/usb/usb_transfer.c:3022 (sleep mutex:USB device mutex)
  699. 1 0 32 0 54 0 0 0 0 /usr/src/sys/kern/kern_exit.c:1254 (sleep mutex:process lock)
  700. 4 0 347 0 116 2 0 0 0 /usr/src/sys/vm/vm_map.c:2494 (sx:vm map (user))
  701. 73216 60 111109 84 13633 8 0 0 17 /usr/src/sys/amd64/amd64/pmap.c:3208 (rw:pmap pv list)
  702. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:512)
  703. 5826 0 7846 0 5065 1 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dbuf.c:1055 (sx:db->db_mtx)
  704. 0 0 0 0 6 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:mbuf)
  705. 0 0 3 0 8 0 0 0 0 /usr/src/sys/kern/kern_exit.c:1280 (sleep mutex:process lock)
  706. 480 0 172200 0 415689 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:833 (sleep mutex:ix1:tx(10))
  707. 547 0 215787 0 512998 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:833 (sleep mutex:ix0:tx(10))
  708. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_buf_14336)
  709. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_buf_32768)
  710. 34909 0 50498 0 87 580 0 0 0 /usr/src/sys/kern/sys_generic.c:1384 (sx:filedesc structure)
  711. 3 0 67 0 296 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c:1275 (sx:arc_mru->arcs_locks[i].arcs_lock)
  712. 6 0 1414 0 4537 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c:1870 (sx:buf_hash_table.ht_locks[i].ht_lock)
  713. 0 0 3 0 16 0 0 0 0 /usr/src/sys/cam/cam_xpt.c:4320 (sleep mutex:CAM queue lock)
  714. 4 0 66 0 240 0 0 0 0 /usr/src/sys/dev/usb/usb_transfer.c:2198 (sleep mutex:ehci1)
  715. 10 0 227 0 54 4 0 0 0 /usr/src/sys/kern/kern_mutex.c:160 (sleep mutex:Syncer mtx)
  716. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:range_seg_cache)
  717. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_data_buf_94208)
  718. 0 0 29 0 179 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c:1310 (sx:arc_mru->arcs_locks[i].arcs_lock)
  719. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:hostcache)
  720. 0 452 13 452 46 0 9 0 1 /usr/src/sys/dev/ixgbe/ixgbe.c:906 (sleep mutex:ix1:tx(10))
  721. 0 108 32 266 143 0 1 0 4 /usr/src/sys/dev/ixgbe/ixgbe.c:906 (sleep mutex:ix0:tx(10))
  722. 1 0 89 0 116 0 0 0 0 /usr/src/sys/vm/vm_map.c:2596 (sx:vm map (user))
  723. 23833 0 24920 0 140 178 0 0 0 /usr/src/sys/kern/sys_generic.c:1459 (sx:filedesc structure)
  724. 23818 0 24899 0 1909 13 0 0 0 /usr/src/sys/kern/uipc_socket.c:2916 (sleep mutex:so_snd)
  725. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:syncache)
  726. 1 0 24 0 28 0 0 0 0 /usr/src/sys/kern/kern_time.c:756 (sleep mutex:process lock)
  727. 21405 0 21630 0 3 7210 0 0 0 /usr/src/sys/vm/uma_core.c:1772 (sleep mutex:UMA lock)
  728. 0 0 5 0 18 0 0 0 0 /usr/src/sys/kern/sys_socket.c:129 (sleep mutex:so_rcv)
  729. 0 0 14 0 212 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dnode.c:471 (sx:os->os_lock)
  730. 13 0 732556 0 834497 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:4361 (sleep mutex:ix0:rx(11))
  731. 13 0 671680 0 766179 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:4361 (sleep mutex:ix1:rx(11))
  732. 404 0 4766 0 118 40 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:1420 (sleep mutex:ix0:tx(8))
  733. 0 0 4 0 18 0 0 0 0 /usr/src/sys/kern/sys_socket.c:155 (sleep mutex:so_rcv)
  734. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_buf_16384)
  735. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_buf_36864)
  736. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:UMA Slabs)
  737. 0 0 3 0 18 0 0 0 0 /usr/src/sys/kern/sys_socket.c:158 (sleep mutex:so_rcv)
  738. 0 0 4 0 16 0 0 0 0 /usr/src/sys/cam/cam_xpt.c:4403 (sleep mutex:CAM queue lock)
  739. 13281 0 15769 0 39857 0 0 0 0 /usr/src/sys/amd64/amd64/pmap.c:5561 (sleep mutex:pmap)
  740. 5975 0 6002 0 54 111 0 0 0 /usr/src/sys/kern/kern_mutex.c:160 (sleep mutex:buffer daemon lock)
  741. 5 0 186 0 267 0 0 0 0 /usr/src/sys/kern/sys_pipe.c:1430 (sleep mutex:pipe mutex)
  742. 12 0 923 0 1850 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:4420 (sleep mutex:ix0:rx(11))
  743. 2 0 228 0 525 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:4420 (sleep mutex:ix1:rx(11))
  744. 121516 0 324977 0 51 6372 0 0 0 /usr/src/sys/kern/kern_mutex.c:160 (sleep mutex:ix1)
  745. 0 0 150 0 2273 0 0 0 1 /usr/src/sys/vm/vm_object.c:672 (sleep mutex:vm object_list)
  746. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:16384)
  747. 3 0 170 0 240 0 0 0 0 /usr/src/sys/dev/usb/usb_transfer.c:2339 (sleep mutex:ehci1)
  748. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_link_cache)
  749. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_data_buf_98304)
  750. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:cyclic_id_cache)
  751. 2 0 854 0 2946 0 0 0 0 /usr/src/sys/vm/uma_core.c:2215 (sleep mutex:256 Bucket)
  752. 3 0 3 0 1 3 0 0 0 /usr/src/sys/cam/cam_xpt.c:3294 (sleep mutex:AHCI enclosure lock)
  753. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:selfd)
  754. 0 0 21 0 64 0 0 0 0 /usr/src/sys/kern/subr_eventhandler.c:254 (sleep mutex:process_exec)
  755. 2 0 54 0 67 0 0 0 0 /usr/src/sys/kern/sys_pipe.c:1503 (sleep mutex:pipe mutex)
  756. 822 0 454096 0 944869 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:833 (sleep mutex:ix1:tx(11))
  757. 694 0 253405 0 650371 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:833 (sleep mutex:ix0:tx(11))
  758. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:fakepg)
  759. 0 0 148 0 2076 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/txg.c:758 (sx:tl->tl_lock)
  760. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_buf_20480)
  761. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_buf_40960)
  762. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:sackhole)
  763. 5 1 845 4 10493 0 0 0 9 /usr/src/sys/vm/vm_page.c:2045 (sleep mutex:vm inactive pagequeue)
  764. 0 0 16 0 86 0 0 0 0 /usr/src/sys/fs/pseudofs/pseudofs_vncache.c:321 (sleep mutex:pfs_vncache)
  765. 2 0 373 0 735 0 0 0 0 /usr/src/sys/vm/vm_object.c:1601 (sleep mutex:vm page)
  766. 177 0 1583 0 64 24 0 0 0 /usr/src/sys/kern/imgact_elf.c:822 (lockmgr:zfs)
  767. 0 0 11 0 86 0 0 0 0 /usr/src/sys/kern/kern_exit.c:541 (sleep mutex:sigacts)
  768. 23818 0 24416 0 1909 12 0 0 0 /usr/src/sys/kern/uipc_socket.c:2917 (sleep mutex:so_rcv)
  769. 83 0 887 0 589 1 0 0 0 /usr/src/sys/amd64/amd64/pmap.c:3530 (rw:pmap pv list)
  770. 0 0 31 0 323 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/txg.c:809 (sx:tl->tl_lock)
  771. 0 0 29 0 150 0 0 0 0 /usr/src/sys/modules/dtrace/fasttrap/../../../cddl/contrib/opensolaris/uts/common/dtrace/fasttrap.c:1781 (sx:fasttrap_provs.fth_table[i].ftb_mtx)
  772. 4 687 98 1322 261 0 5 0 5 /usr/src/sys/dev/ixgbe/ixgbe.c:906 (sleep mutex:ix0:tx(11))
  773. 7 807 109 3253 257 0 12 0 7 /usr/src/sys/dev/ixgbe/ixgbe.c:906 (sleep mutex:ix1:tx(11))
  774. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_data_buf_512)
  775. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_data_buf_102400)
  776. 7 0 247 0 3030 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/vdev.c:2856 (sx:vd->vdev_stat_lock)
  777. 4 0 40 0 93 0 0 0 0 /usr/src/sys/kern/kern_descrip.c:836 (sx:filedesc structure)
  778. 10 0 21 0 89 0 0 0 0 /usr/src/sys/vm/uma_core.c:2725 (sleep mutex:zio_cache)
  779. 5 0 242 0 2436 0 0 0 1 /usr/src/sys/geom/geom_io.c:548 (sleep mutex:sleep mtxpool)
  780. 5 0 204 0 91 2 0 0 0 /usr/src/sys/netinet6/mld6.c:1752 (sleep mutex:mld_mtx)
  781. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:STS VFS Cache)
  782. 7 0 69 0 55 1 0 0 0 /usr/src/sys/kern/vfs_subr.c:891 (sleep mutex:vnode_free_list)
  783. 448 0 15892 0 91 174 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:1420 (sleep mutex:ix1:tx(9))
  784. 403 0 14333 0 95 150 0 0 1 /usr/src/sys/dev/ixgbe/ixgbe.c:1420 (sleep mutex:ix0:tx(9))
  785. 6 0 118 0 142 0 0 0 1 /usr/src/sys/kern/sys_pipe.c:1642 (sleep mutex:pipe mutex)
  786. 20495 0 47865 0 664 72 0 0 0 /usr/src/sys/vm/vm_pageout.c:305 (sleep mutex:vm page)
  787. 0 0 2 0 10 0 0 0 0 /usr/src/sys/vm/uma_core.c:2725 (sleep mutex:g_bio)
  788. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_buf_24576)
  789. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_buf_45056)
  790. 19246 0 367414666 0 15513962 23 0 0 0 /usr/src/sys/net/route.c:431 (rw:radix node head)
  791. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:pf state keys)
  792. 0 0 19 0 163 0 0 0 0 /usr/src/sys/kern/kern_prot.c:1231 (sleep mutex:process lock)
  793. 0 0 37 0 142 0 0 0 0 /usr/src/sys/kern/sys_pipe.c:1682 (sleep mutex:pipe mutex)
  794. 2 0 350 0 5065 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dbuf.c:1065 (sx:dn->dn_mtx)
  795. 1 0 31 0 64 0 0 0 0 /usr/src/sys/kern/imgact_elf.c:947 (lockmgr:zfs)
  796. 2 0 341 0 933 0 0 0 0 /usr/src/sys/amd64/amd64/pmap.c:5852 (sleep mutex:pmap)
  797. 5 0 5 0 1 5 0 0 0 /usr/src/sys/cam/scsi/scsi_enc_ses.c:1910 (sx:enccache)
  798. 2 0 166 0 1551 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:1440 (sx:zio->io_lock)
  799. 0 0 17 0 88 0 0 0 0 /usr/src/sys/kern/kern_sig.c:2099 (sleep mutex:sigacts)
  800. 5760 0 7796 0 10153 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dmu_zfetch.c:368 (sx:zf->zf_rwlock)
  801. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:UMA RCntSlabs)
  802. 5865 0 6126 0 2436 2 0 0 0 /usr/src/sys/geom/geom_io.c:657 (sleep mutex:sleep mtxpool)
  803. 116 0 1264 0 98 12 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dbuf.c:2341 (sx:dr->dt.di.dr_mtx)
  804. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_data_buf_1024)
  805. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_data_buf_106496)
  806. 13588 0 21384 0 935 22 0 0 0 /usr/src/sys/kern/kern_sysctl.c:874 (sx:sysctl lock)
  807. 1 0 182 0 854 0 0 0 0 /usr/src/sys/netinet/if_ether.c:598 (rw:in_ifaddr_lock)
  808. 1 0 42 0 30 1 0 0 0 /usr/src/sys/dev/usb/usb_request.c:493 (sleep mutex:ehci1)
  809. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:ttyoutq)
  810. 1 0 53 0 110 0 0 0 0 /usr/src/sys/libkern/arc4random.c:141 (sleep mutex:arc4_mtx)
  811. 213 0 2931 0 215 13 0 0 0 /usr/src/sys/vm/vm_map.c:3029 (sx:vm map (user))
  812. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_buf_49152)
  813. 3 0 112 0 52 2 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/trim_map.c:577 (sx:spa->spa_trim_lock)
  814. 0 0 23 0 135 0 0 0 0 /usr/src/sys/kern/kern_exec.c:997 (sleep mutex:vm page)
  815. 25160 0 25491 0 493 51 0 0 0 /usr/src/sys/amd64/amd64/pmap.c:5948 (sleep mutex:pmap)
  816. 1 0 42 0 141 0 0 0 0 /usr/src/sys/netinet/tcp_hostcache.c:290 (sleep mutex:tcp_hc_entry)
  817. 0 0 14 0 194 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dsl_dataset.c:108 (sx:ds->ds_lock)
  818. 0 0 15 0 135 0 0 0 0 /usr/src/sys/kern/kern_exec.c:1019 (sleep mutex:vm page)
  819. 0 0 25 0 264 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dbuf.c:1197 (sx:dn->dn_mtx)
  820. 0 0 26 0 255 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/bplist.c:50 (sx:bpl->bpl_lock)
  821. 0 0 24 0 228 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zap_micro.c:1223 (sx:zap->zap_rwlock)
  822. 33500 0 66850 0 54 1237 0 0 0 /usr/src/sys/vm/vm_pageout.c:1336 (sleep mutex:vm active pagequeue)
  823. 0 0 74 0 445 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dbuf.c:1217 (sx:dn->dn_mtx)
  824. 0 0 15 0 194 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dsl_dataset.c:152 (sx:ds->ds_lock)
  825. 0 0 7 0 32 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/bplist.c:67 (sx:bpl->bpl_lock)
  826. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_data_buf_1536)
  827. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_data_buf_110592)
  828. 387 0 6092 0 112 54 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:1420 (sleep mutex:ix1:tx(10))
  829. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:socket)
  830. 24 0 892 0 1731 0 0 0 0 /usr/src/sys/vm/vm_object.c:1917 (sleep mutex:vm page)
  831. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:mbuf_jumbo_16k)
  832. 1 0 216 0 1746 0 0 0 0 /usr/src/sys/vm/vm_object.c:427 (rw:vm object)
  833. 0 0 10 0 28 0 0 0 0 /usr/src/sys/netinet/udp_usrreq.c:500 (rw:udp)
  834. 2 0 16 0 194 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dsl_dataset.c:193 (sx:ds->ds_lock)
  835. 6 0 272 0 861 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zap_micro.c:1287 (sx:zap->zap_rwlock)
  836. 10 0 579 0 3094 0 0 0 0 /usr/src/sys/vm/vm_glue.c:168 (sx:vm map (user))
  837. 1 0 20 0 67 0 0 0 0 /usr/src/sys/kern/kern_mutex.c:160 (sleep mutex:pipe mutex)
  838. 0 0 24 0 206 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dbuf.c:1289 (sx:dn->dn_mtx)
  839. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_buf_53248)
  840. 2 0 749 1 10388 0 0 0 5 /usr/src/sys/vm/vm_page.c:2422 (sleep mutex:vm inactive pagequeue)
  841. 45648 193 57618 569 16630 3 0 0 62 /usr/src/sys/vm/vm_page.c:1486 (sleep mutex:vm page free queue)
  842. 2 0 49 0 248 0 0 0 0 /usr/src/sys/vm/vm_object.c:481 (rw:vm object)
  843. 1 0 320 0 1292 0 0 0 0 /usr/src/sys/vm/swap_pager.c:225 (sleep mutex:process lock)
  844. 51172 0 123801 0 16201 7 0 0 0 /usr/src/sys/vm/vm_fault.c:303 (rw:vm object)
  845. 15515 0 20850 0 9741 2 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dnode.c:1088 (sx:dn->dn_struct_rwlock)
  846. 5 0 104 0 1361 0 0 0 0 /usr/src/sys/vm/vm_map.c:4041 (rw:vm object)
  847. 9 0 245 0 64 3 0 0 0 /usr/src/sys/kern/kern_exec.c:614 (lockmgr:zfs)
  848. 105080 0 105160 0 88 1195 0 0 0 /usr/src/sys/netinet6/nd6.c:1894 (rw:if_afdata)
  849. 43228 0 50870 0 25269 2 0 0 0 /usr/src/sys/vm/vm_object.c:513 (rw:vm object)
  850. 1 0 38 0 430 0 0 0 0 /usr/src/sys/vm/vm_map.c:4069 (rw:vm object)
  851. 5886 0 8425 0 5541 1 0 0 0 /usr/src/sys/vm/vm_fault.c:341 (rw:vm object)
  852. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_data_buf_2048)
  853. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_data_buf_114688)
  854. 1 0 30 0 30 1 0 0 0 /usr/src/sys/dev/usb/controller/ehci.c:3890 (sleep mutex:ehci1)
  855. 2 0 587 0 2946 0 0 0 0 /usr/src/sys/vm/uma_core.c:2725 (sleep mutex:256 Bucket)
  856. 16 0 488 0 1815 0 0 0 0 /usr/src/sys/kern/kern_descrip.c:1220 (sx:filedesc structure)
  857. 0 0 24 0 88 0 0 0 0 /usr/src/sys/netinet/tcp_input.c:1730 (sleep mutex:so_snd)
  858. 103920 0 148998 0 81 1839 0 0 0 /usr/src/sys/vm/vm_map.c:3265 (sx:vm map (user))
  859. 12 779 12500816 286324556 15513872 0 18 0 9788497 /usr/src/sys/netinet/in_rmx.c:114 (sleep mutex:rtentry)
  860. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:zio_buf_57344)
  861. 2 0 30 0 120 0 0 0 0 /usr/src/sys/dev/usb/usb_transfer.c:2923 (sleep mutex:ehci1)
  862. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:472 (sleep mutex:L VFS Cache)
  863. 1 0 29 0 52 0 0 0 0 /usr/src/sys/kern/kern_sx.c:167 (sx:spa->spa_trim_lock)
  864. 12 0 2513 3 7466 0 0 0 7 /usr/src/sys/kern/kern_intr.c:916 (spin mutex:sched lock 5)
  865. 1 0 219 0 593 0 0 0 0 /usr/src/sys/kern/kern_proc.c:944 (spin mutex:sched lock 5)
  866. 2 0 116 0 204 0 0 0 0 /usr/src/sys/kern/sched_ule.c:885 (spin mutex:sched lock 9)
  867. 1 1 1526 5 5982 0 0 0 11 /usr/src/sys/kern/sched_ule.c:886 (spin mutex:sched lock 9)
  868. 1 0 752 1 2412 0 0 0 3 /usr/src/sys/kern/sched_ule.c:888 (spin mutex:sched lock 9)
  869. 2 0 328 0 1096 0 0 0 0 /usr/src/sys/kern/sched_ule.c:889 (spin mutex:sched lock 9)
  870. 0 0 1 0 4 0 0 0 0 /usr/src/sys/kern/vfs_subr.c:1900 (spin mutex:sched lock 0)
  871. 1 0 400 0 2682 0 0 0 1 /usr/src/sys/kern/kern_switch.c:211 (spin mutex:sched lock 0)
  872. 0 0 234 0 1964 0 0 0 0 /usr/src/sys/kern/kern_proc.c:774 (spin mutex:sched lock 0)
  873. 0 0 2905 0 27799 0 0 0 0 /usr/src/sys/kern/kern_proc.c:774 (spin mutex:sleepq chain)
  874. 0 0 0 0 2 0 0 0 0 /usr/src/sys/kern/kern_thread.c:489 (spin mutex:sched lock 0)
  875. 1 0 232 0 432 0 0 0 0 /usr/src/sys/kern/kern_resource.c:634 (spin mutex:process slock)
  876. 0 0 68 0 576 0 0 0 0 /usr/src/sys/kern/kern_resource.c:1075 (spin mutex:sched lock 2)
  877. 10 0 1866 1 3836 0 0 0 3 /usr/src/sys/kern/kern_intr.c:916 (spin mutex:sched lock 0)
  878. 1 0 642 0 1988 0 0 0 0 /usr/src/sys/kern/kern_proc.c:944 (spin mutex:sched lock 0)
  879. 2 0 353 0 950 0 0 0 0 /usr/src/sys/kern/sched_ule.c:885 (spin mutex:sched lock 4)
  880. 1 1 748 4 2681 0 0 0 7 /usr/src/sys/kern/sched_ule.c:886 (spin mutex:sched lock 4)
  881. 1 2 1594 20 4995 0 0 0 26 /usr/src/sys/kern/sched_ule.c:888 (spin mutex:sched lock 4)
  882. 1 0 231 0 793 0 0 0 0 /usr/src/sys/kern/sched_ule.c:889 (spin mutex:sched lock 4)
  883. 2 0 9420 0 33675 0 0 0 1 /usr/src/sys/kern/kern_proc.c:944 (spin mutex:sleepq chain)
  884. 0 0 22 0 150 0 0 0 0 /usr/src/sys/kern/kern_umtx.c:3910 (spin mutex:umtx lock)
  885. 12 0 113454 0 813371 0 0 0 0 /usr/src/sys/kern/kern_clocksource.c:233 (spin mutex:et_hw_mtx)
  886. 1 0 186 0 520 0 0 0 2 /usr/src/sys/kern/sched_ule.c:1184 (spin mutex:sched lock 9)
  887. 0 0 47 0 211 0 0 0 0 /usr/src/sys/x86/x86/io_apic.c:209 (spin mutex:icu)
  888. 0 0 64 0 453 0 0 0 0 /usr/src/sys/kern/kern_proc.c:774 (spin mutex:sched lock 11)
  889. 5 6 14949 6 33534 0 0 0 1 /usr/src/sys/kern/subr_taskqueue.c:235 (spin mutex:fast_taskqueue)
  890. 2 1 5409 12 5624 0 0 0 18 /usr/src/sys/kern/subr_taskqueue.c:344 (spin mutex:fast_taskqueue)
  891. 0 0 4 0 14 0 0 0 0 /usr/src/sys/kern/sched_ule.c:2137 (spin mutex:sched lock 8)
  892. 12 0 902 0 2253 0 0 0 0 /usr/src/sys/kern/kern_intr.c:916 (spin mutex:sched lock 11)
  893. 1 0 205 0 602 0 0 0 0 /usr/src/sys/kern/kern_proc.c:944 (spin mutex:sched lock 11)
  894. 1 0 279 0 777 0 0 0 1 /usr/src/sys/kern/sched_ule.c:1184 (spin mutex:sched lock 4)
  895. 0 0 72 0 263 0 0 0 0 /usr/src/sys/dev/random/random_harvestq.c:183 (spin mutex:entropy harvest mutex)
  896. 0 0 127 0 271 0 0 0 0 /usr/src/sys/dev/random/random_harvestq.c:198 (spin mutex:entropy harvest mutex)
  897. 0 2 68 2 532 0 0 0 1 /usr/src/sys/kern/kern_proc.c:774 (spin mutex:sched lock 6)
  898. 0 0 333 0 1359 0 0 0 0 /usr/src/sys/dev/random/random_harvestq.c:294 (spin mutex:entropy harvest mutex)
  899. 1 1 1127 9 3584 0 0 0 18 /usr/src/sys/kern/kern_intr.c:1370 (spin mutex:sched lock 0)
  900. 0 0 71 0 567 0 0 0 0 /usr/src/sys/kern/kern_resource.c:1075 (spin mutex:sched lock 8)
  901. 13 0 1420 0 3836 0 0 0 2 /usr/src/sys/kern/kern_intr.c:916 (spin mutex:sched lock 6)
  902. 1 0 211 0 571 0 0 0 0 /usr/src/sys/kern/kern_proc.c:944 (spin mutex:sched lock 6)
  903. 2 0 552 1 2080 0 0 0 3 /usr/src/sys/kern/sched_ule.c:885 (spin mutex:sched lock 10)
  904. 9 2 1842 16 7052 0 0 0 25 /usr/src/sys/kern/sched_ule.c:886 (spin mutex:sched lock 10)
  905. 2 0 47 1 93 0 0 0 2 /usr/src/sys/kern/sched_ule.c:888 (spin mutex:sched lock 10)
  906. 2 1 4154 18 26060 0 0 0 28 /usr/src/sys/kern/sched_ule.c:889 (spin mutex:sched lock 10)
  907. 0 0 325 0 2629 0 0 0 0 /usr/src/sys/kern/kern_clocksource.c:767 (spin mutex:et_hw_mtx)
  908. 0 0 64 0 485 0 0 0 0 /usr/src/sys/kern/kern_proc.c:774 (spin mutex:sched lock 1)
  909. 0 0 1026 0 5999 0 0 0 0 /usr/src/sys/kern/kern_clocksource.c:869 (spin mutex:et_hw_mtx)
  910. 0 0 65 0 554 0 0 0 0 /usr/src/sys/kern/kern_resource.c:1075 (spin mutex:sched lock 3)
  911. 7 1 1559 24 3847 0 0 0 41 /usr/src/sys/kern/kern_intr.c:916 (spin mutex:sched lock 1)
  912. 1 0 195 0 524 0 0 0 0 /usr/src/sys/kern/kern_proc.c:944 (spin mutex:sched lock 1)
  913. 1 0 521 0 1293 0 0 0 0 /usr/src/sys/kern/sched_ule.c:885 (spin mutex:sched lock 5)
  914. 1 2 842 4 3097 0 0 0 4 /usr/src/sys/kern/sched_ule.c:886 (spin mutex:sched lock 5)
  915. 12 1 1910 8 6496 0 0 0 9 /usr/src/sys/kern/sched_ule.c:888 (spin mutex:sched lock 5)
  916. 1 0 664 0 2074 0 0 0 2 /usr/src/sys/kern/sched_ule.c:889 (spin mutex:sched lock 5)
  917. 1 1 295 18 747 0 0 0 28 /usr/src/sys/kern/sched_ule.c:1184 (spin mutex:sched lock 10)
  918. 0 0 14 0 87 0 0 0 0 /usr/src/sys/kern/kern_fork.c:682 (spin mutex:process slock)
  919. 0 0 17 0 56 0 0 0 0 /usr/src/sys/kern/sched_ule.c:875 (spin mutex:sched lock 0)
  920. 13 0 1069 1 2519 0 0 0 2 /usr/src/sys/kern/sched_ule.c:885 (spin mutex:sched lock 0)
  921. 2 1 3314 32 10192 0 0 0 51 /usr/src/sys/kern/sched_ule.c:888 (spin mutex:sched lock 0)
  922. 1 2 264 5 860 0 0 0 5 /usr/src/sys/kern/sched_ule.c:1184 (spin mutex:sched lock 5)
  923. 0 1 76 3 554 0 0 0 4 /usr/src/sys/kern/kern_proc.c:774 (spin mutex:sched lock 7)
  924. 0 0 69 0 548 0 0 0 0 /usr/src/sys/kern/kern_resource.c:1075 (spin mutex:sched lock 9)
  925. 13 2 1707 28 3896 0 0 0 29 /usr/src/sys/kern/kern_intr.c:916 (spin mutex:sched lock 7)
  926. 1 0 219 0 574 0 0 0 0 /usr/src/sys/kern/kern_proc.c:944 (spin mutex:sched lock 7)
  927. 2 0 1797 3 6957 0 0 0 7 /usr/src/sys/kern/sched_ule.c:886 (spin mutex:sched lock 11)
  928. 2 0 296 0 811 0 0 0 0 /usr/src/sys/kern/sched_ule.c:889 (spin mutex:sched lock 11)
  929. 1 0 258 0 843 0 0 0 0 /usr/src/sys/kern/sched_ule.c:1184 (spin mutex:sched lock 0)
  930. 0 0 67 0 576 0 0 0 0 /usr/src/sys/kern/kern_proc.c:774 (spin mutex:sched lock 2)
  931. 0 0 55 0 459 0 0 0 1 /usr/src/sys/kern/kern_resource.c:1075 (spin mutex:sched lock 4)
  932. 4 0 334 0 121 2 0 0 0 /usr/src/sys/amd64/amd64/mp_machdep.c:1145 (spin mutex:smp rendezvous)
  933. 9 0 4843 1 9731 0 0 0 5 /usr/src/sys/kern/kern_intr.c:916 (spin mutex:sched lock 2)
  934. 1 0 211 0 586 0 0 0 1 /usr/src/sys/kern/kern_proc.c:944 (spin mutex:sched lock 2)
  935. 2 0 323 0 615 0 0 0 0 /usr/src/sys/kern/sched_ule.c:885 (spin mutex:sched lock 6)
  936. 2 1 551 17 2123 0 0 0 23 /usr/src/sys/kern/sched_ule.c:886 (spin mutex:sched lock 6)
  937. 2 1 2114 13 6353 0 0 0 24 /usr/src/sys/kern/sched_ule.c:888 (spin mutex:sched lock 6)
  938. 12 0 184 0 618 0 0 0 0 /usr/src/sys/kern/sched_ule.c:889 (spin mutex:sched lock 6)
  939. 1 0 221 0 567 0 0 0 1 /usr/src/sys/kern/sched_ule.c:1184 (spin mutex:sched lock 11)
  940. 9 1 5135 45 19402 0 0 0 78 /usr/src/sys/kern/sched_ule.c:885 (spin mutex:sched lock 1)
  941. 1 0 100 0 257 0 0 0 0 /usr/src/sys/kern/sched_ule.c:886 (spin mutex:sched lock 1)
  942. 2 0 2133 0 6934 0 0 0 3 /usr/src/sys/kern/sched_ule.c:888 (spin mutex:sched lock 1)
  943. 2 0 445 8 2301 0 0 0 13 /usr/src/sys/kern/sched_ule.c:889 (spin mutex:sched lock 1)
  944. 1 0 201 0 534 0 0 0 1 /usr/src/sys/kern/sched_ule.c:1184 (spin mutex:sched lock 6)
  945. 0 0 71 0 548 0 0 0 0 /usr/src/sys/kern/kern_proc.c:774 (spin mutex:sched lock 8)
  946. 84 0 11163 0 6441 1 0 0 0 /usr/src/sys/kern/kern_proc.c:874 (spin mutex:process slock)
  947. 0 0 13 0 21 0 0 0 0 /usr/src/sys/kern/kern_synch.c:609 (spin mutex:sched lock 0)
  948. 3 0 15852 0 35539 0 0 0 0 /usr/src/sys/kern/kern_proc.c:943 (spin mutex:process slock)
  949. 0 0 68 0 567 0 0 0 0 /usr/src/sys/kern/kern_resource.c:1075 (spin mutex:sched lock 10)
  950. 1 0 164 0 271 0 0 0 0 /usr/src/sys/kern/kern_synch.c:345 (spin mutex:entropy harvest mutex)
  951. 2 2 1604 22 3421 0 0 0 20 /usr/src/sys/kern/kern_intr.c:916 (spin mutex:sched lock 8)
  952. 1 0 229 0 668 0 0 0 1 /usr/src/sys/kern/kern_proc.c:944 (spin mutex:sched lock 8)
  953. 0 0 248 0 705 0 0 0 0 /usr/src/sys/kern/sched_ule.c:1897 (spin mutex:sched lock 0)
  954. 1 0 793 0 7277 0 0 0 0 /usr/src/sys/kern/sched_ule.c:1940 (spin mutex:sched lock 0)
  955. 1 2 437 35 1453 0 0 0 44 /usr/src/sys/kern/sched_ule.c:1184 (spin mutex:sched lock 1)
  956. 0 0 74 0 542 0 0 0 0 /usr/src/sys/kern/kern_proc.c:774 (spin mutex:sched lock 3)
  957. 1 0 11 0 14 0 0 0 0 /usr/src/sys/kern/subr_turnstile.c:211 (spin mutex:sched lock 0)
  958. 17 5 30355 27 80814 0 0 0 26 /usr/src/sys/kern/subr_sleepqueue.c:237 (spin mutex:sleepq chain)
  959. 0 2 73 2 569 0 0 0 2 /usr/src/sys/kern/kern_resource.c:1075 (spin mutex:sched lock 5)
  960. 0 1 95 1 694 0 0 0 1 /usr/src/sys/kern/subr_sleepqueue.c:340 (spin mutex:sched lock 0)
  961. 10 1 1410 2 3025 0 0 0 3 /usr/src/sys/kern/kern_intr.c:916 (spin mutex:sched lock 3)
  962. 0 0 5 0 29 0 0 0 0 /usr/src/sys/kern/sched_ule.c:2151 (spin mutex:sched lock 0)
  963. 1 0 211 0 572 0 0 0 0 /usr/src/sys/kern/kern_proc.c:944 (spin mutex:sched lock 3)
  964. 2 1 2735 34 10070 0 0 0 38 /usr/src/sys/kern/sched_ule.c:885 (spin mutex:sched lock 7)
  965. 2 0 617 0 2423 0 0 0 0 /usr/src/sys/kern/sched_ule.c:886 (spin mutex:sched lock 7)
  966. 1 2 1231 5 3782 0 0 0 8 /usr/src/sys/kern/sched_ule.c:888 (spin mutex:sched lock 7)
  967. 2 1 2626 28 16205 0 0 0 32 /usr/src/sys/kern/sched_ule.c:889 (spin mutex:sched lock 7)
  968. 0 0 3 0 12 0 0 0 0 /usr/src/sys/kern/sched_ule.c:2188 (spin mutex:sched lock 0)
  969. 13 0 287 0 105 2 0 0 0 /usr/src/sys/kern/subr_turnstile.c:542 (spin mutex:turnstile chain)
  970. 0 0 18 0 71 0 0 0 0 /usr/src/sys/kern/subr_sleepqueue.c:424 (spin mutex:sched lock 0)
  971. 4 9 143616 15401 177502 0 0 0 13551 /usr/src/sys/kern/subr_turnstile.c:552 (spin mutex:turnstile chain)
  972. 0 0 226 0 1975 0 0 0 1 /usr/src/sys/kern/kern_resource.c:1075 (spin mutex:sched lock 0)
  973. 0 0 0 0 2 0 0 0 0 /usr/src/sys/kern/sched_ule.c:2137 (spin mutex:sched lock 11)
  974. 0 0 82 0 558 0 0 0 0 /usr/src/sys/kern/subr_sleepqueue.c:616 (spin mutex:sched lock 0)
  975. 0 0 3201 0 28237 0 0 0 0 /usr/src/sys/kern/kern_resource.c:1075 (spin mutex:sleepq chain)
  976. 2 0 301 0 813 0 0 0 0 /usr/src/sys/kern/sched_ule.c:885 (spin mutex:sched lock 2)
  977. 1 13 718 18 2812 0 0 0 9 /usr/src/sys/kern/sched_ule.c:886 (spin mutex:sched lock 2)
  978. 13 3 2538 33 7924 0 0 0 43 /usr/src/sys/kern/sched_ule.c:888 (spin mutex:sched lock 2)
  979. 1 0 66 0 296 0 0 0 0 /usr/src/sys/kern/sched_ule.c:889 (spin mutex:sched lock 2)
  980. 0 0 15 0 65 0 0 0 0 /usr/src/sys/kern/subr_sleepqueue.c:651 (spin mutex:sched lock 0)
  981. 9 2 344 33 1083 0 0 0 36 /usr/src/sys/kern/sched_ule.c:1184 (spin mutex:sched lock 7)
  982. 0 0 80 0 542 0 0 0 0 /usr/src/sys/kern/kern_proc.c:774 (spin mutex:sched lock 9)
  983. 0 0 2 0 11 0 0 0 0 /usr/src/sys/kern/subr_turnstile.c:731 (spin mutex:sched lock 0)
  984. 4 0 186 0 86 2 0 0 0 /usr/src/sys/kern/kern_exit.c:597 (spin mutex:process slock)
  985. 0 0 1 0 3 0 0 0 0 /usr/src/sys/kern/sched_ule.c:2611 (spin mutex:sched lock 0)
  986. 0 0 53 0 453 0 0 0 0 /usr/src/sys/kern/kern_resource.c:1075 (spin mutex:sched lock 11)
  987. 0 0 1 0 2 0 0 0 0 /usr/src/sys/kern/kern_fork.c:484 (spin mutex:sched lock 0)
  988. 12 1 1430 1 4676 0 0 0 1 /usr/src/sys/kern/kern_intr.c:916 (spin mutex:sched lock 9)
  989. 0 0 219 0 585 0 0 0 0 /usr/src/sys/kern/kern_proc.c:944 (spin mutex:sched lock 9)
  990. 0 0 5 0 10 0 0 0 0 /usr/src/sys/kern/subr_turnstile.c:896 (spin mutex:sched lock 0)
  991. 0 0 0 0 4 0 0 0 0 /usr/src/sys/kern/sched_ule.c:2712 (spin mutex:sched lock 0)
  992. 1 0 133 0 367 0 0 0 0 /usr/src/sys/kern/sched_ule.c:1184 (spin mutex:sched lock 2)
  993. 3 0 2118 0 1492 1 0 0 0 /usr/src/sys/kern/subr_sleepqueue.c:893 (spin mutex:sleepq chain)
  994. 0 0 64 0 449 0 0 0 0 /usr/src/sys/kern/kern_proc.c:774 (spin mutex:sched lock 4)
  995. 0 0 1 0 4 0 0 0 0 /usr/src/sys/kern/kern_umtx.c:3917 (spin mutex:sched lock 0)
  996. 5 0 107317 0 177482 0 0 0 0 /usr/src/sys/kern/subr_turnstile.c:561 (spin mutex:turnstile lock)
  997. 0 0 965 0 4135 0 0 0 0 /usr/src/sys/kern/kern_synch.c:345 (spin mutex:fast_taskqueue)
  998. 11 0 257 0 105 2 0 0 1 /usr/src/sys/kern/subr_turnstile.c:599 (spin mutex:turnstile lock)
  999. 1 0 1 0 2 0 0 0 0 /usr/src/sys/kern/kern_fork.c:721 (spin mutex:sched lock 0)
  1000. 0 0 69 0 540 0 0 0 0 /usr/src/sys/kern/kern_resource.c:1075 (spin mutex:sched lock 6)
  1001. 0 0 20 0 103 0 0 0 0 /usr/src/sys/kern/subr_turnstile.c:713 (spin mutex:td_contested)
  1002. 1 0 974 0 2067 0 0 0 0 /usr/src/sys/kern/kern_intr.c:916 (spin mutex:sched lock 4)
  1003. 1 0 179 0 481 0 0 0 0 /usr/src/sys/kern/kern_proc.c:944 (spin mutex:sched lock 4)
  1004. 3 1 1099 7 3458 0 0 0 7 /usr/src/sys/kern/sched_ule.c:885 (spin mutex:sched lock 8)
  1005. 1 1 1622 22 6467 0 0 0 39 /usr/src/sys/kern/sched_ule.c:886 (spin mutex:sched lock 8)
  1006. 1 1 1146 14 3494 0 0 0 26 /usr/src/sys/kern/sched_ule.c:888 (spin mutex:sched lock 8)
  1007. 2 1 1518 15 8429 0 0 0 12 /usr/src/sys/kern/sched_ule.c:889 (spin mutex:sched lock 8)
  1008. 0 0 68 0 428 0 0 0 1 /usr/src/sys/kern/kern_exit.c:988 (spin mutex:process slock)
  1009. 0 0 19 0 105 0 0 0 0 /usr/src/sys/kern/subr_turnstile.c:837 (spin mutex:td_contested)
  1010. 1 0 554 0 1279 0 0 0 0 /usr/src/sys/kern/kern_timeout.c:342 (spin mutex:callout)
  1011. 0 0 20 0 105 0 0 0 0 /usr/src/sys/kern/subr_turnstile.c:897 (spin mutex:td_contested)
  1012. 2 0 5170 0 4839 1 0 0 0 /usr/src/sys/kern/kern_timeout.c:409 (spin mutex:callout)
  1013. 0 0 27 0 342 0 0 0 0 /usr/src/sys/kern/kern_exit.c:1146 (spin mutex:process slock)
  1014. 0 0 59 0 535 0 0 0 0 /usr/src/sys/kern/kern_resource.c:1075 (spin mutex:sched lock 1)
  1015. 1 0 436 0 1054 0 0 0 0 /usr/src/sys/kern/sched_ule.c:885 (spin mutex:sched lock 3)
  1016. 1 0 665 1 2607 0 0 0 6 /usr/src/sys/kern/sched_ule.c:886 (spin mutex:sched lock 3)
  1017. 1 1 1993 4 6666 0 0 0 6 /usr/src/sys/kern/sched_ule.c:888 (spin mutex:sched lock 3)
  1018. 7 0 235 0 658 0 0 0 1 /usr/src/sys/kern/sched_ule.c:889 (spin mutex:sched lock 3)
  1019. 7 0 1378 0 5933 0 0 0 0 /usr/src/sys/kern/kern_timeout.c:537 (spin mutex:callout)
  1020. 1 2 244 13 792 0 0 0 13 /usr/src/sys/kern/sched_ule.c:1184 (spin mutex:sched lock 8)
  1021. 0 0 81 0 537 0 0 0 0 /usr/src/sys/kern/kern_proc.c:774 (spin mutex:sched lock 10)
  1022. 1 0 6333 0 60173 0 0 0 3 /usr/src/sys/kern/kern_clock.c:537 (spin mutex:sched lock 0)
  1023. 2 0 1731 0 3605 0 0 0 0 /usr/src/sys/kern/kern_timeout.c:703 (spin mutex:callout)
  1024. 13 0 2247 2 7209 0 0 0 4 /usr/src/sys/kern/kern_intr.c:916 (spin mutex:sched lock 10)
  1025. 1 0 204 0 561 0 0 0 0 /usr/src/sys/kern/kern_proc.c:944 (spin mutex:sched lock 10)
  1026. 1 0 249 1 755 0 0 0 2 /usr/src/sys/kern/sched_ule.c:1184 (spin mutex:sched lock 3)
  1027. 1 0 177 0 489 0 0 0 0 /usr/src/sys/kern/kern_timeout.c:807 (spin mutex:callout)
  1028. 0 0 77 0 560 0 0 0 0 /usr/src/sys/kern/kern_proc.c:774 (spin mutex:sched lock 5)
  1029. 0 0 1712 0 7663 0 0 0 1 /usr/src/sys/kern/kern_clock.c:764 (spin mutex:sched lock 0)
  1030. 0 1 68 1 579 0 0 0 1 /usr/src/sys/kern/kern_resource.c:1075 (spin mutex:sched lock 7)
  1031. 6 0 28 0 9 3 0 0 0 /usr/src/sys/netinet6/in6.c:2667 (rw:lle)
  1032. 0 0 64 0 425 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dbuf.c:163 (sx:h->hash_mutexes[i])
  1033. 0 0 1 0 4 0 0 0 0 /usr/src/sys/vm/uma_core.c:2215 (sleep mutex:zio_buf_4096)
  1034. 19 0 731 0 86 8 0 0 0 /usr/src/sys/netinet6/in6_pcb.c:1114 (rw:tcpinp)
  1035. 0 0 0 0 4 0 0 0 0 /usr/src/sys/vm/uma_core.c:2725 (sleep mutex:MAP ENTRY)
  1036. 0 0 3 0 12 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/spa.c:6078 (sx:spa->spa_async_lock)
  1037. 0 0 2 0 12 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/spa.c:6091 (sx:spa->spa_async_lock)
  1038. 0 0 1 0 10 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dsl_dataset.c:518 (sx:ds->ds_lock)
  1039. 21 0 143 0 20 7 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dnode.c:1368 (sx:dn->dn_struct_rwlock)
  1040. 9 0 85 0 11 7 0 0 0 /usr/src/sys/netinet/udp_usrreq.c:1100 (rw:udpinp)
  1041. 2 0 512 0 744 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_znode.c:1168 (sx:zp->z_lock)
  1042. 0 0 10 0 109 0 0 0 0 /usr/src/sys/kern/kern_rangelock.c:164 (sleep mutex:vnode interlock)
  1043. 0 0 0 0 2 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dsl_dataset.c:604 (sx:ds->ds_lock)
  1044. 1 0 48 0 109 0 0 0 0 /usr/src/sys/kern/kern_rangelock.c:219 (sleep mutex:vnode interlock)
  1045. 10 0 650 0 259 2 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dnode.c:1506 (sx:dn->dn_struct_rwlock)
  1046. 1 0 3 0 3 1 0 0 0 /usr/src/sys/kern/vfs_subr.c:3699 (rw:bufobj interlock)
  1047. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:1022 (sleep mutex:socket)
  1048. 0 0 31 0 321 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dbuf.c:2212 (sx:db->db_mtx)
  1049. 1 0 24 0 40 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/compat/opensolaris/kern/opensolaris_vm.c:62 (rw:vm object)
  1050. 0 0 126 0 878 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dmu.c:1837 (sx:dn->dn_mtx)
  1051. 0 0 4 0 11 0 0 0 0 /usr/src/sys/kern/kern_event.c:1043 (sleep mutex:kqueue)
  1052. 5 0 40 0 13 3 0 0 0 /usr/src/sys/netinet/tcp_usrreq.c:232 (rw:tcpinp)
  1053. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:2215 (sleep mutex:zio_buf_7168)
  1054. 0 0 13 0 127 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_znode.c:744 (sleep mutex:struct mount mtx)
  1055. 30 0 2083 0 127 16 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_znode.c:835 (sx:zfsvfs->z_hold_mtx[i])
  1056. 0 0 2 0 24 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dmu_objset.c:676 (sx:os_lock)
  1057. 17 0 1208 0 120 10 0 0 0 /usr/src/sys/kern/vfs_syscalls.c:2610 (lockmgr:zfs)
  1058. 70 0 198 0 8 24 0 0 0 /usr/src/sys/vm/vm_kern.c:345 (rw:kmem vm object)
  1059. 14 0 33 0 3 11 0 0 0 /usr/src/sys/netinet/tcp_timer.c:510 (rw:tcpinp)
  1060. 0 0 4 0 11 0 0 0 0 /usr/src/sys/kern/kern_event.c:1168 (sleep mutex:kqueue)
  1061. 8 1 359 3 914 0 0 0 4 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/trim_map.c:346 (sx:tm->tm_lock)
  1062. 0 0 12 0 174 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dsl_prop.c:249 (sx:dd->dd_lock)
  1063. 0 0 2 0 9 0 0 0 0 /usr/src/sys/vm/uma_core.c:2215 (sleep mutex:dnode_t)
  1064. 0 0 12 0 127 0 0 0 0 /usr/src/sys/vm/vnode_pager.c:224 (sleep mutex:vnode interlock)
  1065. 0 0 3 0 21 0 0 0 0 /usr/src/sys/kern/kern_event.c:1212 (sleep mutex:kqueue)
  1066. 0 0 1 0 11 0 0 0 0 /usr/src/sys/kern/kern_event.c:1229 (sleep mutex:kqueue)
  1067. 0 0 0 0 8 0 0 0 0 /usr/src/sys/vm/uma_core.c:2268 (sleep mutex:dnode_t)
  1068. 47 0 2152 0 120 17 0 0 0 /usr/src/sys/kern/vfs_syscalls.c:2761 (lockmgr:zfs)
  1069. 4 0 77 0 22 3 0 0 0 /usr/src/sys/kern/kern_descrip.c:1936 (sx:filedesc structure)
  1070. 1 0 24 0 22 1 0 0 0 /usr/src/sys/kern/kern_descrip.c:1939 (sx:filedesc structure)
  1071. 0 0 4 0 10 0 0 0 0 /usr/src/sys/kern/kern_event.c:1282 (sleep mutex:kqueue)
  1072. 0 0 1 0 8 0 0 0 0 /usr/src/sys/vm/uma_core.c:2215 (sleep mutex:8192)
  1073. 0 0 3 0 10 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/metaslab.c:543 (sx:mg->mg_lock)
  1074. 30 0 111 0 5 22 0 0 0 /usr/src/sys/netinet/tcp_usrreq.c:462 (rw:tcpinp)
  1075. 0 0 4 0 22 0 0 0 0 /usr/src/sys/geom/geom_disk.c:453 (sleep mutex:g_disk_start)
  1076. 0 0 6 0 15 0 0 0 0 /usr/src/sys/netinet/in_pcb.c:309 (rw:udpinp)
  1077. 3 0 166 0 425 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dbuf.c:1760 (sx:dn->dn_dbufs_mtx)
  1078. 0 0 39 0 103 0 0 0 0 /usr/src/sys/fs/devfs/devfs_vnops.c:202 (sx:devfsmount)
  1079. 16 0 75 0 14 5 0 0 0 /usr/src/sys/vm/vm_object.c:1306 (rw:vm object)
  1080. 16 0 71 0 14 5 0 0 0 /usr/src/sys/vm/vm_object.c:1307 (rw:vm object)
  1081. 1 0 97 0 298 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/trim_map.c:492 (sx:tm->tm_lock)
  1082. 11 0 183 0 103 1 0 0 0 /usr/src/sys/fs/devfs/devfs_vnops.c:211 (sx:devfsmount)
  1083. 0 0 24 0 174 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dsl_prop.c:391 (sx:dd->dd_lock)
  1084. 0 0 2 0 15 0 0 0 0 /usr/src/sys/netinet/udp_usrreq.c:1747 (sleep mutex:so_rcv)
  1085. 0 0 7 0 45 0 0 0 0 /usr/src/sys/vm/uma_core.c:2725 (sleep mutex:4096)
  1086. 0 0 3 0 10 0 0 0 0 /usr/src/sys/kern/subr_log.c:186 (sleep mutex:msgbuf lock)
  1087. 138 0 259 0 60 4 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/space_map.c:384 (sx:msp->ms_lock)
  1088. 0 0 3 0 15 0 0 0 0 /usr/src/sys/netinet/udp_usrreq.c:1664 (rw:udpinp)
  1089. 1 0 3 0 8 0 0 0 0 /usr/src/sys/vm/uma_core.c:2379 (sleep mutex:dnode_t)
  1090. 10 0 103 0 15 6 0 0 0 /usr/src/sys/netinet/udp_usrreq.c:1686 (rw:udpinp)
  1091. 0 0 54 0 568 0 0 0 0 /usr/src/sys/kern/kern_umtx.c:450 (sleep mutex:umtxql)
  1092. 3 0 71 0 55 1 0 0 0 /usr/src/sys/kern/vfs_vnops.c:420 (lockmgr:devfs)
  1093. 56 0 3108 0 744 4 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_znode.c:1133 (sx:zfsvfs->z_hold_mtx[i])
  1094. 0 0 5 0 30 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/metaslab.c:1649 (sx:msp->ms_lock)
  1095. 0 0 4 0 11 0 0 0 0 /usr/src/sys/kern/kern_event.c:1395 (sleep mutex:kqueue)
  1096. 0 0 0 0 1 0 0 0 0 /usr/src/sys/netinet/tcp_input.c:2557 (sleep mutex:so_snd)
  1097. 2 0 17 0 15 1 0 0 0 /usr/src/sys/netinet/udp_usrreq.c:1719 (rw:udpinp)
  1098. 20 0 167 0 13 12 0 0 0 /usr/src/sys/netinet/tcp_usrreq.c:593 (rw:tcpinp)
  1099. 0 0 2 0 14 0 0 0 0 /usr/src/sys/vm/vm_object.c:1414 (rw:vm object)
  1100. 2 0 13 0 15 0 0 0 0 /usr/src/sys/netinet/udp_usrreq.c:1738 (rw:udpinp)
  1101. 2 0 88 0 1092 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dsl_pool.c:717 (sx:dp->dp_lock)
  1102. 0 0 3 0 10 0 0 0 0 /usr/src/sys/kern/kern_event.c:1477 (sleep mutex:kqueue)
  1103. 6 0 12 0 45 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/metaslab.c:737 (sx:mg->mg_lock)
  1104. 0 0 2 0 10 0 0 0 0 /usr/src/sys/kern/uipc_socket.c:496 (sleep mutex:accept)
  1105. 134 0 148 0 45 3 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/metaslab.c:757 (sx:mg->mg_lock)
  1106. 5 0 208 0 411 0 0 0 0 /usr/src/sys/kern/vfs_subr.c:4756 (sleep mutex:vnode interlock)
  1107. 0 0 5 0 30 0 0 0 0 /usr/src/sys/kern/kern_descrip.c:2196 (sx:filedesc structure)
  1108. 0 0 15 0 142 0 0 0 0 /usr/src/sys/fs/devfs/devfs_vnops.c:412 (sx:devfsmount)
  1109. 2 0 23 0 15 1 0 0 0 /usr/src/sys/netinet/udp_usrreq.c:1590 (rw:udp)
  1110. 1 0 39 0 204 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c:3545 (sx:buf_hash_table.ht_locks[i].ht_lock)
  1111. 0 0 3 0 10 0 0 0 0 /usr/src/sys/kern/uipc_socket.c:561 (sleep mutex:accept)
  1112. 0 0 17 0 24 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dmu_objset.c:581 (sx:os->os_lock)
  1113. 0 0 0 0 2 0 0 0 0 /usr/src/sys/vm/uma_core.c:2215 (sleep mutex:zio_buf_32768)
  1114. 0 0 2 0 24 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dmu_objset.c:608 (sx:os->os_lock)
  1115. 5427 0 5556 0 6 926 0 0 0 /usr/src/sys/vm/vm_glue.c:708 (sx:allproc)
  1116. 0 0 6 0 55 0 0 0 0 /usr/src/sys/fs/devfs/devfs_vnops.c:549 (sx:proctree)
  1117. 21 0 1570 0 120 13 0 0 0 /usr/src/sys/kern/vfs_syscalls.c:3115 (lockmgr:zfs)
  1118. 0 0 0 0 2 0 0 0 0 /usr/src/sys/vm/uma_core.c:2268 (sleep mutex:zio_buf_32768)
  1119. 5 0 295 0 432 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:4361 (sleep mutex:ix0:rx(1))
  1120. 3 0 23 0 15 1 0 0 0 /usr/src/sys/netinet/udp_usrreq.c:1718 (rw:udp)
  1121. 0 0 0 0 2 0 0 0 0 /usr/src/sys/netinet/ip_icmp.c:719 (rw:in_ifaddr_lock)
  1122. 23 0 271 0 45 6 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/metaslab.c:1939 (sx:msp->ms_lock)
  1123. 9 0 387 0 2953 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:4420 (sleep mutex:ix0:rx(1))
  1124. 1 0 7 0 10 0 0 0 0 /usr/src/sys/kern/kern_event.c:1691 (sleep mutex:kqueue)
  1125. 0 0 0 0 1 0 0 0 0 /usr/src/sys/vm/uma_core.c:2725 (sleep mutex:zio_buf_8192)
  1126. 0 0 4 0 17 0 0 0 0 /usr/src/sys/vm/uma_core.c:2215 (sleep mutex:zio_buf_16384)
  1127. 4 0 34 0 12 2 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/txg.c:521 (sx:tx->tx_sync_lock)
  1128. 3 0 189 0 259 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dnode.c:1646 (sx:dn->dn_mtx)
  1129. 0 0 0 0 2 0 0 0 0 /usr/src/sys/vm/uma_core.c:2379 (sleep mutex:zio_buf_32768)
  1130. 0 0 9 0 38 0 0 0 0 /usr/src/sys/kern/uipc_socket.c:341 (sleep mutex:so_glabel)
  1131. 8 0 72 0 15 4 0 0 0 /usr/src/sys/netinet/udp_usrreq.c:1697 (rw:pcbinfohash)
  1132. 72 0 350 0 30 11 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/metaslab.c:2016 (sx:msp->ms_lock)
  1133. 4 0 29 0 12 2 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/txg.c:567 (sx:tx->tx_sync_lock)
  1134. 0 0 7 0 38 0 0 0 0 /usr/src/sys/kern/uipc_socket.c:366 (sleep mutex:so_glabel)
  1135. 2 0 107 0 86 1 0 0 0 /usr/src/sys/netinet6/in6_pcb.c:1107 (rw:pcbinfohash)
  1136. 0 0 4 0 15 0 0 0 0 /usr/src/sys/netinet/udp_usrreq.c:1743 (rw:pcbinfohash)
  1137. 0 0 41 0 590 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dnode.c:1702 (sx:dn->dn_mtx)
  1138. 0 0 1 0 9 0 0 0 0 /usr/src/sys/vm/uma_core.c:2725 (sleep mutex:8192)
  1139. 0 0 13 0 127 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dmu_tx.c:115 (sx:dn->dn_mtx)
  1140. 1 0 24 0 38 0 0 0 0 /usr/src/sys/kern/uipc_socket.c:815 (sleep mutex:accept)
  1141. 1 0 21 0 13 1 0 0 0 /usr/src/sys/netinet/tcp_usrreq.c:985 (rw:tcpinp)
  1142. 0 0 0 0 2 0 0 0 0 /usr/src/sys/vm/uma_core.c:2725 (sleep mutex:zio_buf_10240)
  1143. 0 0 1 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:2215 (sleep mutex:zio_buf_20480)
  1144. 0 0 5 0 20 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dnode.c:1374 (sx:dn->dn_dbufs_mtx)
  1145. 0 0 9 0 38 0 0 0 0 /usr/src/sys/vm/uma_core.c:2379 (sleep mutex:UMA Slabs)
  1146. 0 0 2 0 24 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dmu_objset.c:454 (sx:ds->ds_lock)
  1147. 0 0 1 0 10 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dsl_deadlist.c:358 (sx:dl->dl_lock)
  1148. 0 0 0 0 1 0 0 0 0 /usr/src/sys/vm/uma_core.c:2268 (sleep mutex:zio_buf_20480)
  1149. 0 0 1 0 8 0 0 0 0 /usr/src/sys/kern/kern_osd.c:224 (sleep mutex:osd_list)
  1150. 0 0 1 0 11 0 0 0 0 /usr/src/sys/kern/kern_event.c:1885 (sleep mutex:kqueue)
  1151. 0 0 2 0 11 0 0 0 0 /usr/src/sys/kern/kern_event.c:1907 (sleep mutex:kqueue)
  1152. 5 0 19 0 8 2 0 0 0 /usr/src/sys/kern/uipc_socket.c:605 (sleep mutex:so_rcv)
  1153. 1 0 2 0 3 0 0 0 0 /usr/src/sys/netinet/tcp_timer.c:495 (rw:tcp)
  1154. 0 0 47 0 464 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c:3165 (sx:zp->z_lock)
  1155. 0 0 33 0 142 0 0 0 0 /usr/src/sys/fs/devfs/devfs_vnops.c:405 (sleep mutex:devfs interlock)
  1156. 0 0 0 0 8 0 0 0 0 /usr/src/sys/kern/kern_osd.c:316 (sleep mutex:osd_list)
  1157. 0 0 0 0 1 0 0 0 0 /usr/src/sys/vm/uma_core.c:2379 (sleep mutex:zio_buf_20480)
  1158. 2 0 49 0 38 1 0 0 0 /usr/src/sys/kern/uipc_sockbuf.c:245 (sleep mutex:so_snd)
  1159. 92773 0 92806 0 86 1079 0 0 0 /usr/src/sys/kern/kern_proc.c:562 (sleep mutex:process group)
  1160. 0 0 0 0 1 0 0 0 0 /usr/src/sys/vm/uma_core.c:1022 (sleep mutex:zio_buf_81920)
  1161. 0 0 2 0 8 0 0 0 0 /usr/src/sys/kern/kern_proc.c:593 (sleep mutex:process group)
  1162. 0 0 37 0 127 0 0 0 0 /usr/src/sys/kern/vfs_subr.c:1224 (sleep mutex:vnode interlock)
  1163. 2 0 59 0 151 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dnode_sync.c:443 (sx:dn->dn_struct_rwlock)
  1164. 16 0 65 0 396 0 0 0 0 /usr/src/sys/vm/vm_glue.c:710 (sleep mutex:process lock)
  1165. 0 0 0 0 1 0 0 0 0 /usr/src/sys/vm/uma_core.c:2725 (sleep mutex:zio_buf_14336)
  1166. 0 0 0 0 2 0 0 0 0 /usr/src/sys/vm/uma_core.c:2725 (sleep mutex:zio_buf_32768)
  1167. 0 0 7 0 16 0 0 0 0 /usr/src/sys/kern/kern_proc.c:616 (sleep mutex:process group)
  1168. 0 0 1 0 7 0 0 0 0 /usr/src/sys/kern/uipc_sockbuf.c:115 (sleep mutex:so_rcv)
  1169. 2 0 15 0 86 0 0 0 0 /usr/src/sys/kern/kern_proc.c:563 (sleep mutex:process lock)
  1170. 0 0 2 0 11 0 0 0 0 /usr/src/sys/kern/uipc_socket.c:1014 (sleep mutex:so_snd)
  1171. 0 0 5 0 15 0 0 0 0 /usr/src/sys/vm/uma_core.c:1022 (sleep mutex:dmu_buf_impl_t)
  1172. 0 0 11 0 120 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c:3361 (sx:zp->z_lock)
  1173. 10 0 474 0 127 3 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/sa.c:1627 (sx:hdl->sa_lock)
  1174. 1 0 88 0 142 0 0 0 0 /usr/src/sys/fs/devfs/devfs_vnops.c:408 (sleep mutex:vnode interlock)
  1175. 0 0 3 0 21 0 0 0 0 /usr/src/sys/kern/kern_event.c:2147 (sleep mutex:kqueue)
  1176. 0 0 11 0 38 0 0 0 0 /usr/src/sys/kern/uipc_socket.c:846 (sleep mutex:so_rcv)
  1177. 0 0 0 0 1 0 0 0 0 /usr/src/sys/vm/uma_core.c:2215 (sleep mutex:socket)
  1178. 0 0 13 0 127 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_znode.c:726 (sx:zfsvfs->z_znodes_lock)
  1179. 10 0 946 0 464 2 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c:3418 (sx:zp->z_lock)
  1180. 27 5 119 5 47 2 0 0 1 /usr/src/sys/kern/kern_sx.c:167 (sx:tx->tx_sync_lock)
  1181. 0 0 0 0 1 0 0 0 0 /usr/src/sys/vm/uma_core.c:2268 (sleep mutex:socket)
  1182. 0 0 2 0 11 0 0 0 0 /usr/src/sys/kern/kern_event.c:2213 (sleep mutex:kqueue)
  1183. 14 375 201 2996 457 0 6 0 14 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/metaslab.c:2482 (sx:msp->ms_lock)
  1184. 2 0 38 0 38 1 0 0 0 /usr/src/sys/kern/uipc_sockbuf.c:246 (sleep mutex:so_rcv)
  1185. 0 0 1 0 8 0 0 0 0 /usr/src/sys/kern/kern_proc.c:694 (sleep mutex:process lock)
  1186. 20 0 173 0 13 13 0 0 0 /usr/src/sys/netinet/tcp_usrreq.c:590 (rw:tcp)
  1187. 1 0 2 0 6 0 0 0 0 /usr/src/sys/kern/vfs_subr.c:1690 (sleep mutex:Syncer mtx)
  1188. 1 0 7 0 5 1 0 0 0 /usr/src/sys/kern/vfs_vnops.c:1285 (lockmgr:devfs)
  1189. 0 0 0 0 4 0 0 0 0 /usr/src/sys/vm/uma_core.c:2725 (sleep mutex:16384)
  1190. 499 0 7377 0 40 184 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dmu_objset.c:447 (sx:ds->ds_opening_lock)
  1191. 1 0 9 0 14 0 0 0 0 /usr/src/sys/amd64/amd64/machdep.c:441 (sleep mutex:process lock)
  1192. 1 0 13 0 16 0 0 0 0 /usr/src/sys/kern/vfs_vnops.c:1322 (lockmgr:devfs)
  1193. 0 0 0 0 4 0 0 0 0 /usr/src/sys/netinet/in_pcb.c:1293 (rw:udpinp)
  1194. 1 0 20 0 55 0 0 0 0 /usr/src/sys/fs/devfs/devfs_vnops.c:576 (sleep mutex:vnode interlock)
  1195. 2 0 82 0 96 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dnode_sync.c:416 (sx:db->db_mtx)
  1196. 0 0 6 0 11 0 0 0 0 /usr/src/sys/kern/vfs_lookup.c:519 (lockmgr:devfs)
  1197. 0 0 0 0 1 0 0 0 0 /usr/src/sys/vm/uma_core.c:2379 (sleep mutex:socket)
  1198. 3 0 8 0 3 2 0 0 0 /usr/src/sys/kern/vfs_subr.c:1772 (sleep mutex:Syncer mtx)
  1199. 1 0 26 0 127 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dnode_sync.c:445 (sx:db->db_mtx)
  1200. 2 0 38 0 66 0 0 0 0 /usr/src/sys/amd64/amd64/pmap.c:4480 (rw:pmap pv global)
  1201. 0 0 38 0 127 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dnode_sync.c:464 (sx:db->db_mtx)
  1202. 0 0 18 0 127 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/sa.c:1852 (sx:hdl->sa_lock)
  1203. 37 0 1675 0 1228 1 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/sa.c:1889 (sx:hdl->sa_lock)
  1204. 0 0 5 0 10 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/metaslab.c:1674 (sx:mg->mg_lock)
  1205. 0 0 6 0 13 0 0 0 0 /usr/src/sys/netinet/tcp_input.c:3591 (sleep mutex:so_snd)
  1206. 168 0 455 0 3 151 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/spa.c:311 (sx:spa->spa_props_lock)
  1207. 0 0 3 0 13 0 0 0 0 /usr/src/sys/netinet/tcp_usrreq.c:1001 (sleep mutex:so_rcv)
  1208. 465 0 595 0 30 19 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/metaslab.c:1708 (sx:mg->mg_lock)
  1209. 476 1 29643 24 2953 10 0 0 43 /usr/src/sys/dev/ixgbe/ixgbe.c:1525 (sleep mutex:ix0:tx(1))
  1210. 80 0 4777 0 499 9 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:1525 (sleep mutex:ix1:tx(1))
  1211. 11282 0 11445 0 351 32 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dmu_objset.c:1279 (sx:db->db_mtx)
  1212. 1 0 4 0 12 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/rrwlock.c:197 (sx:rrl->rr_lock)
  1213. 0 0 4 0 33 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dsl_dir.c:302 (sx:dd->dd_lock)
  1214. 16 0 334 0 103 3 0 0 0 /usr/src/sys/fs/devfs/devfs_vnops.c:210 (lockmgr:devfs)
  1215. 5 0 8 0 3 2 0 0 0 /usr/src/sys/kern/vfs_subr.c:1740 (sleep mutex:vnode interlock)
  1216. 0 0 4 0 20 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c:434 (sleep mutex:vm page)
  1217. 1 0 9 0 11 0 0 0 0 /usr/src/sys/netinet/in_pcb.c:1249 (rw:pcbinfohash)
  1218. 0 0 4 0 20 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c:449 (sleep mutex:vm page)
  1219. 5 0 45 0 14 3 0 0 0 /usr/src/sys/kern/subr_trap.c:270 (sleep mutex:process lock)
  1220. 0 0 3 0 7 0 0 0 0 /usr/src/sys/netinet6/in6.c:1982 (rw:if_addr_lock)
  1221. 1 0 79 0 204 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c:3525 (sx:buf->b_evict_lock)
  1222. 2 0 26 0 13 2 0 0 0 /usr/src/sys/netinet/tcp_usrreq.c:984 (rw:tcp)
  1223. 39 0 894 0 127 7 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dmu_object.c:43 (sx:os->os_obj_lock)
  1224. 0 0 4 0 13 0 0 0 0 /usr/src/sys/netinet/tcp_input.c:3608 (sleep mutex:so_rcv)
  1225. 0 0 5 0 18 0 0 0 0 /usr/src/sys/vm/uma_core.c:1022 (sleep mutex:zio_buf_512)
  1226. 0 0 0 0 1 0 0 0 0 /usr/src/sys/kern/kern_sig.c:1475 (sleep mutex:process lock)
  1227. 0 0 1 0 11 0 0 0 0 /usr/src/sys/kern/kern_event.c:950 (sleep mutex:protect sysfilt_ops)
  1228. 0 0 1 0 11 0 0 0 0 /usr/src/sys/kern/kern_event.c:966 (sleep mutex:protect sysfilt_ops)
  1229. 5 0 107 0 120 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_acl.c:1448 (sx:zp->z_lock)
  1230. 0 0 12 0 76 0 0 0 0 /usr/src/sys/kern/uipc_sockbuf.c:306 (sleep mutex:process lock)
  1231. 0 0 14 0 127 0 0 0 0 /usr/src/sys/vm/vnode_pager.c:139 (rw:vm object)
  1232. 0 0 149 0 2104 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dmu_tx.c:1153 (sx:dn->dn_mtx)
  1233. 22 0 48 0 3 16 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/spa_config.c:325 (sx:spa_namespace_lock)
  1234. 0 0 8 0 127 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dnode_sync.c:526 (sx:dn->dn_mtx)
  1235. 1 0 8 0 26 0 0 0 0 /usr/src/sys/kern/uipc_sockbuf.c:867 (sleep mutex:so_rcv)
  1236. 8 0 232 0 1087 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dmu.c:279 (sx:dn->dn_struct_rwlock)
  1237. 9 0 112 0 127 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dmu.c:282 (sx:dn->dn_struct_rwlock)
  1238. 0 0 50 0 354 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dnode_sync.c:565 (sx:dn->dn_mtx)
  1239. 0 0 5 0 21 0 0 0 0 /usr/src/sys/kern/uipc_syscalls.c:663 (sleep mutex:so_rcv)
  1240. 0 0 0 0 3 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dmu_objset.c:1298 (sx:dn->dn_mtx)
  1241. 0 0 26 0 87 0 0 0 0 /usr/src/sys/kern/subr_eventhandler.c:254 (sleep mutex:process_dtor)
  1242. 0 0 7 0 29 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/unique.c:86 (sx:unique_mtx)
  1243. 0 0 1 0 5 0 0 0 0 /usr/src/sys/vm/uma_core.c:2215 (sleep mutex:128)
  1244. 0 0 45 0 498 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dmu.c:354 (sx:dn->dn_struct_rwlock)
  1245. 1 0 96 0 924 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zap.c:524 (sx:l->l_rwlock)
  1246. 0 0 35 0 478 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dmu_objset.c:1341 (sx:dn->dn_mtx)
  1247. 0 0 8 0 29 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/unique.c:109 (sx:unique_mtx)
  1248. 1 0 4 0 4 1 0 0 0 /usr/src/sys/netinet6/in6_src.c:1130 (sx:addrsel_sxlock)
  1249. 11 0 220 0 460 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c:878 (sx:buf_hash_table.ht_locks[i].ht_lock)
  1250. 1 0 38 0 32 1 0 0 0 /usr/src/sys/fs/devfs/devfs_vnops.c:594 (lockmgr:devfs)
  1251. 2 0 14 0 86 0 0 0 0 /usr/src/sys/kern/kern_exit.c:832 (sx:allproc)
  1252. 2 0 39 0 66 0 0 0 0 /usr/src/sys/amd64/amd64/pmap.c:4481 (sleep mutex:pmap)
  1253. 1 0 36 0 64 0 0 0 0 /usr/src/sys/fs/devfs/devfs_vfsops.c:213 (sx:devfsmount)
  1254. 0 0 1 0 16 0 0 0 0 /usr/src/sys/kern/subr_unit.c:288 (sleep mutex:unit# allocation)
  1255. 7 0 21 0 5 4 0 0 0 /usr/src/sys/netinet/tcp_usrreq.c:1117 (rw:pcbinfohash)
  1256. 1 0 23 0 127 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/sa.c:474 (sx:sa->sa_lock)
  1257. 3 0 165 0 425 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dbuf.c:175 (sx:db->db_mtx)
  1258. 3 0 14 0 5 2 0 0 0 /usr/src/sys/netinet/tcp_subr.c:1653 (sleep mutex:isn_mtx)
  1259. 0 0 12 0 87 0 0 0 0 /usr/src/sys/kern/kern_exit.c:898 (sx:allproc)
  1260. 1 0 38 0 127 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_acl.c:1713 (sx:zp->z_lock)
  1261. 1 0 96 0 1091 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dsl_dataset.c:2813 (sx:ds->ds_lock)
  1262. 0 0 7 0 34 0 0 0 0 /usr/src/sys/netinet/tcp_subr.c:1813 (sleep mutex:rtentry)
  1263. 0 0 0 0 1 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zil.c:862 (sx:zilog->zl_lock)
  1264. 1 0 574 0 2231 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dmu_tx.c:1391 (sx:dn->dn_mtx)
  1265. 0 0 0 0 3 0 0 0 0 /usr/src/sys/kern/vfs_subr.c:4734 (sleep mutex:struct mount mtx)
  1266. 13 0 190 0 175 1 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dnode_sync.c:407 (sx:dn->dn_dbufs_mtx)
  1267. 1 0 2 0 3 0 0 0 0 /usr/src/sys/kern/vfs_subr.c:1760 (rw:bufobj interlock)
  1268. 0 0 14 0 87 0 0 0 0 /usr/src/sys/kern/kern_proc.c:212 (sleep mutex:process_dtor)
  1269. 0 0 4 0 19 0 0 0 0 /usr/src/sys/vm/uma_core.c:2215 (sleep mutex:256)
  1270. 33 0 180 0 6 30 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dsl_dir.c:917 (sx:dd->dd_lock)
  1271. 0 0 0 0 3 0 0 0 0 /usr/src/sys/kern/vfs_subr.c:4805 (sleep mutex:struct mount mtx)
  1272. 0 0 19 0 64 0 0 0 0 /usr/src/sys/kern/vfs_lookup.c:804 (lockmgr:crossmp)
  1273. 0 0 3 0 12 0 0 0 0 /usr/src/sys/kern/kern_prot.c:126 (sleep mutex:process lock)
  1274. 0 0 0 0 1 0 0 0 0 /usr/src/sys/vm/uma_core.c:2215 (sleep mutex:zio_buf_81920)
  1275. 0 0 6 0 55 0 0 0 0 /usr/src/sys/fs/devfs/devfs_vnops.c:1113 (sleep mutex:sleep mtxpool)
  1276. 0 0 79 0 1092 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/txg.c:306 (sx:tx->tx_cpu[c].tc_lock)
  1277. 0 0 3 0 15 0 0 0 0 /usr/src/sys/vm/uma_core.c:1022 (sleep mutex:VNODE)
  1278. 0 0 4 0 13 0 0 0 0 /usr/src/sys/kern/kern_khelp.c:159 (rw:helper list lock)
  1279. 5 0 21 0 5 4 0 0 0 /usr/src/sys/netinet/tcp_usrreq.c:1638 (rw:tcp)
  1280. 0 0 5 0 11 0 0 0 0 /usr/src/sys/kern/kern_mutex.c:160 (sleep mutex:so_rcv)
  1281. 0 0 0 0 1 0 0 0 0 /usr/src/sys/vm/uma_core.c:2268 (sleep mutex:zio_buf_81920)
  1282. 0 0 2 0 8 0 0 0 0 /usr/src/sys/vm/uma_core.c:2215 (sleep mutex:RADIX NODE)
  1283. 0 0 0 0 4 0 0 0 0 /usr/src/sys/vm/uma_core.c:2215 (sleep mutex:dmu_buf_impl_t)
  1284. 1 0 271 0 1092 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/txg.c:342 (sx:tx->tx_cpu[c].tc_lock)
  1285. 0 0 14 0 156 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dbuf.c:1277 (sx:dr->dt.di.dr_mtx)
  1286. 0 0 4 0 13 0 0 0 0 /usr/src/sys/kern/kern_khelp.c:195 (rw:helper list lock)
  1287. 0 0 4 0 14 0 0 0 0 /usr/src/sys/amd64/amd64/machdep.c:442 (sleep mutex:sigacts)
  1288. 16 0 187 0 134 1 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_dir.c:718 (sx:zp->z_lock)
  1289. 1 0 440 0 2182 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dsl_dir.c:1112 (sx:dd->dd_lock)
  1290. 1 0 45 0 96 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dbuf.c:490 (sx:db->db_mtx)
  1291. 0 0 12 0 144 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/txg.c:389 (sx:tx->tx_cpu[c].tc_lock)
  1292. 11 0 188 0 134 1 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_dir.c:747 (sx:zp->z_lock)
  1293. 0 0 0 0 4 0 0 0 0 /usr/src/sys/vm/uma_core.c:2268 (sleep mutex:dmu_buf_impl_t)
  1294. 1 0 7 0 15 0 0 0 0 /usr/src/sys/netinet/in_pcb.c:2024 (rw:pcbinfohash)
  1295. 0 0 0 0 1 0 0 0 0 /usr/src/sys/vm/uma_core.c:2379 (sleep mutex:zio_buf_81920)
  1296. 1 0 8 0 14 0 0 0 0 /usr/src/sys/kern/uipc_socket.c:2109 (sleep mutex:so_rcv)
  1297. 3 0 207 0 93 2 0 0 0 /usr/src/sys/netinet6/ip6_input.c:700 (rw:if_addr_lock)
  1298. 1 0 12 0 15 0 0 0 0 /usr/src/sys/dev/usb/controller/usb_controller.c:407 (sleep mutex:ehci1)
  1299. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:2725 (sleep mutex:128)
  1300. 0 0 20 0 86 0 0 0 0 /usr/src/sys/kern/kern_exit.c:804 (sleep mutex:process lock)
  1301. 1 0 41 0 59 0 0 0 0 /usr/src/sys/fs/devfs/devfs_vnops.c:1090 (lockmgr:devfs)
  1302. 1 0 3 0 4 0 0 0 0 /usr/src/sys/vm/uma_core.c:2379 (sleep mutex:dmu_buf_impl_t)
  1303. 9 0 54 0 8 6 0 0 0 /usr/src/sys/netinet/tcp_syncache.c:705 (rw:tcpinp)
  1304. 0 0 13 0 86 0 0 0 0 /usr/src/sys/kern/kern_exit.c:836 (sleep mutex:process lock)
  1305. 0 0 2 0 10 0 0 0 0 /usr/src/sys/kern/kern_event.c:717 (sx:filedesc structure)
  1306. 0 0 2 0 18 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zap_micro.c:1228 (sx:l->l_rwlock)
  1307. 0 0 11 0 86 0 0 0 0 /usr/src/sys/kern/kern_exit.c:850 (sleep mutex:process lock)
  1308. 0 0 21 0 86 0 0 0 0 /usr/src/sys/kern/kern_exit.c:853 (sleep mutex:process lock)
  1309. 0 0 146 0 2182 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dsl_dir.c:1289 (sx:dd->dd_lock)
  1310. 0 0 3 0 6 0 0 0 0 /usr/src/sys/vm/vm_fault.c:775 (sleep mutex:vm page)
  1311. 80 0 560 0 23 24 0 0 0 /usr/src/sys/dev/random/yarrow.c:340 (sleep mutex:Yarrow reseed)
  1312. 0 0 1 0 8 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/spa_errlog.c:154 (sx:spa->spa_errlist_lock)
  1313. 0 0 12 0 38 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zap.c:1186 (sx:l->l_rwlock)
  1314. 0 0 0 0 1 0 0 0 0 /usr/src/sys/vm/uma_core.c:2725 (sleep mutex:64)
  1315. 0 0 8 0 38 0 0 0 0 /usr/src/sys/netinet/ip_output.c:684 (sleep mutex:rtentry)
  1316. 0 0 6 0 8 0 0 0 0 /usr/src/sys/netinet/tcp_subr.c:1042 (sleep mutex:accept)
  1317. 4 0 276 0 142 1 0 0 0 /usr/src/sys/kern/vfs_subr.c:2137 (lockmgr:devfs)
  1318. 0 0 3 0 17 0 0 0 0 /usr/src/sys/vm/uma_core.c:2725 (sleep mutex:256)
  1319. 3 0 34 0 14 2 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zap_micro.c:376 (sx:zap->zap_rwlock)
  1320. 11 0 64 0 8 8 0 0 0 /usr/src/sys/netinet/tcp_input.c:1107 (rw:tcpinp)
  1321. 5 0 40 0 14 2 0 0 0 /usr/src/sys/kern/subr_trap.c:271 (sleep mutex:sigacts)
  1322. 10 0 389 0 120 3 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c:3417 (sx:zp->z_acl_lock)
  1323. 1 0 60 0 127 0 0 0 0 /usr/src/sys/kern/vfs_subr.c:1223 (sleep mutex:struct mount mtx)
  1324. 1 0 7 0 11 0 0 0 0 /usr/src/sys/kern/kern_mutex.c:160 (sleep mutex:kqueue)
  1325. 123 0 788 0 85 9 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/spa.c:2971 (sx:spa_namespace_lock)
  1326. 5 0 178 0 116 1 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dbuf.c:858 (sx:db->db_mtx)
  1327. 0 0 0 0 1 0 0 0 0 /usr/src/sys/vm/uma_core.c:2725 (sleep mutex:zio_buf_81920)
  1328. 0 0 13 0 85 0 0 0 0 /usr/src/sys/vm/uma_core.c:2215 (sleep mutex:zio_cache)
  1329. 2 0 2 0 1 2 0 0 0 /usr/src/sys/kern/kern_sig.c:1492 (sleep mutex:sigacts)
  1330. 0 0 12 0 132 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/ddt.c:637 (sx:ddt->ddt_lock)
  1331. 0 0 11 0 27 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/spa_errlog.c:349 (sx:spa->spa_errlist_lock)
  1332. 2 0 4 0 11 0 0 0 0 /usr/src/sys/vm/uma_core.c:2215 (sleep mutex:g_bio)
  1333. 0 0 1 0 6 0 0 0 0 /usr/src/sys/vm/uma_core.c:2725 (sleep mutex:RADIX NODE)
  1334. 2 0 111 0 93 1 0 0 0 /usr/src/sys/netinet6/ip6_input.c:688 (rw:if_afdata)
  1335. 1 0 52 0 254 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/sa.c:1284 (sx:sa->sa_lock)
  1336. 8 0 27 0 16 1 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dbuf.c:993 (sx:db->db_mtx)
  1337. 0 0 13 0 127 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dnode.c:361 (sx:dn->dn_struct_rwlock)
  1338. 80 0 317 0 5 63 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/bpobj.c:212 (sx:bpo->bpo_lock)
  1339. 0 0 0 0 5 0 0 0 0 /usr/src/sys/vm/uma_core.c:2215 (sleep mutex:zio_buf_512)
  1340. 0 0 26 0 254 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/sa.c:1322 (sx:sa->sa_lock)
  1341. 1 0 15 0 74 0 0 0 0 /usr/src/sys/kern/kern_mutex.c:160 (sleep mutex:AHCI channel lock)
  1342. 0 0 0 0 5 0 0 0 0 /usr/src/sys/vm/uma_core.c:2268 (sleep mutex:zio_buf_512)
  1343. 0 0 3 0 8 0 0 0 0 /usr/src/sys/netinet/tcp_subr.c:1043 (sleep mutex:so_rcv)
  1344. 0 0 7 0 46 0 0 0 0 /usr/src/sys/kern/kern_descrip.c:526 (sx:filedesc structure)
  1345. 6 0 1714 0 1092 1 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/txg.c:303 (sx:tx->tx_cpu[c].tc_open_lock)
  1346. 9 0 404 0 837 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zil.c:1280 (sx:zilog->zl_itxg[i].itxg_lock)
  1347. 0 0 0 0 3 0 0 0 0 /usr/src/sys/kern/uipc_socket.c:2680 (sleep mutex:so_rcv)
  1348. 0 0 56 0 744 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_znode.c:1188 (sleep mutex:vnode interlock)
  1349. 1 0 16 0 50 0 0 0 0 /usr/src/sys/kern/sys_pipe.c:1348 (sleep mutex:pipe mutex)
  1350. 0 0 22 0 211 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dnode.c:447 (sx:os->os_lock)
  1351. 0 0 2 0 5 0 0 0 0 /usr/src/sys/vm/uma_core.c:2379 (sleep mutex:zio_buf_512)
  1352. 3 0 291 0 144 2 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/txg.c:368 (sx:tx->tx_cpu[c].tc_open_lock)
  1353. 0 0 1 0 4 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zil.c:1346 (sx:zilog->zl_itxg[i].itxg_lock)
  1354. 4 0 142 0 411 0 0 0 0 /usr/src/sys/kern/vfs_subr.c:4795 (sleep mutex:vnode_free_list)
  1355. 1 0 2 0 3 0 0 0 0 /usr/src/sys/kern/vfs_subr.c:4811 (sleep mutex:vnode_free_list)
  1356. 0 0 3 0 20 0 0 0 0 /usr/src/sys/vm/uma_core.c:1022 (sleep mutex:dnode_t)
  1357. 498711 0 498734 0 3 166244 0 0 0 /usr/src/sys/kern/vfs_subr.c:1756 (lockmgr:syncer)
  1358. 31 0 289 0 26 11 0 0 0 /usr/src/sys/netinet/tcp_input.c:752 (rw:tcp)
  1359. 1 0 44 0 156 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dbuf.c:1270 (sx:db->db_mtx)
  1360. 3 0 10 0 4 2 0 0 0 /usr/src/sys/netpfil/pf/pf_ioctl.c:1794 (rw:pf rulesets)
  1361. 20 0 108 0 35 3 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/bpobj.c:488 (sx:bpo->bpo_lock)
  1362. 0 0 6 0 32 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/vdev.c:2757 (sx:vd->vdev_stat_lock)
  1363. 2 0 11 0 8 1 0 0 0 /usr/src/sys/kern/subr_vmem.c:1136 (sleep mutex:kmem arena)
  1364. 0 0 9 0 57 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/bpobj.c:547 (sx:bpo->bpo_lock)
  1365. 396350 0 408082 0 517 789 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c:1516 (lockmgr:zfs)
  1366. 21 0 45 0 3 15 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/spa_config.c:329 (sx:spa->spa_props_lock)
  1367. 2 0 18 0 14 1 0 0 0 /usr/src/sys/kern/kern_resource.c:310 (sleep mutex:process lock)
  1368. 0 9 0 9 1 0 9 0 1 /usr/src/sys/vm/uma_core.c:2727 (sleep mutex:zio_cache)
  1369. 0 0 4 0 20 0 0 0 0 /usr/src/sys/netinet/in_pcb.c:913 (sleep mutex:rtentry)
  1370. 1 0 21 0 38 0 0 0 0 /usr/src/sys/kern/uipc_socket.c:3280 (sleep mutex:accept)
  1371. 5 0 130 0 120 1 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_acl.c:1447 (sx:zp->z_acl_lock)
  1372. 0 0 17 0 127 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_znode.c:560 (sx:zp->z_lock)
  1373. 0 0 1 0 8 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/spa_errlog.c:142 (sx:spa->spa_errlog_lock)
  1374. 0 0 5 0 11 0 0 0 0 /usr/src/sys/kern/uipc_socket.c:2977 (sleep mutex:so_rcv)
  1375. 46 0 2888 0 127 22 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_znode.c:739 (lockmgr:zfs)
  1376. 0 0 3 0 30 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/vdev.c:2982 (sx:vd->vdev_stat_lock)
  1377. 0 0 4 0 30 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/vdev.c:2989 (sx:vd->vdev_stat_lock)
  1378. 0 0 3 0 13 0 0 0 0 /usr/src/sys/netinet/tcp_subr.c:753 (rw:cc_list)
  1379. 4 0 18 0 36 0 0 0 0 /usr/src/sys/kern/uipc_socket.c:3317 (sleep mutex:so_snd)
  1380. 1 0 273 0 878 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dmu.c:1836 (sx:dn->dn_struct_rwlock)
  1381. 0 0 4 0 26 0 0 0 0 /usr/src/sys/kern/uipc_socket.c:3333 (sleep mutex:so_snd)
  1382. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:2725 (sleep mutex:VM OBJECT)
  1383. 0 0 4 0 12 0 0 0 0 /usr/src/sys/kern/vfs_syscalls.c:480 (sleep mutex:mountlist)
  1384. 0 0 7 0 32 0 0 0 0 /usr/src/sys/kern/uipc_socket.c:3352 (sleep mutex:so_snd)
  1385. 0 0 2 0 8 0 0 0 0 /usr/src/sys/vm/uma_core.c:2215 (sleep mutex:2048)
  1386. 1 0 9 0 11 0 0 0 0 /usr/src/sys/kern/uipc_socket.c:3145 (sleep mutex:so_rcv)
  1387. 0 0 0 0 4 0 0 0 0 /usr/src/sys/vm/uma_core.c:2215 (sleep mutex:VNODE)
  1388. 6 0 316 0 259 1 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dbuf.c:822 (sx:dn->dn_dbufs_mtx)
  1389. 0 0 0 0 2 0 0 0 0 /usr/src/sys/vm/uma_core.c:1022 (sleep mutex:zio_buf_32768)
  1390. 0 0 1 0 9 0 0 0 0 /usr/src/sys/vm/uma_core.c:2725 (sleep mutex:1024)
  1391. 0 0 11 0 36 0 0 0 0 /usr/src/sys/kern/vfs_syscalls.c:536 (sleep mutex:mountlist)
  1392. 0 0 21 0 255 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/bplist.c:74 (sx:bpl->bpl_lock)
  1393. 2 0 9 0 5 1 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/trim_map.c:646 (sx:spa->spa_trim_lock)
  1394. 0 0 0 0 1 0 0 0 0 /usr/src/sys/vm/uma_core.c:2725 (sleep mutex:zio_buf_1024)
  1395. 0 0 0 0 4 0 0 0 0 /usr/src/sys/vm/uma_core.c:2268 (sleep mutex:VNODE)
  1396. 0 0 1 0 10 0 0 0 0 /usr/src/sys/kern/kern_event.c:1759 (sx:filedesc structure)
  1397. 1 0 62 0 127 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_acl.c:1712 (sx:zp->z_acl_lock)
  1398. 2 0 9 0 8 1 0 0 0 /usr/src/sys/netinet/tcp_syncache.c:347 (sleep mutex:tcp_sc_head)
  1399. 2 0 15 0 8 1 0 0 0 /usr/src/sys/netinet/tcp_syncache.c:706 (rw:pcbinfohash)
  1400. 0 0 1 0 5 0 0 0 0 /usr/src/sys/kern/uipc_socket.c:3267 (sleep mutex:so_rcv)
  1401. 0 0 10 0 38 0 0 0 0 /usr/src/sys/kern/uipc_socket.c:3281 (sleep mutex:so_rcv)
  1402. 0 0 1 0 2 0 0 0 0 /usr/src/sys/netinet6/nd6_nbr.c:726 (rw:if_afdata)
  1403. 0 0 13 0 127 0 0 0 0 /usr/src/sys/kern/vfs_subr.c:1244 (sleep mutex:vnode_free_list)
  1404. 0 0 6 0 36 0 0 0 0 /usr/src/sys/kern/uipc_socket.c:3316 (sleep mutex:so_rcv)
  1405. 0 0 1 0 4 0 0 0 0 /usr/src/sys/vm/uma_core.c:2379 (sleep mutex:VNODE)
  1406. 1 0 4 0 8 0 0 0 0 /usr/src/sys/kern/kern_module.c:436 (sx:module subsystem sx lock)
  1407. 1 0 6 0 26 0 0 0 0 /usr/src/sys/kern/uipc_socket.c:3328 (sleep mutex:so_rcv)
  1408. 2 0 14 0 32 0 0 0 0 /usr/src/sys/kern/uipc_socket.c:3347 (sleep mutex:so_rcv)
  1409. 0 0 2 0 7 0 0 0 0 /usr/src/sys/netinet6/icmp6.c:2008 (rw:rip)
  1410. 3 0 35 0 13 2 0 0 0 /usr/src/sys/netinet/in_pcb.c:309 (rw:tcpinp)
  1411. 9 0 72 0 22 3 0 0 0 /usr/src/sys/netinet/tcp_syncache.c:520 (sleep mutex:tcp_sc_head)
  1412. 0 0 1 0 6 0 0 0 0 /usr/src/sys/kern/kern_resource.c:811 (sleep mutex:process lock)
  1413. 0 0 0 0 2 0 0 0 0 /usr/src/sys/vm/uma_core.c:1022 (sleep mutex:zio_buf_20480)
  1414. 0 0 0 0 1 0 0 0 0 /usr/src/sys/kern/sched_ule.c:2137 (spin mutex:sched lock 2)
  1415. 0 0 0 0 3 0 0 0 0 /usr/src/sys/kern/kern_sig.c:587 (spin mutex:sched lock 1)
  1416. 1 1 6835 3 59933 0 0 0 4 /usr/src/sys/kern/kern_clock.c:537 (spin mutex:sched lock 1)
  1417. 0 0 1775 0 7624 0 0 0 0 /usr/src/sys/kern/kern_clock.c:764 (spin mutex:sched lock 1)
  1418. 0 0 3 0 8 0 0 0 0 /usr/src/sys/kern/vfs_subr.c:1900 (spin mutex:sched lock 1)
  1419. 1 0 536 0 3230 0 0 0 0 /usr/src/sys/kern/kern_switch.c:211 (spin mutex:sched lock 1)
  1420. 0 0 9 0 27 0 0 0 0 /usr/src/sys/kern/kern_thread.c:489 (spin mutex:sched lock 1)
  1421. 0 0 3 0 27 0 0 0 0 /usr/src/sys/kern/kern_thread.c:515 (spin mutex:sched lock 1)
  1422. 0 0 0 0 1 0 0 0 0 /usr/src/sys/kern/kern_sig.c:2350 (spin mutex:sched lock 5)
  1423. 0 0 3 0 28 0 0 0 0 /usr/src/sys/kern/subr_trap.c:215 (spin mutex:sched lock 1)
  1424. 0 0 12 0 22 0 0 0 0 /usr/src/sys/kern/subr_trap.c:253 (spin mutex:sched lock 1)
  1425. 1 0 5 0 6 0 0 0 0 /usr/src/sys/kern/subr_turnstile.c:211 (spin mutex:sched lock 4)
  1426. 2 0 9 0 6 1 0 0 0 /usr/src/sys/kern/kern_sig.c:2350 (spin mutex:sleepq chain)
  1427. 1 5 889 8 3760 0 0 0 7 /usr/src/sys/kern/kern_intr.c:1370 (spin mutex:sched lock 1)
  1428. 0 0 5 0 20 0 0 0 0 /usr/src/sys/kern/sched_ule.c:2137 (spin mutex:sched lock 10)
  1429. 0 0 1 0 3 0 0 0 0 /usr/src/sys/kern/kern_sig.c:2350 (spin mutex:sched lock 1)
  1430. 0 0 0 0 4 0 0 0 0 /usr/src/sys/kern/sched_ule.c:2137 (spin mutex:sched lock 5)
  1431. 1 0 58 0 91 0 0 0 0 /usr/src/sys/kern/kern_synch.c:609 (spin mutex:sched lock 1)
  1432. 0 0 0 0 5 0 0 0 0 /usr/src/sys/kern/kern_resource.c:518 (spin mutex:sched lock 1)
  1433. 0 0 489 1 1772 0 0 0 2 /usr/src/sys/kern/sched_ule.c:1897 (spin mutex:sched lock 1)
  1434. 1 0 1012 0 9728 0 0 0 0 /usr/src/sys/kern/sched_ule.c:1940 (spin mutex:sched lock 1)
  1435. 2 1 23 3 50 0 0 0 3 /usr/src/sys/kern/subr_turnstile.c:211 (spin mutex:sched lock 1)
  1436. 4 0 36 1 20 1 0 0 2 /usr/src/sys/kern/subr_turnstile.c:555 (spin mutex:turnstile lock)
  1437. 0 0 2 0 19 0 0 0 0 /usr/src/sys/kern/subr_turnstile.c:721 (spin mutex:td_contested)
  1438. 0 0 155 2 1724 0 0 0 5 /usr/src/sys/kern/subr_sleepqueue.c:340 (spin mutex:sched lock 1)
  1439. 0 0 4 0 22 0 0 0 0 /usr/src/sys/kern/sched_ule.c:2137 (spin mutex:sched lock 1)
  1440. 3 0 16 0 14 1 0 0 0 /usr/src/sys/kern/kern_sig.c:2349 (spin mutex:process slock)
  1441. 0 0 27 2 202 0 0 0 3 /usr/src/sys/kern/sched_ule.c:2151 (spin mutex:sched lock 1)
  1442. 0 0 11 0 57 0 0 0 0 /usr/src/sys/kern/sched_ule.c:2188 (spin mutex:sched lock 1)
  1443. 0 0 41 0 186 0 0 0 0 /usr/src/sys/kern/subr_sleepqueue.c:424 (spin mutex:sched lock 1)
  1444. 0 0 0 0 1 0 0 0 0 /usr/src/sys/kern/kern_sig.c:587 (spin mutex:sched lock 5)
  1445. 0 0 171 0 1372 0 0 0 0 /usr/src/sys/kern/subr_sleepqueue.c:616 (spin mutex:sched lock 1)
  1446. 0 0 29 0 166 0 0 0 0 /usr/src/sys/kern/subr_sleepqueue.c:651 (spin mutex:sched lock 1)
  1447. 1 1 8 1 15 0 0 0 1 /usr/src/sys/kern/subr_turnstile.c:211 (spin mutex:sched lock 7)
  1448. 0 0 5 0 48 0 0 0 0 /usr/src/sys/kern/subr_turnstile.c:731 (spin mutex:sched lock 1)
  1449. 0 0 1 0 6 0 0 0 0 /usr/src/sys/kern/kern_sig.c:587 (spin mutex:sleepq chain)
  1450. 0 0 46 4 123 0 0 0 7 /usr/src/sys/kern/sched_ule.c:2611 (spin mutex:sched lock 1)
  1451. 0 0 9 0 19 0 0 0 0 /usr/src/sys/kern/kern_fork.c:484 (spin mutex:sched lock 1)
  1452. 0 0 18 0 39 0 0 0 0 /usr/src/sys/kern/subr_turnstile.c:896 (spin mutex:sched lock 1)
  1453. 0 0 2 0 18 0 0 0 0 /usr/src/sys/kern/sched_ule.c:2712 (spin mutex:sched lock 1)
  1454. 0 0 6 0 43 0 0 0 0 /usr/src/sys/kern/kern_umtx.c:3917 (spin mutex:sched lock 1)
  1455. 1 0 20 0 19 1 0 0 0 /usr/src/sys/kern/kern_fork.c:721 (spin mutex:sched lock 1)
  1456. 19 0 418973 0 593514 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:4361 (sleep mutex:ix0:rx(2))
  1457. 9 0 964 0 2498 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:4420 (sleep mutex:ix0:rx(2))
  1458. 481 0 156812 0 2498 62 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:1525 (sleep mutex:ix0:tx(2))
  1459. 152 0 23041 0 7118 3 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:1525 (sleep mutex:ix1:tx(2))
  1460. 1 0 4 0 5 0 0 0 0 /usr/src/sys/netinet/tcp_timewait.c:307 (sleep mutex:accept)
  1461. 3 0 9 0 3 3 0 0 0 /usr/src/sys/netinet/tcp_timewait.c:644 (rw:tcpinp)
  1462. 0 0 1 0 5 0 0 0 0 /usr/src/sys/netinet/tcp_timewait.c:289 (sleep mutex:so_rcv)
  1463. 0 0 2 0 5 0 0 0 0 /usr/src/sys/netinet/tcp_timewait.c:308 (sleep mutex:so_rcv)
  1464. 0 0 7 0 13 0 0 0 0 /usr/src/sys/netinet6/udp6_usrreq.c:276 (rw:udp)
  1465. 0 0 1 0 5 0 0 0 0 /usr/src/sys/kern/kern_mutex.c:160 (sleep mutex:tcp_sc_head)
  1466. 0 0 6 0 26 0 0 0 0 /usr/src/sys/kern/sched_ule.c:2151 (spin mutex:sched lock 2)
  1467. 0 0 1 0 7 0 0 0 0 /usr/src/sys/kern/subr_sleepqueue.c:424 (spin mutex:sched lock 2)
  1468. 0 0 37 0 209 0 0 0 0 /usr/src/sys/kern/subr_sleepqueue.c:616 (spin mutex:sched lock 2)
  1469. 0 0 0 0 4 0 0 0 0 /usr/src/sys/kern/subr_sleepqueue.c:651 (spin mutex:sched lock 2)
  1470. 0 0 0 0 2 0 0 0 0 /usr/src/sys/kern/subr_turnstile.c:731 (spin mutex:sched lock 2)
  1471. 1 1 13 6 29 0 0 0 9 /usr/src/sys/kern/sched_ule.c:2611 (spin mutex:sched lock 2)
  1472. 1 0 2 0 3 0 0 0 0 /usr/src/sys/kern/subr_turnstile.c:896 (spin mutex:sched lock 2)
  1473. 1 1 6888 3 60338 0 0 0 5 /usr/src/sys/kern/kern_clock.c:537 (spin mutex:sched lock 2)
  1474. 0 0 1591 0 7670 0 0 0 1 /usr/src/sys/kern/kern_clock.c:764 (spin mutex:sched lock 2)
  1475. 0 0 754 0 5654 0 0 0 0 /usr/src/sys/kern/kern_switch.c:211 (spin mutex:sched lock 2)
  1476. 12 1 3224 11 9635 0 0 0 23 /usr/src/sys/kern/kern_intr.c:1370 (spin mutex:sched lock 2)
  1477. 0 0 0 0 1 0 0 0 0 /usr/src/sys/kern/kern_synch.c:609 (spin mutex:sched lock 2)
  1478. 0 0 64 0 222 0 0 0 0 /usr/src/sys/kern/sched_ule.c:1897 (spin mutex:sched lock 2)
  1479. 12 0 1508 0 15578 0 0 0 0 /usr/src/sys/kern/sched_ule.c:1940 (spin mutex:sched lock 2)
  1480. 1 0 2 0 3 0 0 0 0 /usr/src/sys/kern/subr_turnstile.c:211 (spin mutex:sched lock 2)
  1481. 0 0 32 0 220 0 0 0 0 /usr/src/sys/kern/subr_sleepqueue.c:340 (spin mutex:sched lock 2)
  1482. 0 0 0 0 3 0 0 0 0 /usr/src/sys/netpfil/pf/pf.c:1701 (sleep mutex:pf unlinked rules)
  1483. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:2215 (sleep mutex:zio_buf_6144)
  1484. 10 0 64 0 7 9 0 0 0 /usr/src/sys/netinet6/in6_src.c:305 (rw:in6_ifaddr_lock)
  1485. 0 0 0 0 2 0 0 0 0 /usr/src/sys/kern/kern_proc.c:601 (sleep mutex:ttymtx)
  1486. 0 0 1 0 5 0 0 0 0 /usr/src/sys/vm/uma_core.c:2215 (sleep mutex:16384)
  1487. 0 0 1 0 5 0 0 0 0 /usr/src/sys/netinet6/nd6_nbr.c:1108 (sleep mutex:rtentry)
  1488. 0 0 0 0 7 0 0 0 0 /usr/src/sys/kern/kern_proc.c:352 (sleep mutex:process group)
  1489. 0 0 3 0 8 0 0 0 0 /usr/src/sys/kern/kern_proc.c:466 (sleep mutex:process group)
  1490. 1 0 6 0 8 0 0 0 0 /usr/src/sys/kern/kern_proc.c:538 (sleep mutex:process group)
  1491. 0 0 4 0 8 0 0 0 0 /usr/src/sys/kern/kern_proc.c:539 (sleep mutex:process group)
  1492. 0 0 1 0 8 0 0 0 0 /usr/src/sys/kern/kern_proc.c:540 (sleep mutex:process lock)
  1493. 0 0 0 0 3 0 0 0 0 /usr/src/sys/netpfil/pf/pf_if.c:255 (sleep mutex:pf unlinked interfaces)
  1494. 12 0 149711 0 208519 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:4361 (sleep mutex:ix0:rx(3))
  1495. 2 0 630 0 1885 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:4420 (sleep mutex:ix0:rx(3))
  1496. 1 0 8 0 32 0 0 0 0 /usr/src/sys/netinet6/in6_src.c:964 (sleep mutex:addrsel_lock)
  1497. 0 0 0 0 4 0 0 0 0 /usr/src/sys/vm/uma_core.c:1022 (sleep mutex:256 Bucket)
  1498. 248 0 17677 0 999 17 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:1525 (sleep mutex:ix1:tx(3))
  1499. 524 1 69788 11 1885 37 0 0 12 /usr/src/sys/dev/ixgbe/ixgbe.c:1525 (sleep mutex:ix0:tx(3))
  1500. 0 0 1 0 5 0 0 0 0 /usr/src/sys/kern/tty.c:378 (sleep mutex:process lock)
  1501. 4 0 30 0 10 3 0 0 0 /usr/src/sys/kern/kern_prot.c:410 (sx:proctree)
  1502. 39451 0 84143 0 24576 3 0 0 0 /usr/src/sys/netpfil/pf/pf.c:1513 (sleep mutex:pf_srchash)
  1503. 1 0 3 0 5 0 0 0 0 /usr/src/sys/kern/tty.c:1644 (sleep mutex:ttymtx)
  1504. 5600 0 5776 0 7 825 0 0 0 /usr/src/sys/dev/random/yarrow.c:253 (sleep mutex:Yarrow reseed)
  1505. 0 0 1 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:2969 (sleep mutex:pf source nodes)
  1506. 0 0 1 0 3 0 0 0 0 /usr/src/sys/netpfil/pf/pf_norm.c:209 (sleep mutex:pf fragments)
  1507. 1 0 3 0 5 0 0 0 0 /usr/src/sys/kern/tty.c:1635 (sx:proctree)
  1508. 0 0 0 0 1 0 0 0 0 /usr/src/sys/vm/uma_core.c:2268 (sleep mutex:256 Bucket)
  1509. 0 0 1 0 3 0 0 0 0 /usr/src/sys/netpfil/pf/pf.c:1685 (sleep mutex:pf overload/flush queue)
  1510. 0 0 0 0 1 0 0 0 0 /usr/src/sys/vm/uma_core.c:2379 (sleep mutex:256 Bucket)
  1511. 1 0 4 0 5 0 0 0 0 /usr/src/sys/netinet6/nd6.c:1577 (rw:if_afdata)
  1512. 0 0 0 0 1 0 0 0 0 /usr/src/sys/vm/uma_core.c:1022 (sleep mutex:UMA Slabs)
  1513. 0 0 6 0 9 0 0 0 0 /usr/src/sys/kern/kern_synch.c:609 (spin mutex:sched lock 3)
  1514. 0 0 0 0 1 0 0 0 0 /usr/src/sys/kern/kern_thread.c:515 (spin mutex:sched lock 11)
  1515. 0 0 225 0 649 0 0 0 0 /usr/src/sys/kern/sched_ule.c:1897 (spin mutex:sched lock 3)
  1516. 12 0 747 0 6349 0 0 0 0 /usr/src/sys/kern/sched_ule.c:1940 (spin mutex:sched lock 3)
  1517. 1 0 4 0 6 0 0 0 0 /usr/src/sys/kern/subr_turnstile.c:211 (spin mutex:sched lock 3)
  1518. 0 0 74 0 646 0 0 0 0 /usr/src/sys/kern/subr_sleepqueue.c:340 (spin mutex:sched lock 3)
  1519. 0 0 8 0 49 0 0 0 0 /usr/src/sys/kern/sched_ule.c:2151 (spin mutex:sched lock 3)
  1520. 0 0 1 0 5 0 0 0 0 /usr/src/sys/kern/sched_ule.c:2188 (spin mutex:sched lock 3)
  1521. 0 0 10 0 51 0 0 0 0 /usr/src/sys/kern/subr_sleepqueue.c:424 (spin mutex:sched lock 3)
  1522. 0 0 88 0 510 0 0 0 0 /usr/src/sys/kern/subr_sleepqueue.c:616 (spin mutex:sched lock 3)
  1523. 0 0 18 0 85 0 0 0 1 /usr/src/sys/kern/subr_sleepqueue.c:651 (spin mutex:sched lock 3)
  1524. 0 0 0 0 3 0 0 0 0 /usr/src/sys/kern/subr_turnstile.c:731 (spin mutex:sched lock 3)
  1525. 0 0 0 0 1 0 0 0 0 /usr/src/sys/kern/kern_fork.c:484 (spin mutex:sched lock 3)
  1526. 0 0 2 0 4 0 0 0 0 /usr/src/sys/kern/subr_turnstile.c:896 (spin mutex:sched lock 3)
  1527. 1 0 1 0 1 1 0 0 0 /usr/src/sys/kern/kern_fork.c:721 (spin mutex:sched lock 3)
  1528. 1 1 6839 4 59983 0 0 0 7 /usr/src/sys/kern/kern_clock.c:537 (spin mutex:sched lock 3)
  1529. 0 0 1633 0 7632 0 0 0 2 /usr/src/sys/kern/kern_clock.c:764 (spin mutex:sched lock 3)
  1530. 0 0 2 0 5 0 0 0 0 /usr/src/sys/kern/vfs_subr.c:1900 (spin mutex:sched lock 3)
  1531. 1 0 468 0 2473 0 0 0 0 /usr/src/sys/kern/kern_switch.c:211 (spin mutex:sched lock 3)
  1532. 9 1 971 2 2964 0 0 0 3 /usr/src/sys/kern/kern_intr.c:1370 (spin mutex:sched lock 3)
  1533. 0 0 2 0 15 0 0 0 0 /usr/src/sys/fs/devfs/devfs_vnops.c:914 (sleep mutex:dev_clone)
  1534. 1 0 33 0 127 0 0 0 0 /usr/src/sys/vm/vm_object.c:738 (rw:vm object)
  1535. 0 0 16 0 127 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dnode.c:1334 (sx:os->os_lock)
  1536. 0 0 1 0 9 0 0 0 0 /usr/src/sys/vm/uma_core.c:2268 (sleep mutex:4096)
  1537. 0 0 4 0 9 0 0 0 0 /usr/src/sys/vm/uma_core.c:2379 (sleep mutex:4096)
  1538. 0 0 12 0 127 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_znode.c:1381 (sx:zp->z_lock)
  1539. 0 0 22 0 251 0 0 0 0 /usr/src/sys/kern/vfs_subr.c:2702 (sleep mutex:struct mount mtx)
  1540. 0 0 1 0 12 0 0 0 0 /usr/src/sys/kern/kern_descrip.c:343 (sleep mutex:process lock)
  1541. 13 0 422 0 500 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dmu_tx.c:160 (sx:dn->dn_struct_rwlock)
  1542. 0 0 0 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:2725 (sleep mutex:zio_buf_4096)
  1543. 0 0 3 0 6 0 0 0 0 /usr/src/sys/kern/vfs_cache.c:1089 (sx:filedesc structure)
  1544. 2 0 126 0 115 1 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dmu_tx.c:309 (sx:dn->dn_struct_rwlock)
  1545. 0 0 12 0 115 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c:1088 (sx:zp->z_acl_lock)
  1546. 0 0 9 0 127 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dnode.c:1322 (sx:dn->dn_mtx)
  1547. 2 0 192 0 254 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dmu_tx.c:438 (sx:dn->dn_struct_rwlock)
  1548. 7 0 487 0 127 3 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_znode.c:1357 (sx:zfsvfs->z_hold_mtx[i])
  1549. 0 0 34 0 127 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_znode.c:1379 (sx:zfsvfs->z_hold_mtx[i])
  1550. 4 0 11 0 5 2 0 0 0 /usr/src/sys/fs/devfs/devfs_vnops.c:912 (sx:clone events drain lock)
  1551. 2 0 14 0 127 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_znode.c:1419 (sleep mutex:struct mount mtx)
  1552. 4 0 33 0 10 3 0 0 0 /usr/src/sys/kern/kern_event.c:1838 (sleep mutex:kqueue)
  1553. 0 0 8 0 110 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_rlock.c:580 (sx:zp->z_range_lock)
  1554. 1 0 83 0 127 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/sa.c:1349 (sx:hdl->sa_lock)
  1555. 20 0 64 0 155 0 0 0 0 /usr/src/sys/kern/vfs_cache.c:949 (rw:Name Cache)
  1556. 0 0 13 0 115 0 0 0 0 /usr/src/sys/kern/vfs_vnops.c:2053 (sleep mutex:process lock)
  1557. 91 0 4216 0 115 36 0 0 0 /usr/src/sys/kern/vfs_vnops.c:865 (lockmgr:zfs)
  1558. 0 0 2 0 7 0 0 0 0 /usr/src/sys/kern/kern_mib.c:295 (sleep mutex:jail mutex)
  1559. 0 0 34 0 127 0 0 0 0 /usr/src/sys/kern/vfs_subr.c:1169 (sleep mutex:vnode interlock)
  1560. 0 0 0 0 1 0 0 0 0 /usr/src/sys/fs/devfs/devfs_vnops.c:918 (sx:devfsmount)
  1561. 10 0 26 0 36 0 0 0 0 /usr/src/sys/kern/vfs_cache.c:1236 (rw:Name Cache)
  1562. 1 0 8 0 14 0 0 0 0 /usr/src/sys/kern/vfs_cache.c:1291 (rw:Name Cache)
  1563. 1 0 6 0 7 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/sa.c:1813 (sx:hdl->sa_lock)
  1564. 1 0 39 0 254 0 0 0 0 /usr/src/sys/kern/vfs_subr.c:1269 (rw:bufobj interlock)
  1565. 0 0 18 0 254 0 0 0 0 /usr/src/sys/kern/vfs_subr.c:1319 (rw:bufobj interlock)
  1566. 7 0 65 0 10 6 0 0 0 /usr/src/sys/netinet/in_pcb.c:1803 (rw:udpinp)
  1567. 0 0 9 0 127 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_znode.c:1407 (sx:zfsvfs->z_znodes_lock)
  1568. 0 0 16 0 127 0 0 0 0 /usr/src/sys/vm/vnode_pager.c:158 (rw:vm object)
  1569. 0 0 9 0 127 0 0 0 0 /usr/src/sys/vm/vnode_pager.c:279 (rw:vm object)
  1570. 0 0 22 0 115 0 0 0 0 /usr/src/sys/vm/vnode_pager.c:377 (rw:vm object)
  1571. 350 0 13143 0 1162 11 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:1525 (sleep mutex:ix1:tx(4))
  1572. 397 224 19024 225 744 25 0 0 2 /usr/src/sys/dev/ixgbe/ixgbe.c:1525 (sleep mutex:ix0:tx(4))
  1573. 0 0 0 0 4 0 0 0 0 /usr/src/sys/kern/kern_prot.c:145 (sleep mutex:process lock)
  1574. 20 0 968 0 127 7 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_dir.c:832 (sx:zp->z_lock)
  1575. 2 0 156 0 134 1 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_dir.c:888 (sx:zp->z_lock)
  1576. 2 0 8 0 4 2 0 0 0 /usr/src/sys/kern/tty_tty.c:68 (sx:clone events drain lock)
  1577. 0 0 12 0 127 0 0 0 0 /usr/src/sys/kern/vfs_subr.c:2659 (sleep mutex:vnode interlock)
  1578. 126 0 555 0 7 79 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c:3849 (sx:zp->z_name_lock)
  1579. 1 0 53 0 127 0 0 0 0 /usr/src/sys/kern/vfs_subr.c:1168 (sleep mutex:struct mount mtx)
  1580. 0 0 13 0 127 0 0 0 0 /usr/src/sys/kern/vfs_subr.c:2823 (sleep mutex:vnode interlock)
  1581. 0 0 13 0 127 0 0 0 0 /usr/src/sys/kern/kern_lockf.c:787 (sleep mutex:vnode interlock)
  1582. 0 0 3 0 9 0 0 0 0 /usr/src/sys/vm/uma_core.c:1022 (sleep mutex:4096)
  1583. 0 0 2 0 4 0 0 0 0 /usr/src/sys/kern/tty_tty.c:67 (sx:proctree)
  1584. 0 0 30 0 254 0 0 0 0 /usr/src/sys/kern/vfs_subr.c:1315 (rw:vm object)
  1585. 0 0 23 0 254 0 0 0 0 /usr/src/sys/kern/vfs_subr.c:1328 (rw:vm object)
  1586. 0 0 1 0 4 0 0 0 0 /usr/src/sys/vm/uma_core.c:2215 (sleep mutex:VM OBJECT)
  1587. 0 0 2 0 20 0 0 0 0 /usr/src/sys/kern/kern_descrip.c:513 (sx:filedesc structure)
  1588. 5 0 49 0 10 4 0 0 0 /usr/src/sys/netinet/udp_usrreq.c:360 (sleep mutex:so_rcv)
  1589. 47 0 54 0 24 2 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zil.c:1423 (sx:zilog->zl_itxg[i].itxg_lock)
  1590. 0 0 1 0 5 0 0 0 0 /usr/src/sys/kern/subr_eventhandler.c:254 (sleep mutex:dev_clone)
  1591. 49 0 3901 0 127 30 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c:6547 (sx:zfsvfs->z_teardown_inactive_lock)
  1592. 0 0 12 0 127 0 0 0 0 /usr/src/sys/kern/vfs_subr.c:1176 (sleep mutex:vnode_free_list)
  1593. 0 0 0 0 4 0 0 0 0 /usr/src/sys/fs/devfs/devfs_vnops.c:168 (sleep mutex:cdevpriv lock)
  1594. 0 0 0 0 3 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dbuf.c:1357 (sx:dn->dn_mtx)
  1595. 0 0 45 1 236 0 0 0 6 /usr/src/sys/x86/x86/io_apic.c:226 (spin mutex:icu)
  1596. 1 0 24 0 35 0 0 0 0 /usr/src/sys/kern/kern_synch.c:609 (spin mutex:sched lock 4)
  1597. 0 0 131 0 401 0 0 0 0 /usr/src/sys/kern/sched_ule.c:1897 (spin mutex:sched lock 4)
  1598. 1 0 425 0 3859 0 0 0 0 /usr/src/sys/kern/sched_ule.c:1940 (spin mutex:sched lock 4)
  1599. 0 0 60 0 396 0 0 0 0 /usr/src/sys/kern/subr_sleepqueue.c:340 (spin mutex:sched lock 4)
  1600. 0 0 1 0 6 0 0 0 0 /usr/src/sys/kern/sched_ule.c:2137 (spin mutex:sched lock 4)
  1601. 0 0 10 0 65 0 0 0 1 /usr/src/sys/kern/sched_ule.c:2151 (spin mutex:sched lock 4)
  1602. 0 0 5 0 19 0 0 0 0 /usr/src/sys/kern/sched_ule.c:2188 (spin mutex:sched lock 4)
  1603. 0 0 16 0 75 0 0 0 0 /usr/src/sys/kern/subr_sleepqueue.c:424 (spin mutex:sched lock 4)
  1604. 0 0 52 0 272 0 0 0 0 /usr/src/sys/kern/subr_sleepqueue.c:616 (spin mutex:sched lock 4)
  1605. 0 0 9 0 49 0 0 0 0 /usr/src/sys/kern/subr_sleepqueue.c:651 (spin mutex:sched lock 4)
  1606. 0 0 1 0 5 0 0 0 0 /usr/src/sys/kern/subr_turnstile.c:731 (spin mutex:sched lock 4)
  1607. 0 0 0 0 1 0 0 0 0 /usr/src/sys/kern/sched_ule.c:2611 (spin mutex:sched lock 4)
  1608. 0 0 1 0 3 0 0 0 0 /usr/src/sys/kern/kern_fork.c:484 (spin mutex:sched lock 4)
  1609. 0 0 2 0 4 0 0 0 0 /usr/src/sys/kern/subr_turnstile.c:896 (spin mutex:sched lock 4)
  1610. 0 0 0 0 4 0 0 0 0 /usr/src/sys/kern/sched_ule.c:2712 (spin mutex:sched lock 4)
  1611. 0 0 1 0 8 0 0 0 0 /usr/src/sys/kern/kern_umtx.c:3917 (spin mutex:sched lock 4)
  1612. 1 0 3 0 3 1 0 0 0 /usr/src/sys/kern/kern_fork.c:721 (spin mutex:sched lock 4)
  1613. 0 1 6846 2 59866 0 0 0 5 /usr/src/sys/kern/kern_clock.c:537 (spin mutex:sched lock 4)
  1614. 0 0 1601 0 7635 0 0 0 2 /usr/src/sys/kern/kern_clock.c:764 (spin mutex:sched lock 4)
  1615. 0 0 2 0 5 0 0 0 0 /usr/src/sys/kern/vfs_subr.c:1900 (spin mutex:sched lock 4)
  1616. 1 0 191 0 1354 0 0 0 0 /usr/src/sys/kern/kern_switch.c:211 (spin mutex:sched lock 4)
  1617. 0 0 2 0 5 0 0 0 0 /usr/src/sys/kern/kern_thread.c:489 (spin mutex:sched lock 4)
  1618. 0 0 0 0 5 0 0 0 0 /usr/src/sys/kern/kern_thread.c:515 (spin mutex:sched lock 4)
  1619. 0 0 0 0 3 0 0 0 0 /usr/src/sys/kern/subr_trap.c:215 (spin mutex:sched lock 4)
  1620. 1 0 2 0 2 1 0 0 0 /usr/src/sys/kern/subr_trap.c:253 (spin mutex:sched lock 4)
  1621. 1 1 665 9 1958 0 0 0 16 /usr/src/sys/kern/kern_intr.c:1370 (spin mutex:sched lock 4)
  1622. 0 0 0 0 1 0 0 0 0 /usr/src/sys/vm/uma_core.c:1022 (sleep mutex:zio_buf_45056)
  1623. 0 0 7 0 49 0 0 0 0 /usr/src/sys/kern/kern_resource.c:1270 (rw:uidinfo hash)
  1624. 0 0 3 0 23 0 0 0 0 /usr/src/sys/kern/kern_resource.c:1276 (rw:uidinfo hash)
  1625. 0 0 5 0 61 0 0 0 0 /usr/src/sys/kern/kern_prot.c:1946 (sleep mutex:process lock)
  1626. 0 0 0 0 2 0 0 0 0 /usr/src/sys/netinet6/nd6_nbr.c:471 (rw:lle)
  1627. 0 0 0 0 2 0 0 0 0 /usr/src/sys/netinet6/nd6_nbr.c:581 (sleep mutex:rtentry)
  1628. 0 0 0 0 1 0 0 0 0 /usr/src/sys/vm/uma_core.c:2215 (sleep mutex:zio_buf_45056)
  1629. 0 0 0 0 1 0 0 0 0 /usr/src/sys/vm/uma_core.c:2268 (sleep mutex:zio_buf_45056)
  1630. 1 0 1 0 1 1 0 0 0 /usr/src/sys/vm/uma_core.c:2379 (sleep mutex:zio_buf_45056)
  1631. 0 0 0 0 1 0 0 0 0 /usr/src/sys/vm/uma_core.c:2725 (sleep mutex:selfd)
  1632. 8 0 163881 0 226730 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:4361 (sleep mutex:ix0:rx(5))
  1633. 3 0 686 0 2361 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:4420 (sleep mutex:ix0:rx(5))
  1634. 0 0 4 0 13 0 0 0 0 /usr/src/sys/vm/uma_core.c:2725 (sleep mutex:12 Bucket)
  1635. 509 180 73554 193 2361 31 0 0 13 /usr/src/sys/dev/ixgbe/ixgbe.c:1525 (sleep mutex:ix0:tx(5))
  1636. 349 0 19222 0 4918 3 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:1525 (sleep mutex:ix1:tx(5))
  1637. 1 0 3 0 3 1 0 0 0 /usr/src/sys/kern/kern_prot.c:507 (sleep mutex:process lock)
  1638. 0 0 0 0 1 0 0 0 0 /usr/src/sys/kern/kern_exec.c:916 (sleep mutex:process lock)
  1639. 0 0 2 0 3 0 0 0 0 /usr/src/sys/kern/kern_prot.c:675 (sleep mutex:process lock)
  1640. 1 0 8 0 11 0 0 0 0 /usr/src/sys/kern/kern_prot.c:839 (sleep mutex:process lock)
  1641. 0 0 0 0 2 0 0 0 0 /usr/src/sys/netinet6/nd6.c:551 (rw:lle)
  1642. 1 0 4 0 4 1 0 0 0 /usr/src/sys/kern/kern_rwlock.c:149 (rw:lle)
  1643. 0 0 0 0 3 0 0 0 0 /usr/src/sys/kern/subr_trap.c:215 (spin mutex:sched lock 5)
  1644. 0 0 2 0 3 0 0 0 0 /usr/src/sys/kern/subr_trap.c:253 (spin mutex:sched lock 5)
  1645. 12 7 1969 12 7410 0 0 0 9 /usr/src/sys/kern/kern_intr.c:1370 (spin mutex:sched lock 5)
  1646. 0 0 18 0 29 0 0 0 0 /usr/src/sys/kern/kern_synch.c:609 (spin mutex:sched lock 5)
  1647. 9 0 279 0 962 0 0 0 0 /usr/src/sys/kern/sched_ule.c:1897 (spin mutex:sched lock 5)
  1648. 1 0 1383 0 15508 0 0 0 0 /usr/src/sys/kern/sched_ule.c:1940 (spin mutex:sched lock 5)
  1649. 1 0 4 0 12 0 0 0 0 /usr/src/sys/kern/subr_turnstile.c:211 (spin mutex:sched lock 5)
  1650. 0 0 103 0 949 0 0 0 0 /usr/src/sys/kern/subr_sleepqueue.c:340 (spin mutex:sched lock 5)
  1651. 0 0 10 0 56 0 0 0 2 /usr/src/sys/kern/sched_ule.c:2151 (spin mutex:sched lock 5)
  1652. 0 0 3 0 11 0 0 0 0 /usr/src/sys/kern/sched_ule.c:2188 (spin mutex:sched lock 5)
  1653. 0 0 14 0 76 0 0 0 0 /usr/src/sys/kern/subr_sleepqueue.c:424 (spin mutex:sched lock 5)
  1654. 0 0 116 0 737 0 0 0 0 /usr/src/sys/kern/subr_sleepqueue.c:616 (spin mutex:sched lock 5)
  1655. 0 0 26 0 136 0 0 0 0 /usr/src/sys/kern/subr_sleepqueue.c:651 (spin mutex:sched lock 5)
  1656. 0 0 2 0 13 0 0 0 0 /usr/src/sys/kern/subr_turnstile.c:731 (spin mutex:sched lock 5)
  1657. 0 0 1 0 2 0 0 0 0 /usr/src/sys/kern/kern_fork.c:484 (spin mutex:sched lock 5)
  1658. 1 0 10 0 14 0 0 0 0 /usr/src/sys/kern/subr_turnstile.c:896 (spin mutex:sched lock 5)
  1659. 0 0 0 0 2 0 0 0 0 /usr/src/sys/kern/sched_ule.c:2712 (spin mutex:sched lock 5)
  1660. 0 0 1 0 5 0 0 0 0 /usr/src/sys/kern/kern_umtx.c:3917 (spin mutex:sched lock 5)
  1661. 0 0 1 0 2 0 0 0 0 /usr/src/sys/kern/kern_fork.c:721 (spin mutex:sched lock 5)
  1662. 1 0 5756 1 60118 0 0 0 5 /usr/src/sys/kern/kern_clock.c:537 (spin mutex:sched lock 5)
  1663. 0 0 1644 0 7643 0 0 0 0 /usr/src/sys/kern/kern_clock.c:764 (spin mutex:sched lock 5)
  1664. 0 0 2 0 6 0 0 0 0 /usr/src/sys/kern/vfs_subr.c:1900 (spin mutex:sched lock 5)
  1665. 11 0 989 0 6711 0 0 0 0 /usr/src/sys/kern/kern_switch.c:211 (spin mutex:sched lock 5)
  1666. 0 0 1 0 2 0 0 0 0 /usr/src/sys/kern/kern_thread.c:489 (spin mutex:sched lock 5)
  1667. 0 0 0 0 2 0 0 0 0 /usr/src/sys/kern/kern_thread.c:515 (spin mutex:sched lock 5)
  1668. 7 0 48 0 12 4 0 0 0 /usr/src/sys/kern/uipc_usrreq.c:860 (rw:unp_link_rwlock)
  1669. 0 0 13 0 122 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c:1935 (sx:zp->z_lock)
  1670. 5 0 16 0 4 4 0 0 0 /usr/src/sys/kern/uipc_usrreq.c:899 (sleep mutex:so_rcv)
  1671. 1 0 76 0 122 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c:1986 (sx:zp->z_lock)
  1672. 0 0 1 0 5 0 0 0 0 /usr/src/sys/vm/vm_glue.c:336 (sleep mutex:kstkch)
  1673. 0 0 0 0 4 0 0 0 0 /usr/src/sys/vm/uma_core.c:2725 (sleep mutex:VNODE)
  1674. 0 0 1 0 4 0 0 0 0 /usr/src/sys/kern/subr_log.c:152 (sleep mutex:msgbuf lock)
  1675. 0 0 0 0 2 0 0 0 0 /usr/src/sys/kern/subr_log.c:173 (sleep mutex:msgbuf lock)
  1676. 27 0 53 0 2 26 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c:2331 (sx:zp->z_parent_lock)
  1677. 1 0 2 0 2 1 0 0 0 /usr/src/sys/kern/tty.c:1941 (sx:tty list)
  1678. 28 0 54 0 2 27 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c:2325 (sx:zp->z_name_lock)
  1679. 0 0 0 0 2 0 0 0 0 /usr/src/sys/kern/tty.c:161 (sleep mutex:Giant)
  1680. 1 0 1 0 2 0 0 0 0 /usr/src/sys/kern/tty.c:233 (sleep mutex:Giant)
  1681. 0 0 1 0 5 0 0 0 0 /usr/src/sys/kern/subr_unit.c:615 (sleep mutex:TID lock)
  1682. 79 0 1624 0 104 15 0 0 0 /usr/src/sys/kern/vfs_vnops.c:1285 (lockmgr:zfs)
  1683. 0 0 6 0 18 0 0 0 0 /usr/src/sys/vm/uma_core.c:2215 (sleep mutex:12 Bucket)
  1684. 1 0 13 0 16 0 0 0 0 /usr/src/sys/vm/uma_core.c:2379 (sleep mutex:12 Bucket)
  1685. 1 0 139 0 257 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dmu.c:557 (sx:dn->dn_struct_rwlock)
  1686. 14 0 20 0 2 10 0 0 0 /usr/src/sys/kern/tty_ttydisc.c:483 (sleep mutex:Giant)
  1687. 0 0 0 0 2 0 0 0 0 /usr/src/sys/vm/uma_core.c:2725 (sleep mutex:S VFS Cache)
  1688. 0 0 1 0 5 0 0 0 0 /usr/src/sys/kern/subr_eventhandler.c:254 (sleep mutex:thread_ctor)
  1689. 570 0 22164 0 2532 8 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:1525 (sleep mutex:ix0:tx(6))
  1690. 541 0 15140 0 1208 12 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:1525 (sleep mutex:ix1:tx(6))
  1691. 0 0 11 0 122 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c:1901 (sleep mutex:vnode interlock)
  1692. 0 0 1 0 5 0 0 0 0 /usr/src/sys/kern/kern_thread.c:149 (sleep mutex:thread_ctor)
  1693. 2 0 11 0 5 2 0 0 0 /usr/src/sys/vm/vm_glue.c:393 (rw:vm object)
  1694. 1 0 49 0 366 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zil.c:1228 (sx:zilog->zl_itxg[i].itxg_lock)
  1695. 1 0 55 0 122 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c:1987 (sleep mutex:vnode interlock)
  1696. 0 0 1 0 8 0 0 0 0 /usr/src/sys/vm/uma_core.c:2215 (sleep mutex:1024)
  1697. 2 0 9 0 5 1 0 0 0 /usr/src/sys/kern/subr_vmem.c:1136 (sleep mutex:kernel arena)
  1698. 6 0 19 0 4 4 0 0 0 /usr/src/sys/kern/uipc_usrreq.c:893 (sleep mutex:unp_mtx)
  1699. 0 0 0 0 4 0 0 0 0 /usr/src/sys/vm/uma_core.c:2725 (sleep mutex:zfs_znode_cache)
  1700. 1 0 6255 1 60088 0 0 0 2 /usr/src/sys/kern/kern_clock.c:537 (spin mutex:sched lock 6)
  1701. 1 0 1808 0 7639 0 0 0 0 /usr/src/sys/kern/kern_clock.c:764 (spin mutex:sched lock 6)
  1702. 0 0 0 0 1 0 0 0 0 /usr/src/sys/kern/vfs_subr.c:1900 (spin mutex:sched lock 6)
  1703. 12 0 627 0 3075 0 0 0 0 /usr/src/sys/kern/kern_switch.c:211 (spin mutex:sched lock 6)
  1704. 0 0 3 0 7 0 0 0 0 /usr/src/sys/kern/kern_thread.c:489 (spin mutex:sched lock 6)
  1705. 0 0 1 0 7 0 0 0 0 /usr/src/sys/kern/kern_thread.c:515 (spin mutex:sched lock 6)
  1706. 0 0 1 0 4 0 0 0 0 /usr/src/sys/kern/subr_trap.c:215 (spin mutex:sched lock 6)
  1707. 0 0 2 0 3 0 0 0 0 /usr/src/sys/kern/subr_trap.c:253 (spin mutex:sched lock 6)
  1708. 1 1 1177 7 3763 0 0 0 14 /usr/src/sys/kern/kern_intr.c:1370 (spin mutex:sched lock 6)
  1709. 0 0 2 0 6 0 0 0 0 /usr/src/sys/kern/sched_ule.c:2137 (spin mutex:sched lock 9)
  1710. 9 0 15 0 2 7 0 0 0 /usr/src/sys/dev/syscons/syscons.c:2694 (spin mutex:scrlock)
  1711. 1 0 19 0 22 0 0 0 0 /usr/src/sys/kern/kern_synch.c:609 (spin mutex:sched lock 6)
  1712. 1 1 125 1 273 0 0 0 1 /usr/src/sys/kern/sched_ule.c:1897 (spin mutex:sched lock 6)
  1713. 11 0 714 0 7217 0 0 0 0 /usr/src/sys/kern/sched_ule.c:1940 (spin mutex:sched lock 6)
  1714. 1 0 4 0 3 1 0 0 0 /usr/src/sys/kern/subr_turnstile.c:211 (spin mutex:sched lock 6)
  1715. 0 0 59 0 270 0 0 0 0 /usr/src/sys/kern/subr_sleepqueue.c:340 (spin mutex:sched lock 6)
  1716. 0 0 1 0 4 0 0 0 0 /usr/src/sys/kern/sched_ule.c:2137 (spin mutex:sched lock 6)
  1717. 0 0 11 0 35 0 0 0 0 /usr/src/sys/kern/sched_ule.c:2151 (spin mutex:sched lock 6)
  1718. 0 0 6 0 24 0 0 0 0 /usr/src/sys/kern/sched_ule.c:2188 (spin mutex:sched lock 6)
  1719. 0 0 9 0 37 0 0 0 0 /usr/src/sys/kern/subr_sleepqueue.c:424 (spin mutex:sched lock 6)
  1720. 0 0 46 0 189 0 0 0 0 /usr/src/sys/kern/subr_sleepqueue.c:616 (spin mutex:sched lock 6)
  1721. 0 0 11 0 44 0 0 0 0 /usr/src/sys/kern/subr_sleepqueue.c:651 (spin mutex:sched lock 6)
  1722. 4 0 6 0 2 3 0 0 0 /usr/src/sys/kern/subr_msgbuf.c:199 (spin mutex:msgbuf)
  1723. 0 0 0 0 3 0 0 0 0 /usr/src/sys/kern/subr_turnstile.c:731 (spin mutex:sched lock 6)
  1724. 0 0 0 0 4 0 0 0 0 /usr/src/sys/kern/subr_msgbuf.c:325 (spin mutex:msgbuf)
  1725. 0 0 1 0 2 0 0 0 1 /usr/src/sys/kern/sched_ule.c:2611 (spin mutex:sched lock 6)
  1726. 1 0 3 0 5 0 0 0 0 /usr/src/sys/kern/kern_fork.c:484 (spin mutex:sched lock 6)
  1727. 0 0 2 0 3 0 0 0 0 /usr/src/sys/kern/subr_turnstile.c:896 (spin mutex:sched lock 6)
  1728. 0 0 1 0 7 0 0 0 0 /usr/src/sys/kern/sched_ule.c:2712 (spin mutex:sched lock 6)
  1729. 0 0 2 0 11 0 0 0 0 /usr/src/sys/kern/kern_umtx.c:3917 (spin mutex:sched lock 6)
  1730. 2 0 6 0 5 1 0 0 0 /usr/src/sys/kern/kern_fork.c:721 (spin mutex:sched lock 6)
  1731. 0 0 2 0 8 0 0 0 0 /usr/src/sys/kern/vfs_cache.c:1153 (sx:filedesc structure)
  1732. 0 0 0 0 1 0 0 0 0 /usr/src/sys/vm/uma_core.c:2215 (sleep mutex:zio_buf_12288)
  1733. 0 0 1 0 4 0 0 0 0 /usr/src/sys/vm/uma_core.c:2215 (sleep mutex:zio_link_cache)
  1734. 14 0 14 0 1 14 0 0 0 /usr/src/sys/vm/uma_core.c:495 (sleep mutex:zio_buf_512)
  1735. 6 0 664 0 674 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:4361 (sleep mutex:ix1:rx(7))
  1736. 0 0 0 0 2 0 0 0 0 /usr/src/sys/vm/uma_core.c:2215 (sleep mutex:64)
  1737. 1 0 541 0 3323 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:4420 (sleep mutex:ix1:rx(7))
  1738. 1 0 7 0 6 1 0 0 0 /usr/src/sys/amd64/amd64/../../kern/subr_syscall.c:230 (sleep mutex:process lock)
  1739. 0 0 0 0 1 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zil.c:1519 (sx:zilog->zl_lock)
  1740. 0 0 0 0 2 0 0 0 0 /usr/src/sys/vm/uma_core.c:2725 (sleep mutex:dmu_buf_impl_t)
  1741. 749 47 76565 60 3323 23 0 0 25 /usr/src/sys/dev/ixgbe/ixgbe.c:1525 (sleep mutex:ix1:tx(7))
  1742. 233 0 16105 0 297 54 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:1525 (sleep mutex:ix0:tx(7))
  1743. 0 0 1 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:2215 (sleep mutex:zio_buf_1024)
  1744. 5 0 6 0 2 3 0 0 0 /usr/src/sys/kern/kern_sysctl.c:673 (sx:sysctl lock)
  1745. 0 0 0 0 2 0 0 0 0 /usr/src/sys/vm/uma_core.c:2725 (sleep mutex:zio_buf_512)
  1746. 0 0 1 0 3 0 0 0 0 /usr/src/sys/kern/kern_sysctl.c:901 (sx:sysctl lock)
  1747. 0 0 126 0 1193 0 0 0 1 /usr/src/sys/kern/subr_sleepqueue.c:616 (spin mutex:sched lock 7)
  1748. 0 0 25 0 118 0 0 0 0 /usr/src/sys/kern/subr_sleepqueue.c:651 (spin mutex:sched lock 7)
  1749. 0 0 4 0 22 0 0 0 0 /usr/src/sys/kern/subr_turnstile.c:731 (spin mutex:sched lock 7)
  1750. 1 0 62 2 115 0 0 0 5 /usr/src/sys/kern/sched_ule.c:2611 (spin mutex:sched lock 7)
  1751. 0 0 0 0 2 0 0 0 0 /usr/src/sys/kern/kern_thread.c:515 (spin mutex:sched lock 0)
  1752. 1 0 7 0 11 0 0 0 0 /usr/src/sys/kern/kern_fork.c:484 (spin mutex:sched lock 7)
  1753. 1 0 9 0 13 0 0 0 0 /usr/src/sys/kern/subr_turnstile.c:896 (spin mutex:sched lock 7)
  1754. 0 0 3 0 14 0 0 0 0 /usr/src/sys/kern/sched_ule.c:2712 (spin mutex:sched lock 7)
  1755. 0 0 3 0 19 0 0 0 0 /usr/src/sys/kern/kern_umtx.c:3917 (spin mutex:sched lock 7)
  1756. 1 0 11 0 11 1 0 0 0 /usr/src/sys/kern/kern_fork.c:721 (spin mutex:sched lock 7)
  1757. 1 1 6705 1 59892 0 0 0 3 /usr/src/sys/kern/kern_clock.c:537 (spin mutex:sched lock 7)
  1758. 1 0 1955 1 7625 0 0 0 4 /usr/src/sys/kern/kern_clock.c:764 (spin mutex:sched lock 7)
  1759. 1 0 6 0 10 0 0 0 0 /usr/src/sys/kern/vfs_subr.c:1900 (spin mutex:sched lock 7)
  1760. 1 0 628 0 3356 0 0 0 0 /usr/src/sys/kern/kern_switch.c:211 (spin mutex:sched lock 7)
  1761. 0 0 5 0 11 0 0 0 0 /usr/src/sys/kern/kern_thread.c:489 (spin mutex:sched lock 7)
  1762. 0 0 2 0 11 0 0 0 0 /usr/src/sys/kern/kern_thread.c:515 (spin mutex:sched lock 7)
  1763. 0 0 1 0 5 0 0 0 0 /usr/src/sys/kern/subr_trap.c:215 (spin mutex:sched lock 7)
  1764. 1 0 3 0 4 0 0 0 0 /usr/src/sys/kern/subr_trap.c:253 (spin mutex:sched lock 7)
  1765. 1 0 1043 4 3834 0 0 0 10 /usr/src/sys/kern/kern_intr.c:1370 (spin mutex:sched lock 7)
  1766. 1 0 36 0 46 0 0 0 0 /usr/src/sys/kern/kern_synch.c:609 (spin mutex:sched lock 7)
  1767. 0 0 0 0 3 0 0 0 0 /usr/src/sys/kern/kern_resource.c:518 (spin mutex:sched lock 7)
  1768. 0 1 395 1 1451 0 0 0 2 /usr/src/sys/kern/sched_ule.c:1897 (spin mutex:sched lock 7)
  1769. 1 0 1073 0 9510 0 0 0 0 /usr/src/sys/kern/sched_ule.c:1940 (spin mutex:sched lock 7)
  1770. 0 0 3 0 18 0 0 0 0 /usr/src/sys/kern/kern_thread.c:515 (spin mutex:sched lock 10)
  1771. 0 1 125 12 1429 0 0 0 10 /usr/src/sys/kern/subr_sleepqueue.c:340 (spin mutex:sched lock 7)
  1772. 0 0 1 0 6 0 0 0 0 /usr/src/sys/kern/sched_ule.c:2137 (spin mutex:sched lock 7)
  1773. 0 0 29 0 151 0 0 0 0 /usr/src/sys/kern/sched_ule.c:2151 (spin mutex:sched lock 7)
  1774. 0 0 6 0 30 0 0 0 0 /usr/src/sys/kern/sched_ule.c:2188 (spin mutex:sched lock 7)
  1775. 0 0 30 0 118 0 0 0 0 /usr/src/sys/kern/subr_sleepqueue.c:424 (spin mutex:sched lock 7)
  1776. 3 0 4 0 2 2 0 0 0 /usr/src/sys/kern/uipc_usrreq.c:1366 (sleep mutex:unp_mtx)
  1777. 3 0 4 0 2 2 0 0 0 /usr/src/sys/kern/uipc_usrreq.c:1367 (sleep mutex:unp_mtx)
  1778. 2 0 3 0 2 1 0 0 0 /usr/src/sys/kern/uipc_usrreq.c:1368 (sleep mutex:unp_mtx)
  1779. 0 0 0 0 1 0 0 0 0 /usr/src/sys/vm/uma_core.c:2215 (sleep mutex:zio_buf_131072)
  1780. 0 0 0 0 7 0 0 0 0 /usr/src/sys/kern/vfs_syscalls.c:764 (sx:filedesc structure)
  1781. 9 0 20 0 4 5 0 0 0 /usr/src/sys/kern/uipc_usrreq.c:1409 (sleep mutex:unp_mtx)
  1782. 9 0 19 0 4 4 0 0 0 /usr/src/sys/kern/uipc_usrreq.c:1410 (sleep mutex:unp_mtx)
  1783. 0 0 0 0 4 0 0 0 0 /usr/src/sys/kern/uipc_usrreq.c:1421 (sleep mutex:unp_mtx)
  1784. 0 0 0 0 1 0 0 0 0 /usr/src/sys/vm/uma_core.c:2268 (sleep mutex:zio_buf_131072)
  1785. 0 0 2 0 10 0 0 0 0 /usr/src/sys/kern/uipc_usrreq.c:433 (sleep mutex:unp_list_lock)
  1786. 3 0 18 0 8 2 0 0 0 /usr/src/sys/kern/uipc_usrreq.c:959 (sleep mutex:so_rcv)
  1787. 0 0 0 0 1 0 0 0 0 /usr/src/sys/vm/uma_core.c:2379 (sleep mutex:zio_buf_131072)
  1788. 0 0 2 0 23 0 0 0 0 /usr/src/sys/kern/kern_resource.c:1338 (rw:uidinfo hash)
  1789. 0 0 2 0 10 0 0 0 0 /usr/src/sys/kern/uipc_usrreq.c:655 (sleep mutex:unp_list_lock)
  1790. 15 0 36 0 4 9 0 0 0 /usr/src/sys/kern/uipc_usrreq.c:1342 (rw:unp_link_rwlock)
  1791. 3 0 10 0 3 3 0 0 0 /usr/src/sys/netinet/igmp.c:824 (sleep mutex:in_multi_mtx)
  1792. 0 0 1 0 4 0 0 0 0 /usr/src/sys/kern/uipc_usrreq.c:1420 (rw:unp_link_rwlock)
  1793. 6 0 415 0 1915 0 0 0 0 /usr/src/sys/kern/vfs_subr.c:4669 (sleep mutex:vnode interlock)
  1794. 0 0 0 0 1 0 0 0 0 /usr/src/sys/kern/vfs_subr.c:4699 (sleep mutex:vnode interlock)
  1795. 0 0 0 0 1 0 0 0 0 /usr/src/sys/vm/uma_core.c:2725 (sleep mutex:sa_cache)
  1796. 0 0 0 0 1 0 0 0 0 /usr/src/sys/vm/uma_core.c:2725 (sleep mutex:zio_buf_12288)
  1797. 0 0 0 0 2 0 0 0 0 /usr/src/sys/kern/kern_proc.c:1078 (sx:allproc)
  1798. 2 0 6 0 3 2 0 0 0 /usr/src/sys/netinet/igmp.c:855 (rw:if_addr_lock)
  1799. 3 0 8 0 3 2 0 0 0 /usr/src/sys/netinet/igmp.c:825 (sleep mutex:igmp_mtx)
  1800. 0 0 0 0 2 0 0 0 0 /usr/src/sys/kern/kern_proc.c:1063 (sleep mutex:process lock)
  1801. 0 0 0 0 1 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zil.c:469 (sx:zilog->zl_lock)
  1802. 19 0 19 0 1 19 0 0 0 /usr/src/sys/vm/vm_reserv.c:610 (sleep mutex:vm page free queue)
  1803. 2 0 569 0 1916 0 0 0 0 /usr/src/sys/kern/vfs_subr.c:4653 (sleep mutex:struct mount mtx)
  1804. 0 0 0 0 1 0 0 0 0 /usr/src/sys/kern/vfs_subr.c:4680 (sleep mutex:struct mount mtx)
  1805. 0 0 1 0 3 0 0 0 0 /usr/src/sys/netinet/raw_ip.c:297 (rw:rip)
  1806. 1 0 1 0 1 1 0 0 0 /usr/src/sys/kern/subr_bus.c:539 (sleep mutex:dev mtx)
  1807. 4 0 311 0 366 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:4361 (sleep mutex:ix1:rx(8))
  1808. 0 0 0 0 1 0 0 0 0 /usr/src/sys/vm/uma_core.c:2725 (sleep mutex:KNOTE)
  1809. 2 0 10 0 7 1 0 0 0 /usr/src/sys/kern/vfs_syscalls.c:746 (lockmgr:zfs)
  1810. 1 0 269 0 2370 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:4420 (sleep mutex:ix1:rx(8))
  1811. 0 0 0 0 1 0 0 0 0 /usr/src/sys/vm/uma_core.c:2725 (sleep mutex:udp_inpcb)
  1812. 0 0 0 0 2 0 0 0 0 /usr/src/sys/kern/vfs_cache.c:676 (lockmgr:zfs)
  1813. 0 0 0 0 1 0 0 0 0 /usr/src/sys/vm/uma_core.c:1022 (sleep mutex:zio_buf_131072)
  1814. 0 0 0 0 1 0 0 0 0 /usr/src/sys/vm/uma_core.c:2725 (sleep mutex:udpcb)
  1815. 0 0 0 0 1 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zil.c:1564 (sx:zilog->zl_lock)
  1816. 0 0 6 0 93 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/vnode.c:95 (sleep mutex:vnode interlock)
  1817. 0 0 1 0 10 0 0 0 0 /usr/src/sys/kern/uipc_usrreq.c:612 (sleep mutex:unp_mtx)
  1818. 1 0 7 0 10 0 0 0 0 /usr/src/sys/kern/uipc_usrreq.c:656 (sleep mutex:unp_mtx)
  1819. 0 0 0 0 3 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zil.c:1389 (sx:zilog->zl_itxg[i].itxg_lock)
  1820. 5 0 20 0 6 3 0 0 0 /usr/src/sys/kern/uipc_usrreq.c:716 (sleep mutex:unp_mtx)
  1821. 4 0 18 0 6 3 0 0 0 /usr/src/sys/kern/uipc_usrreq.c:719 (sleep mutex:unp_mtx)
  1822. 635 1 32924 7 2370 13 0 0 8 /usr/src/sys/dev/ixgbe/ixgbe.c:1525 (sleep mutex:ix1:tx(8))
  1823. 64 0 5416 0 861 6 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:1525 (sleep mutex:ix0:tx(8))
  1824. 0 0 2 0 8 0 0 0 0 /usr/src/sys/kern/uipc_usrreq.c:824 (sleep mutex:unp_mtx)
  1825. 0 0 1 0 5 0 0 0 0 /usr/src/sys/vm/uma_core.c:2215 (sleep mutex:MAP ENTRY)
  1826. 0 0 0 0 2 0 0 0 0 /usr/src/sys/kern/uipc_usrreq.c:377 (rw:unp_link_rwlock)
  1827. 4 0 22 0 8 2 0 0 0 /usr/src/sys/kern/uipc_usrreq.c:958 (sleep mutex:unp_mtx)
  1828. 0 0 0 0 1 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zil.c:785 (sx:zilog->zl_vdev_lock)
  1829. 1 0 3 0 4 0 0 0 0 /usr/src/sys/kern/uipc_usrreq.c:584 (rw:unp_link_rwlock)
  1830. 0 0 3 0 10 0 0 0 0 /usr/src/sys/kern/uipc_usrreq.c:611 (rw:unp_link_rwlock)
  1831. 0 0 0 0 8 0 0 0 0 /usr/src/sys/kern/uipc_usrreq.c:831 (sleep mutex:so_snd)
  1832. 1 0 6 0 10 0 0 0 0 /usr/src/sys/kern/uipc_usrreq.c:654 (rw:unp_link_rwlock)
  1833. 5 0 7 0 2 3 0 0 0 /usr/src/sys/kern/uipc_socket.c:3295 (sleep mutex:so_rcv)
  1834. 5 0 21 0 6 3 0 0 0 /usr/src/sys/kern/uipc_usrreq.c:715 (rw:unp_link_rwlock)
  1835. 0 0 2 0 4 0 0 0 0 /usr/src/sys/kern/uipc_usrreq.c:1300 (sleep mutex:unp_mtx)
  1836. 0 0 1 0 8 0 0 0 0 /usr/src/sys/kern/uipc_usrreq.c:1010 (sleep mutex:so_snd)
  1837. 0 0 1 0 8 0 0 0 0 /usr/src/sys/kern/uipc_usrreq.c:811 (sleep mutex:so_rcv)
  1838. 1 0 36 0 46 0 0 0 0 /usr/src/sys/kern/kern_synch.c:609 (spin mutex:sched lock 8)
  1839. 0 0 0 0 1 0 0 0 0 /usr/src/sys/kern/kern_resource.c:518 (spin mutex:sched lock 8)
  1840. 1 0 300 0 957 0 0 0 1 /usr/src/sys/kern/sched_ule.c:1897 (spin mutex:sched lock 8)
  1841. 1 0 830 0 7349 0 0 0 0 /usr/src/sys/kern/sched_ule.c:1940 (spin mutex:sched lock 8)
  1842. 1 0 6 0 7 0 0 0 0 /usr/src/sys/kern/subr_turnstile.c:211 (spin mutex:sched lock 8)
  1843. 0 1 144 4 949 0 0 0 3 /usr/src/sys/kern/subr_sleepqueue.c:340 (spin mutex:sched lock 8)
  1844. 0 0 19 2 88 0 0 0 4 /usr/src/sys/kern/sched_ule.c:2151 (spin mutex:sched lock 8)
  1845. 0 0 10 0 40 0 0 0 0 /usr/src/sys/kern/sched_ule.c:2188 (spin mutex:sched lock 8)
  1846. 0 0 37 0 101 0 0 0 0 /usr/src/sys/kern/subr_sleepqueue.c:424 (spin mutex:sched lock 8)
  1847. 0 0 111 0 741 0 0 0 0 /usr/src/sys/kern/subr_sleepqueue.c:616 (spin mutex:sched lock 8)
  1848. 0 0 25 0 107 0 0 0 0 /usr/src/sys/kern/subr_sleepqueue.c:651 (spin mutex:sched lock 8)
  1849. 0 0 2 0 8 0 0 0 0 /usr/src/sys/kern/subr_turnstile.c:731 (spin mutex:sched lock 8)
  1850. 0 1 25 2 44 0 0 0 3 /usr/src/sys/kern/sched_ule.c:2611 (spin mutex:sched lock 8)
  1851. 1 0 10 0 16 0 0 0 0 /usr/src/sys/kern/kern_fork.c:484 (spin mutex:sched lock 8)
  1852. 0 0 4 0 8 0 0 0 0 /usr/src/sys/kern/subr_turnstile.c:896 (spin mutex:sched lock 8)
  1853. 0 0 3 0 12 0 0 0 0 /usr/src/sys/kern/sched_ule.c:2712 (spin mutex:sched lock 8)
  1854. 0 0 3 0 18 0 0 0 0 /usr/src/sys/kern/kern_umtx.c:3917 (spin mutex:sched lock 8)
  1855. 1 0 17 0 16 1 0 0 0 /usr/src/sys/kern/kern_fork.c:721 (spin mutex:sched lock 8)
  1856. 0 0 0 0 2 0 0 0 0 /usr/src/sys/kern/kern_sig.c:587 (spin mutex:sched lock 8)
  1857. 1 0 6663 0 60017 0 0 0 2 /usr/src/sys/kern/kern_clock.c:537 (spin mutex:sched lock 8)
  1858. 1 0 1972 2 7629 0 0 0 6 /usr/src/sys/kern/kern_clock.c:764 (spin mutex:sched lock 8)
  1859. 0 0 5 0 9 0 0 0 0 /usr/src/sys/kern/vfs_subr.c:1900 (spin mutex:sched lock 8)
  1860. 1 0 409 0 2511 0 0 0 0 /usr/src/sys/kern/kern_switch.c:211 (spin mutex:sched lock 8)
  1861. 0 0 5 0 12 0 0 0 0 /usr/src/sys/kern/kern_thread.c:489 (spin mutex:sched lock 8)
  1862. 0 0 2 0 12 0 0 0 0 /usr/src/sys/kern/kern_thread.c:515 (spin mutex:sched lock 8)
  1863. 0 0 1 0 9 0 0 0 0 /usr/src/sys/kern/subr_trap.c:215 (spin mutex:sched lock 8)
  1864. 0 0 4 0 7 0 0 0 0 /usr/src/sys/kern/subr_trap.c:253 (spin mutex:sched lock 8)
  1865. 12 1 1077 10 3358 0 0 0 19 /usr/src/sys/kern/kern_intr.c:1370 (spin mutex:sched lock 8)
  1866. 0 0 1 0 2 0 0 0 0 /usr/src/sys/kern/kern_sig.c:2350 (spin mutex:sched lock 8)
  1867. 0 0 0 0 1 0 0 0 0 /usr/src/sys/vm/uma_core.c:1022 (sleep mutex:12 Bucket)
  1868. 0 0 0 0 1 0 0 0 0 /usr/src/sys/vm/uma_core.c:2725 (sleep mutex:arc_buf_hdr_t)
  1869. 0 0 0 0 2 0 0 0 0 /usr/src/sys/vm/uma_core.c:2725 (sleep mutex:zio_data_buf_512)
  1870. 19 0 28 0 3 9 0 0 0 /usr/src/sys/netinet6/in6_rmx.c:229 (rw:radix node head)
  1871. 0 0 0 0 1 0 0 0 0 /usr/src/sys/vm/uma_core.c:2725 (sleep mutex:zio_data_buf_10240)
  1872. 621 0 20327 0 769 26 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:1525 (sleep mutex:ix1:tx(9))
  1873. 468 0 13880 0 3795 3 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:1525 (sleep mutex:ix0:tx(9))
  1874. 1 0 11 0 16 0 0 0 0 /usr/src/sys/kern/kern_synch.c:609 (spin mutex:sched lock 9)
  1875. 1 0 129 0 242 0 0 0 0 /usr/src/sys/kern/sched_ule.c:1897 (spin mutex:sched lock 9)
  1876. 1 0 786 0 9028 0 0 0 0 /usr/src/sys/kern/sched_ule.c:1940 (spin mutex:sched lock 9)
  1877. 0 0 45 0 242 0 0 0 0 /usr/src/sys/kern/subr_sleepqueue.c:340 (spin mutex:sched lock 9)
  1878. 0 0 10 0 39 0 0 0 0 /usr/src/sys/kern/sched_ule.c:2151 (spin mutex:sched lock 9)
  1879. 0 0 1 0 5 0 0 0 0 /usr/src/sys/kern/sched_ule.c:2188 (spin mutex:sched lock 9)
  1880. 0 0 10 0 34 0 0 0 0 /usr/src/sys/kern/subr_sleepqueue.c:424 (spin mutex:sched lock 9)
  1881. 0 0 49 0 178 0 0 0 0 /usr/src/sys/kern/subr_sleepqueue.c:616 (spin mutex:sched lock 9)
  1882. 0 0 8 0 30 0 0 0 0 /usr/src/sys/kern/subr_sleepqueue.c:651 (spin mutex:sched lock 9)
  1883. 0 0 0 0 1 0 0 0 0 /usr/src/sys/kern/sched_ule.c:2712 (spin mutex:sched lock 9)
  1884. 0 0 0 0 1 0 0 0 0 /usr/src/sys/kern/kern_umtx.c:3917 (spin mutex:sched lock 9)
  1885. 0 0 6069 2 59968 0 0 0 4 /usr/src/sys/kern/kern_clock.c:537 (spin mutex:sched lock 9)
  1886. 0 0 1743 1 7626 0 0 0 4 /usr/src/sys/kern/kern_clock.c:764 (spin mutex:sched lock 9)
  1887. 11 0 544 0 4122 0 0 0 0 /usr/src/sys/kern/kern_switch.c:211 (spin mutex:sched lock 9)
  1888. 0 0 0 0 1 0 0 0 0 /usr/src/sys/kern/kern_thread.c:489 (spin mutex:sched lock 9)
  1889. 1 0 1323 1 4582 0 0 0 5 /usr/src/sys/kern/kern_intr.c:1370 (spin mutex:sched lock 9)
  1890. 0 0 0 0 2 0 0 0 0 /usr/src/sys/kern/uipc_usrreq.c:1485 (sleep mutex:so_rcv)
  1891. 0 0 0 0 2 0 0 0 0 /usr/src/sys/vm/vm_object.c:1310 (rw:vm object)
  1892. 0 0 0 0 2 0 0 0 0 /usr/src/sys/kern/kern_proc.c:368 (sx:allproc)
  1893. 0 0 0 0 2 0 0 0 0 /usr/src/sys/vm/uma_core.c:2215 (sleep mutex:arc_buf_hdr_t)
  1894. 0 0 0 0 2 0 0 0 0 /usr/src/sys/kern/kern_descrip.c:2134 (sx:filedesc structure)
  1895. 0 0 0 0 2 0 0 0 0 /usr/src/sys/vm/uma_core.c:2268 (sleep mutex:arc_buf_hdr_t)
  1896. 1 0 1 0 2 0 0 0 0 /usr/src/sys/vm/uma_core.c:2379 (sleep mutex:arc_buf_hdr_t)
  1897. 1 0 3 0 4 0 0 0 0 /usr/src/sys/vm/uma_core.c:1022 (sleep mutex:64)
  1898. 0 0 11 0 40 0 0 0 0 /usr/src/sys/vm/uma_core.c:1022 (sleep mutex:256)
  1899. 0 0 0 0 1 0 0 0 0 /usr/src/sys/kern/kern_event.c:2167 (sleep mutex:kqueue)
  1900. 1 0 2 0 2 1 0 0 0 /usr/src/sys/vm/uma_core.c:1022 (sleep mutex:arc_buf_t)
  1901. 0 0 1 0 22 0 0 0 0 /usr/src/sys/vm/vm_mmap.c:637 (sx:pmc-sx)
  1902. 0 0 2 0 12 0 0 0 0 /usr/src/sys/vm/uma_core.c:1022 (sleep mutex:zfs_znode_cache)
  1903. 0 0 0 0 1 0 0 0 0 /usr/src/sys/vm/uma_core.c:2268 (sleep mutex:64)
  1904. 0 0 1 0 10 0 0 0 0 /usr/src/sys/vm/uma_core.c:2268 (sleep mutex:256)
  1905. 1 0 1 0 1 1 0 0 0 /usr/src/sys/vm/uma_core.c:2379 (sleep mutex:64)
  1906. 0 0 0 0 2 0 0 0 0 /usr/src/sys/kern/kern_prot.c:165 (sleep mutex:process lock)
  1907. 0 0 3 0 10 0 0 0 0 /usr/src/sys/vm/uma_core.c:2379 (sleep mutex:256)
  1908. 0 0 0 0 2 0 0 0 0 /usr/src/sys/kern/kern_prot.c:197 (sleep mutex:process lock)
  1909. 0 0 1 0 2 0 0 0 0 /usr/src/sys/kern/kern_exec.c:729 (sleep mutex:process lock)
  1910. 0 0 0 0 1 0 0 0 0 /usr/src/sys/vm/uma_core.c:2215 (sleep mutex:arc_buf_t)
  1911. 0 0 0 0 1 0 0 0 0 /usr/src/sys/vm/uma_core.c:2268 (sleep mutex:arc_buf_t)
  1912. 1 0 1 0 1 1 0 0 0 /usr/src/sys/vm/uma_core.c:2379 (sleep mutex:arc_buf_t)
  1913. 12 0 291 0 395 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:4361 (sleep mutex:ix0:rx(10))
  1914. 0 0 14 0 41 0 0 0 0 /usr/src/sys/vm/uma_core.c:2725 (sleep mutex:mbuf_jumbo_page)
  1915. 3 0 598 0 4025 0 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:4420 (sleep mutex:ix0:rx(10))
  1916. 0 0 1 0 4 0 0 0 0 /usr/src/sys/vm/uma_core.c:2215 (sleep mutex:zfs_znode_cache)
  1917. 0 0 0 0 4 0 0 0 0 /usr/src/sys/vm/uma_core.c:2268 (sleep mutex:zfs_znode_cache)
  1918. 2 0 5 0 2 2 0 0 0 /usr/src/sys/kern/uipc_usrreq.c:632 (sleep mutex:unp_mtx)
  1919. 2 0 4 0 2 2 0 0 0 /usr/src/sys/kern/uipc_usrreq.c:635 (sleep mutex:unp_mtx)
  1920. 0 0 0 0 6 0 0 0 0 /usr/src/sys/kern/vfs_syscalls.c:4131 (sx:filedesc structure)
  1921. 0 0 2 0 4 0 0 0 0 /usr/src/sys/vm/uma_core.c:2379 (sleep mutex:zfs_znode_cache)
  1922. 2 0 17 0 22 0 0 0 0 /usr/src/sys/kern/kern_prot.c:1035 (sleep mutex:process lock)
  1923. 0 0 0 0 8 0 0 0 0 /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dsl_dir.c:1952 (sx:dd->dd_lock)
  1924. 0 0 10 0 20 0 0 0 0 /usr/src/sys/kern/kern_prot.c:1114 (sleep mutex:process lock)
  1925. 0 0 0 0 4 0 0 0 0 /usr/src/sys/netpfil/pf/pf_ioctl.c:1938 (rw:pf rulesets)
  1926. 0 0 2 0 6 0 0 0 0 /usr/src/sys/vm/uma_core.c:1022 (sleep mutex:arc_buf_hdr_t)
  1927. 2 0 5 0 2 2 0 0 0 /usr/src/sys/kern/uipc_usrreq.c:629 (rw:unp_link_rwlock)
  1928. 0 0 1 0 5 0 0 0 0 /usr/src/sys/kern/kern_resource.c:683 (sleep mutex:process lock)
  1929. 0 0 1 0 3 0 0 0 0 /usr/src/sys/kern/kern_resource.c:687 (sleep mutex:process lock)
  1930. 601 0 11423 0 3037 3 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:1525 (sleep mutex:ix1:tx(10))
  1931. 671 1 42699 17 4025 10 0 0 27 /usr/src/sys/dev/ixgbe/ixgbe.c:1525 (sleep mutex:ix0:tx(10))
  1932. 0 0 0 0 2 0 0 0 0 /usr/src/sys/kern/kern_descrip.c:1255 (sx:filedesc structure)
  1933. 0 0 0 0 4 0 0 0 0 /usr/src/sys/kern/kern_descrip.c:1260 (sx:filedesc structure)
  1934. 4 0 5 0 2 2 0 0 0 /usr/src/sys/kern/kern_exec.c:728 (lockmgr:zfs)
  1935. 2 1 1795 13 7146 0 0 0 23 /usr/src/sys/kern/kern_intr.c:1370 (spin mutex:sched lock 10)
  1936. 0 0 0 0 1 0 0 0 0 /usr/src/sys/kern/kern_sig.c:2350 (spin mutex:sched lock 4)
  1937. 0 0 0 0 1 0 0 0 0 /usr/src/sys/kern/kern_sig.c:2350 (spin mutex:sched lock 10)
  1938. 1 0 33 0 50 0 0 0 0 /usr/src/sys/kern/kern_synch.c:609 (spin mutex:sched lock 10)
  1939. 0 0 1 0 5 0 0 0 0 /usr/src/sys/kern/kern_resource.c:518 (spin mutex:sched lock 10)
  1940. 1 0 259 0 784 0 0 0 0 /usr/src/sys/kern/sched_ule.c:1897 (spin mutex:sched lock 10)
  1941. 1 0 1365 0 14834 0 0 0 0 /usr/src/sys/kern/sched_ule.c:1940 (spin mutex:sched lock 10)
  1942. 1 0 5 0 5 1 0 0 0 /usr/src/sys/kern/subr_turnstile.c:211 (spin mutex:sched lock 10)
  1943. 0 0 95 0 778 0 0 0 1 /usr/src/sys/kern/subr_sleepqueue.c:340 (spin mutex:sched lock 10)
  1944. 0 0 21 0 94 0 0 0 3 /usr/src/sys/kern/sched_ule.c:2151 (spin mutex:sched lock 10)
  1945. 0 0 10 0 53 0 0 0 0 /usr/src/sys/kern/sched_ule.c:2188 (spin mutex:sched lock 10)
  1946. 0 0 28 0 129 0 0 0 0 /usr/src/sys/kern/subr_sleepqueue.c:424 (spin mutex:sched lock 10)
  1947. 0 0 85 0 556 0 0 0 0 /usr/src/sys/kern/subr_sleepqueue.c:616 (spin mutex:sched lock 10)
  1948. 0 0 24 0 93 0 0 0 0 /usr/src/sys/kern/subr_sleepqueue.c:651 (spin mutex:sched lock 10)
  1949. 0 0 2 0 6 0 0 0 0 /usr/src/sys/kern/subr_turnstile.c:731 (spin mutex:sched lock 10)
  1950. 0 0 57 0 112 0 0 0 1 /usr/src/sys/kern/sched_ule.c:2611 (spin mutex:sched lock 10)
  1951. 1 0 15 0 28 0 0 0 0 /usr/src/sys/kern/kern_fork.c:484 (spin mutex:sched lock 10)
  1952. 1 0 4 0 6 0 0 0 0 /usr/src/sys/kern/subr_turnstile.c:896 (spin mutex:sched lock 10)
  1953. 0 0 4 0 24 0 0 0 0 /usr/src/sys/kern/sched_ule.c:2712 (spin mutex:sched lock 10)
  1954. 0 0 0 0 1 0 0 0 0 /usr/src/sys/kern/kern_sig.c:587 (spin mutex:sched lock 4)
  1955. 0 0 7 0 39 0 0 0 0 /usr/src/sys/kern/kern_umtx.c:3917 (spin mutex:sched lock 10)
  1956. 1 0 32 0 28 1 0 0 0 /usr/src/sys/kern/kern_fork.c:721 (spin mutex:sched lock 10)
  1957. 0 0 0 0 1 0 0 0 0 /usr/src/sys/kern/kern_thread.c:515 (spin mutex:sched lock 9)
  1958. 0 0 0 0 1 0 0 0 0 /usr/src/sys/kern/kern_sig.c:587 (spin mutex:sched lock 10)
  1959. 1 0 6866 2 60036 0 0 0 3 /usr/src/sys/kern/kern_clock.c:537 (spin mutex:sched lock 10)
  1960. 0 0 1889 0 7635 0 0 0 2 /usr/src/sys/kern/kern_clock.c:764 (spin mutex:sched lock 10)
  1961. 0 0 2 0 4 0 0 0 0 /usr/src/sys/kern/vfs_subr.c:1900 (spin mutex:sched lock 10)
  1962. 12 2 868 2 6435 0 0 0 1 /usr/src/sys/kern/kern_switch.c:211 (spin mutex:sched lock 10)
  1963. 0 0 8 0 18 0 0 0 0 /usr/src/sys/kern/kern_thread.c:489 (spin mutex:sched lock 10)
  1964. 0 0 2 0 21 0 0 0 0 /usr/src/sys/kern/subr_trap.c:215 (spin mutex:sched lock 10)
  1965. 1 0 11 0 18 0 0 0 0 /usr/src/sys/kern/subr_trap.c:253 (spin mutex:sched lock 10)
  1966. 566 0 30669 0 434 70 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:1525 (sleep mutex:ix1:tx(11))
  1967. 478 0 16463 0 1748 9 0 0 0 /usr/src/sys/dev/ixgbe/ixgbe.c:1525 (sleep mutex:ix0:tx(11))
  1968. 0 0 0 0 1 0 0 0 0 /usr/src/sys/vm/uma_core.c:2268 (sleep mutex:zio_buf_7168)
  1969. 0 0 0 0 1 0 0 0 0 /usr/src/sys/vm/uma_core.c:2379 (sleep mutex:zio_buf_7168)
  1970. 1 0 2 0 3 0 0 0 0 /usr/src/sys/vm/uma_core.c:1022 (sleep mutex:S VFS Cache)
  1971. 0 0 0 0 1 0 0 0 0 /usr/src/sys/vm/uma_core.c:2215 (sleep mutex:S VFS Cache)
  1972. 0 0 0 0 1 0 0 0 0 /usr/src/sys/vm/uma_core.c:2268 (sleep mutex:S VFS Cache)
  1973. 0 0 0 0 1 0 0 0 0 /usr/src/sys/vm/uma_core.c:2379 (sleep mutex:S VFS Cache)
  1974. 0 0 0 0 1 0 0 0 0 /usr/src/sys/vm/uma_core.c:1022 (sleep mutex:zio_buf_7168)
  1975. 0 0 0 0 1 0 0 0 0 /usr/src/sys/vm/uma_core.c:2215 (sleep mutex:zio_buf_3584)
  1976. 0 0 1764 0 7635 0 0 0 2 /usr/src/sys/kern/kern_clock.c:764 (spin mutex:sched lock 11)
  1977. 0 0 0 0 2 0 0 0 0 /usr/src/sys/kern/vfs_subr.c:1900 (spin mutex:sched lock 11)
  1978. 11 0 263 0 1823 0 0 0 0 /usr/src/sys/kern/kern_switch.c:211 (spin mutex:sched lock 11)
  1979. 0 0 0 0 1 0 0 0 0 /usr/src/sys/kern/kern_thread.c:489 (spin mutex:sched lock 11)
  1980. 0 0 0 0 1 0 0 0 0 /usr/src/sys/kern/sched_ule.c:2137 (spin mutex:sched lock 3)
  1981. 1 0 743 3 2201 0 0 0 6 /usr/src/sys/kern/kern_intr.c:1370 (spin mutex:sched lock 11)
  1982. 1 0 15 0 18 0 0 0 0 /usr/src/sys/kern/kern_synch.c:609 (spin mutex:sched lock 11)
  1983. 1 0 109 0 224 0 0 0 0 /usr/src/sys/kern/sched_ule.c:1897 (spin mutex:sched lock 11)
  1984. 1 0 447 0 4333 0 0 0 0 /usr/src/sys/kern/sched_ule.c:1940 (spin mutex:sched lock 11)
  1985. 0 0 41 0 223 0 0 0 0 /usr/src/sys/kern/subr_sleepqueue.c:340 (spin mutex:sched lock 11)
  1986. 0 0 9 0 41 0 0 0 0 /usr/src/sys/kern/sched_ule.c:2151 (spin mutex:sched lock 11)
  1987. 0 0 1 0 5 0 0 0 0 /usr/src/sys/kern/sched_ule.c:2188 (spin mutex:sched lock 11)
  1988. 0 0 12 0 40 0 0 0 0 /usr/src/sys/kern/subr_sleepqueue.c:424 (spin mutex:sched lock 11)
  1989. 0 0 42 0 138 0 0 0 0 /usr/src/sys/kern/subr_sleepqueue.c:616 (spin mutex:sched lock 11)
  1990. 0 0 11 0 45 0 0 0 0 /usr/src/sys/kern/subr_sleepqueue.c:651 (spin mutex:sched lock 11)
  1991. 0 0 0 0 1 0 0 0 0 /usr/src/sys/kern/subr_turnstile.c:731 (spin mutex:sched lock 11)
  1992. 0 0 0 0 1 0 0 0 0 /usr/src/sys/kern/subr_turnstile.c:896 (spin mutex:sched lock 11)
  1993. 0 0 0 0 1 0 0 0 0 /usr/src/sys/kern/sched_ule.c:2712 (spin mutex:sched lock 11)
  1994. 0 0 0 0 2 0 0 0 0 /usr/src/sys/kern/kern_umtx.c:3917 (spin mutex:sched lock 11)
  1995. 0 0 5588 1 59912 0 0 0 2 /usr/src/sys/kern/kern_clock.c:537 (spin mutex:sched lock 11)
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!