API tools faq
paste
Guest User

Untitled

a guest
Mar 8th, 2013
150
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 7.68 KB | None | 0 0
raw download clone embed print report
  1. [ 6734.471033]
  2. [ 6734.489047] ======================================================
  3. [ 6734.513111] [ INFO: possible circular locking dependency detected ]
  4. [ 6734.537668] 3.8.0-ceph-00198-g33ff4a8 #1 Not tainted
  5. [ 6734.561159] -------------------------------------------------------
  6. [ 6734.587277] kworker/0:4/23425 is trying to acquire lock:
  7. [ 6734.612925] (&sb->s_type->i_lock_key#19){+.+...}, at: [<ffffffff8119d767>] igrab+0x27/0x70
  8. [ 6734.663805]
  9. [ 6734.663805] but task is already holding lock:
  10. [ 6734.712215] (&(&s->s_cap_lock)->rlock){+.+...}, at: [<ffffffffa0943a21>] iterate_session_caps+0x41/0x220 [ceph]
  11. [ 6734.769417]
  12. [ 6734.769417] which lock already depends on the new lock.
  13. [ 6734.769417]
  14. [ 6734.848788]
  15. [ 6734.848788] the existing dependency chain (in reverse order) is:
  16. [ 6734.906324]
  17. -> #3 (&(&s->s_cap_lock)->rlock){+.+...}:
  18. [ 6734.961293] [<ffffffff810b6d22>] lock_acquire+0xa2/0x140
  19. [ 6734.993886] [<ffffffff8165dbb1>] _raw_spin_lock+0x31/0x40
  20. [ 6735.026642] [<ffffffffa093b5c9>] ceph_add_cap+0x499/0x700 [ceph]
  21. [ 6735.060343] [<ffffffffa092d9d7>] fill_inode.isra.7+0x727/0x850 [ceph]
  22. [ 6735.095296] [<ffffffffa092e34a>] ceph_fill_trace+0x30a/0x8c0 [ceph]
  23. [ 6735.130175] [<ffffffffa094a2b9>] dispatch+0xba9/0x1730 [ceph]
  24. [ 6735.164425] [<ffffffffa08fb556>] con_work+0x1f86/0x2f10 [libceph]
  25. [ 6735.198973] [<ffffffff81072ba9>] process_one_work+0x199/0x510
  26. [ 6735.233129] [<ffffffff81074895>] worker_thread+0x165/0x3f0
  27. [ 6735.267158] [<ffffffff8107a4ba>] kthread+0xea/0xf0
  28. [ 6735.300323] [<ffffffff81666e6c>] ret_from_fork+0x7c/0xb0
  29. [ 6735.333946]
  30. -> #2 (&(&ci->i_ceph_lock)->rlock){+.+...}:
  31. [ 6735.392668] [<ffffffff810b6d22>] lock_acquire+0xa2/0x140
  32. [ 6735.425983] [<ffffffff8165dbb1>] _raw_spin_lock+0x31/0x40
  33. [ 6735.458986] [<ffffffffa092f7e4>] ceph_d_prune+0x44/0x80 [ceph]
  34. [ 6735.492110] [<ffffffff81198caa>] dentry_lru_prune+0x9a/0xa0
  35. [ 6735.524320] [<ffffffff8119afd4>] shrink_dentry_list+0x324/0x3e0
  36. [ 6735.556225] [<ffffffff8119b311>] shrink_dcache_parent+0x281/0x310
  37. [ 6735.588668] [<ffffffff81191697>] vfs_rmdir+0xc7/0x140
  38. [ 6735.620252] [<ffffffff811918db>] do_rmdir+0x1cb/0x1e0
  39. [ 6735.650841] [<ffffffff811941cd>] sys_unlinkat+0x2d/0x40
  40. [ 6735.680742] [<ffffffff81666f19>] system_call_fastpath+0x16/0x1b
  41. [ 6735.711523]
  42. -> #1 (&(&dentry->d_lock)->rlock){+.+...}:
  43. [ 6735.764541] [<ffffffff810b6d22>] lock_acquire+0xa2/0x140
  44. [ 6735.796209] [<ffffffff8165dbb1>] _raw_spin_lock+0x31/0x40
  45. [ 6735.827771] [<ffffffff81199fdf>] __d_instantiate+0x2f/0x120
  46. [ 6735.859273] [<ffffffff8119a118>] d_instantiate+0x48/0x80
  47. [ 6735.890314] [<ffffffff8119c1b3>] d_make_root+0x43/0x70
  48. [ 6735.920480] [<ffffffffa092a605>] open_root_dentry+0x175/0x1c0 [ceph]
  49. [ 6735.952340] [<ffffffffa092b214>] ceph_mount+0x3a4/0x840 [ceph]
  50. [ 6735.983496] [<ffffffff81187ba3>] mount_fs+0x43/0x1b0
  51. [ 6736.013531] [<ffffffff811a3096>] vfs_kern_mount+0x76/0x120
  52. [ 6736.044043] [<ffffffff811a5354>] do_mount+0x1f4/0xa20
  53. [ 6736.073791] [<ffffffff811a5c10>] sys_mount+0x90/0xe0
  54. [ 6736.103334] [<ffffffff81666f19>] system_call_fastpath+0x16/0x1b
  55. [ 6736.133727]
  56. -> #0 (&sb->s_type->i_lock_key#19){+.+...}:
  57. [ 6736.186189] [<ffffffff810b673f>] __lock_acquire+0x1cff/0x1d10
  58. [ 6736.217656] [<ffffffff810b6d22>] lock_acquire+0xa2/0x140
  59. [ 6736.248360] [<ffffffff8165dbb1>] _raw_spin_lock+0x31/0x40
  60. [ 6736.278997] [<ffffffff8119d767>] igrab+0x27/0x70
  61. [ 6736.308056] [<ffffffffa0943ada>] iterate_session_caps+0xfa/0x220 [ceph]
  62. [ 6736.363319] [<ffffffffa0943c36>] wake_up_session_caps+0x36/0x60 [ceph]
  63. [ 6736.396122] [<ffffffffa09445ab>] renewed_caps.isra.31+0xcb/0x150 [ceph]
  64. [ 6736.453871] [<ffffffffa0949eee>] dispatch+0x7de/0x1730 [ceph]
  65. [ 6736.486817] [<ffffffffa08fb556>] con_work+0x1f86/0x2f10 [libceph]
  66. [ 6736.520494] [<ffffffff81072ba9>] process_one_work+0x199/0x510
  67. [ 6736.554057] [<ffffffff81074895>] worker_thread+0x165/0x3f0
  68. [ 6736.587299] [<ffffffff8107a4ba>] kthread+0xea/0xf0
  69. [ 6736.619374] [<ffffffff81666e6c>] ret_from_fork+0x7c/0xb0
  70. [ 6736.651788]
  71. [ 6736.651788] other info that might help us debug this:
  72. [ 6736.651788]
  73. [ 6736.735997] Chain exists of:
  74. &sb->s_type->i_lock_key#19 --> &(&ci->i_ceph_lock)->rlock --> &(&s->s_cap_lock)->rlock
  75.  
  76. [ 6736.850919] Possible unsafe locking scenario:
  77. [ 6736.850919]
  78. [ 6736.908958] CPU0 CPU1
  79. [ 6736.939481] ---- ----
  80. [ 6736.969767] lock(&(&s->s_cap_lock)->rlock);
  81. [ 6736.999900] lock(&(&ci->i_ceph_lock)->rlock);
  82. [ 6737.033551] lock(&(&s->s_cap_lock)->rlock);
  83. [ 6737.066777] lock(&sb->s_type->i_lock_key#19);
  84. [ 6737.097050]
  85. [ 6737.097050] *** DEADLOCK ***
  86. [ 6737.097050]
  87. [ 6737.177318] 4 locks held by kworker/0:4/23425:
  88. [ 6737.206441] #0: (ceph-msgr){++++.+}, at: [<ffffffff81072b3c>] process_one_work+0x12c/0x510
  89. [ 6737.264423] #1: ((&(&con->work)->work)){+.+.+.}, at: [<ffffffff81072b3c>] process_one_work+0x12c/0x510
  90. [ 6737.325310] #2: (&s->s_mutex){+.+.+.}, at: [<ffffffffa0949d58>] dispatch+0x648/0x1730 [ceph]
  91. [ 6737.386640] #3: (&(&s->s_cap_lock)->rlock){+.+...}, at: [<ffffffffa0943a21>] iterate_session_caps+0x41/0x220 [ceph]
  92. [ 6737.453046]
  93. [ 6737.453046] stack backtrace:
  94. [ 6737.512335] Pid: 23425, comm: kworker/0:4 Not tainted 3.8.0-ceph-00198-g33ff4a8 #1
  95. [ 6737.576692] Call Trace:
  96. [ 6737.607567] [<ffffffff816541d7>] print_circular_bug+0x1fb/0x20c
  97. [ 6737.643327] [<ffffffff810b673f>] __lock_acquire+0x1cff/0x1d10
  98. [ 6737.678171] [<ffffffff81055ce7>] ? print_time.part.5+0x67/0x90
  99. [ 6737.712410] [<ffffffff8119d767>] ? igrab+0x27/0x70
  100. [ 6737.745955] [<ffffffff810b6d22>] lock_acquire+0xa2/0x140
  101. [ 6737.779912] [<ffffffff8119d767>] ? igrab+0x27/0x70
  102. [ 6737.813227] [<ffffffff8165dbb1>] _raw_spin_lock+0x31/0x40
  103. [ 6737.847715] [<ffffffff8119d767>] ? igrab+0x27/0x70
  104. [ 6737.881848] [<ffffffff8119d767>] igrab+0x27/0x70
  105. [ 6737.915494] [<ffffffffa0943ada>] iterate_session_caps+0xfa/0x220 [ceph]
  106. [ 6737.951272] [<ffffffffa0943cb0>] ? invalidate_authorizer+0x50/0x50 [ceph]
  107. [ 6737.987562] [<ffffffffa0943c36>] wake_up_session_caps+0x36/0x60 [ceph]
  108. [ 6738.023150] [<ffffffffa09445ab>] renewed_caps.isra.31+0xcb/0x150 [ceph]
  109. [ 6738.058885] [<ffffffffa0949eee>] dispatch+0x7de/0x1730 [ceph]
  110. [ 6738.094141] [<ffffffff810b75e6>] ? mark_held_locks+0x86/0x140
  111. [ 6738.129900] [<ffffffff8165b9d6>] ? __mutex_unlock_slowpath+0xd6/0x170
  112. [ 6738.166602] [<ffffffff810b783d>] ? trace_hardirqs_on+0xd/0x10
  113. [ 6738.201953] [<ffffffffa08fb556>] con_work+0x1f86/0x2f10 [libceph]
  114. [ 6738.237199] [<ffffffff810725d1>] ? queue_delayed_work_on+0x61/0xc0
  115. [ 6738.272013] [<ffffffff810b77a5>] ? trace_hardirqs_on_caller+0x105/0x190
  116. [ 6738.306700] [<ffffffff81072c17>] ? process_one_work+0x207/0x510
  117. [ 6738.339902] [<ffffffff81072b3c>] ? process_one_work+0x12c/0x510
  118. [ 6738.371848] [<ffffffff810b77a5>] ? trace_hardirqs_on_caller+0x105/0x190
  119. [ 6738.404014] [<ffffffff81072ba9>] process_one_work+0x199/0x510
  120. [ 6738.434521] [<ffffffff81072b3c>] ? process_one_work+0x12c/0x510
  121. [ 6738.465210] [<ffffffffa08f95d0>] ? ceph_con_close+0xd0/0xd0 [libceph]
  122. [ 6738.497133] [<ffffffff81074895>] worker_thread+0x165/0x3f0
  123. [ 6738.527475] [<ffffffff81074730>] ? manage_workers+0x2a0/0x2a0
  124. [ 6738.557426] [<ffffffff8107a4ba>] kthread+0xea/0xf0
  125. [ 6738.586414] [<ffffffff8107a3d0>] ? flush_kthread_work+0x1a0/0x1a0
  126. [ 6738.616795] [<ffffffff81666e6c>] ret_from_fork+0x7c/0xb0
  127. [ 6738.646125] [<ffffffff8107a3d0>] ? flush_kthread_work+0x1a0/0x1a0
Advertisement
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!