Advertisement
Guest User

Untitled

a guest
Oct 2nd, 2012
96
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 52.49 KB | None | 0 0
  1. The stacktrace from old 2.6.37 kernel earlier that morning (occured a few times in syslog, only one shown here):
  2. ###########
  3. 930 Oct 2 07:13:21 kernel: [258241.092060] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
  4. 931 Oct 2 07:13:21 kernel: [258241.092106] kswapd0 D 00000000 0 492 2 0x00000000
  5. 932 Oct 2 07:13:21 kernel: [258241.092142] f3081400 00000046 00000001 00000000 00000001 c15e5c80 c15e5c80 00000005
  6. 933 Oct 2 07:13:21 kernel: [258241.092206] f3294400 f3294580 f3505c80 00000004 00000000 00000001 c104049c f3294584
  7. 934 Oct 2 07:13:21 kernel: [258241.092269] f3294580 0000eab0 d8d6d906 0000eab0 f3506210 d8cded2f 0000eab0 d8d6d906
  8. 935 Oct 2 07:13:21 kernel: [258241.092332] Call Trace:
  9. 936 Oct 2 07:13:21 kernel: [258241.092363] [<c104049c>] ? sched_clock_local+0x16/0x127
  10. 937 Oct 2 07:13:21 kernel: [258241.092395] [<c10218b9>] ? enqueue_task_fair+0x13d/0x188
  11. 938 Oct 2 07:13:21 kernel: [258241.092426] [<c13dd683>] ? __mutex_lock_slowpath+0x105/0x1d3
  12. 939 Oct 2 07:13:21 kernel: [258241.092456] [<c13dd759>] ? mutex_lock+0x8/0x14
  13. 940 Oct 2 07:13:21 kernel: [258241.092485] [<c1187f96>] ? xfs_qm_dqreclaim_one+0x1b/0x1f8
  14. 941 Oct 2 07:13:21 kernel: [258241.092515] [<c1188b8d>] ? xfs_qm_shake_freelist+0xf/0x22
  15. 942 Oct 2 07:13:21 kernel: [258241.092546] [<c1064e35>] ? shrink_slab+0x55/0x135
  16. 943 Oct 2 07:13:21 kernel: [258241.092574] [<c1065315>] ? kswapd+0x400/0x5db
  17. 944 Oct 2 07:13:21 kernel: [258241.092605] [<c103c301>] ? autoremove_wake_function+0x0/0x2d
  18. 945 Oct 2 07:13:21 kernel: [258241.092635] [<c1064f15>] ? kswapd+0x0/0x5db
  19. 946 Oct 2 07:13:21 kernel: [258241.092662] [<c103c03b>] ? kthread+0x65/0x6a
  20. 947 Oct 2 07:13:21 kernel: [258241.092690] [<c103bfd6>] ? kthread+0x0/0x6a
  21. 948 Oct 2 07:13:21 kernel: [258241.092718] [<c1002c36>] ? kernel_thread_helper+0x6/0x10
  22. 949 Oct 2 07:13:21 kernel: [258241.092757] INFO: task mysqld:7329 blocked for more than 120 seconds.
  23. 950 Oct 2 07:13:21 kernel: [258241.092787] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
  24. 951 Oct 2 07:13:21 kernel: [258241.092833] mysqld D f3029740 0 7329 5596 0x00000000
  25. 952 Oct 2 07:13:21 kernel: [258241.092867] c1558520 00000086 00000000 f3029740 f313b800 c15e5c80 c15e5c80 f3356d80
  26. 953 Oct 2 07:13:21 kernel: [258241.092930] f3356c00 f3356d80 f3405c80 00000000 00000000 00000005 c104049c f3356d84
  27. 954 Oct 2 07:13:21 kernel: [258241.092993] f3356d80 0000eabe 1cfec18b 0000eabe f3406210 1cfe4cff 0000eabe 1cfec18b
  28. 955 Oct 2 07:13:21 kernel: [258241.093055] Call Trace:
  29. 956 Oct 2 07:13:21 kernel: [258241.093080] [<c104049c>] ? sched_clock_local+0x16/0x127
  30. 957 Oct 2 07:13:21 kernel: [258241.093110] [<c10218b9>] ? enqueue_task_fair+0x13d/0x188
  31. 958 Oct 2 07:13:21 kernel: [258241.093139] [<c13dd683>] ? __mutex_lock_slowpath+0x105/0x1d3
  32. 959 Oct 2 07:13:21 kernel: [258241.093168] [<c13dd759>] ? mutex_lock+0x8/0x14
  33. 960 Oct 2 07:13:21 kernel: [258241.093196] [<c1187f96>] ? xfs_qm_dqreclaim_one+0x1b/0x1f8
  34. 961 Oct 2 07:13:21 kernel: [258241.093226] [<c1188b8d>] ? xfs_qm_shake_freelist+0xf/0x22
  35. 962 Oct 2 07:13:21 kernel: [258241.099661] [<c1064e35>] ? shrink_slab+0x55/0x135
  36. 963 Oct 2 07:13:21 kernel: [258241.099697] [<c10656d5>] ? try_to_free_pages+0x1e5/0x37e
  37. 964 Oct 2 07:13:21 kernel: [258241.099735] [<c10609de>] ? __alloc_pages_nodemask+0x2de/0x4aa
  38. 965 Oct 2 07:13:21 kernel: [258241.099773] [<c10272b6>] ? try_to_wake_up+0x308/0x314
  39. 966 Oct 2 07:13:21 kernel: [258241.099809] [<c107f152>] ? cache_alloc_refill+0x240/0x434
  40. 967 Oct 2 07:13:21 kernel: [258241.099845] [<c107f3b1>] ? __kmalloc+0x6b/0x8d
  41. 968 Oct 2 07:13:21 kernel: [258241.099878] [<c101faca>] ? __wake_up_sync+0x7/0x9
  42. 969 Oct 2 07:13:21 kernel: [258241.099916] [<c135451e>] ? __alloc_skb+0x4c/0xf9
  43. 970 Oct 2 07:13:21 kernel: [258241.099952] [<c13ab932>] ? unix_destruct_scm+0x9b/0xa1
  44. 971 Oct 2 07:13:21 kernel: [258241.099988] [<c13dd749>] ? __mutex_lock_slowpath+0x1cb/0x1d3
  45. 972 Oct 2 07:13:21 kernel: [258241.100025] [<c1350434>] ? sock_alloc_send_pskb+0x9e/0x26a
  46. 973 Oct 2 07:13:21 kernel: [258241.100056] [<c13ac90c>] ? unix_stream_recvmsg+0x4b9/0x578
  47. 974 Oct 2 07:13:21 kernel: [258241.100086] [<c135060c>] ? sock_alloc_send_skb+0xc/0xf
  48. ############
  49.  
  50. Server was rebooted and partition failed to mount:
  51. ###########
  52. 2082 Oct 2 08:09:05 kernel: [ 7.699185] XFS (sdb1): Mounting Filesystem
  53. 2083 Oct 2 08:09:05 kernel: [ 7.768548] XFS (sdb1): Starting recovery (logdev: internal)
  54. 2084 Oct 2 08:09:05 kernel: [ 8.329059] XFS (sdb1): xlog_recover_process_data: bad clientid 0x0
  55. 2085 Oct 2 08:09:05 kernel: [ 8.329143] XFS (sdb1): log mount/recovery failed: error 5
  56. 2086 Oct 2 08:09:05 kernel: [ 8.329257] XFS (sdb1): log mount failed
  57. ###########
  58.  
  59.  
  60.  
  61. The xfs_repair output:
  62. ############
  63. server044:~# xfs_repair /dev/sdb1
  64. Phase 1 - find and verify superblock...
  65. Phase 2 - using internal log
  66. - zero log...
  67. ERROR: The filesystem has valuable metadata changes in a log which needs to
  68. be replayed. Mount the filesystem to replay the log, and unmount it before
  69. re-running xfs_repair. If you are unable to mount the filesystem, then use
  70. the -L option to destroy the log and attempt a repair.
  71. Note that destroying the log may cause corruption -- please attempt a mount
  72. of the filesystem before doing this.
  73.  
  74. server044:~# xfs_repair -L -P /dev/sdb1
  75. Phase 1 - find and verify superblock...
  76. Phase 2 - using internal log
  77. - zero log...
  78. ALERT: The filesystem has valuable metadata changes in a log which is being
  79. destroyed because the -L option was used.
  80. - scan filesystem freespace and inode maps...
  81. agi unlinked bucket 2 is 1603650 in ag 0 (inode=1603650)
  82. agi unlinked bucket 10 is 2273226 in ag 0 (inode=2273226)
  83. agi unlinked bucket 30 is 2289118 in ag 0 (inode=2289118)
  84. agi unlinked bucket 51 is 5603571 in ag 0 (inode=5603571)
  85. agi unlinked bucket 5 is 17034181 in ag 1 (inode=2164517829)
  86. agi unlinked bucket 6 is 17401734 in ag 1 (inode=2164885382)
  87. agi unlinked bucket 54 is 15353974 in ag 1 (inode=2162837622)
  88. agi unlinked bucket 56 is 17300024 in ag 1 (inode=2164783672)
  89. sb_ifree 60513, counted 60509
  90. sb_fdblocks 177949013, counted 177949062
  91. - found root inode chunk
  92. Phase 3 - for each AG...
  93. - scan and clear agi unlinked lists...
  94. - process known inodes and perform inode discovery...
  95. - agno = 0
  96. data fork in ino 8437 claims free block 273053794
  97. data fork in ino 8437 claims free block 273053795
  98. data fork in ino 8858 claims free block 162692765
  99. data fork in ino 8858 claims free block 162692766
  100. data fork in ino 30117 claims free block 275400091
  101. data fork in ino 30117 claims free block 275400092
  102. data fork in ino 71585 claims free block 409772723
  103. data fork in ino 71585 claims free block 409772724
  104. data fork in ino 93624 claims free block 269577593
  105. data fork in ino 93867 claims free block 168984451
  106. data fork in ino 93867 claims free block 168984452
  107. data fork in ino 163018 claims free block 135703041
  108. data fork in ino 163018 claims free block 135703042
  109. data fork in ino 194264 claims free block 275988185
  110. data fork in ino 194264 claims free block 275988186
  111. data fork in ino 204896 claims free block 155427507
  112. data fork in ino 204896 claims free block 155427508
  113. data fork in ino 249369 claims free block 411866281
  114. data fork in ino 249369 claims free block 411866282
  115. data fork in ino 285865 claims free block 137979973
  116. data fork in ino 285865 claims free block 137979974
  117. data fork in ino 375451 claims free block 407692091
  118. data fork in ino 375451 claims free block 407692092
  119. data fork in ino 385811 claims free block 404899504
  120. data fork in ino 385811 claims free block 404899505
  121. data fork in ino 385811 claims free block 404899513
  122. data fork in ino 385811 claims free block 404899514
  123. data fork in ino 386146 claims free block 409496338
  124. data fork in ino 386146 claims free block 409496339
  125. data fork in ino 394739 claims free block 410837198
  126. data fork in ino 394739 claims free block 410837199
  127. data fork in ino 395589 claims free block 404236034
  128. data fork in ino 395589 claims free block 404236035
  129. data fork in ino 416700 claims free block 403758061
  130. data fork in ino 416700 claims free block 403758062
  131. data fork in ino 489750 claims free block 269835524
  132. data fork in ino 489750 claims free block 269835525
  133. data fork in ino 525093 claims free block 168844252
  134. data fork in ino 525093 claims free block 168844253
  135. data fork in ino 525127 claims free block 273985593
  136. data fork in ino 525127 claims free block 273985595
  137. data fork in ino 525127 claims free block 273985596
  138. data fork in ino 533699 claims free block 271838364
  139. data fork in ino 533699 claims free block 271838365
  140. data fork in ino 535289 claims free block 276064526
  141. data fork in ino 535289 claims free block 276064527
  142. data fork in ino 536042 claims free block 138241682
  143. data fork in ino 536042 claims free block 138241683
  144. data fork in ino 536203 claims free block 274867067
  145. data fork in ino 536203 claims free block 274867068
  146. data fork in ino 536421 claims free block 414300105
  147. data fork in ino 536421 claims free block 414300106
  148. data fork in ino 537093 claims free block 274755942
  149. data fork in ino 537093 claims free block 274755943
  150. data fork in ino 537125 claims free block 410424787
  151. data fork in ino 537125 claims free block 410424788
  152. data fork in ino 657176 claims free block 149067481
  153. data fork in ino 657176 claims free block 149067482
  154. data fork in ino 710530 claims free block 409662150
  155. data fork in ino 710530 claims free block 409662151
  156. data fork in ino 851649 claims free block 273691123
  157. data fork in ino 851649 claims free block 273691124
  158. data fork in ino 852597 claims free block 143795764
  159. data fork in ino 852597 claims free block 143795765
  160. data fork in ino 856738 claims free block 407645539
  161. data fork in ino 856738 claims free block 407645540
  162. data fork in ino 861063 claims free block 269724003
  163. data fork in ino 861063 claims free block 269724004
  164. data fork in ino 905060 claims free block 281802732
  165. data fork in ino 905060 claims free block 281802733
  166. data fork in ino 954644 claims free block 409358579
  167. data fork in ino 954644 claims free block 409358580
  168. data fork in ino 1072804 claims free block 135787508
  169. data fork in ino 1072804 claims free block 135787509
  170. data fork in ino 1072937 claims free block 138277073
  171. data fork in ino 1072937 claims free block 138277074
  172. data fork in ino 1075376 claims free block 137261655
  173. data fork in ino 1075376 claims free block 137261656
  174. data fork in ino 1077531 claims free block 167079598
  175. data fork in ino 1077531 claims free block 167079599
  176. data fork in ino 1086655 claims free block 174350124
  177. data fork in ino 1086655 claims free block 174350125
  178. data fork in ino 1275847 claims free block 138248468
  179. data fork in ino 1275847 claims free block 138248469
  180. f7626700: Badness in key lookup (length)
  181. bp=(bno 801824, len 16384 bytes) key=(bno 801824, len 8192 bytes)
  182. data fork in ino 1647048 claims free block 409772381
  183. data fork in ino 1647048 claims free block 409772382
  184. data fork in ino 1649108 claims free block 273734873
  185. data fork in ino 1649108 claims free block 273734874
  186. data fork in ino 1760771 claims free block 137078500
  187. data fork in ino 1760771 claims free block 137078501
  188. data fork in ino 1761291 claims free block 410729797
  189. data fork in ino 1761291 claims free block 410729798
  190. data fork in ino 1761539 claims free block 269959185
  191. data fork in ino 1761539 claims free block 269959186
  192. data fork in ino 1761588 claims free block 137378619
  193. data fork in ino 1761588 claims free block 137378620
  194. data fork in ino 1761934 claims free block 136822933
  195. data fork in ino 1761934 claims free block 136822934
  196. data fork in ino 1771492 claims free block 273492576
  197. data fork in ino 1771492 claims free block 273492577
  198. data fork in ino 1927893 claims free block 137016559
  199. data fork in ino 1927893 claims free block 137016560
  200. data fork in ino 1937657 claims free block 405623715
  201. data fork in ino 1937657 claims free block 405623716
  202. data fork in ino 1940779 claims free block 136227997
  203. data fork in ino 1940779 claims free block 136227998
  204. data fork in ino 1943004 claims free block 273523369
  205. data fork in ino 1943004 claims free block 273523370
  206. data fork in ino 2021982 claims free block 135557598
  207. data fork in ino 2021982 claims free block 135557599
  208. data fork in ino 2095027 claims free block 270068345
  209. data fork in ino 2095027 claims free block 270068346
  210. data fork in ino 2266995 claims free block 406100303
  211. data fork in ino 2266995 claims free block 406100317
  212. data fork in ino 2267233 claims free block 164053460
  213. data fork in ino 2267233 claims free block 164053461
  214. f7626700: Badness in key lookup (length)
  215. bp=(bno 1136592, len 16384 bytes) key=(bno 1136592, len 8192 bytes)
  216. data fork in ino 2274334 claims free block 274950958
  217. data fork in ino 2274334 claims free block 274950959
  218. data fork in ino 2281464 claims free block 403776321
  219. data fork in ino 2281464 claims free block 403776322
  220. data fork in ino 2281465 claims free block 138165581
  221. data fork in ino 2281465 claims free block 138165582
  222. data fork in ino 2282849 claims free block 143104594
  223. data fork in ino 2282849 claims free block 143104595
  224. data fork in ino 2282850 claims free block 403751864
  225. data fork in ino 2282850 claims free block 403751865
  226. f7626700: Badness in key lookup (length)
  227. bp=(bno 1144528, len 16384 bytes) key=(bno 1144528, len 8192 bytes)
  228. data fork in ino 2291431 claims free block 156764447
  229. data fork in ino 2291431 claims free block 156764458
  230. data fork in ino 2291431 claims free block 156764459
  231. data fork in ino 2292511 claims free block 156839854
  232. data fork in ino 2292511 claims free block 156839855
  233. data fork in ino 2294983 claims free block 136223285
  234. data fork in ino 2295020 claims free block 288084966
  235. data fork in ino 2295166 claims free block 276517440
  236. data fork in ino 2295166 claims free block 276517441
  237. data fork in ino 2295773 claims free block 276064706
  238. data fork in ino 2295773 claims free block 276064707
  239. data fork in regular inode 2296832 claims used block 156764448
  240. bad data fork in inode 2296832
  241. cleared inode 2296832
  242. data fork in regular inode 2297374 claims used block 269577594
  243. bad data fork in inode 2297374
  244. cleared inode 2297374
  245. data fork in regular inode 2297662 claims used block 273750641
  246. bad data fork in inode 2297662
  247. cleared inode 2297662
  248. data fork in regular inode 2298388 claims used block 404899506
  249. bad data fork in inode 2298388
  250. cleared inode 2298388
  251. data fork in ino 2298505 claims free block 170996910
  252. data fork in ino 2298505 claims free block 170996911
  253. data fork in ino 2298522 claims free block 138286883
  254. data fork in ino 2298522 claims free block 138286884
  255. data fork in ino 2298543 claims free block 409840411
  256. data fork in ino 2298543 claims free block 409840412
  257. data fork in regular inode 2298839 claims used block 405230877
  258. bad data fork in inode 2298839
  259. cleared inode 2298839
  260. data fork in regular inode 2298878 claims used block 138241680
  261. bad data fork in inode 2298878
  262. cleared inode 2298878
  263. data fork in regular inode 2299669 claims used block 403837561
  264. bad data fork in inode 2299669
  265. cleared inode 2299669
  266. data fork in regular inode 2360061 claims used block 406100305
  267. bad data fork in inode 2360061
  268. cleared inode 2360061
  269. data fork in ino 2361598 claims free block 175757324
  270. data fork in ino 2361598 claims free block 175757325
  271. data fork in regular inode 2361679 claims used block 405230878
  272. bad data fork in inode 2361679
  273. cleared inode 2361679
  274. data fork in ino 2361733 claims free block 409836547
  275. data fork in ino 2361733 claims free block 409836548
  276. data fork in ino 2362093 claims free block 136542447
  277. data fork in ino 2362093 claims free block 136542448
  278. data fork in regular inode 2362674 claims used block 273731337
  279. bad data fork in inode 2362674
  280. cleared inode 2362674
  281. data fork in ino 2362684 claims free block 152102122
  282. data fork in ino 2362684 claims free block 152102123
  283. data fork in ino 2362687 claims free block 410551504
  284. data fork in ino 2362687 claims free block 410551505
  285. data fork in ino 2369403 claims free block 409422362
  286. data fork in ino 2369403 claims free block 409422363
  287. data fork in ino 2375174 claims free block 136246408
  288. data fork in ino 2375174 claims free block 136246409
  289. data fork in ino 2375417 claims free block 269783698
  290. data fork in ino 2375417 claims free block 269783699
  291. data fork in ino 2375511 claims free block 135322919
  292. data fork in ino 2375511 claims free block 135322920
  293. data fork in ino 2377955 claims free block 282118500
  294. data fork in ino 2377955 claims free block 282118501
  295. data fork in ino 2378950 claims free block 403787921
  296. data fork in ino 2378950 claims free block 403787922
  297. data fork in ino 2462931 claims free block 414927574
  298. data fork in ino 2462931 claims free block 414927575
  299. data fork in ino 2533851 claims free block 269662101
  300. data fork in ino 2533851 claims free block 269662102
  301. data fork in ino 2615410 claims free block 273348748
  302. data fork in ino 2615410 claims free block 273348749
  303. data fork in ino 3018796 claims free block 138252874
  304. data fork in ino 3018796 claims free block 138252875
  305. data fork in ino 3033870 claims free block 405230854
  306. data fork in ino 3033870 claims free block 405230855
  307. data fork in ino 3054610 claims free block 270589175
  308. data fork in ino 3054610 claims free block 270589176
  309. data fork in ino 3055222 claims free block 411532182
  310. data fork in ino 3055222 claims free block 411532183
  311. data fork in regular inode 3055222 claims used block 411532187
  312. bad data fork in inode 3055222
  313. cleared inode 3055222
  314. data fork in ino 3246301 claims free block 405684149
  315. data fork in regular inode 3246301 claims used block 405684150
  316. bad data fork in inode 3246301
  317. cleared inode 3246301
  318. data fork in ino 3544629 claims free block 270397149
  319. data fork in ino 3544629 claims free block 270397150
  320. data fork in regular inode 3708679 claims used block 406100304
  321. bad data fork in inode 3708679
  322. cleared inode 3708679
  323. data fork in regular inode 3890694 claims used block 137624149
  324. bad data fork in inode 3890694
  325. cleared inode 3890694
  326. data fork in ino 4064947 claims free block 411391924
  327. data fork in ino 4064947 claims free block 411391925
  328. data fork in ino 4076623 claims free block 138254027
  329. data fork in ino 4076623 claims free block 138254028
  330. data fork in ino 4081277 claims free block 409326041
  331. data fork in ino 4081277 claims free block 409326042
  332. data fork in ino 4155572 claims free block 272526090
  333. data fork in ino 4155572 claims free block 272526091
  334. data fork in ino 4560820 claims free block 407876120
  335. data fork in regular inode 4560820 claims used block 407876121
  336. bad data fork in inode 4560820
  337. cleared inode 4560820
  338. data fork in ino 4575326 claims free block 135832894
  339. data fork in ino 4575326 claims free block 135832895
  340. data fork in regular inode 4575445 claims used block 409282646
  341. bad data fork in inode 4575445
  342. cleared inode 4575445
  343. data fork in ino 4590671 claims free block 147043747
  344. data fork in ino 4590671 claims free block 147043748
  345. data fork in ino 4751692 claims free block 158136383
  346. data fork in ino 4751692 claims free block 158136384
  347. data fork in ino 4789951 claims free block 274890646
  348. data fork in ino 4789951 claims free block 274890647
  349. data fork in ino 4802199 claims free block 276205976
  350. data fork in ino 4802199 claims free block 276205977
  351. data fork in ino 4836498 claims free block 408893043
  352. data fork in ino 4836498 claims free block 408893044
  353. data fork in ino 4914728 claims free block 176294416
  354. data fork in ino 4914728 claims free block 176294417
  355. data fork in ino 4914781 claims free block 409858746
  356. data fork in ino 4914781 claims free block 409858747
  357. data fork in ino 4941366 claims free block 135324420
  358. data fork in ino 4941366 claims free block 135324421
  359. data fork in ino 4994616 claims free block 159446955
  360. data fork in ino 4994616 claims free block 159446956
  361. data fork in regular inode 5020894 claims used block 270589174
  362. bad data fork in inode 5020894
  363. cleared inode 5020894
  364. data fork in regular inode 5181998 claims used block 137016557
  365. bad data fork in inode 5181998
  366. cleared inode 5181998
  367. correcting nblocks for inode 5368057, was 109959 - counted 109957
  368. data fork in ino 5493851 claims free block 413102016
  369. data fork in ino 5493851 claims free block 413102017
  370. data fork in ino 5494091 claims free block 142172762
  371. data fork in ino 5494091 claims free block 142172763
  372. f7626700: Badness in key lookup (length)
  373. bp=(bno 2801760, len 16384 bytes) key=(bno 2801760, len 8192 bytes)
  374. data fork in ino 5636995 claims free block 271964121
  375. data fork in ino 5636995 claims free block 271964122
  376. data fork in ino 5780377 claims free block 275052611
  377. data fork in ino 5780377 claims free block 275052612
  378. data fork in ino 5881667 claims free block 135324475
  379. data fork in ino 5881667 claims free block 135324476
  380. data fork in ino 5882713 claims free block 410072430
  381. data fork in ino 5882713 claims free block 410072431
  382. data fork in ino 5891399 claims free block 406030261
  383. data fork in regular inode 5891399 claims used block 406030262
  384. bad data fork in inode 5891399
  385. cleared inode 5891399
  386. data fork in ino 6084856 claims free block 273355017
  387. data fork in ino 6084856 claims free block 273355018
  388. data fork in ino 6137337 claims free block 269727771
  389. data fork in ino 6137337 claims free block 269727772
  390. data fork in ino 6225252 claims free block 275278002
  391. data fork in ino 6225252 claims free block 275278003
  392. correcting nblocks for inode 6233113, was 15093 - counted 15090
  393. data fork in regular inode 6437326 claims used block 135181881
  394. bad data fork in inode 6437326
  395. cleared inode 6437326
  396. data fork in regular inode 6470113 claims used block 270397146
  397. bad data fork in inode 6470113
  398. cleared inode 6470113
  399. data fork in regular inode 6470630 claims used block 270397147
  400. bad data fork in inode 6470630
  401. cleared inode 6470630
  402. data fork in ino 6818455 claims free block 276514500
  403. data fork in ino 6818455 claims free block 276514501
  404. - agno = 1
  405. bad directory block magic # 0x73657373 in block 0 for directory inode 2147498078
  406. corrupt block 0 in directory inode 2147498078
  407. will junk block
  408. no . entry for directory 2147498078
  409. no .. entry for directory 2147498078
  410. problem with directory contents in inode 2147498078
  411. cleared inode 2147498078
  412. data fork in ino 2147846064 claims free block 406052320
  413. data fork in ino 2147846064 claims free block 406052321
  414. data fork in regular inode 2147938710 claims used block 270068344
  415. bad data fork in inode 2147938710
  416. cleared inode 2147938710
  417. data fork in regular inode 2148257917 claims used block 134662367
  418. bad data fork in inode 2148257917
  419. cleared inode 2148257917
  420. data fork in regular inode 2148290382 claims used block 270397144
  421. bad data fork in inode 2148290382
  422. cleared inode 2148290382
  423. data fork in ino 2148333091 claims free block 180307242
  424. data fork in ino 2148333091 claims free block 180307243
  425. data fork in regular inode 2148564999 claims used block 270397145
  426. bad data fork in inode 2148564999
  427. cleared inode 2148564999
  428. data fork in ino 2148567165 claims free block 274957939
  429. data fork in ino 2148567165 claims free block 274957940
  430. data fork in regular inode 2148570520 claims used block 270589173
  431. bad data fork in inode 2148570520
  432. cleared inode 2148570520
  433. data fork in regular inode 2148998696 claims used block 137624148
  434. bad data fork in inode 2148998696
  435. cleared inode 2148998696
  436. ^[[Bdata fork in regular inode 2153555253 claims used block 156764446
  437. bad data fork in inode 2153555253
  438. cleared inode 2153555253
  439. data fork in regular inode 2155250164 claims used block 409358572
  440. bad data fork in inode 2155250164
  441. cleared inode 2155250164
  442. data fork in regular inode 2155305772 claims used block 402683441
  443. bad data fork in inode 2155305772
  444. cleared inode 2155305772
  445. data fork in regular inode 2155558058 claims used block 137016558
  446. bad data fork in inode 2155558058
  447. cleared inode 2155558058
  448. data fork in regular inode 2155651751 claims used block 137996635
  449. bad data fork in inode 2155651751
  450. cleared inode 2155651751
  451. data fork in regular inode 2155747507 claims used block 409358577
  452. bad data fork in inode 2155747507
  453. cleared inode 2155747507
  454. data fork in ino 2155869393 claims free block 276774280
  455. data fork in ino 2155869393 claims free block 276774281
  456. data fork in regular inode 2157672271 claims used block 408893037
  457. bad data fork in inode 2157672271
  458. cleared inode 2157672271
  459. data fork in ino 2158260052 claims free block 275978558
  460. data fork in ino 2158260052 claims free block 275978559
  461. data fork in regular inode 2158989739 claims used block 270397148
  462. bad data fork in inode 2158989739
  463. cleared inode 2158989739
  464. imap claims a free inode 2159403513 is in use, correcting imap and clearing inode
  465. cleared inode 2159403513
  466. imap claims a free inode 2161753706 is in use, correcting imap and clearing inode
  467. cleared inode 2161753706
  468. data fork in regular inode 2161777666 claims used block 273734863
  469. bad data fork in inode 2161777666
  470. cleared inode 2161777666
  471. imap claims a free inode 2162959737 is in use, correcting imap and clearing inode
  472. cleared inode 2162959737
  473. data fork in regular inode 2163719976 claims used block 405623713
  474. bad data fork in inode 2163719976
  475. cleared inode 2163719976
  476. data fork in regular inode 2163720085 claims used block 405623714
  477. bad data fork in inode 2163720085
  478. cleared inode 2163720085
  479. data fork in regular inode 2163720086 claims used block 405623712
  480. bad data fork in inode 2163720086
  481. cleared inode 2163720086
  482. data fork in regular inode 2164689900 claims used block 409326033
  483. bad data fork in inode 2164689900
  484. cleared inode 2164689900
  485. data fork in regular inode 2164779181 claims used block 409358573
  486. bad data fork in inode 2164779181
  487. cleared inode 2164779181
  488. data fork in regular inode 2164911310 claims used block 273985592
  489. bad data fork in inode 2164911310
  490. cleared inode 2164911310
  491. data fork in regular inode 2164966795 claims used block 409358571
  492. bad data fork in inode 2164966795
  493. cleared inode 2164966795
  494. data fork in regular inode 2164977124 claims used block 273985594
  495. bad data fork in inode 2164977124
  496. cleared inode 2164977124
  497. data fork in regular inode 2165006721 claims used block 409358570
  498. bad data fork in inode 2165006721
  499. cleared inode 2165006721
  500. data fork in regular inode 2466403933 claims used block 269263807
  501. bad data fork in inode 2466403933
  502. cleared inode 2466403933
  503. - agno = 2
  504. - agno = 3
  505. - process newly discovered inodes...
  506. Phase 4 - check for duplicate blocks...
  507. - setting up duplicate extent list...
  508. - check for inodes claiming duplicate blocks...
  509. - agno = 0
  510. entry "wp1120120_203UDVO2MA" at block 4 offset 16 in directory inode 142 references free inode 2147498078
  511. clearing inode number in entry at offset 16...
  512. entry "wp10819048_9C672AG45J" at block 6 offset 1232 in directory inode 142 references free inode 2466403933
  513. clearing inode number in entry at offset 1232...
  514. entry "access_log.wp1119298" at block 0 offset 2512 in directory inode 143 references free inode 6437326
  515. clearing inode number in entry at offset 2512...
  516. entry "access_log.wp1119558" at block 1 offset 3056 in directory inode 143 references free inode 2297374
  517. clearing inode number in entry at offset 3056...
  518. entry "error_log.wp1119224" at block 6 offset 1712 in directory inode 143 references free inode 3246301
  519. clearing inode number in entry at offset 1712...
  520. entry "error_log.wp10553751" at block 9 offset 112 in directory inode 143 references free inode 5891399
  521. clearing inode number in entry at offset 112...
  522. entry "error_log.wp1173939" at block 12 offset 2160 in directory inode 143 references free inode 3055222
  523. clearing inode number in entry at offset 2160...
  524. entry "error_log.wp10822893" at block 13 offset 1552 in directory inode 143 references free inode 3890694
  525. clearing inode number in entry at offset 1552...
  526. entry "error_log.wp10898833" at block 20 offset 2128 in directory inode 143 references free inode 2362674
  527. clearing inode number in entry at offset 2128...
  528. entry "error_log.wp10903950" at block 24 offset 2384 in directory inode 143 references free inode 4575445
  529. clearing inode number in entry at offset 2384...
  530. entry "error_log.wp10903681" at block 24 offset 2768 in directory inode 143 references free inode 4560820
  531. clearing inode number in entry at offset 2768...
  532. entry "error_log.wp10915670" at block 29 offset 1456 in directory inode 143 references free inode 2361679
  533. clearing inode number in entry at offset 1456...
  534. entry "access_log.wp10916031" at block 32 offset 2608 in directory inode 143 references free inode 2299669
  535. clearing inode number in entry at offset 2608...
  536. data fork in ino 21399 claims dup extent, off - 0, start - 273731337, cnt 1
  537. bad data fork in inode 21399
  538. cleared inode 21399
  539. data fork in ino 93624 claims dup extent, off - 0, start - 269577592, cnt 16
  540. bad data fork in inode 93624
  541. cleared inode 93624
  542. entry "ip.txt" in shortform directory 173027 references free inode 5181998
  543. junking entry "ip.txt" in directory inode 173027
  544. entry "dovecot-uidlist" at block 3 offset 2400 in directory inode 247458 references free inode 2297662
  545. clearing inode number in entry at offset 2400...
  546. data fork in ino 385811 claims dup extent, off - 0, start - 404899503, cnt 16
  547. bad data fork in inode 385811
  548. cleared inode 385811
  549. data fork in ino 405584 claims dup extent, off - 0, start - 407876121, cnt 1
  550. bad data fork in inode 405584
  551. cleared inode 405584
  552. data fork in ino 525127 claims dup extent, off - 0, start - 273985591, cnt 16
  553. bad data fork in inode 525127
  554. cleared inode 525127
  555. data fork in ino 536042 claims dup extent, off - 0, start - 138241679, cnt 16
  556. bad data fork in inode 536042
  557. cleared inode 536042
  558. data fork in ino 536076 claims dup extent, off - 0, start - 273750640, cnt 16
  559. bad data fork in inode 536076
  560. cleared inode 536076
  561. data fork in ino 954644 claims dup extent, off - 0, start - 409358569, cnt 16
  562. bad data fork in inode 954644
  563. cleared inode 954644
  564. data fork in ino 954673 claims dup extent, off - 0, start - 405230876, cnt 16
  565. bad data fork in inode 954673
  566. cleared inode 954673
  567. data fork in ino 1649108 claims dup extent, off - 0, start - 273734862, cnt 16
  568. bad data fork in inode 1649108
  569. cleared inode 1649108
  570. data fork in ino 1927893 claims dup extent, off - 0, start - 137016556, cnt 16
  571. bad data fork in inode 1927893
  572. cleared inode 1927893
  573. data fork in ino 1931938 claims dup extent, off - 912, start - 411532187, cnt 16
  574. bad data fork in inode 1931938
  575. cleared inode 1931938
  576. data fork in ino 1937657 claims dup extent, off - 0, start - 405623711, cnt 16
  577. bad data fork in inode 1937657
  578. cleared inode 1937657
  579. data fork in ino 2095027 claims dup extent, off - 0, start - 270068343, cnt 16
  580. bad data fork in inode 2095027
  581. cleared inode 2095027
  582. data fork in ino 2266995 claims dup extent, off - 0, start - 406100302, cnt 16
  583. bad data fork in inode 2266995
  584. cleared inode 2266995
  585. data fork in ino 2275710 claims dup extent, off - 0, start - 403837560, cnt 16
  586. bad data fork in inode 2275710
  587. cleared inode 2275710
  588. data fork in ino 2281025 claims dup extent, off - 0, start - 402683441, cnt 1
  589. bad data fork in inode 2281025
  590. cleared inode 2281025
  591. data fork in ino 2291431 claims dup extent, off - 0, start - 156764445, cnt 16
  592. bad data fork in inode 2291431
  593. cleared inode 2291431
  594. data fork in ino 2298433 claims dup extent, off - 59, start - 409282646, cnt 21
  595. bad data fork in inode 2298433
  596. cleared inode 2298433
  597. data fork in ino 2298829 claims dup extent, off - 0, start - 405684150, cnt 16
  598. bad data fork in inode 2298829
  599. cleared inode 2298829
  600. data fork in ino 2299630 claims dup extent, off - 16, start - 406030262, cnt 16
  601. bad data fork in inode 2299630
  602. cleared inode 2299630
  603. data fork in ino 2361677 claims dup extent, off - 0, start - 137624149, cnt 1
  604. bad data fork in inode 2361677
  605. cleared inode 2361677
  606. data fork in ino 2559335 claims dup extent, off - 1, start - 135181881, cnt 15
  607. bad data fork in inode 2559335
  608. cleared inode 2559335
  609. entry "dovecot-uidlist" in shortform directory 2607662 references free inode 2298878
  610. junking entry "dovecot-uidlist" in directory inode 2607662
  611. entry "dovecot-uidlist" at block 0 offset 648 in directory inode 2610741 references free inode 2298839
  612. clearing inode number in entry at offset 648...
  613. data fork in ino 3054610 claims dup extent, off - 0, start - 270589172, cnt 16
  614. bad data fork in inode 3054610
  615. cleared inode 3054610
  616. data fork in ino 3544629 claims dup extent, off - 0, start - 270397143, cnt 16
  617. bad data fork in inode 3544629
  618. cleared inode 3544629
  619. entry "1349153291.M449676P13565.server044,S=2110,W=2164:2,S" at block 1 offset 3408 in directory inode 3708220 references free inode 3708679
  620. clearing inode number in entry at offset 3408...
  621. data fork in ino 4081277 claims dup extent, off - 0, start - 409326032, cnt 16
  622. bad data fork in inode 4081277
  623. cleared inode 4081277
  624. data fork in ino 4836498 claims dup extent, off - 0, start - 408893036, cnt 16
  625. bad data fork in inode 4836498
  626. cleared inode 4836498
  627. entry "recruitment.xml" in shortform directory 5009096 references free inode 5020894
  628. junking entry "recruitment.xml" in directory inode 5009096
  629. entry "data_77125464b795fc68848c19ea4ff74b1a-SMF-theme_settings-1.php" at block 0 offset 312 in directory inode 5013235 references free inode 405584
  630. clearing inode number in entry at offset 312...
  631. entry "20121002.csv" at block 1 offset 3856 in directory inode 6015837 references free inode 2361677
  632. clearing inode number in entry at offset 3856...
  633. entry "dovecot-uidlist" at block 0 offset 576 in directory inode 6180205 references free inode 2298388
  634. clearing inode number in entry at offset 576...
  635. entry ".htaccess" at block 0 offset 408 in directory inode 6469826 references free inode 6470113
  636. clearing inode number in entry at offset 408...
  637. entry ".htaccess" at block 0 offset 672 in directory inode 6470254 references free inode 6470630
  638. clearing inode number in entry at offset 672...
  639. - agno = 1
  640. entry "sess_7qbvd89pma8gsj50non7q6vop7" at block 0 offset 336 in directory inode 2147484108 references free inode 2155305772
  641. clearing inode number in entry at offset 336...
  642. entry "sess_etohvl8t49lcrdvbv4k9qhrq31" at block 0 offset 2688 in directory inode 2147488668 references free inode 2148257917
  643. clearing inode number in entry at offset 2688...
  644. entry "sess_62gflo1ap5vsc8t8rhgc87amv3" at block 2 offset 1168 in directory inode 2147526627 references free inode 2148998696
  645. clearing inode number in entry at offset 1168...
  646. entry "sess_urbprl9iklakjvqfg90a42ibi3" at block 0 offset 1680 in directory inode 2147539866 references free inode 2161753706
  647. clearing inode number in entry at offset 1680...
  648. entry "sess_76ra405khffdsdlmrfcbimv6r3" at block 0 offset 3168 in directory inode 2147539866 references free inode 2159403513
  649. clearing inode number in entry at offset 3168...
  650. entry "1349153056.10610_0.server044" at block 0 offset 368 in directory inode 2148900589 references free inode 2296832
  651. clearing inode number in entry at offset 368...
  652. entry "dovecot-uidlist" at block 0 offset 424 in directory inode 2149787252 references free inode 2155651751
  653. clearing inode number in entry at offset 424...
  654. entry "dovecot-uidlist" at block 0 offset 344 in directory inode 2150267648 references free inode 2153555253
  655. clearing inode number in entry at offset 344...
  656. entry "1349154319.9155_0.server044" in shortform directory 2150429143 references free inode 5668791
  657. junking entry "1349154319.9155_0.server044" in directory inode 2150429143
  658. data fork in ino 2154168617 claims dup extent, off - 0, start - 137996636, cnt 16
  659. bad data fork in inode 2154168617
  660. cleared inode 2154168617
  661. data fork in ino 2154318209 claims dup extent, off - 0, start - 137996635, cnt 1
  662. bad data fork in inode 2154318209
  663. cleared inode 2154318209
  664. entry ".htaccess" in shortform directory 2155274502 references free inode 2158989739
  665. junking entry ".htaccess" in directory inode 2155274502
  666. entry "page_tail.html.php" at block 0 offset 128 in directory inode 2157965199 references free inode 2163720085
  667. clearing inode number in entry at offset 128...
  668. entry "inclcss.html.php" at block 0 offset 160 in directory inode 2157965199 references free inode 2163720086
  669. clearing inode number in entry at offset 160...
  670. entry "rp_status.html.php" at block 0 offset 400 in directory inode 2157965199 references free inode 2163719976
  671. clearing inode number in entry at offset 400...
  672. entry "mmini_monthwc.gif" at block 6 offset 3376 in directory inode 2406989311 references free inode 2155250164
  673. clearing inode number in entry at offset 3376...
  674. entry "mini_y2012tp.gif" at block 0 offset 1480 in directory inode 2406989348 references free inode 2155747507
  675. clearing inode number in entry at offset 1480...
  676. entry "windbft_y2012.gif" at block 0 offset 2664 in directory inode 2406989348 references free inode 2157672271
  677. clearing inode number in entry at offset 2664...
  678. entry "ddis_f_w2012_40.gif" at block 81 offset 2464 in directory inode 2406989348 references free inode 2164689900
  679. clearing inode number in entry at offset 2464...
  680. entry "m201210r.gif" at block 81 offset 2680 in directory inode 2406989348 references free inode 2164779181
  681. clearing inode number in entry at offset 2680...
  682. entry "mini_w2012_40wr.gif" at block 82 offset 80 in directory inode 2406989348 references free inode 2164911310
  683. clearing inode number in entry at offset 80...
  684. entry "mmini_m201210fi.gif" at block 82 offset 656 in directory inode 2406989348 references free inode 2164966795
  685. clearing inode number in entry at offset 656...
  686. entry "mmini_m201210ti.gif" at block 82 offset 816 in directory inode 2406989348 references free inode 2164977124
  687. clearing inode number in entry at offset 816...
  688. entry "mmini_w2012_40wr.gif" at block 82 offset 1456 in directory inode 2406989348 references free inode 2165006721
  689. clearing inode number in entry at offset 1456...
  690. entry "dovecot-uidlist" at block 0 offset 528 in directory inode 2407560913 references free inode 2148570520
  691. clearing inode number in entry at offset 528...
  692. entry "1349154259.M477073P8284.server044,S=1546,W=1589:2,S" at block 0 offset 808 in directory inode 2407560921 references free inode 2155558058
  693. clearing inode number in entry at offset 808...
  694. entry "dovecot-uidlist" at block 0 offset 488 in directory inode 2407561384 references free inode 2147938710
  695. clearing inode number in entry at offset 488...
  696. entry "dovecot.index" at block 0 offset 592 in directory inode 2407561384 references free inode 2148290382
  697. clearing inode number in entry at offset 592...
  698. entry "dovecot-uidlist" at block 0 offset 352 in directory inode 2407561458 references free inode 2148564999
  699. clearing inode number in entry at offset 352...
  700. entry "dovecot-uidlist" at block 0 offset 552 in directory inode 2407567044 references free inode 2154168617
  701. clearing inode number in entry at offset 552...
  702. entry "1349153295.17937_0.server044" at block 1 offset 1576 in directory inode 2407577984 references free inode 2360061
  703. clearing inode number in entry at offset 1576...
  704. data fork in ino 2464278601 claims dup extent, off - 0, start - 269263807, cnt 1
  705. bad data fork in inode 2464278601
  706. cleared inode 2464278601
  707. - agno = 2
  708. - agno = 3
  709. Phase 5 - rebuild AG headers and trees...
  710. - reset superblock...
  711. Phase 6 - check inode connectivity...
  712. - resetting contents of realtime bitmap and summary inodes
  713. - traversing filesystem ...
  714. rebuilding directory inode 142
  715. entry "error_log.wp1120005" in directory inode 143 points to free inode 3054610
  716. entry "access_log.wp1119409" in directory inode 143 points to free inode 2559335
  717. entry "access_log.wp1119495" in directory inode 143 points to free inode 1931938
  718. entry "access_log.wp1120024" in directory inode 143 points to free inode 2298433
  719. entry "error_log.wp1120341" in directory inode 143 points to free inode 93624
  720. entry "error_log.wp1119327" in directory inode 143 points to free inode 4836498
  721. entry "error_log.wp10915906" in directory inode 143 points to free inode 954644
  722. entry "error_log.wp1120004" in directory inode 143 points to free inode 536076
  723. entry "error_log.wp10899492" in directory inode 143 points to free inode 4081277
  724. entry "error_log.wp1119462" in directory inode 143 points to free inode 1937657
  725. entry "error_log.wp1119579" in directory inode 143 points to free inode 1649108
  726. entry "error_log.wp1120022" in directory inode 143 points to free inode 2298829
  727. entry "error_log.wp1120207" in directory inode 143 points to free inode 536042
  728. entry "error_log.wp1120212" in directory inode 143 points to free inode 3544629
  729. entry "error_log.wp10895906" in directory inode 143 points to free inode 2291431
  730. entry "error_log.wp10898248" in directory inode 143 points to free inode 954673
  731. entry "error_log.wp10899164" in directory inode 143 points to free inode 525127
  732. entry "error_log.wp10899247" in directory inode 143 points to free inode 1927893
  733. entry "error_log.wp10908079" in directory inode 143 points to free inode 2266995
  734. entry "error_log.wp10907590" in directory inode 143 points to free inode 385811
  735. entry "error_log.wp10907108" in directory inode 143 points to free inode 2275710
  736. entry "error_log.wp10906808" in directory inode 143 points to free inode 2095027
  737. entry "access_log.wp10915860" in directory inode 143 points to free inode 2299630
  738. rebuilding directory inode 143
  739. entry "sess_sjc3r4d37kcdh5067jcg36gdr5" in directory inode 1180 points to free inode 2281025
  740. bad hash table for directory inode 1180 (no data entry): rebuilding
  741. rebuilding directory inode 1180
  742. entry "b0201474" in directory inode 2771 points to free inode 21399
  743. rebuilding directory inode 2771
  744. bad hash table for directory inode 247458 (no data entry): rebuilding
  745. rebuilding directory inode 247458
  746. bad hash table for directory inode 2610741 (no data entry): rebuilding
  747. rebuilding directory inode 2610741
  748. bad hash table for directory inode 3708220 (no data entry): rebuilding
  749. rebuilding directory inode 3708220
  750. bad hash table for directory inode 5013235 (no data entry): rebuilding
  751. rebuilding directory inode 5013235
  752. bad hash table for directory inode 6015837 (no data entry): rebuilding
  753. rebuilding directory inode 6015837
  754. bad hash table for directory inode 6180205 (no data entry): rebuilding
  755. rebuilding directory inode 6180205
  756. bad hash table for directory inode 6469826 (no data entry): rebuilding
  757. rebuilding directory inode 6469826
  758. bad hash table for directory inode 6470254 (no data entry): rebuilding
  759. rebuilding directory inode 6470254
  760. bad hash table for directory inode 2147484108 (no data entry): rebuilding
  761. rebuilding directory inode 2147484108
  762. bad hash table for directory inode 2147488668 (no data entry): rebuilding
  763. rebuilding directory inode 2147488668
  764. bad hash table for directory inode 2147526627 (no data entry): rebuilding
  765. rebuilding directory inode 2147526627
  766. bad hash table for directory inode 2147539866 (no data entry): rebuilding
  767. rebuilding directory inode 2147539866
  768. bad hash table for directory inode 2148900589 (no data entry): rebuilding
  769. rebuilding directory inode 2148900589
  770. bad hash table for directory inode 2149787252 (no data entry): rebuilding
  771. rebuilding directory inode 2149787252
  772. bad hash table for directory inode 2150267648 (no data entry): rebuilding
  773. rebuilding directory inode 2150267648
  774. entry "months.js" in directory inode 2153073272 points to free inode 2154318209
  775. rebuilding directory inode 2153073272
  776. bad hash table for directory inode 2157965199 (no data entry): rebuilding
  777. rebuilding directory inode 2157965199
  778. rebuilding directory inode 2406989311
  779. rebuilding directory inode 2406989348
  780. bad hash table for directory inode 2407560913 (no data entry): rebuilding
  781. rebuilding directory inode 2407560913
  782. bad hash table for directory inode 2407560921 (no data entry): rebuilding
  783. rebuilding directory inode 2407560921
  784. bad hash table for directory inode 2407561384 (no data entry): rebuilding
  785. rebuilding directory inode 2407561384
  786. bad hash table for directory inode 2407561458 (no data entry): rebuilding
  787. rebuilding directory inode 2407561458
  788. bad hash table for directory inode 2407567044 (no data entry): rebuilding
  789. rebuilding directory inode 2407567044
  790. bad hash table for directory inode 2407577984 (no data entry): rebuilding
  791. rebuilding directory inode 2407577984
  792. entry "access_log_2012-10-02_02-58.gz" in directory inode 2464278524 points to free inode 2464278601
  793. bad hash table for directory inode 2464278524 (no data entry): rebuilding
  794. rebuilding directory inode 2464278524
  795. - traversal finished ...
  796. - moving disconnected inodes to lost+found ...
  797. disconnected inode 1603650, moving to lost+found
  798. disconnected inode 2267036, moving to lost+found
  799. disconnected inode 2273226, moving to lost+found
  800. disconnected inode 2282993, moving to lost+found
  801. disconnected inode 2289118, moving to lost+found
  802. disconnected inode 2296381, moving to lost+found
  803. disconnected inode 2296803, moving to lost+found
  804. disconnected inode 2298304, moving to lost+found
  805. disconnected inode 2361887, moving to lost+found
  806. disconnected inode 5603571, moving to lost+found
  807. disconnected inode 2147594146, moving to lost+found
  808. disconnected inode 2147674684, moving to lost+found
  809. disconnected inode 2147678107, moving to lost+found
  810. disconnected inode 2147736987, moving to lost+found
  811. disconnected inode 2147748298, moving to lost+found
  812. disconnected inode 2147793832, moving to lost+found
  813. disconnected inode 2147909030, moving to lost+found
  814. disconnected inode 2148038493, moving to lost+found
  815. disconnected inode 2148100354, moving to lost+found
  816. disconnected inode 2148133074, moving to lost+found
  817. disconnected inode 2148165880, moving to lost+found
  818. disconnected inode 2148225884, moving to lost+found
  819. disconnected inode 2148238753, moving to lost+found
  820. disconnected inode 2148306078, moving to lost+found
  821. disconnected inode 2148487735, moving to lost+found
  822. disconnected inode 2148497265, moving to lost+found
  823. disconnected inode 2148559119, moving to lost+found
  824. disconnected inode 2148629200, moving to lost+found
  825. disconnected inode 2149068430, moving to lost+found
  826. disconnected inode 2149190682, moving to lost+found
  827. disconnected inode 2149425104, moving to lost+found
  828. disconnected inode 2150869824, moving to lost+found
  829. disconnected inode 2152727671, moving to lost+found
  830. disconnected inode 2152837391, moving to lost+found
  831. disconnected inode 2153227781, moving to lost+found
  832. disconnected inode 2153557561, moving to lost+found
  833. disconnected inode 2153675934, moving to lost+found
  834. disconnected inode 2153682903, moving to lost+found
  835. disconnected inode 2154222207, moving to lost+found
  836. disconnected inode 2154618046, moving to lost+found
  837. disconnected inode 2154732165, moving to lost+found
  838. disconnected inode 2154790609, moving to lost+found
  839. disconnected inode 2154849233, moving to lost+found
  840. disconnected inode 2154907536, moving to lost+found
  841. disconnected inode 2155216709, moving to lost+found
  842. disconnected inode 2155483129, moving to lost+found
  843. disconnected inode 2155766329, moving to lost+found
  844. disconnected inode 2155874546, moving to lost+found
  845. disconnected inode 2156977245, moving to lost+found
  846. disconnected inode 2157056159, moving to lost+found
  847. disconnected inode 2157619004, moving to lost+found
  848. disconnected inode 2157626766, moving to lost+found
  849. disconnected inode 2159768076, moving to lost+found
  850. disconnected inode 2161908550, moving to lost+found
  851. disconnected inode 2161980804, moving to lost+found
  852. disconnected inode 2162112438, moving to lost+found
  853. disconnected inode 2162153712, moving to lost+found
  854. disconnected inode 2162572418, moving to lost+found
  855. disconnected inode 2162773503, moving to lost+found
  856. disconnected inode 2162837622, moving to lost+found
  857. disconnected inode 2162841414, moving to lost+found
  858. disconnected inode 2162915537, moving to lost+found
  859. disconnected inode 2164517829, moving to lost+found
  860. disconnected inode 2164783672, moving to lost+found
  861. disconnected inode 2164885382, moving to lost+found
  862. disconnected inode 2166462376, moving to lost+found
  863. disconnected inode 2166498204, moving to lost+found
  864. disconnected inode 2166498511, moving to lost+found
  865. disconnected inode 2166498524, moving to lost+found
  866. disconnected inode 2166499065, moving to lost+found
  867. disconnected inode 2166499076, moving to lost+found
  868. disconnected inode 2166502062, moving to lost+found
  869. disconnected inode 2166502080, moving to lost+found
  870. disconnected inode 2166505613, moving to lost+found
  871. disconnected inode 2466355559, moving to lost+found
  872. disconnected inode 2466402698, moving to lost+found
  873. Phase 7 - verify and correct link counts...
  874. resetting inode 142 nlinks from 2095 to 2093
  875. resetting inode 395325 nlinks from 1 to 2
  876. resetting inode 418223 nlinks from 1 to 2
  877. resetting inode 1767769 nlinks from 1 to 2
  878. resetting inode 2281421 nlinks from 1 to 2
  879. resetting inode 2292506 nlinks from 1 to 2
  880. resetting inode 2293631 nlinks from 1 to 2
  881. resetting inode 2294758 nlinks from 1 to 2
  882. resetting inode 2294836 nlinks from 1 to 2
  883. resetting inode 2295162 nlinks from 1 to 2
  884. resetting inode 2296416 nlinks from 1 to 2
  885. resetting inode 2360756 nlinks from 1 to 2
  886. resetting inode 2360948 nlinks from 1 to 2
  887. resetting inode 6346087 nlinks from 1 to 2
  888. resetting inode 2147562120 nlinks from 1 to 2
  889. resetting inode 2149306339 nlinks from 1 to 2
  890. resetting inode 2150632294 nlinks from 1 to 2
  891. resetting inode 2154432466 nlinks from 1 to 2
  892. resetting inode 2154895103 nlinks from 1 to 2
  893. resetting inode 2156307212 nlinks from 1 to 2
  894. resetting inode 2166540929 nlinks from 1 to 2
  895. Note - quota info will be regenerated on next quota mount.
  896. cache_purge: shake on cache 0x80c7878 left 1 nodes!?
  897. done
  898. #############
  899.  
  900.  
  901.  
  902. The Quota-Check after xfs_repair was done (for time reference):
  903. ###########
  904. 3324 Oct 2 08:45:22 kernel: [ 2186.654363] XFS (sdb1): Mounting Filesystem
  905. 3325 Oct 2 08:45:22 kernel: [ 2186.704472] XFS (sdb1): Ending clean mount
  906. 3326 Oct 2 08:45:22 kernel: [ 2186.723298] XFS (sdb1): Quotacheck needed: Please wait.
  907. ###########
  908.  
  909.  
  910.  
  911. Stacktrace after xfs_repair finished without reboot:
  912. ###########
  913. 3457 Oct 2 08:48:56 kernel: [ 2400.544361] INFO: task mount:32460 blocked for more than 120 seconds.
  914. 3458 Oct 2 08:48:56 kernel: [ 2400.544395] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
  915. 3459 Oct 2 08:48:56 kernel: [ 2400.544441] mount D ffff8802254e8480 0 32460 21009 0x20020000
  916. 3460 Oct 2 08:48:56 kernel: [ 2400.544478] ffff8802254e8200 0000000000000082 ffffffff815f3410 0000000000011300
  917. 3461 Oct 2 08:48:56 kernel: [ 2400.544532] ffff880221807fd8 0000000000004000 ffff880221807fd8 0000000000011300
  918. 3462 Oct 2 08:48:56 kernel: [ 2400.544584] ffff8802254e8200 ffff880221806010 ffff880221807900 0000000000807910
  919. 3463 Oct 2 08:48:56 kernel: [ 2400.544637] Call Trace:
  920. 3464 Oct 2 08:48:56 kernel: [ 2400.544669] [<ffffffff8104a2e6>] ? try_to_wake_up+0x218/0x218
  921. 3465 Oct 2 08:48:56 kernel: [ 2400.544702] [<ffffffff811ab52e>] ? xfs_buf_iowait+0x1a/0x23
  922. 3466 Oct 2 08:48:56 kernel: [ 2400.544732] [<ffffffff811acb9d>] ? xfs_buf_read_map+0x4b/0x73
  923. 3467 Oct 2 08:48:56 kernel: [ 2400.544764] [<ffffffff811ef8f0>] ? xfs_trans_read_buf_map+0x46/0x25b
  924. 3468 Oct 2 08:48:56 kernel: [ 2400.544797] [<ffffffff814626cc>] ? schedule_timeout+0x1f/0x189
  925. 3469 Oct 2 08:48:56 kernel: [ 2400.544828] [<ffffffff811cf96c>] ? xfs_btree_read_buf_block+0x88/0xaf
  926. 3470 Oct 2 08:48:56 kernel: [ 2400.544859] [<ffffffff8104a2e6>] ? try_to_wake_up+0x218/0x218
  927. 3471 Oct 2 08:48:56 kernel: [ 2400.544889] [<ffffffff81463bb8>] ? wait_for_common+0xc8/0x142
  928. 3472 Oct 2 08:48:56 kernel: [ 2400.544919] [<ffffffff8104a2e6>] ? try_to_wake_up+0x218/0x218
  929. 3473 Oct 2 08:48:56 kernel: [ 2400.544949] [<ffffffff811f3c5c>] ? xfs_qm_flush_one+0x3c/0x87
  930. 3474 Oct 2 08:48:56 kernel: [ 2400.544978] [<ffffffff811f382d>] ? xfs_qm_dquot_walk+0x99/0x100
  931. 3475 Oct 2 08:48:56 kernel: [ 2400.545008] [<ffffffff811f3c20>] ? xfs_qm_dqiterate+0x200/0x200
  932. 3476 Oct 2 08:48:56 kernel: [ 2400.545039] [<ffffffff811f41d2>] ? xfs_qm_quotacheck+0x13c/0x252
  933. 3477 Oct 2 08:48:56 kernel: [ 2400.545069] [<ffffffff811f4cdb>] ? xfs_qm_mount_quotas+0x8e/0x14c
  934. 3478 Oct 2 08:48:56 kernel: [ 2400.545100] [<ffffffff811e7f72>] ? xfs_mountfs+0x4d1/0x58f
  935. 3479 Oct 2 08:48:56 kernel: [ 2400.545130] [<ffffffff811b863a>] ? xfs_fs_fill_super+0x1b2/0x26e
  936. 3480 Oct 2 08:48:56 kernel: [ 2400.545161] [<ffffffff810ae86c>] ? mount_bdev+0x137/0x199
  937. 3481 Oct 2 08:48:56 kernel: [ 2400.545190] [<ffffffff811b8488>] ? xfs_setup_devices+0x86/0x86
  938. 3482 Oct 2 08:48:56 kernel: [ 2400.545220] [<ffffffff810ad61c>] ? mount_fs+0xc/0xa9
  939. 3483 Oct 2 08:48:56 kernel: [ 2400.545250] [<ffffffff810c4b11>] ? vfs_kern_mount+0x67/0xe3
  940. 3484 Oct 2 08:48:56 kernel: [ 2400.545279] [<ffffffff810c4bff>] ? do_kern_mount+0x49/0xd6
  941. 3485 Oct 2 08:48:56 kernel: [ 2400.545308] [<ffffffff810c53b4>] ? do_mount+0x728/0x78f
  942. 3486 Oct 2 08:48:56 kernel: [ 2400.545339] [<ffffffff810e5148>] ? compat_sys_mount+0x1b8/0x1fa
  943. 3487 Oct 2 08:48:56 kernel: [ 2400.545370] [<ffffffff814669f9>] ? ia32_do_call+0x13/0x13
  944. ###########
  945.  
  946. After the reboot, the partition mounted fine.
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement