API tools faq
paste
Advertisement
Guest User

Untitled

a guest
Jul 27th, 2010
177
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 38.72 KB | None | 0 0
raw download clone embed print report
  1. 10.07.27_21:23:28.748394 log 10.07.27_21:23:27.325737 mon0 10.0.0.2:6789/0 9 : [INF] osd6 10.0.0.6:6800/2020 failed (by osd9 10.0.0.9:6800/1984)
  2. 10.07.27_21:23:28.748394 log 10.07.27_21:23:28.120290 mon0 10.0.0.2:6789/0 10 : [INF] osd6 10.0.0.6:6800/2020 failed (by osd8 10.0.0.8:6800/2318)
  3. 10.07.27_21:23:28.748394 log 10.07.27_21:23:28.120491 mon0 10.0.0.2:6789/0 11 : [INF] osd7 10.0.0.7:6800/2038 failed (by osd8 10.0.0.8:6800/2318)
  4. 10.07.27_21:23:28.986274 pg v10949: 2640 pgs: 365 active, 1918 active+clean, 106 crashed+replay, 4 peering, 11 crashed+peering, 236 crashed+down+peering; 10956 MB data, 18283 MB used, 893 GB / 911 GB avail; 2107/10202 degraded (20.653%)
  5. 10.07.27_21:23:30.306120 osd e250: 6 osds: 2 up, 4 in -- 2 blacklisted MDSes
  6. 10.07.27_21:23:30.596185 pg v10950: 2640 pgs: 365 active, 1918 active+clean, 106 crashed+replay, 4 peering, 11 crashed+peering, 236 crashed+down+peering; 10956 MB data, 18283 MB used, 893 GB / 911 GB avail; 2107/10202 degraded (20.653%)
  7.  
  8.  
  9. [ 17.220678] Btrfs loaded
  10. [ 17.253122] device fsid 14cceef72443196-9f3b892de2661394 devid 1 transid 11321 /dev/sdb2
  11. [ 17.320290] device fsid 14cceef72443196-9f3b892de2661394 devid 1 transid 11321 /dev/sdb2
  12. [ 17.334898] eth1: link up.
  13. [ 17.335585] ADDRCONF(NETDEV_CHANGE): eth1: link becomes ready
  14. [ 18.260001] CPUFREQ: Per core ondemand sysfs interface is deprecated - ignore_nice_load
  15. [ 18.522530] Clocksource tsc unstable (delta = -67324596 ns)
  16. [ 27.772517] eth1: no IPv6 routers present
  17. [ 672.539988] kswapd0: page allocation failure. order:0, mode:0x4020
  18. [ 672.540000] Pid: 58, comm: kswapd0 Not tainted 2.6.35-020635rc1-generic #020635rc1
  19. [ 672.540006] Call Trace:
  20. [ 672.540011] <IRQ> [<ffffffff810fa946>] __alloc_pages_slowpath+0x416/0x550
  21. [ 672.540017] [<ffffffff810fac0d>] __alloc_pages_nodemask+0x18d/0x1d0
  22. [ 672.540017] [<ffffffff814b64f4>] ? tcp_v4_rcv+0x5a4/0x820
  23. [ 672.540017] [<ffffffff81129243>] alloc_pages_current+0xa3/0x110
  24. [ 672.540017] [<ffffffff811311e5>] allocate_slab+0x175/0x180
  25. [ 672.540017] [<ffffffff81131220>] new_slab+0x30/0x190
  26. [ 672.540017] [<ffffffff811333d7>] __slab_alloc+0x1d7/0x240
  27. [ 672.540017] [<ffffffff814579ad>] ? dev_alloc_skb+0x1d/0x40
  28. [ 672.540017] [<ffffffff81133cb9>] __kmalloc_node_track_caller+0x199/0x1f0
  29. [ 672.540017] [<ffffffff814579ad>] ? dev_alloc_skb+0x1d/0x40
  30. [ 672.540017] [<ffffffff8145783f>] __alloc_skb+0x7f/0x170
  31. [ 672.540017] [<ffffffff814579ad>] dev_alloc_skb+0x1d/0x40
  32. [ 672.540017] [<ffffffffa00f069b>] nv_alloc_rx_optimized+0x19b/0x270 [forcedeth]
  33. [ 672.540017] [<ffffffffa00f10d8>] nv_napi_poll+0x188/0x310 [forcedeth]
  34. [ 672.540017] [<ffffffff81464bdb>] net_rx_action+0x10b/0x200
  35. [ 672.540017] [<ffffffff814582ce>] ? __kfree_skb+0x1e/0x30
  36. [ 672.540017] [<ffffffff810673f7>] __do_softirq+0xc7/0x1e0
  37. [ 672.540017] [<ffffffff8102df2b>] ? ack_apic_level+0x7b/0x100
  38. [ 672.540017] [<ffffffff8100bf5c>] call_softirq+0x1c/0x30
  39. [ 672.540017] [<ffffffff8100d915>] do_softirq+0x65/0xa0
  40. [ 672.540017] [<ffffffff81066b9c>] irq_exit+0x7c/0x90
  41. [ 672.540017] [<ffffffff81553fc8>] do_IRQ+0x78/0xf0
  42. [ 672.540017] [<ffffffff8154ca13>] ret_from_intr+0x0/0x11
  43. [ 672.540017] <EOI> [<ffffffffa03c3670>] ? btrfs_clear_bit_hook+0x0/0x130 [btrfs]
  44. [ 672.540017] [<ffffffffa03c368b>] ? btrfs_clear_bit_hook+0x1b/0x130 [btrfs]
  45. [ 672.540017] [<ffffffffa03dc414>] clear_state_cb+0x24/0x30 [btrfs]
  46. [ 672.540017] [<ffffffffa03dd25b>] clear_state_bit+0x5b/0x120 [btrfs]
  47. [ 672.540017] [<ffffffffa03dda34>] clear_extent_bit+0x304/0x3a0 [btrfs]
  48. [ 672.540017] [<ffffffffa03de439>] try_release_extent_state+0x89/0xb0 [btrfs]
  49. [ 672.540017] [<ffffffffa03de5b3>] try_release_extent_mapping+0x153/0x180 [btrfs]
  50. [ 672.540017] [<ffffffffa03c1f6b>] __btrfs_releasepage+0x3b/0x70 [btrfs]
  51. [ 672.540017] [<ffffffffa03c1fc8>] btrfs_releasepage+0x28/0x30 [btrfs]
  52. [ 672.540017] [<ffffffff810f3f32>] try_to_release_page+0x32/0x50
  53. [ 672.540017] [<ffffffff8110129c>] shrink_page_list+0x45c/0x4e0
  54. [ 672.540017] [<ffffffff81101b94>] shrink_inactive_list+0x264/0x680
  55. [ 672.540017] [<ffffffffa03cd18d>] ? btrfs_drop_extent_cache+0x2bd/0x2f0 [btrfs]
  56. [ 672.540017] [<ffffffffa03c38c1>] ? btrfs_destroy_inode+0x121/0x210 [btrfs]
  57. [ 672.540017] [<ffffffff81102006>] shrink_list+0x56/0xa0
  58. [ 672.540017] [<ffffffff81102158>] shrink_zone+0x108/0x110
  59. [ 672.540017] [<ffffffff81102893>] balance_pgdat+0x493/0x530
  60. [ 672.540017] [<ffffffff81102a34>] kswapd+0x104/0x200
  61. [ 672.540017] [<ffffffff8107ea10>] ? autoremove_wake_function+0x0/0x40
  62. [ 672.540017] [<ffffffff81102930>] ? kswapd+0x0/0x200
  63. [ 672.540017] [<ffffffff8107e616>] kthread+0x96/0xa0
  64. [ 672.540017] [<ffffffff8100be64>] kernel_thread_helper+0x4/0x10
  65. [ 672.540017] [<ffffffff8107e580>] ? kthread+0x0/0xa0
  66. [ 672.540017] [<ffffffff8100be60>] ? kernel_thread_helper+0x0/0x10
  67. [ 672.540017] Mem-Info:
  68. [ 672.540017] Node 0 DMA per-cpu:
  69. [ 672.540017] CPU 0: hi: 0, btch: 1 usd: 0
  70. [ 672.540017] CPU 1: hi: 0, btch: 1 usd: 0
  71. [ 672.540017] Node 0 DMA32 per-cpu:
  72. [ 672.540017] CPU 0: hi: 186, btch: 31 usd: 195
  73. [ 672.540017] CPU 1: hi: 186, btch: 31 usd: 108
  74. [ 672.540017] active_anon:8404 inactive_anon:20256 isolated_anon:0
  75. [ 672.540017] active_file:46664 inactive_file:157072 isolated_file:32
  76. [ 672.540017] unevictable:672 dirty:623 writeback:0 unstable:0
  77. [ 672.540017] free:1345 slab_reclaimable:3124 slab_unreclaimable:4326
  78. [ 672.540017] mapped:1588 shmem:61 pagetables:425 bounce:0
  79. [ 672.540017] Node 0 DMA free:3932kB min:60kB low:72kB high:88kB active_anon:0kB inactive_anon:0kB active_file:20kB inactive_file:11900kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15704kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:20kB slab_unreclaimable:20kB kernel_stack:8kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
  80. [ 672.540017] lowmem_reserve[]: 0 977 977 977
  81. [ 672.540017] Node 0 DMA32 free:1448kB min:3968kB low:4960kB high:5952kB active_anon:33616kB inactive_anon:81024kB active_file:186636kB inactive_file:616388kB unevictable:2688kB isolated(anon):0kB isolated(file):128kB present:1000972kB mlocked:2688kB dirty:2492kB writeback:0kB mapped:6352kB shmem:244kB slab_reclaimable:12476kB slab_unreclaimable:17284kB kernel_stack:1184kB pagetables:1700kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:32 all_unreclaimable? no
  82. [ 672.540017] lowmem_reserve[]: 0 0 0 0
  83. [ 672.540017] Node 0 DMA: 1*4kB 1*8kB 3*16kB 5*32kB 4*64kB 3*128kB 2*256kB 1*512kB 0*1024kB 1*2048kB 0*4096kB = 3932kB
  84. [ 672.540017] Node 0 DMA32: 190*4kB 4*8kB 3*16kB 1*32kB 1*64kB 0*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 1448kB
  85. [ 672.540017] 204286 total pagecache pages
  86. [ 672.540017] 0 pages in swap cache
  87. [ 672.540017] Swap cache stats: add 0, delete 0, find 0/0
  88. [ 672.540017] Free swap = 5253216kB
  89. [ 672.540017] Total swap = 5253216kB
  90. [ 672.540017] 257792 pages RAM
  91. [ 672.540017] 6209 pages reserved
  92. [ 672.540017] 209325 pages shared
  93. [ 672.540017] 47693 pages non-shared
  94. [ 672.540017] SLUB: Unable to allocate memory on node -1 (gfp=0x20)
  95. [ 672.540017] cache: kmalloc-4096, object size: 4096, buffer size: 4096, default order: 3, min order: 0
  96. [ 672.540017] node 0: slabs: 524, objs: 2043, free: 0
  97. [ 672.551703] kswapd0: page allocation failure. order:0, mode:0x4020
  98. [ 672.551710] Pid: 58, comm: kswapd0 Not tainted 2.6.35-020635rc1-generic #020635rc1
  99. [ 672.551715] Call Trace:
  100. [ 672.551718] <IRQ> [<ffffffff810fa946>] __alloc_pages_slowpath+0x416/0x550
  101. [ 672.551739] [<ffffffff810fac0d>] __alloc_pages_nodemask+0x18d/0x1d0
  102. [ 672.551749] [<ffffffff814b64f4>] ? tcp_v4_rcv+0x5a4/0x820
  103. [ 672.551757] [<ffffffff81129243>] alloc_pages_current+0xa3/0x110
  104. [ 672.551767] [<ffffffff811311e5>] allocate_slab+0x175/0x180
  105. [ 672.551775] [<ffffffff81131220>] new_slab+0x30/0x190
  106. [ 672.551782] [<ffffffff811333d7>] __slab_alloc+0x1d7/0x240
  107. [ 672.551792] [<ffffffff814579ad>] ? dev_alloc_skb+0x1d/0x40
  108. [ 672.551800] [<ffffffff81133cb9>] __kmalloc_node_track_caller+0x199/0x1f0
  109. [ 672.551808] [<ffffffff814579ad>] ? dev_alloc_skb+0x1d/0x40
  110. [ 672.551817] [<ffffffff8145783f>] __alloc_skb+0x7f/0x170
  111. [ 672.551825] [<ffffffff814579ad>] dev_alloc_skb+0x1d/0x40
  112. [ 672.551843] [<ffffffffa00f069b>] nv_alloc_rx_optimized+0x19b/0x270 [forcedeth]
  113. [ 672.551855] [<ffffffffa00f10d8>] nv_napi_poll+0x188/0x310 [forcedeth]
  114. [ 672.551865] [<ffffffff81464bdb>] net_rx_action+0x10b/0x200
  115. [ 672.551876] [<ffffffff810673f7>] __do_softirq+0xc7/0x1e0
  116. [ 672.551885] [<ffffffff8102df2b>] ? ack_apic_level+0x7b/0x100
  117. [ 672.551894] [<ffffffff8100bf5c>] call_softirq+0x1c/0x30
  118. [ 672.551901] [<ffffffff8100d915>] do_softirq+0x65/0xa0
  119. [ 672.551909] [<ffffffff81066b9c>] irq_exit+0x7c/0x90
  120. [ 672.551916] [<ffffffff81553fc8>] do_IRQ+0x78/0xf0
  121. [ 672.551924] [<ffffffff8154ca13>] ret_from_intr+0x0/0x11
  122. [ 672.551928] <EOI> [<ffffffffa03c3670>] ? btrfs_clear_bit_hook+0x0/0x130 [btrfs]
  123. [ 672.551987] [<ffffffffa03c368b>] ? btrfs_clear_bit_hook+0x1b/0x130 [btrfs]
  124. [ 672.552013] [<ffffffffa03dc414>] clear_state_cb+0x24/0x30 [btrfs]
  125. [ 672.552038] [<ffffffffa03dd25b>] clear_state_bit+0x5b/0x120 [btrfs]
  126. [ 672.552064] [<ffffffffa03dda34>] clear_extent_bit+0x304/0x3a0 [btrfs]
  127. [ 672.552091] [<ffffffffa03de439>] try_release_extent_state+0x89/0xb0 [btrfs]
  128. [ 672.552116] [<ffffffffa03de5b3>] try_release_extent_mapping+0x153/0x180 [btrfs]
  129. [ 672.552142] [<ffffffffa03c1f6b>] __btrfs_releasepage+0x3b/0x70 [btrfs]
  130. [ 672.552166] [<ffffffffa03c1fc8>] btrfs_releasepage+0x28/0x30 [btrfs]
  131. [ 672.552174] [<ffffffff810f3f32>] try_to_release_page+0x32/0x50
  132. [ 672.552183] [<ffffffff8110129c>] shrink_page_list+0x45c/0x4e0
  133. [ 672.552192] [<ffffffff81101b94>] shrink_inactive_list+0x264/0x680
  134. [ 672.552219] [<ffffffffa03cd18d>] ? btrfs_drop_extent_cache+0x2bd/0x2f0 [btrfs]
  135. [ 672.552244] [<ffffffffa03c38c1>] ? btrfs_destroy_inode+0x121/0x210 [btrfs]
  136. [ 672.552253] [<ffffffff81102006>] shrink_list+0x56/0xa0
  137. [ 672.552260] [<ffffffff81102158>] shrink_zone+0x108/0x110
  138. [ 672.552269] [<ffffffff81102893>] balance_pgdat+0x493/0x530
  139. [ 672.552277] [<ffffffff81102a34>] kswapd+0x104/0x200
  140. [ 672.552285] [<ffffffff8107ea10>] ? autoremove_wake_function+0x0/0x40
  141. [ 672.552293] [<ffffffff81102930>] ? kswapd+0x0/0x200
  142. [ 672.552301] [<ffffffff8107e616>] kthread+0x96/0xa0
  143. [ 672.552309] [<ffffffff8100be64>] kernel_thread_helper+0x4/0x10
  144. [ 672.552318] [<ffffffff8107e580>] ? kthread+0x0/0xa0
  145. [ 672.552324] [<ffffffff8100be60>] ? kernel_thread_helper+0x0/0x10
  146. [ 672.552329] Mem-Info:
  147. [ 672.552332] Node 0 DMA per-cpu:
  148. [ 672.552338] CPU 0: hi: 0, btch: 1 usd: 0
  149. [ 672.552343] CPU 1: hi: 0, btch: 1 usd: 0
  150. [ 672.552346] Node 0 DMA32 per-cpu:
  151. [ 672.552352] CPU 0: hi: 186, btch: 31 usd: 195
  152. [ 672.552357] CPU 1: hi: 186, btch: 31 usd: 108
  153. [ 672.552368] active_anon:8404 inactive_anon:20256 isolated_anon:0
  154. [ 672.552370] active_file:46664 inactive_file:157040 isolated_file:64
  155. [ 672.552373] unevictable:672 dirty:623 writeback:0 unstable:0
  156. [ 672.552375] free:1345 slab_reclaimable:3124 slab_unreclaimable:4326
  157. [ 672.552377] mapped:1588 shmem:61 pagetables:425 bounce:0
  158. [ 672.552382] Node 0 DMA free:3932kB min:60kB low:72kB high:88kB active_anon:0kB inactive_anon:0kB active_file:20kB inactive_file:11900kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15704kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:20kB slab_unreclaimable:20kB kernel_stack:8kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
  159. [ 672.552404] lowmem_reserve[]: 0 977 977 977
  160. [ 672.552413] Node 0 DMA32 free:1448kB min:3968kB low:4960kB high:5952kB active_anon:33616kB inactive_anon:81024kB active_file:186636kB inactive_file:616260kB unevictable:2688kB isolated(anon):0kB isolated(file):256kB present:1000972kB mlocked:2688kB dirty:2492kB writeback:0kB mapped:6352kB shmem:244kB slab_reclaimable:12476kB slab_unreclaimable:17284kB kernel_stack:1184kB pagetables:1700kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:64 all_unreclaimable? no
  161. [ 672.552438] lowmem_reserve[]: 0 0 0 0
  162. [ 672.552446] Node 0 DMA: 1*4kB 1*8kB 3*16kB 5*32kB 4*64kB 3*128kB 2*256kB 1*512kB 0*1024kB 1*2048kB 0*4096kB = 3932kB
  163. [ 672.552470] Node 0 DMA32: 190*4kB 4*8kB 3*16kB 1*32kB 1*64kB 0*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 1448kB
  164. [ 672.552493] 204286 total pagecache pages
  165. [ 672.552496] 0 pages in swap cache
  166. [ 672.552501] Swap cache stats: add 0, delete 0, find 0/0
  167. [ 672.552505] Free swap = 5253216kB
  168. [ 672.552508] Total swap = 5253216kB
  169. [ 672.561124] 257792 pages RAM
  170. [ 672.561124] 6209 pages reserved
  171. [ 672.561124] 209357 pages shared
  172. [ 672.561124] 47693 pages non-shared
  173. [ 672.561124] SLUB: Unable to allocate memory on node -1 (gfp=0x20)
  174. [ 672.561124] cache: kmalloc-4096, object size: 4096, buffer size: 4096, default order: 3, min order: 0
  175. [ 672.561124] node 0: slabs: 524, objs: 2043, free: 0
  176. [ 672.563046] kswapd0: page allocation failure. order:0, mode:0x4020
  177. [ 672.563053] Pid: 58, comm: kswapd0 Not tainted 2.6.35-020635rc1-generic #020635rc1
  178. [ 672.563058] Call Trace:
  179. [ 672.563061] <IRQ> [<ffffffff810fa946>] __alloc_pages_slowpath+0x416/0x550
  180. [ 672.563082] [<ffffffff810fac0d>] __alloc_pages_nodemask+0x18d/0x1d0
  181. [ 672.563091] [<ffffffff814b64f4>] ? tcp_v4_rcv+0x5a4/0x820
  182. [ 672.563100] [<ffffffff81129243>] alloc_pages_current+0xa3/0x110
  183. [ 672.563110] [<ffffffff811311e5>] allocate_slab+0x175/0x180
  184. [ 672.563118] [<ffffffff81131220>] new_slab+0x30/0x190
  185. [ 672.563125] [<ffffffff811333d7>] __slab_alloc+0x1d7/0x240
  186. [ 672.563134] [<ffffffff814579ad>] ? dev_alloc_skb+0x1d/0x40
  187. [ 672.563142] [<ffffffff81133cb9>] __kmalloc_node_track_caller+0x199/0x1f0
  188. [ 672.563150] [<ffffffff814579ad>] ? dev_alloc_skb+0x1d/0x40
  189. [ 672.563159] [<ffffffff8145783f>] __alloc_skb+0x7f/0x170
  190. [ 672.563167] [<ffffffff814579ad>] dev_alloc_skb+0x1d/0x40
  191. [ 672.563185] [<ffffffffa00f069b>] nv_alloc_rx_optimized+0x19b/0x270 [forcedeth]
  192. [ 672.563196] [<ffffffffa00f10d8>] nv_napi_poll+0x188/0x310 [forcedeth]
  193. [ 672.563207] [<ffffffff81464bdb>] net_rx_action+0x10b/0x200
  194. [ 672.563215] [<ffffffff814582ce>] ? __kfree_skb+0x1e/0x30
  195. [ 672.563225] [<ffffffff810673f7>] __do_softirq+0xc7/0x1e0
  196. [ 672.563234] [<ffffffff8102df2b>] ? ack_apic_level+0x7b/0x100
  197. [ 672.563243] [<ffffffff8100bf5c>] call_softirq+0x1c/0x30
  198. [ 672.563250] [<ffffffff8100d915>] do_softirq+0x65/0xa0
  199. [ 672.563258] [<ffffffff81066b9c>] irq_exit+0x7c/0x90
  200. [ 672.563265] [<ffffffff81553fc8>] do_IRQ+0x78/0xf0
  201. [ 672.563273] [<ffffffff8154ca13>] ret_from_intr+0x0/0x11
  202. [ 672.563277] <EOI> [<ffffffffa03c3670>] ? btrfs_clear_bit_hook+0x0/0x130 [btrfs]
  203. [ 672.563336] [<ffffffffa03c368b>] ? btrfs_clear_bit_hook+0x1b/0x130 [btrfs]
  204. [ 672.563362] [<ffffffffa03dc414>] clear_state_cb+0x24/0x30 [btrfs]
  205. [ 672.563387] [<ffffffffa03dd25b>] clear_state_bit+0x5b/0x120 [btrfs]
  206. [ 672.563413] [<ffffffffa03dda34>] clear_extent_bit+0x304/0x3a0 [btrfs]
  207. [ 672.563439] [<ffffffffa03de439>] try_release_extent_state+0x89/0xb0 [btrfs]
  208. [ 672.563465] [<ffffffffa03de5b3>] try_release_extent_mapping+0x153/0x180 [btrfs]
  209. [ 672.563490] [<ffffffffa03c1f6b>] __btrfs_releasepage+0x3b/0x70 [btrfs]
  210. [ 672.563515] [<ffffffffa03c1fc8>] btrfs_releasepage+0x28/0x30 [btrfs]
  211. [ 672.563523] [<ffffffff810f3f32>] try_to_release_page+0x32/0x50
  212. [ 672.563531] [<ffffffff8110129c>] shrink_page_list+0x45c/0x4e0
  213. [ 672.563540] [<ffffffff81101b94>] shrink_inactive_list+0x264/0x680
  214. [ 672.563567] [<ffffffffa03cd18d>] ? btrfs_drop_extent_cache+0x2bd/0x2f0 [btrfs]
  215. [ 672.563593] [<ffffffffa03c38c1>] ? btrfs_destroy_inode+0x121/0x210 [btrfs]
  216. [ 672.563601] [<ffffffff81102006>] shrink_list+0x56/0xa0
  217. [ 672.563609] [<ffffffff81102158>] shrink_zone+0x108/0x110
  218. [ 672.563617] [<ffffffff81102893>] balance_pgdat+0x493/0x530
  219. [ 672.563625] [<ffffffff81102a34>] kswapd+0x104/0x200
  220. [ 672.563633] [<ffffffff8107ea10>] ? autoremove_wake_function+0x0/0x40
  221. [ 672.563641] [<ffffffff81102930>] ? kswapd+0x0/0x200
  222. [ 672.563650] [<ffffffff8107e616>] kthread+0x96/0xa0
  223. [ 672.563657] [<ffffffff8100be64>] kernel_thread_helper+0x4/0x10
  224. [ 672.563666] [<ffffffff8107e580>] ? kthread+0x0/0xa0
  225. [ 672.563673] [<ffffffff8100be60>] ? kernel_thread_helper+0x0/0x10
  226. [ 672.563677] Mem-Info:
  227. [ 672.563680] Node 0 DMA per-cpu:
  228. [ 672.563686] CPU 0: hi: 0, btch: 1 usd: 0
  229. [ 672.563690] CPU 1: hi: 0, btch: 1 usd: 0
  230. [ 672.563694] Node 0 DMA32 per-cpu:
  231. [ 672.563700] CPU 0: hi: 186, btch: 31 usd: 195
  232. [ 672.563705] CPU 1: hi: 186, btch: 31 usd: 108
  233. [ 672.563715] active_anon:8404 inactive_anon:20256 isolated_anon:0
  234. [ 672.563717] active_file:46664 inactive_file:157040 isolated_file:64
  235. [ 672.563720] unevictable:672 dirty:623 writeback:0 unstable:0
  236. [ 672.563722] free:1345 slab_reclaimable:3124 slab_unreclaimable:4326
  237. [ 672.563725] mapped:1588 shmem:61 pagetables:425 bounce:0
  238. [ 672.563729] Node 0 DMA free:3932kB min:60kB low:72kB high:88kB active_anon:0kB inactive_anon:0kB active_file:20kB inactive_file:11900kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15704kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:20kB slab_unreclaimable:20kB kernel_stack:8kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
  239. [ 672.563751] lowmem_reserve[]: 0 977 977 977
  240. [ 672.563761] Node 0 DMA32 free:1448kB min:3968kB low:4960kB high:5952kB active_anon:33616kB inactive_anon:81024kB active_file:186636kB inactive_file:616260kB unevictable:2688kB isolated(anon):0kB isolated(file):256kB present:1000972kB mlocked:2688kB dirty:2492kB writeback:0kB mapped:6352kB shmem:244kB slab_reclaimable:12476kB slab_unreclaimable:17284kB kernel_stack:1184kB pagetables:1700kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:64 all_unreclaimable? no
  241. [ 672.563785] lowmem_reserve[]: 0 0 0 0
  242. [ 672.563793] Node 0 DMA: 1*4kB 1*8kB 3*16kB 5*32kB 4*64kB 3*128kB 2*256kB 1*512kB 0*1024kB 1*2048kB 0*4096kB = 3932kB
  243. [ 672.563817] Node 0 DMA32: 190*4kB 4*8kB 3*16kB 1*32kB 1*64kB 0*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 1448kB
  244. [ 672.563840] 204286 total pagecache pages
  245. [ 672.563843] 0 pages in swap cache
  246. [ 672.563848] Swap cache stats: add 0, delete 0, find 0/0
  247. [ 672.563851] Free swap = 5253216kB
  248. [ 672.563855] Total swap = 5253216kB
  249. [ 672.572461] 257792 pages RAM
  250. [ 672.572461] 6209 pages reserved
  251. [ 672.572461] 209357 pages shared
  252. [ 672.572461] 47693 pages non-shared
  253. [ 672.572461] SLUB: Unable to allocate memory on node -1 (gfp=0x20)
  254. [ 672.572461] cache: kmalloc-4096, object size: 4096, buffer size: 4096, default order: 3, min order: 0
  255. [ 672.572461] node 0: slabs: 524, objs: 2043, free: 0
  256. [ 672.574405] kswapd0: page allocation failure. order:0, mode:0x4020
  257. [ 672.574412] Pid: 58, comm: kswapd0 Not tainted 2.6.35-020635rc1-generic #020635rc1
  258. [ 672.574416] Call Trace:
  259. [ 672.574420] <IRQ> [<ffffffff810fa946>] __alloc_pages_slowpath+0x416/0x550
  260. [ 672.574441] [<ffffffff810fac0d>] __alloc_pages_nodemask+0x18d/0x1d0
  261. [ 672.574450] [<ffffffff814b64f4>] ? tcp_v4_rcv+0x5a4/0x820
  262. [ 672.574459] [<ffffffff81129243>] alloc_pages_current+0xa3/0x110
  263. [ 672.574468] [<ffffffff811311e5>] allocate_slab+0x175/0x180
  264. [ 672.574477] [<ffffffff81131220>] new_slab+0x30/0x190
  265. [ 672.574484] [<ffffffff811333d7>] __slab_alloc+0x1d7/0x240
  266. [ 672.574493] [<ffffffff814579ad>] ? dev_alloc_skb+0x1d/0x40
  267. [ 672.574501] [<ffffffff81133cb9>] __kmalloc_node_track_caller+0x199/0x1f0
  268. [ 672.574509] [<ffffffff814579ad>] ? dev_alloc_skb+0x1d/0x40
  269. [ 672.574518] [<ffffffff8145783f>] __alloc_skb+0x7f/0x170
  270. [ 672.574526] [<ffffffff814579ad>] dev_alloc_skb+0x1d/0x40
  271. [ 672.574544] [<ffffffffa00f069b>] nv_alloc_rx_optimized+0x19b/0x270 [forcedeth]
  272. [ 672.574555] [<ffffffffa00f10d8>] nv_napi_poll+0x188/0x310 [forcedeth]
  273. [ 672.574564] [<ffffffff810c3e00>] ? dyntick_save_progress_counter+0x0/0x50
  274. [ 672.574574] [<ffffffff81464bdb>] net_rx_action+0x10b/0x200
  275. [ 672.574585] [<ffffffff810673f7>] __do_softirq+0xc7/0x1e0
  276. [ 672.574594] [<ffffffff8102df2b>] ? ack_apic_level+0x7b/0x100
  277. [ 672.574603] [<ffffffff8100bf5c>] call_softirq+0x1c/0x30
  278. [ 672.574610] [<ffffffff8100d915>] do_softirq+0x65/0xa0
  279. [ 672.574618] [<ffffffff81066b9c>] irq_exit+0x7c/0x90
  280. [ 672.574626] [<ffffffff81553fc8>] do_IRQ+0x78/0xf0
  281. [ 672.574633] [<ffffffff8154ca13>] ret_from_intr+0x0/0x11
  282. [ 672.574637] <EOI> [<ffffffffa03c3670>] ? btrfs_clear_bit_hook+0x0/0x130 [btrfs]
  283. [ 672.574696] [<ffffffffa03c368b>] ? btrfs_clear_bit_hook+0x1b/0x130 [btrfs]
  284. [ 672.574722] [<ffffffffa03dc414>] clear_state_cb+0x24/0x30 [btrfs]
  285. [ 672.574748] [<ffffffffa03dd25b>] clear_state_bit+0x5b/0x120 [btrfs]
  286. [ 672.574774] [<ffffffffa03dda34>] clear_extent_bit+0x304/0x3a0 [btrfs]
  287. [ 672.574801] [<ffffffffa03de439>] try_release_extent_state+0x89/0xb0 [btrfs]
  288. [ 672.574826] [<ffffffffa03de5b3>] try_release_extent_mapping+0x153/0x180 [btrfs]
  289. [ 672.574851] [<ffffffffa03c1f6b>] __btrfs_releasepage+0x3b/0x70 [btrfs]
  290. [ 672.574876] [<ffffffffa03c1fc8>] btrfs_releasepage+0x28/0x30 [btrfs]
  291. [ 672.574884] [<ffffffff810f3f32>] try_to_release_page+0x32/0x50
  292. [ 672.574892] [<ffffffff8110129c>] shrink_page_list+0x45c/0x4e0
  293. [ 672.574901] [<ffffffff81101b94>] shrink_inactive_list+0x264/0x680
  294. [ 672.574928] [<ffffffffa03cd18d>] ? btrfs_drop_extent_cache+0x2bd/0x2f0 [btrfs]
  295. [ 672.574954] [<ffffffffa03c38c1>] ? btrfs_destroy_inode+0x121/0x210 [btrfs]
  296. [ 672.574962] [<ffffffff81102006>] shrink_list+0x56/0xa0
  297. [ 672.574970] [<ffffffff81102158>] shrink_zone+0x108/0x110
  298. [ 672.574978] [<ffffffff81102893>] balance_pgdat+0x493/0x530
  299. [ 672.574987] [<ffffffff81102a34>] kswapd+0x104/0x200
  300. [ 672.574994] [<ffffffff8107ea10>] ? autoremove_wake_function+0x0/0x40
  301. [ 672.575002] [<ffffffff81102930>] ? kswapd+0x0/0x200
  302. [ 672.575011] [<ffffffff8107e616>] kthread+0x96/0xa0
  303. [ 672.575018] [<ffffffff8100be64>] kernel_thread_helper+0x4/0x10
  304. [ 672.575027] [<ffffffff8107e580>] ? kthread+0x0/0xa0
  305. [ 672.575034] [<ffffffff8100be60>] ? kernel_thread_helper+0x0/0x10
  306. [ 672.575038] Mem-Info:
  307. [ 672.575041] Node 0 DMA per-cpu:
  308. [ 672.575047] CPU 0: hi: 0, btch: 1 usd: 0
  309. [ 672.575052] CPU 1: hi: 0, btch: 1 usd: 0
  310. [ 672.575056] Node 0 DMA32 per-cpu:
  311. [ 672.575061] CPU 0: hi: 186, btch: 31 usd: 195
  312. [ 672.575066] CPU 1: hi: 186, btch: 31 usd: 108
  313. [ 672.575076] active_anon:8404 inactive_anon:20256 isolated_anon:0
  314. [ 672.575079] active_file:46664 inactive_file:157040 isolated_file:64
  315. [ 672.575081] unevictable:672 dirty:623 writeback:0 unstable:0
  316. [ 672.575083] free:1345 slab_reclaimable:3124 slab_unreclaimable:4326
  317. [ 672.575086] mapped:1588 shmem:61 pagetables:425 bounce:0
  318. [ 672.575090] Node 0 DMA free:3932kB min:60kB low:72kB high:88kB active_anon:0kB inactive_anon:0kB active_file:20kB inactive_file:11900kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15704kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:20kB slab_unreclaimable:20kB kernel_stack:8kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
  319. [ 672.575113] lowmem_reserve[]: 0 977 977 977
  320. [ 672.575122] Node 0 DMA32 free:1448kB min:3968kB low:4960kB high:5952kB active_anon:33616kB inactive_anon:81024kB active_file:186636kB inactive_file:616260kB unevictable:2688kB isolated(anon):0kB isolated(file):256kB present:1000972kB mlocked:2688kB dirty:2492kB writeback:0kB mapped:6352kB shmem:244kB slab_reclaimable:12476kB slab_unreclaimable:17284kB kernel_stack:1184kB pagetables:1700kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:64 all_unreclaimable? no
  321. [ 672.575146] lowmem_reserve[]: 0 0 0 0
  322. [ 672.575155] Node 0 DMA: 1*4kB 1*8kB 3*16kB 5*32kB 4*64kB 3*128kB 2*256kB 1*512kB 0*1024kB 1*2048kB 0*4096kB = 3932kB
  323. [ 672.575178] Node 0 DMA32: 190*4kB 4*8kB 3*16kB 1*32kB 1*64kB 0*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 1448kB
  324. [ 672.575201] 204286 total pagecache pages
  325. [ 672.575204] 0 pages in swap cache
  326. [ 672.575209] Swap cache stats: add 0, delete 0, find 0/0
  327. [ 672.575212] Free swap = 5253216kB
  328. [ 672.575216] Total swap = 5253216kB
  329. [ 672.583800] 257792 pages RAM
  330. [ 672.583800] 6209 pages reserved
  331. [ 672.583800] 209357 pages shared
  332. [ 672.583800] 47693 pages non-shared
  333. [ 672.583800] SLUB: Unable to allocate memory on node -1 (gfp=0x20)
  334. [ 672.583800] cache: kmalloc-4096, object size: 4096, buffer size: 4096, default order: 3, min order: 0
  335. [ 672.583800] node 0: slabs: 524, objs: 2043, free: 0
  336. [ 672.585757] kswapd0: page allocation failure. order:0, mode:0x4020
  337. [ 672.585764] Pid: 58, comm: kswapd0 Not tainted 2.6.35-020635rc1-generic #020635rc1
  338. [ 672.585768] Call Trace:
  339. [ 672.585772] <IRQ> [<ffffffff810fa946>] __alloc_pages_slowpath+0x416/0x550
  340. [ 672.585793] [<ffffffff810fac0d>] __alloc_pages_nodemask+0x18d/0x1d0
  341. [ 672.585802] [<ffffffff814b64f4>] ? tcp_v4_rcv+0x5a4/0x820
  342. [ 672.585810] [<ffffffff81129243>] alloc_pages_current+0xa3/0x110
  343. [ 672.585820] [<ffffffff811311e5>] allocate_slab+0x175/0x180
  344. [ 672.585828] [<ffffffff81131220>] new_slab+0x30/0x190
  345. [ 672.585835] [<ffffffff811333d7>] __slab_alloc+0x1d7/0x240
  346. [ 672.585844] [<ffffffff814579ad>] ? dev_alloc_skb+0x1d/0x40
  347. [ 672.585852] [<ffffffff81133cb9>] __kmalloc_node_track_caller+0x199/0x1f0
  348. [ 672.585860] [<ffffffff814579ad>] ? dev_alloc_skb+0x1d/0x40
  349. [ 672.585868] [<ffffffff8145783f>] __alloc_skb+0x7f/0x170
  350. [ 672.585876] [<ffffffff814579ad>] dev_alloc_skb+0x1d/0x40
  351. [ 672.585895] [<ffffffffa00f069b>] nv_alloc_rx_optimized+0x19b/0x270 [forcedeth]
  352. [ 672.585906] [<ffffffffa00f10d8>] nv_napi_poll+0x188/0x310 [forcedeth]
  353. [ 672.585916] [<ffffffff81464bdb>] net_rx_action+0x10b/0x200
  354. [ 672.585925] [<ffffffff814582ce>] ? __kfree_skb+0x1e/0x30
  355. [ 672.585935] [<ffffffff810673f7>] __do_softirq+0xc7/0x1e0
  356. [ 672.585944] [<ffffffff8102df2b>] ? ack_apic_level+0x7b/0x100
  357. [ 672.585952] [<ffffffff8100bf5c>] call_softirq+0x1c/0x30
  358. [ 672.585960] [<ffffffff8100d915>] do_softirq+0x65/0xa0
  359. [ 672.585967] [<ffffffff81066b9c>] irq_exit+0x7c/0x90
  360. [ 672.585974] [<ffffffff81553fc8>] do_IRQ+0x78/0xf0
  361. [ 672.585982] [<ffffffff8154ca13>] ret_from_intr+0x0/0x11
  362. [ 672.585986] <EOI> [<ffffffffa03c3670>] ? btrfs_clear_bit_hook+0x0/0x130 [btrfs]
  363. [ 672.586044] [<ffffffffa03c368b>] ? btrfs_clear_bit_hook+0x1b/0x130 [btrfs]
  364. [ 672.586070] [<ffffffffa03dc414>] clear_state_cb+0x24/0x30 [btrfs]
  365. [ 672.586095] [<ffffffffa03dd25b>] clear_state_bit+0x5b/0x120 [btrfs]
  366. [ 672.586121] [<ffffffffa03dda34>] clear_extent_bit+0x304/0x3a0 [btrfs]
  367. [ 672.586147] [<ffffffffa03de439>] try_release_extent_state+0x89/0xb0 [btrfs]
  368. [ 672.586172] [<ffffffffa03de5b3>] try_release_extent_mapping+0x153/0x180 [btrfs]
  369. [ 672.586198] [<ffffffffa03c1f6b>] __btrfs_releasepage+0x3b/0x70 [btrfs]
  370. [ 672.586222] [<ffffffffa03c1fc8>] btrfs_releasepage+0x28/0x30 [btrfs]
  371. [ 672.586230] [<ffffffff810f3f32>] try_to_release_page+0x32/0x50
  372. [ 672.586238] [<ffffffff8110129c>] shrink_page_list+0x45c/0x4e0
  373. [ 672.586247] [<ffffffff81101b94>] shrink_inactive_list+0x264/0x680
  374. [ 672.586274] [<ffffffffa03cd18d>] ? btrfs_drop_extent_cache+0x2bd/0x2f0 [btrfs]
  375. [ 672.586299] [<ffffffffa03c38c1>] ? btrfs_destroy_inode+0x121/0x210 [btrfs]
  376. [ 672.586308] [<ffffffff81102006>] shrink_list+0x56/0xa0
  377. [ 672.586315] [<ffffffff81102158>] shrink_zone+0x108/0x110
  378. [ 672.586323] [<ffffffff81102893>] balance_pgdat+0x493/0x530
  379. [ 672.586332] [<ffffffff81102a34>] kswapd+0x104/0x200
  380. [ 672.586339] [<ffffffff8107ea10>] ? autoremove_wake_function+0x0/0x40
  381. [ 672.586347] [<ffffffff81102930>] ? kswapd+0x0/0x200
  382. [ 672.586356] [<ffffffff8107e616>] kthread+0x96/0xa0
  383. [ 672.586363] [<ffffffff8100be64>] kernel_thread_helper+0x4/0x10
  384. [ 672.586371] [<ffffffff8107e580>] ? kthread+0x0/0xa0
  385. [ 672.586378] [<ffffffff8100be60>] ? kernel_thread_helper+0x0/0x10
  386. [ 672.586382] Mem-Info:
  387. [ 672.586386] Node 0 DMA per-cpu:
  388. [ 672.586391] CPU 0: hi: 0, btch: 1 usd: 0
  389. [ 672.586396] CPU 1: hi: 0, btch: 1 usd: 0
  390. [ 672.586400] Node 0 DMA32 per-cpu:
  391. [ 672.586405] CPU 0: hi: 186, btch: 31 usd: 195
  392. [ 672.586410] CPU 1: hi: 186, btch: 31 usd: 108
  393. [ 672.586421] active_anon:8404 inactive_anon:20256 isolated_anon:0
  394. [ 672.586423] active_file:46664 inactive_file:157040 isolated_file:64
  395. [ 672.586425] unevictable:672 dirty:623 writeback:0 unstable:0
  396. [ 672.586428] free:1345 slab_reclaimable:3124 slab_unreclaimable:4326
  397. [ 672.586430] mapped:1588 shmem:61 pagetables:425 bounce:0
  398. [ 672.586435] Node 0 DMA free:3932kB min:60kB low:72kB high:88kB active_anon:0kB inactive_anon:0kB active_file:20kB inactive_file:11900kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15704kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:20kB slab_unreclaimable:20kB kernel_stack:8kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
  399. [ 672.586457] lowmem_reserve[]: 0 977 977 977
  400. [ 672.586466] Node 0 DMA32 free:1448kB min:3968kB low:4960kB high:5952kB active_anon:33616kB inactive_anon:81024kB active_file:186636kB inactive_file:616260kB unevictable:2688kB isolated(anon):0kB isolated(file):256kB present:1000972kB mlocked:2688kB dirty:2492kB writeback:0kB mapped:6352kB shmem:244kB slab_reclaimable:12476kB slab_unreclaimable:17284kB kernel_stack:1184kB pagetables:1700kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:64 all_unreclaimable? no
  401. [ 672.586491] lowmem_reserve[]: 0 0 0 0
  402. [ 672.586499] Node 0 DMA: 1*4kB 1*8kB 3*16kB 5*32kB 4*64kB 3*128kB 2*256kB 1*512kB 0*1024kB 1*2048kB 0*4096kB = 3932kB
  403. [ 672.586522] Node 0 DMA32: 190*4kB 4*8kB 3*16kB 1*32kB 1*64kB 0*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 1448kB
  404. [ 672.586545] 204286 total pagecache pages
  405. [ 672.586549] 0 pages in swap cache
  406. [ 672.586553] Swap cache stats: add 0, delete 0, find 0/0
  407. [ 672.586557] Free swap = 5253216kB
  408. [ 672.586560] Total swap = 5253216kB
  409. [ 672.595165] 257792 pages RAM
  410. [ 672.595165] 6209 pages reserved
  411. [ 672.595165] 209357 pages shared
  412. [ 672.595165] 47693 pages non-shared
  413. [ 672.595165] SLUB: Unable to allocate memory on node -1 (gfp=0x20)
  414. [ 672.595165] cache: kmalloc-4096, object size: 4096, buffer size: 4096, default order: 3, min order: 0
  415. [ 672.595165] node 0: slabs: 524, objs: 2043, free: 0
  416. [ 798.345582] __alloc_pages_slowpath: 38 callbacks suppressed
  417. [ 798.345592] cosd: page allocation failure. order:0, mode:0x4020
  418. [ 798.345601] Pid: 1520, comm: cosd Not tainted 2.6.35-020635rc1-generic #020635rc1
  419. [ 798.345606] Call Trace:
  420. [ 798.345611] <IRQ> [<ffffffff810fa946>] __alloc_pages_slowpath+0x416/0x550
  421. [ 798.345638] [<ffffffff810fac0d>] __alloc_pages_nodemask+0x18d/0x1d0
  422. [ 798.345648] [<ffffffff81129243>] alloc_pages_current+0xa3/0x110
  423. [ 798.345658] [<ffffffff811311e5>] allocate_slab+0x175/0x180
  424. [ 798.345666] [<ffffffff81131220>] new_slab+0x30/0x190
  425. [ 798.345674] [<ffffffff811333d7>] __slab_alloc+0x1d7/0x240
  426. [ 798.345685] [<ffffffff814579ad>] ? dev_alloc_skb+0x1d/0x40
  427. [ 798.345692] [<ffffffff81133cb9>] __kmalloc_node_track_caller+0x199/0x1f0
  428. [ 798.345701] [<ffffffff814579ad>] ? dev_alloc_skb+0x1d/0x40
  429. [ 798.345709] [<ffffffff8145783f>] __alloc_skb+0x7f/0x170
  430. [ 798.345718] [<ffffffff814579ad>] dev_alloc_skb+0x1d/0x40
  431. [ 798.345743] [<ffffffffa00f069b>] nv_alloc_rx_optimized+0x19b/0x270 [forcedeth]
  432. [ 798.345756] [<ffffffffa00f10d8>] nv_napi_poll+0x188/0x310 [forcedeth]
  433. [ 798.345767] [<ffffffff81464bdb>] net_rx_action+0x10b/0x200
  434. [ 798.345775] [<ffffffff814582ce>] ? __kfree_skb+0x1e/0x30
  435. [ 798.345786] [<ffffffff810673f7>] __do_softirq+0xc7/0x1e0
  436. [ 798.345797] [<ffffffff8102df2b>] ? ack_apic_level+0x7b/0x100
  437. [ 798.345805] [<ffffffff8100bf5c>] call_softirq+0x1c/0x30
  438. [ 798.345814] [<ffffffff8100d915>] do_softirq+0x65/0xa0
  439. [ 798.345822] [<ffffffff81066b9c>] irq_exit+0x7c/0x90
  440. [ 798.345830] [<ffffffff81553fc8>] do_IRQ+0x78/0xf0
  441. [ 798.345838] [<ffffffff8154ca13>] ret_from_intr+0x0/0x11
  442. [ 798.345842] <EOI> Mem-Info:
  443. [ 798.345849] Node 0 DMA per-cpu:
  444. [ 798.345856] CPU 0: hi: 0, btch: 1 usd: 0
  445. [ 798.345861] CPU 1: hi: 0, btch: 1 usd: 0
  446. [ 798.345865] Node 0 DMA32 per-cpu:
  447. [ 798.345871] CPU 0: hi: 186, btch: 31 usd: 133
  448. [ 798.345876] CPU 1: hi: 186, btch: 31 usd: 121
  449. [ 798.345887] active_anon:4685 inactive_anon:20256 isolated_anon:0
  450. [ 798.345890] active_file:39044 inactive_file:168705 isolated_file:0
  451. [ 798.345893] unevictable:672 dirty:75 writeback:0 unstable:0
  452. [ 798.345895] free:1327 slab_reclaimable:3163 slab_unreclaimable:3492
  453. [ 798.345897] mapped:1569 shmem:61 pagetables:425 bounce:0
  454. [ 798.345902] Node 0 DMA free:3920kB min:60kB low:72kB high:88kB active_anon:0kB inactive_anon:0kB active_file:16kB inactive_file:11896kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15704kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:20kB slab_unreclaimable:40kB kernel_stack:8kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
  455. [ 798.345925] lowmem_reserve[]: 0 977 977 977
  456. [ 798.345935] Node 0 DMA32 free:1388kB min:3968kB low:4960kB high:5952kB active_anon:18740kB inactive_anon:81024kB active_file:156160kB inactive_file:662924kB unevictable:2688kB isolated(anon):0kB isolated(file):0kB present:1000972kB mlocked:2688kB dirty:300kB writeback:0kB mapped:6276kB shmem:244kB slab_reclaimable:12632kB slab_unreclaimable:13928kB kernel_stack:1184kB pagetables:1700kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:64 all_unreclaimable? no
  457. [ 798.345959] lowmem_reserve[]: 0 0 0 0
  458. [ 798.345967] Node 0 DMA: 2*4kB 1*8kB 2*16kB 5*32kB 4*64kB 3*128kB 2*256kB 1*512kB 0*1024kB 1*2048kB 0*4096kB = 3920kB
  459. [ 798.345991] Node 0 DMA32: 157*4kB 1*8kB 1*16kB 1*32kB 1*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 1388kB
  460. [ 798.346014] 208276 total pagecache pages
  461. [ 798.346018] 0 pages in swap cache
  462. [ 798.346022] Swap cache stats: add 0, delete 0, find 0/0
  463. [ 798.346026] Free swap = 5253216kB
  464. [ 798.346029] Total swap = 5253216kB
  465. [ 798.350018] 257792 pages RAM
  466. [ 798.350018] 6209 pages reserved
  467. [ 798.350018] 215665 pages shared
  468. [ 798.350018] 42069 pages non-shared
  469. [ 798.350018] SLUB: Unable to allocate memory on node -1 (gfp=0x20)
  470. [ 798.350018] cache: kmalloc-4096, object size: 4096, buffer size: 4096, default order: 3, min order: 0
  471. [ 798.350018] node 0: slabs: 556, objs: 1291, free: 0
  472. [ 798.356830] cosd: page allocation failure. order:0, mode:0x4020
  473. [ 798.356838] Pid: 1520, comm: cosd Not tainted 2.6.35-020635rc1-generic #020635rc1
  474. [ 798.356842] Call Trace:
  475. [ 798.356846] <IRQ> [<ffffffff810fa946>] __alloc_pages_slowpath+0x416/0x550
  476. [ 798.356870] [<ffffffff810fac0d>] __alloc_pages_nodemask+0x18d/0x1d0
  477. [ 798.356879] [<ffffffff8154c42e>] ? _raw_spin_lock+0xe/0x20
  478. [ 798.356888] [<ffffffff814b64f4>] ? tcp_v4_rcv+0x5a4/0x820
  479. [ 798.356898] [<ffffffff81129243>] alloc_pages_current+0xa3/0x110
  480. [ 798.356909] [<ffffffff811311e5>] allocate_slab+0x175/0x180
  481. [ 798.356917] [<ffffffff81131220>] new_slab+0x30/0x190
  482. [ 798.356924] [<ffffffff811333d7>] __slab_alloc+0x1d7/0x240
  483. [ 798.356935] [<ffffffff814579ad>] ? dev_alloc_skb+0x1d/0x40
  484. [ 798.356943] [<ffffffff81133cb9>] __kmalloc_node_track_caller+0x199/0x1f0
  485. [ 798.356951] [<ffffffff814579ad>] ? dev_alloc_skb+0x1d/0x40
  486. [ 798.356960] [<ffffffff8145783f>] __alloc_skb+0x7f/0x170
  487. [ 798.356968] [<ffffffff814579ad>] dev_alloc_skb+0x1d/0x40
  488. [ 798.356991] [<ffffffffa00f069b>] nv_alloc_rx_optimized+0x19b/0x270 [forcedeth]
  489. [ 798.357003] [<ffffffffa00f10d8>] nv_napi_poll+0x188/0x310 [forcedeth]
  490. [ 798.357015] [<ffffffff81464bdb>] net_rx_action+0x10b/0x200
  491. [ 798.357023] [<ffffffff814582ce>] ? __kfree_skb+0x1e/0x30
  492. [ 798.357034] [<ffffffff810673f7>] __do_softirq+0xc7/0x1e0
  493. [ 798.357044] [<ffffffff8102df2b>] ? ack_apic_level+0x7b/0x100
  494. [ 798.357054] [<ffffffff8100bf5c>] call_softirq+0x1c/0x30
  495. [ 798.357062] [<ffffffff8100d915>] do_softirq+0x65/0xa0
  496. [ 798.357069] [<ffffffff81066b9c>] irq_exit+0x7c/0x90
  497. [ 798.357077] [<ffffffff81553fc8>] do_IRQ+0x78/0xf0
  498. [ 798.357084] [<ffffffff8154ca13>] ret_from_intr+0x0/0x11
  499. [ 798.357089] <EOI> Mem-Info:
  500. [ 798.357094] Node 0 DMA per-cpu:
  501. [ 798.357101] CPU 0: hi: 0, btch: 1 usd: 0
  502. [ 798.357106] CPU 1: hi: 0, btch: 1 usd: 0
  503. [ 798.357109] Node 0 DMA32 per-cpu:
  504. [ 798.357115] CPU 0: hi: 186, btch: 31 usd: 133
  505. [ 798.357120] CPU 1: hi: 186, btch: 31 usd: 185
  506. [ 798.357131] active_anon:4685 inactive_anon:20256 isolated_anon:0
  507. [ 798.357134] active_file:39044 inactive_file:168641 isolated_file:0
  508. [ 798.357136] unevictable:672 dirty:75 writeback:0 unstable:0
  509. [ 798.357138] free:1351 slab_reclaimable:3163 slab_unreclaimable:3468
  510. [ 798.357141] mapped:1569 shmem:61 pagetables:425 bounce:0
  511. [ 798.357145] Node 0 DMA free:3920kB min:60kB low:72kB high:88kB active_anon:0kB inactive_anon:0kB active_file:16kB inactive_file:11896kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15704kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:20kB slab_unreclaimable:40kB kernel_stack:8kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
  512. [ 798.357168] lowmem_reserve[]: 0 977 977 977
  513. [ 798.357177] Node 0 DMA32 free:1672kB min:3968kB low:4960kB high:5952kB active_anon:18740kB inactive_anon:81024kB active_file:156160kB inactive_file:662668kB unevictable:2688kB isolated(anon):0kB isolated(file):0kB present:1000972kB mlocked:2688kB dirty:300kB writeback:0kB mapped:6276kB shmem:244kB slab_reclaimable:12632kB slab_unreclaimable:13736kB kernel_stack:1184kB pagetables:1700kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
  514. [ 798.357201] lowmem_reserve[]: 0 0 0 0
  515. [ 798.357210] Node 0 DMA: 2*4kB 1*8kB 2*16kB 5*32kB 4*64kB 3*128kB 2*256kB 1*512kB 0*1024kB 1*2048kB 0*4096kB = 3920kB
  516. [ 798.357233] Node 0 DMA32: 168*4kB 3*8kB 5*16kB 6*32kB 1*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 1672kB
  517. [ 798.357257] 208201 total pagecache pages
  518. [ 798.357261] 0 pages in swap cache
  519. [ 798.357265] Swap cache stats: add 0, delete 0, find 0/0
  520. [ 798.357269] Free swap = 5253216kB
  521. [ 798.357272] Total swap = 5253216kB
  522. [ 798.366276] 257792 pages RAM
  523. [ 798.366276] 6209 pages reserved
  524. [ 798.366276] 215690 pages shared
  525. [ 798.366276] 41636 pages non-shared
  526. [ 798.366276] SLUB: Unable to allocate memory on node -1 (gfp=0x20)
  527. [ 798.366276] cache: kmalloc-4096, object size: 4096, buffer size: 4096, default order: 3, min order: 0
  528. [ 798.366276] node 0: slabs: 471, objs: 681, free: 119
  529. [ 3813.309551] device fsid 14cceef72443196-9f3b892de2661394 devid 1 transid 11567 /dev/sdb2
  530. [ 3813.418275] device fsid 14cceef72443196-9f3b892de2661394 devid 1 transid 11567 /dev/sdb2
  531. [18054.033766] device fsid 14cceef72443196-9f3b892de2661394 devid 1 transid 11619 /dev/sdb2
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!