View difference between Paste ID: YDuDxXBq and 6VSakLdM
SHOW: | | - or go back to the newest paste.
1-
Jul 30 07:08:08 wowdb kernel: 0kB isolated(file):0kB present:7514400kB mlocked:0kB dirty:84kB writeback:0kB mapped:724kB shmem:8kB slab_reclaimable:8652kB slab_unreclaimable:10988kB kernel_stack:1256kB pagetables:11880kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:416 all_unreclaimable? yes
1+
Jul 30 07:08:08 dbserver kernel: 0kB isolated(file):0kB present:7514400kB mlocked:0kB dirty:84kB writeback:0kB mapped:724kB shmem:8kB slab_reclaimable:8652kB slab_unreclaimable:10988kB kernel_stack:1256kB pagetables:11880kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:416 all_unreclaimable? yes
2-
Jul 30 07:08:08 wowdb kernel: [40888.797019] lowmem_reserve[]: 0 0 0 0
2+
Jul 30 07:08:08 dbserver kernel: [40888.797019] lowmem_reserve[]: 0 0 0 0
3-
Jul 30 07:08:08 wowdb kernel: [40888.797021] Node 0 DMA: 2*4kB 1*8kB 2*16kB 1*32kB 2*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15824kB
3+
Jul 30 07:08:08 dbserver kernel: [40888.797021] Node 0 DMA: 2*4kB 1*8kB 2*16kB 1*32kB 2*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15824kB
4-
Jul 30 07:08:08 wowdb kernel: [40888.797026] Node 0 DMA32: 15*4kB 24*8kB 7*16kB 4*32kB 0*64kB 2*128kB 0*256kB 1*512kB 3*1024kB 2*2048kB 6*4096kB = 33004kB
4+
Jul 30 07:08:08 dbserver kernel: [40888.797026] Node 0 DMA32: 15*4kB 24*8kB 7*16kB 4*32kB 0*64kB 2*128kB 0*256kB 1*512kB 3*1024kB 2*2048kB 6*4096kB = 33004kB
5-
Jul 30 07:08:08 wowdb kernel: [40888.797031] Node 0 Normal: 176*4kB 24*8kB 89*16kB 29*32kB 8*64kB 7*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 1*4096kB = 9008kB
5+
Jul 30 07:08:08 dbserver kernel: [40888.797031] Node 0 Normal: 176*4kB 24*8kB 89*16kB 29*32kB 8*64kB 7*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 1*4096kB = 9008kB
6-
Jul 30 07:08:08 wowdb kernel: [40888.797035] 85036 total pagecache pages
6+
Jul 30 07:08:08 dbserver kernel: [40888.797035] 85036 total pagecache pages
7-
Jul 30 07:08:08 wowdb kernel: [40888.797036] 83905 pages in swap cache
7+
Jul 30 07:08:08 dbserver kernel: [40888.797036] 83905 pages in swap cache
8-
Jul 30 07:08:08 wowdb kernel: [40888.797038] Swap cache stats: add 166633, delete 82728, find 3836/5944
8+
Jul 30 07:08:08 dbserver kernel: [40888.797038] Swap cache stats: add 166633, delete 82728, find 3836/5944
9-
Jul 30 07:08:08 wowdb kernel: [40888.797038] Free swap  = 0kB
9+
Jul 30 07:08:08 dbserver kernel: [40888.797038] Free swap  = 0kB
10-
Jul 30 07:08:08 wowdb kernel: [40888.797039] Total swap = 577532kB
10+
Jul 30 07:08:08 dbserver kernel: [40888.797039] Total swap = 577532kB
11-
Jul 30 07:08:08 wowdb kernel: [40888.812903] 2691056 pages RAM
11+
Jul 30 07:08:08 dbserver kernel: [40888.812903] 2691056 pages RAM
12-
Jul 30 07:08:08 wowdb kernel: [40888.812905] 56870 pages reserved
12+
Jul 30 07:08:08 dbserver kernel: [40888.812905] 56870 pages reserved
13-
Jul 30 07:08:08 wowdb kernel: [40888.812905] 293 pages shared
13+
Jul 30 07:08:08 dbserver kernel: [40888.812905] 293 pages shared
14-
Jul 30 07:08:08 wowdb kernel: [40888.812906] 2618608 pages non-shared
14+
Jul 30 07:08:08 dbserver kernel: [40888.812906] 2618608 pages non-shared
15-
Jul 30 07:08:08 wowdb kernel: [40888.812908] Out of memory: kill process 7602 (mysqld) score 110721 or a child
15+
Jul 30 07:08:08 dbserver kernel: [40888.812908] Out of memory: kill process 7602 (mysqld) score 110721 or a child
16-
Jul 30 07:08:08 wowdb kernel: [40888.812973] Killed process 7602 (mysqld) vsz:6200404kB, anon-rss:4732512kB, file-rss:0kB
16+
Jul 30 07:08:08 dbserver kernel: [40888.812973] Killed process 7602 (mysqld) vsz:6200404kB, anon-rss:4732512kB, file-rss:0kB
17-
Jul 30 07:08:08 wowdb kernel: [40888.817148] mysqld invoked oom-killer: gfp_mask=0x200da, order=0, oom_adj=0
17+
Jul 30 07:08:08 dbserver kernel: [40888.817148] mysqld invoked oom-killer: gfp_mask=0x200da, order=0, oom_adj=0
18-
Jul 30 07:08:08 wowdb kernel: [40888.817151] mysqld cpuset=/ mems_allowed=0
18+
Jul 30 07:08:08 dbserver kernel: [40888.817151] mysqld cpuset=/ mems_allowed=0
19-
Jul 30 07:08:08 wowdb kernel: [40888.817152] Pid: 7604, comm: mysqld Not tainted 2.6.35-22-generic #35-Ubuntu
19+
Jul 30 07:08:08 dbserver kernel: [40888.817152] Pid: 7604, comm: mysqld Not tainted 2.6.35-22-generic #35-Ubuntu
20-
Jul 30 07:08:08 wowdb kernel: [40888.817154] Call Trace:
20+
Jul 30 07:08:08 dbserver kernel: [40888.817154] Call Trace:
21-
Jul 30 07:08:08 wowdb kernel: [40888.817159]  [<ffffffff810aeddd>] ? cpuset_print_task_mems_allowed+0x9d/0xb0
21+
Jul 30 07:08:08 dbserver kernel: [40888.817159]  [<ffffffff810aeddd>] ? cpuset_print_task_mems_allowed+0x9d/0xb0
22-
Jul 30 07:08:08 wowdb kernel: [40888.817164]  [<ffffffff81104291>] dump_header+0x81/0xc0
22+
Jul 30 07:08:08 dbserver kernel: [40888.817164]  [<ffffffff81104291>] dump_header+0x81/0xc0
23-
Jul 30 07:08:08 wowdb kernel: [40888.817166]  [<ffffffff81104351>] oom_kill_process+0x81/0x180
23+
Jul 30 07:08:08 dbserver kernel: [40888.817166]  [<ffffffff81104351>] oom_kill_process+0x81/0x180
24-
Jul 30 07:08:08 wowdb kernel: [40888.817168]  [<ffffffff81104888>] __out_of_memory+0x58/0xd0
24+
Jul 30 07:08:08 dbserver kernel: [40888.817168]  [<ffffffff81104888>] __out_of_memory+0x58/0xd0
25-
Jul 30 07:08:08 wowdb kernel: [40888.817169]  [<ffffffff81104986>] out_of_memory+0x86/0x1c0
25+
Jul 30 07:08:08 dbserver kernel: [40888.817169]  [<ffffffff81104986>] out_of_memory+0x86/0x1c0
26-
Jul 30 07:08:08 wowdb kernel: [40888.817172]  [<ffffffff811081f6>] __alloc_pages_slowpath+0x526/0x590
26+
Jul 30 07:08:08 dbserver kernel: [40888.817172]  [<ffffffff811081f6>] __alloc_pages_slowpath+0x526/0x590
27-
Jul 30 07:08:08 wowdb kernel: [40888.817174]  [<ffffffff811083fa>] __alloc_pages_nodemask+0x19a/0x1f0
27+
Jul 30 07:08:08 dbserver kernel: [40888.817174]  [<ffffffff811083fa>] __alloc_pages_nodemask+0x19a/0x1f0
28-
Jul 30 07:08:08 wowdb kernel: [40888.817176]  [<ffffffff8113b429>] alloc_page_vma+0x89/0x140
28+
Jul 30 07:08:08 dbserver kernel: [40888.817176]  [<ffffffff8113b429>] alloc_page_vma+0x89/0x140
29-
Jul 30 07:08:08 wowdb kernel: [40888.817179]  [<ffffffff8112efae>] read_swap_cache_async+0xde/0x130
29+
Jul 30 07:08:08 dbserver kernel: [40888.817179]  [<ffffffff8112efae>] read_swap_cache_async+0xde/0x130
30-
Jul 30 07:08:08 wowdb kernel: [40888.817181]  [<ffffffff8112f901>] ? valid_swaphandles+0x141/0x170
30+
Jul 30 07:08:08 dbserver kernel: [40888.817181]  [<ffffffff8112f901>] ? valid_swaphandles+0x141/0x170
31-
Jul 30 07:08:08 wowdb kernel: [40888.817183]  [<ffffffff8112f087>] swapin_readahead+0x87/0xc0
31+
Jul 30 07:08:08 dbserver kernel: [40888.817183]  [<ffffffff8112f087>] swapin_readahead+0x87/0xc0
32-
Jul 30 07:08:08 wowdb kernel: [40888.817185]  [<ffffffff81120425>] do_swap_page+0x115/0x5a0
32+
Jul 30 07:08:08 dbserver kernel: [40888.817185]  [<ffffffff81120425>] do_swap_page+0x115/0x5a0
33-
Jul 30 07:08:08 wowdb kernel: [40888.817188]  [<ffffffff8114c561>] ? __mem_cgroup_try_charge+0x71/0x450
33+
Jul 30 07:08:08 dbserver kernel: [40888.817188]  [<ffffffff8114c561>] ? __mem_cgroup_try_charge+0x71/0x450
34-
Jul 30 07:08:08 wowdb kernel: [40888.817191]  [<ffffffff81120b8b>] handle_mm_fault+0x2db/0x440
34+
Jul 30 07:08:08 dbserver kernel: [40888.817191]  [<ffffffff81120b8b>] handle_mm_fault+0x2db/0x440
35-
Jul 30 07:08:08 wowdb kernel: [40888.817194]  [<ffffffff81050ae7>] ? find_busiest_group+0x757/0xa00
35+
Jul 30 07:08:08 dbserver kernel: [40888.817194]  [<ffffffff81050ae7>] ? find_busiest_group+0x757/0xa00
36-
Jul 30 07:08:08 wowdb kernel: [40888.817197]  [<ffffffff8158cefa>] do_page_fault+0x12a/0x350
36+
Jul 30 07:08:08 dbserver kernel: [40888.817197]  [<ffffffff8158cefa>] do_page_fault+0x12a/0x350
37-
Jul 30 07:08:08 wowdb kernel: [40888.817199]  [<ffffffff81589a75>] page_fault+0x25/0x30
37+
Jul 30 07:08:08 dbserver kernel: [40888.817199]  [<ffffffff81589a75>] page_fault+0x25/0x30
38-
Jul 30 07:08:08 wowdb kernel: [40888.817202]  [<ffffffff812c1a5c>] ? __get_user_8+0x1c/0x23
38+
Jul 30 07:08:08 dbserver kernel: [40888.817202]  [<ffffffff812c1a5c>] ? __get_user_8+0x1c/0x23
39-
Jul 30 07:08:08 wowdb kernel: [40888.817205]  [<ffffffff810918fd>] ? exit_robust_list+0x5d/0x160
39+
Jul 30 07:08:08 dbserver kernel: [40888.817205]  [<ffffffff810918fd>] ? exit_robust_list+0x5d/0x160
40-
Jul 30 07:08:08 wowdb kernel: [40888.817208]  [<ffffffff81036dd9>] ? default_spin_lock_flags+0x9/0x10
40+
Jul 30 07:08:08 dbserver kernel: [40888.817208]  [<ffffffff81036dd9>] ? default_spin_lock_flags+0x9/0x10
41-
Jul 30 07:08:08 wowdb kernel: [40888.817211]  [<ffffffff8105e413>] mm_release+0x113/0x130
41+
Jul 30 07:08:08 dbserver kernel: [40888.817211]  [<ffffffff8105e413>] mm_release+0x113/0x130
42-
Jul 30 07:08:08 wowdb kernel: [40888.817213]  [<ffffffff81064de6>] exit_mm+0x26/0x140
42+
Jul 30 07:08:08 dbserver kernel: [40888.817213]  [<ffffffff81064de6>] exit_mm+0x26/0x140
43-
Jul 30 07:08:08 wowdb kernel: [40888.817215]  [<ffffffff810d2a4d>] ? taskstats_exit+0x19d/0x260
43+
Jul 30 07:08:08 dbserver kernel: [40888.817215]  [<ffffffff810d2a4d>] ? taskstats_exit+0x19d/0x260
44-
Jul 30 07:08:08 wowdb kernel: [40888.817217]  [<ffffffff810a3470>] ? acct_collect+0x160/0x1b0
44+
Jul 30 07:08:08 dbserver kernel: [40888.817217]  [<ffffffff810a3470>] ? acct_collect+0x160/0x1b0
45-
Jul 30 07:08:08 wowdb kernel: [40888.817219]  [<ffffffff81065151>] do_exit+0x141/0x3f0
45+
Jul 30 07:08:08 dbserver kernel: [40888.817219]  [<ffffffff81065151>] do_exit+0x141/0x3f0
46-
Jul 30 07:08:08 wowdb kernel: [40888.817222]  [<ffffffff810700bc>] ? lock_timer_base+0x3c/0x70
46+
Jul 30 07:08:08 dbserver kernel: [40888.817222]  [<ffffffff810700bc>] ? lock_timer_base+0x3c/0x70
47-
Jul 30 07:08:08 wowdb kernel: [40888.817224]  [<ffffffff81065455>] do_group_exit+0x55/0xd0
47+
Jul 30 07:08:08 dbserver kernel: [40888.817224]  [<ffffffff81065455>] do_group_exit+0x55/0xd0
48-
Jul 30 07:08:08 wowdb kernel: [40888.817226]  [<ffffffff81076341>] get_signal_to_deliver+0x201/0x440
48+
Jul 30 07:08:08 dbserver kernel: [40888.817226]  [<ffffffff81076341>] get_signal_to_deliver+0x201/0x440
49-
Jul 30 07:08:08 wowdb kernel: [40888.817229]  [<ffffffff81009989>] do_signal+0x69/0x1a0
49+
Jul 30 07:08:08 dbserver kernel: [40888.817229]  [<ffffffff81009989>] do_signal+0x69/0x1a0
50-
Jul 30 07:08:08 wowdb kernel: [40888.817232]  [<ffffffff8118fe20>] ? timeout_func+0x0/0x20
50+
Jul 30 07:08:08 dbserver kernel: [40888.817232]  [<ffffffff8118fe20>] ? timeout_func+0x0/0x20
51-
Jul 30 07:08:08 wowdb kernel: [40888.817234]  [<ffffffff81009b25>] do_notify_resume+0x65/0x90
51+
Jul 30 07:08:08 dbserver kernel: [40888.817234]  [<ffffffff81009b25>] do_notify_resume+0x65/0x90
52-
Jul 30 07:08:08 wowdb kernel: [40888.817236]  [<ffffffff8100a3c0>] int_signal+0x12/0x17
52+
Jul 30 07:08:08 dbserver kernel: [40888.817236]  [<ffffffff8100a3c0>] int_signal+0x12/0x17
53-
Jul 30 07:08:08 wowdb kernel: [40888.817237] Mem-Info:
53+
Jul 30 07:08:08 dbserver kernel: [40888.817237] Mem-Info:
54-
Jul 30 07:08:08 wowdb kernel: [40888.817238] Node 0 DMA per-cpu:
54+
Jul 30 07:08:08 dbserver kernel: [40888.817238] Node 0 DMA per-cpu:
55-
Jul 30 07:08:08 wowdb kernel: [40888.817240] CPU    0: hi:    0, btch:   1 usd:   0
55+
Jul 30 07:08:08 dbserver kernel: [40888.817240] CPU    0: hi:    0, btch:   1 usd:   0
56-
Jul 30 07:08:08 wowdb kernel: [40888.817241] CPU    1: hi:    0, btch:   1 usd:   0
56+
Jul 30 07:08:08 dbserver kernel: [40888.817241] CPU    1: hi:    0, btch:   1 usd:   0
57-
Jul 30 07:08:08 wowdb kernel: [40888.817242] CPU    2: hi:    0, btch:   1 usd:   0
57+
Jul 30 07:08:08 dbserver kernel: [40888.817242] CPU    2: hi:    0, btch:   1 usd:   0
58-
Jul 30 07:08:08 wowdb kernel: [40888.817243] CPU    3: hi:    0, btch:   1 usd:   0
58+
Jul 30 07:08:08 dbserver kernel: [40888.817243] CPU    3: hi:    0, btch:   1 usd:   0
59-
Jul 30 07:08:08 wowdb kernel: [40888.817244] Node 0 DMA32 per-cpu:
59+
Jul 30 07:08:08 dbserver kernel: [40888.817244] Node 0 DMA32 per-cpu:
60-
Jul 30 07:08:08 wowdb kernel: [40888.817245] CPU    0: hi:  186, btch:  31 usd:  30
60+
Jul 30 07:08:08 dbserver kernel: [40888.817245] CPU    0: hi:  186, btch:  31 usd:  30
61-
Jul 30 07:08:08 wowdb kernel: [40888.817246] CPU    1: hi:  186, btch:  31 usd:  91
61+
Jul 30 07:08:08 dbserver kernel: [40888.817246] CPU    1: hi:  186, btch:  31 usd:  91
62-
Jul 30 07:08:08 wowdb kernel: [40888.817247] CPU    2: hi:  186, btch:  31 usd:  77
62+
Jul 30 07:08:08 dbserver kernel: [40888.817247] CPU    2: hi:  186, btch:  31 usd:  77
63-
Jul 30 07:08:08 wowdb kernel: [40888.817249] CPU    3: hi:  186, btch:  31 usd: 178
63+
Jul 30 07:08:08 dbserver kernel: [40888.817249] CPU    3: hi:  186, btch:  31 usd: 178
64-
Jul 30 07:08:08 wowdb kernel: [40888.817249] Node 0 Normal per-cpu:
64+
Jul 30 07:08:08 dbserver kernel: [40888.817249] Node 0 Normal per-cpu:
65-
Jul 30 07:08:08 wowdb kernel: [40888.817251] CPU    0: hi:  186, btch:  31 usd:  36
65+
Jul 30 07:08:08 dbserver kernel: [40888.817251] CPU    0: hi:  186, btch:  31 usd:  36
66-
Jul 30 07:08:08 wowdb kernel: [40888.817252] CPU    1: hi:  186, btch:  31 usd:   8
66+
Jul 30 07:08:08 dbserver kernel: [40888.817252] CPU    1: hi:  186, btch:  31 usd:   8
67-
Jul 30 07:08:08 wowdb kernel: [40888.817253] CPU    2: hi:  186, btch:  31 usd:  78
67+
Jul 30 07:08:08 dbserver kernel: [40888.817253] CPU    2: hi:  186, btch:  31 usd:  78
68-
Jul 30 07:08:08 wowdb kernel: [40888.817254] CPU    3: hi:  186, btch:  31 usd: 165
68+
Jul 30 07:08:08 dbserver kernel: [40888.817254] CPU    3: hi:  186, btch:  31 usd: 165
69-
Jul 30 07:08:08 wowdb kernel: [40888.817256] active_anon:1118901 inactive_anon:148659 isolated_anon:0
69+
Jul 30 07:08:08 dbserver kernel: [40888.817256] active_anon:1118901 inactive_anon:148659 isolated_anon:0
70-
Jul 30 07:08:08 wowdb kernel: [40888.817257]  active_file:43 inactive_file:1138 isolated_file:0
70+
Jul 30 07:08:08 dbserver kernel: [40888.817257]  active_file:43 inactive_file:1138 isolated_file:0
71-
Jul 30 07:08:08 wowdb kernel: [40888.817257]  unevictable:0 dirty:21 writeback:0 unstable:0
71+
Jul 30 07:08:08 dbserver kernel: [40888.817257]  unevictable:0 dirty:21 writeback:0 unstable:0
72-
Jul 30 07:08:08 wowdb kernel: [40888.817258]  free:14490 slab_reclaimable:2163 slab_unreclaimable:2752
72+
Jul 30 07:08:08 dbserver kernel: [40888.817258]  free:14490 slab_reclaimable:2163 slab_unreclaimable:2752
73-
Jul 30 07:08:08 wowdb kernel: [40888.817258]  mapped:211 shmem:2 pagetables:3138 bounce:0
73+
Jul 30 07:08:08 dbserver kernel: [40888.817258]  mapped:211 shmem:2 pagetables:3138 bounce:0
74-
Jul 30 07:08:08 wowdb kernel: [40888.817260] Node 0 DMA free:15824kB min:16kB low:20kB high:24kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15708kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:8kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
74+
Jul 30 07:08:08 dbserver kernel: [40888.817260] Node 0 DMA free:15824kB min:16kB low:20kB high:24kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15708kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:8kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
75-
Jul 30 07:08:08 wowdb kernel: [40888.817265] lowmem_reserve[]: 0 3000 10338 10338
75+
Jul 30 07:08:08 dbserver kernel: [40888.817265] lowmem_reserve[]: 0 3000 10338 10338
76-
Jul 30 07:08:08 wowdb kernel: [40888.817267] Node 0 DMA32 free:33004kB min:3772kB low:4712kB high:5656kB active_anon:255152kB inactive_anon:67028kB active_file:88kB inactive_file:16kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3072096kB mlocked:0kB dirty:0kB writeback:0kB mapped:120kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:12kB kernel_stack:0kB pagetables:672kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:156 all_unreclaimable? yes
76+
Jul 30 07:08:08 dbserver kernel: [40888.817267] Node 0 DMA32 free:33004kB min:3772kB low:4712kB high:5656kB active_anon:255152kB inactive_anon:67028kB active_file:88kB inactive_file:16kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3072096kB mlocked:0kB dirty:0kB writeback:0kB mapped:120kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:12kB kernel_stack:0kB pagetables:672kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:156 all_unreclaimable? yes
77-
Jul 30 07:08:08 wowdb kernel: [40888.817272] lowmem_reserve[]: 0 0 7338 7338
77+
Jul 30 07:08:08 dbserver kernel: [40888.817272] lowmem_reserve[]: 0 0 7338 7338
78-
Jul 30 07:08:08 wowdb kernel: [40888.817274] Node 0 Normal free:9132kB min:9228kB low:11532kB high:13840kB active_anon:4220452kB inactive_anon:527608kB active_file:84kB inactive_file:4536kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:7514400kB mlocked:0kB dirty:84kB writeback:0kB mapped:724kB shmem:8kB slab_reclaimable:8652kB slab_unreclaimable:10988kB kernel_stack:1256kB pagetables:11880kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:576 all_unreclaimable? yes
78+
Jul 30 07:08:08 dbserver kernel: [40888.817274] Node 0 Normal free:9132kB min:9228kB low:11532kB high:13840kB active_anon:4220452kB inactive_anon:527608kB active_file:84kB inactive_file:4536kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:7514400kB mlocked:0kB dirty:84kB writeback:0kB mapped:724kB shmem:8kB slab_reclaimable:8652kB slab_unreclaimable:10988kB kernel_stack:1256kB pagetables:11880kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:576 all_unreclaimable? yes
79-
Jul 30 07:08:08 wowdb kernel: [40888.817279] lowmem_reserve[]: 0 0 0 0
79+
Jul 30 07:08:08 dbserver kernel: [40888.817279] lowmem_reserve[]: 0 0 0 0
80-
Jul 30 07:08:08 wowdb kernel: [40888.817281] Node 0 DMA: 2*4kB 1*8kB 2*16kB 1*32kB 2*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15824kB
80+
Jul 30 07:08:08 dbserver kernel: [40888.817281] Node 0 DMA: 2*4kB 1*8kB 2*16kB 1*32kB 2*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15824kB
81-
Jul 30 07:08:08 wowdb kernel: [40888.817286] Node 0 DMA32: 15*4kB 24*8kB 7*16kB 4*32kB 0*64kB 2*128kB 0*256kB 1*512kB 3*1024kB 2*2048kB 6*4096kB = 33004kB
81+
Jul 30 07:08:08 dbserver kernel: [40888.817286] Node 0 DMA32: 15*4kB 24*8kB 7*16kB 4*32kB 0*64kB 2*128kB 0*256kB 1*512kB 3*1024kB 2*2048kB 6*4096kB = 33004kB
82-
Jul 30 07:08:08 wowdb kernel: [40888.817294] Node 0 Normal: 176*4kB 24*8kB 89*16kB 29*32kB 8*64kB 7*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 1*4096kB = 9008kB
82+
Jul 30 07:08:08 dbserver kernel: [40888.817294] Node 0 Normal: 176*4kB 24*8kB 89*16kB 29*32kB 8*64kB 7*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 1*4096kB = 9008kB
83-
Jul 30 07:08:08 wowdb kernel: [40888.817301] 85036 total pagecache pages
83+
Jul 30 07:08:08 dbserver kernel: [40888.817301] 85036 total pagecache pages
84-
Jul 30 07:08:08 wowdb kernel: [40888.817302] 83899 pages in swap cache
84+
Jul 30 07:08:08 dbserver kernel: [40888.817302] 83899 pages in swap cache
85-
Jul 30 07:08:08 wowdb kernel: [40888.817304] Swap cache stats: add 166635, delete 82736, find 3838/5952
85+
Jul 30 07:08:08 dbserver kernel: [40888.817304] Swap cache stats: add 166635, delete 82736, find 3838/5952
86-
Jul 30 07:08:08 wowdb kernel: [40888.817306] Free swap  = 0kB
86+
Jul 30 07:08:08 dbserver kernel: [40888.817306] Free swap  = 0kB
87-
Jul 30 07:08:08 wowdb kernel: [40888.817307] Total swap = 577532kB
87+
Jul 30 07:08:08 dbserver kernel: [40888.817307] Total swap = 577532kB
88-
Jul 30 07:08:08 wowdb kernel: [40888.831310] 2691056 pages RAM
88+
Jul 30 07:08:08 dbserver kernel: [40888.831310] 2691056 pages RAM
89-
Jul 30 07:08:08 wowdb kernel: [40888.831313] 56870 pages reserved
89+
Jul 30 07:08:08 dbserver kernel: [40888.831313] 56870 pages reserved
90-
Jul 30 07:08:08 wowdb kernel: [40888.831314] 293 pages shared
90+
Jul 30 07:08:08 dbserver kernel: [40888.831314] 293 pages shared
91-
Jul 30 07:08:08 wowdb kernel: [40888.831315] 2618602 pages non-shared
91+
Jul 30 07:08:08 dbserver kernel: [40888.831315] 2618602 pages non-shared
92-
Jul 30 07:08:08 wowdb kernel: [40888.831318] Out of memory: kill process 749 (rsyslogd) score 15750 or a child
92+
Jul 30 07:08:08 dbserver kernel: [40888.831318] Out of memory: kill process 749 (rsyslogd) score 15750 or a child
93-
Jul 30 07:08:08 wowdb kernel: [40888.831375] Killed process 749 (rsyslogd) vsz:126004kB, anon-rss:72kB, file-rss:0kB
93+
Jul 30 07:08:08 dbserver kernel: [40888.831375] Killed process 749 (rsyslogd) vsz:126004kB, anon-rss:72kB, file-rss:0kB
94-
Jul 30 07:08:08 wowdb kernel: [40888.836877] mysqld invoked oom-killer: gfp_mask=0x200da, order=0, oom_adj=0
94+
Jul 30 07:08:08 dbserver kernel: [40888.836877] mysqld invoked oom-killer: gfp_mask=0x200da, order=0, oom_adj=0
95-
Jul 30 07:08:08 wowdb kernel: [40888.836879] mysqld cpuset=/ mems_allowed=0
95+
Jul 30 07:08:08 dbserver kernel: [40888.836879] mysqld cpuset=/ mems_allowed=0
96-
Jul 30 07:08:08 wowdb kernel: [40888.836881] Pid: 7604, comm: mysqld Not tainted 2.6.35-22-generic #35-Ubuntu
96+
Jul 30 07:08:08 dbserver kernel: [40888.836881] Pid: 7604, comm: mysqld Not tainted 2.6.35-22-generic #35-Ubuntu
97-
Jul 30 07:08:08 wowdb kernel: [40888.836882] Call Trace:
97+
Jul 30 07:08:08 dbserver kernel: [40888.836882] Call Trace:
98-
Jul 30 07:08:08 wowdb kernel: [40888.836888]  [<ffffffff810aeddd>] ? cpuset_print_task_mems_allowed+0x9d/0xb0
98+
Jul 30 07:08:08 dbserver kernel: [40888.836888]  [<ffffffff810aeddd>] ? cpuset_print_task_mems_allowed+0x9d/0xb0
99-
Jul 30 07:08:08 wowdb kernel: [40888.836891]  [<ffffffff81104291>] dump_header+0x81/0xc0
99+
Jul 30 07:08:08 dbserver kernel: [40888.836891]  [<ffffffff81104291>] dump_header+0x81/0xc0
100-
Jul 30 07:08:08 wowdb kernel: [40888.836893]  [<ffffffff81104351>] oom_kill_process+0x81/0x180
100+
Jul 30 07:08:08 dbserver kernel: [40888.836893]  [<ffffffff81104351>] oom_kill_process+0x81/0x180
101-
Jul 30 07:08:08 wowdb kernel: [40888.836894]  [<ffffffff81104888>] __out_of_memory+0x58/0xd0
101+
Jul 30 07:08:08 dbserver kernel: [40888.836894]  [<ffffffff81104888>] __out_of_memory+0x58/0xd0
102-
Jul 30 07:08:08 wowdb kernel: [40888.836896]  [<ffffffff81104986>] out_of_memory+0x86/0x1c0
102+
Jul 30 07:08:08 dbserver kernel: [40888.836896]  [<ffffffff81104986>] out_of_memory+0x86/0x1c0
103-
Jul 30 07:08:08 wowdb kernel: [40888.836899]  [<ffffffff811081f6>] __alloc_pages_slowpath+0x526/0x590
103+
Jul 30 07:08:08 dbserver kernel: [40888.836899]  [<ffffffff811081f6>] __alloc_pages_slowpath+0x526/0x590
104-
Jul 30 07:08:08 wowdb kernel: [40888.836902]  [<ffffffff811083fa>] __alloc_pages_nodemask+0x19a/0x1f0
104+
Jul 30 07:08:08 dbserver kernel: [40888.836902]  [<ffffffff811083fa>] __alloc_pages_nodemask+0x19a/0x1f0
105-
Jul 30 07:08:08 wowdb kernel: [40888.836906]  [<ffffffff8113b429>] alloc_page_vma+0x89/0x140
105+
Jul 30 07:08:08 dbserver kernel: [40888.836906]  [<ffffffff8113b429>] alloc_page_vma+0x89/0x140
106-
Jul 30 07:08:08 wowdb kernel: [40888.836910]  [<ffffffff8112efae>] read_swap_cache_async+0xde/0x130
106+
Jul 30 07:08:08 dbserver kernel: [40888.836910]  [<ffffffff8112efae>] read_swap_cache_async+0xde/0x130
107-
Jul 30 07:08:08 wowdb kernel: [40888.836913]  [<ffffffff8112f901>] ? valid_swaphandles+0x141/0x170
107+
Jul 30 07:08:08 dbserver kernel: [40888.836913]  [<ffffffff8112f901>] ? valid_swaphandles+0x141/0x170
108-
Jul 30 07:08:08 wowdb kernel: [40888.836916]  [<ffffffff8112f087>] swapin_readahead+0x87/0xc0
108+
Jul 30 07:08:08 dbserver kernel: [40888.836916]  [<ffffffff8112f087>] swapin_readahead+0x87/0xc0
109-
Jul 30 07:08:08 wowdb kernel: [40888.836920]  [<ffffffff81120425>] do_swap_page+0x115/0x5a0
109+
Jul 30 07:08:08 dbserver kernel: [40888.836920]  [<ffffffff81120425>] do_swap_page+0x115/0x5a0
110-
Jul 30 07:08:08 wowdb kernel: [40888.836924]  [<ffffffff8114c561>] ? __mem_cgroup_try_charge+0x71/0x450
110+
Jul 30 07:08:08 dbserver kernel: [40888.836924]  [<ffffffff8114c561>] ? __mem_cgroup_try_charge+0x71/0x450
111-
Jul 30 07:08:08 wowdb kernel: [40888.836927]  [<ffffffff81120b8b>] handle_mm_fault+0x2db/0x440
111+
Jul 30 07:08:08 dbserver kernel: [40888.836927]  [<ffffffff81120b8b>] handle_mm_fault+0x2db/0x440
112-
Jul 30 07:08:08 wowdb kernel: [40888.836930]  [<ffffffff81050ae7>] ? find_busiest_group+0x757/0xa00
112+
Jul 30 07:08:08 dbserver kernel: [40888.836930]  [<ffffffff81050ae7>] ? find_busiest_group+0x757/0xa00
113-
Jul 30 07:08:08 wowdb kernel: [40888.836934]  [<ffffffff8158cefa>] do_page_fault+0x12a/0x350
113+
Jul 30 07:08:08 dbserver kernel: [40888.836934]  [<ffffffff8158cefa>] do_page_fault+0x12a/0x350
114-
Jul 30 07:08:08 wowdb kernel: [40888.836936]  [<ffffffff81589a75>] page_fault+0x25/0x30
114+
Jul 30 07:08:08 dbserver kernel: [40888.836936]  [<ffffffff81589a75>] page_fault+0x25/0x30
115-
Jul 30 07:08:08 wowdb kernel: [40888.836939]  [<ffffffff812c1a5c>] ? __get_user_8+0x1c/0x23
115+
Jul 30 07:08:08 dbserver kernel: [40888.836939]  [<ffffffff812c1a5c>] ? __get_user_8+0x1c/0x23
116-
Jul 30 07:08:08 wowdb kernel: [40888.836942]  [<ffffffff810918fd>] ? exit_robust_list+0x5d/0x160
116+
Jul 30 07:08:08 dbserver kernel: [40888.836942]  [<ffffffff810918fd>] ? exit_robust_list+0x5d/0x160
117-
Jul 30 07:08:08 wowdb kernel: [40888.836945]  [<ffffffff81036dd9>] ? default_spin_lock_flags+0x9/0x10
117+
Jul 30 07:08:08 dbserver kernel: [40888.836945]  [<ffffffff81036dd9>] ? default_spin_lock_flags+0x9/0x10
118-
Jul 30 07:08:08 wowdb kernel: [40888.836947]  [<ffffffff8105e413>] mm_release+0x113/0x130
118+
Jul 30 07:08:08 dbserver kernel: [40888.836947]  [<ffffffff8105e413>] mm_release+0x113/0x130
119-
Jul 30 07:08:08 wowdb kernel: [40888.836949]  [<ffffffff81064de6>] exit_mm+0x26/0x140
119+
Jul 30 07:08:08 dbserver kernel: [40888.836949]  [<ffffffff81064de6>] exit_mm+0x26/0x140
120-
Jul 30 07:08:08 wowdb kernel: [40888.836952]  [<ffffffff810d2a4d>] ? taskstats_exit+0x19d/0x260
120+
Jul 30 07:08:08 dbserver kernel: [40888.836952]  [<ffffffff810d2a4d>] ? taskstats_exit+0x19d/0x260
121-
Jul 30 07:08:08 wowdb kernel: [40888.836953]  [<ffffffff810a3470>] ? acct_collect+0x160/0x1b0
121+
Jul 30 07:08:08 dbserver kernel: [40888.836953]  [<ffffffff810a3470>] ? acct_collect+0x160/0x1b0
122-
Jul 30 07:08:08 wowdb kernel: [40888.836955]  [<ffffffff81065151>] do_exit+0x141/0x3f0
122+
Jul 30 07:08:08 dbserver kernel: [40888.836955]  [<ffffffff81065151>] do_exit+0x141/0x3f0
123-
Jul 30 07:08:08 wowdb kernel: [40888.836958]  [<ffffffff810700bc>] ? lock_timer_base+0x3c/0x70
123+
Jul 30 07:08:08 dbserver kernel: [40888.836958]  [<ffffffff810700bc>] ? lock_timer_base+0x3c/0x70
124-
Jul 30 07:08:08 wowdb kernel: [40888.836961]  [<ffffffff81065455>] do_group_exit+0x55/0xd0
124+
Jul 30 07:08:08 dbserver kernel: [40888.836961]  [<ffffffff81065455>] do_group_exit+0x55/0xd0
125-
Jul 30 07:08:08 wowdb kernel: [40888.836962]  [<ffffffff81076341>] get_signal_to_deliver+0x201/0x440
125+
Jul 30 07:08:08 dbserver kernel: [40888.836962]  [<ffffffff81076341>] get_signal_to_deliver+0x201/0x440
126-
Jul 30 07:08:08 wowdb kernel: [40888.836965]  [<ffffffff81009989>] do_signal+0x69/0x1a0
126+
Jul 30 07:08:08 dbserver kernel: [40888.836965]  [<ffffffff81009989>] do_signal+0x69/0x1a0
127-
Jul 30 07:08:08 wowdb kernel: [40888.836969]  [<ffffffff8118fe20>] ? timeout_func+0x0/0x20
127+
Jul 30 07:08:08 dbserver kernel: [40888.836969]  [<ffffffff8118fe20>] ? timeout_func+0x0/0x20
128-
Jul 30 07:08:08 wowdb kernel: [40888.836971]  [<ffffffff81009b25>] do_notify_resume+0x65/0x90
128+
Jul 30 07:08:08 dbserver kernel: [40888.836971]  [<ffffffff81009b25>] do_notify_resume+0x65/0x90
129-
Jul 30 07:08:08 wowdb kernel: [40888.836973]  [<ffffffff8100a3c0>] int_signal+0x12/0x17
129+
Jul 30 07:08:08 dbserver kernel: [40888.836973]  [<ffffffff8100a3c0>] int_signal+0x12/0x17
130-
Jul 30 07:08:08 wowdb kernel: [40888.836974] Mem-Info:
130+
Jul 30 07:08:08 dbserver kernel: [40888.836974] Mem-Info:
131-
Jul 30 07:08:08 wowdb kernel: [40888.836975] Node 0 DMA per-cpu:
131+
Jul 30 07:08:08 dbserver kernel: [40888.836975] Node 0 DMA per-cpu:
132-
Jul 30 07:08:08 wowdb kernel: [40888.836977] CPU    0: hi:    0, btch:   1 usd:   0
132+
Jul 30 07:08:08 dbserver kernel: [40888.836977] CPU    0: hi:    0, btch:   1 usd:   0
133-
Jul 30 07:08:08 wowdb kernel: [40888.836978] CPU    1: hi:    0, btch:   1 usd:   0
133+
Jul 30 07:08:08 dbserver kernel: [40888.836978] CPU    1: hi:    0, btch:   1 usd:   0
134-
Jul 30 07:08:08 wowdb kernel: [40888.836979] CPU    2: hi:    0, btch:   1 usd:   0
134+
Jul 30 07:08:08 dbserver kernel: [40888.836979] CPU    2: hi:    0, btch:   1 usd:   0
135-
Jul 30 07:08:08 wowdb kernel: [40888.836980] CPU    3: hi:    0, btch:   1 usd:   0
135+
Jul 30 07:08:08 dbserver kernel: [40888.836980] CPU    3: hi:    0, btch:   1 usd:   0
136-
Jul 30 07:08:08 wowdb kernel: [40888.836981] Node 0 DMA32 per-cpu:
136+
Jul 30 07:08:08 dbserver kernel: [40888.836981] Node 0 DMA32 per-cpu:
137-
Jul 30 07:08:08 wowdb kernel: [40888.836982] CPU    0: hi:  186, btch:  31 usd:  30
137+
Jul 30 07:08:08 dbserver kernel: [40888.836982] CPU    0: hi:  186, btch:  31 usd:  30
138-
Jul 30 07:08:08 wowdb kernel: [40888.836983] CPU    1: hi:  186, btch:  31 usd:  91
138+
Jul 30 07:08:08 dbserver kernel: [40888.836983] CPU    1: hi:  186, btch:  31 usd:  91
139-
Jul 30 07:08:08 wowdb kernel: [40888.836984] CPU    2: hi:  186, btch:  31 usd:  77
139+
Jul 30 07:08:08 dbserver kernel: [40888.836984] CPU    2: hi:  186, btch:  31 usd:  77
140
Jul 30 07:08:08 dbserver kernel: [40888.836985] CPU    3: hi:  186, btch:  31 usd: 178
141
Jul 30 07:08:08 dbserver kernel: [40888.836986] Node 0 Normal per-cpu:
142
Jul 30 07:08:08 dbserver kernel: [40888.836987] CPU    0: hi:  186, btch:  31 usd:  36
143
Jul 30 07:08:08 dbserver kernel: [40888.836988] CPU    1: hi:  186, btch:  31 usd:   8
144
Jul 30 07:08:08 dbserver kernel: [40888.836989] CPU    2: hi:  186, btch:  31 usd:  78
145
Jul 30 07:08:08 dbserver kernel: [40888.836990] CPU    3: hi:  186, btch:  31 usd: 165
146
Jul 30 07:08:08 dbserver kernel: [40888.836993] active_anon:1118901 inactive_anon:148659 isolated_anon:0
147
Jul 30 07:08:08 dbserver kernel: [40888.836994]  active_file:43 inactive_file:1138 isolated_file:0
148
Jul 30 07:08:08 dbserver kernel: [40888.836994]  unevictable:0 dirty:21 writeback:0 unstable:0
149
Jul 30 07:08:08 dbserver kernel: [40888.836995]  free:14490 slab_reclaimable:2163 slab_unreclaimable:2752
150
Jul 30 07:08:08 dbserver kernel: [40888.836995]  mapped:211 shmem:2 pagetables:3138 bounce:0
151
Jul 30 07:08:08 dbserver kernel: [40888.836996] Node 0 DMA free:15824kB min:16kB low:20kB high:24kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15708kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:8kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
152
Jul 30 07:08:08 dbserver kernel: [40888.837002] lowmem_reserve[]: 0 3000 10338 10338
153
Jul 30 07:08:08 dbserver kernel: [40888.837004] Node 0 DMA32 free:33004kB min:3772kB low:4712kB high:5656kB active_anon:255152kB inactive_anon:67028kB active_file:88kB inactive_file:16kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3072096kB mlocked:0kB dirty:0kB writeback:0kB mapped:120kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:12kB kernel_stack:0kB pagetables:672kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:156 all_unreclaimable? yes
154
Jul 30 07:08:08 dbserver kernel: [40888.837009] lowmem_reserve[]: 0 0 7338 7338
155
Jul 30 07:08:08 dbserver kernel: [40888.837011] Node 0 Normal free:9132kB min:9228kB low:11532kB high:13840kB active_anon:4220452kB inactive_anon:527608kB active_file:84kB inactive_file:4536kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:7514400kB mlocked:0kB dirty:84kB writeback:0kB mapped:724kB shmem:8kB slab_reclaimable:8652kB slab_unreclaimable:10988kB kernel_stack:1256kB pagetables:11880kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:576 all_unreclaimable? yes
156
Jul 30 07:08:08 dbserver kernel: [40888.837016] lowmem_reserve[]: 0 0 0 0
157
Jul 30 07:08:08 dbserver kernel: [40888.837018] Node 0 DMA: 2*4kB 1*8kB 2*16kB 1*32kB 2*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15824kB
158
Jul 30 07:08:08 dbserver kernel: [40888.837023] Node 0 DMA32: 15*4kB 24*8kB 7*16kB 4*32kB 0*64kB 2*128kB 0*256kB 1*512kB 3*1024kB 2*2048kB 6*4096kB = 33004kB
159
Jul 30 07:08:08 dbserver kernel: [40888.837027] Node 0 Normal: 176*4kB 24*8kB 89*16kB 29*32kB 8*64kB 7*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 1*4096kB = 9008kB
160
Jul 30 07:08:08 dbserver kernel: [40888.837032] 85036 total pagecache pages
161
Jul 30 07:08:08 dbserver kernel: [40888.837033] 83899 pages in swap cache
162
Jul 30 07:08:08 dbserver kernel: [40888.837034] Swap cache stats: add 166635, delete 82736, find 3838/5952
163
Jul 30 07:08:08 dbserver kernel: [40888.837035] Free swap  = 0kB
164
Jul 30 07:08:08 dbserver kernel: [40888.837036] Total swap = 577532kB
165
Jul 30 07:08:08 dbserver kernel: [40888.851031] 2691056 pages RAM
166
Jul 30 07:08:08 dbserver kernel: [40888.851033] 56870 pages reserved
167
Jul 30 07:08:08 dbserver kernel: [40888.851034] 296 pages shared
168
Jul 30 07:08:08 dbserver kernel: [40888.851035] 2618439 pages non-shared
169
Jul 30 07:08:08 dbserver kernel: [40888.851037] Out of memory: kill process 799 (atd) score 2366 or a child
170
Jul 30 07:08:08 dbserver kernel: [40888.851093] Killed process 799 (atd) vsz:18932kB, anon-rss:0kB, file-rss:0kB