Advertisement
Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- <4>[ 223.801775] CPU 29: hi: 0, btch: 1 usd: 0
- <4>[ 223.801962] CPU 30: hi: 0, btch: 1 usd: 0
- <4>[ 223.802239] CPU 31: hi: 0, btch: 1 usd: 0
- <4>[ 223.802422] Node 0 DMA32 per-cpu:
- <4>[ 223.802683] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 223.802867] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 223.803056] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 223.803242] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 223.803430] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 223.803620] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 223.803811] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 223.804003] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 223.804196] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 223.804389] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 223.804578] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 223.804768] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 223.804960] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 223.805153] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 223.805345] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 223.805537] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 223.805729] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 223.805923] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 223.806112] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 223.806300] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 223.806489] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 223.806679] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 223.806868] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 223.807062] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 223.807255] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 223.807447] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 223.807637] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 223.807827] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 223.808019] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 223.808211] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 223.808403] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 223.808593] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 223.808783] Node 0 Normal per-cpu:
- <4>[ 223.809055] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 223.809250] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 223.809441] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 223.809634] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 223.809827] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 223.810021] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 223.810211] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 223.810399] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 223.810590] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 223.810779] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 223.810970] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 223.811159] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 223.811349] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 223.811539] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 223.811733] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 223.811925] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 223.812116] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 223.812307] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 223.812497] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 223.812686] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 223.812876] CPU 20: hi: 186, btch: 31 usd: 105
- <4>[ 223.813070] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 223.813266] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 223.813460] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 223.813654] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 223.813845] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 223.814039] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 223.814227] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 223.814415] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 223.814605] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 223.814796] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 223.814990] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 223.815179] Node 1 Normal per-cpu:
- <4>[ 223.815452] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 223.815646] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 223.815835] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 223.816023] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 223.816208] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 223.816493] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 223.816678] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 223.816863] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 223.817051] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 223.817236] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 223.817422] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 223.817614] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 223.817803] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 223.817996] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 223.818187] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 223.818378] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 223.818569] CPU 16: hi: 186, btch: 31 usd: 59
- <4>[ 223.818761] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 223.818953] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 223.819144] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 223.819335] CPU 20: hi: 186, btch: 31 usd: 93
- <4>[ 223.819526] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 223.819718] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 223.819911] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 223.820102] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 223.820292] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 223.820483] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 223.820673] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 223.820865] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 223.821059] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 223.821249] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 223.821439] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 223.821632] active_anon:28808 inactive_anon:1871 isolated_anon:0
- <4>[ 223.821633] active_file:86 inactive_file:393 isolated_file:0
- <4>[ 223.821634] unevictable:11770 dirty:0 writeback:0 unstable:0
- <4>[ 223.821635] free:50690 slab_reclaimable:2856 slab_unreclaimable:45471
- <4>[ 223.821636] mapped:1930 shmem:54 pagetables:1140 bounce:0
- <4>[ 223.822600] Node 0 DMA free:15744kB min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15356kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
- <4>[ 223.823447] lowmem_reserve[]: 0 2955 32245 32245
- <4>[ 223.824042] Node 0 DMA32 free:120384kB min:4120kB low:5148kB high:6180kB active_anon:0kB inactive_anon:0kB active_file:8kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3026080kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:20kB slab_unreclaimable:17360kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:4 all_unreclaimable? no
- <4>[ 223.824877] lowmem_reserve[]: 0 0 29290 29290
- <4>[ 223.825470] Node 0 Normal free:30512kB min:40868kB low:51084kB high:61300kB active_anon:58116kB inactive_anon:3748kB active_file:96kB inactive_file:0kB unevictable:44928kB isolated(anon):0kB isolated(file):0kB present:29992960kB mlocked:44928kB dirty:0kB writeback:0kB mapped:5332kB shmem:136kB slab_reclaimable:6052kB slab_unreclaimable:75664kB kernel_stack:4816kB pagetables:2140kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
- <4>[ 223.826330] lowmem_reserve[]: 0 0 0 0
- <4>[ 223.826921] Node 1 Normal free:36564kB min:45096kB low:56368kB high:67644kB active_anon:57116kB inactive_anon:3736kB active_file:240kB inactive_file:1212kB unevictable:2152kB isolated(anon):0kB isolated(file):0kB present:33095680kB mlocked:2152kB dirty:0kB writeback:0kB mapped:2388kB shmem:80kB slab_reclaimable:5352kB slab_unreclaimable:88860kB kernel_stack:752kB pagetables:2420kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
- <4>[ 223.827782] lowmem_reserve[]: 0 0 0 0
- <4>[ 223.828373] Node 0 DMA: 2*4kB 1*8kB 1*16kB 1*32kB 1*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15744kB
- <4>[ 223.829728] Node 0 DMA32: 19*4kB 7*8kB 8*16kB 8*32kB 11*64kB 11*128kB 8*256kB 10*512kB 6*1024kB 5*2048kB 23*4096kB = 120388kB
- <4>[ 223.831120] Node 0 Normal: 1175*4kB 608*8kB 355*16kB 187*32kB 76*64kB 5*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 1*4096kB = 30828kB
- <4>[ 223.832477] Node 1 Normal: 817*4kB 715*8kB 444*16kB 219*32kB 82*64kB 18*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB 1*4096kB = 36796kB
- <4>[ 223.833833] 2253 total pagecache pages
- <4>[ 223.834038] 0 pages in swap cache
- <4>[ 223.834222] Swap cache stats: add 0, delete 0, find 0/0
- <4>[ 223.834410] Free swap = 0kB
- <4>[ 223.834593] Total swap = 0kB
- <6>[ 223.998655] 16777215 pages RAM
- <6>[ 223.998847] 294628 pages reserved
- <6>[ 223.999032] 124216 pages shared
- <6>[ 223.999220] 16393886 pages non-shared
- <6>[ 223.999406] [ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
- <6>[ 223.999764] [ 1047] 0 1047 2797 302 2 -17 -1000 udevd
- <6>[ 224.000065] [ 3171] 0 3171 6909 183 3 -17 -1000 auditd
- <6>[ 224.000361] [ 3728] 81 3728 5350 148 1 0 0 dbus-daemon
- <6>[ 224.000661] [ 3758] 0 3758 55368 6992 1 0 0 snmpd
- <6>[ 224.000953] [ 3772] 0 3772 16018 260 0 -17 -1000 sshd
- <6>[ 224.001238] [ 3782] 0 3782 5522 219 1 0 0 xinetd
- <6>[ 224.001605] [ 3801] 0 3801 5053 327 19 0 0 cmproxyd
- <6>[ 224.001893] [ 3812] 38 3812 6484 301 2 0 0 ntpd
- <6>[ 224.002178] [ 3953] 0 3953 19669 496 1 0 0 master
- <6>[ 224.002462] [ 3961] 0 3961 29302 305 16 0 0 crond
- <6>[ 224.002755] [ 3963] 89 3963 19689 478 17 0 0 pickup
- <6>[ 224.003048] [ 3964] 89 3964 19706 478 17 0 0 qmgr
- <6>[ 224.005300] [ 3974] 0 3974 5363 115 1 0 0 atd
- <6>[ 224.005600] [ 4272] 0 4272 234055 3595 0 0 0 dsm_sa_datamgrd
- <6>[ 224.005897] [ 4552] 0 4552 72683 512 17 0 0 dsm_sa_eventmgr
- <6>[ 224.006194] [ 4613] 0 4613 125242 1354 9 0 0 dsm_sa_snmpd
- <6>[ 224.006493] [ 4643] 0 4643 33158 204 3 0 0 dsm_om_connsvcd
- <6>[ 224.006804] [ 4644] 0 4644 1217768 15606 1 0 0 dsm_om_connsvcd
- <6>[ 224.007101] [ 4800] 0 4800 140898 872 0 0 0 dsm_om_shrsvcd
- <6>[ 224.007395] [ 4835] 0 4835 10060 407 1 0 0 cmclconfd
- <6>[ 224.007695] [ 4842] 0 4842 21240 11772 16 0 0 cmcld
- <6>[ 224.007990] [ 4848] 0 4848 10060 397 2 0 0 cmclconfd
- <6>[ 224.008287] [ 4852] 0 4852 5055 330 2 0 0 cmserviced
- <6>[ 224.008588] [ 4854] 0 4854 4451 247 17 0 0 cmlogd
- <6>[ 224.008883] [ 4855] 0 4855 8906 375 1 0 0 cmfileassistd
- <6>[ 224.009183] [ 4856] 0 4856 5171 353 2 0 0 cmnetd
- <6>[ 224.009476] [ 4860] 0 4860 5050 302 0 0 0 cmresourced
- <6>[ 224.009787] [ 4864] 0 4864 10060 370 3 0 0 cmclconfd
- <6>[ 224.010078] [ 4924] 0 4924 1015 148 9 0 0 mingetty
- <6>[ 224.010371] [ 4926] 0 4926 1015 148 5 0 0 mingetty
- <6>[ 224.010677] [ 4928] 0 4928 1015 149 21 0 0 mingetty
- <6>[ 224.010970] [ 4930] 0 4930 1015 149 3 0 0 mingetty
- <6>[ 224.011263] [ 4932] 0 4932 1015 149 2 0 0 mingetty
- <6>[ 224.011556] [ 4934] 0 4934 1015 149 18 0 0 mingetty
- <6>[ 224.011855] [ 4936] 0 4936 2796 300 4 -17 -1000 udevd
- <6>[ 224.012155] [ 4937] 0 4937 2796 299 5 -17 -1000 udevd
- <6>[ 224.012447] [ 5060] 0 5060 23954 555 2 0 0 sshd
- <6>[ 224.012752] [ 5078] 1033 5078 23954 306 0 0 0 sshd
- <6>[ 224.013049] [ 5079] 1033 5079 27075 292 17 0 0 bash
- <4>[ 224.014914] snmpd invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0, oom_score_adj=0
- <6>[ 224.015207] snmpd cpuset=/ mems_allowed=0-1
- <4>[ 224.015391] Pid: 3758, comm: snmpd Tainted: G W --------------- 2.6.32-279.5.2.el6.x86_64 #1
- <4>[ 224.015784] Call Trace:
- <4>[ 224.015972] [<ffffffff810c4bf1>] ? cpuset_print_task_mems_allowed+0x91/0xb0
- <4>[ 224.016164] [<ffffffff81117360>] ? dump_header+0x90/0x1b0
- <4>[ 224.016355] [<ffffffff810e37de>] ? __delayacct_freepages_end+0x2e/0x30
- <4>[ 224.016548] [<ffffffff8121494c>] ? security_real_capable_noaudit+0x3c/0x70
- <4>[ 224.016743] [<ffffffff811177e2>] ? oom_kill_process+0x82/0x2a0
- <4>[ 224.016942] [<ffffffff81117721>] ? select_bad_process+0xe1/0x120
- <4>[ 224.017137] [<ffffffff81117c20>] ? out_of_memory+0x220/0x3c0
- <4>[ 224.017334] [<ffffffff8112793e>] ? __alloc_pages_nodemask+0x89e/0x940
- <4>[ 224.017532] [<ffffffff8115c45a>] ? alloc_pages_current+0xaa/0x110
- <4>[ 224.017727] [<ffffffff81114767>] ? __page_cache_alloc+0x87/0x90
- <4>[ 224.017926] [<ffffffff8112a38b>] ? __do_page_cache_readahead+0xdb/0x210
- <4>[ 224.018121] [<ffffffff8112a4e1>] ? ra_submit+0x21/0x30
- <4>[ 224.018315] [<ffffffff81115a93>] ? filemap_fault+0x4c3/0x500
- <4>[ 224.018510] [<ffffffff8113ee94>] ? __do_fault+0x54/0x510
- <4>[ 224.018707] [<ffffffff8113f447>] ? handle_pte_fault+0xf7/0xb50
- <4>[ 224.018906] [<ffffffff810920d0>] ? autoremove_wake_function+0x0/0x40
- <4>[ 224.019104] [<ffffffff81010bae>] ? copy_user_generic+0xe/0x20
- <4>[ 224.019299] [<ffffffff8118fe69>] ? set_fd_set+0x49/0x60
- <4>[ 224.019490] [<ffffffff8119133c>] ? core_sys_select+0x1ec/0x2c0
- <4>[ 224.019682] [<ffffffff81140084>] ? handle_mm_fault+0x1e4/0x2b0
- <4>[ 224.019880] [<ffffffff81044479>] ? __do_page_fault+0x139/0x480
- <4>[ 224.020076] [<ffffffff8142894e>] ? sys_recvfrom+0xee/0x180
- <4>[ 224.020271] [<ffffffff815034ee>] ? do_page_fault+0x3e/0xa0
- <4>[ 224.020462] [<ffffffff815008a5>] ? page_fault+0x25/0x30
- <6>[ 224.020653] Mem-Info:
- <4>[ 224.020839] Node 0 DMA per-cpu:
- <4>[ 224.021104] CPU 0: hi: 0, btch: 1 usd: 0
- <4>[ 224.021294] CPU 1: hi: 0, btch: 1 usd: 0
- <4>[ 224.021482] CPU 2: hi: 0, btch: 1 usd: 0
- <4>[ 224.021670] CPU 3: hi: 0, btch: 1 usd: 0
- <4>[ 224.021861] CPU 4: hi: 0, btch: 1 usd: 0
- <4>[ 224.022049] CPU 5: hi: 0, btch: 1 usd: 0
- <4>[ 224.022237] CPU 6: hi: 0, btch: 1 usd: 0
- <4>[ 224.022425] CPU 7: hi: 0, btch: 1 usd: 0
- <4>[ 224.022620] CPU 8: hi: 0, btch: 1 usd: 0
- <4>[ 224.022812] CPU 9: hi: 0, btch: 1 usd: 0
- <4>[ 224.023003] CPU 10: hi: 0, btch: 1 usd: 0
- <4>[ 224.023192] CPU 11: hi: 0, btch: 1 usd: 0
- <4>[ 224.023380] CPU 12: hi: 0, btch: 1 usd: 0
- <4>[ 224.023576] CPU 13: hi: 0, btch: 1 usd: 0
- <4>[ 224.023772] CPU 14: hi: 0, btch: 1 usd: 0
- <4>[ 224.023959] CPU 15: hi: 0, btch: 1 usd: 0
- <4>[ 224.024147] CPU 16: hi: 0, btch: 1 usd: 0
- <4>[ 224.024336] CPU 17: hi: 0, btch: 1 usd: 0
- <4>[ 224.024523] CPU 18: hi: 0, btch: 1 usd: 0
- <4>[ 224.024719] CPU 19: hi: 0, btch: 1 usd: 0
- <4>[ 224.024910] CPU 20: hi: 0, btch: 1 usd: 0
- <4>[ 224.025099] CPU 21: hi: 0, btch: 1 usd: 0
- <4>[ 224.025287] CPU 22: hi: 0, btch: 1 usd: 0
- <4>[ 224.025475] CPU 23: hi: 0, btch: 1 usd: 0
- <4>[ 224.025669] CPU 24: hi: 0, btch: 1 usd: 0
- <4>[ 224.025859] CPU 25: hi: 0, btch: 1 usd: 0
- <4>[ 224.026047] CPU 26: hi: 0, btch: 1 usd: 0
- <4>[ 224.026236] CPU 27: hi: 0, btch: 1 usd: 0
- <4>[ 224.026425] CPU 28: hi: 0, btch: 1 usd: 0
- <4>[ 224.026624] CPU 29: hi: 0, btch: 1 usd: 0
- <4>[ 224.026817] CPU 30: hi: 0, btch: 1 usd: 0
- <4>[ 224.027012] CPU 31: hi: 0, btch: 1 usd: 0
- <4>[ 224.027204] Node 0 DMA32 per-cpu:
- <4>[ 224.027469] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 224.027664] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 224.027855] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 224.028042] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 224.028231] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 224.028425] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 224.028615] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 224.028806] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 224.028995] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 224.029184] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 224.029372] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 224.029557] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 224.029741] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 224.029955] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 224.030139] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 224.030325] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 224.030509] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 224.030700] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 224.030887] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 224.031078] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 224.031267] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 224.031458] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 224.031651] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 224.031842] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 224.032035] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 224.032224] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 224.032414] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 224.032604] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 224.032799] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 224.032988] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 224.033180] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 224.033372] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 224.033569] Node 0 Normal per-cpu:
- <4>[ 224.033839] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 224.034027] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 224.034216] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 224.034404] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 224.034592] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 224.034785] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 224.034973] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 224.035162] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 224.035350] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 224.035545] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 224.035733] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 224.035924] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 224.036112] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 224.036301] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 224.036491] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 224.036683] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 224.036883] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 224.037075] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 224.037268] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 224.037464] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 224.037655] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 224.037846] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 224.038034] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 224.038223] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 224.038413] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 224.038608] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 224.038799] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 224.040954] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 224.041143] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 224.041332] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 224.041521] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 224.041709] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 224.041905] Node 1 Normal per-cpu:
- <4>[ 224.042169] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 224.042358] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 224.042546] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 224.042735] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 224.042926] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 224.043116] CPU 5: hi: 186, btch: 31 usd: 1
- <4>[ 224.043305] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 224.043501] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 224.043685] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 224.043872] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 224.044153] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 224.044337] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 224.044522] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 224.044706] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 224.044893] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 224.045077] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 224.045265] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 224.045461] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 224.045650] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 224.045840] CPU 19: hi: 186, btch: 31 usd: 148
- <4>[ 224.046031] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 224.046219] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 224.046408] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 224.046605] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 224.046797] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 224.046989] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 224.047179] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 224.047379] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 224.047570] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 224.047769] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 224.047958] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 224.048147] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 224.048339] active_anon:28808 inactive_anon:1871 isolated_anon:0
- <4>[ 224.048340] active_file:86 inactive_file:208 isolated_file:0
- <4>[ 224.048340] unevictable:11770 dirty:0 writeback:0 unstable:0
- <4>[ 224.048341] free:50906 slab_reclaimable:2856 slab_unreclaimable:45471
- <4>[ 224.048342] mapped:1930 shmem:54 pagetables:1140 bounce:0
- <4>[ 224.049300] Node 0 DMA free:15744kB min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15356kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
- <4>[ 224.050137] lowmem_reserve[]: 0 2955 32245 32245
- <4>[ 224.050728] Node 0 DMA32 free:120384kB min:4120kB low:5148kB high:6180kB active_anon:0kB inactive_anon:0kB active_file:8kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3026080kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:20kB slab_unreclaimable:17360kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:4 all_unreclaimable? no
- <4>[ 224.051577] lowmem_reserve[]: 0 0 29290 29290
- <4>[ 224.052179] Node 0 Normal free:30932kB min:40868kB low:51084kB high:61300kB active_anon:58116kB inactive_anon:3748kB active_file:96kB inactive_file:0kB unevictable:44928kB isolated(anon):0kB isolated(file):0kB present:29992960kB mlocked:44928kB dirty:0kB writeback:0kB mapped:5332kB shmem:136kB slab_reclaimable:6052kB slab_unreclaimable:75664kB kernel_stack:4816kB pagetables:2140kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
- <4>[ 224.053029] lowmem_reserve[]: 0 0 0 0
- <4>[ 224.053616] Node 1 Normal free:36564kB min:45096kB low:56368kB high:67644kB active_anon:57116kB inactive_anon:3736kB active_file:240kB inactive_file:832kB unevictable:2152kB isolated(anon):0kB isolated(file):0kB present:33095680kB mlocked:2152kB dirty:0kB writeback:0kB mapped:2388kB shmem:80kB slab_reclaimable:5352kB slab_unreclaimable:88860kB kernel_stack:752kB pagetables:2420kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
- <4>[ 224.054474] lowmem_reserve[]: 0 0 0 0
- <4>[ 224.055067] Node 0 DMA: 2*4kB 1*8kB 1*16kB 1*32kB 1*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15744kB
- <4>[ 224.056417] Node 0 DMA32: 19*4kB 7*8kB 8*16kB 8*32kB 11*64kB 11*128kB 8*256kB 10*512kB 6*1024kB 5*2048kB 23*4096kB = 120388kB
- <4>[ 224.057776] Node 0 Normal: 1217*4kB 623*8kB 353*16kB 186*32kB 79*64kB 5*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 1*4096kB = 31244kB
- <4>[ 224.059161] Node 1 Normal: 928*4kB 712*8kB 447*16kB 220*32kB 82*64kB 19*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB 1*4096kB = 37424kB
- <4>[ 224.060520] 2120 total pagecache pages
- <4>[ 224.060706] 0 pages in swap cache
- <4>[ 224.060894] Swap cache stats: add 0, delete 0, find 0/0
- <4>[ 224.061083] Free swap = 0kB
- <4>[ 224.061265] Total swap = 0kB
- <6>[ 224.224379] 16777215 pages RAM
- <6>[ 224.224566] 294628 pages reserved
- <6>[ 224.224755] 124115 pages shared
- <6>[ 224.224941] 16393836 pages non-shared
- <6>[ 224.225126] [ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
- <6>[ 224.225497] [ 1047] 0 1047 2797 302 2 -17 -1000 udevd
- <6>[ 224.225803] [ 3171] 0 3171 6909 183 3 -17 -1000 auditd
- <6>[ 224.226100] [ 3728] 81 3728 5350 148 1 0 0 dbus-daemon
- <6>[ 224.226401] [ 3758] 0 3758 55368 6985 1 0 0 snmpd
- <6>[ 224.226703] [ 3772] 0 3772 16018 260 0 -17 -1000 sshd
- <6>[ 224.226995] [ 3782] 0 3782 5522 219 1 0 0 xinetd
- <6>[ 224.227288] [ 3801] 0 3801 5053 327 19 0 0 cmproxyd
- <6>[ 224.227587] [ 3812] 38 3812 6484 299 2 0 0 ntpd
- <6>[ 224.227881] [ 3953] 0 3953 19669 496 1 0 0 master
- <6>[ 224.228173] [ 3961] 0 3961 29302 305 16 0 0 crond
- <6>[ 224.228466] [ 3963] 89 3963 19689 478 17 0 0 pickup
- <6>[ 224.228752] [ 3964] 89 3964 19706 478 17 0 0 qmgr
- <6>[ 224.229129] [ 3974] 0 3974 5363 115 1 0 0 atd
- <6>[ 224.229420] [ 4272] 0 4272 234055 3595 0 0 0 dsm_sa_datamgrd
- <6>[ 224.229707] [ 4552] 0 4552 72683 512 17 0 0 dsm_sa_eventmgr
- <6>[ 224.229993] [ 4613] 0 4613 125242 1354 9 0 0 dsm_sa_snmpd
- <6>[ 224.230286] [ 4643] 0 4643 33158 204 3 0 0 dsm_om_connsvcd
- <6>[ 224.230587] [ 4644] 0 4644 1217768 15606 1 0 0 dsm_om_connsvcd
- <6>[ 224.230886] [ 4800] 0 4800 140898 872 0 0 0 dsm_om_shrsvcd
- <6>[ 224.231184] [ 4835] 0 4835 10060 407 1 0 0 cmclconfd
- <6>[ 224.231487] [ 4842] 0 4842 21240 11772 16 0 0 cmcld
- <6>[ 224.231785] [ 4848] 0 4848 10060 397 2 0 0 cmclconfd
- <6>[ 224.232080] [ 4852] 0 4852 5055 330 2 0 0 cmserviced
- <6>[ 224.232379] [ 4854] 0 4854 4451 247 17 0 0 cmlogd
- <6>[ 224.232674] [ 4855] 0 4855 8906 375 1 0 0 cmfileassistd
- <6>[ 224.232968] [ 4856] 0 4856 5171 353 2 0 0 cmnetd
- <6>[ 224.233260] [ 4860] 0 4860 5050 302 0 0 0 cmresourced
- <6>[ 224.233564] [ 4864] 0 4864 10060 370 3 0 0 cmclconfd
- <6>[ 224.233869] [ 4924] 0 4924 1015 148 9 0 0 mingetty
- <6>[ 224.234165] [ 4926] 0 4926 1015 148 5 0 0 mingetty
- <6>[ 224.234464] [ 4928] 0 4928 1015 149 21 0 0 mingetty
- <6>[ 224.234758] [ 4930] 0 4930 1015 149 3 0 0 mingetty
- <6>[ 224.235052] [ 4932] 0 4932 1015 149 2 0 0 mingetty
- <6>[ 224.235345] [ 4934] 0 4934 1015 149 18 0 0 mingetty
- <6>[ 224.235638] [ 4936] 0 4936 2796 300 4 -17 -1000 udevd
- <6>[ 224.235928] [ 4937] 0 4937 2796 299 5 -17 -1000 udevd
- <6>[ 224.236221] [ 5060] 0 5060 23954 555 2 0 0 sshd
- <6>[ 224.236526] [ 5078] 1033 5078 23954 306 0 0 0 sshd
- <6>[ 224.236825] [ 5079] 1033 5079 27075 292 17 0 0 bash
- <3>[ 224.237119] Out of memory: Kill process 3728 (dbus-daemon) score 1 or sacrifice child
- <3>[ 224.237412] Killed process 3728, UID 81, (dbus-daemon) total-vm:21400kB, anon-rss:252kB, file-rss:340kB
- <4>[ 228.545719] ntpd invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0, oom_score_adj=0
- <6>[ 228.546017] ntpd cpuset=/ mems_allowed=0-1
- <4>[ 228.546205] Pid: 3812, comm: ntpd Tainted: G W --------------- 2.6.32-279.5.2.el6.x86_64 #1
- <4>[ 228.546500] Call Trace:
- <4>[ 228.546694] [<ffffffff810c4bf1>] ? cpuset_print_task_mems_allowed+0x91/0xb0
- <4>[ 228.546894] [<ffffffff81117360>] ? dump_header+0x90/0x1b0
- <4>[ 228.549043] [<ffffffff810e37de>] ? __delayacct_freepages_end+0x2e/0x30
- <4>[ 228.549240] [<ffffffff8121494c>] ? security_real_capable_noaudit+0x3c/0x70
- <4>[ 228.549436] [<ffffffff811177e2>] ? oom_kill_process+0x82/0x2a0
- <4>[ 228.549630] [<ffffffff81117721>] ? select_bad_process+0xe1/0x120
- <4>[ 228.549824] [<ffffffff81117c20>] ? out_of_memory+0x220/0x3c0
- <4>[ 228.550024] [<ffffffff8112793e>] ? __alloc_pages_nodemask+0x89e/0x940
- <4>[ 228.550222] [<ffffffff8115c45a>] ? alloc_pages_current+0xaa/0x110
- <4>[ 228.550418] [<ffffffff81114767>] ? __page_cache_alloc+0x87/0x90
- <4>[ 228.550611] [<ffffffff8112a38b>] ? __do_page_cache_readahead+0xdb/0x210
- <4>[ 228.550807] [<ffffffff81190140>] ? pollwake+0x0/0x60
- <4>[ 228.550999] [<ffffffff8112a4e1>] ? ra_submit+0x21/0x30
- <4>[ 228.551194] [<ffffffff81115a93>] ? filemap_fault+0x4c3/0x500
- <4>[ 228.551388] [<ffffffff8113ee94>] ? __do_fault+0x54/0x510
- <4>[ 228.551579] [<ffffffff8113f447>] ? handle_pte_fault+0xf7/0xb50
- <4>[ 228.551778] [<ffffffff810920d0>] ? autoremove_wake_function+0x0/0x40
- <4>[ 228.551977] [<ffffffff81010bae>] ? copy_user_generic+0xe/0x20
- <4>[ 228.552174] [<ffffffff8118fe69>] ? set_fd_set+0x49/0x60
- <4>[ 228.552368] [<ffffffff8119133c>] ? core_sys_select+0x1ec/0x2c0
- <4>[ 228.552565] [<ffffffff81140084>] ? handle_mm_fault+0x1e4/0x2b0
- <4>[ 228.552762] [<ffffffff81044479>] ? __do_page_fault+0x139/0x480
- <4>[ 228.552960] [<ffffffff81428759>] ? sys_sendto+0x139/0x190
- <4>[ 228.553151] [<ffffffff81012bd9>] ? read_tsc+0x9/0x20
- <4>[ 228.553346] [<ffffffff8109ce29>] ? ktime_get_ts+0xa9/0xe0
- <4>[ 228.553534] [<ffffffff8118fd98>] ? poll_select_copy_remaining+0xf8/0x150
- <4>[ 228.553729] [<ffffffff815034ee>] ? do_page_fault+0x3e/0xa0
- <4>[ 228.554017] [<ffffffff815008a5>] ? page_fault+0x25/0x30
- <6>[ 228.554204] Mem-Info:
- <4>[ 228.554383] Node 0 DMA per-cpu:
- <4>[ 228.554644] CPU 0: hi: 0, btch: 1 usd: 0
- <4>[ 228.554829] CPU 1: hi: 0, btch: 1 usd: 0
- <4>[ 228.555015] CPU 2: hi: 0, btch: 1 usd: 0
- <4>[ 228.555202] CPU 3: hi: 0, btch: 1 usd: 0
- <4>[ 228.555390] CPU 4: hi: 0, btch: 1 usd: 0
- <4>[ 228.555578] CPU 5: hi: 0, btch: 1 usd: 0
- <4>[ 228.555766] CPU 6: hi: 0, btch: 1 usd: 0
- <4>[ 228.555957] CPU 7: hi: 0, btch: 1 usd: 0
- <4>[ 228.556145] CPU 8: hi: 0, btch: 1 usd: 0
- <4>[ 228.556335] CPU 9: hi: 0, btch: 1 usd: 0
- <4>[ 228.556525] CPU 10: hi: 0, btch: 1 usd: 0
- <4>[ 228.556720] CPU 11: hi: 0, btch: 1 usd: 0
- <4>[ 228.556911] CPU 12: hi: 0, btch: 1 usd: 0
- <4>[ 228.557104] CPU 13: hi: 0, btch: 1 usd: 0
- <4>[ 228.557297] CPU 14: hi: 0, btch: 1 usd: 0
- <4>[ 228.557487] CPU 15: hi: 0, btch: 1 usd: 0
- <4>[ 228.557675] CPU 16: hi: 0, btch: 1 usd: 0
- <4>[ 228.557867] CPU 17: hi: 0, btch: 1 usd: 0
- <4>[ 228.558055] CPU 18: hi: 0, btch: 1 usd: 0
- <4>[ 228.558243] CPU 19: hi: 0, btch: 1 usd: 0
- <4>[ 228.558431] CPU 20: hi: 0, btch: 1 usd: 0
- <4>[ 228.558619] CPU 21: hi: 0, btch: 1 usd: 0
- <4>[ 228.558808] CPU 22: hi: 0, btch: 1 usd: 0
- <4>[ 228.558998] CPU 23: hi: 0, btch: 1 usd: 0
- <4>[ 228.559186] CPU 24: hi: 0, btch: 1 usd: 0
- <4>[ 228.559374] CPU 25: hi: 0, btch: 1 usd: 0
- <4>[ 228.559561] CPU 26: hi: 0, btch: 1 usd: 0
- <4>[ 228.559750] CPU 27: hi: 0, btch: 1 usd: 0
- <4>[ 228.559942] CPU 28: hi: 0, btch: 1 usd: 0
- <4>[ 228.560131] CPU 29: hi: 0, btch: 1 usd: 0
- <4>[ 228.560320] CPU 30: hi: 0, btch: 1 usd: 0
- <4>[ 228.560508] CPU 31: hi: 0, btch: 1 usd: 0
- <4>[ 228.560700] Node 0 DMA32 per-cpu:
- <4>[ 228.560969] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 228.561161] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 228.561351] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 228.561550] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 228.561742] CPU 4: hi: 186, btch: 31 usd: 2
- <4>[ 228.561941] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 228.562130] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 228.562320] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 228.562530] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 228.562719] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 228.562912] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 228.563103] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 228.563291] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 228.563483] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 228.563675] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 228.563876] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 228.564065] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 228.564254] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 228.564445] CPU 18: hi: 186, btch: 31 usd: 1
- <4>[ 228.564645] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 228.564838] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 228.565030] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 228.565223] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 228.565414] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 228.565607] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 228.565797] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 228.565989] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 228.566181] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 228.566371] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 228.566560] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 228.566755] CPU 30: hi: 186, btch: 31 usd: 24
- <4>[ 228.566946] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 228.567134] Node 0 Normal per-cpu:
- <4>[ 228.567398] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 228.567591] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 228.567776] CPU 2: hi: 186, btch: 31 usd: 3
- <4>[ 228.567962] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 228.568246] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 228.568430] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 228.568615] CPU 6: hi: 186, btch: 31 usd: 6
- <4>[ 228.568799] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 228.568985] CPU 8: hi: 186, btch: 31 usd: 1
- <4>[ 228.569169] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 228.569357] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 228.569545] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 228.569743] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 228.569934] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 228.570122] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 228.570312] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 228.570500] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 228.570689] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 228.570880] CPU 18: hi: 186, btch: 31 usd: 1
- <4>[ 228.571073] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 228.571263] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 228.571454] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 228.571643] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 228.571836] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 228.572025] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 228.572212] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 228.572401] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 228.572589] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 228.572777] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 228.572967] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 228.573156] CPU 30: hi: 186, btch: 31 usd: 18
- <4>[ 228.573347] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 228.573538] Node 1 Normal per-cpu:
- <4>[ 228.573806] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 228.573998] CPU 1: hi: 186, btch: 31 usd: 8
- <4>[ 228.574187] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 228.574375] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 228.574566] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 228.574762] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 228.574952] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 228.575144] CPU 7: hi: 186, btch: 31 usd: 10
- <4>[ 228.575333] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 228.575527] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 228.575715] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 228.575907] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 228.576096] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 228.576285] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 228.576475] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 228.576670] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 228.576860] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 228.577049] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 228.577239] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 228.577428] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 228.577619] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 228.577810] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 228.578002] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 228.578192] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 228.578380] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 228.578569] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 228.578760] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 228.578956] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 228.579147] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 228.579338] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 228.579531] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 228.579720] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 228.579914] active_anon:28616 inactive_anon:1850 isolated_anon:0
- <4>[ 228.579915] active_file:28 inactive_file:58 isolated_file:0
- <4>[ 228.579916] unevictable:11770 dirty:0 writeback:0 unstable:0
- <4>[ 228.579916] free:51711 slab_reclaimable:2648 slab_unreclaimable:45377
- <4>[ 228.579917] mapped:1871 shmem:54 pagetables:1102 bounce:0
- <4>[ 228.580877] Node 0 DMA free:15744kB min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15356kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
- <4>[ 228.581714] lowmem_reserve[]: 0 2955 32245 32245
- <4>[ 228.582388] Node 0 DMA32 free:120448kB min:4120kB low:5148kB high:6180kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:4kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3026080kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:20kB slab_unreclaimable:17216kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:2 all_unreclaimable? no
- <4>[ 228.583198] lowmem_reserve[]: 0 0 29290 29290
- <4>[ 228.583794] Node 0 Normal free:32004kB min:40868kB low:51084kB high:61300kB active_anon:57332kB inactive_anon:3964kB active_file:96kB inactive_file:0kB unevictable:44928kB isolated(anon):0kB isolated(file):0kB present:29992960kB mlocked:44928kB dirty:0kB writeback:0kB mapped:5332kB shmem:136kB slab_reclaimable:5612kB slab_unreclaimable:75628kB kernel_stack:4816kB pagetables:2012kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:272 all_unreclaimable? yes
- <4>[ 228.586611] lowmem_reserve[]: 0 0 0 0
- <4>[ 228.587200] Node 1 Normal free:38648kB min:45096kB low:56368kB high:67644kB active_anon:57132kB inactive_anon:3436kB active_file:16kB inactive_file:228kB unevictable:2152kB isolated(anon):0kB isolated(file):0kB present:33095680kB mlocked:2152kB dirty:0kB writeback:0kB mapped:2152kB shmem:80kB slab_reclaimable:4960kB slab_unreclaimable:88664kB kernel_stack:720kB pagetables:2396kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:362 all_unreclaimable? yes
- <4>[ 228.588045] lowmem_reserve[]: 0 0 0 0
- <4>[ 228.588639] Node 0 DMA: 2*4kB 1*8kB 1*16kB 1*32kB 1*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15744kB
- <4>[ 228.589983] Node 0 DMA32: 30*4kB 7*8kB 7*16kB 7*32kB 10*64kB 10*128kB 7*256kB 9*512kB 7*1024kB 5*2048kB 23*4096kB = 120448kB
- <4>[ 228.591335] Node 0 Normal: 1297*4kB 638*8kB 359*16kB 189*32kB 79*64kB 6*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 1*4096kB = 32004kB
- <4>[ 228.592692] Node 1 Normal: 1187*4kB 725*8kB 450*16kB 221*32kB 83*64kB 20*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB 1*4096kB = 38836kB
- <4>[ 228.594045] 2013 total pagecache pages
- <4>[ 228.594236] 0 pages in swap cache
- <4>[ 228.594422] Swap cache stats: add 0, delete 0, find 0/0
- <4>[ 228.594611] Free swap = 0kB
- <4>[ 228.594797] Total swap = 0kB
- <6>[ 228.759348] 16777215 pages RAM
- <6>[ 228.759536] 294628 pages reserved
- <6>[ 228.759723] 124003 pages shared
- <6>[ 228.759907] 16393380 pages non-shared
- <6>[ 228.760094] [ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
- <6>[ 228.760465] [ 1047] 0 1047 2797 302 2 -17 -1000 udevd
- <6>[ 228.760770] [ 3171] 0 3171 6909 183 3 -17 -1000 auditd
- <6>[ 228.761063] [ 3758] 0 3758 55368 6985 2 0 0 snmpd
- <6>[ 228.761357] [ 3772] 0 3772 16018 260 0 -17 -1000 sshd
- <6>[ 228.761649] [ 3782] 0 3782 5522 219 1 0 0 xinetd
- <6>[ 228.761945] [ 3801] 0 3801 5053 327 19 0 0 cmproxyd
- <6>[ 228.762236] [ 3812] 38 3812 6484 298 17 0 0 ntpd
- <6>[ 228.762529] [ 3953] 0 3953 19669 496 1 0 0 master
- <6>[ 228.762822] [ 3961] 0 3961 29302 305 16 0 0 crond
- <6>[ 228.763114] [ 3963] 89 3963 19689 478 17 0 0 pickup
- <6>[ 228.763416] [ 3964] 89 3964 19706 478 17 0 0 qmgr
- <6>[ 228.763717] [ 3974] 0 3974 5363 115 1 0 0 atd
- <6>[ 228.764009] [ 4272] 0 4272 234055 3595 0 0 0 dsm_sa_datamgrd
- <6>[ 228.764304] [ 4552] 0 4552 72683 512 17 0 0 dsm_sa_eventmgr
- <6>[ 228.764604] [ 4613] 0 4613 125242 1354 9 0 0 dsm_sa_snmpd
- <6>[ 228.764904] [ 4643] 0 4643 33158 204 3 0 0 dsm_om_connsvcd
- <6>[ 228.765205] [ 4644] 0 4644 1217768 15606 1 0 0 dsm_om_connsvcd
- <6>[ 228.765498] [ 4800] 0 4800 140898 872 0 0 0 dsm_om_shrsvcd
- <6>[ 228.765795] [ 4835] 0 4835 10060 407 1 0 0 cmclconfd
- <6>[ 228.766087] [ 4842] 0 4842 21240 11772 16 0 0 cmcld
- <6>[ 228.766379] [ 4848] 0 4848 10060 397 2 0 0 cmclconfd
- <6>[ 228.766676] [ 4852] 0 4852 5055 330 2 0 0 cmserviced
- <6>[ 228.766968] [ 4854] 0 4854 4451 247 17 0 0 cmlogd
- <6>[ 228.767355] [ 4855] 0 4855 8906 375 1 0 0 cmfileassistd
- <6>[ 228.767641] [ 4856] 0 4856 5171 353 2 0 0 cmnetd
- <6>[ 228.767926] [ 4860] 0 4860 5050 302 0 0 0 cmresourced
- <6>[ 228.768211] [ 4864] 0 4864 10060 370 3 0 0 cmclconfd
- <6>[ 228.768513] [ 4924] 0 4924 1015 148 9 0 0 mingetty
- <6>[ 228.768810] [ 4926] 0 4926 1015 148 5 0 0 mingetty
- <6>[ 228.769103] [ 4928] 0 4928 1015 149 21 0 0 mingetty
- <6>[ 228.769401] [ 4930] 0 4930 1015 149 3 0 0 mingetty
- <6>[ 228.769705] [ 4932] 0 4932 1015 149 2 0 0 mingetty
- <6>[ 228.769996] [ 4934] 0 4934 1015 149 18 0 0 mingetty
- <6>[ 228.770287] [ 4936] 0 4936 2796 300 4 -17 -1000 udevd
- <6>[ 228.770595] [ 4937] 0 4937 2796 299 5 -17 -1000 udevd
- <6>[ 228.770891] [ 5060] 0 5060 23954 555 2 0 0 sshd
- <6>[ 228.771184] [ 5078] 1033 5078 23954 306 0 0 0 sshd
- <6>[ 228.771476] [ 5079] 1033 5079 27075 292 17 0 0 bash
- <3>[ 228.771770] Out of memory: Kill process 3758 (snmpd) score 1 or sacrifice child
- <3>[ 228.772064] Killed process 3758, UID 0, (snmpd) total-vm:221472kB, anon-rss:27588kB, file-rss:352kB
- <4>[ 228.807388] dsm_sa_snmpd invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0, oom_score_adj=0
- <6>[ 228.807703] dsm_sa_snmpd cpuset=/ mems_allowed=0-1
- <4>[ 228.807895] Pid: 4619, comm: dsm_sa_snmpd Tainted: G W --------------- 2.6.32-279.5.2.el6.x86_64 #1
- <4>[ 228.808196] Call Trace:
- <4>[ 228.808389] [<ffffffff810c4bf1>] ? cpuset_print_task_mems_allowed+0x91/0xb0
- <4>[ 228.808590] [<ffffffff81117360>] ? dump_header+0x90/0x1b0
- <4>[ 228.808787] [<ffffffff810e37de>] ? __delayacct_freepages_end+0x2e/0x30
- <4>[ 228.808998] [<ffffffff8121494c>] ? security_real_capable_noaudit+0x3c/0x70
- <4>[ 228.809194] [<ffffffff811177e2>] ? oom_kill_process+0x82/0x2a0
- <4>[ 228.809386] [<ffffffff81117721>] ? select_bad_process+0xe1/0x120
- <4>[ 228.809579] [<ffffffff81117c20>] ? out_of_memory+0x220/0x3c0
- <4>[ 228.809771] [<ffffffff8112793e>] ? __alloc_pages_nodemask+0x89e/0x940
- <4>[ 228.810063] [<ffffffff8115c45a>] ? alloc_pages_current+0xaa/0x110
- <4>[ 228.810254] [<ffffffff81114767>] ? __page_cache_alloc+0x87/0x90
- <4>[ 228.810445] [<ffffffff8112a38b>] ? __do_page_cache_readahead+0xdb/0x210
- <4>[ 228.810636] [<ffffffff8112a4e1>] ? ra_submit+0x21/0x30
- <4>[ 228.810824] [<ffffffff81115a93>] ? filemap_fault+0x4c3/0x500
- <4>[ 228.811014] [<ffffffff8113ee94>] ? __do_fault+0x54/0x510
- <4>[ 228.811207] [<ffffffff8113f447>] ? handle_pte_fault+0xf7/0xb50
- <4>[ 228.811403] [<ffffffff810629d3>] ? dequeue_entity+0x113/0x2e0
- <4>[ 228.811599] [<ffffffff81063c0b>] ? dequeue_task_fair+0x12b/0x130
- <4>[ 228.811796] [<ffffffff810097cc>] ? __switch_to+0x1ac/0x320
- <4>[ 228.811988] [<ffffffff81140084>] ? handle_mm_fault+0x1e4/0x2b0
- <4>[ 228.812182] [<ffffffff81097045>] ? __hrtimer_start_range_ns+0x1a5/0x470
- <4>[ 228.812382] [<ffffffff81044479>] ? __do_page_fault+0x139/0x480
- <4>[ 228.812579] [<ffffffff8109738f>] ? hrtimer_try_to_cancel+0x3f/0xd0
- <4>[ 228.812774] [<ffffffff81097442>] ? hrtimer_cancel+0x22/0x30
- <4>[ 228.812969] [<ffffffff814ff583>] ? do_nanosleep+0x93/0xc0
- <4>[ 228.813163] [<ffffffff81097514>] ? hrtimer_nanosleep+0xc4/0x180
- <4>[ 228.813361] [<ffffffff810962a0>] ? hrtimer_wakeup+0x0/0x30
- <4>[ 228.813560] [<ffffffff815034ee>] ? do_page_fault+0x3e/0xa0
- <4>[ 228.813753] [<ffffffff815008a5>] ? page_fault+0x25/0x30
- <6>[ 228.813943] Mem-Info:
- <4>[ 228.814126] Node 0 DMA per-cpu:
- <4>[ 228.814391] CPU 0: hi: 0, btch: 1 usd: 0
- <4>[ 228.814580] CPU 1: hi: 0, btch: 1 usd: 0
- <4>[ 228.814769] CPU 2: hi: 0, btch: 1 usd: 0
- <4>[ 228.814968] CPU 3: hi: 0, btch: 1 usd: 0
- <4>[ 228.815157] CPU 4: hi: 0, btch: 1 usd: 0
- <4>[ 228.815347] CPU 5: hi: 0, btch: 1 usd: 0
- <4>[ 228.815539] CPU 6: hi: 0, btch: 1 usd: 0
- <4>[ 228.815728] CPU 7: hi: 0, btch: 1 usd: 0
- <4>[ 228.815925] CPU 8: hi: 0, btch: 1 usd: 0
- <4>[ 228.816113] CPU 9: hi: 0, btch: 1 usd: 0
- <4>[ 228.816301] CPU 10: hi: 0, btch: 1 usd: 0
- <4>[ 228.816492] CPU 11: hi: 0, btch: 1 usd: 0
- <4>[ 228.816680] CPU 12: hi: 0, btch: 1 usd: 0
- <4>[ 228.816869] CPU 13: hi: 0, btch: 1 usd: 0
- <4>[ 228.817062] CPU 14: hi: 0, btch: 1 usd: 0
- <4>[ 228.817255] CPU 15: hi: 0, btch: 1 usd: 0
- <4>[ 228.817447] CPU 16: hi: 0, btch: 1 usd: 0
- <4>[ 228.817639] CPU 17: hi: 0, btch: 1 usd: 0
- <4>[ 228.817828] CPU 18: hi: 0, btch: 1 usd: 0
- <4>[ 228.818016] CPU 19: hi: 0, btch: 1 usd: 0
- <4>[ 228.818205] CPU 20: hi: 0, btch: 1 usd: 0
- <4>[ 228.818393] CPU 21: hi: 0, btch: 1 usd: 0
- <4>[ 228.818584] CPU 22: hi: 0, btch: 1 usd: 0
- <4>[ 228.818774] CPU 23: hi: 0, btch: 1 usd: 0
- <4>[ 228.818962] CPU 24: hi: 0, btch: 1 usd: 0
- <4>[ 228.819150] CPU 25: hi: 0, btch: 1 usd: 0
- <4>[ 228.819339] CPU 26: hi: 0, btch: 1 usd: 0
- <4>[ 228.819531] CPU 27: hi: 0, btch: 1 usd: 0
- <4>[ 228.819720] CPU 28: hi: 0, btch: 1 usd: 0
- <4>[ 228.819924] CPU 29: hi: 0, btch: 1 usd: 0
- <4>[ 228.820116] CPU 30: hi: 0, btch: 1 usd: 0
- <4>[ 228.820306] CPU 31: hi: 0, btch: 1 usd: 0
- <4>[ 228.822493] Node 0 DMA32 per-cpu:
- <4>[ 228.822758] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 228.822948] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 228.823137] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 228.823328] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 228.823520] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 228.823712] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 228.823897] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 228.824082] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 228.824346] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 228.824533] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 228.824718] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 228.824903] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 228.825087] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 228.825272] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 228.825467] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 228.825658] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 228.825848] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 228.826035] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 228.826223] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 228.826414] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 228.826603] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 228.826793] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 228.826982] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 228.827173] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 228.827364] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 228.827556] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 228.827748] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 228.827937] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 228.828126] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 228.828317] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 228.828509] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 228.828698] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 228.828887] Node 0 Normal per-cpu:
- <4>[ 228.829151] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 228.829342] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 228.829540] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 228.829733] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 228.829923] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 228.830116] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 228.830306] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 228.830500] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 228.830689] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 228.830879] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 228.831069] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 228.831259] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 228.831457] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 228.831647] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 228.831838] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 228.832026] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 228.832216] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 228.832407] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 228.832595] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 228.832784] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 228.832972] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 228.833162] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 228.833352] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 228.833544] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 228.833736] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 228.833926] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 228.834115] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 228.834305] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 228.834497] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 228.834690] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 228.834879] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 228.835069] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 228.835259] Node 1 Normal per-cpu:
- <4>[ 228.835529] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 228.835720] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 228.835910] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 228.836100] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 228.836292] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 228.836486] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 228.836679] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 228.836867] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 228.837056] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 228.837247] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 228.837440] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 228.837631] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 228.837820] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 228.838008] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 228.838192] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 228.838472] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 228.838657] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 228.838841] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 228.839025] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 228.839210] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 228.839398] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 228.839585] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 228.839773] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 228.839965] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 228.840154] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 228.840343] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 228.840536] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 228.840728] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 228.840916] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 228.841108] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 228.841298] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 228.841491] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 228.841684] active_anon:22284 inactive_anon:1430 isolated_anon:0
- <4>[ 228.841685] active_file:28 inactive_file:276 isolated_file:0
- <4>[ 228.841686] unevictable:11770 dirty:0 writeback:0 unstable:0
- <4>[ 228.841687] free:53856 slab_reclaimable:2648 slab_unreclaimable:45377
- <4>[ 228.841688] mapped:1871 shmem:54 pagetables:1102 bounce:0
- <4>[ 228.842650] Node 0 DMA free:15744kB min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15356kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
- <4>[ 228.843494] lowmem_reserve[]: 0 2955 32245 32245
- <4>[ 228.844084] Node 0 DMA32 free:120544kB min:4120kB low:5148kB high:6180kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:4kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3026080kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:20kB slab_unreclaimable:17216kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
- <4>[ 228.844924] lowmem_reserve[]: 0 0 29290 29290
- <4>[ 228.845514] Node 0 Normal free:35820kB min:40868kB low:51084kB high:61300kB active_anon:35920kB inactive_anon:2284kB active_file:96kB inactive_file:872kB unevictable:44928kB isolated(anon):0kB isolated(file):0kB present:29992960kB mlocked:44928kB dirty:0kB writeback:0kB mapped:5332kB shmem:136kB slab_reclaimable:5612kB slab_unreclaimable:75628kB kernel_stack:4816kB pagetables:2012kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:512 all_unreclaimable? yes
- <4>[ 228.846369] lowmem_reserve[]: 0 0 0 0
- <4>[ 228.847023] Node 1 Normal free:43316kB min:45096kB low:56368kB high:67644kB active_anon:53216kB inactive_anon:3436kB active_file:16kB inactive_file:228kB unevictable:2152kB isolated(anon):0kB isolated(file):0kB present:33095680kB mlocked:2152kB dirty:0kB writeback:0kB mapped:2152kB shmem:80kB slab_reclaimable:4960kB slab_unreclaimable:88664kB kernel_stack:720kB pagetables:2396kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
- <4>[ 228.847866] lowmem_reserve[]: 0 0 0 0
- <4>[ 228.848457] Node 0 DMA: 2*4kB 1*8kB 1*16kB 1*32kB 1*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15744kB
- <4>[ 228.849803] Node 0 DMA32: 56*4kB 8*8kB 7*16kB 7*32kB 10*64kB 10*128kB 7*256kB 9*512kB 7*1024kB 5*2048kB 23*4096kB = 120560kB
- <4>[ 228.851151] Node 0 Normal: 899*4kB 606*8kB 347*16kB 181*32kB 65*64kB 13*128kB 5*256kB 1*512kB 1*1024kB 2*2048kB 1*4096kB = 36620kB
- <4>[ 228.852503] Node 1 Normal: 1492*4kB 734*8kB 466*16kB 269*32kB 104*64kB 21*128kB 1*256kB 0*512kB 0*1024kB 1*2048kB 1*4096kB = 43648kB
- <4>[ 228.853887] 2132 total pagecache pages
- <4>[ 228.854078] 0 pages in swap cache
- <4>[ 228.854264] Swap cache stats: add 0, delete 0, find 0/0
- <4>[ 228.854460] Free swap = 0kB
- <4>[ 228.854646] Total swap = 0kB
- <6>[ 229.019335] 16777215 pages RAM
- <6>[ 229.019525] 294628 pages reserved
- <6>[ 229.019714] 124114 pages shared
- <6>[ 229.019900] 16390921 pages non-shared
- <6>[ 229.020085] [ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
- <6>[ 229.020448] [ 1047] 0 1047 2797 302 2 -17 -1000 udevd
- <6>[ 229.020751] [ 3171] 0 3171 6909 183 3 -17 -1000 auditd
- <6>[ 229.021048] [ 3772] 0 3772 16018 260 0 -17 -1000 sshd
- <6>[ 229.021346] [ 3782] 0 3782 5522 219 1 0 0 xinetd
- <6>[ 229.021638] [ 3801] 0 3801 5053 327 19 0 0 cmproxyd
- <6>[ 229.021932] [ 3812] 38 3812 6484 298 19 0 0 ntpd
- <6>[ 229.022228] [ 3953] 0 3953 19669 496 1 0 0 master
- <6>[ 229.022525] [ 3961] 0 3961 29302 305 16 0 0 crond
- <6>[ 229.022815] [ 3963] 89 3963 19689 478 17 0 0 pickup
- <6>[ 229.023099] [ 3964] 89 3964 19706 478 17 0 0 qmgr
- <6>[ 229.023484] [ 3974] 0 3974 5363 115 1 0 0 atd
- <6>[ 229.023770] [ 4272] 0 4272 234055 3595 0 0 0 dsm_sa_datamgrd
- <6>[ 229.024056] [ 4552] 0 4552 72683 512 17 0 0 dsm_sa_eventmgr
- <6>[ 229.024344] [ 4613] 0 4613 125242 1356 9 0 0 dsm_sa_snmpd
- <6>[ 229.024641] [ 4643] 0 4643 33158 204 3 0 0 dsm_om_connsvcd
- <6>[ 229.026931] [ 4644] 0 4644 1217768 15607 1 0 0 dsm_om_connsvcd
- <6>[ 229.027231] [ 4800] 0 4800 140898 872 0 0 0 dsm_om_shrsvcd
- <6>[ 229.027532] [ 4835] 0 4835 10060 407 1 0 0 cmclconfd
- <6>[ 229.027832] [ 4842] 0 4842 21240 11772 16 0 0 cmcld
- <6>[ 229.028130] [ 4848] 0 4848 10060 397 2 0 0 cmclconfd
- <6>[ 229.028431] [ 4852] 0 4852 5055 330 2 0 0 cmserviced
- <6>[ 229.028733] [ 4854] 0 4854 4451 247 17 0 0 cmlogd
- <6>[ 229.029029] [ 4855] 0 4855 8906 375 1 0 0 cmfileassistd
- <6>[ 229.029331] [ 4856] 0 4856 5171 380 2 0 0 cmnetd
- <6>[ 229.029623] [ 4860] 0 4860 5050 302 0 0 0 cmresourced
- <6>[ 229.029917] [ 4864] 0 4864 10060 370 3 0 0 cmclconfd
- <6>[ 229.030210] [ 4924] 0 4924 1015 148 9 0 0 mingetty
- <6>[ 229.030505] [ 4926] 0 4926 1015 148 5 0 0 mingetty
- <6>[ 229.030796] [ 4928] 0 4928 1015 149 21 0 0 mingetty
- <6>[ 229.031088] [ 4930] 0 4930 1015 149 3 0 0 mingetty
- <6>[ 229.031388] [ 4932] 0 4932 1015 149 2 0 0 mingetty
- <6>[ 229.031685] [ 4934] 0 4934 1015 149 18 0 0 mingetty
- <6>[ 229.031979] [ 4936] 0 4936 2796 300 4 -17 -1000 udevd
- <6>[ 229.032277] [ 4937] 0 4937 2796 299 5 -17 -1000 udevd
- <6>[ 229.032577] [ 5060] 0 5060 23954 555 2 0 0 sshd
- <6>[ 229.032875] [ 5078] 1033 5078 23954 306 0 0 0 sshd
- <6>[ 229.033169] [ 5079] 1033 5079 27075 292 17 0 0 bash
- <3>[ 229.033466] Out of memory: Kill process 3782 (xinetd) score 1 or sacrifice child
- <3>[ 229.033765] Killed process 4835, UID 0, (cmclconfd) total-vm:40240kB, anon-rss:436kB, file-rss:1192kB
- <4>[ 229.034464] dsm_sa_snmpd invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0, oom_score_adj=0
- <6>[ 229.034769] dsm_sa_snmpd cpuset=/ mems_allowed=0-1
- <4>[ 229.034962] Pid: 4619, comm: dsm_sa_snmpd Tainted: G W --------------- 2.6.32-279.5.2.el6.x86_64 #1
- <4>[ 229.035265] Call Trace:
- <4>[ 229.035460] [<ffffffff810c4bf1>] ? cpuset_print_task_mems_allowed+0x91/0xb0
- <4>[ 229.035662] [<ffffffff81117360>] ? dump_header+0x90/0x1b0
- <4>[ 229.035858] [<ffffffff810e37de>] ? __delayacct_freepages_end+0x2e/0x30
- <4>[ 229.036055] [<ffffffff8121494c>] ? security_real_capable_noaudit+0x3c/0x70
- <4>[ 229.036250] [<ffffffff811177e2>] ? oom_kill_process+0x82/0x2a0
- <4>[ 229.036443] [<ffffffff81117721>] ? select_bad_process+0xe1/0x120
- <4>[ 229.036641] [<ffffffff81117c20>] ? out_of_memory+0x220/0x3c0
- <4>[ 229.036839] [<ffffffff8112793e>] ? __alloc_pages_nodemask+0x89e/0x940
- <4>[ 229.037036] [<ffffffff8115c45a>] ? alloc_pages_current+0xaa/0x110
- <4>[ 229.037227] [<ffffffff81114767>] ? __page_cache_alloc+0x87/0x90
- <4>[ 229.037417] [<ffffffff8112a38b>] ? __do_page_cache_readahead+0xdb/0x210
- <4>[ 229.037709] [<ffffffff8112a4e1>] ? ra_submit+0x21/0x30
- <4>[ 229.037897] [<ffffffff81115a93>] ? filemap_fault+0x4c3/0x500
- <4>[ 229.038086] [<ffffffff8113ee94>] ? __do_fault+0x54/0x510
- <4>[ 229.038275] [<ffffffff8113f447>] ? handle_pte_fault+0xf7/0xb50
- <4>[ 229.038466] [<ffffffff810629d3>] ? dequeue_entity+0x113/0x2e0
- <4>[ 229.038656] [<ffffffff81063c0b>] ? dequeue_task_fair+0x12b/0x130
- <4>[ 229.038851] [<ffffffff810097cc>] ? __switch_to+0x1ac/0x320
- <4>[ 229.039044] [<ffffffff81140084>] ? handle_mm_fault+0x1e4/0x2b0
- <4>[ 229.039240] [<ffffffff81097045>] ? __hrtimer_start_range_ns+0x1a5/0x470
- <4>[ 229.039439] [<ffffffff81044479>] ? __do_page_fault+0x139/0x480
- <4>[ 229.039634] [<ffffffff8109738f>] ? hrtimer_try_to_cancel+0x3f/0xd0
- <4>[ 229.039827] [<ffffffff81097442>] ? hrtimer_cancel+0x22/0x30
- <4>[ 229.040022] [<ffffffff814ff583>] ? do_nanosleep+0x93/0xc0
- <4>[ 229.040215] [<ffffffff81097514>] ? hrtimer_nanosleep+0xc4/0x180
- <4>[ 229.040409] [<ffffffff810962a0>] ? hrtimer_wakeup+0x0/0x30
- <4>[ 229.040609] [<ffffffff815034ee>] ? do_page_fault+0x3e/0xa0
- <4>[ 229.040803] [<ffffffff815008a5>] ? page_fault+0x25/0x30
- <6>[ 229.040997] Mem-Info:
- <4>[ 229.041181] Node 0 DMA per-cpu:
- <4>[ 229.041448] CPU 0: hi: 0, btch: 1 usd: 0
- <4>[ 229.041639] CPU 1: hi: 0, btch: 1 usd: 0
- <4>[ 229.041827] CPU 2: hi: 0, btch: 1 usd: 0
- <4>[ 229.042016] CPU 3: hi: 0, btch: 1 usd: 0
- <4>[ 229.042206] CPU 4: hi: 0, btch: 1 usd: 0
- <4>[ 229.042396] CPU 5: hi: 0, btch: 1 usd: 0
- <4>[ 229.042587] CPU 6: hi: 0, btch: 1 usd: 0
- <4>[ 229.042775] CPU 7: hi: 0, btch: 1 usd: 0
- <4>[ 229.042964] CPU 8: hi: 0, btch: 1 usd: 0
- <4>[ 229.043153] CPU 9: hi: 0, btch: 1 usd: 0
- <4>[ 229.043347] CPU 10: hi: 0, btch: 1 usd: 0
- <4>[ 229.043539] CPU 11: hi: 0, btch: 1 usd: 0
- <4>[ 229.043726] CPU 12: hi: 0, btch: 1 usd: 0
- <4>[ 229.043915] CPU 13: hi: 0, btch: 1 usd: 0
- <4>[ 229.044104] CPU 14: hi: 0, btch: 1 usd: 0
- <4>[ 229.044293] CPU 15: hi: 0, btch: 1 usd: 0
- <4>[ 229.044482] CPU 16: hi: 0, btch: 1 usd: 0
- <4>[ 229.044677] CPU 17: hi: 0, btch: 1 usd: 0
- <4>[ 229.044867] CPU 18: hi: 0, btch: 1 usd: 0
- <4>[ 229.045058] CPU 19: hi: 0, btch: 1 usd: 0
- <4>[ 229.045246] CPU 20: hi: 0, btch: 1 usd: 0
- <4>[ 229.045435] CPU 21: hi: 0, btch: 1 usd: 0
- <4>[ 229.045626] CPU 22: hi: 0, btch: 1 usd: 0
- <4>[ 229.045814] CPU 23: hi: 0, btch: 1 usd: 0
- <4>[ 229.046006] CPU 24: hi: 0, btch: 1 usd: 0
- <4>[ 229.046195] CPU 25: hi: 0, btch: 1 usd: 0
- <4>[ 229.046385] CPU 26: hi: 0, btch: 1 usd: 0
- <4>[ 229.046575] CPU 27: hi: 0, btch: 1 usd: 0
- <4>[ 229.046764] CPU 28: hi: 0, btch: 1 usd: 0
- <4>[ 229.046953] CPU 29: hi: 0, btch: 1 usd: 0
- <4>[ 229.047141] CPU 30: hi: 0, btch: 1 usd: 0
- <4>[ 229.047331] CPU 31: hi: 0, btch: 1 usd: 0
- <4>[ 229.047523] Node 0 DMA32 per-cpu:
- <4>[ 229.047789] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 229.047979] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 229.048168] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 229.048359] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 229.048553] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 229.048748] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 229.048942] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 229.049135] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 229.049326] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 229.049519] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 229.049707] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 229.049897] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 229.050088] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 229.050277] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 229.050467] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 229.050659] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 229.050848] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 229.051037] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 229.051227] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 229.051414] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 229.051601] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 229.051883] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 229.052068] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 229.052253] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 229.052437] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 229.052624] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 229.052808] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 229.052997] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 229.053189] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 229.053379] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 229.053572] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 229.053762] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 229.053952] Node 0 Normal per-cpu:
- <4>[ 229.054219] CPU 0: hi: 186, btch: 31 usd: 30
- <4>[ 229.054409] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 229.054601] CPU 2: hi: 186, btch: 31 usd: 26
- <4>[ 229.054790] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 229.054979] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 229.055169] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 229.055359] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 229.055549] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 229.055738] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 229.055925] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 229.056114] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 229.056303] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 229.056496] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 229.056687] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 229.056876] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 229.057064] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 229.057251] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 229.057440] CPU 17: hi: 186, btch: 31 usd: 127
- <4>[ 229.057630] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 229.057819] CPU 19: hi: 186, btch: 31 usd: 1
- <4>[ 229.058007] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 229.058197] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 229.058386] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 229.058578] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 229.058769] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 229.058960] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 229.059150] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 229.059340] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 229.059531] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 229.061666] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 229.061855] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 229.062045] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 229.062236] Node 1 Normal per-cpu:
- <4>[ 229.062506] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 229.062697] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 229.062886] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 229.063077] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 229.063267] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 229.063457] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 229.063649] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 229.063840] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 229.064029] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 229.064217] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 229.064409] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 229.064601] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 229.064793] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 229.064983] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 229.065173] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 229.065363] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 229.065554] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 229.065739] CPU 17: hi: 186, btch: 31 usd: 13
- <4>[ 229.065924] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 229.066202] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 229.066386] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 229.066573] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 229.066757] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 229.066942] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 229.067127] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 229.067317] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 229.067508] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 229.067701] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 229.067891] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 229.068081] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 229.068271] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 229.068461] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 229.068655] active_anon:22204 inactive_anon:1430 isolated_anon:0
- <4>[ 229.068656] active_file:28 inactive_file:276 isolated_file:0
- <4>[ 229.068657] unevictable:11770 dirty:0 writeback:0 unstable:0
- <4>[ 229.068658] free:53856 slab_reclaimable:2648 slab_unreclaimable:45377
- <4>[ 229.068659] mapped:1871 shmem:54 pagetables:1102 bounce:0
- <4>[ 229.069617] Node 0 DMA free:15744kB min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15356kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
- <4>[ 229.070451] lowmem_reserve[]: 0 2955 32245 32245
- <4>[ 229.071042] Node 0 DMA32 free:120544kB min:4120kB low:5148kB high:6180kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:4kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3026080kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:20kB slab_unreclaimable:17216kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
- <4>[ 229.071880] lowmem_reserve[]: 0 0 29290 29290
- <4>[ 229.072471] Node 0 Normal free:35820kB min:40868kB low:51084kB high:61300kB active_anon:35600kB inactive_anon:2284kB active_file:96kB inactive_file:872kB unevictable:44928kB isolated(anon):0kB isolated(file):0kB present:29992960kB mlocked:44928kB dirty:0kB writeback:0kB mapped:5332kB shmem:136kB slab_reclaimable:5612kB slab_unreclaimable:75628kB kernel_stack:4816kB pagetables:2012kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:512 all_unreclaimable? yes
- <4>[ 229.073329] lowmem_reserve[]: 0 0 0 0
- <4>[ 229.073921] Node 1 Normal free:43316kB min:45096kB low:56368kB high:67644kB active_anon:53216kB inactive_anon:3436kB active_file:16kB inactive_file:228kB unevictable:2152kB isolated(anon):0kB isolated(file):0kB present:33095680kB mlocked:2152kB dirty:0kB writeback:0kB mapped:2152kB shmem:80kB slab_reclaimable:4960kB slab_unreclaimable:88664kB kernel_stack:720kB pagetables:2396kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
- <4>[ 229.074766] lowmem_reserve[]: 0 0 0 0
- <4>[ 229.075354] Node 0 DMA: 2*4kB 1*8kB 1*16kB 1*32kB 1*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15744kB
- <4>[ 229.076703] Node 0 DMA32: 56*4kB 8*8kB 7*16kB 7*32kB 10*64kB 10*128kB 7*256kB 9*512kB 7*1024kB 5*2048kB 23*4096kB = 120560kB
- <4>[ 229.078051] Node 0 Normal: 898*4kB 605*8kB 348*16kB 181*32kB 65*64kB 14*128kB 4*256kB 1*512kB 1*1024kB 2*2048kB 1*4096kB = 36496kB
- <4>[ 229.079405] Node 1 Normal: 1492*4kB 734*8kB 466*16kB 269*32kB 104*64kB 21*128kB 1*256kB 0*512kB 0*1024kB 1*2048kB 1*4096kB = 43648kB
- <4>[ 229.080836] 2132 total pagecache pages
- <4>[ 229.081018] 0 pages in swap cache
- <4>[ 229.081200] Swap cache stats: add 0, delete 0, find 0/0
- <4>[ 229.081386] Free swap = 0kB
- <4>[ 229.081571] Total swap = 0kB
- <6>[ 229.246016] 16777215 pages RAM
- <6>[ 229.246207] 294628 pages reserved
- <6>[ 229.246393] 123796 pages shared
- <6>[ 229.246577] 16390800 pages non-shared
- <6>[ 229.246763] [ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
- <6>[ 229.247125] [ 1047] 0 1047 2797 302 2 -17 -1000 udevd
- <6>[ 229.247429] [ 3171] 0 3171 6909 183 3 -17 -1000 auditd
- <6>[ 229.247722] [ 3772] 0 3772 16018 260 0 -17 -1000 sshd
- <6>[ 229.248017] [ 3782] 0 3782 5522 219 28 0 0 xinetd
- <6>[ 229.248311] [ 3801] 0 3801 5053 327 19 0 0 cmproxyd
- <6>[ 229.248605] [ 3812] 38 3812 6484 298 12 0 0 ntpd
- <6>[ 229.248897] [ 3953] 0 3953 19669 496 1 0 0 master
- <6>[ 229.249191] [ 3961] 0 3961 29302 305 16 0 0 crond
- <6>[ 229.249484] [ 3963] 89 3963 19689 478 17 0 0 pickup
- <6>[ 229.249775] [ 3964] 89 3964 19706 478 17 0 0 qmgr
- <6>[ 229.250066] [ 3974] 0 3974 5363 115 1 0 0 atd
- <6>[ 229.250360] [ 4272] 0 4272 234055 3595 0 0 0 dsm_sa_datamgrd
- <6>[ 229.250650] [ 4552] 0 4552 72683 512 17 0 0 dsm_sa_eventmgr
- <6>[ 229.250934] [ 4613] 0 4613 125242 1356 9 0 0 dsm_sa_snmpd
- <6>[ 229.251244] [ 4643] 0 4643 33158 204 3 0 0 dsm_om_connsvcd
- <6>[ 229.251531] [ 4644] 0 4644 1217768 15607 1 0 0 dsm_om_connsvcd
- <6>[ 229.251817] [ 4800] 0 4800 140898 872 0 0 0 dsm_om_shrsvcd
- <6>[ 229.252103] [ 4842] 0 4842 21240 11772 16 0 0 cmcld
- <6>[ 229.252398] [ 4848] 0 4848 10060 397 2 0 0 cmclconfd
- <6>[ 229.252690] [ 4852] 0 4852 5055 330 2 0 0 cmserviced
- <6>[ 229.252990] [ 4854] 0 4854 4451 247 17 0 0 cmlogd
- <6>[ 229.253289] [ 4855] 0 4855 8906 375 1 0 0 cmfileassistd
- <6>[ 229.253589] [ 4856] 0 4856 5171 380 2 0 0 cmnetd
- <6>[ 229.253886] [ 4860] 0 4860 5050 302 0 0 0 cmresourced
- <6>[ 229.254184] [ 4864] 0 4864 10060 370 3 0 0 cmclconfd
- <6>[ 229.254479] [ 4924] 0 4924 1015 148 9 0 0 mingetty
- <6>[ 229.254773] [ 4926] 0 4926 1015 148 5 0 0 mingetty
- <6>[ 229.255066] [ 4928] 0 4928 1015 149 21 0 0 mingetty
- <6>[ 229.255362] [ 4930] 0 4930 1015 149 3 0 0 mingetty
- <6>[ 229.255656] [ 4932] 0 4932 1015 149 2 0 0 mingetty
- <6>[ 229.255952] [ 4934] 0 4934 1015 149 18 0 0 mingetty
- <6>[ 229.256246] [ 4936] 0 4936 2796 300 4 -17 -1000 udevd
- <6>[ 229.256540] [ 4937] 0 4937 2796 299 5 -17 -1000 udevd
- <6>[ 229.256832] [ 5060] 0 5060 23954 555 2 0 0 sshd
- <6>[ 229.257125] [ 5078] 1033 5078 23954 306 0 0 0 sshd
- <6>[ 229.257418] [ 5079] 1033 5079 27075 292 17 0 0 bash
- <3>[ 229.257710] Out of memory: Kill process 3782 (xinetd) score 1 or sacrifice child
- <3>[ 229.258002] Killed process 4848, UID 0, (cmclconfd) total-vm:40240kB, anon-rss:436kB, file-rss:1152kB
- <4>[ 229.259475] dsm_sa_snmpd invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0, oom_score_adj=0
- <6>[ 229.259770] dsm_sa_snmpd cpuset=/ mems_allowed=0-1
- <4>[ 229.259964] Pid: 4619, comm: dsm_sa_snmpd Tainted: G W --------------- 2.6.32-279.5.2.el6.x86_64 #1
- <4>[ 229.260266] Call Trace:
- <4>[ 229.260462] [<ffffffff810c4bf1>] ? cpuset_print_task_mems_allowed+0x91/0xb0
- <4>[ 229.260660] [<ffffffff81117360>] ? dump_header+0x90/0x1b0
- <4>[ 229.260858] [<ffffffff810e37de>] ? __delayacct_freepages_end+0x2e/0x30
- <4>[ 229.261055] [<ffffffff8121494c>] ? security_real_capable_noaudit+0x3c/0x70
- <4>[ 229.261253] [<ffffffff811177e2>] ? oom_kill_process+0x82/0x2a0
- <4>[ 229.261449] [<ffffffff81117721>] ? select_bad_process+0xe1/0x120
- <4>[ 229.261646] [<ffffffff81117c20>] ? out_of_memory+0x220/0x3c0
- <4>[ 229.261844] [<ffffffff8112793e>] ? __alloc_pages_nodemask+0x89e/0x940
- <4>[ 229.262040] [<ffffffff8115c45a>] ? alloc_pages_current+0xaa/0x110
- <4>[ 229.262237] [<ffffffff81114767>] ? __page_cache_alloc+0x87/0x90
- <4>[ 229.264431] [<ffffffff8112a38b>] ? __do_page_cache_readahead+0xdb/0x210
- <4>[ 229.264626] [<ffffffff8112a4e1>] ? ra_submit+0x21/0x30
- <4>[ 229.264817] [<ffffffff81115a93>] ? filemap_fault+0x4c3/0x500
- <4>[ 229.265007] [<ffffffff8113ee94>] ? __do_fault+0x54/0x510
- <4>[ 229.265286] [<ffffffff8113f447>] ? handle_pte_fault+0xf7/0xb50
- <4>[ 229.265479] [<ffffffff810629d3>] ? dequeue_entity+0x113/0x2e0
- <4>[ 229.265668] [<ffffffff81063c0b>] ? dequeue_task_fair+0x12b/0x130
- <4>[ 229.265859] [<ffffffff810097cc>] ? __switch_to+0x1ac/0x320
- <4>[ 229.266046] [<ffffffff81140084>] ? handle_mm_fault+0x1e4/0x2b0
- <4>[ 229.266236] [<ffffffff81097045>] ? __hrtimer_start_range_ns+0x1a5/0x470
- <4>[ 229.266437] [<ffffffff81044479>] ? __do_page_fault+0x139/0x480
- <4>[ 229.266629] [<ffffffff8109738f>] ? hrtimer_try_to_cancel+0x3f/0xd0
- <4>[ 229.266823] [<ffffffff81097442>] ? hrtimer_cancel+0x22/0x30
- <4>[ 229.267017] [<ffffffff814ff583>] ? do_nanosleep+0x93/0xc0
- <4>[ 229.267208] [<ffffffff81097514>] ? hrtimer_nanosleep+0xc4/0x180
- <4>[ 229.267403] [<ffffffff810962a0>] ? hrtimer_wakeup+0x0/0x30
- <4>[ 229.267597] [<ffffffff815034ee>] ? do_page_fault+0x3e/0xa0
- <4>[ 229.267789] [<ffffffff815008a5>] ? page_fault+0x25/0x30
- <6>[ 229.267982] Mem-Info:
- <4>[ 229.268168] Node 0 DMA per-cpu:
- <4>[ 229.268438] CPU 0: hi: 0, btch: 1 usd: 0
- <4>[ 229.268629] CPU 1: hi: 0, btch: 1 usd: 0
- <4>[ 229.268820] CPU 2: hi: 0, btch: 1 usd: 0
- <4>[ 229.269009] CPU 3: hi: 0, btch: 1 usd: 0
- <4>[ 229.269198] CPU 4: hi: 0, btch: 1 usd: 0
- <4>[ 229.269389] CPU 5: hi: 0, btch: 1 usd: 0
- <4>[ 229.269578] CPU 6: hi: 0, btch: 1 usd: 0
- <4>[ 229.269767] CPU 7: hi: 0, btch: 1 usd: 0
- <4>[ 229.269956] CPU 8: hi: 0, btch: 1 usd: 0
- <4>[ 229.270144] CPU 9: hi: 0, btch: 1 usd: 0
- <4>[ 229.270336] CPU 10: hi: 0, btch: 1 usd: 0
- <4>[ 229.270524] CPU 11: hi: 0, btch: 1 usd: 0
- <4>[ 229.270714] CPU 12: hi: 0, btch: 1 usd: 0
- <4>[ 229.270904] CPU 13: hi: 0, btch: 1 usd: 0
- <4>[ 229.271092] CPU 14: hi: 0, btch: 1 usd: 0
- <4>[ 229.271281] CPU 15: hi: 0, btch: 1 usd: 0
- <4>[ 229.271472] CPU 16: hi: 0, btch: 1 usd: 0
- <4>[ 229.271661] CPU 17: hi: 0, btch: 1 usd: 0
- <4>[ 229.271849] CPU 18: hi: 0, btch: 1 usd: 0
- <4>[ 229.272040] CPU 19: hi: 0, btch: 1 usd: 0
- <4>[ 229.272230] CPU 20: hi: 0, btch: 1 usd: 0
- <4>[ 229.272424] CPU 21: hi: 0, btch: 1 usd: 0
- <4>[ 229.272614] CPU 22: hi: 0, btch: 1 usd: 0
- <4>[ 229.272802] CPU 23: hi: 0, btch: 1 usd: 0
- <4>[ 229.272994] CPU 24: hi: 0, btch: 1 usd: 0
- <4>[ 229.273184] CPU 25: hi: 0, btch: 1 usd: 0
- <4>[ 229.273376] CPU 26: hi: 0, btch: 1 usd: 0
- <4>[ 229.273564] CPU 27: hi: 0, btch: 1 usd: 0
- <4>[ 229.273753] CPU 28: hi: 0, btch: 1 usd: 0
- <4>[ 229.273942] CPU 29: hi: 0, btch: 1 usd: 0
- <4>[ 229.274131] CPU 30: hi: 0, btch: 1 usd: 0
- <4>[ 229.274319] CPU 31: hi: 0, btch: 1 usd: 0
- <4>[ 229.274509] Node 0 DMA32 per-cpu:
- <4>[ 229.274773] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 229.274962] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 229.275150] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 229.275340] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 229.275529] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 229.275718] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 229.275906] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 229.276097] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 229.276289] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 229.276484] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 229.276677] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 229.276866] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 229.277056] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 229.277246] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 229.277437] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 229.277625] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 229.277815] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 229.278005] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 229.278195] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 229.278386] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 229.278574] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 229.278764] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 229.278955] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 229.279139] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 229.279326] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 229.279600] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 229.279784] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 229.279968] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 229.280153] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 229.280339] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 229.280524] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 229.280715] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 229.280904] Node 0 Normal per-cpu:
- <4>[ 229.281171] CPU 0: hi: 186, btch: 31 usd: 30
- <4>[ 229.281364] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 229.281552] CPU 2: hi: 186, btch: 31 usd: 165
- <4>[ 229.281742] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 229.281932] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 229.282122] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 229.282311] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 229.282502] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 229.282692] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 229.282882] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 229.283077] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 229.283266] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 229.283457] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 229.283646] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 229.283834] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 229.284022] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 229.284210] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 229.284401] CPU 17: hi: 186, btch: 31 usd: 127
- <4>[ 229.284588] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 229.284776] CPU 19: hi: 186, btch: 31 usd: 1
- <4>[ 229.284965] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 229.285153] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 229.285344] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 229.285533] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 229.285722] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 229.285911] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 229.286099] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 229.286287] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 229.286481] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 229.286672] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 229.286863] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 229.287052] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 229.287240] Node 1 Normal per-cpu:
- <4>[ 229.287508] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 229.287696] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 229.287885] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 229.288073] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 229.288261] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 229.288452] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 229.288641] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 229.288828] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 229.289017] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 229.289206] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 229.289399] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 229.289589] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 229.289777] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 229.289964] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 229.290153] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 229.290343] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 229.290534] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 229.290727] CPU 17: hi: 186, btch: 31 usd: 13
- <4>[ 229.290917] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 229.291107] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 229.291294] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 229.291485] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 229.291672] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 229.291861] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 229.292049] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 229.292238] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 229.292429] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 229.292618] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 229.292807] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 229.292998] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 229.293188] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 229.293375] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 229.293562] active_anon:22124 inactive_anon:1430 isolated_anon:0
- <4>[ 229.293563] active_file:28 inactive_file:276 isolated_file:0
- <4>[ 229.293564] unevictable:11770 dirty:0 writeback:0 unstable:0
- <4>[ 229.293565] free:53856 slab_reclaimable:2648 slab_unreclaimable:45377
- <4>[ 229.293566] mapped:1871 shmem:54 pagetables:1102 bounce:0
- <4>[ 229.294574] Node 0 DMA free:15744kB min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15356kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
- <4>[ 229.295410] lowmem_reserve[]: 0 2955 32245 32245
- <4>[ 229.295999] Node 0 DMA32 free:120544kB min:4120kB low:5148kB high:6180kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:4kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3026080kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:20kB slab_unreclaimable:17216kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
- <4>[ 229.296846] lowmem_reserve[]: 0 0 29290 29290
- <4>[ 229.297439] Node 0 Normal free:35820kB min:40868kB low:51084kB high:61300kB active_anon:35280kB inactive_anon:2284kB active_file:96kB inactive_file:872kB unevictable:44928kB isolated(anon):0kB isolated(file):0kB present:29992960kB mlocked:44928kB dirty:0kB writeback:0kB mapped:5332kB shmem:136kB slab_reclaimable:5612kB slab_unreclaimable:75628kB kernel_stack:4816kB pagetables:2012kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:512 all_unreclaimable? yes
- <4>[ 229.298284] lowmem_reserve[]: 0 0 0 0
- <4>[ 229.298873] Node 1 Normal free:43316kB min:45096kB low:56368kB high:67644kB active_anon:53216kB inactive_anon:3436kB active_file:16kB inactive_file:228kB unevictable:2152kB isolated(anon):0kB isolated(file):0kB present:33095680kB mlocked:2152kB dirty:0kB writeback:0kB mapped:2152kB shmem:80kB slab_reclaimable:4960kB slab_unreclaimable:88664kB kernel_stack:720kB pagetables:2396kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
- <4>[ 229.301678] lowmem_reserve[]: 0 0 0 0
- <4>[ 229.302265] Node 0 DMA: 2*4kB 1*8kB 1*16kB 1*32kB 1*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15744kB
- <4>[ 229.303615] Node 0 DMA32: 56*4kB 8*8kB 7*16kB 7*32kB 10*64kB 10*128kB 7*256kB 9*512kB 7*1024kB 5*2048kB 23*4096kB = 120560kB
- <4>[ 229.304960] Node 0 Normal: 898*4kB 605*8kB 348*16kB 181*32kB 65*64kB 14*128kB 4*256kB 1*512kB 1*1024kB 2*2048kB 1*4096kB = 36496kB
- <4>[ 229.306310] Node 1 Normal: 1492*4kB 734*8kB 466*16kB 269*32kB 104*64kB 21*128kB 1*256kB 0*512kB 0*1024kB 1*2048kB 1*4096kB = 43648kB
- <4>[ 229.307656] 2132 total pagecache pages
- <4>[ 229.307838] 0 pages in swap cache
- <4>[ 229.308049] Swap cache stats: add 0, delete 0, find 0/0
- <4>[ 229.308234] Free swap = 0kB
- <4>[ 229.308414] Total swap = 0kB
- <6>[ 229.472849] 16777215 pages RAM
- <6>[ 229.473039] 294628 pages reserved
- <6>[ 229.473226] 123508 pages shared
- <6>[ 229.473415] 16390660 pages non-shared
- <6>[ 229.473604] [ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
- <6>[ 229.473965] [ 1047] 0 1047 2797 302 2 -17 -1000 udevd
- <6>[ 229.474266] [ 3171] 0 3171 6909 183 3 -17 -1000 auditd
- <6>[ 229.474560] [ 3772] 0 3772 16018 260 0 -17 -1000 sshd
- <6>[ 229.474854] [ 3782] 0 3782 5522 219 28 0 0 xinetd
- <6>[ 229.475148] [ 3801] 0 3801 5053 327 19 0 0 cmproxyd
- <6>[ 229.475443] [ 3812] 38 3812 6484 298 12 0 0 ntpd
- <6>[ 229.475738] [ 3953] 0 3953 19669 496 1 0 0 master
- <6>[ 229.476029] [ 3961] 0 3961 29302 305 16 0 0 crond
- <6>[ 229.476323] [ 3963] 89 3963 19689 478 17 0 0 pickup
- <6>[ 229.476614] [ 3964] 89 3964 19706 478 17 0 0 qmgr
- <6>[ 229.476906] [ 3974] 0 3974 5363 115 1 0 0 atd
- <6>[ 229.477199] [ 4272] 0 4272 234055 3595 0 0 0 dsm_sa_datamgrd
- <6>[ 229.477494] [ 4552] 0 4552 72683 512 17 0 0 dsm_sa_eventmgr
- <6>[ 229.477787] [ 4613] 0 4613 125242 1356 9 0 0 dsm_sa_snmpd
- <6>[ 229.478082] [ 4643] 0 4643 33158 204 3 0 0 dsm_om_connsvcd
- <6>[ 229.478369] [ 4644] 0 4644 1217768 15607 1 0 0 dsm_om_connsvcd
- <6>[ 229.478754] [ 4800] 0 4800 140898 872 0 0 0 dsm_om_shrsvcd
- <6>[ 229.479040] [ 4842] 0 4842 21240 11772 16 0 0 cmcld
- <6>[ 229.479326] [ 4852] 0 4852 5055 330 2 0 0 cmserviced
- <6>[ 229.479610] [ 4854] 0 4854 4451 247 17 0 0 cmlogd
- <6>[ 229.479901] [ 4855] 0 4855 8906 375 1 0 0 cmfileassistd
- <6>[ 229.480196] [ 4856] 0 4856 5171 380 2 0 0 cmnetd
- <6>[ 229.480489] [ 4860] 0 4860 5050 302 0 0 0 cmresourced
- <6>[ 229.480785] [ 4864] 0 4864 10060 370 3 0 0 cmclconfd
- <6>[ 229.481082] [ 4924] 0 4924 1015 148 9 0 0 mingetty
- <6>[ 229.481379] [ 4926] 0 4926 1015 148 5 0 0 mingetty
- <6>[ 229.481671] [ 4928] 0 4928 1015 149 21 0 0 mingetty
- <6>[ 229.481965] [ 4930] 0 4930 1015 149 3 0 0 mingetty
- <6>[ 229.482259] [ 4932] 0 4932 1015 149 2 0 0 mingetty
- <6>[ 229.482551] [ 4934] 0 4934 1015 149 18 0 0 mingetty
- <6>[ 229.482846] [ 4936] 0 4936 2796 300 4 -17 -1000 udevd
- <6>[ 229.483141] [ 4937] 0 4937 2796 299 5 -17 -1000 udevd
- <6>[ 229.483438] [ 5060] 0 5060 23954 555 2 0 0 sshd
- <6>[ 229.483734] [ 5078] 1033 5078 23954 306 0 0 0 sshd
- <6>[ 229.484027] [ 5079] 1033 5079 27075 292 17 0 0 bash
- <3>[ 229.484321] Out of memory: Kill process 3782 (xinetd) score 1 or sacrifice child
- <3>[ 229.484613] Killed process 4864, UID 0, (cmclconfd) total-vm:40240kB, anon-rss:364kB, file-rss:1116kB
- <4>[ 229.486314] dsm_sa_snmpd invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0, oom_score_adj=0
- <6>[ 229.486613] dsm_sa_snmpd cpuset=/ mems_allowed=0-1
- <4>[ 229.486804] Pid: 4619, comm: dsm_sa_snmpd Tainted: G W --------------- 2.6.32-279.5.2.el6.x86_64 #1
- <4>[ 229.487102] Call Trace:
- <4>[ 229.487297] [<ffffffff810c4bf1>] ? cpuset_print_task_mems_allowed+0x91/0xb0
- <4>[ 229.487493] [<ffffffff81117360>] ? dump_header+0x90/0x1b0
- <4>[ 229.487691] [<ffffffff810e37de>] ? __delayacct_freepages_end+0x2e/0x30
- <4>[ 229.487888] [<ffffffff8121494c>] ? security_real_capable_noaudit+0x3c/0x70
- <4>[ 229.488082] [<ffffffff811177e2>] ? oom_kill_process+0x82/0x2a0
- <4>[ 229.488278] [<ffffffff81117721>] ? select_bad_process+0xe1/0x120
- <4>[ 229.488471] [<ffffffff81117c20>] ? out_of_memory+0x220/0x3c0
- <4>[ 229.488674] [<ffffffff8112793e>] ? __alloc_pages_nodemask+0x89e/0x940
- <4>[ 229.488872] [<ffffffff8115c45a>] ? alloc_pages_current+0xaa/0x110
- <4>[ 229.489070] [<ffffffff81114767>] ? __page_cache_alloc+0x87/0x90
- <4>[ 229.489267] [<ffffffff8112a38b>] ? __do_page_cache_readahead+0xdb/0x210
- <4>[ 229.489463] [<ffffffff8112a4e1>] ? ra_submit+0x21/0x30
- <4>[ 229.489657] [<ffffffff81115a93>] ? filemap_fault+0x4c3/0x500
- <4>[ 229.489851] [<ffffffff8113ee94>] ? __do_fault+0x54/0x510
- <4>[ 229.490044] [<ffffffff8113f447>] ? handle_pte_fault+0xf7/0xb50
- <4>[ 229.490241] [<ffffffff810629d3>] ? dequeue_entity+0x113/0x2e0
- <4>[ 229.490436] [<ffffffff81063c0b>] ? dequeue_task_fair+0x12b/0x130
- <4>[ 229.490632] [<ffffffff810097cc>] ? __switch_to+0x1ac/0x320
- <4>[ 229.490824] [<ffffffff81140084>] ? handle_mm_fault+0x1e4/0x2b0
- <4>[ 229.491019] [<ffffffff81097045>] ? __hrtimer_start_range_ns+0x1a5/0x470
- <4>[ 229.491219] [<ffffffff81044479>] ? __do_page_fault+0x139/0x480
- <4>[ 229.491412] [<ffffffff8109738f>] ? hrtimer_try_to_cancel+0x3f/0xd0
- <4>[ 229.491606] [<ffffffff81097442>] ? hrtimer_cancel+0x22/0x30
- <4>[ 229.491804] [<ffffffff814ff583>] ? do_nanosleep+0x93/0xc0
- <4>[ 229.491998] [<ffffffff81097514>] ? hrtimer_nanosleep+0xc4/0x180
- <4>[ 229.492193] [<ffffffff810962a0>] ? hrtimer_wakeup+0x0/0x30
- <4>[ 229.492386] [<ffffffff815034ee>] ? do_page_fault+0x3e/0xa0
- <4>[ 229.492574] [<ffffffff815008a5>] ? page_fault+0x25/0x30
- <6>[ 229.492761] Mem-Info:
- <4>[ 229.492998] Node 0 DMA per-cpu:
- <4>[ 229.493262] CPU 0: hi: 0, btch: 1 usd: 0
- <4>[ 229.493446] CPU 1: hi: 0, btch: 1 usd: 0
- <4>[ 229.493631] CPU 2: hi: 0, btch: 1 usd: 0
- <4>[ 229.493816] CPU 3: hi: 0, btch: 1 usd: 0
- <4>[ 229.494002] CPU 4: hi: 0, btch: 1 usd: 0
- <4>[ 229.494192] CPU 5: hi: 0, btch: 1 usd: 0
- <4>[ 229.494380] CPU 6: hi: 0, btch: 1 usd: 0
- <4>[ 229.494570] CPU 7: hi: 0, btch: 1 usd: 0
- <4>[ 229.494758] CPU 8: hi: 0, btch: 1 usd: 0
- <4>[ 229.494947] CPU 9: hi: 0, btch: 1 usd: 0
- <4>[ 229.495135] CPU 10: hi: 0, btch: 1 usd: 0
- <4>[ 229.495326] CPU 11: hi: 0, btch: 1 usd: 0
- <4>[ 229.495514] CPU 12: hi: 0, btch: 1 usd: 0
- <4>[ 229.495703] CPU 13: hi: 0, btch: 1 usd: 0
- <4>[ 229.495892] CPU 14: hi: 0, btch: 1 usd: 0
- <4>[ 229.496085] CPU 15: hi: 0, btch: 1 usd: 0
- <4>[ 229.496282] CPU 16: hi: 0, btch: 1 usd: 0
- <4>[ 229.496474] CPU 17: hi: 0, btch: 1 usd: 0
- <4>[ 229.496663] CPU 18: hi: 0, btch: 1 usd: 0
- <4>[ 229.496852] CPU 19: hi: 0, btch: 1 usd: 0
- <4>[ 229.497040] CPU 20: hi: 0, btch: 1 usd: 0
- <4>[ 229.497231] CPU 21: hi: 0, btch: 1 usd: 0
- <4>[ 229.497419] CPU 22: hi: 0, btch: 1 usd: 0
- <4>[ 229.497608] CPU 23: hi: 0, btch: 1 usd: 0
- <4>[ 229.497796] CPU 24: hi: 0, btch: 1 usd: 0
- <4>[ 229.497985] CPU 25: hi: 0, btch: 1 usd: 0
- <4>[ 229.498175] CPU 26: hi: 0, btch: 1 usd: 0
- <4>[ 229.498364] CPU 27: hi: 0, btch: 1 usd: 0
- <4>[ 229.498554] CPU 28: hi: 0, btch: 1 usd: 0
- <4>[ 229.498743] CPU 29: hi: 0, btch: 1 usd: 0
- <4>[ 229.498931] CPU 30: hi: 0, btch: 1 usd: 0
- <4>[ 229.499119] CPU 31: hi: 0, btch: 1 usd: 0
- <4>[ 229.499308] Node 0 DMA32 per-cpu:
- <4>[ 229.499574] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 229.499764] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 229.499954] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 229.500145] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 229.500340] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 229.500533] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 229.500722] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 229.500911] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 229.501100] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 229.501291] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 229.501480] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 229.501668] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 229.501856] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 229.502045] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 229.504224] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 229.504415] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 229.504604] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 229.504795] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 229.504984] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 229.505177] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 229.505369] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 229.505559] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 229.505750] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 229.505939] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 229.506129] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 229.506320] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 229.506512] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 229.506697] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 229.506882] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 229.507168] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 229.507352] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 229.507536] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 229.507720] Node 0 Normal per-cpu:
- <4>[ 229.507981] CPU 0: hi: 186, btch: 31 usd: 30
- <4>[ 229.508168] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 229.508357] CPU 2: hi: 186, btch: 31 usd: 166
- <4>[ 229.508547] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 229.508737] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 229.508926] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 229.509116] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 229.509306] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 229.509494] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 229.509683] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 229.509873] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 229.510064] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 229.510256] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 229.510448] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 229.510637] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 229.510826] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 229.511017] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 229.511208] CPU 17: hi: 186, btch: 31 usd: 127
- <4>[ 229.511400] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 229.511590] CPU 19: hi: 186, btch: 31 usd: 1
- <4>[ 229.511780] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 229.511970] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 229.512158] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 229.512351] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 229.512540] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 229.512730] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 229.512919] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 229.513110] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 229.513301] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 229.513489] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 229.513678] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 229.513869] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 229.514059] Node 1 Normal per-cpu:
- <4>[ 229.514330] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 229.514521] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 229.514712] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 229.514904] CPU 3: hi: 186, btch: 31 usd: 122
- <4>[ 229.515092] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 229.515286] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 229.515475] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 229.515664] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 229.515854] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 229.516044] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 229.516237] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 229.516425] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 229.516616] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 229.516808] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 229.516998] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 229.517190] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 229.517381] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 229.517572] CPU 17: hi: 186, btch: 31 usd: 13
- <4>[ 229.517762] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 229.517952] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 229.518145] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 229.518341] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 229.518532] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 229.518721] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 229.518910] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 229.519098] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 229.519290] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 229.519477] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 229.519668] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 229.519857] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 229.520045] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 229.520237] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 229.520427] active_anon:22035 inactive_anon:1430 isolated_anon:0
- <4>[ 229.520428] active_file:29 inactive_file:319 isolated_file:0
- <4>[ 229.520429] unevictable:11770 dirty:0 writeback:0 unstable:0
- <4>[ 229.520430] free:53814 slab_reclaimable:2648 slab_unreclaimable:45377
- <4>[ 229.520431] mapped:1867 shmem:54 pagetables:1102 bounce:0
- <4>[ 229.521456] Node 0 DMA free:15744kB min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15356kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
- <4>[ 229.522265] lowmem_reserve[]: 0 2955 32245 32245
- <4>[ 229.522857] Node 0 DMA32 free:120548kB min:4120kB low:5148kB high:6180kB active_anon:0kB inactive_anon:0kB active_file:4kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3026080kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:20kB slab_unreclaimable:17216kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:1 all_unreclaimable? no
- <4>[ 229.523694] lowmem_reserve[]: 0 0 29290 29290
- <4>[ 229.524285] Node 0 Normal free:35648kB min:40868kB low:51084kB high:61300kB active_anon:35280kB inactive_anon:2284kB active_file:96kB inactive_file:1048kB unevictable:44928kB isolated(anon):0kB isolated(file):0kB present:29992960kB mlocked:44928kB dirty:0kB writeback:0kB mapped:5316kB shmem:136kB slab_reclaimable:5612kB slab_unreclaimable:75628kB kernel_stack:4816kB pagetables:2012kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:512 all_unreclaimable? yes
- <4>[ 229.525143] lowmem_reserve[]: 0 0 0 0
- <4>[ 229.525733] Node 1 Normal free:43316kB min:45096kB low:56368kB high:67644kB active_anon:52860kB inactive_anon:3436kB active_file:16kB inactive_file:228kB unevictable:2152kB isolated(anon):0kB isolated(file):0kB present:33095680kB mlocked:2152kB dirty:0kB writeback:0kB mapped:2152kB shmem:80kB slab_reclaimable:4960kB slab_unreclaimable:88664kB kernel_stack:720kB pagetables:2396kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
- <4>[ 229.526577] lowmem_reserve[]: 0 0 0 0
- <4>[ 229.527167] Node 0 DMA: 2*4kB 1*8kB 1*16kB 1*32kB 1*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15744kB
- <4>[ 229.528516] Node 0 DMA32: 56*4kB 8*8kB 7*16kB 7*32kB 10*64kB 10*128kB 7*256kB 9*512kB 7*1024kB 5*2048kB 23*4096kB = 120560kB
- <4>[ 229.529865] Node 0 Normal: 898*4kB 605*8kB 348*16kB 181*32kB 65*64kB 14*128kB 4*256kB 1*512kB 1*1024kB 2*2048kB 1*4096kB = 36496kB
- <4>[ 229.531221] Node 1 Normal: 1492*4kB 734*8kB 466*16kB 269*32kB 104*64kB 21*128kB 1*256kB 0*512kB 0*1024kB 1*2048kB 1*4096kB = 43648kB
- <4>[ 229.532575] 2147 total pagecache pages
- <4>[ 229.532761] 0 pages in swap cache
- <4>[ 229.532948] Swap cache stats: add 0, delete 0, find 0/0
- <4>[ 229.533136] Free swap = 0kB
- <4>[ 229.533322] Total swap = 0kB
- <6>[ 229.697841] 16777215 pages RAM
- <6>[ 229.698034] 294628 pages reserved
- <6>[ 229.698220] 123229 pages shared
- <6>[ 229.698406] 16390538 pages non-shared
- <6>[ 229.698592] [ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
- <6>[ 229.698953] [ 1047] 0 1047 2797 302 2 -17 -1000 udevd
- <6>[ 229.699261] [ 3171] 0 3171 6909 183 3 -17 -1000 auditd
- <6>[ 229.699559] [ 3772] 0 3772 16018 260 0 -17 -1000 sshd
- <6>[ 229.699853] [ 3782] 0 3782 5522 219 28 0 0 xinetd
- <6>[ 229.700150] [ 3801] 0 3801 5053 327 19 0 0 cmproxyd
- <6>[ 229.700445] [ 3812] 38 3812 6484 298 12 0 0 ntpd
- <6>[ 229.700759] [ 3953] 0 3953 19669 496 1 0 0 master
- <6>[ 229.701057] [ 3961] 0 3961 29302 305 16 0 0 crond
- <6>[ 229.701353] [ 3963] 89 3963 19689 478 17 0 0 pickup
- <6>[ 229.701648] [ 3964] 89 3964 19706 478 17 0 0 qmgr
- <6>[ 229.701953] [ 3974] 0 3974 5363 115 1 0 0 atd
- <6>[ 229.702250] [ 4272] 0 4272 234055 3595 0 0 0 dsm_sa_datamgrd
- <6>[ 229.702551] [ 4552] 0 4552 72683 512 17 0 0 dsm_sa_eventmgr
- <6>[ 229.702850] [ 4613] 0 4613 125242 1356 9 0 0 dsm_sa_snmpd
- <6>[ 229.703154] [ 4643] 0 4643 33158 204 3 0 0 dsm_om_connsvcd
- <6>[ 229.703453] [ 4644] 0 4644 1217768 15607 1 0 0 dsm_om_connsvcd
- <6>[ 229.703753] [ 4800] 0 4800 140898 872 0 0 0 dsm_om_shrsvcd
- <6>[ 229.704053] [ 4842] 0 4842 21240 11772 16 0 0 cmcld
- <6>[ 229.704346] [ 4852] 0 4852 5055 330 2 0 0 cmserviced
- <6>[ 229.704651] [ 4854] 0 4854 4451 247 17 0 0 cmlogd
- <6>[ 229.704951] [ 4855] 0 4855 8906 375 1 0 0 cmfileassistd
- <6>[ 229.705251] [ 4856] 0 4856 5171 380 2 0 0 cmnetd
- <6>[ 229.707587] [ 4860] 0 4860 5050 302 0 0 0 cmresourced
- <6>[ 229.707889] [ 4924] 0 4924 1015 148 9 0 0 mingetty
- <6>[ 229.708190] [ 4926] 0 4926 1015 148 5 0 0 mingetty
- <6>[ 229.708485] [ 4928] 0 4928 1015 149 21 0 0 mingetty
- <6>[ 229.708784] [ 4930] 0 4930 1015 149 3 0 0 mingetty
- <6>[ 229.709085] [ 4932] 0 4932 1015 149 2 0 0 mingetty
- <6>[ 229.709382] [ 4934] 0 4934 1015 149 18 0 0 mingetty
- <6>[ 229.709678] [ 4936] 0 4936 2796 300 4 -17 -1000 udevd
- <6>[ 229.709977] [ 4937] 0 4937 2796 299 5 -17 -1000 udevd
- <6>[ 229.710278] [ 5060] 0 5060 23954 555 2 0 0 sshd
- <6>[ 229.710579] [ 5078] 1033 5078 23954 306 0 0 0 sshd
- <6>[ 229.710873] [ 5079] 1033 5079 27075 292 17 0 0 bash
- <3>[ 229.711169] Out of memory: Kill process 3782 (xinetd) score 1 or sacrifice child
- <3>[ 229.711462] Killed process 3782, UID 0, (xinetd) total-vm:22088kB, anon-rss:232kB, file-rss:644kB
- <4>[ 229.712564] dsm_om_connsvcd invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0, oom_score_adj=0
- <6>[ 229.712870] dsm_om_connsvcd cpuset=/ mems_allowed=0-1
- <4>[ 229.713067] Pid: 4693, comm: dsm_om_connsvcd Tainted: G W --------------- 2.6.32-279.5.2.el6.x86_64 #1
- <4>[ 229.713367] Call Trace:
- <4>[ 229.713574] [<ffffffff810c4bf1>] ? cpuset_print_task_mems_allowed+0x91/0xb0
- <4>[ 229.713773] [<ffffffff81117360>] ? dump_header+0x90/0x1b0
- <4>[ 229.713969] [<ffffffff810e37de>] ? __delayacct_freepages_end+0x2e/0x30
- <4>[ 229.714171] [<ffffffff8121494c>] ? security_real_capable_noaudit+0x3c/0x70
- <4>[ 229.714369] [<ffffffff811177e2>] ? oom_kill_process+0x82/0x2a0
- <4>[ 229.714563] [<ffffffff81117721>] ? select_bad_process+0xe1/0x120
- <4>[ 229.714762] [<ffffffff81117c20>] ? out_of_memory+0x220/0x3c0
- <4>[ 229.714971] [<ffffffff8112793e>] ? __alloc_pages_nodemask+0x89e/0x940
- <4>[ 229.715177] [<ffffffff8115c45a>] ? alloc_pages_current+0xaa/0x110
- <4>[ 229.715376] [<ffffffff81114767>] ? __page_cache_alloc+0x87/0x90
- <4>[ 229.715572] [<ffffffff8112a38b>] ? __do_page_cache_readahead+0xdb/0x210
- <4>[ 229.715767] [<ffffffff8112a4e1>] ? ra_submit+0x21/0x30
- <4>[ 229.715959] [<ffffffff81115a93>] ? filemap_fault+0x4c3/0x500
- <4>[ 229.716156] [<ffffffff81136afe>] ? __inc_zone_state+0x2e/0x70
- <4>[ 229.716350] [<ffffffff8113ee94>] ? __do_fault+0x54/0x510
- <4>[ 229.716543] [<ffffffff8113f447>] ? handle_pte_fault+0xf7/0xb50
- <4>[ 229.716742] [<ffffffff8100ba4e>] ? common_interrupt+0xe/0x13
- <4>[ 229.716936] [<ffffffff81140084>] ? handle_mm_fault+0x1e4/0x2b0
- <4>[ 229.717134] [<ffffffff81044479>] ? __do_page_fault+0x139/0x480
- <4>[ 229.717334] [<ffffffff815034ee>] ? do_page_fault+0x3e/0xa0
- <4>[ 229.717528] [<ffffffff815008a5>] ? page_fault+0x25/0x30
- <6>[ 229.717721] Mem-Info:
- <4>[ 229.717909] Node 0 DMA per-cpu:
- <4>[ 229.718180] CPU 0: hi: 0, btch: 1 usd: 0
- <4>[ 229.718371] CPU 1: hi: 0, btch: 1 usd: 0
- <4>[ 229.718562] CPU 2: hi: 0, btch: 1 usd: 0
- <4>[ 229.718768] CPU 3: hi: 0, btch: 1 usd: 0
- <4>[ 229.718962] CPU 4: hi: 0, btch: 1 usd: 0
- <4>[ 229.719159] CPU 5: hi: 0, btch: 1 usd: 0
- <4>[ 229.719352] CPU 6: hi: 0, btch: 1 usd: 0
- <4>[ 229.719550] CPU 7: hi: 0, btch: 1 usd: 0
- <4>[ 229.719740] CPU 8: hi: 0, btch: 1 usd: 0
- <4>[ 229.719934] CPU 9: hi: 0, btch: 1 usd: 0
- <4>[ 229.720124] CPU 10: hi: 0, btch: 1 usd: 0
- <4>[ 229.720308] CPU 11: hi: 0, btch: 1 usd: 0
- <4>[ 229.720590] CPU 12: hi: 0, btch: 1 usd: 0
- <4>[ 229.720781] CPU 13: hi: 0, btch: 1 usd: 0
- <4>[ 229.720967] CPU 14: hi: 0, btch: 1 usd: 0
- <4>[ 229.721154] CPU 15: hi: 0, btch: 1 usd: 0
- <4>[ 229.721339] CPU 16: hi: 0, btch: 1 usd: 0
- <4>[ 229.721523] CPU 17: hi: 0, btch: 1 usd: 0
- <4>[ 229.721713] CPU 18: hi: 0, btch: 1 usd: 0
- <4>[ 229.721903] CPU 19: hi: 0, btch: 1 usd: 0
- <4>[ 229.722096] CPU 20: hi: 0, btch: 1 usd: 0
- <4>[ 229.722287] CPU 21: hi: 0, btch: 1 usd: 0
- <4>[ 229.722477] CPU 22: hi: 0, btch: 1 usd: 0
- <4>[ 229.722674] CPU 23: hi: 0, btch: 1 usd: 0
- <4>[ 229.722870] CPU 24: hi: 0, btch: 1 usd: 0
- <4>[ 229.723065] CPU 25: hi: 0, btch: 1 usd: 0
- <4>[ 229.723257] CPU 26: hi: 0, btch: 1 usd: 0
- <4>[ 229.723456] CPU 27: hi: 0, btch: 1 usd: 0
- <4>[ 229.723649] CPU 28: hi: 0, btch: 1 usd: 0
- <4>[ 229.723843] CPU 29: hi: 0, btch: 1 usd: 0
- <4>[ 229.724035] CPU 30: hi: 0, btch: 1 usd: 0
- <4>[ 229.724227] CPU 31: hi: 0, btch: 1 usd: 0
- <4>[ 229.724419] Node 0 DMA32 per-cpu:
- <4>[ 229.724686] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 229.724880] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 229.725073] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 229.725264] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 229.725454] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 229.725651] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 229.725841] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 229.726031] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 229.726224] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 229.726414] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 229.726604] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 229.726801] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 229.726992] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 229.727184] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 229.727373] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 229.727575] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 229.727765] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 229.727963] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 229.728158] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 229.728349] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 229.728539] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 229.728736] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 229.728930] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 229.729123] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 229.729314] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 229.729512] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 229.729703] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 229.729892] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 229.730084] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 229.730275] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 229.730465] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 229.730662] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 229.730860] Node 0 Normal per-cpu:
- <4>[ 229.731130] CPU 0: hi: 186, btch: 31 usd: 30
- <4>[ 229.731320] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 229.731512] CPU 2: hi: 186, btch: 31 usd: 166
- <4>[ 229.731709] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 229.731900] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 229.732097] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 229.732288] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 229.732484] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 229.732683] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 229.732877] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 229.733069] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 229.733260] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 229.733450] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 229.733646] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 229.733839] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 229.734028] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 229.734219] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 229.734403] CPU 17: hi: 186, btch: 31 usd: 127
- <4>[ 229.734589] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 229.734864] CPU 19: hi: 186, btch: 31 usd: 1
- <4>[ 229.735052] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 229.735236] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 229.735421] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 229.735613] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 229.735798] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 229.735989] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 229.736181] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 229.736372] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 229.736562] CPU 28: hi: 186, btch: 31 usd: 14
- <4>[ 229.736759] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 229.736952] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 229.737147] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 229.737337] Node 1 Normal per-cpu:
- <4>[ 229.737604] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 229.737800] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 229.737994] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 229.738190] CPU 3: hi: 186, btch: 31 usd: 123
- <4>[ 229.738383] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 229.738586] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 229.738774] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 229.738965] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 229.739158] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 229.739349] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 229.739538] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 229.739730] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 229.739919] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 229.740111] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 229.740302] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 229.740500] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 229.740690] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 229.740884] CPU 17: hi: 186, btch: 31 usd: 13
- <4>[ 229.741077] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 229.741272] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 229.741462] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 229.741666] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 229.741858] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 229.742056] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 229.744256] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 229.744445] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 229.744636] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 229.744834] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 229.745025] CPU 28: hi: 186, btch: 31 usd: 94
- <4>[ 229.745217] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 229.745408] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 229.745608] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 229.745810] active_anon:21880 inactive_anon:1380 isolated_anon:0
- <4>[ 229.745811] active_file:93 inactive_file:233 isolated_file:0
- <4>[ 229.745812] unevictable:11770 dirty:0 writeback:0 unstable:0
- <4>[ 229.745812] free:54013 slab_reclaimable:2642 slab_unreclaimable:45385
- <4>[ 229.745813] mapped:1941 shmem:54 pagetables:965 bounce:0
- <4>[ 229.746779] Node 0 DMA free:15744kB min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15356kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
- <4>[ 229.747640] lowmem_reserve[]: 0 2955 32245 32245
- <4>[ 229.748234] Node 0 DMA32 free:120560kB min:4120kB low:5148kB high:6180kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:4kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3026080kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:20kB slab_unreclaimable:17216kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:2 all_unreclaimable? no
- <4>[ 229.749160] lowmem_reserve[]: 0 0 29290 29290
- <4>[ 229.749752] Node 0 Normal free:36340kB min:40868kB low:51084kB high:61300kB active_anon:35024kB inactive_anon:2276kB active_file:0kB inactive_file:1068kB unevictable:44928kB isolated(anon):0kB isolated(file):0kB present:29992960kB mlocked:44928kB dirty:0kB writeback:0kB mapped:5612kB shmem:136kB slab_reclaimable:5588kB slab_unreclaimable:75656kB kernel_stack:4816kB pagetables:1812kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:512 all_unreclaimable? yes
- <4>[ 229.750621] lowmem_reserve[]: 0 0 0 0
- <4>[ 229.751213] Node 1 Normal free:43408kB min:45096kB low:56368kB high:67644kB active_anon:52496kB inactive_anon:3244kB active_file:384kB inactive_file:0kB unevictable:2152kB isolated(anon):0kB isolated(file):0kB present:33095680kB mlocked:2152kB dirty:0kB writeback:0kB mapped:2152kB shmem:80kB slab_reclaimable:4960kB slab_unreclaimable:88668kB kernel_stack:720kB pagetables:2048kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:556 all_unreclaimable? yes
- <4>[ 229.752068] lowmem_reserve[]: 0 0 0 0
- <4>[ 229.752656] Node 0 DMA: 2*4kB 1*8kB 1*16kB 1*32kB 1*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15744kB
- <4>[ 229.754005] Node 0 DMA32: 56*4kB 8*8kB 7*16kB 7*32kB 10*64kB 10*128kB 7*256kB 9*512kB 7*1024kB 5*2048kB 23*4096kB = 120560kB
- <4>[ 229.755358] Node 0 Normal: 867*4kB 605*8kB 348*16kB 181*32kB 65*64kB 14*128kB 4*256kB 1*512kB 1*1024kB 2*2048kB 1*4096kB = 36372kB
- <4>[ 229.756721] Node 1 Normal: 1461*4kB 734*8kB 466*16kB 269*32kB 104*64kB 21*128kB 1*256kB 0*512kB 0*1024kB 1*2048kB 1*4096kB = 43524kB
- <4>[ 229.758076] 2238 total pagecache pages
- <4>[ 229.758264] 0 pages in swap cache
- <4>[ 229.758450] Swap cache stats: add 0, delete 0, find 0/0
- <4>[ 229.758641] Free swap = 0kB
- <4>[ 229.758828] Total swap = 0kB
- <6>[ 229.923949] 16777215 pages RAM
- <6>[ 229.924139] 294628 pages reserved
- <6>[ 229.924323] 123068 pages shared
- <6>[ 229.924507] 16390491 pages non-shared
- <6>[ 229.924693] [ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
- <6>[ 229.925053] [ 1047] 0 1047 2797 302 2 -17 -1000 udevd
- <6>[ 229.925355] [ 3171] 0 3171 6909 183 3 -17 -1000 auditd
- <6>[ 229.925661] [ 3772] 0 3772 16018 260 0 -17 -1000 sshd
- <6>[ 229.925958] [ 3801] 0 3801 5053 327 19 0 0 cmproxyd
- <6>[ 229.926251] [ 3812] 38 3812 6484 298 12 0 0 ntpd
- <6>[ 229.926550] [ 3953] 0 3953 19669 496 1 0 0 master
- <6>[ 229.926850] [ 3961] 0 3961 29302 305 16 0 0 crond
- <6>[ 229.927145] [ 3963] 89 3963 19689 478 17 0 0 pickup
- <6>[ 229.927442] [ 3964] 89 3964 19706 478 17 0 0 qmgr
- <6>[ 229.927736] [ 3974] 0 3974 5363 115 1 0 0 atd
- <6>[ 229.928030] [ 4272] 0 4272 234055 3595 0 0 0 dsm_sa_datamgrd
- <6>[ 229.928334] [ 4552] 0 4552 72683 512 17 0 0 dsm_sa_eventmgr
- <6>[ 229.928634] [ 4613] 0 4613 125242 1356 9 0 0 dsm_sa_snmpd
- <6>[ 229.928931] [ 4643] 0 4643 33158 204 3 0 0 dsm_om_connsvcd
- <6>[ 229.929225] [ 4644] 0 4644 1217768 15607 1 0 0 dsm_om_connsvcd
- <6>[ 229.929523] [ 4800] 0 4800 140898 872 0 0 0 dsm_om_shrsvcd
- <6>[ 229.929822] [ 4842] 0 4842 21240 11772 16 0 0 cmcld
- <6>[ 229.930118] [ 4852] 0 4852 5055 330 2 0 0 cmserviced
- <6>[ 229.930418] [ 4854] 0 4854 4451 247 17 0 0 cmlogd
- <6>[ 229.930715] [ 4855] 0 4855 8906 375 1 0 0 cmfileassistd
- <6>[ 229.931022] [ 4856] 0 4856 5171 380 2 0 0 cmnetd
- <6>[ 229.931326] [ 4860] 0 4860 5050 302 0 0 0 cmresourced
- <6>[ 229.931642] [ 4924] 0 4924 1015 148 9 0 0 mingetty
- <6>[ 229.931937] [ 4926] 0 4926 1015 148 5 0 0 mingetty
- <6>[ 229.932232] [ 4928] 0 4928 1015 149 21 0 0 mingetty
- <6>[ 229.932527] [ 4930] 0 4930 1015 149 3 0 0 mingetty
- <6>[ 229.932830] [ 4932] 0 4932 1015 149 2 0 0 mingetty
- <6>[ 229.933126] [ 4934] 0 4934 1015 149 18 0 0 mingetty
- <6>[ 229.933418] [ 4936] 0 4936 2796 300 4 -17 -1000 udevd
- <6>[ 229.933703] [ 4937] 0 4937 2796 299 5 -17 -1000 udevd
- <6>[ 229.934089] [ 5060] 0 5060 23954 555 2 0 0 sshd
- <6>[ 229.934381] [ 5078] 1033 5078 23954 306 0 0 0 sshd
- <6>[ 229.934666] [ 5079] 1033 5079 27075 292 17 0 0 bash
- <3>[ 229.934955] Out of memory: Kill process 3801 (cmproxyd) score 1 or sacrifice child
- <3>[ 229.935252] Killed process 3801, UID 0, (cmproxyd) total-vm:20212kB, anon-rss:524kB, file-rss:784kB
- <4>[ 229.936036] dsm_om_connsvcd invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0, oom_score_adj=0
- <6>[ 229.936333] dsm_om_connsvcd cpuset=/ mems_allowed=0-1
- <4>[ 229.936524] Pid: 4693, comm: dsm_om_connsvcd Tainted: G W --------------- 2.6.32-279.5.2.el6.x86_64 #1
- <4>[ 229.936829] Call Trace:
- <4>[ 229.937030] [<ffffffff810c4bf1>] ? cpuset_print_task_mems_allowed+0x91/0xb0
- <4>[ 229.937226] [<ffffffff81117360>] ? dump_header+0x90/0x1b0
- <4>[ 229.937422] [<ffffffff810e37de>] ? __delayacct_freepages_end+0x2e/0x30
- <4>[ 229.937623] [<ffffffff8121494c>] ? security_real_capable_noaudit+0x3c/0x70
- <4>[ 229.937827] [<ffffffff811177e2>] ? oom_kill_process+0x82/0x2a0
- <4>[ 229.938022] [<ffffffff81117721>] ? select_bad_process+0xe1/0x120
- <4>[ 229.938217] [<ffffffff81117c20>] ? out_of_memory+0x220/0x3c0
- <4>[ 229.938416] [<ffffffff8112793e>] ? __alloc_pages_nodemask+0x89e/0x940
- <4>[ 229.938613] [<ffffffff8115c45a>] ? alloc_pages_current+0xaa/0x110
- <4>[ 229.938813] [<ffffffff81114767>] ? __page_cache_alloc+0x87/0x90
- <4>[ 229.939012] [<ffffffff8112a38b>] ? __do_page_cache_readahead+0xdb/0x210
- <4>[ 229.939209] [<ffffffff8112a4e1>] ? ra_submit+0x21/0x30
- <4>[ 229.939405] [<ffffffff81115a93>] ? filemap_fault+0x4c3/0x500
- <4>[ 229.939611] [<ffffffff81136afe>] ? __inc_zone_state+0x2e/0x70
- <4>[ 229.939809] [<ffffffff8113ee94>] ? __do_fault+0x54/0x510
- <4>[ 229.940004] [<ffffffff8113f447>] ? handle_pte_fault+0xf7/0xb50
- <4>[ 229.940202] [<ffffffff8100ba4e>] ? common_interrupt+0xe/0x13
- <4>[ 229.940402] [<ffffffff81140084>] ? handle_mm_fault+0x1e4/0x2b0
- <4>[ 229.940600] [<ffffffff81044479>] ? __do_page_fault+0x139/0x480
- <4>[ 229.940804] [<ffffffff815034ee>] ? do_page_fault+0x3e/0xa0
- <4>[ 229.941002] [<ffffffff815008a5>] ? page_fault+0x25/0x30
- <6>[ 229.941195] Mem-Info:
- <4>[ 229.941379] Node 0 DMA per-cpu:
- <4>[ 229.941646] CPU 0: hi: 0, btch: 1 usd: 0
- <4>[ 229.941836] CPU 1: hi: 0, btch: 1 usd: 0
- <4>[ 229.942028] CPU 2: hi: 0, btch: 1 usd: 0
- <4>[ 229.942217] CPU 3: hi: 0, btch: 1 usd: 0
- <4>[ 229.942406] CPU 4: hi: 0, btch: 1 usd: 0
- <4>[ 229.942603] CPU 5: hi: 0, btch: 1 usd: 0
- <4>[ 229.942792] CPU 6: hi: 0, btch: 1 usd: 0
- <4>[ 229.942985] CPU 7: hi: 0, btch: 1 usd: 0
- <4>[ 229.943173] CPU 8: hi: 0, btch: 1 usd: 0
- <4>[ 229.943369] CPU 9: hi: 0, btch: 1 usd: 0
- <4>[ 229.943565] CPU 10: hi: 0, btch: 1 usd: 0
- <4>[ 229.943754] CPU 11: hi: 0, btch: 1 usd: 0
- <4>[ 229.943946] CPU 12: hi: 0, btch: 1 usd: 0
- <4>[ 229.944134] CPU 13: hi: 0, btch: 1 usd: 0
- <4>[ 229.944324] CPU 14: hi: 0, btch: 1 usd: 0
- <4>[ 229.944520] CPU 15: hi: 0, btch: 1 usd: 0
- <4>[ 229.944711] CPU 16: hi: 0, btch: 1 usd: 0
- <4>[ 229.944905] CPU 17: hi: 0, btch: 1 usd: 0
- <4>[ 229.945097] CPU 18: hi: 0, btch: 1 usd: 0
- <4>[ 229.945297] CPU 19: hi: 0, btch: 1 usd: 0
- <4>[ 229.945487] CPU 20: hi: 0, btch: 1 usd: 0
- <4>[ 229.947648] CPU 21: hi: 0, btch: 1 usd: 0
- <4>[ 229.947832] CPU 22: hi: 0, btch: 1 usd: 0
- <4>[ 229.948019] CPU 23: hi: 0, btch: 1 usd: 0
- <4>[ 229.948252] CPU 24: hi: 0, btch: 1 usd: 0
- <4>[ 229.948443] CPU 25: hi: 0, btch: 1 usd: 0
- <4>[ 229.948627] CPU 26: hi: 0, btch: 1 usd: 0
- <4>[ 229.948811] CPU 27: hi: 0, btch: 1 usd: 0
- <4>[ 229.948997] CPU 28: hi: 0, btch: 1 usd: 0
- <4>[ 229.949182] CPU 29: hi: 0, btch: 1 usd: 0
- <4>[ 229.949371] CPU 30: hi: 0, btch: 1 usd: 0
- <4>[ 229.949559] CPU 31: hi: 0, btch: 1 usd: 0
- <4>[ 229.949751] Node 0 DMA32 per-cpu:
- <4>[ 229.950021] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 229.950209] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 229.950398] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 229.950595] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 229.950784] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 229.950975] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 229.951166] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 229.951363] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 229.951555] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 229.951748] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 229.951939] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 229.952127] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 229.952316] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 229.952514] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 229.952705] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 229.952898] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 229.953089] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 229.953285] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 229.953476] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 229.953666] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 229.953855] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 229.954044] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 229.954235] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 229.954430] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 229.954619] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 229.954809] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 229.955003] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 229.955194] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 229.955387] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 229.955585] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 229.955779] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 229.955971] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 229.956159] Node 0 Normal per-cpu:
- <4>[ 229.956424] CPU 0: hi: 186, btch: 31 usd: 30
- <4>[ 229.956613] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 229.956802] CPU 2: hi: 186, btch: 31 usd: 166
- <4>[ 229.956994] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 229.957185] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 229.957382] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 229.957573] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 229.957767] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 229.957959] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 229.958151] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 229.958341] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 229.958537] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 229.958728] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 229.958920] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 229.959108] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 229.959305] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 229.959504] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 229.959694] CPU 17: hi: 186, btch: 31 usd: 127
- <4>[ 229.959889] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 229.960077] CPU 19: hi: 186, btch: 31 usd: 87
- <4>[ 229.960265] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 229.960462] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 229.960650] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 229.960838] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 229.961029] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 229.961217] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 229.961406] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 229.961602] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 229.961795] CPU 28: hi: 186, btch: 31 usd: 14
- <4>[ 229.961982] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 229.962166] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 229.962459] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 229.962652] Node 1 Normal per-cpu:
- <4>[ 229.962917] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 229.963102] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 229.963286] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 229.963486] CPU 3: hi: 186, btch: 31 usd: 123
- <4>[ 229.963676] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 229.963863] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 229.964054] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 229.964243] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 229.964431] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 229.964619] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 229.964809] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 229.965002] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 229.965190] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 229.965387] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 229.965578] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 229.965771] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 229.965964] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 229.966154] CPU 17: hi: 186, btch: 31 usd: 13
- <4>[ 229.966343] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 229.966531] CPU 19: hi: 186, btch: 31 usd: 98
- <4>[ 229.966720] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 229.966913] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 229.967101] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 229.967296] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 229.967485] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 229.967681] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 229.967870] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 229.968060] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 229.968249] CPU 28: hi: 186, btch: 31 usd: 94
- <4>[ 229.968443] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 229.968632] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 229.968820] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 229.969013] active_anon:21880 inactive_anon:1380 isolated_anon:0
- <4>[ 229.969014] active_file:107 inactive_file:219 isolated_file:0
- <4>[ 229.969015] unevictable:11770 dirty:0 writeback:0 unstable:0
- <4>[ 229.969016] free:54005 slab_reclaimable:2642 slab_unreclaimable:45385
- <4>[ 229.969017] mapped:1941 shmem:54 pagetables:965 bounce:0
- <4>[ 229.970001] Node 0 DMA free:15744kB min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15356kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
- <4>[ 229.970845] lowmem_reserve[]: 0 2955 32245 32245
- <4>[ 229.971438] Node 0 DMA32 free:120560kB min:4120kB low:5148kB high:6180kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:4kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3026080kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:20kB slab_unreclaimable:17216kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:2 all_unreclaimable? no
- <4>[ 229.972288] lowmem_reserve[]: 0 0 29290 29290
- <4>[ 229.972882] Node 0 Normal free:36308kB min:40868kB low:51084kB high:61300kB active_anon:35024kB inactive_anon:2276kB active_file:44kB inactive_file:1012kB unevictable:44928kB isolated(anon):0kB isolated(file):0kB present:29992960kB mlocked:44928kB dirty:0kB writeback:0kB mapped:5612kB shmem:136kB slab_reclaimable:5588kB slab_unreclaimable:75656kB kernel_stack:4816kB pagetables:1812kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:512 all_unreclaimable? yes
- <4>[ 229.973744] lowmem_reserve[]: 0 0 0 0
- <4>[ 229.974339] Node 1 Normal free:43408kB min:45096kB low:56368kB high:67644kB active_anon:52496kB inactive_anon:3244kB active_file:384kB inactive_file:0kB unevictable:2152kB isolated(anon):0kB isolated(file):0kB present:33095680kB mlocked:2152kB dirty:0kB writeback:0kB mapped:2152kB shmem:80kB slab_reclaimable:4960kB slab_unreclaimable:88668kB kernel_stack:720kB pagetables:2048kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:556 all_unreclaimable? yes
- <4>[ 229.975207] lowmem_reserve[]: 0 0 0 0
- <4>[ 229.975798] Node 0 DMA: 2*4kB 1*8kB 1*16kB 1*32kB 1*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15744kB
- <4>[ 229.977209] Node 0 DMA32: 56*4kB 8*8kB 7*16kB 7*32kB 10*64kB 10*128kB 7*256kB 9*512kB 7*1024kB 5*2048kB 23*4096kB = 120560kB
- <4>[ 229.978572] Node 0 Normal: 867*4kB 605*8kB 348*16kB 181*32kB 65*64kB 14*128kB 4*256kB 1*512kB 1*1024kB 2*2048kB 1*4096kB = 36372kB
- <4>[ 229.979925] Node 1 Normal: 1430*4kB 734*8kB 466*16kB 269*32kB 104*64kB 21*128kB 1*256kB 0*512kB 0*1024kB 1*2048kB 1*4096kB = 43400kB
- <4>[ 229.981282] 2246 total pagecache pages
- <4>[ 229.981468] 0 pages in swap cache
- <4>[ 229.981659] Swap cache stats: add 0, delete 0, find 0/0
- <4>[ 229.981849] Free swap = 0kB
- <4>[ 229.982035] Total swap = 0kB
- <6>[ 230.146911] 16777215 pages RAM
- <6>[ 230.147096] 294628 pages reserved
- <6>[ 230.147376] 122872 pages shared
- <6>[ 230.147555] 16390338 pages non-shared
- <6>[ 230.147737] [ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
- <6>[ 230.148089] [ 1047] 0 1047 2797 302 2 -17 -1000 udevd
- <6>[ 230.148380] [ 3171] 0 3171 6909 183 3 -17 -1000 auditd
- <6>[ 230.148678] [ 3772] 0 3772 16018 260 0 -17 -1000 sshd
- <6>[ 230.148974] [ 3812] 38 3812 6484 298 12 0 0 ntpd
- <6>[ 230.149268] [ 3953] 0 3953 19669 496 1 0 0 master
- <6>[ 230.149566] [ 3961] 0 3961 29302 305 16 0 0 crond
- <6>[ 230.149866] [ 3963] 89 3963 19689 478 17 0 0 pickup
- <6>[ 230.150161] [ 3964] 89 3964 19706 478 17 0 0 qmgr
- <6>[ 230.150453] [ 3974] 0 3974 5363 115 1 0 0 atd
- <6>[ 230.152705] [ 4272] 0 4272 234055 3595 0 0 0 dsm_sa_datamgrd
- <6>[ 230.153005] [ 4552] 0 4552 72683 512 17 0 0 dsm_sa_eventmgr
- <6>[ 230.153306] [ 4613] 0 4613 125242 1356 9 0 0 dsm_sa_snmpd
- <6>[ 230.153605] [ 4643] 0 4643 33158 204 3 0 0 dsm_om_connsvcd
- <6>[ 230.153902] [ 4644] 0 4644 1217768 15607 1 0 0 dsm_om_connsvcd
- <6>[ 230.154196] [ 4800] 0 4800 140898 872 0 0 0 dsm_om_shrsvcd
- <6>[ 230.154491] [ 4842] 0 4842 21240 11772 16 0 0 cmcld
- <6>[ 230.154787] [ 4852] 0 4852 5055 330 2 0 0 cmserviced
- <6>[ 230.155081] [ 4854] 0 4854 4451 247 17 0 0 cmlogd
- <6>[ 230.155386] [ 4855] 0 4855 8906 375 1 0 0 cmfileassistd
- <6>[ 230.155685] [ 4856] 0 4856 5171 380 2 0 0 cmnetd
- <6>[ 230.155978] [ 4860] 0 4860 5050 302 0 0 0 cmresourced
- <6>[ 230.156279] [ 4924] 0 4924 1015 148 9 0 0 mingetty
- <6>[ 230.156573] [ 4926] 0 4926 1015 148 5 0 0 mingetty
- <6>[ 230.156869] [ 4928] 0 4928 1015 149 21 0 0 mingetty
- <6>[ 230.157163] [ 4930] 0 4930 1015 149 3 0 0 mingetty
- <6>[ 230.157458] [ 4932] 0 4932 1015 149 2 0 0 mingetty
- <6>[ 230.157754] [ 4934] 0 4934 1015 149 18 0 0 mingetty
- <6>[ 230.158055] [ 4936] 0 4936 2796 300 4 -17 -1000 udevd
- <6>[ 230.158355] [ 4937] 0 4937 2796 299 5 -17 -1000 udevd
- <6>[ 230.158652] [ 5060] 0 5060 23954 555 2 0 0 sshd
- <6>[ 230.158951] [ 5078] 1033 5078 23954 306 0 0 0 sshd
- <6>[ 230.159248] [ 5079] 1033 5079 27075 292 17 0 0 bash
- <3>[ 230.159542] Out of memory: Kill process 3812 (ntpd) score 1 or sacrifice child
- <3>[ 230.159838] Killed process 3812, UID 38, (ntpd) total-vm:25936kB, anon-rss:416kB, file-rss:776kB
- <4>[ 230.160983] dsm_om_connsvcd invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0, oom_score_adj=0
- <6>[ 230.161274] dsm_om_connsvcd cpuset=/ mems_allowed=0-1
- <4>[ 230.161553] Pid: 4693, comm: dsm_om_connsvcd Tainted: G W --------------- 2.6.32-279.5.2.el6.x86_64 #1
- <4>[ 230.161847] Call Trace:
- <4>[ 230.162035] [<ffffffff810c4bf1>] ? cpuset_print_task_mems_allowed+0x91/0xb0
- <4>[ 230.162228] [<ffffffff81117360>] ? dump_header+0x90/0x1b0
- <4>[ 230.162420] [<ffffffff810e37de>] ? __delayacct_freepages_end+0x2e/0x30
- <4>[ 230.162619] [<ffffffff8121494c>] ? security_real_capable_noaudit+0x3c/0x70
- <4>[ 230.162820] [<ffffffff811177e2>] ? oom_kill_process+0x82/0x2a0
- <4>[ 230.163014] [<ffffffff81117721>] ? select_bad_process+0xe1/0x120
- <4>[ 230.163209] [<ffffffff81117c20>] ? out_of_memory+0x220/0x3c0
- <4>[ 230.163408] [<ffffffff8112793e>] ? __alloc_pages_nodemask+0x89e/0x940
- <4>[ 230.163605] [<ffffffff8115c45a>] ? alloc_pages_current+0xaa/0x110
- <4>[ 230.163806] [<ffffffff81114767>] ? __page_cache_alloc+0x87/0x90
- <4>[ 230.164000] [<ffffffff8112a38b>] ? __do_page_cache_readahead+0xdb/0x210
- <4>[ 230.164211] [<ffffffff8112a4e1>] ? ra_submit+0x21/0x30
- <4>[ 230.164403] [<ffffffff81115a93>] ? filemap_fault+0x4c3/0x500
- <4>[ 230.164599] [<ffffffff81136afe>] ? __inc_zone_state+0x2e/0x70
- <4>[ 230.164799] [<ffffffff8113ee94>] ? __do_fault+0x54/0x510
- <4>[ 230.164992] [<ffffffff8113f447>] ? handle_pte_fault+0xf7/0xb50
- <4>[ 230.165195] [<ffffffff8100ba4e>] ? common_interrupt+0xe/0x13
- <4>[ 230.165393] [<ffffffff81140084>] ? handle_mm_fault+0x1e4/0x2b0
- <4>[ 230.165591] [<ffffffff81044479>] ? __do_page_fault+0x139/0x480
- <4>[ 230.165792] [<ffffffff815034ee>] ? do_page_fault+0x3e/0xa0
- <4>[ 230.165984] [<ffffffff815008a5>] ? page_fault+0x25/0x30
- <6>[ 230.166180] Mem-Info:
- <4>[ 230.166363] Node 0 DMA per-cpu:
- <4>[ 230.166630] CPU 0: hi: 0, btch: 1 usd: 0
- <4>[ 230.166821] CPU 1: hi: 0, btch: 1 usd: 0
- <4>[ 230.167010] CPU 2: hi: 0, btch: 1 usd: 0
- <4>[ 230.167206] CPU 3: hi: 0, btch: 1 usd: 0
- <4>[ 230.167402] CPU 4: hi: 0, btch: 1 usd: 0
- <4>[ 230.167591] CPU 5: hi: 0, btch: 1 usd: 0
- <4>[ 230.167782] CPU 6: hi: 0, btch: 1 usd: 0
- <4>[ 230.167971] CPU 7: hi: 0, btch: 1 usd: 0
- <4>[ 230.168161] CPU 8: hi: 0, btch: 1 usd: 0
- <4>[ 230.168362] CPU 9: hi: 0, btch: 1 usd: 0
- <4>[ 230.168550] CPU 10: hi: 0, btch: 1 usd: 0
- <4>[ 230.168741] CPU 11: hi: 0, btch: 1 usd: 0
- <4>[ 230.168933] CPU 12: hi: 0, btch: 1 usd: 0
- <4>[ 230.169130] CPU 13: hi: 0, btch: 1 usd: 0
- <4>[ 230.169321] CPU 14: hi: 0, btch: 1 usd: 0
- <4>[ 230.169516] CPU 15: hi: 0, btch: 1 usd: 0
- <4>[ 230.169707] CPU 16: hi: 0, btch: 1 usd: 0
- <4>[ 230.169899] CPU 17: hi: 0, btch: 1 usd: 0
- <4>[ 230.170087] CPU 18: hi: 0, btch: 1 usd: 0
- <4>[ 230.170282] CPU 19: hi: 0, btch: 1 usd: 0
- <4>[ 230.170471] CPU 20: hi: 0, btch: 1 usd: 0
- <4>[ 230.170659] CPU 21: hi: 0, btch: 1 usd: 0
- <4>[ 230.170850] CPU 22: hi: 0, btch: 1 usd: 0
- <4>[ 230.171041] CPU 23: hi: 0, btch: 1 usd: 0
- <4>[ 230.171230] CPU 24: hi: 0, btch: 1 usd: 0
- <4>[ 230.171428] CPU 25: hi: 0, btch: 1 usd: 0
- <4>[ 230.171618] CPU 26: hi: 0, btch: 1 usd: 0
- <4>[ 230.171809] CPU 27: hi: 0, btch: 1 usd: 0
- <4>[ 230.171998] CPU 28: hi: 0, btch: 1 usd: 0
- <4>[ 230.172195] CPU 29: hi: 0, btch: 1 usd: 0
- <4>[ 230.172386] CPU 30: hi: 0, btch: 1 usd: 0
- <4>[ 230.172576] CPU 31: hi: 0, btch: 1 usd: 0
- <4>[ 230.172768] Node 0 DMA32 per-cpu:
- <4>[ 230.173038] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 230.173239] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 230.173429] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 230.173618] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 230.173811] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 230.173998] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 230.174188] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 230.174383] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 230.174572] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 230.174762] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 230.174951] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 230.175146] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 230.175332] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 230.175524] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 230.175810] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 230.175995] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 230.176179] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 230.176370] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 230.176562] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 230.176748] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 230.176937] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 230.177133] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 230.177322] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 230.177512] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 230.177700] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 230.177892] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 230.178084] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 230.178281] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 230.178478] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 230.178676] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 230.178870] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 230.179062] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 230.179251] Node 0 Normal per-cpu:
- <4>[ 230.179517] CPU 0: hi: 186, btch: 31 usd: 30
- <4>[ 230.179707] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 230.179900] CPU 2: hi: 186, btch: 31 usd: 166
- <4>[ 230.180088] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 230.180276] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 230.180474] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 230.180669] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 230.180860] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 230.181049] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 230.181246] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 230.181435] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 230.181628] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 230.181823] CPU 12: hi: 186, btch: 31 usd: 69
- <4>[ 230.182014] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 230.182204] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 230.182401] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 230.182592] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 230.182785] CPU 17: hi: 186, btch: 31 usd: 127
- <4>[ 230.182977] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 230.183175] CPU 19: hi: 186, btch: 31 usd: 87
- <4>[ 230.183367] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 230.183557] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 230.183748] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 230.183937] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 230.184125] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 230.184320] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 230.184509] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 230.184699] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 230.184889] CPU 28: hi: 186, btch: 31 usd: 14
- <4>[ 230.185078] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 230.185267] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 230.185456] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 230.185644] Node 1 Normal per-cpu:
- <4>[ 230.185911] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 230.186107] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 230.188288] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 230.188480] CPU 3: hi: 186, btch: 31 usd: 123
- <4>[ 230.188669] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 230.188861] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 230.189049] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 230.189243] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 230.189432] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 230.189616] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 230.189802] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 230.190084] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 230.190269] CPU 12: hi: 186, btch: 31 usd: 130
- <4>[ 230.190467] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 230.190653] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 230.190841] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 230.191025] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 230.191222] CPU 17: hi: 186, btch: 31 usd: 13
- <4>[ 230.191414] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 230.191603] CPU 19: hi: 186, btch: 31 usd: 98
- <4>[ 230.191794] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 230.191983] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 230.192174] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 230.192371] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 230.192562] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 230.192754] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 230.192945] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 230.193142] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 230.193333] CPU 28: hi: 186, btch: 31 usd: 94
- <4>[ 230.193523] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 230.193712] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 230.193905] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 230.194099] active_anon:21880 inactive_anon:1380 isolated_anon:0
- <4>[ 230.194100] active_file:107 inactive_file:219 isolated_file:0
- <4>[ 230.194100] unevictable:11770 dirty:0 writeback:0 unstable:0
- <4>[ 230.194101] free:54005 slab_reclaimable:2642 slab_unreclaimable:45385
- <4>[ 230.194103] mapped:1941 shmem:54 pagetables:965 bounce:0
- <4>[ 230.195068] Node 0 DMA free:15744kB min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15356kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
- <4>[ 230.195908] lowmem_reserve[]: 0 2955 32245 32245
- <4>[ 230.196515] Node 0 DMA32 free:120560kB min:4120kB low:5148kB high:6180kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:4kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3026080kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:20kB slab_unreclaimable:17216kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:2 all_unreclaimable? no
- <4>[ 230.197379] lowmem_reserve[]: 0 0 29290 29290
- <4>[ 230.197972] Node 0 Normal free:36308kB min:40868kB low:51084kB high:61300kB active_anon:35024kB inactive_anon:2276kB active_file:44kB inactive_file:1012kB unevictable:44928kB isolated(anon):0kB isolated(file):0kB present:29992960kB mlocked:44928kB dirty:0kB writeback:0kB mapped:5612kB shmem:136kB slab_reclaimable:5588kB slab_unreclaimable:75656kB kernel_stack:4816kB pagetables:1812kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:512 all_unreclaimable? yes
- <4>[ 230.198826] lowmem_reserve[]: 0 0 0 0
- <4>[ 230.199426] Node 1 Normal free:43408kB min:45096kB low:56368kB high:67644kB active_anon:52496kB inactive_anon:3244kB active_file:384kB inactive_file:0kB unevictable:2152kB isolated(anon):0kB isolated(file):0kB present:33095680kB mlocked:2152kB dirty:0kB writeback:0kB mapped:2152kB shmem:80kB slab_reclaimable:4960kB slab_unreclaimable:88668kB kernel_stack:720kB pagetables:2048kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:556 all_unreclaimable? yes
- <4>[ 230.200285] lowmem_reserve[]: 0 0 0 0
- <4>[ 230.200874] Node 0 DMA: 2*4kB 1*8kB 1*16kB 1*32kB 1*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15744kB
- <4>[ 230.202218] Node 0 DMA32: 56*4kB 8*8kB 7*16kB 7*32kB 10*64kB 10*128kB 7*256kB 9*512kB 7*1024kB 5*2048kB 23*4096kB = 120560kB
- <4>[ 230.203589] Node 0 Normal: 835*4kB 606*8kB 348*16kB 181*32kB 65*64kB 13*128kB 4*256kB 1*512kB 1*1024kB 2*2048kB 1*4096kB = 36124kB
- <4>[ 230.205000] Node 1 Normal: 1399*4kB 734*8kB 466*16kB 269*32kB 104*64kB 21*128kB 1*256kB 0*512kB 0*1024kB 1*2048kB 1*4096kB = 43276kB
- <4>[ 230.206374] 2246 total pagecache pages
- <4>[ 230.206561] 0 pages in swap cache
- <4>[ 230.206749] Swap cache stats: add 0, delete 0, find 0/0
- <4>[ 230.206939] Free swap = 0kB
- <4>[ 230.207123] Total swap = 0kB
- <6>[ 230.371750] 16777215 pages RAM
- <6>[ 230.371938] 294628 pages reserved
- <6>[ 230.372124] 122678 pages shared
- <6>[ 230.372311] 16390232 pages non-shared
- <6>[ 230.372498] [ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
- <6>[ 230.372862] [ 1047] 0 1047 2797 302 2 -17 -1000 udevd
- <6>[ 230.373164] [ 3171] 0 3171 6909 183 3 -17 -1000 auditd
- <6>[ 230.373462] [ 3772] 0 3772 16018 260 0 -17 -1000 sshd
- <6>[ 230.373767] [ 3953] 0 3953 19669 496 1 0 0 master
- <6>[ 230.374059] [ 3961] 0 3961 29302 305 16 0 0 crond
- <6>[ 230.374354] [ 3963] 89 3963 19689 478 17 0 0 pickup
- <6>[ 230.374641] [ 3964] 89 3964 19706 478 17 0 0 qmgr
- <6>[ 230.375029] [ 3974] 0 3974 5363 115 1 0 0 atd
- <6>[ 230.375313] [ 4272] 0 4272 234055 3595 0 0 0 dsm_sa_datamgrd
- <6>[ 230.375601] [ 4552] 0 4552 72683 512 17 0 0 dsm_sa_eventmgr
- <6>[ 230.375887] [ 4613] 0 4613 125242 1356 9 0 0 dsm_sa_snmpd
- <6>[ 230.376180] [ 4643] 0 4643 33158 204 3 0 0 dsm_om_connsvcd
- <6>[ 230.376474] [ 4644] 0 4644 1217768 15607 1 0 0 dsm_om_connsvcd
- <6>[ 230.376772] [ 4800] 0 4800 140898 872 0 0 0 dsm_om_shrsvcd
- <6>[ 230.377068] [ 4842] 0 4842 21240 11772 16 0 0 cmcld
- <6>[ 230.377363] [ 4852] 0 4852 5055 330 2 0 0 cmserviced
- <6>[ 230.377660] [ 4854] 0 4854 4451 247 17 0 0 cmlogd
- <6>[ 230.377954] [ 4855] 0 4855 8906 375 1 0 0 cmfileassistd
- <6>[ 230.378248] [ 4856] 0 4856 5171 380 2 0 0 cmnetd
- <6>[ 230.378541] [ 4860] 0 4860 5050 302 0 0 0 cmresourced
- <6>[ 230.378838] [ 4924] 0 4924 1015 148 9 0 0 mingetty
- <6>[ 230.379130] [ 4926] 0 4926 1015 148 5 0 0 mingetty
- <6>[ 230.379424] [ 4928] 0 4928 1015 149 21 0 0 mingetty
- <6>[ 230.379722] [ 4930] 0 4930 1015 149 3 0 0 mingetty
- <6>[ 230.380024] [ 4932] 0 4932 1015 149 2 0 0 mingetty
- <6>[ 230.380321] [ 4934] 0 4934 1015 149 18 0 0 mingetty
- <6>[ 230.380616] [ 4936] 0 4936 2796 300 4 -17 -1000 udevd
- <6>[ 230.380908] [ 4937] 0 4937 2796 299 5 -17 -1000 udevd
- <6>[ 230.381201] [ 5060] 0 5060 23954 555 2 0 0 sshd
- <6>[ 230.381494] [ 5078] 1033 5078 23954 306 0 0 0 sshd
- <6>[ 230.381790] [ 5079] 1033 5079 27075 292 17 0 0 bash
- <3>[ 230.382083] Out of memory: Kill process 3953 (master) score 1 or sacrifice child
- <3>[ 230.382380] Killed process 3963, UID 89, (pickup) total-vm:78756kB, anon-rss:812kB, file-rss:1100kB
- <4>[ 230.383699] dsm_sa_snmpd invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0, oom_score_adj=0
- <6>[ 230.384004] dsm_sa_snmpd cpuset=/ mems_allowed=0-1
- <4>[ 230.384196] Pid: 4619, comm: dsm_sa_snmpd Tainted: G W --------------- 2.6.32-279.5.2.el6.x86_64 #1
- <4>[ 230.384496] Call Trace:
- <4>[ 230.384690] [<ffffffff810c4bf1>] ? cpuset_print_task_mems_allowed+0x91/0xb0
- <4>[ 230.384887] [<ffffffff81117360>] ? dump_header+0x90/0x1b0
- <4>[ 230.385082] [<ffffffff810e37de>] ? __delayacct_freepages_end+0x2e/0x30
- <4>[ 230.385279] [<ffffffff8121494c>] ? security_real_capable_noaudit+0x3c/0x70
- <4>[ 230.385475] [<ffffffff811177e2>] ? oom_kill_process+0x82/0x2a0
- <4>[ 230.385670] [<ffffffff81117721>] ? select_bad_process+0xe1/0x120
- <4>[ 230.385863] [<ffffffff81117c20>] ? out_of_memory+0x220/0x3c0
- <4>[ 230.386060] [<ffffffff8112793e>] ? __alloc_pages_nodemask+0x89e/0x940
- <4>[ 230.386256] [<ffffffff8115c45a>] ? alloc_pages_current+0xaa/0x110
- <4>[ 230.386451] [<ffffffff81114767>] ? __page_cache_alloc+0x87/0x90
- <4>[ 230.386647] [<ffffffff8112a38b>] ? __do_page_cache_readahead+0xdb/0x210
- <4>[ 230.386842] [<ffffffff8112a4e1>] ? ra_submit+0x21/0x30
- <4>[ 230.387033] [<ffffffff81115a93>] ? filemap_fault+0x4c3/0x500
- <4>[ 230.387227] [<ffffffff8113ee94>] ? __do_fault+0x54/0x510
- <4>[ 230.387420] [<ffffffff8113f447>] ? handle_pte_fault+0xf7/0xb50
- <4>[ 230.387619] [<ffffffff810629d3>] ? dequeue_entity+0x113/0x2e0
- <4>[ 230.387813] [<ffffffff81063c0b>] ? dequeue_task_fair+0x12b/0x130
- <4>[ 230.388010] [<ffffffff810097cc>] ? __switch_to+0x1ac/0x320
- <4>[ 230.388203] [<ffffffff81140084>] ? handle_mm_fault+0x1e4/0x2b0
- <4>[ 230.388401] [<ffffffff81097045>] ? __hrtimer_start_range_ns+0x1a5/0x470
- <4>[ 230.388605] [<ffffffff81044479>] ? __do_page_fault+0x139/0x480
- <4>[ 230.388794] [<ffffffff8109738f>] ? hrtimer_try_to_cancel+0x3f/0xd0
- <4>[ 230.388982] [<ffffffff81097442>] ? hrtimer_cancel+0x22/0x30
- <4>[ 230.389276] [<ffffffff814ff583>] ? do_nanosleep+0x93/0xc0
- <4>[ 230.389465] [<ffffffff81097514>] ? hrtimer_nanosleep+0xc4/0x180
- <4>[ 230.389656] [<ffffffff810962a0>] ? hrtimer_wakeup+0x0/0x30
- <4>[ 230.391798] [<ffffffff815034ee>] ? do_page_fault+0x3e/0xa0
- <4>[ 230.391993] [<ffffffff815008a5>] ? page_fault+0x25/0x30
- <6>[ 230.392185] Mem-Info:
- <4>[ 230.392370] Node 0 DMA per-cpu:
- <4>[ 230.392639] CPU 0: hi: 0, btch: 1 usd: 0
- <4>[ 230.392830] CPU 1: hi: 0, btch: 1 usd: 0
- <4>[ 230.393019] CPU 2: hi: 0, btch: 1 usd: 0
- <4>[ 230.393207] CPU 3: hi: 0, btch: 1 usd: 0
- <4>[ 230.393397] CPU 4: hi: 0, btch: 1 usd: 0
- <4>[ 230.393588] CPU 5: hi: 0, btch: 1 usd: 0
- <4>[ 230.393776] CPU 6: hi: 0, btch: 1 usd: 0
- <4>[ 230.393965] CPU 7: hi: 0, btch: 1 usd: 0
- <4>[ 230.394153] CPU 8: hi: 0, btch: 1 usd: 0
- <4>[ 230.394342] CPU 9: hi: 0, btch: 1 usd: 0
- <4>[ 230.394529] CPU 10: hi: 0, btch: 1 usd: 0
- <4>[ 230.394719] CPU 11: hi: 0, btch: 1 usd: 0
- <4>[ 230.394908] CPU 12: hi: 0, btch: 1 usd: 0
- <4>[ 230.395096] CPU 13: hi: 0, btch: 1 usd: 0
- <4>[ 230.395285] CPU 14: hi: 0, btch: 1 usd: 0
- <4>[ 230.395474] CPU 15: hi: 0, btch: 1 usd: 0
- <4>[ 230.395668] CPU 16: hi: 0, btch: 1 usd: 0
- <4>[ 230.395858] CPU 17: hi: 0, btch: 1 usd: 0
- <4>[ 230.396049] CPU 18: hi: 0, btch: 1 usd: 0
- <4>[ 230.396238] CPU 19: hi: 0, btch: 1 usd: 0
- <4>[ 230.396428] CPU 20: hi: 0, btch: 1 usd: 0
- <4>[ 230.396619] CPU 21: hi: 0, btch: 1 usd: 0
- <4>[ 230.396807] CPU 22: hi: 0, btch: 1 usd: 0
- <4>[ 230.396995] CPU 23: hi: 0, btch: 1 usd: 0
- <4>[ 230.397184] CPU 24: hi: 0, btch: 1 usd: 0
- <4>[ 230.397373] CPU 25: hi: 0, btch: 1 usd: 0
- <4>[ 230.397565] CPU 26: hi: 0, btch: 1 usd: 0
- <4>[ 230.397754] CPU 27: hi: 0, btch: 1 usd: 0
- <4>[ 230.397941] CPU 28: hi: 0, btch: 1 usd: 0
- <4>[ 230.398130] CPU 29: hi: 0, btch: 1 usd: 0
- <4>[ 230.398318] CPU 30: hi: 0, btch: 1 usd: 0
- <4>[ 230.398507] CPU 31: hi: 0, btch: 1 usd: 0
- <4>[ 230.398697] Node 0 DMA32 per-cpu:
- <4>[ 230.398962] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 230.399152] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 230.399341] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 230.399529] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 230.399723] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 230.399913] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 230.400104] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 230.400293] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 230.400482] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 230.400674] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 230.400862] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 230.401050] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 230.401238] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 230.401428] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 230.401619] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 230.401808] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 230.401996] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 230.402188] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 230.402378] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 230.402569] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 230.402758] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 230.402945] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 230.403129] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 230.403402] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 230.403589] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 230.403774] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 230.403958] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 230.404143] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 230.404327] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 230.404514] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 230.404706] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 230.404897] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 230.405088] Node 0 Normal per-cpu:
- <4>[ 230.405355] CPU 0: hi: 186, btch: 31 usd: 30
- <4>[ 230.405548] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 230.405736] CPU 2: hi: 186, btch: 31 usd: 166
- <4>[ 230.405925] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 230.406115] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 230.406310] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 230.406502] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 230.406694] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 230.406886] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 230.407077] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 230.407270] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 230.407459] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 230.407651] CPU 12: hi: 186, btch: 31 usd: 69
- <4>[ 230.407842] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 230.408032] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 230.408222] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 230.408413] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 230.408604] CPU 17: hi: 186, btch: 31 usd: 127
- <4>[ 230.408793] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 230.408982] CPU 19: hi: 186, btch: 31 usd: 87
- <4>[ 230.409171] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 230.409359] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 230.409551] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 230.409741] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 230.409932] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 230.410122] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 230.410312] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 230.410503] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 230.410695] CPU 28: hi: 186, btch: 31 usd: 14
- <4>[ 230.410889] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 230.411079] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 230.411270] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 230.411459] Node 1 Normal per-cpu:
- <4>[ 230.411727] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 230.411916] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 230.412107] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 230.412297] CPU 3: hi: 186, btch: 31 usd: 123
- <4>[ 230.412487] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 230.412679] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 230.412870] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 230.413058] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 230.413247] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 230.413436] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 230.413627] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 230.413816] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 230.414006] CPU 12: hi: 186, btch: 31 usd: 130
- <4>[ 230.414195] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 230.414385] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 230.414577] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 230.414767] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 230.414962] CPU 17: hi: 186, btch: 31 usd: 171
- <4>[ 230.415153] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 230.415343] CPU 19: hi: 186, btch: 31 usd: 98
- <4>[ 230.415535] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 230.415723] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 230.415910] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 230.416099] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 230.416287] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 230.416475] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 230.416667] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 230.416854] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 230.417043] CPU 28: hi: 186, btch: 31 usd: 94
- <4>[ 230.417227] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 230.417412] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 230.417696] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 230.417882] active_anon:21702 inactive_anon:1380 isolated_anon:0
- <4>[ 230.417883] active_file:107 inactive_file:219 isolated_file:0
- <4>[ 230.417884] unevictable:11770 dirty:0 writeback:0 unstable:0
- <4>[ 230.417885] free:54098 slab_reclaimable:2642 slab_unreclaimable:45385
- <4>[ 230.417886] mapped:1941 shmem:54 pagetables:965 bounce:0
- <4>[ 230.418822] Node 0 DMA free:15744kB min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15356kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
- <4>[ 230.419654] lowmem_reserve[]: 0 2955 32245 32245
- <4>[ 230.420245] Node 0 DMA32 free:120560kB min:4120kB low:5148kB high:6180kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:4kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3026080kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:20kB slab_unreclaimable:17216kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:2 all_unreclaimable? no
- <4>[ 230.421093] lowmem_reserve[]: 0 0 29290 29290
- <4>[ 230.421687] Node 0 Normal free:36308kB min:40868kB low:51084kB high:61300kB active_anon:35024kB inactive_anon:2276kB active_file:44kB inactive_file:1012kB unevictable:44928kB isolated(anon):0kB isolated(file):0kB present:29992960kB mlocked:44928kB dirty:0kB writeback:0kB mapped:5612kB shmem:136kB slab_reclaimable:5588kB slab_unreclaimable:75656kB kernel_stack:4816kB pagetables:1812kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:512 all_unreclaimable? yes
- <4>[ 230.422543] lowmem_reserve[]: 0 0 0 0
- <4>[ 230.423134] Node 1 Normal free:43780kB min:45096kB low:56368kB high:67644kB active_anon:51784kB inactive_anon:3244kB active_file:384kB inactive_file:0kB unevictable:2152kB isolated(anon):0kB isolated(file):0kB present:33095680kB mlocked:2152kB dirty:0kB writeback:0kB mapped:2152kB shmem:80kB slab_reclaimable:4960kB slab_unreclaimable:88668kB kernel_stack:720kB pagetables:2048kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
- <4>[ 230.423978] lowmem_reserve[]: 0 0 0 0
- <4>[ 230.424570] Node 0 DMA: 2*4kB 1*8kB 1*16kB 1*32kB 1*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15744kB
- <4>[ 230.425921] Node 0 DMA32: 56*4kB 8*8kB 7*16kB 7*32kB 10*64kB 10*128kB 7*256kB 9*512kB 7*1024kB 5*2048kB 23*4096kB = 120560kB
- <4>[ 230.427269] Node 0 Normal: 835*4kB 606*8kB 348*16kB 181*32kB 65*64kB 13*128kB 4*256kB 1*512kB 1*1024kB 2*2048kB 1*4096kB = 36124kB
- <4>[ 230.428622] Node 1 Normal: 1418*4kB 749*8kB 473*16kB 271*32kB 104*64kB 21*128kB 1*256kB 0*512kB 0*1024kB 1*2048kB 1*4096kB = 43648kB
- <4>[ 230.429971] 2246 total pagecache pages
- <4>[ 230.430157] 0 pages in swap cache
- <4>[ 230.430342] Swap cache stats: add 0, delete 0, find 0/0
- <4>[ 230.430535] Free swap = 0kB
- <4>[ 230.432710] Total swap = 0kB
- <6>[ 230.596537] 16777215 pages RAM
- <6>[ 230.596734] 294628 pages reserved
- <6>[ 230.596926] 122631 pages shared
- <6>[ 230.597115] 16390501 pages non-shared
- <6>[ 230.597304] [ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
- <6>[ 230.597668] [ 1047] 0 1047 2797 302 2 -17 -1000 udevd
- <6>[ 230.597967] [ 3171] 0 3171 6909 183 3 -17 -1000 auditd
- <6>[ 230.598262] [ 3772] 0 3772 16018 260 0 -17 -1000 sshd
- <6>[ 230.598559] [ 3953] 0 3953 19669 496 1 0 0 master
- <6>[ 230.598853] [ 3961] 0 3961 29302 305 16 0 0 crond
- <6>[ 230.599146] [ 3964] 89 3964 19706 478 17 0 0 qmgr
- <6>[ 230.599441] [ 3974] 0 3974 5363 115 1 0 0 atd
- <6>[ 230.599733] [ 4272] 0 4272 234055 3598 0 0 0 dsm_sa_datamgrd
- <6>[ 230.600026] [ 4552] 0 4552 72683 512 17 0 0 dsm_sa_eventmgr
- <6>[ 230.600322] [ 4613] 0 4613 125242 1358 9 0 0 dsm_sa_snmpd
- <6>[ 230.600624] [ 4643] 0 4643 33158 204 3 0 0 dsm_om_connsvcd
- <6>[ 230.600921] [ 4644] 0 4644 1217768 15607 1 0 0 dsm_om_connsvcd
- <6>[ 230.601216] [ 4800] 0 4800 140898 872 0 0 0 dsm_om_shrsvcd
- <6>[ 230.601516] [ 4842] 0 4842 21240 11772 16 0 0 cmcld
- <6>[ 230.601811] [ 4852] 0 4852 5055 330 2 0 0 cmserviced
- <6>[ 230.602109] [ 4854] 0 4854 4451 247 17 0 0 cmlogd
- <6>[ 230.602394] [ 4855] 0 4855 8906 375 1 0 0 cmfileassistd
- <6>[ 230.602780] [ 4856] 0 4856 5171 353 2 0 0 cmnetd
- <6>[ 230.603066] [ 4860] 0 4860 5050 302 0 0 0 cmresourced
- <6>[ 230.603352] [ 4924] 0 4924 1015 148 9 0 0 mingetty
- <6>[ 230.603640] [ 4926] 0 4926 1015 148 5 0 0 mingetty
- <6>[ 230.603935] [ 4928] 0 4928 1015 149 21 0 0 mingetty
- <6>[ 230.604230] [ 4930] 0 4930 1015 149 3 0 0 mingetty
- <6>[ 230.604528] [ 4932] 0 4932 1015 149 2 0 0 mingetty
- <6>[ 230.604827] [ 4934] 0 4934 1015 149 18 0 0 mingetty
- <6>[ 230.605124] [ 4936] 0 4936 2796 300 4 -17 -1000 udevd
- <6>[ 230.605422] [ 4937] 0 4937 2796 299 5 -17 -1000 udevd
- <6>[ 230.605714] [ 5060] 0 5060 23954 555 2 0 0 sshd
- <6>[ 230.606011] [ 5078] 1033 5078 23954 306 0 0 0 sshd
- <6>[ 230.606311] [ 5079] 1033 5079 27075 292 17 0 0 bash
- <3>[ 230.606613] Out of memory: Kill process 3953 (master) score 1 or sacrifice child
- <3>[ 230.606906] Killed process 3964, UID 89, (qmgr) total-vm:78824kB, anon-rss:812kB, file-rss:1100kB
- <4>[ 230.608528] dsm_sa_snmpd invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0, oom_score_adj=0
- <6>[ 230.608826] dsm_sa_snmpd cpuset=/ mems_allowed=0-1
- <4>[ 230.609017] Pid: 4619, comm: dsm_sa_snmpd Tainted: G W --------------- 2.6.32-279.5.2.el6.x86_64 #1
- <4>[ 230.609319] Call Trace:
- <4>[ 230.609517] [<ffffffff810c4bf1>] ? cpuset_print_task_mems_allowed+0x91/0xb0
- <4>[ 230.609717] [<ffffffff81117360>] ? dump_header+0x90/0x1b0
- <4>[ 230.609916] [<ffffffff810e37de>] ? __delayacct_freepages_end+0x2e/0x30
- <4>[ 230.610113] [<ffffffff8121494c>] ? security_real_capable_noaudit+0x3c/0x70
- <4>[ 230.610308] [<ffffffff811177e2>] ? oom_kill_process+0x82/0x2a0
- <4>[ 230.610503] [<ffffffff81117721>] ? select_bad_process+0xe1/0x120
- <4>[ 230.610696] [<ffffffff81117c20>] ? out_of_memory+0x220/0x3c0
- <4>[ 230.610894] [<ffffffff8112793e>] ? __alloc_pages_nodemask+0x89e/0x940
- <4>[ 230.611090] [<ffffffff8115c45a>] ? alloc_pages_current+0xaa/0x110
- <4>[ 230.611286] [<ffffffff81114767>] ? __page_cache_alloc+0x87/0x90
- <4>[ 230.611482] [<ffffffff8112a38b>] ? __do_page_cache_readahead+0xdb/0x210
- <4>[ 230.611678] [<ffffffff8112a4e1>] ? ra_submit+0x21/0x30
- <4>[ 230.611870] [<ffffffff81115a93>] ? filemap_fault+0x4c3/0x500
- <4>[ 230.612066] [<ffffffff8113ee94>] ? __do_fault+0x54/0x510
- <4>[ 230.612259] [<ffffffff8113f447>] ? handle_pte_fault+0xf7/0xb50
- <4>[ 230.612457] [<ffffffff810629d3>] ? dequeue_entity+0x113/0x2e0
- <4>[ 230.612649] [<ffffffff81063c0b>] ? dequeue_task_fair+0x12b/0x130
- <4>[ 230.612844] [<ffffffff810097cc>] ? __switch_to+0x1ac/0x320
- <4>[ 230.613037] [<ffffffff81140084>] ? handle_mm_fault+0x1e4/0x2b0
- <4>[ 230.613232] [<ffffffff81097045>] ? __hrtimer_start_range_ns+0x1a5/0x470
- <4>[ 230.613434] [<ffffffff81044479>] ? __do_page_fault+0x139/0x480
- <4>[ 230.613630] [<ffffffff8109738f>] ? hrtimer_try_to_cancel+0x3f/0xd0
- <4>[ 230.613825] [<ffffffff81097442>] ? hrtimer_cancel+0x22/0x30
- <4>[ 230.614020] [<ffffffff814ff583>] ? do_nanosleep+0x93/0xc0
- <4>[ 230.614212] [<ffffffff81097514>] ? hrtimer_nanosleep+0xc4/0x180
- <4>[ 230.614407] [<ffffffff810962a0>] ? hrtimer_wakeup+0x0/0x30
- <4>[ 230.614600] [<ffffffff815034ee>] ? do_page_fault+0x3e/0xa0
- <4>[ 230.614793] [<ffffffff815008a5>] ? page_fault+0x25/0x30
- <6>[ 230.614985] Mem-Info:
- <4>[ 230.615170] Node 0 DMA per-cpu:
- <4>[ 230.615437] CPU 0: hi: 0, btch: 1 usd: 0
- <4>[ 230.615626] CPU 1: hi: 0, btch: 1 usd: 0
- <4>[ 230.615818] CPU 2: hi: 0, btch: 1 usd: 0
- <4>[ 230.616009] CPU 3: hi: 0, btch: 1 usd: 0
- <4>[ 230.616199] CPU 4: hi: 0, btch: 1 usd: 0
- <4>[ 230.616384] CPU 5: hi: 0, btch: 1 usd: 0
- <4>[ 230.616571] CPU 6: hi: 0, btch: 1 usd: 0
- <4>[ 230.616862] CPU 7: hi: 0, btch: 1 usd: 0
- <4>[ 230.617047] CPU 8: hi: 0, btch: 1 usd: 0
- <4>[ 230.617232] CPU 9: hi: 0, btch: 1 usd: 0
- <4>[ 230.617419] CPU 10: hi: 0, btch: 1 usd: 0
- <4>[ 230.617604] CPU 11: hi: 0, btch: 1 usd: 0
- <4>[ 230.617789] CPU 12: hi: 0, btch: 1 usd: 0
- <4>[ 230.617977] CPU 13: hi: 0, btch: 1 usd: 0
- <4>[ 230.618167] CPU 14: hi: 0, btch: 1 usd: 0
- <4>[ 230.618357] CPU 15: hi: 0, btch: 1 usd: 0
- <4>[ 230.618550] CPU 16: hi: 0, btch: 1 usd: 0
- <4>[ 230.618742] CPU 17: hi: 0, btch: 1 usd: 0
- <4>[ 230.618930] CPU 18: hi: 0, btch: 1 usd: 0
- <4>[ 230.619120] CPU 19: hi: 0, btch: 1 usd: 0
- <4>[ 230.619311] CPU 20: hi: 0, btch: 1 usd: 0
- <4>[ 230.619501] CPU 21: hi: 0, btch: 1 usd: 0
- <4>[ 230.619692] CPU 22: hi: 0, btch: 1 usd: 0
- <4>[ 230.619881] CPU 23: hi: 0, btch: 1 usd: 0
- <4>[ 230.620073] CPU 24: hi: 0, btch: 1 usd: 0
- <4>[ 230.620263] CPU 25: hi: 0, btch: 1 usd: 0
- <4>[ 230.620457] CPU 26: hi: 0, btch: 1 usd: 0
- <4>[ 230.620644] CPU 27: hi: 0, btch: 1 usd: 0
- <4>[ 230.620831] CPU 28: hi: 0, btch: 1 usd: 0
- <4>[ 230.621020] CPU 29: hi: 0, btch: 1 usd: 0
- <4>[ 230.621209] CPU 30: hi: 0, btch: 1 usd: 0
- <4>[ 230.621401] CPU 31: hi: 0, btch: 1 usd: 0
- <4>[ 230.621589] Node 0 DMA32 per-cpu:
- <4>[ 230.621853] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 230.622044] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 230.622234] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 230.622426] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 230.622617] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 230.622805] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 230.622993] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 230.623182] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 230.623372] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 230.623564] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 230.623758] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 230.623948] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 230.624142] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 230.624331] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 230.624523] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 230.624712] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 230.624900] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 230.625090] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 230.625278] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 230.625469] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 230.625658] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 230.625847] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 230.626036] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 230.626225] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 230.626417] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 230.626605] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 230.626794] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 230.626983] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 230.627172] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 230.627361] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 230.627554] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 230.627746] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 230.627940] Node 0 Normal per-cpu:
- <4>[ 230.628207] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 230.628398] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 230.628589] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 230.628777] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 230.628966] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 230.629156] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 230.629345] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 230.631547] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 230.631732] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 230.631917] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 230.632102] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 230.632292] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 230.632484] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 230.632676] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 230.632865] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 230.633056] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 230.633245] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 230.633437] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 230.633628] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 230.633819] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 230.634009] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 230.634200] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 230.634391] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 230.634583] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 230.634772] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 230.634964] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 230.635154] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 230.635347] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 230.635539] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 230.635730] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 230.635919] CPU 30: hi: 186, btch: 31 usd: 1
- <4>[ 230.636108] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 230.636300] Node 1 Normal per-cpu:
- <4>[ 230.636571] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 230.636761] CPU 1: hi: 186, btch: 31 usd: 157
- <4>[ 230.636950] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 230.637140] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 230.637328] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 230.637520] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 230.637711] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 230.637900] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 230.638090] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 230.638280] CPU 9: hi: 186, btch: 31 usd: 2
- <4>[ 230.638473] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 230.638661] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 230.638850] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 230.639042] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 230.639234] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 230.639426] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 230.639618] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 230.639807] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 230.639997] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 230.640185] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 230.640377] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 230.640568] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 230.640757] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 230.640946] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 230.641136] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 230.641324] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 230.641514] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 230.641702] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 230.641891] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 230.642080] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 230.642269] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 230.642462] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 230.642655] active_anon:21358 inactive_anon:1317 isolated_anon:0
- <4>[ 230.642656] active_file:0 inactive_file:223 isolated_file:32
- <4>[ 230.642657] unevictable:11770 dirty:0 writeback:0 unstable:0
- <4>[ 230.642658] free:52572 slab_reclaimable:2593 slab_unreclaimable:45380
- <4>[ 230.642659] mapped:1899 shmem:54 pagetables:876 bounce:0
- <4>[ 230.643620] Node 0 DMA free:15744kB min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15356kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
- <4>[ 230.644456] lowmem_reserve[]: 0 2955 32245 32245
- <4>[ 230.645040] Node 0 DMA32 free:120560kB min:4120kB low:5148kB high:6180kB active_anon:0kB inactive_anon:0kB active_file:4kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3026080kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:20kB slab_unreclaimable:17192kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:3 all_unreclaimable? no
- <4>[ 230.645895] lowmem_reserve[]: 0 0 29290 29290
- <4>[ 230.646487] Node 0 Normal free:31076kB min:40868kB low:51084kB high:61300kB active_anon:34636kB inactive_anon:2268kB active_file:0kB inactive_file:352kB unevictable:44928kB isolated(anon):0kB isolated(file):0kB present:29992960kB mlocked:44928kB dirty:0kB writeback:0kB mapped:5344kB shmem:136kB slab_reclaimable:5512kB slab_unreclaimable:75764kB kernel_stack:4816kB pagetables:1748kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:150 all_unreclaimable? yes
- <4>[ 230.647329] lowmem_reserve[]: 0 0 0 0
- <4>[ 230.647920] Node 1 Normal free:42908kB min:45096kB low:56368kB high:67644kB active_anon:50796kB inactive_anon:3000kB active_file:76kB inactive_file:540kB unevictable:2152kB isolated(anon):0kB isolated(file):128kB present:33095680kB mlocked:2152kB dirty:0kB writeback:0kB mapped:2252kB shmem:80kB slab_reclaimable:4840kB slab_unreclaimable:88564kB kernel_stack:720kB pagetables:1756kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
- <4>[ 230.648778] lowmem_reserve[]: 0 0 0 0
- <4>[ 230.649369] Node 0 DMA: 2*4kB 1*8kB 1*16kB 1*32kB 1*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15744kB
- <4>[ 230.650719] Node 0 DMA32: 56*4kB 8*8kB 7*16kB 7*32kB 10*64kB 10*128kB 7*256kB 9*512kB 7*1024kB 5*2048kB 23*4096kB = 120560kB
- <4>[ 230.652076] Node 0 Normal: 1151*4kB 627*8kB 361*16kB 176*32kB 63*64kB 15*128kB 3*256kB 0*512kB 0*1024kB 0*2048kB 1*4096kB = 31844kB
- <4>[ 230.653439] Node 1 Normal: 988*4kB 674*8kB 474*16kB 282*32kB 115*64kB 25*128kB 2*256kB 1*512kB 0*1024kB 1*2048kB 1*4096kB = 43680kB
- <4>[ 230.654791] 2183 total pagecache pages
- <4>[ 230.654980] 0 pages in swap cache
- <4>[ 230.655169] Swap cache stats: add 0, delete 0, find 0/0
- <4>[ 230.655358] Free swap = 0kB
- <4>[ 230.655546] Total swap = 0kB
- <6>[ 230.819844] 16777215 pages RAM
- <6>[ 230.820034] 294628 pages reserved
- <6>[ 230.820219] 122081 pages shared
- <6>[ 230.820407] 16392183 pages non-shared
- <6>[ 230.820592] [ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
- <6>[ 230.820949] [ 1047] 0 1047 2797 302 2 -17 -1000 udevd
- <6>[ 230.821249] [ 3171] 0 3171 6909 183 3 -17 -1000 auditd
- <6>[ 230.821543] [ 3772] 0 3772 16018 260 0 -17 -1000 sshd
- <6>[ 230.821838] [ 3953] 0 3953 19669 496 3 0 0 master
- <6>[ 230.822132] [ 3961] 0 3961 29302 305 16 0 0 crond
- <6>[ 230.822430] [ 3974] 0 3974 5363 115 1 0 0 atd
- <6>[ 230.822721] [ 4272] 0 4272 234055 3598 0 0 0 dsm_sa_datamgrd
- <6>[ 230.823015] [ 4552] 0 4552 72683 512 17 0 0 dsm_sa_eventmgr
- <6>[ 230.823312] [ 4613] 0 4613 125242 1358 9 0 0 dsm_sa_snmpd
- <6>[ 230.823605] [ 4643] 0 4643 33158 204 3 0 0 dsm_om_connsvcd
- <6>[ 230.823901] [ 4644] 0 4644 1217768 15607 1 0 0 dsm_om_connsvcd
- <6>[ 230.824199] [ 4800] 0 4800 140898 872 0 0 0 dsm_om_shrsvcd
- <6>[ 230.824499] [ 4842] 0 4842 21240 11772 16 0 0 cmcld
- <6>[ 230.824791] [ 4852] 0 4852 5055 330 2 0 0 cmserviced
- <6>[ 230.825085] [ 4854] 0 4854 4451 247 17 0 0 cmlogd
- <6>[ 230.825381] [ 4855] 0 4855 8906 375 1 0 0 cmfileassistd
- <6>[ 230.825679] [ 4856] 0 4856 5171 353 2 0 0 cmnetd
- <6>[ 230.825972] [ 4860] 0 4860 5050 302 0 0 0 cmresourced
- <6>[ 230.826271] [ 4924] 0 4924 1015 148 9 0 0 mingetty
- <6>[ 230.826566] [ 4926] 0 4926 1015 148 5 0 0 mingetty
- <6>[ 230.826865] [ 4928] 0 4928 1015 149 21 0 0 mingetty
- <6>[ 230.827163] [ 4930] 0 4930 1015 149 3 0 0 mingetty
- <6>[ 230.827455] [ 4932] 0 4932 1015 149 2 0 0 mingetty
- <6>[ 230.827748] [ 4934] 0 4934 1015 149 18 0 0 mingetty
- <6>[ 230.828041] [ 4936] 0 4936 2796 300 4 -17 -1000 udevd
- <6>[ 230.828335] [ 4937] 0 4937 2796 299 5 -17 -1000 udevd
- <6>[ 230.828627] [ 5060] 0 5060 23954 555 2 0 0 sshd
- <6>[ 230.828919] [ 5078] 1033 5078 23954 306 0 0 0 sshd
- <6>[ 230.829214] [ 5079] 1033 5079 27075 292 17 0 0 bash
- <3>[ 230.829515] Out of memory: Kill process 3953 (master) score 1 or sacrifice child
- <3>[ 230.829802] Killed process 3953, UID 0, (master) total-vm:78676kB, anon-rss:840kB, file-rss:1144kB
- <3>[ 230.832105] Out of memory: Kill process 3961 (crond) score 1 or sacrifice child
- <3>[ 230.832404] Killed process 3961, UID 0, (crond) total-vm:117208kB, anon-rss:604kB, file-rss:616kB
- <4>[ 236.527290] __ratelimit: 1 callbacks suppressed
- <4>[ 236.527482] dsm_sa_snmpd invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0, oom_score_adj=0
- <6>[ 236.529747] dsm_sa_snmpd cpuset=/ mems_allowed=0-1
- <4>[ 236.529944] Pid: 4619, comm: dsm_sa_snmpd Tainted: G W --------------- 2.6.32-279.5.2.el6.x86_64 #1
- <4>[ 236.530250] Call Trace:
- <4>[ 236.530446] [<ffffffff810c4bf1>] ? cpuset_print_task_mems_allowed+0x91/0xb0
- <4>[ 236.530643] [<ffffffff81117360>] ? dump_header+0x90/0x1b0
- <4>[ 236.530839] [<ffffffff815003e7>] ? _spin_unlock_irqrestore+0x17/0x20
- <4>[ 236.531033] [<ffffffff811177e2>] ? oom_kill_process+0x82/0x2a0
- <4>[ 236.531229] [<ffffffff81117721>] ? select_bad_process+0xe1/0x120
- <4>[ 236.531425] [<ffffffff81117c20>] ? out_of_memory+0x220/0x3c0
- <4>[ 236.531623] [<ffffffff8112793e>] ? __alloc_pages_nodemask+0x89e/0x940
- <4>[ 236.531821] [<ffffffff8115c45a>] ? alloc_pages_current+0xaa/0x110
- <4>[ 236.532018] [<ffffffff81114767>] ? __page_cache_alloc+0x87/0x90
- <4>[ 236.532215] [<ffffffff8112a38b>] ? __do_page_cache_readahead+0xdb/0x210
- <4>[ 236.532410] [<ffffffff8112a4e1>] ? ra_submit+0x21/0x30
- <4>[ 236.532602] [<ffffffff81115a93>] ? filemap_fault+0x4c3/0x500
- <4>[ 236.532797] [<ffffffff8113ee94>] ? __do_fault+0x54/0x510
- <4>[ 236.532988] [<ffffffff8113f447>] ? handle_pte_fault+0xf7/0xb50
- <4>[ 236.533186] [<ffffffff810629d3>] ? dequeue_entity+0x113/0x2e0
- <4>[ 236.533380] [<ffffffff81063c0b>] ? dequeue_task_fair+0x12b/0x130
- <4>[ 236.533575] [<ffffffff810097cc>] ? __switch_to+0x1ac/0x320
- <4>[ 236.533768] [<ffffffff81140084>] ? handle_mm_fault+0x1e4/0x2b0
- <4>[ 236.533965] [<ffffffff81097045>] ? __hrtimer_start_range_ns+0x1a5/0x470
- <4>[ 236.534165] [<ffffffff81044479>] ? __do_page_fault+0x139/0x480
- <4>[ 236.534359] [<ffffffff8109738f>] ? hrtimer_try_to_cancel+0x3f/0xd0
- <4>[ 236.534553] [<ffffffff81097442>] ? hrtimer_cancel+0x22/0x30
- <4>[ 236.534740] [<ffffffff814ff583>] ? do_nanosleep+0x93/0xc0
- <4>[ 236.534928] [<ffffffff81097514>] ? hrtimer_nanosleep+0xc4/0x180
- <4>[ 236.535214] [<ffffffff810962a0>] ? hrtimer_wakeup+0x0/0x30
- <4>[ 236.535403] [<ffffffff815034ee>] ? do_page_fault+0x3e/0xa0
- <4>[ 236.535591] [<ffffffff815008a5>] ? page_fault+0x25/0x30
- <6>[ 236.535776] Mem-Info:
- <4>[ 236.535955] Node 0 DMA per-cpu:
- <4>[ 236.536220] CPU 0: hi: 0, btch: 1 usd: 0
- <4>[ 236.536411] CPU 1: hi: 0, btch: 1 usd: 0
- <4>[ 236.536601] CPU 2: hi: 0, btch: 1 usd: 0
- <4>[ 236.536790] CPU 3: hi: 0, btch: 1 usd: 0
- <4>[ 236.536981] CPU 4: hi: 0, btch: 1 usd: 0
- <4>[ 236.537173] CPU 5: hi: 0, btch: 1 usd: 0
- <4>[ 236.537362] CPU 6: hi: 0, btch: 1 usd: 0
- <4>[ 236.537550] CPU 7: hi: 0, btch: 1 usd: 0
- <4>[ 236.537737] CPU 8: hi: 0, btch: 1 usd: 0
- <4>[ 236.537927] CPU 9: hi: 0, btch: 1 usd: 0
- <4>[ 236.538120] CPU 10: hi: 0, btch: 1 usd: 0
- <4>[ 236.538316] CPU 11: hi: 0, btch: 1 usd: 0
- <4>[ 236.538513] CPU 12: hi: 0, btch: 1 usd: 0
- <4>[ 236.538708] CPU 13: hi: 0, btch: 1 usd: 0
- <4>[ 236.538899] CPU 14: hi: 0, btch: 1 usd: 0
- <4>[ 236.539092] CPU 15: hi: 0, btch: 1 usd: 0
- <4>[ 236.539280] CPU 16: hi: 0, btch: 1 usd: 0
- <4>[ 236.539469] CPU 17: hi: 0, btch: 1 usd: 0
- <4>[ 236.539657] CPU 18: hi: 0, btch: 1 usd: 0
- <4>[ 236.539845] CPU 19: hi: 0, btch: 1 usd: 0
- <4>[ 236.540034] CPU 20: hi: 0, btch: 1 usd: 0
- <4>[ 236.540226] CPU 21: hi: 0, btch: 1 usd: 0
- <4>[ 236.540416] CPU 22: hi: 0, btch: 1 usd: 0
- <4>[ 236.540605] CPU 23: hi: 0, btch: 1 usd: 0
- <4>[ 236.540793] CPU 24: hi: 0, btch: 1 usd: 0
- <4>[ 236.540981] CPU 25: hi: 0, btch: 1 usd: 0
- <4>[ 236.541174] CPU 26: hi: 0, btch: 1 usd: 0
- <4>[ 236.541364] CPU 27: hi: 0, btch: 1 usd: 0
- <4>[ 236.541552] CPU 28: hi: 0, btch: 1 usd: 0
- <4>[ 236.541741] CPU 29: hi: 0, btch: 1 usd: 0
- <4>[ 236.541931] CPU 30: hi: 0, btch: 1 usd: 0
- <4>[ 236.542124] CPU 31: hi: 0, btch: 1 usd: 0
- <4>[ 236.542315] Node 0 DMA32 per-cpu:
- <4>[ 236.542582] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 236.542773] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 236.542961] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 236.543153] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 236.543341] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 236.543531] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 236.543719] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 236.543907] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 236.544097] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 236.544285] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 236.544473] CPU 10: hi: 186, btch: 31 usd: 3
- <4>[ 236.544661] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 236.544850] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 236.545039] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 236.545230] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 236.545419] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 236.545610] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 236.545798] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 236.545989] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 236.546182] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 236.546374] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 236.546566] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 236.546758] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 236.546946] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 236.547138] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 236.547326] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 236.547516] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 236.547705] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 236.547896] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 236.548089] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 236.548280] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 236.548470] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 236.548659] Node 0 Normal per-cpu:
- <4>[ 236.548919] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 236.549106] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 236.549388] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 236.549572] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 236.549756] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 236.549941] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 236.550128] CPU 6: hi: 186, btch: 31 usd: 6
- <4>[ 236.550313] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 236.550501] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 236.550690] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 236.550880] CPU 10: hi: 186, btch: 31 usd: 1
- <4>[ 236.551070] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 236.551264] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 236.551455] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 236.551644] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 236.551834] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 236.552024] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 236.552217] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 236.552408] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 236.552603] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 236.552796] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 236.552986] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 236.553178] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 236.553370] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 236.553559] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 236.553748] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 236.553937] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 236.554131] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 236.554320] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 236.554509] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 236.554699] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 236.554889] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 236.555081] Node 1 Normal per-cpu:
- <4>[ 236.555346] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 236.555536] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 236.555726] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 236.555917] CPU 3: hi: 186, btch: 31 usd: 1
- <4>[ 236.556112] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 236.556305] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 236.556498] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 236.556689] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 236.556880] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 236.557071] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 236.557264] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 236.557454] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 236.557645] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 236.557835] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 236.558024] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 236.558217] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 236.558409] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 236.558601] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 236.558791] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 236.558982] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 236.559174] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 236.559366] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 236.559556] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 236.559745] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 236.559935] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 236.560128] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 236.560320] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 236.560513] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 236.560704] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 236.560892] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 236.561085] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 236.561273] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 236.561465] active_anon:20300 inactive_anon:1900 isolated_anon:0
- <4>[ 236.561466] active_file:0 inactive_file:231 isolated_file:0
- <4>[ 236.561467] unevictable:11770 dirty:0 writeback:0 unstable:0
- <4>[ 236.561468] free:53249 slab_reclaimable:2300 slab_unreclaimable:45298
- <4>[ 236.561469] mapped:1886 shmem:54 pagetables:778 bounce:0
- <4>[ 236.562420] Node 0 DMA free:15744kB min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15356kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
- <4>[ 236.563246] lowmem_reserve[]: 0 2955 32245 32245
- <4>[ 236.563899] Node 0 DMA32 free:120668kB min:4120kB low:5148kB high:6180kB active_anon:0kB inactive_anon:0kB active_file:4kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3026080kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:20kB slab_unreclaimable:17076kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:1 all_unreclaimable? no
- <4>[ 236.566666] lowmem_reserve[]: 0 0 29290 29290
- <4>[ 236.567257] Node 0 Normal free:32400kB min:40868kB low:51084kB high:61300kB active_anon:34212kB inactive_anon:2348kB active_file:100kB inactive_file:224kB unevictable:44928kB isolated(anon):0kB isolated(file):0kB present:29992960kB mlocked:44928kB dirty:0kB writeback:0kB mapped:5336kB shmem:136kB slab_reclaimable:4820kB slab_unreclaimable:75668kB kernel_stack:4816kB pagetables:1732kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
- <4>[ 236.568116] lowmem_reserve[]: 0 0 0 0
- <4>[ 236.568706] Node 1 Normal free:44464kB min:45096kB low:56368kB high:67644kB active_anon:46988kB inactive_anon:5252kB active_file:0kB inactive_file:448kB unevictable:2152kB isolated(anon):0kB isolated(file):0kB present:33095680kB mlocked:2152kB dirty:0kB writeback:0kB mapped:2208kB shmem:80kB slab_reclaimable:4348kB slab_unreclaimable:88440kB kernel_stack:720kB pagetables:1380kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:1035 all_unreclaimable? yes
- <4>[ 236.569552] lowmem_reserve[]: 0 0 0 0
- <4>[ 236.570144] Node 0 DMA: 2*4kB 1*8kB 1*16kB 1*32kB 1*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15744kB
- <4>[ 236.571494] Node 0 DMA32: 67*4kB 14*8kB 8*16kB 7*32kB 10*64kB 10*128kB 7*256kB 9*512kB 7*1024kB 5*2048kB 23*4096kB = 120668kB
- <4>[ 236.572846] Node 0 Normal: 1230*4kB 638*8kB 361*16kB 178*32kB 67*64kB 17*128kB 3*256kB 0*512kB 0*1024kB 0*2048kB 1*4096kB = 32824kB
- <4>[ 236.574201] Node 1 Normal: 1069*4kB 634*8kB 457*16kB 301*32kB 119*64kB 28*128kB 3*256kB 0*512kB 1*1024kB 1*2048kB 1*4096kB = 45428kB
- <4>[ 236.575552] 2140 total pagecache pages
- <4>[ 236.575737] 0 pages in swap cache
- <4>[ 236.575923] Swap cache stats: add 0, delete 0, find 0/0
- <4>[ 236.576116] Free swap = 0kB
- <4>[ 236.576299] Total swap = 0kB
- <6>[ 236.740630] 16777215 pages RAM
- <6>[ 236.740819] 294628 pages reserved
- <6>[ 236.741007] 121624 pages shared
- <6>[ 236.741191] 16391472 pages non-shared
- <6>[ 236.741378] [ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
- <6>[ 236.741731] [ 1047] 0 1047 2797 302 2 -17 -1000 udevd
- <6>[ 236.742032] [ 3171] 0 3171 6909 183 3 -17 -1000 auditd
- <6>[ 236.742326] [ 3772] 0 3772 16018 260 0 -17 -1000 sshd
- <6>[ 236.742621] [ 3974] 0 3974 5363 115 1 0 0 atd
- <6>[ 236.742915] [ 4272] 0 4272 234055 3595 0 0 0 dsm_sa_datamgrd
- <6>[ 236.743212] [ 4552] 0 4552 72683 512 17 0 0 dsm_sa_eventmgr
- <6>[ 236.743506] [ 4613] 0 4613 125242 1354 9 0 0 dsm_sa_snmpd
- <6>[ 236.743800] [ 4643] 0 4643 33158 204 3 0 0 dsm_om_connsvcd
- <6>[ 236.744097] [ 4644] 0 4644 1217768 15606 1 0 0 dsm_om_connsvcd
- <6>[ 236.744391] [ 4800] 0 4800 140898 872 0 0 0 dsm_om_shrsvcd
- <6>[ 236.744686] [ 4842] 0 4842 21240 11772 16 0 0 cmcld
- <6>[ 236.744982] [ 4852] 0 4852 5055 330 2 0 0 cmserviced
- <6>[ 236.745275] [ 4854] 0 4854 4451 247 17 0 0 cmlogd
- <6>[ 236.745570] [ 4855] 0 4855 8906 375 1 0 0 cmfileassistd
- <6>[ 236.745870] [ 4856] 0 4856 5171 353 2 0 0 cmnetd
- <6>[ 236.746169] [ 4860] 0 4860 5050 302 0 0 0 cmresourced
- <6>[ 236.746464] [ 4924] 0 4924 1015 148 9 0 0 mingetty
- <6>[ 236.746756] [ 4926] 0 4926 1015 148 5 0 0 mingetty
- <6>[ 236.747052] [ 4928] 0 4928 1015 149 21 0 0 mingetty
- <6>[ 236.747343] [ 4930] 0 4930 1015 149 3 0 0 mingetty
- <6>[ 236.747636] [ 4932] 0 4932 1015 149 2 0 0 mingetty
- <6>[ 236.747932] [ 4934] 0 4934 1015 149 18 0 0 mingetty
- <6>[ 236.748219] [ 4936] 0 4936 2796 300 4 -17 -1000 udevd
- <6>[ 236.748601] [ 4937] 0 4937 2796 299 5 -17 -1000 udevd
- <6>[ 236.748886] [ 5060] 0 5060 23954 555 2 0 0 sshd
- <6>[ 236.749171] [ 5078] 1033 5078 23954 306 3 0 0 sshd
- <6>[ 236.749455] [ 5079] 1033 5079 27075 292 17 0 0 bash
- <3>[ 236.749746] Out of memory: Kill process 3974 (atd) score 1 or sacrifice child
- <3>[ 236.749944] Killed process 3974, UID 0, (atd) total-vm:21452kB, anon-rss:176kB, file-rss:284kB
- <4>[ 236.751034] dsm_om_connsvcd invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0, oom_score_adj=0
- <6>[ 236.751327] dsm_om_connsvcd cpuset=/ mems_allowed=0-1
- <4>[ 236.751515] Pid: 4693, comm: dsm_om_connsvcd Tainted: G W --------------- 2.6.32-279.5.2.el6.x86_64 #1
- <4>[ 236.751809] Call Trace:
- <4>[ 236.752001] [<ffffffff810c4bf1>] ? cpuset_print_task_mems_allowed+0x91/0xb0
- <4>[ 236.752199] [<ffffffff81117360>] ? dump_header+0x90/0x1b0
- <4>[ 236.752392] [<ffffffff810e37de>] ? __delayacct_freepages_end+0x2e/0x30
- <4>[ 236.752585] [<ffffffff8121494c>] ? security_real_capable_noaudit+0x3c/0x70
- <4>[ 236.752778] [<ffffffff811177e2>] ? oom_kill_process+0x82/0x2a0
- <4>[ 236.752969] [<ffffffff81117721>] ? select_bad_process+0xe1/0x120
- <4>[ 236.753158] [<ffffffff81117c20>] ? out_of_memory+0x220/0x3c0
- <4>[ 236.753352] [<ffffffff8112793e>] ? __alloc_pages_nodemask+0x89e/0x940
- <4>[ 236.753545] [<ffffffff8115c45a>] ? alloc_pages_current+0xaa/0x110
- <4>[ 236.753736] [<ffffffff81114767>] ? __page_cache_alloc+0x87/0x90
- <4>[ 236.753927] [<ffffffff8112a38b>] ? __do_page_cache_readahead+0xdb/0x210
- <4>[ 236.754118] [<ffffffff8112a4e1>] ? ra_submit+0x21/0x30
- <4>[ 236.754306] [<ffffffff81115a93>] ? filemap_fault+0x4c3/0x500
- <4>[ 236.754496] [<ffffffff8113ee94>] ? __do_fault+0x54/0x510
- <4>[ 236.754684] [<ffffffff8113f447>] ? handle_pte_fault+0xf7/0xb50
- <4>[ 236.754875] [<ffffffff8100ba4e>] ? common_interrupt+0xe/0x13
- <4>[ 236.755066] [<ffffffff81140084>] ? handle_mm_fault+0x1e4/0x2b0
- <4>[ 236.755256] [<ffffffff81044479>] ? __do_page_fault+0x139/0x480
- <4>[ 236.755449] [<ffffffff815034ee>] ? do_page_fault+0x3e/0xa0
- <4>[ 236.755638] [<ffffffff815008a5>] ? page_fault+0x25/0x30
- <6>[ 236.755829] Mem-Info:
- <4>[ 236.756013] Node 0 DMA per-cpu:
- <4>[ 236.756277] CPU 0: hi: 0, btch: 1 usd: 0
- <4>[ 236.756466] CPU 1: hi: 0, btch: 1 usd: 0
- <4>[ 236.756650] CPU 2: hi: 0, btch: 1 usd: 0
- <4>[ 236.756835] CPU 3: hi: 0, btch: 1 usd: 0
- <4>[ 236.757022] CPU 4: hi: 0, btch: 1 usd: 0
- <4>[ 236.757207] CPU 5: hi: 0, btch: 1 usd: 0
- <4>[ 236.757392] CPU 6: hi: 0, btch: 1 usd: 0
- <4>[ 236.757577] CPU 7: hi: 0, btch: 1 usd: 0
- <4>[ 236.757764] CPU 8: hi: 0, btch: 1 usd: 0
- <4>[ 236.757954] CPU 9: hi: 0, btch: 1 usd: 0
- <4>[ 236.758142] CPU 10: hi: 0, btch: 1 usd: 0
- <4>[ 236.758328] CPU 11: hi: 0, btch: 1 usd: 0
- <4>[ 236.758513] CPU 12: hi: 0, btch: 1 usd: 0
- <4>[ 236.758699] CPU 13: hi: 0, btch: 1 usd: 0
- <4>[ 236.758885] CPU 14: hi: 0, btch: 1 usd: 0
- <4>[ 236.759073] CPU 15: hi: 0, btch: 1 usd: 0
- <4>[ 236.759258] CPU 16: hi: 0, btch: 1 usd: 0
- <4>[ 236.759445] CPU 17: hi: 0, btch: 1 usd: 0
- <4>[ 236.759633] CPU 18: hi: 0, btch: 1 usd: 0
- <4>[ 236.759821] CPU 19: hi: 0, btch: 1 usd: 0
- <4>[ 236.760012] CPU 20: hi: 0, btch: 1 usd: 0
- <4>[ 236.760200] CPU 21: hi: 0, btch: 1 usd: 0
- <4>[ 236.760386] CPU 22: hi: 0, btch: 1 usd: 0
- <4>[ 236.760572] CPU 23: hi: 0, btch: 1 usd: 0
- <4>[ 236.760759] CPU 24: hi: 0, btch: 1 usd: 0
- <4>[ 236.760950] CPU 25: hi: 0, btch: 1 usd: 0
- <4>[ 236.761138] CPU 26: hi: 0, btch: 1 usd: 0
- <4>[ 236.761324] CPU 27: hi: 0, btch: 1 usd: 0
- <4>[ 236.761515] CPU 28: hi: 0, btch: 1 usd: 0
- <4>[ 236.761701] CPU 29: hi: 0, btch: 1 usd: 0
- <4>[ 236.761888] CPU 30: hi: 0, btch: 1 usd: 0
- <4>[ 236.762075] CPU 31: hi: 0, btch: 1 usd: 0
- <4>[ 236.762260] Node 0 DMA32 per-cpu:
- <4>[ 236.762516] CPU 0: hi: 186, btch: 31 usd: 1
- <4>[ 236.762799] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 236.762983] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 236.763166] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 236.763347] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 236.763530] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 236.763711] CPU 6: hi: 186, btch: 31 usd: 1
- <4>[ 236.763896] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 236.764086] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 236.764270] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 236.764455] CPU 10: hi: 186, btch: 31 usd: 3
- <4>[ 236.764641] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 236.764825] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 236.765012] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 236.765197] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 236.765382] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 236.765569] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 236.765759] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 236.765948] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 236.766138] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 236.766322] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 236.766508] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 236.766693] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 236.766878] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 236.767065] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 236.767250] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 236.769394] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 236.769579] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 236.769763] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 236.769951] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 236.770135] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 236.770321] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 236.770506] Node 0 Normal per-cpu:
- <4>[ 236.770766] CPU 0: hi: 186, btch: 31 usd: 4
- <4>[ 236.770952] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 236.771136] CPU 2: hi: 186, btch: 31 usd: 1
- <4>[ 236.771321] CPU 3: hi: 186, btch: 31 usd: 60
- <4>[ 236.771505] CPU 4: hi: 186, btch: 31 usd: 2
- <4>[ 236.771690] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 236.771875] CPU 6: hi: 186, btch: 31 usd: 6
- <4>[ 236.772062] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 236.772247] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 236.772431] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 236.772617] CPU 10: hi: 186, btch: 31 usd: 1
- <4>[ 236.772805] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 236.772995] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 236.773181] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 236.773368] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 236.773553] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 236.773739] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 236.773927] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 236.774111] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 236.774296] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 236.774481] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 236.774666] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 236.774851] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 236.775038] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 236.775223] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 236.775408] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 236.775594] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 236.775781] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 236.775969] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 236.776158] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 236.776345] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 236.776528] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 236.776710] Node 1 Normal per-cpu:
- <4>[ 236.777060] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 236.777242] CPU 1: hi: 186, btch: 31 usd: 4
- <4>[ 236.777424] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 236.777605] CPU 3: hi: 186, btch: 31 usd: 4
- <4>[ 236.777787] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 236.777972] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 236.778158] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 236.778348] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 236.778534] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 236.778720] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 236.778907] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 236.779097] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 236.779287] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 236.779476] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 236.779663] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 236.779853] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 236.780043] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 236.780233] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 236.780421] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 236.780609] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 236.780797] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 236.780984] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 236.781170] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 236.781358] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 236.781543] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 236.781728] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 236.781915] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 236.782103] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 236.782289] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 236.782476] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 236.782661] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 236.782845] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 236.783035] active_anon:20300 inactive_anon:1900 isolated_anon:0
- <4>[ 236.783036] active_file:0 inactive_file:168 isolated_file:0
- <4>[ 236.783037] unevictable:11770 dirty:0 writeback:0 unstable:0
- <4>[ 236.783038] free:53319 slab_reclaimable:2297 slab_unreclaimable:45296
- <4>[ 236.783039] mapped:1886 shmem:54 pagetables:778 bounce:0
- <4>[ 236.783981] Node 0 DMA free:15744kB min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15356kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
- <4>[ 236.784809] lowmem_reserve[]: 0 2955 32245 32245
- <4>[ 236.785386] Node 0 DMA32 free:120668kB min:4120kB low:5148kB high:6180kB active_anon:0kB inactive_anon:0kB active_file:4kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3026080kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:20kB slab_unreclaimable:17076kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:1 all_unreclaimable? no
- <4>[ 236.786208] lowmem_reserve[]: 0 0 29290 29290
- <4>[ 236.786783] Node 0 Normal free:32400kB min:40868kB low:51084kB high:61300kB active_anon:34212kB inactive_anon:2348kB active_file:100kB inactive_file:224kB unevictable:44928kB isolated(anon):0kB isolated(file):0kB present:29992960kB mlocked:44928kB dirty:0kB writeback:0kB mapped:5336kB shmem:136kB slab_reclaimable:4820kB slab_unreclaimable:75668kB kernel_stack:4816kB pagetables:1732kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
- <4>[ 236.787626] lowmem_reserve[]: 0 0 0 0
- <4>[ 236.788208] Node 1 Normal free:44464kB min:45096kB low:56368kB high:67644kB active_anon:46988kB inactive_anon:5252kB active_file:0kB inactive_file:448kB unevictable:2152kB isolated(anon):0kB isolated(file):0kB present:33095680kB mlocked:2152kB dirty:0kB writeback:0kB mapped:2208kB shmem:80kB slab_reclaimable:4348kB slab_unreclaimable:88440kB kernel_stack:720kB pagetables:1380kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:1035 all_unreclaimable? yes
- <4>[ 236.789043] lowmem_reserve[]: 0 0 0 0
- <4>[ 236.789618] Node 0 DMA: 2*4kB 1*8kB 1*16kB 1*32kB 1*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15744kB
- <4>[ 236.790931] Node 0 DMA32: 67*4kB 14*8kB 8*16kB 7*32kB 10*64kB 10*128kB 7*256kB 9*512kB 7*1024kB 5*2048kB 23*4096kB = 120668kB
- <4>[ 236.792339] Node 0 Normal: 1230*4kB 638*8kB 361*16kB 178*32kB 67*64kB 17*128kB 3*256kB 0*512kB 0*1024kB 0*2048kB 1*4096kB = 32824kB
- <4>[ 236.793665] Node 1 Normal: 1069*4kB 634*8kB 457*16kB 301*32kB 119*64kB 28*128kB 3*256kB 0*512kB 1*1024kB 1*2048kB 1*4096kB = 45428kB
- <4>[ 236.794991] 2140 total pagecache pages
- <4>[ 236.795173] 0 pages in swap cache
- <4>[ 236.795356] Swap cache stats: add 0, delete 0, find 0/0
- <4>[ 236.795545] Free swap = 0kB
- <4>[ 236.795727] Total swap = 0kB
- <6>[ 236.960788] 16777215 pages RAM
- <6>[ 236.960972] 294628 pages reserved
- <6>[ 236.961154] 121553 pages shared
- <6>[ 236.961335] 16391409 pages non-shared
- <6>[ 236.961513] [ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
- <6>[ 236.961836] [ 1047] 0 1047 2797 302 2 -17 -1000 udevd
- <6>[ 236.962124] [ 3171] 0 3171 6909 183 3 -17 -1000 auditd
- <6>[ 236.962406] [ 3772] 0 3772 16018 260 0 -17 -1000 sshd
- <6>[ 236.962688] [ 4272] 0 4272 234055 3595 0 0 0 dsm_sa_datamgrd
- <6>[ 236.962972] [ 4552] 0 4552 72683 512 17 0 0 dsm_sa_eventmgr
- <6>[ 236.963262] [ 4613] 0 4613 125242 1354 9 0 0 dsm_sa_snmpd
- <6>[ 236.963552] [ 4643] 0 4643 33158 204 3 0 0 dsm_om_connsvcd
- <6>[ 236.963845] [ 4644] 0 4644 1217768 15606 1 0 0 dsm_om_connsvcd
- <6>[ 236.964142] [ 4800] 0 4800 140898 872 0 0 0 dsm_om_shrsvcd
- <6>[ 236.964436] [ 4842] 0 4842 21240 11772 16 0 0 cmcld
- <6>[ 236.964727] [ 4852] 0 4852 5055 330 2 0 0 cmserviced
- <6>[ 236.965024] [ 4854] 0 4854 4451 247 17 0 0 cmlogd
- <6>[ 236.965316] [ 4855] 0 4855 8906 375 1 0 0 cmfileassistd
- <6>[ 236.965609] [ 4856] 0 4856 5171 380 2 0 0 cmnetd
- <6>[ 236.965901] [ 4860] 0 4860 5050 302 0 0 0 cmresourced
- <6>[ 236.966195] [ 4924] 0 4924 1015 148 9 0 0 mingetty
- <6>[ 236.966485] [ 4926] 0 4926 1015 148 5 0 0 mingetty
- <6>[ 236.966779] [ 4928] 0 4928 1015 149 21 0 0 mingetty
- <6>[ 236.967070] [ 4930] 0 4930 1015 149 3 0 0 mingetty
- <6>[ 236.967362] [ 4932] 0 4932 1015 149 2 0 0 mingetty
- <6>[ 236.967655] [ 4934] 0 4934 1015 149 18 0 0 mingetty
- <6>[ 236.967954] [ 4936] 0 4936 2796 300 4 -17 -1000 udevd
- <6>[ 236.968246] [ 4937] 0 4937 2796 299 5 -17 -1000 udevd
- <6>[ 236.968537] [ 5060] 0 5060 23954 555 2 0 0 sshd
- <6>[ 236.968833] [ 5078] 1033 5078 23954 306 3 0 0 sshd
- <6>[ 236.969126] [ 5079] 1033 5079 27075 292 17 0 0 bash
- <3>[ 236.969421] Out of memory: Kill process 4272 (dsm_sa_datamgrd) score 1 or sacrifice child
- <3>[ 236.969720] Killed process 4272, UID 0, (dsm_sa_datamgrd) total-vm:936220kB, anon-rss:13020kB, file-rss:1360kB
- <4>[ 236.972855] dsm_sa_snmpd invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0, oom_score_adj=0
- <6>[ 236.973150] dsm_sa_snmpd cpuset=/ mems_allowed=0-1
- <4>[ 236.973339] Pid: 4618, comm: dsm_sa_snmpd Tainted: G W --------------- 2.6.32-279.5.2.el6.x86_64 #1
- <4>[ 236.973641] Call Trace:
- <4>[ 236.973833] [<ffffffff810c4bf1>] ? cpuset_print_task_mems_allowed+0x91/0xb0
- <4>[ 236.974028] [<ffffffff81117360>] ? dump_header+0x90/0x1b0
- <4>[ 236.974218] [<ffffffff810e37de>] ? __delayacct_freepages_end+0x2e/0x30
- <4>[ 236.974415] [<ffffffff8121494c>] ? security_real_capable_noaudit+0x3c/0x70
- <4>[ 236.974611] [<ffffffff811177e2>] ? oom_kill_process+0x82/0x2a0
- <4>[ 236.974807] [<ffffffff81117721>] ? select_bad_process+0xe1/0x120
- <4>[ 236.974998] [<ffffffff81117c20>] ? out_of_memory+0x220/0x3c0
- <4>[ 236.975193] [<ffffffff8112793e>] ? __alloc_pages_nodemask+0x89e/0x940
- <4>[ 236.975387] [<ffffffff8115c45a>] ? alloc_pages_current+0xaa/0x110
- <4>[ 236.975580] [<ffffffff81114767>] ? __page_cache_alloc+0x87/0x90
- <4>[ 236.975768] [<ffffffff8112a38b>] ? __do_page_cache_readahead+0xdb/0x210
- <4>[ 236.975956] [<ffffffff8112a4e1>] ? ra_submit+0x21/0x30
- <4>[ 236.976240] [<ffffffff81115a93>] ? filemap_fault+0x4c3/0x500
- <4>[ 236.976428] [<ffffffff8113ee94>] ? __do_fault+0x54/0x510
- <4>[ 236.976613] [<ffffffff8113f447>] ? handle_pte_fault+0xf7/0xb50
- <4>[ 236.976803] [<ffffffff812007d9>] ? ipc_lock+0x39/0x60
- <4>[ 236.976988] [<ffffffff81204991>] ? sys_semtimedop+0x4d1/0x890
- <4>[ 236.977173] [<ffffffff81140084>] ? handle_mm_fault+0x1e4/0x2b0
- <4>[ 236.977365] [<ffffffff81044479>] ? __do_page_fault+0x139/0x480
- <4>[ 236.977558] [<ffffffff814287a5>] ? sys_sendto+0x185/0x190
- <4>[ 236.977751] [<ffffffff81139c00>] ? sys_madvise+0x350/0x760
- <4>[ 236.977942] [<ffffffff815034ee>] ? do_page_fault+0x3e/0xa0
- <4>[ 236.978131] [<ffffffff815008a5>] ? page_fault+0x25/0x30
- <6>[ 236.978319] Mem-Info:
- <4>[ 236.978501] Node 0 DMA per-cpu:
- <4>[ 236.978764] CPU 0: hi: 0, btch: 1 usd: 0
- <4>[ 236.978951] CPU 1: hi: 0, btch: 1 usd: 0
- <4>[ 236.979142] CPU 2: hi: 0, btch: 1 usd: 0
- <4>[ 236.979332] CPU 3: hi: 0, btch: 1 usd: 0
- <4>[ 236.979522] CPU 4: hi: 0, btch: 1 usd: 0
- <4>[ 236.979711] CPU 5: hi: 0, btch: 1 usd: 0
- <4>[ 236.979902] CPU 6: hi: 0, btch: 1 usd: 0
- <4>[ 236.980090] CPU 7: hi: 0, btch: 1 usd: 0
- <4>[ 236.980277] CPU 8: hi: 0, btch: 1 usd: 0
- <4>[ 236.980467] CPU 9: hi: 0, btch: 1 usd: 0
- <4>[ 236.980656] CPU 10: hi: 0, btch: 1 usd: 0
- <4>[ 236.980844] CPU 11: hi: 0, btch: 1 usd: 0
- <4>[ 236.981033] CPU 12: hi: 0, btch: 1 usd: 0
- <4>[ 236.981222] CPU 13: hi: 0, btch: 1 usd: 0
- <4>[ 236.981409] CPU 14: hi: 0, btch: 1 usd: 0
- <4>[ 236.981594] CPU 15: hi: 0, btch: 1 usd: 0
- <4>[ 236.981782] CPU 16: hi: 0, btch: 1 usd: 0
- <4>[ 236.981969] CPU 17: hi: 0, btch: 1 usd: 0
- <4>[ 236.982155] CPU 18: hi: 0, btch: 1 usd: 0
- <4>[ 236.982342] CPU 19: hi: 0, btch: 1 usd: 0
- <4>[ 236.982527] CPU 20: hi: 0, btch: 1 usd: 0
- <4>[ 236.982713] CPU 21: hi: 0, btch: 1 usd: 0
- <4>[ 236.982900] CPU 22: hi: 0, btch: 1 usd: 0
- <4>[ 236.983092] CPU 23: hi: 0, btch: 1 usd: 0
- <4>[ 236.983281] CPU 24: hi: 0, btch: 1 usd: 0
- <4>[ 236.983472] CPU 25: hi: 0, btch: 1 usd: 0
- <4>[ 236.983657] CPU 26: hi: 0, btch: 1 usd: 0
- <4>[ 236.983848] CPU 27: hi: 0, btch: 1 usd: 0
- <4>[ 236.984034] CPU 28: hi: 0, btch: 1 usd: 0
- <4>[ 236.984219] CPU 29: hi: 0, btch: 1 usd: 0
- <4>[ 236.984405] CPU 30: hi: 0, btch: 1 usd: 0
- <4>[ 236.984590] CPU 31: hi: 0, btch: 1 usd: 0
- <4>[ 236.984776] Node 0 DMA32 per-cpu:
- <4>[ 236.985034] CPU 0: hi: 186, btch: 31 usd: 1
- <4>[ 236.985219] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 236.985405] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 236.985590] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 236.985777] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 236.985963] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 236.986149] CPU 6: hi: 186, btch: 31 usd: 1
- <4>[ 236.986333] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 236.986517] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 236.986704] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 236.986892] CPU 10: hi: 186, btch: 31 usd: 3
- <4>[ 236.987080] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 236.987270] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 236.987460] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 236.987650] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 236.987842] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 236.988029] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 236.988220] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 236.988407] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 236.988593] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 236.988783] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 236.988969] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 236.989156] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 236.989343] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 236.989529] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 236.989716] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 236.989901] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 236.990082] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 236.990358] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 236.990540] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 236.990726] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 236.990908] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 236.991089] Node 0 Normal per-cpu:
- <4>[ 236.991345] CPU 0: hi: 186, btch: 31 usd: 4
- <4>[ 236.991533] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 236.991719] CPU 2: hi: 186, btch: 31 usd: 26
- <4>[ 236.991907] CPU 3: hi: 186, btch: 31 usd: 60
- <4>[ 236.992094] CPU 4: hi: 186, btch: 31 usd: 2
- <4>[ 236.992281] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 236.992467] CPU 6: hi: 186, btch: 31 usd: 6
- <4>[ 236.992657] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 236.992847] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 236.993035] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 236.993222] CPU 10: hi: 186, btch: 31 usd: 1
- <4>[ 236.993407] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 236.993594] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 236.993784] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 236.993971] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 236.994157] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 236.994343] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 236.994529] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 236.994713] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 236.994900] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 236.995084] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 236.995269] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 236.995454] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 236.995639] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 236.995827] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 236.996013] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 236.996199] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 236.996384] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 236.996568] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 236.996756] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 236.996941] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 236.997126] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 236.997317] Node 1 Normal per-cpu:
- <4>[ 236.997580] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 236.997772] CPU 1: hi: 186, btch: 31 usd: 4
- <4>[ 236.997960] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 236.998150] CPU 3: hi: 186, btch: 31 usd: 4
- <4>[ 236.998335] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 236.998521] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 236.998706] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 236.998893] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 236.999079] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 236.999264] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 236.999450] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 236.999634] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 236.999821] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 237.000006] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 237.000192] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 237.000378] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 237.000563] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 237.000749] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 237.000936] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 237.001123] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 237.001313] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 237.001503] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 237.001693] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 237.001880] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 237.002067] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 237.002252] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 237.002437] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 237.002622] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 237.002808] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 237.002994] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 237.003181] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 237.003371] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 237.003559] active_anon:20300 inactive_anon:1900 isolated_anon:0
- <4>[ 237.003560] active_file:0 inactive_file:248 isolated_file:0
- <4>[ 237.003561] unevictable:11770 dirty:0 writeback:0 unstable:0
- <4>[ 237.003562] free:53146 slab_reclaimable:2297 slab_unreclaimable:45296
- <4>[ 237.003563] mapped:1886 shmem:54 pagetables:778 bounce:0
- <4>[ 237.004490] Node 0 DMA free:15744kB min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15356kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
- <4>[ 237.005307] lowmem_reserve[]: 0 2955 32245 32245
- <4>[ 237.005888] Node 0 DMA32 free:120668kB min:4120kB low:5148kB high:6180kB active_anon:0kB inactive_anon:0kB active_file:4kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3026080kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:20kB slab_unreclaimable:17076kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:1 all_unreclaimable? no
- <4>[ 237.008683] lowmem_reserve[]: 0 0 29290 29290
- <4>[ 237.009262] Node 0 Normal free:31708kB min:40868kB low:51084kB high:61300kB active_anon:34212kB inactive_anon:2348kB active_file:100kB inactive_file:544kB unevictable:44928kB isolated(anon):0kB isolated(file):0kB present:29992960kB mlocked:44928kB dirty:0kB writeback:0kB mapped:5336kB shmem:136kB slab_reclaimable:4820kB slab_unreclaimable:75668kB kernel_stack:4816kB pagetables:1732kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:363 all_unreclaimable? yes
- <4>[ 237.010093] lowmem_reserve[]: 0 0 0 0
- <4>[ 237.010666] Node 1 Normal free:44464kB min:45096kB low:56368kB high:67644kB active_anon:46988kB inactive_anon:5252kB active_file:0kB inactive_file:448kB unevictable:2152kB isolated(anon):0kB isolated(file):0kB present:33095680kB mlocked:2152kB dirty:0kB writeback:0kB mapped:2208kB shmem:80kB slab_reclaimable:4348kB slab_unreclaimable:88440kB kernel_stack:720kB pagetables:1380kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:1035 all_unreclaimable? yes
- <4>[ 237.011510] lowmem_reserve[]: 0 0 0 0
- <4>[ 237.012089] Node 0 DMA: 2*4kB 1*8kB 1*16kB 1*32kB 1*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15744kB
- <4>[ 237.013414] Node 0 DMA32: 67*4kB 14*8kB 8*16kB 7*32kB 10*64kB 10*128kB 7*256kB 9*512kB 7*1024kB 5*2048kB 23*4096kB = 120668kB
- <4>[ 237.014741] Node 0 Normal: 1013*4kB 638*8kB 361*16kB 178*32kB 67*64kB 17*128kB 3*256kB 0*512kB 0*1024kB 0*2048kB 1*4096kB = 31956kB
- <4>[ 237.016069] Node 1 Normal: 1069*4kB 634*8kB 457*16kB 301*32kB 119*64kB 28*128kB 3*256kB 0*512kB 1*1024kB 1*2048kB 1*4096kB = 45428kB
- <4>[ 237.017390] 2259 total pagecache pages
- <4>[ 237.017577] 0 pages in swap cache
- <4>[ 237.017766] Swap cache stats: add 0, delete 0, find 0/0
- <4>[ 237.017956] Free swap = 0kB
- <4>[ 237.018138] Total swap = 0kB
- <6>[ 237.183455] 16777215 pages RAM
- <6>[ 237.183641] 294628 pages reserved
- <6>[ 237.183826] 121586 pages shared
- <6>[ 237.184011] 16391568 pages non-shared
- <6>[ 237.184198] [ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
- <6>[ 237.184526] [ 1047] 0 1047 2797 302 2 -17 -1000 udevd
- <6>[ 237.184819] [ 3171] 0 3171 6909 183 3 -17 -1000 auditd
- <6>[ 237.185108] [ 3772] 0 3772 16018 260 0 -17 -1000 sshd
- <6>[ 237.185399] [ 4492] 0 4272 234055 3595 28 0 0 dsm_sa_datamgrd
- <6>[ 237.185690] [ 4552] 0 4552 72683 512 17 0 0 dsm_sa_eventmgr
- <6>[ 237.185979] [ 4613] 0 4613 125242 1354 9 0 0 dsm_sa_snmpd
- <6>[ 237.186267] [ 4643] 0 4643 33158 204 3 0 0 dsm_om_connsvcd
- <6>[ 237.186555] [ 4644] 0 4644 1217768 15606 1 0 0 dsm_om_connsvcd
- <6>[ 237.186846] [ 4800] 0 4800 140898 872 0 0 0 dsm_om_shrsvcd
- <6>[ 237.187134] [ 4842] 0 4842 21240 11772 16 0 0 cmcld
- <6>[ 237.187423] [ 4852] 0 4852 5055 330 2 0 0 cmserviced
- <6>[ 237.187717] [ 4854] 0 4854 4451 247 17 0 0 cmlogd
- <6>[ 237.188009] [ 4855] 0 4855 8906 375 1 0 0 cmfileassistd
- <6>[ 237.188302] [ 4856] 0 4856 5171 380 2 0 0 cmnetd
- <6>[ 237.188592] [ 4860] 0 4860 5050 302 0 0 0 cmresourced
- <6>[ 237.188881] [ 4924] 0 4924 1015 148 9 0 0 mingetty
- <6>[ 237.189163] [ 4926] 0 4926 1015 148 5 0 0 mingetty
- <6>[ 237.189530] [ 4928] 0 4928 1015 149 21 0 0 mingetty
- <6>[ 237.189811] [ 4930] 0 4930 1015 149 3 0 0 mingetty
- <6>[ 237.190091] [ 4932] 0 4932 1015 149 2 0 0 mingetty
- <6>[ 237.190370] [ 4934] 0 4934 1015 149 18 0 0 mingetty
- <6>[ 237.190654] [ 4936] 0 4936 2796 300 4 -17 -1000 udevd
- <6>[ 237.190942] [ 4937] 0 4937 2796 299 5 -17 -1000 udevd
- <6>[ 237.191230] [ 5060] 0 5060 23954 555 2 0 0 sshd
- <6>[ 237.191518] [ 5078] 1033 5078 23954 306 3 0 0 sshd
- <6>[ 237.191813] [ 5079] 1033 5079 27075 292 17 0 0 bash
- <3>[ 237.192102] Out of memory: Kill process 4492 (dsm_sa_datamgrd) score 1 or sacrifice child
- <3>[ 237.192390] Killed process 4492, UID 0, (dsm_sa_datamgrd) total-vm:936220kB, anon-rss:13020kB, file-rss:1360kB
- <4>[ 237.526871] sshd invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0, oom_score_adj=0
- <6>[ 237.527168] sshd cpuset=/ mems_allowed=0-1
- <4>[ 237.527375] Pid: 5078, comm: sshd Tainted: G W --------------- 2.6.32-279.5.2.el6.x86_64 #1
- <4>[ 237.527671] Call Trace:
- <4>[ 237.527863] [<ffffffff810c4bf1>] ? cpuset_print_task_mems_allowed+0x91/0xb0
- <4>[ 237.528062] [<ffffffff81117360>] ? dump_header+0x90/0x1b0
- <4>[ 237.528257] [<ffffffff810e37de>] ? __delayacct_freepages_end+0x2e/0x30
- <4>[ 237.528461] [<ffffffff8121494c>] ? security_real_capable_noaudit+0x3c/0x70
- <4>[ 237.528658] [<ffffffff811177e2>] ? oom_kill_process+0x82/0x2a0
- <4>[ 237.528851] [<ffffffff81117721>] ? select_bad_process+0xe1/0x120
- <4>[ 237.529043] [<ffffffff81117c20>] ? out_of_memory+0x220/0x3c0
- <4>[ 237.529239] [<ffffffff8112793e>] ? __alloc_pages_nodemask+0x89e/0x940
- <4>[ 237.529439] [<ffffffff8115c45a>] ? alloc_pages_current+0xaa/0x110
- <4>[ 237.529635] [<ffffffff81114767>] ? __page_cache_alloc+0x87/0x90
- <4>[ 237.529830] [<ffffffff81190140>] ? pollwake+0x0/0x60
- <4>[ 237.530020] [<ffffffff8112a38b>] ? __do_page_cache_readahead+0xdb/0x210
- <4>[ 237.530215] [<ffffffff81190140>] ? pollwake+0x0/0x60
- <4>[ 237.530407] [<ffffffff8112a4e1>] ? ra_submit+0x21/0x30
- <4>[ 237.530594] [<ffffffff81115a93>] ? filemap_fault+0x4c3/0x500
- <4>[ 237.530783] [<ffffffff8113ee94>] ? __do_fault+0x54/0x510
- <4>[ 237.531069] [<ffffffff8113f447>] ? handle_pte_fault+0xf7/0xb50
- <4>[ 237.531259] [<ffffffff810533f3>] ? __wake_up+0x53/0x70
- <4>[ 237.531451] [<ffffffff8131644d>] ? tty_wakeup+0x3d/0x80
- <4>[ 237.531640] [<ffffffff8109248c>] ? remove_wait_queue+0x3c/0x50
- <4>[ 237.531829] [<ffffffff81140084>] ? handle_mm_fault+0x1e4/0x2b0
- <4>[ 237.532020] [<ffffffff81044479>] ? __do_page_fault+0x139/0x480
- <4>[ 237.532215] [<ffffffff81060250>] ? default_wake_function+0x0/0x20
- <4>[ 237.532413] [<ffffffff810724c7>] ? current_fs_time+0x27/0x30
- <4>[ 237.532611] [<ffffffff815034ee>] ? do_page_fault+0x3e/0xa0
- <4>[ 237.532805] [<ffffffff815008a5>] ? page_fault+0x25/0x30
- <6>[ 237.532997] Mem-Info:
- <4>[ 237.533183] Node 0 DMA per-cpu:
- <4>[ 237.533454] CPU 0: hi: 0, btch: 1 usd: 0
- <4>[ 237.533644] CPU 1: hi: 0, btch: 1 usd: 0
- <4>[ 237.533834] CPU 2: hi: 0, btch: 1 usd: 0
- <4>[ 237.534023] CPU 3: hi: 0, btch: 1 usd: 0
- <4>[ 237.534216] CPU 4: hi: 0, btch: 1 usd: 0
- <4>[ 237.534415] CPU 5: hi: 0, btch: 1 usd: 0
- <4>[ 237.534610] CPU 6: hi: 0, btch: 1 usd: 0
- <4>[ 237.534803] CPU 7: hi: 0, btch: 1 usd: 0
- <4>[ 237.534993] CPU 8: hi: 0, btch: 1 usd: 0
- <4>[ 237.535183] CPU 9: hi: 0, btch: 1 usd: 0
- <4>[ 237.535376] CPU 10: hi: 0, btch: 1 usd: 0
- <4>[ 237.535566] CPU 11: hi: 0, btch: 1 usd: 0
- <4>[ 237.535755] CPU 12: hi: 0, btch: 1 usd: 0
- <4>[ 237.535949] CPU 13: hi: 0, btch: 1 usd: 0
- <4>[ 237.536137] CPU 14: hi: 0, btch: 1 usd: 0
- <4>[ 237.536328] CPU 15: hi: 0, btch: 1 usd: 0
- <4>[ 237.536517] CPU 16: hi: 0, btch: 1 usd: 0
- <4>[ 237.536706] CPU 17: hi: 0, btch: 1 usd: 0
- <4>[ 237.536894] CPU 18: hi: 0, btch: 1 usd: 0
- <4>[ 237.537082] CPU 19: hi: 0, btch: 1 usd: 0
- <4>[ 237.537272] CPU 20: hi: 0, btch: 1 usd: 0
- <4>[ 237.537465] CPU 21: hi: 0, btch: 1 usd: 0
- <4>[ 237.537656] CPU 22: hi: 0, btch: 1 usd: 0
- <4>[ 237.537845] CPU 23: hi: 0, btch: 1 usd: 0
- <4>[ 237.538036] CPU 24: hi: 0, btch: 1 usd: 0
- <4>[ 237.538226] CPU 25: hi: 0, btch: 1 usd: 0
- <4>[ 237.538419] CPU 26: hi: 0, btch: 1 usd: 0
- <4>[ 237.538609] CPU 27: hi: 0, btch: 1 usd: 0
- <4>[ 237.538799] CPU 28: hi: 0, btch: 1 usd: 0
- <4>[ 237.538989] CPU 29: hi: 0, btch: 1 usd: 0
- <4>[ 237.539179] CPU 30: hi: 0, btch: 1 usd: 0
- <4>[ 237.539372] CPU 31: hi: 0, btch: 1 usd: 0
- <4>[ 237.539563] Node 0 DMA32 per-cpu:
- <4>[ 237.539829] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 237.540020] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 237.540211] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 237.540404] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 237.540595] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 237.540784] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 237.540974] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 237.541162] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 237.541354] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 237.541544] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 237.541734] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 237.541924] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 237.542117] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 237.542309] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 237.542504] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 237.542696] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 237.542886] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 237.543075] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 237.543264] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 237.543457] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 237.543648] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 237.543835] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 237.544023] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 237.546187] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 237.546380] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 237.546571] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 237.546760] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 237.546949] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 237.547141] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 237.547333] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 237.547524] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 237.547714] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 237.547902] Node 0 Normal per-cpu:
- <4>[ 237.548167] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 237.548359] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 237.548547] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 237.548735] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 237.548923] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 237.549112] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 237.549300] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 237.549492] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 237.549683] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 237.549872] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 237.550064] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 237.550258] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 237.550452] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 237.550644] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 237.550834] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 237.551022] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 237.551210] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 237.551400] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 237.551588] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 237.551776] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 237.551964] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 237.552152] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 237.552344] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 237.552532] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 237.552720] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 237.552908] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 237.553097] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 237.553285] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 237.553476] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 237.553664] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 237.553853] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 237.554046] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 237.554238] Node 1 Normal per-cpu:
- <4>[ 237.554514] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 237.554703] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 237.554892] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 237.555083] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 237.555272] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 237.555465] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 237.555656] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 237.555846] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 237.556037] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 237.556226] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 237.556419] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 237.556608] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 237.556797] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 237.556985] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 237.557176] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 237.557368] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 237.557559] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 237.557750] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 237.557939] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 237.558132] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 237.558328] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 237.558526] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 237.558715] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 237.558904] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 237.559089] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 237.559274] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 237.559533] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 237.559718] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 237.559902] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 237.560087] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 237.560271] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 237.560457] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 237.560648] active_anon:17307 inactive_anon:1644 isolated_anon:0
- <4>[ 237.560649] active_file:45 inactive_file:150 isolated_file:0
- <4>[ 237.560650] unevictable:11770 dirty:2 writeback:0 unstable:0
- <4>[ 237.560651] free:52344 slab_reclaimable:2297 slab_unreclaimable:45300
- <4>[ 237.560652] mapped:1897 shmem:54 pagetables:724 bounce:0
- <4>[ 237.561609] Node 0 DMA free:15744kB min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15356kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
- <4>[ 237.562463] lowmem_reserve[]: 0 2955 32245 32245
- <4>[ 237.563058] Node 0 DMA32 free:120672kB min:4120kB low:5148kB high:6180kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:4kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3026080kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:20kB slab_unreclaimable:17076kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:1 all_unreclaimable? no
- <4>[ 237.563911] lowmem_reserve[]: 0 0 29290 29290
- <4>[ 237.564501] Node 0 Normal free:32964kB min:40868kB low:51084kB high:61300kB active_anon:24476kB inactive_anon:1532kB active_file:16kB inactive_file:0kB unevictable:44928kB isolated(anon):0kB isolated(file):0kB present:29992960kB mlocked:44928kB dirty:0kB writeback:0kB mapped:5316kB shmem:136kB slab_reclaimable:4820kB slab_unreclaimable:75664kB kernel_stack:4744kB pagetables:1592kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
- <4>[ 237.565360] lowmem_reserve[]: 0 0 0 0
- <4>[ 237.565947] Node 1 Normal free:40488kB min:45096kB low:56368kB high:67644kB active_anon:44752kB inactive_anon:5044kB active_file:56kB inactive_file:572kB unevictable:2152kB isolated(anon):0kB isolated(file):0kB present:33095680kB mlocked:2152kB dirty:8kB writeback:0kB mapped:2148kB shmem:80kB slab_reclaimable:4348kB slab_unreclaimable:88460kB kernel_stack:656kB pagetables:1304kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
- <4>[ 237.566795] lowmem_reserve[]: 0 0 0 0
- <4>[ 237.567387] Node 0 DMA: 2*4kB 1*8kB 1*16kB 1*32kB 1*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15744kB
- <4>[ 237.568735] Node 0 DMA32: 72*4kB 14*8kB 8*16kB 7*32kB 10*64kB 10*128kB 7*256kB 9*512kB 7*1024kB 5*2048kB 23*4096kB = 120688kB
- <4>[ 237.570083] Node 0 Normal: 1123*4kB 621*8kB 337*16kB 183*32kB 74*64kB 25*128kB 3*256kB 0*512kB 0*1024kB 0*2048kB 1*4096kB = 33508kB
- <4>[ 237.571438] Node 1 Normal: 924*4kB 586*8kB 392*16kB 258*32kB 119*64kB 27*128kB 2*256kB 0*512kB 0*1024kB 1*2048kB 1*4096kB = 40640kB
- <4>[ 237.572788] 2029 total pagecache pages
- <4>[ 237.572975] 0 pages in swap cache
- <4>[ 237.573159] Swap cache stats: add 0, delete 0, find 0/0
- <4>[ 237.573346] Free swap = 0kB
- <4>[ 237.573525] Total swap = 0kB
- <6>[ 237.737515] 16777215 pages RAM
- <6>[ 237.737705] 294628 pages reserved
- <6>[ 237.737891] 121346 pages shared
- <6>[ 237.738076] 16392438 pages non-shared
- <6>[ 237.738264] [ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
- <6>[ 237.738601] [ 1047] 0 1047 2797 302 2 -17 -1000 udevd
- <6>[ 237.738895] [ 3171] 0 3171 6909 183 3 -17 -1000 auditd
- <6>[ 237.739192] [ 3772] 0 3772 16018 260 0 -17 -1000 sshd
- <6>[ 237.739485] [ 4552] 0 4552 72683 512 17 0 0 dsm_sa_eventmgr
- <6>[ 237.739781] [ 4613] 0 4613 125242 1354 9 0 0 dsm_sa_snmpd
- <6>[ 237.740074] [ 4643] 0 4643 33158 204 3 0 0 dsm_om_connsvcd
- <6>[ 237.740370] [ 4644] 0 4644 1217768 15606 1 0 0 dsm_om_connsvcd
- <6>[ 237.740662] [ 4800] 0 4800 140898 872 0 0 0 dsm_om_shrsvcd
- <6>[ 237.740956] [ 4842] 0 4842 21240 11772 16 0 0 cmcld
- <6>[ 237.741253] [ 4852] 0 4852 5055 330 2 0 0 cmserviced
- <6>[ 237.741547] [ 4854] 0 4854 4451 247 17 0 0 cmlogd
- <6>[ 237.741837] [ 4855] 0 4855 8906 375 1 0 0 cmfileassistd
- <6>[ 237.742130] [ 4856] 0 4856 5171 353 2 0 0 cmnetd
- <6>[ 237.742423] [ 4860] 0 4860 5050 302 0 0 0 cmresourced
- <6>[ 237.742717] [ 4924] 0 4924 1015 148 9 0 0 mingetty
- <6>[ 237.743009] [ 4926] 0 4926 1015 148 5 0 0 mingetty
- <6>[ 237.743309] [ 4928] 0 4928 1015 149 21 0 0 mingetty
- <6>[ 237.743608] [ 4930] 0 4930 1015 149 3 0 0 mingetty
- <6>[ 237.743898] [ 4932] 0 4932 1015 149 2 0 0 mingetty
- <6>[ 237.744184] [ 4934] 0 4934 1015 149 18 0 0 mingetty
- <6>[ 237.744566] [ 4936] 0 4936 2796 300 4 -17 -1000 udevd
- <6>[ 237.744850] [ 4937] 0 4937 2796 299 5 -17 -1000 udevd
- <6>[ 237.745133] [ 5060] 0 5060 23954 555 2 0 0 sshd
- <6>[ 237.745422] [ 5078] 1033 5078 23954 306 3 0 0 sshd
- <6>[ 237.745713] [ 5079] 1033 5079 27075 292 1 0 0 bash
- <6>[ 237.746004] [ 5257] 0 5257 4837 94 13 0 0 init
- <3>[ 237.746301] Out of memory: Kill process 4552 (dsm_sa_eventmgr) score 1 or sacrifice child
- <3>[ 237.748561] Killed process 4552, UID 0, (dsm_sa_eventmgr) total-vm:290732kB, anon-rss:744kB, file-rss:1304kB
- <4>[ 237.749603] dsm_om_connsvcd invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0, oom_score_adj=0
- <6>[ 237.749897] dsm_om_connsvcd cpuset=/ mems_allowed=0-1
- <4>[ 237.750083] Pid: 4707, comm: dsm_om_connsvcd Tainted: G W --------------- 2.6.32-279.5.2.el6.x86_64 #1
- <4>[ 237.750383] Call Trace:
- <4>[ 237.750577] [<ffffffff810c4bf1>] ? cpuset_print_task_mems_allowed+0x91/0xb0
- <4>[ 237.750772] [<ffffffff81117360>] ? dump_header+0x90/0x1b0
- <4>[ 237.750963] [<ffffffff810e37de>] ? __delayacct_freepages_end+0x2e/0x30
- <4>[ 237.751156] [<ffffffff8121494c>] ? security_real_capable_noaudit+0x3c/0x70
- <4>[ 237.751349] [<ffffffff811177e2>] ? oom_kill_process+0x82/0x2a0
- <4>[ 237.751541] [<ffffffff81117721>] ? select_bad_process+0xe1/0x120
- <4>[ 237.751732] [<ffffffff81117c20>] ? out_of_memory+0x220/0x3c0
- <4>[ 237.751923] [<ffffffff8112793e>] ? __alloc_pages_nodemask+0x89e/0x940
- <4>[ 237.752115] [<ffffffff8115c45a>] ? alloc_pages_current+0xaa/0x110
- <4>[ 237.752308] [<ffffffff81114767>] ? __page_cache_alloc+0x87/0x90
- <4>[ 237.752501] [<ffffffff81190140>] ? pollwake+0x0/0x60
- <4>[ 237.752688] [<ffffffff8112a38b>] ? __do_page_cache_readahead+0xdb/0x210
- <4>[ 237.752880] [<ffffffff8112a4e1>] ? ra_submit+0x21/0x30
- <4>[ 237.753068] [<ffffffff81115a93>] ? filemap_fault+0x4c3/0x500
- <4>[ 237.753257] [<ffffffff8113ee94>] ? __do_fault+0x54/0x510
- <4>[ 237.753451] [<ffffffff810600bc>] ? try_to_wake_up+0x24c/0x3e0
- <4>[ 237.753641] [<ffffffff8113f447>] ? handle_pte_fault+0xf7/0xb50
- <4>[ 237.753831] [<ffffffff812049d6>] ? sys_semtimedop+0x516/0x890
- <4>[ 237.754021] [<ffffffff81010bae>] ? copy_user_generic+0xe/0x20
- <4>[ 237.754213] [<ffffffff8118fe69>] ? set_fd_set+0x49/0x60
- <4>[ 237.754404] [<ffffffff8119133c>] ? core_sys_select+0x1ec/0x2c0
- <4>[ 237.754600] [<ffffffff81140084>] ? handle_mm_fault+0x1e4/0x2b0
- <4>[ 237.754795] [<ffffffff81044479>] ? __do_page_fault+0x139/0x480
- <4>[ 237.754990] [<ffffffff814289cb>] ? sys_recvfrom+0x16b/0x180
- <4>[ 237.755181] [<ffffffff815034ee>] ? do_page_fault+0x3e/0xa0
- <4>[ 237.755370] [<ffffffff815008a5>] ? page_fault+0x25/0x30
- <6>[ 237.755559] Mem-Info:
- <4>[ 237.755739] Node 0 DMA per-cpu:
- <4>[ 237.755998] CPU 0: hi: 0, btch: 1 usd: 0
- <4>[ 237.756184] CPU 1: hi: 0, btch: 1 usd: 0
- <4>[ 237.756370] CPU 2: hi: 0, btch: 1 usd: 0
- <4>[ 237.756558] CPU 3: hi: 0, btch: 1 usd: 0
- <4>[ 237.756743] CPU 4: hi: 0, btch: 1 usd: 0
- <4>[ 237.756928] CPU 5: hi: 0, btch: 1 usd: 0
- <4>[ 237.757114] CPU 6: hi: 0, btch: 1 usd: 0
- <4>[ 237.757301] CPU 7: hi: 0, btch: 1 usd: 0
- <4>[ 237.757493] CPU 8: hi: 0, btch: 1 usd: 0
- <4>[ 237.757677] CPU 9: hi: 0, btch: 1 usd: 0
- <4>[ 237.757864] CPU 10: hi: 0, btch: 1 usd: 0
- <4>[ 237.758050] CPU 11: hi: 0, btch: 1 usd: 0
- <4>[ 237.758231] CPU 12: hi: 0, btch: 1 usd: 0
- <4>[ 237.758413] CPU 13: hi: 0, btch: 1 usd: 0
- <4>[ 237.758698] CPU 14: hi: 0, btch: 1 usd: 0
- <4>[ 237.758880] CPU 15: hi: 0, btch: 1 usd: 0
- <4>[ 237.759062] CPU 16: hi: 0, btch: 1 usd: 0
- <4>[ 237.759243] CPU 17: hi: 0, btch: 1 usd: 0
- <4>[ 237.759425] CPU 18: hi: 0, btch: 1 usd: 0
- <4>[ 237.759609] CPU 19: hi: 0, btch: 1 usd: 0
- <4>[ 237.759797] CPU 20: hi: 0, btch: 1 usd: 0
- <4>[ 237.759983] CPU 21: hi: 0, btch: 1 usd: 0
- <4>[ 237.760169] CPU 22: hi: 0, btch: 1 usd: 0
- <4>[ 237.760356] CPU 23: hi: 0, btch: 1 usd: 0
- <4>[ 237.760547] CPU 24: hi: 0, btch: 1 usd: 0
- <4>[ 237.760734] CPU 25: hi: 0, btch: 1 usd: 0
- <4>[ 237.760921] CPU 26: hi: 0, btch: 1 usd: 0
- <4>[ 237.761107] CPU 27: hi: 0, btch: 1 usd: 0
- <4>[ 237.761293] CPU 28: hi: 0, btch: 1 usd: 0
- <4>[ 237.761482] CPU 29: hi: 0, btch: 1 usd: 0
- <4>[ 237.761669] CPU 30: hi: 0, btch: 1 usd: 0
- <4>[ 237.761857] CPU 31: hi: 0, btch: 1 usd: 0
- <4>[ 237.762045] Node 0 DMA32 per-cpu:
- <4>[ 237.762307] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 237.762494] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 237.762679] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 237.762863] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 237.763049] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 237.763234] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 237.763418] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 237.763605] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 237.763790] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 237.763975] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 237.764159] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 237.764345] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 237.764532] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 237.764717] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 237.764902] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 237.765088] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 237.765276] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 237.765467] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 237.765658] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 237.765848] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 237.766035] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 237.766221] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 237.766406] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 237.766594] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 237.766778] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 237.766964] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 237.767151] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 237.767340] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 237.767529] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 237.767715] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 237.767900] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 237.768086] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 237.768271] Node 0 Normal per-cpu:
- <4>[ 237.768533] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 237.768718] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 237.768902] CPU 2: hi: 186, btch: 31 usd: 163
- <4>[ 237.769089] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 237.769274] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 237.769466] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 237.769655] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 237.769844] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 237.770030] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 237.770214] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 237.770399] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 237.770587] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 237.770771] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 237.770956] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 237.771141] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 237.771327] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 237.771515] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 237.771701] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 237.771886] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 237.772072] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 237.772258] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 237.772441] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 237.772622] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 237.772902] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 237.773083] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 237.773265] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 237.773448] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 237.773630] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 237.773810] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 237.773997] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 237.774185] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 237.774376] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 237.774564] Node 1 Normal per-cpu:
- <4>[ 237.774830] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 237.775019] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 237.775206] CPU 2: hi: 186, btch: 31 usd: 43
- <4>[ 237.775392] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 237.775582] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 237.775770] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 237.775959] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 237.776146] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 237.776337] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 237.776527] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 237.776712] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 237.776899] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 237.777087] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 237.777275] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 237.777467] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 237.777654] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 237.777841] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 237.778030] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 237.778217] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 237.778405] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 237.778594] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 237.778782] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 237.778967] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 237.779154] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 237.779341] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 237.779533] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 237.779722] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 237.779912] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 237.780101] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 237.780290] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 237.780481] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 237.780669] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 237.780857] active_anon:17115 inactive_anon:1712 isolated_anon:0
- <4>[ 237.780858] active_file:18 inactive_file:42 isolated_file:0
- <4>[ 237.780859] unevictable:11770 dirty:2 writeback:0 unstable:0
- <4>[ 237.780860] free:52531 slab_reclaimable:2297 slab_unreclaimable:45300
- <4>[ 237.780861] mapped:1871 shmem:54 pagetables:710 bounce:0
- <4>[ 237.781802] Node 0 DMA free:15744kB min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15356kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
- <4>[ 237.782626] lowmem_reserve[]: 0 2955 32245 32245
- <4>[ 237.785138] Node 0 DMA32 free:120672kB min:4120kB low:5148kB high:6180kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:4kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3026080kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:20kB slab_unreclaimable:17076kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:1 all_unreclaimable? no
- <4>[ 237.785961] lowmem_reserve[]: 0 0 29290 29290
- <4>[ 237.786539] Node 0 Normal free:33220kB min:40868kB low:51084kB high:61300kB active_anon:23708kB inactive_anon:1816kB active_file:16kB inactive_file:0kB unevictable:44928kB isolated(anon):0kB isolated(file):0kB present:29992960kB mlocked:44928kB dirty:0kB writeback:0kB mapped:5316kB shmem:136kB slab_reclaimable:4820kB slab_unreclaimable:75664kB kernel_stack:4728kB pagetables:1536kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:64 all_unreclaimable? yes
- <4>[ 237.787452] lowmem_reserve[]: 0 0 0 0
- <4>[ 237.788022] Node 1 Normal free:40488kB min:45096kB low:56368kB high:67644kB active_anon:44752kB inactive_anon:5032kB active_file:56kB inactive_file:248kB unevictable:2152kB isolated(anon):0kB isolated(file):0kB present:33095680kB mlocked:2152kB dirty:8kB writeback:0kB mapped:2168kB shmem:80kB slab_reclaimable:4348kB slab_unreclaimable:88460kB kernel_stack:656kB pagetables:1304kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
- <4>[ 237.788854] lowmem_reserve[]: 0 0 0 0
- <4>[ 237.789433] Node 0 DMA: 2*4kB 1*8kB 1*16kB 1*32kB 1*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15744kB
- <4>[ 237.790755] Node 0 DMA32: 72*4kB 14*8kB 8*16kB 7*32kB 10*64kB 10*128kB 7*256kB 9*512kB 7*1024kB 5*2048kB 23*4096kB = 120688kB
- <4>[ 237.792078] Node 0 Normal: 1103*4kB 625*8kB 336*16kB 185*32kB 74*64kB 25*128kB 3*256kB 0*512kB 0*1024kB 0*2048kB 1*4096kB = 33508kB
- <4>[ 237.793403] Node 1 Normal: 924*4kB 586*8kB 392*16kB 258*32kB 119*64kB 27*128kB 2*256kB 0*512kB 0*1024kB 1*2048kB 1*4096kB = 40640kB
- <4>[ 237.794728] 1993 total pagecache pages
- <4>[ 237.794910] 0 pages in swap cache
- <4>[ 237.795093] Swap cache stats: add 0, delete 0, find 0/0
- <4>[ 237.795280] Free swap = 0kB
- <4>[ 237.795463] Total swap = 0kB
- <6>[ 237.959985] 16777215 pages RAM
- <6>[ 237.960169] 294628 pages reserved
- <6>[ 237.960354] 121020 pages shared
- <6>[ 237.960534] 16392232 pages non-shared
- <6>[ 237.960716] [ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
- <6>[ 237.961041] [ 1047] 0 1047 2797 302 2 -17 -1000 udevd
- <6>[ 237.961336] [ 3171] 0 3171 6909 183 3 -17 -1000 auditd
- <6>[ 237.961624] [ 3772] 0 3772 16018 260 0 -17 -1000 sshd
- <6>[ 237.961914] [ 4613] 0 4613 125242 1354 9 0 0 dsm_sa_snmpd
- <6>[ 237.962204] [ 4643] 0 4643 33158 204 3 0 0 dsm_om_connsvcd
- <6>[ 237.962495] [ 4644] 0 4644 1217768 15606 1 0 0 dsm_om_connsvcd
- <6>[ 237.962784] [ 4800] 0 4800 140898 872 0 0 0 dsm_om_shrsvcd
- <6>[ 237.963074] [ 4842] 0 4842 21240 11772 16 0 0 cmcld
- <6>[ 237.963371] [ 4852] 0 4852 5055 330 2 0 0 cmserviced
- <6>[ 237.963667] [ 4854] 0 4854 4451 247 17 0 0 cmlogd
- <6>[ 237.963954] [ 4855] 0 4855 8906 375 1 0 0 cmfileassistd
- <6>[ 237.964247] [ 4856] 0 4856 5171 353 2 0 0 cmnetd
- <6>[ 237.964537] [ 4860] 0 4860 5050 302 0 0 0 cmresourced
- <6>[ 237.964825] [ 4924] 0 4924 1015 148 9 0 0 mingetty
- <6>[ 237.965114] [ 4926] 0 4926 1015 148 5 0 0 mingetty
- <6>[ 237.965403] [ 4928] 0 4928 1015 149 21 0 0 mingetty
- <6>[ 237.965691] [ 4930] 0 4930 1015 149 3 0 0 mingetty
- <6>[ 237.965983] [ 4932] 0 4932 1015 149 2 0 0 mingetty
- <6>[ 237.966276] [ 4934] 0 4934 1015 149 18 0 0 mingetty
- <6>[ 237.966567] [ 4936] 0 4936 2796 300 4 -17 -1000 udevd
- <6>[ 237.966858] [ 4937] 0 4937 2796 299 5 -17 -1000 udevd
- <6>[ 237.967150] [ 5060] 0 5060 23954 555 2 0 0 sshd
- <6>[ 237.967443] [ 5078] 1033 5078 23954 306 3 0 0 sshd
- <6>[ 237.967730] [ 5079] 1033 5079 27075 292 1 0 0 bash
- <6>[ 237.968018] [ 5257] 0 5257 4837 94 13 0 0 init
- <3>[ 237.968308] Out of memory: Kill process 4613 (dsm_sa_snmpd) score 1 or sacrifice child
- <3>[ 237.968601] Killed process 4613, UID 0, (dsm_sa_snmpd) total-vm:500968kB, anon-rss:4124kB, file-rss:1292kB
- <4>[ 237.969399] dsm_om_connsvcd invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0, oom_score_adj=0
- <6>[ 237.969693] dsm_om_connsvcd cpuset=/ mems_allowed=0-1
- <4>[ 237.969880] Pid: 4707, comm: dsm_om_connsvcd Tainted: G W --------------- 2.6.32-279.5.2.el6.x86_64 #1
- <4>[ 237.970173] Call Trace:
- <4>[ 237.970360] [<ffffffff810c4bf1>] ? cpuset_print_task_mems_allowed+0x91/0xb0
- <4>[ 237.970553] [<ffffffff81117360>] ? dump_header+0x90/0x1b0
- <4>[ 237.970743] [<ffffffff810e37de>] ? __delayacct_freepages_end+0x2e/0x30
- <4>[ 237.970936] [<ffffffff8121494c>] ? security_real_capable_noaudit+0x3c/0x70
- <4>[ 237.971129] [<ffffffff811177e2>] ? oom_kill_process+0x82/0x2a0
- <4>[ 237.971322] [<ffffffff81117721>] ? select_bad_process+0xe1/0x120
- <4>[ 237.971511] [<ffffffff81117c20>] ? out_of_memory+0x220/0x3c0
- <4>[ 237.971699] [<ffffffff8112793e>] ? __alloc_pages_nodemask+0x89e/0x940
- <4>[ 237.971887] [<ffffffff8115c45a>] ? alloc_pages_current+0xaa/0x110
- <4>[ 237.972109] [<ffffffff81114767>] ? __page_cache_alloc+0x87/0x90
- <4>[ 237.972299] [<ffffffff81190140>] ? pollwake+0x0/0x60
- <4>[ 237.972482] [<ffffffff8112a38b>] ? __do_page_cache_readahead+0xdb/0x210
- <4>[ 237.972670] [<ffffffff8112a4e1>] ? ra_submit+0x21/0x30
- <4>[ 237.972854] [<ffffffff81115a93>] ? filemap_fault+0x4c3/0x500
- <4>[ 237.973040] [<ffffffff8113ee94>] ? __do_fault+0x54/0x510
- <4>[ 237.973230] [<ffffffff810600bc>] ? try_to_wake_up+0x24c/0x3e0
- <4>[ 237.973423] [<ffffffff8113f447>] ? handle_pte_fault+0xf7/0xb50
- <4>[ 237.973614] [<ffffffff812049d6>] ? sys_semtimedop+0x516/0x890
- <4>[ 237.973805] [<ffffffff81010bae>] ? copy_user_generic+0xe/0x20
- <4>[ 237.973995] [<ffffffff8118fe69>] ? set_fd_set+0x49/0x60
- <4>[ 237.974183] [<ffffffff8119133c>] ? core_sys_select+0x1ec/0x2c0
- <4>[ 237.974375] [<ffffffff81140084>] ? handle_mm_fault+0x1e4/0x2b0
- <4>[ 237.974566] [<ffffffff81044479>] ? __do_page_fault+0x139/0x480
- <4>[ 237.974757] [<ffffffff814289cb>] ? sys_recvfrom+0x16b/0x180
- <4>[ 237.974952] [<ffffffff815034ee>] ? do_page_fault+0x3e/0xa0
- <4>[ 237.975142] [<ffffffff815008a5>] ? page_fault+0x25/0x30
- <6>[ 237.975334] Mem-Info:
- <4>[ 237.975516] Node 0 DMA per-cpu:
- <4>[ 237.975777] CPU 0: hi: 0, btch: 1 usd: 0
- <4>[ 237.975963] CPU 1: hi: 0, btch: 1 usd: 0
- <4>[ 237.976149] CPU 2: hi: 0, btch: 1 usd: 0
- <4>[ 237.976336] CPU 3: hi: 0, btch: 1 usd: 0
- <4>[ 237.976522] CPU 4: hi: 0, btch: 1 usd: 0
- <4>[ 237.976708] CPU 5: hi: 0, btch: 1 usd: 0
- <4>[ 237.976896] CPU 6: hi: 0, btch: 1 usd: 0
- <4>[ 237.977083] CPU 7: hi: 0, btch: 1 usd: 0
- <4>[ 237.977270] CPU 8: hi: 0, btch: 1 usd: 0
- <4>[ 237.977458] CPU 9: hi: 0, btch: 1 usd: 0
- <4>[ 237.977645] CPU 10: hi: 0, btch: 1 usd: 0
- <4>[ 237.977831] CPU 11: hi: 0, btch: 1 usd: 0
- <4>[ 237.978017] CPU 12: hi: 0, btch: 1 usd: 0
- <4>[ 237.978203] CPU 13: hi: 0, btch: 1 usd: 0
- <4>[ 237.978392] CPU 14: hi: 0, btch: 1 usd: 0
- <4>[ 237.978577] CPU 15: hi: 0, btch: 1 usd: 0
- <4>[ 237.978762] CPU 16: hi: 0, btch: 1 usd: 0
- <4>[ 237.978952] CPU 17: hi: 0, btch: 1 usd: 0
- <4>[ 237.979142] CPU 18: hi: 0, btch: 1 usd: 0
- <4>[ 237.979334] CPU 19: hi: 0, btch: 1 usd: 0
- <4>[ 237.979521] CPU 20: hi: 0, btch: 1 usd: 0
- <4>[ 237.979710] CPU 21: hi: 0, btch: 1 usd: 0
- <4>[ 237.979894] CPU 22: hi: 0, btch: 1 usd: 0
- <4>[ 237.980080] CPU 23: hi: 0, btch: 1 usd: 0
- <4>[ 237.980265] CPU 24: hi: 0, btch: 1 usd: 0
- <4>[ 237.980454] CPU 25: hi: 0, btch: 1 usd: 0
- <4>[ 237.980638] CPU 26: hi: 0, btch: 1 usd: 0
- <4>[ 237.980825] CPU 27: hi: 0, btch: 1 usd: 0
- <4>[ 237.981013] CPU 28: hi: 0, btch: 1 usd: 0
- <4>[ 237.981199] CPU 29: hi: 0, btch: 1 usd: 0
- <4>[ 237.981387] CPU 30: hi: 0, btch: 1 usd: 0
- <4>[ 237.981572] CPU 31: hi: 0, btch: 1 usd: 0
- <4>[ 237.981760] Node 0 DMA32 per-cpu:
- <4>[ 237.982021] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 237.982207] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 237.982394] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 237.982582] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 237.982768] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 237.982961] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 237.983158] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 237.983355] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 237.983545] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 237.983735] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 237.983921] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 237.984108] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 237.984296] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 237.984484] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 237.984672] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 237.984859] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 237.985047] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 237.985235] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 237.985426] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 237.987586] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 237.987775] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 237.987964] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 237.988153] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 237.988345] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 237.988532] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 237.988721] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 237.988909] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 237.989097] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 237.989288] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 237.989477] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 237.989664] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 237.989853] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 237.990041] Node 0 Normal per-cpu:
- <4>[ 237.990307] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 237.990494] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 237.990679] CPU 2: hi: 186, btch: 31 usd: 163
- <4>[ 237.990867] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 237.991055] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 237.991243] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 237.991434] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 237.991623] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 237.991817] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 237.992004] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 237.992191] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 237.992380] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 237.992568] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 237.992754] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 237.992943] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 237.993133] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 237.993322] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 237.993510] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 237.993697] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 237.993884] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 237.994072] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 237.994262] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 237.994451] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 237.994638] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 237.994828] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 237.995014] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 237.995201] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 237.995393] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 237.995581] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 237.995771] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 237.995959] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 237.996146] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 237.996334] Node 1 Normal per-cpu:
- <4>[ 237.996598] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 237.996788] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 237.996976] CPU 2: hi: 186, btch: 31 usd: 43
- <4>[ 237.997165] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 237.997357] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 237.997546] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 237.997733] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 237.997920] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 237.998107] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 237.998295] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 237.998480] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 237.998670] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 237.998859] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 237.999044] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 237.999232] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 237.999424] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 237.999612] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 237.999802] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 237.999989] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 238.000173] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 238.000358] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 238.000559] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 238.000741] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 238.000922] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 238.001103] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 238.001287] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 238.001468] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 238.001654] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 238.001840] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 238.002026] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 238.002212] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 238.002400] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 238.002588] active_anon:17115 inactive_anon:1712 isolated_anon:0
- <4>[ 238.002589] active_file:18 inactive_file:42 isolated_file:0
- <4>[ 238.002590] unevictable:11770 dirty:2 writeback:0 unstable:0
- <4>[ 238.002591] free:52531 slab_reclaimable:2297 slab_unreclaimable:45300
- <4>[ 238.002592] mapped:1871 shmem:54 pagetables:710 bounce:0
- <4>[ 238.003554] Node 0 DMA free:15744kB min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15356kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
- <4>[ 238.004395] lowmem_reserve[]: 0 2955 32245 32245
- <4>[ 238.004972] Node 0 DMA32 free:120672kB min:4120kB low:5148kB high:6180kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:4kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3026080kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:20kB slab_unreclaimable:17076kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:1 all_unreclaimable? no
- <4>[ 238.005810] lowmem_reserve[]: 0 0 29290 29290
- <4>[ 238.006392] Node 0 Normal free:33220kB min:40868kB low:51084kB high:61300kB active_anon:23708kB inactive_anon:1816kB active_file:16kB inactive_file:0kB unevictable:44928kB isolated(anon):0kB isolated(file):0kB present:29992960kB mlocked:44928kB dirty:0kB writeback:0kB mapped:5316kB shmem:136kB slab_reclaimable:4820kB slab_unreclaimable:75664kB kernel_stack:4728kB pagetables:1536kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:64 all_unreclaimable? yes
- <4>[ 238.007235] lowmem_reserve[]: 0 0 0 0
- <4>[ 238.007818] Node 1 Normal free:40488kB min:45096kB low:56368kB high:67644kB active_anon:44752kB inactive_anon:5032kB active_file:56kB inactive_file:248kB unevictable:2152kB isolated(anon):0kB isolated(file):0kB present:33095680kB mlocked:2152kB dirty:8kB writeback:0kB mapped:2168kB shmem:80kB slab_reclaimable:4348kB slab_unreclaimable:88460kB kernel_stack:656kB pagetables:1304kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
- <4>[ 238.008665] lowmem_reserve[]: 0 0 0 0
- <4>[ 238.009247] Node 0 DMA: 2*4kB 1*8kB 1*16kB 1*32kB 1*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15744kB
- <4>[ 238.010572] Node 0 DMA32: 72*4kB 14*8kB 8*16kB 7*32kB 10*64kB 10*128kB 7*256kB 9*512kB 7*1024kB 5*2048kB 23*4096kB = 120688kB
- <4>[ 238.011893] Node 0 Normal: 1103*4kB 625*8kB 336*16kB 185*32kB 74*64kB 25*128kB 3*256kB 0*512kB 0*1024kB 0*2048kB 1*4096kB = 33508kB
- <4>[ 238.013218] Node 1 Normal: 924*4kB 586*8kB 392*16kB 258*32kB 119*64kB 27*128kB 2*256kB 0*512kB 0*1024kB 1*2048kB 1*4096kB = 40640kB
- <4>[ 238.014542] 1993 total pagecache pages
- <4>[ 238.014781] 0 pages in swap cache
- <4>[ 238.014960] Swap cache stats: add 0, delete 0, find 0/0
- <4>[ 238.015144] Free swap = 0kB
- <4>[ 238.015324] Total swap = 0kB
- <6>[ 238.180252] 16777215 pages RAM
- <6>[ 238.180435] 294628 pages reserved
- <6>[ 238.180616] 121020 pages shared
- <6>[ 238.180796] 16392232 pages non-shared
- <6>[ 238.180981] [ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
- <6>[ 238.181319] [ 1047] 0 1047 2797 302 2 -17 -1000 udevd
- <6>[ 238.181612] [ 3171] 0 3171 6909 183 3 -17 -1000 auditd
- <6>[ 238.181900] [ 3772] 0 3772 16018 260 0 -17 -1000 sshd
- <6>[ 238.182194] [ 4614] 0 4613 125242 1354 12 0 0 dsm_sa_snmpd
- <6>[ 238.182482] [ 4643] 0 4643 33158 204 3 0 0 dsm_om_connsvcd
- <6>[ 238.182770] [ 4644] 0 4644 1217768 15606 1 0 0 dsm_om_connsvcd
- <6>[ 238.183060] [ 4800] 0 4800 140898 872 0 0 0 dsm_om_shrsvcd
- <6>[ 238.183350] [ 4842] 0 4842 21240 11772 16 0 0 cmcld
- <6>[ 238.183638] [ 4852] 0 4852 5055 330 2 0 0 cmserviced
- <6>[ 238.183927] [ 4854] 0 4854 4451 247 17 0 0 cmlogd
- <6>[ 238.184218] [ 4855] 0 4855 8906 375 1 0 0 cmfileassistd
- <6>[ 238.184509] [ 4856] 0 4856 5171 353 2 0 0 cmnetd
- <6>[ 238.184799] [ 4860] 0 4860 5050 302 0 0 0 cmresourced
- <6>[ 238.185080] [ 4924] 0 4924 1015 148 9 0 0 mingetty
- <6>[ 238.185462] [ 4926] 0 4926 1015 148 5 0 0 mingetty
- <6>[ 238.185742] [ 4928] 0 4928 1015 149 21 0 0 mingetty
- <6>[ 238.186022] [ 4930] 0 4930 1015 149 3 0 0 mingetty
- <6>[ 238.186304] [ 4932] 0 4932 1015 149 2 0 0 mingetty
- <6>[ 238.186590] [ 4934] 0 4934 1015 149 18 0 0 mingetty
- <6>[ 238.186882] [ 4936] 0 4936 2796 300 4 -17 -1000 udevd
- <6>[ 238.187174] [ 4937] 0 4937 2796 299 5 -17 -1000 udevd
- <6>[ 238.187467] [ 5060] 0 5060 23954 555 2 0 0 sshd
- <6>[ 238.187764] [ 5078] 1033 5078 23954 306 3 0 0 sshd
- <6>[ 238.188053] [ 5079] 1033 5079 27075 292 1 0 0 bash
- <6>[ 238.188342] [ 5257] 0 5257 4837 94 13 0 0 init
- <3>[ 238.190550] Out of memory: Kill process 4614 (dsm_sa_snmpd) score 1 or sacrifice child
- <3>[ 238.190840] Killed process 4614, UID 0, (dsm_sa_snmpd) total-vm:500968kB, anon-rss:4124kB, file-rss:1292kB
- <4>[ 238.191154] dsm_sa_snmpd: page allocation failure. order:0, mode:0x20058
- <4>[ 238.191347] Pid: 4614, comm: dsm_sa_snmpd Tainted: G W --------------- 2.6.32-279.5.2.el6.x86_64 #1
- <4>[ 238.191639] Call Trace:
- <4>[ 238.191827] [<ffffffff8112781f>] ? __alloc_pages_nodemask+0x77f/0x940
- <4>[ 238.192021] [<ffffffff8115c45a>] ? alloc_pages_current+0xaa/0x110
- <4>[ 238.192213] [<ffffffff81114767>] ? __page_cache_alloc+0x87/0x90
- <4>[ 238.192405] [<ffffffff8111556f>] ? find_or_create_page+0x4f/0xb0
- <4>[ 238.192596] [<ffffffff811ad9cc>] ? __getblk+0xec/0x2e0
- <4>[ 238.192797] [<ffffffffa0098811>] ? __ext4_get_inode_loc+0xf1/0x3b0 [ext4]
- <4>[ 238.192993] [<ffffffffa009ae26>] ? ext4_iget+0x86/0x7d0 [ext4]
- <4>[ 238.193189] [<ffffffffa00a1875>] ? ext4_lookup+0xa5/0x140 [ext4]
- <4>[ 238.193383] [<ffffffff81189875>] ? do_lookup+0x1a5/0x230
- <4>[ 238.193572] [<ffffffff81189c0d>] ? __link_path_walk+0x20d/0x1030
- <4>[ 238.193766] [<ffffffff8118acba>] ? path_walk+0x6a/0xe0
- <4>[ 238.193957] [<ffffffff8118ae8b>] ? do_path_lookup+0x5b/0xa0
- <4>[ 238.194152] [<ffffffff8118af8c>] ? user_path_parent+0x4c/0x80
- <4>[ 238.194341] [<ffffffff8118b273>] ? do_unlinkat+0x33/0x1c0
- <4>[ 238.194531] [<ffffffff810d6c62>] ? audit_syscall_entry+0x272/0x2a0
- <4>[ 238.194723] [<ffffffff8100c5b5>] ? math_state_restore+0x45/0x60
- <4>[ 238.194913] [<ffffffff8118b416>] ? sys_unlink+0x16/0x20
- <4>[ 238.195104] [<ffffffff8100b0f2>] ? system_call_fastpath+0x16/0x1b
- <6>[ 238.195293] Mem-Info:
- <4>[ 238.195471] Node 0 DMA per-cpu:
- <4>[ 238.195731] CPU 0: hi: 0, btch: 1 usd: 0
- <4>[ 238.195916] CPU 1: hi: 0, btch: 1 usd: 0
- <4>[ 238.196104] CPU 2: hi: 0, btch: 1 usd: 0
- <4>[ 238.196290] CPU 3: hi: 0, btch: 1 usd: 0
- <4>[ 238.196475] CPU 4: hi: 0, btch: 1 usd: 0
- <4>[ 238.196662] CPU 5: hi: 0, btch: 1 usd: 0
- <4>[ 238.196850] CPU 6: hi: 0, btch: 1 usd: 0
- <4>[ 238.197043] CPU 7: hi: 0, btch: 1 usd: 0
- <4>[ 238.197229] CPU 8: hi: 0, btch: 1 usd: 0
- <4>[ 238.197415] CPU 9: hi: 0, btch: 1 usd: 0
- <4>[ 238.197602] CPU 10: hi: 0, btch: 1 usd: 0
- <4>[ 238.197792] CPU 11: hi: 0, btch: 1 usd: 0
- <4>[ 238.197978] CPU 12: hi: 0, btch: 1 usd: 0
- <4>[ 238.198169] CPU 13: hi: 0, btch: 1 usd: 0
- <4>[ 238.198354] CPU 14: hi: 0, btch: 1 usd: 0
- <4>[ 238.198539] CPU 15: hi: 0, btch: 1 usd: 0
- <4>[ 238.198724] CPU 16: hi: 0, btch: 1 usd: 0
- <4>[ 238.198909] CPU 17: hi: 0, btch: 1 usd: 0
- <4>[ 238.199098] CPU 18: hi: 0, btch: 1 usd: 0
- <4>[ 238.199279] CPU 19: hi: 0, btch: 1 usd: 0
- <4>[ 238.199461] CPU 20: hi: 0, btch: 1 usd: 0
- <4>[ 238.199731] CPU 21: hi: 0, btch: 1 usd: 0
- <4>[ 238.199914] CPU 22: hi: 0, btch: 1 usd: 0
- <4>[ 238.200098] CPU 23: hi: 0, btch: 1 usd: 0
- <4>[ 238.200281] CPU 24: hi: 0, btch: 1 usd: 0
- <4>[ 238.200464] CPU 25: hi: 0, btch: 1 usd: 0
- <4>[ 238.200644] CPU 26: hi: 0, btch: 1 usd: 0
- <4>[ 238.200830] CPU 27: hi: 0, btch: 1 usd: 0
- <4>[ 238.201020] CPU 28: hi: 0, btch: 1 usd: 0
- <4>[ 238.201206] CPU 29: hi: 0, btch: 1 usd: 0
- <4>[ 238.201390] CPU 30: hi: 0, btch: 1 usd: 0
- <4>[ 238.201579] CPU 31: hi: 0, btch: 1 usd: 0
- <4>[ 238.201768] Node 0 DMA32 per-cpu:
- <4>[ 238.202032] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 238.202218] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 238.202405] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 238.202596] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 238.202785] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 238.202976] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 238.203166] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 238.203354] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 238.203540] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 238.203725] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 238.203910] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 238.204097] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 238.204281] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 238.204467] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 238.204652] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 238.204838] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 238.205027] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 238.205212] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 238.205397] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 238.205582] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 238.205766] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 238.205951] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 238.206139] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 238.206325] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 238.206514] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 238.206704] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 238.206894] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 238.207085] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 238.207273] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 238.207458] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 238.207646] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 238.207831] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 238.208017] Node 0 Normal per-cpu:
- <4>[ 238.208277] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 238.208462] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 238.208646] CPU 2: hi: 186, btch: 31 usd: 163
- <4>[ 238.208832] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 238.209020] CPU 4: hi: 186, btch: 31 usd: 31
- <4>[ 238.209206] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 238.209391] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 238.209576] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 238.209761] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 238.209947] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 238.210135] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 238.210322] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 238.210510] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 238.210696] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 238.210885] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 238.211073] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 238.211259] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 238.211444] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 238.211629] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 238.211815] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 238.212003] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 238.212189] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 238.212374] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 238.212558] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 238.212742] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 238.212927] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 238.213117] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 238.213301] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 238.213482] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 238.213663] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 238.213943] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 238.214126] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 238.214307] Node 1 Normal per-cpu:
- <4>[ 238.214563] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 238.214744] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 238.214925] CPU 2: hi: 186, btch: 31 usd: 43
- <4>[ 238.215113] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 238.215299] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 238.215486] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 238.215677] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 238.215864] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 238.216055] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 238.216245] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 238.216434] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 238.216621] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 238.216813] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 238.217004] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 238.217197] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 238.217386] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 238.217576] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 238.217763] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 238.217950] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 238.218137] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 238.218323] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 238.218509] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 238.218700] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 238.218886] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 238.219074] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 238.219262] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 238.219455] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 238.219642] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 238.219829] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 238.220020] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 238.220206] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 238.220395] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 238.220583] active_anon:17115 inactive_anon:1712 isolated_anon:0
- <4>[ 238.220584] active_file:59 inactive_file:94 isolated_file:0
- <4>[ 238.220585] unevictable:11770 dirty:2 writeback:0 unstable:0
- <4>[ 238.220586] free:52694 slab_reclaimable:2297 slab_unreclaimable:45300
- <4>[ 238.220587] mapped:1876 shmem:54 pagetables:710 bounce:0
- <4>[ 238.221542] Node 0 DMA free:15744kB min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15356kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
- <4>[ 238.222361] lowmem_reserve[]: 0 2955 32245 32245
- <4>[ 238.222937] Node 0 DMA32 free:120676kB min:4120kB low:5148kB high:6180kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:4kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3026080kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:20kB slab_unreclaimable:17076kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:1 all_unreclaimable? no
- <4>[ 238.223764] lowmem_reserve[]: 0 0 29290 29290
- <4>[ 238.224342] Node 0 Normal free:33996kB min:40868kB low:51084kB high:61300kB active_anon:23708kB inactive_anon:1816kB active_file:16kB inactive_file:172kB unevictable:44928kB isolated(anon):0kB isolated(file):0kB present:29992960kB mlocked:44928kB dirty:0kB writeback:0kB mapped:5332kB shmem:136kB slab_reclaimable:4820kB slab_unreclaimable:75664kB kernel_stack:4720kB pagetables:1536kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
- <4>[ 238.227112] lowmem_reserve[]: 0 0 0 0
- <4>[ 238.227683] Node 1 Normal free:40360kB min:45096kB low:56368kB high:67644kB active_anon:44752kB inactive_anon:5032kB active_file:220kB inactive_file:200kB unevictable:2152kB isolated(anon):0kB isolated(file):0kB present:33095680kB mlocked:2152kB dirty:8kB writeback:0kB mapped:2172kB shmem:80kB slab_reclaimable:4348kB slab_unreclaimable:88460kB kernel_stack:656kB pagetables:1304kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:954 all_unreclaimable? yes
- <4>[ 238.228593] lowmem_reserve[]: 0 0 0 0
- <4>[ 238.229168] Node 0 DMA: 2*4kB 1*8kB 1*16kB 1*32kB 1*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15744kB
- <4>[ 238.230485] Node 0 DMA32: 72*4kB 14*8kB 8*16kB 7*32kB 10*64kB 10*128kB 7*256kB 9*512kB 7*1024kB 5*2048kB 23*4096kB = 120688kB
- <4>[ 238.231804] Node 0 Normal: 1150*4kB 649*8kB 342*16kB 190*32kB 75*64kB 26*128kB 3*256kB 0*512kB 0*1024kB 0*2048kB 1*4096kB = 34336kB
- <4>[ 238.233128] Node 1 Normal: 949*4kB 581*8kB 392*16kB 254*32kB 119*64kB 29*128kB 2*256kB 0*512kB 0*1024kB 1*2048kB 1*4096kB = 40828kB
- <4>[ 238.234455] 2089 total pagecache pages
- <4>[ 238.234640] 0 pages in swap cache
- <4>[ 238.234821] Swap cache stats: add 0, delete 0, find 0/0
- <4>[ 238.235012] Free swap = 0kB
- <4>[ 238.235192] Total swap = 0kB
- <6>[ 238.404204] 16777215 pages RAM
- <6>[ 238.404388] 294628 pages reserved
- <6>[ 238.404568] 121004 pages shared
- <6>[ 238.404748] 16392200 pages non-shared
- <4>[ 238.427316] dsm_om_connsvcd invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0, oom_score_adj=0
- <6>[ 238.427603] dsm_om_connsvcd cpuset=/ mems_allowed=0-1
- <4>[ 238.427791] Pid: 4693, comm: dsm_om_connsvcd Tainted: G W --------------- 2.6.32-279.5.2.el6.x86_64 #1
- <4>[ 238.428076] Call Trace:
- <4>[ 238.428258] [<ffffffff810c4bf1>] ? cpuset_print_task_mems_allowed+0x91/0xb0
- <4>[ 238.428452] [<ffffffff81117360>] ? dump_header+0x90/0x1b0
- <4>[ 238.428641] [<ffffffff8121494c>] ? security_real_capable_noaudit+0x3c/0x70
- <4>[ 238.428836] [<ffffffff811177e2>] ? oom_kill_process+0x82/0x2a0
- <4>[ 238.429025] [<ffffffff81117721>] ? select_bad_process+0xe1/0x120
- <4>[ 238.429215] [<ffffffff81117c20>] ? out_of_memory+0x220/0x3c0
- <4>[ 238.429406] [<ffffffff811171d8>] ? try_set_zonelist_oom+0xa8/0xe0
- <4>[ 238.429600] [<ffffffff8112793e>] ? __alloc_pages_nodemask+0x89e/0x940
- <4>[ 238.429797] [<ffffffff8115c45a>] ? alloc_pages_current+0xaa/0x110
- <4>[ 238.429990] [<ffffffff81114767>] ? __page_cache_alloc+0x87/0x90
- <4>[ 238.430184] [<ffffffff8112a38b>] ? __do_page_cache_readahead+0xdb/0x210
- <4>[ 238.430380] [<ffffffff8112a4e1>] ? ra_submit+0x21/0x30
- <4>[ 238.430573] [<ffffffff81115a93>] ? filemap_fault+0x4c3/0x500
- <4>[ 238.430768] [<ffffffff8113ee94>] ? __do_fault+0x54/0x510
- <4>[ 238.430959] [<ffffffff8113f447>] ? handle_pte_fault+0xf7/0xb50
- <4>[ 238.431149] [<ffffffff810962a0>] ? hrtimer_wakeup+0x0/0x30
- <4>[ 238.431337] [<ffffffff81140084>] ? handle_mm_fault+0x1e4/0x2b0
- <4>[ 238.431526] [<ffffffff810a6581>] ? do_futex+0x121/0xb60
- <4>[ 238.431717] [<ffffffff81044479>] ? __do_page_fault+0x139/0x480
- <4>[ 238.431911] [<ffffffff815034ee>] ? do_page_fault+0x3e/0xa0
- <4>[ 238.432099] [<ffffffff815008a5>] ? page_fault+0x25/0x30
- <6>[ 238.432286] Mem-Info:
- <4>[ 238.432470] Node 0 DMA per-cpu:
- <4>[ 238.432731] CPU 0: hi: 0, btch: 1 usd: 0
- <4>[ 238.432918] CPU 1: hi: 0, btch: 1 usd: 0
- <4>[ 238.433103] CPU 2: hi: 0, btch: 1 usd: 0
- <4>[ 238.433289] CPU 3: hi: 0, btch: 1 usd: 0
- <4>[ 238.433473] CPU 4: hi: 0, btch: 1 usd: 0
- <4>[ 238.433658] CPU 5: hi: 0, btch: 1 usd: 0
- <4>[ 238.433843] CPU 6: hi: 0, btch: 1 usd: 0
- <4>[ 238.434029] CPU 7: hi: 0, btch: 1 usd: 0
- <4>[ 238.434218] CPU 8: hi: 0, btch: 1 usd: 0
- <4>[ 238.434406] CPU 9: hi: 0, btch: 1 usd: 0
- <4>[ 238.434595] CPU 10: hi: 0, btch: 1 usd: 0
- <4>[ 238.434782] CPU 11: hi: 0, btch: 1 usd: 0
- <4>[ 238.434967] CPU 12: hi: 0, btch: 1 usd: 0
- <4>[ 238.435152] CPU 13: hi: 0, btch: 1 usd: 0
- <4>[ 238.435336] CPU 14: hi: 0, btch: 1 usd: 0
- <4>[ 238.435520] CPU 15: hi: 0, btch: 1 usd: 0
- <4>[ 238.435706] CPU 16: hi: 0, btch: 1 usd: 0
- <4>[ 238.435892] CPU 17: hi: 0, btch: 1 usd: 0
- <4>[ 238.436078] CPU 18: hi: 0, btch: 1 usd: 0
- <4>[ 238.436262] CPU 19: hi: 0, btch: 1 usd: 0
- <4>[ 238.436447] CPU 20: hi: 0, btch: 1 usd: 0
- <4>[ 238.436636] CPU 21: hi: 0, btch: 1 usd: 0
- <4>[ 238.436825] CPU 22: hi: 0, btch: 1 usd: 0
- <4>[ 238.437012] CPU 23: hi: 0, btch: 1 usd: 0
- <4>[ 238.437197] CPU 24: hi: 0, btch: 1 usd: 0
- <4>[ 238.437382] CPU 25: hi: 0, btch: 1 usd: 0
- <4>[ 238.437568] CPU 26: hi: 0, btch: 1 usd: 0
- <4>[ 238.437755] CPU 27: hi: 0, btch: 1 usd: 0
- <4>[ 238.437943] CPU 28: hi: 0, btch: 1 usd: 0
- <4>[ 238.438133] CPU 29: hi: 0, btch: 1 usd: 0
- <4>[ 238.438322] CPU 30: hi: 0, btch: 1 usd: 0
- <4>[ 238.438512] CPU 31: hi: 0, btch: 1 usd: 0
- <4>[ 238.438697] Node 0 DMA32 per-cpu:
- <4>[ 238.438960] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 238.439144] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 238.439330] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 238.439516] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 238.439702] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 238.439891] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 238.440077] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 238.440263] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 238.440449] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 238.440636] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 238.440824] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 238.441009] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 238.441190] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 238.441371] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 238.441581] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 238.441764] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 238.441944] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 238.442125] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 238.442306] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 238.442488] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 238.442672] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 238.442864] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 238.443051] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 238.443237] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 238.443421] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 238.443606] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 238.443792] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 238.443978] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 238.444164] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 238.444354] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 238.444542] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 238.444731] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 238.444918] Node 0 Normal per-cpu:
- <4>[ 238.445180] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 238.445365] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 238.445550] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 238.445738] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 238.445924] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 238.446109] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 238.446293] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 238.446481] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 238.446668] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 238.446857] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 238.447044] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 238.447229] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 238.447414] CPU 12: hi: 186, btch: 31 usd: 156
- <4>[ 238.447599] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 238.447786] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 238.447972] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 238.448158] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 238.448346] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 238.448536] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 238.448727] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 238.448914] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 238.449101] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 238.449285] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 238.449471] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 238.449656] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 238.449842] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 238.450027] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 238.450212] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 238.450397] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 238.450582] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 238.450769] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 238.450954] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 238.451140] Node 1 Normal per-cpu:
- <4>[ 238.451399] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 238.451583] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 238.451770] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 238.451956] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 238.452144] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 238.452335] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 238.452523] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 238.452711] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 238.452898] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 238.453082] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 238.453268] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 238.453454] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 238.453639] CPU 12: hi: 186, btch: 31 usd: 82
- <4>[ 238.453825] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 238.454010] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 238.454195] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 238.454381] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 238.454567] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 238.454754] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 238.454940] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 238.455128] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 238.455309] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 238.457453] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 238.457641] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 238.457831] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 238.458022] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 238.458207] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 238.458396] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 238.458582] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 238.458771] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 238.458958] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 238.459146] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 238.459336] active_anon:16265 inactive_anon:1648 isolated_anon:0
- <4>[ 238.459337] active_file:59 inactive_file:94 isolated_file:0
- <4>[ 238.459338] unevictable:11770 dirty:2 writeback:0 unstable:0
- <4>[ 238.459339] free:53487 slab_reclaimable:2297 slab_unreclaimable:45300
- <4>[ 238.459339] mapped:1876 shmem:54 pagetables:710 bounce:0
- <4>[ 238.460279] Node 0 DMA free:15744kB min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15356kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
- <4>[ 238.461104] lowmem_reserve[]: 0 2955 32245 32245
- <4>[ 238.461684] Node 0 DMA32 free:120676kB min:4120kB low:5148kB high:6180kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:4kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3026080kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:20kB slab_unreclaimable:17076kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:1 all_unreclaimable? no
- <4>[ 238.462513] lowmem_reserve[]: 0 0 29290 29290
- <4>[ 238.463090] Node 0 Normal free:35112kB min:40868kB low:51084kB high:61300kB active_anon:22364kB inactive_anon:1560kB active_file:16kB inactive_file:172kB unevictable:44928kB isolated(anon):0kB isolated(file):0kB present:29992960kB mlocked:44928kB dirty:0kB writeback:0kB mapped:5332kB shmem:136kB slab_reclaimable:4820kB slab_unreclaimable:75664kB kernel_stack:4720kB pagetables:1536kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:64 all_unreclaimable? no
- <4>[ 238.463929] lowmem_reserve[]: 0 0 0 0
- <4>[ 238.464503] Node 1 Normal free:42416kB min:45096kB low:56368kB high:67644kB active_anon:42696kB inactive_anon:5032kB active_file:220kB inactive_file:200kB unevictable:2152kB isolated(anon):0kB isolated(file):0kB present:33095680kB mlocked:2152kB dirty:8kB writeback:0kB mapped:2172kB shmem:80kB slab_reclaimable:4348kB slab_unreclaimable:88460kB kernel_stack:656kB pagetables:1304kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:541 all_unreclaimable? yes
- <4>[ 238.465333] lowmem_reserve[]: 0 0 0 0
- <4>[ 238.465909] Node 0 DMA: 2*4kB 1*8kB 1*16kB 1*32kB 1*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15744kB
- <4>[ 238.467229] Node 0 DMA32: 72*4kB 14*8kB 8*16kB 7*32kB 10*64kB 10*128kB 7*256kB 9*512kB 7*1024kB 5*2048kB 23*4096kB = 120688kB
- <4>[ 238.468546] Node 0 Normal: 1114*4kB 640*8kB 353*16kB 202*32kB 81*64kB 30*128kB 3*256kB 0*512kB 0*1024kB 0*2048kB 1*4096kB = 35576kB
- <4>[ 238.469956] Node 1 Normal: 949*4kB 581*8kB 392*16kB 254*32kB 119*64kB 29*128kB 2*256kB 0*512kB 0*1024kB 2*2048kB 1*4096kB = 42876kB
- <4>[ 238.471273] 2089 total pagecache pages
- <4>[ 238.471455] 0 pages in swap cache
- <4>[ 238.471637] Swap cache stats: add 0, delete 0, find 0/0
- <4>[ 238.471826] Free swap = 0kB
- <4>[ 238.472007] Total swap = 0kB
- <6>[ 238.635998] 16777215 pages RAM
- <6>[ 238.636184] 294628 pages reserved
- <6>[ 238.636367] 120720 pages shared
- <6>[ 238.636550] 16390912 pages non-shared
- <6>[ 238.636739] [ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
- <6>[ 238.637081] [ 1047] 0 1047 2797 302 2 -17 -1000 udevd
- <6>[ 238.637381] [ 3171] 0 3171 6909 183 3 -17 -1000 auditd
- <6>[ 238.637673] [ 3772] 0 3772 16018 260 0 -17 -1000 sshd
- <6>[ 238.637961] [ 4643] 0 4643 33158 204 3 0 0 dsm_om_connsvcd
- <6>[ 238.638251] [ 4644] 0 4644 1217768 15606 1 0 0 dsm_om_connsvcd
- <6>[ 238.638540] [ 4800] 0 4800 140898 872 0 0 0 dsm_om_shrsvcd
- <6>[ 238.638835] [ 4842] 0 4842 21240 11772 16 0 0 cmcld
- <6>[ 238.639122] [ 4852] 0 4852 5055 330 2 0 0 cmserviced
- <6>[ 238.639411] [ 4854] 0 4854 4451 247 17 0 0 cmlogd
- <6>[ 238.639702] [ 4855] 0 4855 8906 375 1 0 0 cmfileassistd
- <6>[ 238.639990] [ 4856] 0 4856 5171 353 2 0 0 cmnetd
- <6>[ 238.640274] [ 4860] 0 4860 5050 302 0 0 0 cmresourced
- <6>[ 238.640557] [ 4924] 0 4924 1015 148 9 0 0 mingetty
- <6>[ 238.640855] [ 4926] 0 4926 1015 148 5 0 0 mingetty
- <6>[ 238.641136] [ 4928] 0 4928 1015 149 21 0 0 mingetty
- <6>[ 238.641416] [ 4930] 0 4930 1015 149 3 0 0 mingetty
- <6>[ 238.641700] [ 4932] 0 4932 1015 149 2 0 0 mingetty
- <6>[ 238.641988] [ 4934] 0 4934 1015 149 18 0 0 mingetty
- <6>[ 238.642276] [ 4936] 0 4936 2796 300 4 -17 -1000 udevd
- <6>[ 238.642568] [ 4937] 0 4937 2796 299 5 -17 -1000 udevd
- <6>[ 238.642865] [ 5060] 0 5060 23954 555 2 0 0 sshd
- <6>[ 238.643156] [ 5078] 1033 5078 23954 306 19 0 0 sshd
- <6>[ 238.643444] [ 5079] 1033 5079 27075 292 1 0 0 bash
- <6>[ 238.643734] [ 5257] 0 5257 4837 94 13 0 0 init
- <3>[ 238.644020] Out of memory: Kill process 4643 (dsm_om_connsvcd) score 1 or sacrifice child
- <3>[ 238.644338] Killed process 4644, UID 0, (dsm_om_connsvcd) total-vm:4871072kB, anon-rss:61352kB, file-rss:1072kB
- <4>[ 238.645843] init invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0, oom_score_adj=0
- <6>[ 238.646133] init cpuset=/ mems_allowed=0-1
- <4>[ 238.646319] Pid: 1, comm: init Tainted: G W --------------- 2.6.32-279.5.2.el6.x86_64 #1
- <4>[ 238.646611] Call Trace:
- <4>[ 238.646802] [<ffffffff810c4bf1>] ? cpuset_print_task_mems_allowed+0x91/0xb0
- <4>[ 238.646997] [<ffffffff81117360>] ? dump_header+0x90/0x1b0
- <4>[ 238.647189] [<ffffffff810e37de>] ? __delayacct_freepages_end+0x2e/0x30
- <4>[ 238.647386] [<ffffffff8121494c>] ? security_real_capable_noaudit+0x3c/0x70
- <4>[ 238.647582] [<ffffffff811177e2>] ? oom_kill_process+0x82/0x2a0
- <4>[ 238.647779] [<ffffffff81117721>] ? select_bad_process+0xe1/0x120
- <4>[ 238.647969] [<ffffffff81117c20>] ? out_of_memory+0x220/0x3c0
- <4>[ 238.648161] [<ffffffff8112793e>] ? __alloc_pages_nodemask+0x89e/0x940
- <4>[ 238.648353] [<ffffffff8115c45a>] ? alloc_pages_current+0xaa/0x110
- <4>[ 238.648545] [<ffffffff81114767>] ? __page_cache_alloc+0x87/0x90
- <4>[ 238.648738] [<ffffffff8105b483>] ? perf_event_task_sched_out+0x33/0x80
- <4>[ 238.648929] [<ffffffff8112a38b>] ? __do_page_cache_readahead+0xdb/0x210
- <4>[ 238.649120] [<ffffffff8112a4e1>] ? ra_submit+0x21/0x30
- <4>[ 238.649309] [<ffffffff81115a93>] ? filemap_fault+0x4c3/0x500
- <4>[ 238.649500] [<ffffffff814fdab0>] ? thread_return+0x4e/0x76e
- <4>[ 238.649692] [<ffffffff8113ee94>] ? __do_fault+0x54/0x510
- <4>[ 238.649884] [<ffffffff8113f447>] ? handle_pte_fault+0xf7/0xb50
- <4>[ 238.650076] [<ffffffff81081a5d>] ? __sigqueue_free+0x3d/0x50
- <4>[ 238.650269] [<ffffffff810851a2>] ? __dequeue_signal+0x102/0x200
- <4>[ 238.650462] [<ffffffff8108537a>] ? dequeue_signal+0xda/0x170
- <4>[ 238.650654] [<ffffffff81140084>] ? handle_mm_fault+0x1e4/0x2b0
- <4>[ 238.650847] [<ffffffff81044479>] ? __do_page_fault+0x139/0x480
- <4>[ 238.651039] [<ffffffff81198402>] ? alloc_fd+0x92/0x160
- <4>[ 238.651232] [<ffffffff81213386>] ? security_file_permission+0x16/0x20
- <4>[ 238.651429] [<ffffffff815034ee>] ? do_page_fault+0x3e/0xa0
- <4>[ 238.651621] [<ffffffff815008a5>] ? page_fault+0x25/0x30
- <6>[ 238.651812] Mem-Info:
- <4>[ 238.651993] Node 0 DMA per-cpu:
- <4>[ 238.652256] CPU 0: hi: 0, btch: 1 usd: 0
- <4>[ 238.652441] CPU 1: hi: 0, btch: 1 usd: 0
- <4>[ 238.652629] CPU 2: hi: 0, btch: 1 usd: 0
- <4>[ 238.652814] CPU 3: hi: 0, btch: 1 usd: 0
- <4>[ 238.653000] CPU 4: hi: 0, btch: 1 usd: 0
- <4>[ 238.653190] CPU 5: hi: 0, btch: 1 usd: 0
- <4>[ 238.653375] CPU 6: hi: 0, btch: 1 usd: 0
- <4>[ 238.653560] CPU 7: hi: 0, btch: 1 usd: 0
- <4>[ 238.653746] CPU 8: hi: 0, btch: 1 usd: 0
- <4>[ 238.653931] CPU 9: hi: 0, btch: 1 usd: 0
- <4>[ 238.654116] CPU 10: hi: 0, btch: 1 usd: 0
- <4>[ 238.654302] CPU 11: hi: 0, btch: 1 usd: 0
- <4>[ 238.654483] CPU 12: hi: 0, btch: 1 usd: 0
- <4>[ 238.654666] CPU 13: hi: 0, btch: 1 usd: 0
- <4>[ 238.654949] CPU 14: hi: 0, btch: 1 usd: 0
- <4>[ 238.655130] CPU 15: hi: 0, btch: 1 usd: 0
- <4>[ 238.655312] CPU 16: hi: 0, btch: 1 usd: 0
- <4>[ 238.655493] CPU 17: hi: 0, btch: 1 usd: 0
- <4>[ 238.655676] CPU 18: hi: 0, btch: 1 usd: 0
- <4>[ 238.655857] CPU 19: hi: 0, btch: 1 usd: 0
- <4>[ 238.656043] CPU 20: hi: 0, btch: 1 usd: 0
- <4>[ 238.656228] CPU 21: hi: 0, btch: 1 usd: 0
- <4>[ 238.656414] CPU 22: hi: 0, btch: 1 usd: 0
- <4>[ 238.656600] CPU 23: hi: 0, btch: 1 usd: 0
- <4>[ 238.656788] CPU 24: hi: 0, btch: 1 usd: 0
- <4>[ 238.656977] CPU 25: hi: 0, btch: 1 usd: 0
- <4>[ 238.657161] CPU 26: hi: 0, btch: 1 usd: 0
- <4>[ 238.657348] CPU 27: hi: 0, btch: 1 usd: 0
- <4>[ 238.657532] CPU 28: hi: 0, btch: 1 usd: 0
- <4>[ 238.657724] CPU 29: hi: 0, btch: 1 usd: 0
- <4>[ 238.657915] CPU 30: hi: 0, btch: 1 usd: 0
- <4>[ 238.658106] CPU 31: hi: 0, btch: 1 usd: 0
- <4>[ 238.660266] Node 0 DMA32 per-cpu:
- <4>[ 238.660526] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 238.660712] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 238.660896] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 238.661083] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 238.661270] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 238.661459] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 238.661648] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 238.661835] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 238.662021] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 238.662207] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 238.662392] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 238.662576] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 238.662764] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 238.662949] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 238.663133] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 238.663318] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 238.663502] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 238.663688] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 238.663872] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 238.664058] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 238.664243] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 238.664428] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 238.664615] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 238.664801] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 238.664990] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 238.665180] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 238.665369] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 238.665558] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 238.665747] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 238.665935] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 238.666121] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 238.666310] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 238.666500] Node 0 Normal per-cpu:
- <4>[ 238.666765] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 238.666953] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 238.667140] CPU 2: hi: 186, btch: 31 usd: 1
- <4>[ 238.667326] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 238.667513] CPU 4: hi: 186, btch: 31 usd: 1
- <4>[ 238.667704] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 238.667889] CPU 6: hi: 186, btch: 31 usd: 30
- <4>[ 238.668076] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 238.668260] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 238.668447] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 238.668637] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 238.668818] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 238.668999] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 238.669210] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 238.669391] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 238.669572] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 238.669756] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 238.669938] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 238.670120] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 238.670306] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 238.670496] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 238.670686] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 238.670874] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 238.671060] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 238.671248] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 238.671432] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 238.671620] CPU 26: hi: 186, btch: 31 usd: 1
- <4>[ 238.671805] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 238.671992] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 238.672180] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 238.672369] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 238.672554] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 238.672744] Node 1 Normal per-cpu:
- <4>[ 238.673002] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 238.673187] CPU 1: hi: 186, btch: 31 usd: 21
- <4>[ 238.673372] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 238.673558] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 238.673745] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 238.673931] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 238.674117] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 238.674302] CPU 7: hi: 186, btch: 31 usd: 30
- <4>[ 238.674486] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 238.674673] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 238.674858] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 238.675043] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 238.675228] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 238.675413] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 238.675598] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 238.675788] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 238.675977] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 238.676164] CPU 17: hi: 186, btch: 31 usd: 1
- <4>[ 238.676354] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 238.676543] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 238.676734] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 238.676923] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 238.677111] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 238.677299] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 238.677489] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 238.677677] CPU 25: hi: 186, btch: 31 usd: 1
- <4>[ 238.677865] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 238.678050] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 238.678234] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 238.678419] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 238.678607] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 238.678792] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 238.678981] active_anon:16125 inactive_anon:1566 isolated_anon:0
- <4>[ 238.678982] active_file:74 inactive_file:17 isolated_file:0
- <4>[ 238.678983] unevictable:11770 dirty:0 writeback:0 unstable:0
- <4>[ 238.678984] free:53911 slab_reclaimable:2269 slab_unreclaimable:45255
- <4>[ 238.678985] mapped:1871 shmem:54 pagetables:618 bounce:0
- <4>[ 238.679926] Node 0 DMA free:15744kB min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15356kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
- <4>[ 238.680750] lowmem_reserve[]: 0 2955 32245 32245
- <4>[ 238.681326] Node 0 DMA32 free:120800kB min:4120kB low:5148kB high:6180kB active_anon:0kB inactive_anon:0kB active_file:4kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3026080kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:20kB slab_unreclaimable:16956kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:3 all_unreclaimable? no
- <4>[ 238.682154] lowmem_reserve[]: 0 0 29290 29290
- <4>[ 238.682732] Node 0 Normal free:36224kB min:40868kB low:51084kB high:61300kB active_anon:21816kB inactive_anon:1564kB active_file:152kB inactive_file:0kB unevictable:44928kB isolated(anon):0kB isolated(file):0kB present:29992960kB mlocked:44928kB dirty:0kB writeback:0kB mapped:5332kB shmem:136kB slab_reclaimable:4812kB slab_unreclaimable:75628kB kernel_stack:4680kB pagetables:1264kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:13440 all_unreclaimable? yes
- <4>[ 238.683644] lowmem_reserve[]: 0 0 0 0
- <4>[ 238.684214] Node 1 Normal free:42876kB min:45096kB low:56368kB high:67644kB active_anon:42684kB inactive_anon:4700kB active_file:140kB inactive_file:128kB unevictable:2152kB isolated(anon):0kB isolated(file):0kB present:33095680kB mlocked:2152kB dirty:0kB writeback:0kB mapped:2152kB shmem:80kB slab_reclaimable:4244kB slab_unreclaimable:88436kB kernel_stack:640kB pagetables:1208kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:489 all_unreclaimable? yes
- <4>[ 238.685048] lowmem_reserve[]: 0 0 0 0
- <4>[ 238.685627] Node 0 DMA: 2*4kB 1*8kB 1*16kB 1*32kB 1*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15744kB
- <4>[ 238.686948] Node 0 DMA32: 86*4kB 15*8kB 9*16kB 8*32kB 10*64kB 10*128kB 7*256kB 9*512kB 7*1024kB 5*2048kB 23*4096kB = 120800kB
- <4>[ 238.688268] Node 0 Normal: 1071*4kB 651*8kB 357*16kB 202*32kB 83*64kB 33*128kB 4*256kB 0*512kB 0*1024kB 0*2048kB 1*4096kB = 36324kB
- <4>[ 238.689589] Node 1 Normal: 927*4kB 583*8kB 387*16kB 258*32kB 119*64kB 31*128kB 2*256kB 0*512kB 0*1024kB 2*2048kB 1*4096kB = 43108kB
- <4>[ 238.690912] 2083 total pagecache pages
- <4>[ 238.691094] 0 pages in swap cache
- <4>[ 238.691275] Swap cache stats: add 0, delete 0, find 0/0
- <4>[ 238.691461] Free swap = 0kB
- <4>[ 238.691643] Total swap = 0kB
- <6>[ 238.855646] 16777215 pages RAM
- <6>[ 238.855832] 294628 pages reserved
- <6>[ 238.856013] 120695 pages shared
- <6>[ 238.856195] 16391005 pages non-shared
- <6>[ 238.856389] [ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
- <6>[ 238.856724] [ 1047] 0 1047 2797 302 2 -17 -1000 udevd
- <6>[ 238.857015] [ 3171] 0 3171 6909 183 3 -17 -1000 auditd
- <6>[ 238.857311] [ 3772] 0 3772 16018 260 0 -17 -1000 sshd
- <6>[ 238.857601] [ 4643] 0 4643 33158 204 3 0 0 dsm_om_connsvcd
- <6>[ 238.857890] [ 4707] 0 4644 1217768 15606 20 0 0 dsm_om_connsvcd
- <6>[ 238.858179] [ 4800] 0 4800 140898 872 0 0 0 dsm_om_shrsvcd
- <6>[ 238.858469] [ 4842] 0 4842 21240 11772 16 0 0 cmcld
- <6>[ 238.858760] [ 4852] 0 4852 5055 330 2 0 0 cmserviced
- <6>[ 238.859056] [ 4854] 0 4854 4451 247 17 0 0 cmlogd
- <6>[ 238.859353] [ 4855] 0 4855 8906 375 1 0 0 cmfileassistd
- <6>[ 238.859644] [ 4856] 0 4856 5171 353 2 0 0 cmnetd
- <6>[ 238.859932] [ 4860] 0 4860 5050 302 0 0 0 cmresourced
- <6>[ 238.860234] [ 4924] 0 4924 1015 148 9 0 0 mingetty
- <6>[ 238.860523] [ 4926] 0 4926 1015 148 5 0 0 mingetty
- <6>[ 238.860809] [ 4928] 0 4928 1015 149 21 0 0 mingetty
- <6>[ 238.863040] [ 4930] 0 4930 1015 149 3 0 0 mingetty
- <6>[ 238.863343] [ 4932] 0 4932 1015 149 2 0 0 mingetty
- <6>[ 238.863637] [ 4934] 0 4934 1015 149 18 0 0 mingetty
- <6>[ 238.863927] [ 4936] 0 4936 2796 300 4 -17 -1000 udevd
- <6>[ 238.864217] [ 4937] 0 4937 2796 299 5 -17 -1000 udevd
- <6>[ 238.864509] [ 5060] 0 5060 23954 555 2 0 0 sshd
- <6>[ 238.864797] [ 5078] 1033 5078 23954 306 3 0 0 sshd
- <6>[ 238.865083] [ 5079] 1033 5079 27075 292 1 0 0 bash
- <6>[ 238.865370] [ 5257] 0 5257 4837 94 13 0 0 init
- <3>[ 238.865658] Out of memory: Kill process 4643 (dsm_om_connsvcd) score 1 or sacrifice child
- <3>[ 238.865947] Killed process 4707, UID 0, (dsm_om_connsvcd) total-vm:4871072kB, anon-rss:61352kB, file-rss:1072kB
- <4>[ 251.068122] cmnetd invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0, oom_score_adj=0
- <6>[ 251.068425] cmnetd cpuset=/ mems_allowed=0-1
- <4>[ 251.068611] Pid: 4856, comm: cmnetd Tainted: G W --------------- 2.6.32-279.5.2.el6.x86_64 #1
- <4>[ 251.068902] Call Trace:
- <4>[ 251.069091] [<ffffffff810c4bf1>] ? cpuset_print_task_mems_allowed+0x91/0xb0
- <4>[ 251.069283] [<ffffffff81117360>] ? dump_header+0x90/0x1b0
- <4>[ 251.069474] [<ffffffff8121494c>] ? security_real_capable_noaudit+0x3c/0x70
- <4>[ 251.069666] [<ffffffff811177e2>] ? oom_kill_process+0x82/0x2a0
- <4>[ 251.069856] [<ffffffff81117721>] ? select_bad_process+0xe1/0x120
- <4>[ 251.070046] [<ffffffff81117c20>] ? out_of_memory+0x220/0x3c0
- <4>[ 251.070241] [<ffffffff8112793e>] ? __alloc_pages_nodemask+0x89e/0x940
- <4>[ 251.070435] [<ffffffff8115c45a>] ? alloc_pages_current+0xaa/0x110
- <4>[ 251.070626] [<ffffffff81114767>] ? __page_cache_alloc+0x87/0x90
- <4>[ 251.070816] [<ffffffff8112a38b>] ? __do_page_cache_readahead+0xdb/0x210
- <4>[ 251.071008] [<ffffffff81190140>] ? pollwake+0x0/0x60
- <4>[ 251.071198] [<ffffffff8112a4e1>] ? ra_submit+0x21/0x30
- <4>[ 251.071386] [<ffffffff81115a93>] ? filemap_fault+0x4c3/0x500
- <4>[ 251.071577] [<ffffffff8113ee94>] ? __do_fault+0x54/0x510
- <4>[ 251.071765] [<ffffffff8113f447>] ? handle_pte_fault+0xf7/0xb50
- <4>[ 251.071956] [<ffffffff8117f2f5>] ? chrdev_open+0x125/0x230
- <4>[ 251.072146] [<ffffffff814488d5>] ? __rtnl_unlock+0x15/0x20
- <4>[ 251.072336] [<ffffffff8143b882>] ? netdev_run_todo+0x52/0x220
- <4>[ 251.072528] [<ffffffff81010bae>] ? copy_user_generic+0xe/0x20
- <4>[ 251.072718] [<ffffffff8118fe69>] ? set_fd_set+0x49/0x60
- <4>[ 251.072906] [<ffffffff8119133c>] ? core_sys_select+0x1ec/0x2c0
- <4>[ 251.073096] [<ffffffff81140084>] ? handle_mm_fault+0x1e4/0x2b0
- <4>[ 251.073295] [<ffffffff81044479>] ? __do_page_fault+0x139/0x480
- <4>[ 251.073484] [<ffffffff81012bd9>] ? read_tsc+0x9/0x20
- <4>[ 251.073674] [<ffffffff8109ce29>] ? ktime_get_ts+0xa9/0xe0
- <4>[ 251.073862] [<ffffffff8118fd98>] ? poll_select_copy_remaining+0xf8/0x150
- <4>[ 251.074057] [<ffffffff815034ee>] ? do_page_fault+0x3e/0xa0
- <4>[ 251.074247] [<ffffffff815008a5>] ? page_fault+0x25/0x30
- <6>[ 251.074429] Mem-Info:
- <4>[ 251.074605] Node 0 DMA per-cpu:
- <4>[ 251.074956] CPU 0: hi: 0, btch: 1 usd: 0
- <4>[ 251.075139] CPU 1: hi: 0, btch: 1 usd: 0
- <4>[ 251.075320] CPU 2: hi: 0, btch: 1 usd: 0
- <4>[ 251.075501] CPU 3: hi: 0, btch: 1 usd: 0
- <4>[ 251.075682] CPU 4: hi: 0, btch: 1 usd: 0
- <4>[ 251.075863] CPU 5: hi: 0, btch: 1 usd: 0
- <4>[ 251.076048] CPU 6: hi: 0, btch: 1 usd: 0
- <4>[ 251.076241] CPU 7: hi: 0, btch: 1 usd: 0
- <4>[ 251.076426] CPU 8: hi: 0, btch: 1 usd: 0
- <4>[ 251.076621] CPU 9: hi: 0, btch: 1 usd: 0
- <4>[ 251.076807] CPU 10: hi: 0, btch: 1 usd: 0
- <4>[ 251.077005] CPU 11: hi: 0, btch: 1 usd: 0
- <4>[ 251.077191] CPU 12: hi: 0, btch: 1 usd: 0
- <4>[ 251.077383] CPU 13: hi: 0, btch: 1 usd: 0
- <4>[ 251.077576] CPU 14: hi: 0, btch: 1 usd: 0
- <4>[ 251.077780] CPU 15: hi: 0, btch: 1 usd: 0
- <4>[ 251.077970] CPU 16: hi: 0, btch: 1 usd: 0
- <4>[ 251.078163] CPU 17: hi: 0, btch: 1 usd: 0
- <4>[ 251.078354] CPU 18: hi: 0, btch: 1 usd: 0
- <4>[ 251.078548] CPU 19: hi: 0, btch: 1 usd: 0
- <4>[ 251.078732] CPU 20: hi: 0, btch: 1 usd: 0
- <4>[ 251.078924] CPU 21: hi: 0, btch: 1 usd: 0
- <4>[ 251.079111] CPU 22: hi: 0, btch: 1 usd: 0
- <4>[ 251.079311] CPU 23: hi: 0, btch: 1 usd: 0
- <4>[ 251.079497] CPU 24: hi: 0, btch: 1 usd: 0
- <4>[ 251.079688] CPU 25: hi: 0, btch: 1 usd: 0
- <4>[ 251.079873] CPU 26: hi: 0, btch: 1 usd: 0
- <4>[ 251.080065] CPU 27: hi: 0, btch: 1 usd: 0
- <4>[ 251.080252] CPU 28: hi: 0, btch: 1 usd: 0
- <4>[ 251.080444] CPU 29: hi: 0, btch: 1 usd: 0
- <4>[ 251.080630] CPU 30: hi: 0, btch: 1 usd: 0
- <4>[ 251.080822] CPU 31: hi: 0, btch: 1 usd: 0
- <4>[ 251.081008] Node 0 DMA32 per-cpu:
- <4>[ 251.081273] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 251.081459] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 251.081646] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 251.081835] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 251.082025] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 251.082216] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 251.082406] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 251.082599] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 251.082784] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 251.082976] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 251.083163] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 251.083356] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 251.083546] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 251.083738] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 251.083924] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 251.084125] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 251.084316] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 251.084507] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 251.084692] CPU 18: hi: 186, btch: 31 usd: 30
- <4>[ 251.084884] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 251.085068] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 251.085262] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 251.085447] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 251.085634] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 251.085821] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 251.086018] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 251.086207] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 251.086399] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 251.086583] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 251.086769] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 251.086956] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 251.087153] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 251.087339] Node 0 Normal per-cpu:
- <4>[ 251.087600] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 251.087787] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 251.087976] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 251.088165] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 251.088352] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 251.088544] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 251.088726] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 251.088915] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 251.089109] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 251.089297] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 251.089493] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 251.089681] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 251.089862] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 251.090043] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 251.090233] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 251.090428] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 251.090613] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 251.090798] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 251.090987] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 251.091176] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 251.091361] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 251.091549] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 251.091734] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 251.091920] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 251.092110] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 251.092303] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 251.092489] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 251.092683] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 251.092869] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 251.093061] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 251.093248] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 251.093448] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 251.093634] Node 1 Normal per-cpu:
- <4>[ 251.093903] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 251.094108] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 251.094301] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 251.094495] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 251.094684] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 251.094870] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 251.095056] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 251.095243] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 251.095432] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 251.095618] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 251.095802] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 251.095989] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 251.096179] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 251.096366] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 251.096553] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 251.096745] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 251.096929] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 251.097115] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 251.097309] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 251.097493] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 251.097680] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 251.099860] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 251.100045] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 251.100242] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 251.100428] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 251.100614] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 251.100805] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 251.100997] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 251.101184] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 251.101376] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 251.101562] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 251.101747] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 251.101934] active_anon:1776 inactive_anon:657 isolated_anon:0
- <4>[ 251.101935] active_file:70 inactive_file:145 isolated_file:0
- <4>[ 251.101936] unevictable:11770 dirty:2 writeback:0 unstable:0
- <4>[ 251.101936] free:49940 slab_reclaimable:1795 slab_unreclaimable:44898
- <4>[ 251.101937] mapped:1879 shmem:54 pagetables:435 bounce:0
- <4>[ 251.102864] Node 0 DMA free:15744kB min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15356kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
- <4>[ 251.103751] lowmem_reserve[]: 0 2955 32245 32245
- <4>[ 251.104333] Node 0 DMA32 free:120208kB min:4120kB low:5148kB high:6180kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:112kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3026080kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:20kB slab_unreclaimable:16600kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:640 all_unreclaimable? yes
- <4>[ 251.105162] lowmem_reserve[]: 0 0 29290 29290
- <4>[ 251.105745] Node 0 Normal free:30336kB min:40868kB low:51084kB high:61300kB active_anon:3036kB inactive_anon:896kB active_file:124kB inactive_file:320kB unevictable:44928kB isolated(anon):0kB isolated(file):0kB present:29992960kB mlocked:44928kB dirty:0kB writeback:0kB mapped:5332kB shmem:136kB slab_reclaimable:3660kB slab_unreclaimable:75128kB kernel_stack:4456kB pagetables:888kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:724 all_unreclaimable? yes
- <4>[ 251.106599] lowmem_reserve[]: 0 0 0 0
- <4>[ 251.107178] Node 1 Normal free:33472kB min:45096kB low:56368kB high:67644kB active_anon:4068kB inactive_anon:1732kB active_file:156kB inactive_file:148kB unevictable:2152kB isolated(anon):0kB isolated(file):0kB present:33095680kB mlocked:2152kB dirty:8kB writeback:0kB mapped:2184kB shmem:80kB slab_reclaimable:3500kB slab_unreclaimable:87864kB kernel_stack:256kB pagetables:852kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:581 all_unreclaimable? yes
- <4>[ 251.108021] lowmem_reserve[]: 0 0 0 0
- <4>[ 251.108600] Node 0 DMA: 2*4kB 1*8kB 1*16kB 1*32kB 1*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15744kB
- <4>[ 251.109932] Node 0 DMA32: 28*4kB 4*8kB 4*16kB 4*32kB 9*64kB 10*128kB 7*256kB 9*512kB 7*1024kB 5*2048kB 23*4096kB = 120208kB
- <4>[ 251.111252] Node 0 Normal: 844*4kB 519*8kB 298*16kB 177*32kB 80*64kB 33*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 1*4096kB = 31400kB
- <4>[ 251.112575] Node 1 Normal: 657*4kB 457*8kB 299*16kB 173*32kB 102*64kB 28*128kB 4*256kB 0*512kB 0*1024kB 1*2048kB 1*4096kB = 33884kB
- <4>[ 251.113895] 2244 total pagecache pages
- <4>[ 251.114092] 0 pages in swap cache
- <4>[ 251.114273] Swap cache stats: add 0, delete 0, find 0/0
- <4>[ 251.114460] Free swap = 0kB
- <4>[ 251.114638] Total swap = 0kB
- <6>[ 251.277721] 16777215 pages RAM
- <6>[ 251.277907] 294628 pages reserved
- <6>[ 251.278091] 120234 pages shared
- <6>[ 251.278273] 16395023 pages non-shared
- <6>[ 251.278455] [ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
- <6>[ 251.278781] [ 1047] 0 1047 2797 302 2 -17 -1000 udevd
- <6>[ 251.279074] [ 3171] 0 3171 6909 183 3 -17 -1000 auditd
- <6>[ 251.279361] [ 3772] 0 3772 16018 260 0 -17 -1000 sshd
- <6>[ 251.279653] [ 4643] 0 4643 33158 205 1 0 0 dsm_om_connsvcd
- <6>[ 251.279944] [ 4800] 0 4800 140898 872 0 0 0 dsm_om_shrsvcd
- <6>[ 251.280234] [ 4842] 0 4842 21240 11772 16 0 0 cmcld
- <6>[ 251.280521] [ 4852] 0 4852 5055 330 2 0 0 cmserviced
- <6>[ 251.280808] [ 4854] 0 4854 4451 249 17 0 0 cmlogd
- <6>[ 251.281097] [ 4855] 0 4855 8906 375 1 0 0 cmfileassistd
- <6>[ 251.281386] [ 4856] 0 4856 5171 359 18 0 0 cmnetd
- <6>[ 251.281680] [ 4860] 0 4860 5050 302 0 0 0 cmresourced
- <6>[ 251.281976] [ 4924] 0 4924 1015 148 9 0 0 mingetty
- <6>[ 251.282265] [ 4926] 0 4926 1015 148 5 0 0 mingetty
- <6>[ 251.282555] [ 4928] 0 4928 1015 149 21 0 0 mingetty
- <6>[ 251.282847] [ 4930] 0 4930 1015 149 3 0 0 mingetty
- <6>[ 251.283137] [ 4932] 0 4932 1015 149 2 0 0 mingetty
- <6>[ 251.283424] [ 4934] 0 4934 1015 149 18 0 0 mingetty
- <6>[ 251.283711] [ 4936] 0 4936 2796 300 4 -17 -1000 udevd
- <6>[ 251.283999] [ 4937] 0 4937 2796 299 5 -17 -1000 udevd
- <6>[ 251.284290] [ 5060] 0 5060 23954 555 2 0 0 sshd
- <6>[ 251.284585] [ 5078] 1033 5078 23954 306 1 0 0 sshd
- <6>[ 251.284873] [ 5079] 1033 5079 27075 292 1 0 0 bash
- <6>[ 251.285162] [ 5257] 0 5257 61 30 1 0 0 jnx_mlnxsnmp_da
- <3>[ 251.285450] Out of memory: Kill process 4643 (dsm_om_connsvcd) score 1 or sacrifice child
- <3>[ 251.285741] Killed process 4643, UID 0, (dsm_om_connsvcd) total-vm:132632kB, anon-rss:424kB, file-rss:396kB
- <4>[ 251.286992] cmnetd invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0, oom_score_adj=0
- <6>[ 251.287281] cmnetd cpuset=/ mems_allowed=0-1
- <4>[ 251.287464] Pid: 4856, comm: cmnetd Tainted: G W --------------- 2.6.32-279.5.2.el6.x86_64 #1
- <4>[ 251.287755] Call Trace:
- <4>[ 251.287939] [<ffffffff810c4bf1>] ? cpuset_print_task_mems_allowed+0x91/0xb0
- <4>[ 251.288231] [<ffffffff81117360>] ? dump_header+0x90/0x1b0
- <4>[ 251.288418] [<ffffffff810e37de>] ? __delayacct_freepages_end+0x2e/0x30
- <4>[ 251.288607] [<ffffffff8121494c>] ? security_real_capable_noaudit+0x3c/0x70
- <4>[ 251.288796] [<ffffffff811177e2>] ? oom_kill_process+0x82/0x2a0
- <4>[ 251.288982] [<ffffffff81117721>] ? select_bad_process+0xe1/0x120
- <4>[ 251.289168] [<ffffffff81117c20>] ? out_of_memory+0x220/0x3c0
- <4>[ 251.289361] [<ffffffff8112793e>] ? __alloc_pages_nodemask+0x89e/0x940
- <4>[ 251.289553] [<ffffffff8115c45a>] ? alloc_pages_current+0xaa/0x110
- <4>[ 251.289746] [<ffffffff81114767>] ? __page_cache_alloc+0x87/0x90
- <4>[ 251.289938] [<ffffffff8112a38b>] ? __do_page_cache_readahead+0xdb/0x210
- <4>[ 251.290131] [<ffffffff81190140>] ? pollwake+0x0/0x60
- <4>[ 251.290317] [<ffffffff8112a4e1>] ? ra_submit+0x21/0x30
- <4>[ 251.290506] [<ffffffff81115a93>] ? filemap_fault+0x4c3/0x500
- <4>[ 251.290696] [<ffffffff8113ee94>] ? __do_fault+0x54/0x510
- <4>[ 251.290885] [<ffffffff8113f447>] ? handle_pte_fault+0xf7/0xb50
- <4>[ 251.291080] [<ffffffff8117f2f5>] ? chrdev_open+0x125/0x230
- <4>[ 251.291270] [<ffffffff814488d5>] ? __rtnl_unlock+0x15/0x20
- <4>[ 251.291465] [<ffffffff8143b882>] ? netdev_run_todo+0x52/0x220
- <4>[ 251.291658] [<ffffffff81010bae>] ? copy_user_generic+0xe/0x20
- <4>[ 251.291848] [<ffffffff8118fe69>] ? set_fd_set+0x49/0x60
- <4>[ 251.292039] [<ffffffff8119133c>] ? core_sys_select+0x1ec/0x2c0
- <4>[ 251.292230] [<ffffffff81140084>] ? handle_mm_fault+0x1e4/0x2b0
- <4>[ 251.292422] [<ffffffff81044479>] ? __do_page_fault+0x139/0x480
- <4>[ 251.292612] [<ffffffff81012bd9>] ? read_tsc+0x9/0x20
- <4>[ 251.292802] [<ffffffff8109ce29>] ? ktime_get_ts+0xa9/0xe0
- <4>[ 251.292992] [<ffffffff8118fd98>] ? poll_select_copy_remaining+0xf8/0x150
- <4>[ 251.293185] [<ffffffff815034ee>] ? do_page_fault+0x3e/0xa0
- <4>[ 251.293373] [<ffffffff815008a5>] ? page_fault+0x25/0x30
- <6>[ 251.293560] Mem-Info:
- <4>[ 251.293738] Node 0 DMA per-cpu:
- <4>[ 251.293999] CPU 0: hi: 0, btch: 1 usd: 0
- <4>[ 251.294184] CPU 1: hi: 0, btch: 1 usd: 0
- <4>[ 251.294369] CPU 2: hi: 0, btch: 1 usd: 0
- <4>[ 251.294555] CPU 3: hi: 0, btch: 1 usd: 0
- <4>[ 251.294740] CPU 4: hi: 0, btch: 1 usd: 0
- <4>[ 251.294926] CPU 5: hi: 0, btch: 1 usd: 0
- <4>[ 251.295114] CPU 6: hi: 0, btch: 1 usd: 0
- <4>[ 251.295300] CPU 7: hi: 0, btch: 1 usd: 0
- <4>[ 251.295489] CPU 8: hi: 0, btch: 1 usd: 0
- <4>[ 251.295679] CPU 9: hi: 0, btch: 1 usd: 0
- <4>[ 251.295866] CPU 10: hi: 0, btch: 1 usd: 0
- <4>[ 251.296055] CPU 11: hi: 0, btch: 1 usd: 0
- <4>[ 251.296241] CPU 12: hi: 0, btch: 1 usd: 0
- <4>[ 251.296425] CPU 13: hi: 0, btch: 1 usd: 0
- <4>[ 251.296610] CPU 14: hi: 0, btch: 1 usd: 0
- <4>[ 251.296794] CPU 15: hi: 0, btch: 1 usd: 0
- <4>[ 251.296981] CPU 16: hi: 0, btch: 1 usd: 0
- <4>[ 251.297166] CPU 17: hi: 0, btch: 1 usd: 0
- <4>[ 251.297351] CPU 18: hi: 0, btch: 1 usd: 0
- <4>[ 251.297538] CPU 19: hi: 0, btch: 1 usd: 0
- <4>[ 251.297725] CPU 20: hi: 0, btch: 1 usd: 0
- <4>[ 251.297912] CPU 21: hi: 0, btch: 1 usd: 0
- <4>[ 251.298103] CPU 22: hi: 0, btch: 1 usd: 0
- <4>[ 251.298288] CPU 23: hi: 0, btch: 1 usd: 0
- <4>[ 251.298474] CPU 24: hi: 0, btch: 1 usd: 0
- <4>[ 251.298660] CPU 25: hi: 0, btch: 1 usd: 0
- <4>[ 251.298846] CPU 26: hi: 0, btch: 1 usd: 0
- <4>[ 251.299039] CPU 27: hi: 0, btch: 1 usd: 0
- <4>[ 251.299226] CPU 28: hi: 0, btch: 1 usd: 0
- <4>[ 251.299416] CPU 29: hi: 0, btch: 1 usd: 0
- <4>[ 251.301521] CPU 30: hi: 0, btch: 1 usd: 0
- <4>[ 251.301707] CPU 31: hi: 0, btch: 1 usd: 0
- <4>[ 251.301895] Node 0 DMA32 per-cpu:
- <4>[ 251.302154] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 251.302438] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 251.302621] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 251.302803] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 251.302986] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 251.303168] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 251.303348] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 251.303535] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 251.303723] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 251.303910] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 251.304100] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 251.304287] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 251.304473] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 251.304658] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 251.304845] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 251.305034] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 251.305222] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 251.305409] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 251.305598] CPU 18: hi: 186, btch: 31 usd: 30
- <4>[ 251.305784] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 251.305971] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 251.306158] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 251.306344] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 251.306531] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 251.306715] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 251.306900] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 251.307086] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 251.307272] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 251.307456] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 251.307644] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 251.307831] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 251.308022] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 251.308209] Node 0 Normal per-cpu:
- <4>[ 251.308468] CPU 0: hi: 186, btch: 31 usd: 115
- <4>[ 251.308653] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 251.308838] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 251.309026] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 251.309214] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 251.309401] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 251.309590] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 251.309773] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 251.309960] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 251.310145] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 251.310330] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 251.310515] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 251.310700] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 251.310886] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 251.311073] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 251.311258] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 251.311443] CPU 16: hi: 186, btch: 31 usd: 1
- <4>[ 251.311628] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 251.311812] CPU 18: hi: 186, btch: 31 usd: 30
- <4>[ 251.311999] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 251.312184] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 251.312370] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 251.312555] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 251.312740] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 251.312930] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 251.313117] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 251.313304] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 251.313490] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 251.313675] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 251.313860] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 251.314046] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 251.314231] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 251.314416] Node 1 Normal per-cpu:
- <4>[ 251.314675] CPU 0: hi: 186, btch: 31 usd: 18
- <4>[ 251.314860] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 251.315046] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 251.315231] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 251.315416] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 251.315600] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 251.315785] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 251.315973] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 251.316157] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 251.316338] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 251.316699] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 251.316880] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 251.317063] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 251.317244] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 251.317425] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 251.317607] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 251.317796] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 251.317985] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 251.318172] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 251.318359] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 251.318548] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 251.318735] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 251.318922] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 251.319107] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 251.319297] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 251.319487] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 251.319677] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 251.319867] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 251.320054] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 251.320242] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 251.320427] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 251.320614] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 251.320806] active_anon:1776 inactive_anon:577 isolated_anon:0
- <4>[ 251.320807] active_file:70 inactive_file:145 isolated_file:0
- <4>[ 251.320808] unevictable:11770 dirty:2 writeback:0 unstable:0
- <4>[ 251.320809] free:49940 slab_reclaimable:1795 slab_unreclaimable:44898
- <4>[ 251.320810] mapped:1879 shmem:54 pagetables:435 bounce:0
- <4>[ 251.321755] Node 0 DMA free:15744kB min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15356kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
- <4>[ 251.322588] lowmem_reserve[]: 0 2955 32245 32245
- <4>[ 251.323168] Node 0 DMA32 free:120208kB min:4120kB low:5148kB high:6180kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:112kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3026080kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:20kB slab_unreclaimable:16600kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:640 all_unreclaimable? yes
- <4>[ 251.324015] lowmem_reserve[]: 0 0 29290 29290
- <4>[ 251.324591] Node 0 Normal free:30336kB min:40868kB low:51084kB high:61300kB active_anon:3036kB inactive_anon:576kB active_file:124kB inactive_file:320kB unevictable:44928kB isolated(anon):0kB isolated(file):0kB present:29992960kB mlocked:44928kB dirty:0kB writeback:0kB mapped:5332kB shmem:136kB slab_reclaimable:3660kB slab_unreclaimable:75128kB kernel_stack:4456kB pagetables:888kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:724 all_unreclaimable? yes
- <4>[ 251.325422] lowmem_reserve[]: 0 0 0 0
- <4>[ 251.325998] Node 1 Normal free:33472kB min:45096kB low:56368kB high:67644kB active_anon:4068kB inactive_anon:1732kB active_file:156kB inactive_file:148kB unevictable:2152kB isolated(anon):0kB isolated(file):0kB present:33095680kB mlocked:2152kB dirty:8kB writeback:0kB mapped:2184kB shmem:80kB slab_reclaimable:3500kB slab_unreclaimable:87864kB kernel_stack:256kB pagetables:852kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:581 all_unreclaimable? yes
- <4>[ 251.326826] lowmem_reserve[]: 0 0 0 0
- <4>[ 251.327403] Node 0 DMA: 2*4kB 1*8kB 1*16kB 1*32kB 1*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15744kB
- <4>[ 251.328718] Node 0 DMA32: 28*4kB 4*8kB 4*16kB 4*32kB 9*64kB 10*128kB 7*256kB 9*512kB 7*1024kB 5*2048kB 23*4096kB = 120208kB
- <4>[ 251.330036] Node 0 Normal: 813*4kB 519*8kB 298*16kB 177*32kB 80*64kB 33*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 1*4096kB = 31276kB
- <4>[ 251.331445] Node 1 Normal: 657*4kB 457*8kB 299*16kB 173*32kB 102*64kB 28*128kB 4*256kB 0*512kB 0*1024kB 1*2048kB 1*4096kB = 33884kB
- <4>[ 251.332766] 2244 total pagecache pages
- <4>[ 251.332950] 0 pages in swap cache
- <4>[ 251.333131] Swap cache stats: add 0, delete 0, find 0/0
- <4>[ 251.333318] Free swap = 0kB
- <4>[ 251.333498] Total swap = 0kB
- <6>[ 251.497103] 16777215 pages RAM
- <6>[ 251.497290] 294628 pages reserved
- <6>[ 251.497473] 120135 pages shared
- <6>[ 251.497655] 16394890 pages non-shared
- <6>[ 251.497843] [ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
- <6>[ 251.498176] [ 1047] 0 1047 2797 302 2 -17 -1000 udevd
- <6>[ 251.498475] [ 3171] 0 3171 6909 183 3 -17 -1000 auditd
- <6>[ 251.498768] [ 3772] 0 3772 16018 260 0 -17 -1000 sshd
- <6>[ 251.499066] [ 4800] 0 4800 140898 872 0 0 0 dsm_om_shrsvcd
- <6>[ 251.499361] [ 4842] 0 4842 21240 11772 16 0 0 cmcld
- <6>[ 251.499651] [ 4852] 0 4852 5055 330 2 0 0 cmserviced
- <6>[ 251.499944] [ 4854] 0 4854 4451 249 17 0 0 cmlogd
- <6>[ 251.500232] [ 4855] 0 4855 8906 375 1 0 0 cmfileassistd
- <6>[ 251.500524] [ 4856] 0 4856 5171 359 18 0 0 cmnetd
- <6>[ 251.500814] [ 4860] 0 4860 5050 302 0 0 0 cmresourced
- <6>[ 251.501102] [ 4924] 0 4924 1015 148 9 0 0 mingetty
- <6>[ 251.501380] [ 4926] 0 4926 1015 148 5 0 0 mingetty
- <6>[ 251.501763] [ 4928] 0 4928 1015 149 21 0 0 mingetty
- <6>[ 251.502048] [ 4930] 0 4930 1015 149 3 0 0 mingetty
- <6>[ 251.504255] [ 4932] 0 4932 1015 149 2 0 0 mingetty
- <6>[ 251.504552] [ 4934] 0 4934 1015 149 18 0 0 mingetty
- <6>[ 251.504852] [ 4936] 0 4936 2796 300 4 -17 -1000 udevd
- <6>[ 251.505144] [ 4937] 0 4937 2796 299 5 -17 -1000 udevd
- <6>[ 251.505434] [ 5060] 0 5060 23954 555 2 0 0 sshd
- <6>[ 251.505725] [ 5078] 1033 5078 23954 306 1 0 0 sshd
- <6>[ 251.506017] [ 5079] 1033 5079 27075 292 1 0 0 bash
- <6>[ 251.506306] [ 5257] 0 5257 61 30 1 0 0 jnx_mlnxsnmp_da
- <3>[ 251.506601] Out of memory: Kill process 4800 (dsm_om_shrsvcd) score 1 or sacrifice child
- <3>[ 251.506895] Killed process 4800, UID 0, (dsm_om_shrsvcd) total-vm:563592kB, anon-rss:2732kB, file-rss:756kB
- <4>[ 251.509598] init invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0, oom_score_adj=0
- <6>[ 251.509899] init cpuset=/ mems_allowed=0-1
- <4>[ 251.510094] Pid: 1, comm: init Tainted: G W --------------- 2.6.32-279.5.2.el6.x86_64 #1
- <4>[ 251.510392] Call Trace:
- <4>[ 251.510587] [<ffffffff810c4bf1>] ? cpuset_print_task_mems_allowed+0x91/0xb0
- <4>[ 251.510783] [<ffffffff81117360>] ? dump_header+0x90/0x1b0
- <4>[ 251.510979] [<ffffffff810e37de>] ? __delayacct_freepages_end+0x2e/0x30
- <4>[ 251.511178] [<ffffffff8121494c>] ? security_real_capable_noaudit+0x3c/0x70
- <4>[ 251.511375] [<ffffffff811177e2>] ? oom_kill_process+0x82/0x2a0
- <4>[ 251.511573] [<ffffffff81117721>] ? select_bad_process+0xe1/0x120
- <4>[ 251.511770] [<ffffffff81117c20>] ? out_of_memory+0x220/0x3c0
- <4>[ 251.511969] [<ffffffff8112793e>] ? __alloc_pages_nodemask+0x89e/0x940
- <4>[ 251.512165] [<ffffffff8115c45a>] ? alloc_pages_current+0xaa/0x110
- <4>[ 251.512361] [<ffffffff81114767>] ? __page_cache_alloc+0x87/0x90
- <4>[ 251.512558] [<ffffffff81190140>] ? pollwake+0x0/0x60
- <4>[ 251.512751] [<ffffffff8112a38b>] ? __do_page_cache_readahead+0xdb/0x210
- <4>[ 251.512948] [<ffffffff81190140>] ? pollwake+0x0/0x60
- <4>[ 251.513138] [<ffffffff8112a4e1>] ? ra_submit+0x21/0x30
- <4>[ 251.513330] [<ffffffff81115a93>] ? filemap_fault+0x4c3/0x500
- <4>[ 251.513527] [<ffffffff8113ee94>] ? __do_fault+0x54/0x510
- <4>[ 251.513726] [<ffffffff8113f447>] ? handle_pte_fault+0xf7/0xb50
- <4>[ 251.513929] [<ffffffff81081a5d>] ? __sigqueue_free+0x3d/0x50
- <4>[ 251.514133] [<ffffffff810851a2>] ? __dequeue_signal+0x102/0x200
- <4>[ 251.514335] [<ffffffff8108537a>] ? dequeue_signal+0xda/0x170
- <4>[ 251.514531] [<ffffffff81140084>] ? handle_mm_fault+0x1e4/0x2b0
- <4>[ 251.514731] [<ffffffff81044479>] ? __do_page_fault+0x139/0x480
- <4>[ 251.514928] [<ffffffff8119a5b0>] ? mntput_no_expire+0x30/0x110
- <4>[ 251.515127] [<ffffffff815034ee>] ? do_page_fault+0x3e/0xa0
- <4>[ 251.515320] [<ffffffff815008a5>] ? page_fault+0x25/0x30
- <6>[ 251.515507] Mem-Info:
- <4>[ 251.515687] Node 0 DMA per-cpu:
- <4>[ 251.515987] CPU 0: hi: 0, btch: 1 usd: 0
- <4>[ 251.516172] CPU 1: hi: 0, btch: 1 usd: 0
- <4>[ 251.516356] CPU 2: hi: 0, btch: 1 usd: 0
- <4>[ 251.516544] CPU 3: hi: 0, btch: 1 usd: 0
- <4>[ 251.516728] CPU 4: hi: 0, btch: 1 usd: 0
- <4>[ 251.516915] CPU 5: hi: 0, btch: 1 usd: 0
- <4>[ 251.517106] CPU 6: hi: 0, btch: 1 usd: 0
- <4>[ 251.517295] CPU 7: hi: 0, btch: 1 usd: 0
- <4>[ 251.517485] CPU 8: hi: 0, btch: 1 usd: 0
- <4>[ 251.517678] CPU 9: hi: 0, btch: 1 usd: 0
- <4>[ 251.517869] CPU 10: hi: 0, btch: 1 usd: 0
- <4>[ 251.518059] CPU 11: hi: 0, btch: 1 usd: 0
- <4>[ 251.518250] CPU 12: hi: 0, btch: 1 usd: 0
- <4>[ 251.518439] CPU 13: hi: 0, btch: 1 usd: 0
- <4>[ 251.518632] CPU 14: hi: 0, btch: 1 usd: 0
- <4>[ 251.518824] CPU 15: hi: 0, btch: 1 usd: 0
- <4>[ 251.519018] CPU 16: hi: 0, btch: 1 usd: 0
- <4>[ 251.519211] CPU 17: hi: 0, btch: 1 usd: 0
- <4>[ 251.519406] CPU 18: hi: 0, btch: 1 usd: 0
- <4>[ 251.519598] CPU 19: hi: 0, btch: 1 usd: 0
- <4>[ 251.519789] CPU 20: hi: 0, btch: 1 usd: 0
- <4>[ 251.519978] CPU 21: hi: 0, btch: 1 usd: 0
- <4>[ 251.520168] CPU 22: hi: 0, btch: 1 usd: 0
- <4>[ 251.520358] CPU 23: hi: 0, btch: 1 usd: 0
- <4>[ 251.520549] CPU 24: hi: 0, btch: 1 usd: 0
- <4>[ 251.520738] CPU 25: hi: 0, btch: 1 usd: 0
- <4>[ 251.520928] CPU 26: hi: 0, btch: 1 usd: 0
- <4>[ 251.521119] CPU 27: hi: 0, btch: 1 usd: 0
- <4>[ 251.521313] CPU 28: hi: 0, btch: 1 usd: 0
- <4>[ 251.521503] CPU 29: hi: 0, btch: 1 usd: 0
- <4>[ 251.521697] CPU 30: hi: 0, btch: 1 usd: 0
- <4>[ 251.521889] CPU 31: hi: 0, btch: 1 usd: 0
- <4>[ 251.522077] Node 0 DMA32 per-cpu:
- <4>[ 251.522343] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 251.522533] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 251.522723] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 251.522913] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 251.523103] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 251.523292] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 251.523483] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 251.523674] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 251.523863] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 251.524056] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 251.524249] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 251.524444] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 251.524636] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 251.524825] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 251.525017] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 251.525206] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 251.525394] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 251.525585] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 251.525777] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 251.525966] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 251.526154] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 251.526342] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 251.526532] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 251.526723] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 251.526919] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 251.527114] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 251.527305] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 251.527498] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 251.527690] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 251.527881] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 251.528071] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 251.528261] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 251.528451] Node 0 Normal per-cpu:
- <4>[ 251.528718] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 251.528906] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 251.529098] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 251.529288] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 251.529476] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 251.529661] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 251.529846] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 251.530132] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 251.530318] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 251.530504] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 251.530693] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 251.530878] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 251.531063] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 251.531253] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 251.531444] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 251.531635] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 251.531824] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 251.532014] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 251.532203] CPU 18: hi: 186, btch: 31 usd: 29
- <4>[ 251.532393] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 251.532583] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 251.532773] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 251.532963] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 251.533155] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 251.533348] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 251.533542] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 251.533734] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 251.533924] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 251.534114] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 251.534304] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 251.534493] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 251.534687] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 251.534877] Node 1 Normal per-cpu:
- <4>[ 251.535144] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 251.535335] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 251.535527] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 251.535718] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 251.535909] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 251.536099] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 251.536289] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 251.536479] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 251.536671] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 251.536863] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 251.537053] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 251.537245] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 251.537438] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 251.537629] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 251.537819] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 251.538010] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 251.538199] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 251.538389] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 251.538578] CPU 18: hi: 186, btch: 31 usd: 19
- <4>[ 251.538767] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 251.538959] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 251.539149] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 251.539337] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 251.539527] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 251.539715] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 251.539905] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 251.540096] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 251.542269] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 251.542458] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 251.542648] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 251.542838] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 251.543027] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 251.543221] active_anon:1146 inactive_anon:577 isolated_anon:0
- <4>[ 251.543222] active_file:62 inactive_file:209 isolated_file:0
- <4>[ 251.543223] unevictable:11770 dirty:1 writeback:0 unstable:0
- <4>[ 251.543224] free:50832 slab_reclaimable:1794 slab_unreclaimable:44906
- <4>[ 251.543225] mapped:1886 shmem:54 pagetables:435 bounce:0
- <4>[ 251.544269] Node 0 DMA free:15744kB min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15356kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
- <4>[ 251.545076] lowmem_reserve[]: 0 2955 32245 32245
- <4>[ 251.545667] Node 0 DMA32 free:120436kB min:4120kB low:5148kB high:6180kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3026080kB mlocked:0kB dirty:0kB writeback:0kB mapped:20kB shmem:0kB slab_reclaimable:20kB slab_unreclaimable:16600kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
- <4>[ 251.546515] lowmem_reserve[]: 0 0 29290 29290
- <4>[ 251.547103] Node 0 Normal free:30732kB min:40868kB low:51084kB high:61300kB active_anon:3036kB inactive_anon:576kB active_file:120kB inactive_file:680kB unevictable:44928kB isolated(anon):0kB isolated(file):0kB present:29992960kB mlocked:44928kB dirty:0kB writeback:0kB mapped:5340kB shmem:136kB slab_reclaimable:3660kB slab_unreclaimable:75160kB kernel_stack:4456kB pagetables:888kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:966 all_unreclaimable? yes
- <4>[ 251.547964] lowmem_reserve[]: 0 0 0 0
- <4>[ 251.548552] Node 1 Normal free:36416kB min:45096kB low:56368kB high:67644kB active_anon:1548kB inactive_anon:1732kB active_file:128kB inactive_file:164kB unevictable:2152kB isolated(anon):0kB isolated(file):0kB present:33095680kB mlocked:2152kB dirty:4kB writeback:0kB mapped:2184kB shmem:80kB slab_reclaimable:3496kB slab_unreclaimable:87864kB kernel_stack:256kB pagetables:852kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:466 all_unreclaimable? yes
- <4>[ 251.549402] lowmem_reserve[]: 0 0 0 0
- <4>[ 251.549990] Node 0 DMA: 2*4kB 1*8kB 1*16kB 1*32kB 1*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15744kB
- <4>[ 251.551338] Node 0 DMA32: 47*4kB 7*8kB 4*16kB 6*32kB 10*64kB 10*128kB 7*256kB 9*512kB 7*1024kB 5*2048kB 23*4096kB = 120436kB
- <4>[ 251.552690] Node 0 Normal: 686*4kB 525*8kB 295*16kB 185*32kB 83*64kB 34*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 1*4096kB = 31344kB
- <4>[ 251.554040] Node 1 Normal: 641*4kB 473*8kB 304*16kB 175*32kB 102*64kB 29*128kB 3*256kB 1*512kB 0*1024kB 2*2048kB 1*4096kB = 36524kB
- <4>[ 251.555388] 2250 total pagecache pages
- <4>[ 251.555576] 0 pages in swap cache
- <4>[ 251.555761] Swap cache stats: add 0, delete 0, find 0/0
- <4>[ 251.555950] Free swap = 0kB
- <4>[ 251.556133] Total swap = 0kB
- <6>[ 251.720302] 16777215 pages RAM
- <6>[ 251.720490] 294628 pages reserved
- <6>[ 251.720674] 119959 pages shared
- <6>[ 251.720859] 16394285 pages non-shared
- <6>[ 251.721046] [ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
- <6>[ 251.721380] [ 1047] 0 1047 2797 302 2 -17 -1000 udevd
- <6>[ 251.721677] [ 3171] 0 3171 6909 183 3 -17 -1000 auditd
- <6>[ 251.721969] [ 3772] 0 3772 16018 260 0 -17 -1000 sshd
- <6>[ 251.722264] [ 4842] 0 4842 21240 11772 16 0 0 cmcld
- <6>[ 251.722556] [ 4852] 0 4852 5055 330 2 0 0 cmserviced
- <6>[ 251.722851] [ 4854] 0 4854 4451 249 17 0 0 cmlogd
- <6>[ 251.723144] [ 4855] 0 4855 8906 375 1 0 0 cmfileassistd
- <6>[ 251.723439] [ 4856] 0 4856 5171 380 18 0 0 cmnetd
- <6>[ 251.723732] [ 4860] 0 4860 5050 302 0 0 0 cmresourced
- <6>[ 251.724026] [ 4924] 0 4924 1015 148 9 0 0 mingetty
- <6>[ 251.724318] [ 4926] 0 4926 1015 148 5 0 0 mingetty
- <6>[ 251.724612] [ 4928] 0 4928 1015 149 21 0 0 mingetty
- <6>[ 251.724909] [ 4930] 0 4930 1015 149 3 0 0 mingetty
- <6>[ 251.725207] [ 4932] 0 4932 1015 149 2 0 0 mingetty
- <6>[ 251.725501] [ 4934] 0 4934 1015 149 18 0 0 mingetty
- <6>[ 251.725795] [ 4936] 0 4936 2796 300 4 -17 -1000 udevd
- <6>[ 251.726088] [ 4937] 0 4937 2796 299 5 -17 -1000 udevd
- <6>[ 251.726381] [ 5060] 0 5060 23954 555 2 0 0 sshd
- <6>[ 251.726678] [ 5078] 1033 5078 23954 306 1 0 0 sshd
- <6>[ 251.726973] [ 5079] 1033 5079 27075 292 1 0 0 bash
- <6>[ 251.727268] [ 5257] 0 5257 61 30 9 0 0 jnx_mlnxsnmp_da
- <3>[ 251.727570] Out of memory: Kill process 4842 (cmcld) score 1 or sacrifice child
- <3>[ 251.727873] Killed process 4852, UID 0, (cmserviced) total-vm:20220kB, anon-rss:456kB, file-rss:864kB
- <4>[ 251.729467] init invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0, oom_score_adj=0
- <6>[ 251.729754] init cpuset=/ mems_allowed=0-1
- <4>[ 251.729938] Pid: 1, comm: init Tainted: G W --------------- 2.6.32-279.5.2.el6.x86_64 #1
- <4>[ 251.730225] Call Trace:
- <4>[ 251.730418] [<ffffffff810c4bf1>] ? cpuset_print_task_mems_allowed+0x91/0xb0
- <4>[ 251.730613] [<ffffffff81117360>] ? dump_header+0x90/0x1b0
- <4>[ 251.730809] [<ffffffff810e37de>] ? __delayacct_freepages_end+0x2e/0x30
- <4>[ 251.731006] [<ffffffff8121494c>] ? security_real_capable_noaudit+0x3c/0x70
- <4>[ 251.731200] [<ffffffff811177e2>] ? oom_kill_process+0x82/0x2a0
- <4>[ 251.731394] [<ffffffff81117721>] ? select_bad_process+0xe1/0x120
- <4>[ 251.731586] [<ffffffff81117c20>] ? out_of_memory+0x220/0x3c0
- <4>[ 251.731783] [<ffffffff8112793e>] ? __alloc_pages_nodemask+0x89e/0x940
- <4>[ 251.731979] [<ffffffff8115c45a>] ? alloc_pages_current+0xaa/0x110
- <4>[ 251.732174] [<ffffffff81114767>] ? __page_cache_alloc+0x87/0x90
- <4>[ 251.732370] [<ffffffff81190140>] ? pollwake+0x0/0x60
- <4>[ 251.732565] [<ffffffff8112a38b>] ? __do_page_cache_readahead+0xdb/0x210
- <4>[ 251.732763] [<ffffffff81190140>] ? pollwake+0x0/0x60
- <4>[ 251.732956] [<ffffffff8112a4e1>] ? ra_submit+0x21/0x30
- <4>[ 251.733149] [<ffffffff81115a93>] ? filemap_fault+0x4c3/0x500
- <4>[ 251.733344] [<ffffffff8113ee94>] ? __do_fault+0x54/0x510
- <4>[ 251.733538] [<ffffffff8113f447>] ? handle_pte_fault+0xf7/0xb50
- <4>[ 251.733733] [<ffffffff81081a5d>] ? __sigqueue_free+0x3d/0x50
- <4>[ 251.733926] [<ffffffff810851a2>] ? __dequeue_signal+0x102/0x200
- <4>[ 251.734121] [<ffffffff8108537a>] ? dequeue_signal+0xda/0x170
- <4>[ 251.734315] [<ffffffff81140084>] ? handle_mm_fault+0x1e4/0x2b0
- <4>[ 251.734513] [<ffffffff81044479>] ? __do_page_fault+0x139/0x480
- <4>[ 251.734708] [<ffffffff8119a5b0>] ? mntput_no_expire+0x30/0x110
- <4>[ 251.734905] [<ffffffff815034ee>] ? do_page_fault+0x3e/0xa0
- <4>[ 251.735098] [<ffffffff815008a5>] ? page_fault+0x25/0x30
- <6>[ 251.735287] Mem-Info:
- <4>[ 251.735471] Node 0 DMA per-cpu:
- <4>[ 251.735737] CPU 0: hi: 0, btch: 1 usd: 0
- <4>[ 251.735926] CPU 1: hi: 0, btch: 1 usd: 0
- <4>[ 251.736115] CPU 2: hi: 0, btch: 1 usd: 0
- <4>[ 251.736303] CPU 3: hi: 0, btch: 1 usd: 0
- <4>[ 251.736494] CPU 4: hi: 0, btch: 1 usd: 0
- <4>[ 251.736683] CPU 5: hi: 0, btch: 1 usd: 0
- <4>[ 251.736873] CPU 6: hi: 0, btch: 1 usd: 0
- <4>[ 251.737062] CPU 7: hi: 0, btch: 1 usd: 0
- <4>[ 251.737252] CPU 8: hi: 0, btch: 1 usd: 0
- <4>[ 251.737444] CPU 9: hi: 0, btch: 1 usd: 0
- <4>[ 251.737632] CPU 10: hi: 0, btch: 1 usd: 0
- <4>[ 251.737822] CPU 11: hi: 0, btch: 1 usd: 0
- <4>[ 251.738012] CPU 12: hi: 0, btch: 1 usd: 0
- <4>[ 251.738202] CPU 13: hi: 0, btch: 1 usd: 0
- <4>[ 251.738392] CPU 14: hi: 0, btch: 1 usd: 0
- <4>[ 251.738580] CPU 15: hi: 0, btch: 1 usd: 0
- <4>[ 251.738771] CPU 16: hi: 0, btch: 1 usd: 0
- <4>[ 251.738961] CPU 17: hi: 0, btch: 1 usd: 0
- <4>[ 251.739151] CPU 18: hi: 0, btch: 1 usd: 0
- <4>[ 251.739341] CPU 19: hi: 0, btch: 1 usd: 0
- <4>[ 251.739533] CPU 20: hi: 0, btch: 1 usd: 0
- <4>[ 251.739721] CPU 21: hi: 0, btch: 1 usd: 0
- <4>[ 251.739910] CPU 22: hi: 0, btch: 1 usd: 0
- <4>[ 251.740099] CPU 23: hi: 0, btch: 1 usd: 0
- <4>[ 251.740288] CPU 24: hi: 0, btch: 1 usd: 0
- <4>[ 251.740479] CPU 25: hi: 0, btch: 1 usd: 0
- <4>[ 251.740671] CPU 26: hi: 0, btch: 1 usd: 0
- <4>[ 251.740862] CPU 27: hi: 0, btch: 1 usd: 0
- <4>[ 251.741051] CPU 28: hi: 0, btch: 1 usd: 0
- <4>[ 251.741241] CPU 29: hi: 0, btch: 1 usd: 0
- <4>[ 251.741432] CPU 30: hi: 0, btch: 1 usd: 0
- <4>[ 251.741624] CPU 31: hi: 0, btch: 1 usd: 0
- <4>[ 251.741813] Node 0 DMA32 per-cpu:
- <4>[ 251.742078] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 251.742267] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 251.742456] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 251.742645] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 251.742833] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 251.743018] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 251.743203] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 251.743492] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 251.743676] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 251.743861] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 251.744046] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 251.746206] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 251.746397] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 251.746590] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 251.746780] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 251.746969] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 251.747159] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 251.747350] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 251.747542] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 251.747734] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 251.747924] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 251.748113] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 251.748303] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 251.748492] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 251.748682] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 251.748870] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 251.749058] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 251.749247] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 251.749437] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 251.749629] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 251.749819] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 251.750010] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 251.750202] Node 0 Normal per-cpu:
- <4>[ 251.750470] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 251.750660] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 251.750849] CPU 2: hi: 186, btch: 31 usd: 134
- <4>[ 251.751038] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 251.751228] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 251.751417] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 251.751608] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 251.751797] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 251.751988] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 251.752178] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 251.752366] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 251.752556] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 251.752744] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 251.752932] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 251.753121] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 251.753310] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 251.753500] CPU 16: hi: 186, btch: 31 usd: 5
- <4>[ 251.753691] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 251.753881] CPU 18: hi: 186, btch: 31 usd: 29
- <4>[ 251.754071] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 251.754261] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 251.754452] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 251.754641] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 251.754830] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 251.755017] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 251.755206] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 251.755396] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 251.755586] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 251.755774] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 251.755961] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 251.756151] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 251.756340] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 251.756532] Node 1 Normal per-cpu:
- <4>[ 251.756796] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 251.756985] CPU 1: hi: 186, btch: 31 usd: 30
- <4>[ 251.757173] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 251.757357] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 251.757544] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 251.757765] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 251.757949] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 251.758133] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 251.758317] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 251.758502] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 251.758686] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 251.758875] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 251.759063] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 251.759252] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 251.759444] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 251.759633] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 251.759823] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 251.760013] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 251.760202] CPU 18: hi: 186, btch: 31 usd: 19
- <4>[ 251.760395] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 251.760586] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 251.760778] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 251.760971] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 251.761160] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 251.761351] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 251.761542] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 251.761731] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 251.761924] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 251.762114] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 251.762306] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 251.762499] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 251.762687] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 251.762879] active_anon:1037 inactive_anon:551 isolated_anon:0
- <4>[ 251.762880] active_file:107 inactive_file:82 isolated_file:0
- <4>[ 251.762881] unevictable:11770 dirty:1 writeback:0 unstable:0
- <4>[ 251.762882] free:50914 slab_reclaimable:1794 slab_unreclaimable:44906
- <4>[ 251.762883] mapped:1882 shmem:54 pagetables:414 bounce:0
- <4>[ 251.763835] Node 0 DMA free:15744kB min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15356kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
- <4>[ 251.764684] lowmem_reserve[]: 0 2955 32245 32245
- <4>[ 251.765277] Node 0 DMA32 free:120436kB min:4120kB low:5148kB high:6180kB active_anon:0kB inactive_anon:0kB active_file:4kB inactive_file:8kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3026080kB mlocked:0kB dirty:0kB writeback:0kB mapped:20kB shmem:0kB slab_reclaimable:20kB slab_unreclaimable:16600kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
- <4>[ 251.766115] lowmem_reserve[]: 0 0 29290 29290
- <4>[ 251.766704] Node 0 Normal free:30984kB min:40868kB low:51084kB high:61300kB active_anon:2600kB inactive_anon:536kB active_file:120kB inactive_file:320kB unevictable:44928kB isolated(anon):0kB isolated(file):0kB present:29992960kB mlocked:44928kB dirty:0kB writeback:0kB mapped:5332kB shmem:136kB slab_reclaimable:3660kB slab_unreclaimable:75160kB kernel_stack:4456kB pagetables:808kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:966 all_unreclaimable? yes
- <4>[ 251.767550] lowmem_reserve[]: 0 0 0 0
- <4>[ 251.768136] Node 1 Normal free:36492kB min:45096kB low:56368kB high:67644kB active_anon:1548kB inactive_anon:1668kB active_file:304kB inactive_file:0kB unevictable:2152kB isolated(anon):0kB isolated(file):0kB present:33095680kB mlocked:2152kB dirty:4kB writeback:0kB mapped:2176kB shmem:80kB slab_reclaimable:3496kB slab_unreclaimable:87864kB kernel_stack:256kB pagetables:848kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:76 all_unreclaimable? no
- <4>[ 251.768990] lowmem_reserve[]: 0 0 0 0
- <4>[ 251.769583] Node 0 DMA: 2*4kB 1*8kB 1*16kB 1*32kB 1*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15744kB
- <4>[ 251.770932] Node 0 DMA32: 47*4kB 7*8kB 4*16kB 6*32kB 10*64kB 10*128kB 7*256kB 9*512kB 7*1024kB 5*2048kB 23*4096kB = 120436kB
- <4>[ 251.772312] Node 0 Normal: 655*4kB 525*8kB 295*16kB 185*32kB 83*64kB 34*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 1*4096kB = 31220kB
- <4>[ 251.773663] Node 1 Normal: 610*4kB 474*8kB 304*16kB 175*32kB 102*64kB 29*128kB 3*256kB 1*512kB 0*1024kB 2*2048kB 1*4096kB = 36408kB
- <4>[ 251.775012] 2217 total pagecache pages
- <4>[ 251.775199] 0 pages in swap cache
- <4>[ 251.775387] Swap cache stats: add 0, delete 0, find 0/0
- <4>[ 251.775578] Free swap = 0kB
- <4>[ 251.775764] Total swap = 0kB
- <6>[ 251.940005] 16777215 pages RAM
- <6>[ 251.940193] 294628 pages reserved
- <6>[ 251.940381] 119779 pages shared
- <6>[ 251.940566] 16394152 pages non-shared
- <6>[ 251.940756] [ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
- <6>[ 251.941115] [ 1047] 0 1047 2797 302 2 -17 -1000 udevd
- <6>[ 251.941420] [ 3171] 0 3171 6909 183 3 -17 -1000 auditd
- <6>[ 251.941713] [ 3772] 0 3772 16018 260 0 -17 -1000 sshd
- <6>[ 251.942010] [ 4842] 0 4842 21245 11773 16 0 0 cmcld
- <6>[ 251.942295] [ 4854] 0 4854 4451 249 17 0 0 cmlogd
- <6>[ 251.942677] [ 4855] 0 4855 8906 375 1 0 0 cmfileassistd
- <6>[ 251.942962] [ 4856] 0 4856 5171 380 18 0 0 cmnetd
- <6>[ 251.943249] [ 4860] 0 4860 5050 302 0 0 0 cmresourced
- <6>[ 251.943536] [ 4924] 0 4924 1015 148 9 0 0 mingetty
- <6>[ 251.943830] [ 4926] 0 4926 1015 148 5 0 0 mingetty
- <6>[ 251.944124] [ 4928] 0 4928 1015 149 21 0 0 mingetty
- <6>[ 251.944424] [ 4930] 0 4930 1015 149 3 0 0 mingetty
- <6>[ 251.944722] [ 4932] 0 4932 1015 149 2 0 0 mingetty
- <6>[ 251.945020] [ 4934] 0 4934 1015 149 18 0 0 mingetty
- <6>[ 251.945315] [ 4936] 0 4936 2796 300 4 -17 -1000 udevd
- <6>[ 251.945609] [ 4937] 0 4937 2796 299 5 -17 -1000 udevd
- <6>[ 251.945903] [ 5060] 0 5060 23954 555 2 0 0 sshd
- <6>[ 251.946198] [ 5078] 1033 5078 23954 306 1 0 0 sshd
- <6>[ 251.946494] [ 5079] 1033 5079 27075 292 1 0 0 bash
- <6>[ 251.946787] [ 5257] 0 5257 61 30 9 0 0 jnx_mlnxsnmp_da
- <3>[ 251.947085] Out of memory: Kill process 4842 (cmcld) score 1 or sacrifice child
- <3>[ 251.949383] Killed process 4860, UID 0, (cmresourced) total-vm:20200kB, anon-rss:348kB, file-rss:860kB
- <4>[ 251.951307] init invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0, oom_score_adj=0
- <6>[ 251.951605] init cpuset=/ mems_allowed=0-1
- <4>[ 251.951795] Pid: 1, comm: init Tainted: G W --------------- 2.6.32-279.5.2.el6.x86_64 #1
- <4>[ 251.952096] Call Trace:
- <4>[ 251.952292] [<ffffffff810c4bf1>] ? cpuset_print_task_mems_allowed+0x91/0xb0
- <4>[ 251.952490] [<ffffffff81117360>] ? dump_header+0x90/0x1b0
- <4>[ 251.952686] [<ffffffff810e37de>] ? __delayacct_freepages_end+0x2e/0x30
- <4>[ 251.952888] [<ffffffff8121494c>] ? security_real_capable_noaudit+0x3c/0x70
- <4>[ 251.953088] [<ffffffff811177e2>] ? oom_kill_process+0x82/0x2a0
- <4>[ 251.953287] [<ffffffff81117721>] ? select_bad_process+0xe1/0x120
- <4>[ 251.953482] [<ffffffff81117c20>] ? out_of_memory+0x220/0x3c0
- <4>[ 251.953680] [<ffffffff8112793e>] ? __alloc_pages_nodemask+0x89e/0x940
- <4>[ 251.953879] [<ffffffff8115c45a>] ? alloc_pages_current+0xaa/0x110
- <4>[ 251.954076] [<ffffffff81114767>] ? __page_cache_alloc+0x87/0x90
- <4>[ 251.954275] [<ffffffff81190140>] ? pollwake+0x0/0x60
- <4>[ 251.954467] [<ffffffff8112a38b>] ? __do_page_cache_readahead+0xdb/0x210
- <4>[ 251.954664] [<ffffffff81190140>] ? pollwake+0x0/0x60
- <4>[ 251.954858] [<ffffffff8112a4e1>] ? ra_submit+0x21/0x30
- <4>[ 251.955052] [<ffffffff81115a93>] ? filemap_fault+0x4c3/0x500
- <4>[ 251.955251] [<ffffffff8113ee94>] ? __do_fault+0x54/0x510
- <4>[ 251.955448] [<ffffffff8113f447>] ? handle_pte_fault+0xf7/0xb50
- <4>[ 251.955647] [<ffffffff81081a5d>] ? __sigqueue_free+0x3d/0x50
- <4>[ 251.955842] [<ffffffff810851a2>] ? __dequeue_signal+0x102/0x200
- <4>[ 251.956036] [<ffffffff8108537a>] ? dequeue_signal+0xda/0x170
- <4>[ 251.956232] [<ffffffff81140084>] ? handle_mm_fault+0x1e4/0x2b0
- <4>[ 251.956424] [<ffffffff81044479>] ? __do_page_fault+0x139/0x480
- <4>[ 251.956615] [<ffffffff8119a5b0>] ? mntput_no_expire+0x30/0x110
- <4>[ 251.956910] [<ffffffff815034ee>] ? do_page_fault+0x3e/0xa0
- <4>[ 251.957099] [<ffffffff815008a5>] ? page_fault+0x25/0x30
- <6>[ 251.957292] Mem-Info:
- <4>[ 251.957472] Node 0 DMA per-cpu:
- <4>[ 251.957735] CPU 0: hi: 0, btch: 1 usd: 0
- <4>[ 251.957922] CPU 1: hi: 0, btch: 1 usd: 0
- <4>[ 251.958112] CPU 2: hi: 0, btch: 1 usd: 0
- <4>[ 251.958305] CPU 3: hi: 0, btch: 1 usd: 0
- <4>[ 251.958497] CPU 4: hi: 0, btch: 1 usd: 0
- <4>[ 251.958686] CPU 5: hi: 0, btch: 1 usd: 0
- <4>[ 251.958875] CPU 6: hi: 0, btch: 1 usd: 0
- <4>[ 251.959067] CPU 7: hi: 0, btch: 1 usd: 0
- <4>[ 251.959258] CPU 8: hi: 0, btch: 1 usd: 0
- <4>[ 251.959450] CPU 9: hi: 0, btch: 1 usd: 0
- <4>[ 251.959639] CPU 10: hi: 0, btch: 1 usd: 0
- <4>[ 251.959832] CPU 11: hi: 0, btch: 1 usd: 0
- <4>[ 251.960023] CPU 12: hi: 0, btch: 1 usd: 0
- <4>[ 251.960215] CPU 13: hi: 0, btch: 1 usd: 0
- <4>[ 251.960411] CPU 14: hi: 0, btch: 1 usd: 0
- <4>[ 251.960601] CPU 15: hi: 0, btch: 1 usd: 0
- <4>[ 251.960791] CPU 16: hi: 0, btch: 1 usd: 0
- <4>[ 251.960980] CPU 17: hi: 0, btch: 1 usd: 0
- <4>[ 251.961170] CPU 18: hi: 0, btch: 1 usd: 0
- <4>[ 251.961362] CPU 19: hi: 0, btch: 1 usd: 0
- <4>[ 251.961550] CPU 20: hi: 0, btch: 1 usd: 0
- <4>[ 251.961740] CPU 21: hi: 0, btch: 1 usd: 0
- <4>[ 251.961930] CPU 22: hi: 0, btch: 1 usd: 0
- <4>[ 251.962120] CPU 23: hi: 0, btch: 1 usd: 0
- <4>[ 251.962312] CPU 24: hi: 0, btch: 1 usd: 0
- <4>[ 251.962500] CPU 25: hi: 0, btch: 1 usd: 0
- <4>[ 251.962690] CPU 26: hi: 0, btch: 1 usd: 0
- <4>[ 251.962879] CPU 27: hi: 0, btch: 1 usd: 0
- <4>[ 251.963068] CPU 28: hi: 0, btch: 1 usd: 0
- <4>[ 251.963259] CPU 29: hi: 0, btch: 1 usd: 0
- <4>[ 251.963450] CPU 30: hi: 0, btch: 1 usd: 0
- <4>[ 251.963639] CPU 31: hi: 0, btch: 1 usd: 0
- <4>[ 251.963830] Node 0 DMA32 per-cpu:
- <4>[ 251.964097] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 251.964291] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 251.964481] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 251.964671] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 251.964860] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 251.965049] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 251.965241] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 251.965431] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 251.965621] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 251.965810] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 251.965999] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 251.966191] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 251.966382] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 251.966570] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 251.966760] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 251.966949] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 251.967140] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 251.967332] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 251.967524] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 251.967714] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 251.967909] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 251.968099] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 251.968295] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 251.968486] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 251.968676] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 251.968865] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 251.969055] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 251.969247] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 251.969436] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 251.969624] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 251.969814] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 251.970004] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 251.970192] Node 0 Normal per-cpu:
- <4>[ 251.970461] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 251.970646] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 251.970831] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 251.971115] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 251.971302] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 251.971486] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 251.971671] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 251.971856] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 251.972040] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 251.972230] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 251.972419] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 251.972608] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 251.972798] CPU 12: hi: 186, btch: 31 usd: 7
- <4>[ 251.972987] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 251.973178] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 251.973371] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 251.973563] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 251.973753] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 251.973943] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 251.974134] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 251.974329] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 251.974521] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 251.974711] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 251.974902] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 251.975093] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 251.975285] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 251.975477] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 251.975668] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 251.975861] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 251.976051] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 251.976243] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 251.976433] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 251.976624] Node 1 Normal per-cpu:
- <4>[ 251.976892] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 251.977083] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 251.977276] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 251.977467] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 251.977657] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 251.977851] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 251.978048] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 251.978244] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 251.978436] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 251.978626] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 251.978815] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 251.979005] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 251.979195] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 251.979387] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 251.979579] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 251.979768] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 251.979958] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 251.980148] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 251.980339] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 251.980528] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 251.980718] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 251.980907] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 251.981097] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 251.981287] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 251.981477] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 251.981665] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 251.981855] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 251.982044] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 251.982238] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 251.982427] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 251.982617] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 251.982808] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 251.983000] active_anon:1037 inactive_anon:3960 isolated_anon:0
- <4>[ 251.983001] active_file:373 inactive_file:1004 isolated_file:0
- <4>[ 251.983002] unevictable:31 dirty:1 writeback:0 unstable:0
- <4>[ 251.983003] free:58009 slab_reclaimable:1794 slab_unreclaimable:44906
- <4>[ 251.983004] mapped:1273 shmem:54 pagetables:414 bounce:0
- <4>[ 251.983956] Node 0 DMA free:15744kB min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15356kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
- <4>[ 251.984806] lowmem_reserve[]: 0 2955 32245 32245
- <4>[ 251.985464] Node 0 DMA32 free:120436kB min:4120kB low:5148kB high:6180kB active_anon:0kB inactive_anon:0kB active_file:4kB inactive_file:8kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3026080kB mlocked:0kB dirty:0kB writeback:0kB mapped:20kB shmem:0kB slab_reclaimable:20kB slab_unreclaimable:16600kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
- <4>[ 251.988259] lowmem_reserve[]: 0 0 29290 29290
- <4>[ 251.988849] Node 0 Normal free:67260kB min:40868kB low:51084kB high:61300kB active_anon:2600kB inactive_anon:732kB active_file:2184kB inactive_file:1536kB unevictable:108kB isolated(anon):0kB isolated(file):0kB present:29992960kB mlocked:48kB dirty:0kB writeback:0kB mapped:1048kB shmem:136kB slab_reclaimable:3660kB slab_unreclaimable:75160kB kernel_stack:4456kB pagetables:808kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
- <4>[ 251.989699] lowmem_reserve[]: 0 0 0 0
- <4>[ 251.990294] Node 1 Normal free:37032kB min:45096kB low:56368kB high:67644kB active_anon:1548kB inactive_anon:1668kB active_file:1368kB inactive_file:400kB unevictable:16kB isolated(anon):0kB isolated(file):0kB present:33095680kB mlocked:24kB dirty:4kB writeback:0kB mapped:580kB shmem:80kB slab_reclaimable:3496kB slab_unreclaimable:87864kB kernel_stack:256kB pagetables:848kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:32 all_unreclaimable? no
- <4>[ 251.991148] lowmem_reserve[]: 0 0 0 0
- <4>[ 251.991741] Node 0 DMA: 2*4kB 1*8kB 1*16kB 1*32kB 1*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15744kB
- <4>[ 251.993101] Node 0 DMA32: 47*4kB 7*8kB 4*16kB 6*32kB 10*64kB 10*128kB 7*256kB 9*512kB 7*1024kB 5*2048kB 23*4096kB = 120436kB
- <4>[ 251.994450] Node 0 Normal: 620*4kB 517*8kB 307*16kB 168*32kB 80*64kB 43*128kB 7*256kB 5*512kB 5*1024kB 2*2048kB 5*4096kB = 61576kB
- <4>[ 251.995802] Node 1 Normal: 694*4kB 455*8kB 295*16kB 183*32kB 104*64kB 28*128kB 5*256kB 1*512kB 0*1024kB 2*2048kB 1*4096kB = 37216kB
- <4>[ 251.997152] 1608 total pagecache pages
- <4>[ 251.997345] 0 pages in swap cache
- <4>[ 251.997532] Swap cache stats: add 0, delete 0, find 0/0
- <4>[ 251.997726] Free swap = 0kB
- <4>[ 251.997909] Total swap = 0kB
- <6>[ 252.160922] 16777215 pages RAM
- <6>[ 252.161114] 294628 pages reserved
- <6>[ 252.161302] 117880 pages shared
- <6>[ 252.161487] 16394597 pages non-shared
- <6>[ 252.161677] [ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
- <6>[ 252.162041] [ 1047] 0 1047 2797 300 2 -17 -1000 udevd
- <6>[ 252.162344] [ 3171] 0 3171 6909 172 3 -17 -1000 auditd
- <6>[ 252.162647] [ 3772] 0 3772 16018 254 0 -17 -1000 sshd
- <6>[ 252.162942] [ 4854] 0 4854 4451 227 17 0 0 cmlogd
- <6>[ 252.163238] [ 4855] 0 4855 8906 318 1 0 0 cmfileassistd
- <6>[ 252.163533] [ 4924] 0 4924 1015 132 9 0 0 mingetty
- <6>[ 252.163828] [ 4926] 0 4926 1015 131 5 0 0 mingetty
- <6>[ 252.164127] [ 4928] 0 4928 1015 130 21 0 0 mingetty
- <6>[ 252.164421] [ 4930] 0 4930 1015 130 3 0 0 mingetty
- <6>[ 252.164721] [ 4932] 0 4932 1015 130 2 0 0 mingetty
- <6>[ 252.165014] [ 4934] 0 4934 1015 130 18 0 0 mingetty
- <6>[ 252.165310] [ 4936] 0 4936 2796 299 4 -17 -1000 udevd
- <6>[ 252.165607] [ 4937] 0 4937 2796 298 5 -17 -1000 udevd
- <6>[ 252.165904] [ 5060] 0 5060 23954 474 2 0 0 sshd
- <6>[ 252.166205] [ 5078] 1033 5078 23954 299 1 0 0 sshd
- <6>[ 252.166500] [ 5079] 1033 5079 27075 247 1 0 0 bash
- <6>[ 252.166793] [ 5257] 0 5257 61 30 1 0 0 jnx_mlnxsnmp_da
- <3>[ 252.167096] Out of memory: Kill process 4854 (cmlogd) score 1 or sacrifice child
- <3>[ 252.167393] Killed process 4854, UID 0, (cmlogd) total-vm:17804kB, anon-rss:304kB, file-rss:564kB
- <4>[ 252.168515] init invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0, oom_score_adj=0
- <6>[ 252.168810] init cpuset=/ mems_allowed=0-1
- <4>[ 252.168998] Pid: 1, comm: init Tainted: G W --------------- 2.6.32-279.5.2.el6.x86_64 #1
- <4>[ 252.169297] Call Trace:
- <4>[ 252.169493] [<ffffffff810c4bf1>] ? cpuset_print_task_mems_allowed+0x91/0xb0
- <4>[ 252.169690] [<ffffffff81117360>] ? dump_header+0x90/0x1b0
- <4>[ 252.169881] [<ffffffff810e37de>] ? __delayacct_freepages_end+0x2e/0x30
- <4>[ 252.170074] [<ffffffff8121494c>] ? security_real_capable_noaudit+0x3c/0x70
- <4>[ 252.170343] [<ffffffff811177e2>] ? oom_kill_process+0x82/0x2a0
- <4>[ 252.170531] [<ffffffff81117721>] ? select_bad_process+0xe1/0x120
- <4>[ 252.170720] [<ffffffff81117c20>] ? out_of_memory+0x220/0x3c0
- <4>[ 252.170913] [<ffffffff8112793e>] ? __alloc_pages_nodemask+0x89e/0x940
- <4>[ 252.171106] [<ffffffff8115c45a>] ? alloc_pages_current+0xaa/0x110
- <4>[ 252.171297] [<ffffffff81114767>] ? __page_cache_alloc+0x87/0x90
- <4>[ 252.171494] [<ffffffff81190140>] ? pollwake+0x0/0x60
- <4>[ 252.171686] [<ffffffff8112a38b>] ? __do_page_cache_readahead+0xdb/0x210
- <4>[ 252.171884] [<ffffffff81190140>] ? pollwake+0x0/0x60
- <4>[ 252.172075] [<ffffffff8112a4e1>] ? ra_submit+0x21/0x30
- <4>[ 252.172269] [<ffffffff81115a93>] ? filemap_fault+0x4c3/0x500
- <4>[ 252.172462] [<ffffffff8113ee94>] ? __do_fault+0x54/0x510
- <4>[ 252.172653] [<ffffffff8113f447>] ? handle_pte_fault+0xf7/0xb50
- <4>[ 252.172848] [<ffffffff81081a5d>] ? __sigqueue_free+0x3d/0x50
- <4>[ 252.173044] [<ffffffff810851a2>] ? __dequeue_signal+0x102/0x200
- <4>[ 252.173242] [<ffffffff8108537a>] ? dequeue_signal+0xda/0x170
- <4>[ 252.173439] [<ffffffff81140084>] ? handle_mm_fault+0x1e4/0x2b0
- <4>[ 252.173639] [<ffffffff81044479>] ? __do_page_fault+0x139/0x480
- <4>[ 252.173837] [<ffffffff8119a5b0>] ? mntput_no_expire+0x30/0x110
- <4>[ 252.174035] [<ffffffff815034ee>] ? do_page_fault+0x3e/0xa0
- <4>[ 252.174229] [<ffffffff815008a5>] ? page_fault+0x25/0x30
- <6>[ 252.174420] Mem-Info:
- <4>[ 252.174603] Node 0 DMA per-cpu:
- <4>[ 252.174868] CPU 0: hi: 0, btch: 1 usd: 0
- <4>[ 252.175056] CPU 1: hi: 0, btch: 1 usd: 0
- <4>[ 252.175247] CPU 2: hi: 0, btch: 1 usd: 0
- <4>[ 252.175435] CPU 3: hi: 0, btch: 1 usd: 0
- <4>[ 252.175623] CPU 4: hi: 0, btch: 1 usd: 0
- <4>[ 252.175811] CPU 5: hi: 0, btch: 1 usd: 0
- <4>[ 252.176001] CPU 6: hi: 0, btch: 1 usd: 0
- <4>[ 252.176192] CPU 7: hi: 0, btch: 1 usd: 0
- <4>[ 252.176382] CPU 8: hi: 0, btch: 1 usd: 0
- <4>[ 252.176569] CPU 9: hi: 0, btch: 1 usd: 0
- <4>[ 252.176757] CPU 10: hi: 0, btch: 1 usd: 0
- <4>[ 252.176947] CPU 11: hi: 0, btch: 1 usd: 0
- <4>[ 252.177140] CPU 12: hi: 0, btch: 1 usd: 0
- <4>[ 252.177331] CPU 13: hi: 0, btch: 1 usd: 0
- <4>[ 252.177524] CPU 14: hi: 0, btch: 1 usd: 0
- <4>[ 252.177716] CPU 15: hi: 0, btch: 1 usd: 0
- <4>[ 252.177906] CPU 16: hi: 0, btch: 1 usd: 0
- <4>[ 252.178097] CPU 17: hi: 0, btch: 1 usd: 0
- <4>[ 252.178285] CPU 18: hi: 0, btch: 1 usd: 0
- <4>[ 252.178475] CPU 19: hi: 0, btch: 1 usd: 0
- <4>[ 252.178662] CPU 20: hi: 0, btch: 1 usd: 0
- <4>[ 252.178849] CPU 21: hi: 0, btch: 1 usd: 0
- <4>[ 252.179037] CPU 22: hi: 0, btch: 1 usd: 0
- <4>[ 252.179229] CPU 23: hi: 0, btch: 1 usd: 0
- <4>[ 252.179417] CPU 24: hi: 0, btch: 1 usd: 0
- <4>[ 252.179606] CPU 25: hi: 0, btch: 1 usd: 0
- <4>[ 252.179794] CPU 26: hi: 0, btch: 1 usd: 0
- <4>[ 252.179983] CPU 27: hi: 0, btch: 1 usd: 0
- <4>[ 252.180172] CPU 28: hi: 0, btch: 1 usd: 0
- <4>[ 252.180361] CPU 29: hi: 0, btch: 1 usd: 0
- <4>[ 252.180550] CPU 30: hi: 0, btch: 1 usd: 0
- <4>[ 252.180738] CPU 31: hi: 0, btch: 1 usd: 0
- <4>[ 252.180926] Node 0 DMA32 per-cpu:
- <4>[ 252.181195] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 252.181384] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 252.181577] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 252.181769] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 252.181961] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 252.182152] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 252.182343] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 252.182532] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 252.182722] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 252.182915] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 252.183110] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 252.183302] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 252.183494] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 252.183684] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 252.183873] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 252.184058] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 252.184245] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 252.184530] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 252.184715] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 252.184899] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 252.185085] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 252.185270] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 252.185454] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 252.185643] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 252.185832] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 252.186021] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 252.186214] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 252.186402] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 252.186589] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 252.186776] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 252.186967] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 252.187159] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 252.187350] Node 0 Normal per-cpu:
- <4>[ 252.187616] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 252.187809] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 252.188000] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 252.188193] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 252.190328] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 252.190517] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 252.190706] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 252.190895] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 252.191087] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 252.191279] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 252.191467] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 252.191656] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 252.191844] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 252.192033] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 252.192223] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 252.192413] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 252.192603] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 252.192790] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 252.192979] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 252.193167] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 252.193356] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 252.193544] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 252.193731] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 252.193919] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 252.194109] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 252.194297] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 252.194486] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 252.194678] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 252.194868] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 252.195058] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 252.195253] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 252.195441] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 252.195630] Node 1 Normal per-cpu:
- <4>[ 252.195895] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 252.196085] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 252.196274] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 252.196461] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 252.196650] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 252.196838] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 252.197027] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 252.197218] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 252.197411] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 252.197599] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 252.197789] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 252.197978] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 252.198167] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 252.198352] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 252.198541] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 252.198797] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 252.198982] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 252.199172] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 252.199356] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 252.199541] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 252.199726] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 252.199918] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 252.200108] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 252.200297] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 252.200488] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 252.200678] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 252.200868] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 252.201060] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 252.201248] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 252.201438] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 252.201628] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 252.201822] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 252.202016] active_anon:870 inactive_anon:600 isolated_anon:0
- <4>[ 252.202017] active_file:298 inactive_file:402 isolated_file:0
- <4>[ 252.202017] unevictable:31 dirty:0 writeback:0 unstable:0
- <4>[ 252.202018] free:53025 slab_reclaimable:1794 slab_unreclaimable:44906
- <4>[ 252.202019] mapped:293 shmem:54 pagetables:414 bounce:0
- <4>[ 252.202977] Node 0 DMA free:15744kB min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15356kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
- <4>[ 252.203816] lowmem_reserve[]: 0 2955 32245 32245
- <4>[ 252.204407] Node 0 DMA32 free:120436kB min:4120kB low:5148kB high:6180kB active_anon:0kB inactive_anon:0kB active_file:4kB inactive_file:8kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3026080kB mlocked:0kB dirty:0kB writeback:0kB mapped:20kB shmem:0kB slab_reclaimable:20kB slab_unreclaimable:16600kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
- <4>[ 252.205246] lowmem_reserve[]: 0 0 29290 29290
- <4>[ 252.205833] Node 0 Normal free:38032kB min:40868kB low:51084kB high:61300kB active_anon:1932kB inactive_anon:732kB active_file:692kB inactive_file:816kB unevictable:108kB isolated(anon):0kB isolated(file):0kB present:29992960kB mlocked:48kB dirty:0kB writeback:0kB mapped:572kB shmem:136kB slab_reclaimable:3660kB slab_unreclaimable:75160kB kernel_stack:4456kB pagetables:808kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
- <4>[ 252.206685] lowmem_reserve[]: 0 0 0 0
- <4>[ 252.207274] Node 1 Normal free:37888kB min:45096kB low:56368kB high:67644kB active_anon:1548kB inactive_anon:1668kB active_file:496kB inactive_file:784kB unevictable:16kB isolated(anon):0kB isolated(file):0kB present:33095680kB mlocked:24kB dirty:0kB writeback:0kB mapped:580kB shmem:80kB slab_reclaimable:3496kB slab_unreclaimable:87864kB kernel_stack:256kB pagetables:848kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:2223 all_unreclaimable? yes
- <4>[ 252.208115] lowmem_reserve[]: 0 0 0 0
- <4>[ 252.208703] Node 0 DMA: 2*4kB 1*8kB 1*16kB 1*32kB 1*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15744kB
- <4>[ 252.210047] Node 0 DMA32: 47*4kB 7*8kB 4*16kB 6*32kB 10*64kB 10*128kB 7*256kB 9*512kB 7*1024kB 5*2048kB 23*4096kB = 120436kB
- <4>[ 252.211391] Node 0 Normal: 898*4kB 565*8kB 310*16kB 181*32kB 82*64kB 49*128kB 9*256kB 3*512kB 1*1024kB 0*2048kB 1*4096kB = 39344kB
- <4>[ 252.212737] Node 1 Normal: 724*4kB 442*8kB 281*16kB 183*32kB 113*64kB 32*128kB 6*256kB 1*512kB 0*1024kB 2*2048kB 1*4096kB = 38352kB
- <4>[ 252.214179] 967 total pagecache pages
- <4>[ 252.214366] 0 pages in swap cache
- <4>[ 252.214554] Swap cache stats: add 0, delete 0, find 0/0
- <4>[ 252.214743] Free swap = 0kB
- <4>[ 252.214926] Total swap = 0kB
- <6>[ 252.378210] 16777215 pages RAM
- <6>[ 252.378398] 294628 pages reserved
- <6>[ 252.378582] 116636 pages shared
- <6>[ 252.378768] 16393484 pages non-shared
- <6>[ 252.378959] [ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
- <6>[ 252.379322] [ 1047] 0 1047 2797 289 2 -17 -1000 udevd
- <6>[ 252.379620] [ 3171] 0 3171 6909 162 3 -17 -1000 auditd
- <6>[ 252.379911] [ 3772] 0 3772 16018 238 0 -17 -1000 sshd
- <6>[ 252.380208] [ 4855] 0 4855 8906 275 3 0 0 cmfileassistd
- <6>[ 252.380502] [ 4924] 0 4924 1015 106 9 0 0 mingetty
- <6>[ 252.380795] [ 4926] 0 4926 1015 106 5 0 0 mingetty
- <6>[ 252.381090] [ 4928] 0 4928 1015 107 21 0 0 mingetty
- <6>[ 252.381381] [ 4930] 0 4930 1015 107 3 0 0 mingetty
- <6>[ 252.381672] [ 4932] 0 4932 1015 107 2 0 0 mingetty
- <6>[ 252.381966] [ 4934] 0 4934 1015 107 18 0 0 mingetty
- <6>[ 252.382258] [ 4936] 0 4936 2796 287 4 -17 -1000 udevd
- <6>[ 252.382550] [ 4937] 0 4937 2796 287 5 -17 -1000 udevd
- <6>[ 252.382843] [ 5060] 0 5060 23954 417 2 0 0 sshd
- <6>[ 252.383138] [ 5078] 1033 5078 23954 278 1 0 0 sshd
- <6>[ 252.383421] [ 5079] 1033 5079 27075 204 1 0 0 bash
- <6>[ 252.383803] [ 5257] 0 5257 61 30 17 0 0 jnx_mlnxsnmp_da
- <3>[ 252.384090] Out of memory: Kill process 4855 (cmfileassistd) score 1 or sacrifice child
- <3>[ 252.384375] Killed process 4855, UID 0, (cmfileassistd) total-vm:35624kB, anon-rss:360kB, file-rss:740kB
- <4>[ 252.386025] init invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0, oom_score_adj=0
- <6>[ 252.386321] init cpuset=/ mems_allowed=0-1
- <4>[ 252.386510] Pid: 1, comm: init Tainted: G W --------------- 2.6.32-279.5.2.el6.x86_64 #1
- <4>[ 252.386804] Call Trace:
- <4>[ 252.387000] [<ffffffff810c4bf1>] ? cpuset_print_task_mems_allowed+0x91/0xb0
- <4>[ 252.387199] [<ffffffff81117360>] ? dump_header+0x90/0x1b0
- <4>[ 252.387394] [<ffffffff810e37de>] ? __delayacct_freepages_end+0x2e/0x30
- <4>[ 252.387594] [<ffffffff8121494c>] ? security_real_capable_noaudit+0x3c/0x70
- <4>[ 252.387790] [<ffffffff811177e2>] ? oom_kill_process+0x82/0x2a0
- <4>[ 252.387985] [<ffffffff81117721>] ? select_bad_process+0xe1/0x120
- <4>[ 252.388182] [<ffffffff81117c20>] ? out_of_memory+0x220/0x3c0
- <4>[ 252.388380] [<ffffffff8112793e>] ? __alloc_pages_nodemask+0x89e/0x940
- <4>[ 252.388578] [<ffffffff8115c45a>] ? alloc_pages_current+0xaa/0x110
- <4>[ 252.388775] [<ffffffff81114767>] ? __page_cache_alloc+0x87/0x90
- <4>[ 252.388972] [<ffffffff81190140>] ? pollwake+0x0/0x60
- <4>[ 252.389162] [<ffffffff8112a38b>] ? __do_page_cache_readahead+0xdb/0x210
- <4>[ 252.389359] [<ffffffff81190140>] ? pollwake+0x0/0x60
- <4>[ 252.389549] [<ffffffff8112a4e1>] ? ra_submit+0x21/0x30
- <4>[ 252.389740] [<ffffffff81115a93>] ? filemap_fault+0x4c3/0x500
- <4>[ 252.389935] [<ffffffff8113ee94>] ? __do_fault+0x54/0x510
- <4>[ 252.390126] [<ffffffff8113f447>] ? handle_pte_fault+0xf7/0xb50
- <4>[ 252.390320] [<ffffffff81081a5d>] ? __sigqueue_free+0x3d/0x50
- <4>[ 252.390512] [<ffffffff810851a2>] ? __dequeue_signal+0x102/0x200
- <4>[ 252.390708] [<ffffffff8108537a>] ? dequeue_signal+0xda/0x170
- <4>[ 252.390900] [<ffffffff81140084>] ? handle_mm_fault+0x1e4/0x2b0
- <4>[ 252.391098] [<ffffffff81044479>] ? __do_page_fault+0x139/0x480
- <4>[ 252.391295] [<ffffffff8119a5b0>] ? mntput_no_expire+0x30/0x110
- <4>[ 252.391493] [<ffffffff815034ee>] ? do_page_fault+0x3e/0xa0
- <4>[ 252.391684] [<ffffffff815008a5>] ? page_fault+0x25/0x30
- <6>[ 252.393843] Mem-Info:
- <4>[ 252.394027] Node 0 DMA per-cpu:
- <4>[ 252.394292] CPU 0: hi: 0, btch: 1 usd: 0
- <4>[ 252.394482] CPU 1: hi: 0, btch: 1 usd: 0
- <4>[ 252.394672] CPU 2: hi: 0, btch: 1 usd: 0
- <4>[ 252.394862] CPU 3: hi: 0, btch: 1 usd: 0
- <4>[ 252.395056] CPU 4: hi: 0, btch: 1 usd: 0
- <4>[ 252.395246] CPU 5: hi: 0, btch: 1 usd: 0
- <4>[ 252.395435] CPU 6: hi: 0, btch: 1 usd: 0
- <4>[ 252.395628] CPU 7: hi: 0, btch: 1 usd: 0
- <4>[ 252.395821] CPU 8: hi: 0, btch: 1 usd: 0
- <4>[ 252.396015] CPU 9: hi: 0, btch: 1 usd: 0
- <4>[ 252.396205] CPU 10: hi: 0, btch: 1 usd: 0
- <4>[ 252.396397] CPU 11: hi: 0, btch: 1 usd: 0
- <4>[ 252.396587] CPU 12: hi: 0, btch: 1 usd: 0
- <4>[ 252.396777] CPU 13: hi: 0, btch: 1 usd: 0
- <4>[ 252.396968] CPU 14: hi: 0, btch: 1 usd: 0
- <4>[ 252.397157] CPU 15: hi: 0, btch: 1 usd: 0
- <4>[ 252.397347] CPU 16: hi: 0, btch: 1 usd: 0
- <4>[ 252.397531] CPU 17: hi: 0, btch: 1 usd: 0
- <4>[ 252.397716] CPU 18: hi: 0, btch: 1 usd: 0
- <4>[ 252.397966] CPU 19: hi: 0, btch: 1 usd: 0
- <4>[ 252.398151] CPU 20: hi: 0, btch: 1 usd: 0
- <4>[ 252.398335] CPU 21: hi: 0, btch: 1 usd: 0
- <4>[ 252.398519] CPU 22: hi: 0, btch: 1 usd: 0
- <4>[ 252.398703] CPU 23: hi: 0, btch: 1 usd: 0
- <4>[ 252.398887] CPU 24: hi: 0, btch: 1 usd: 0
- <4>[ 252.399078] CPU 25: hi: 0, btch: 1 usd: 0
- <4>[ 252.399270] CPU 26: hi: 0, btch: 1 usd: 0
- <4>[ 252.399459] CPU 27: hi: 0, btch: 1 usd: 0
- <4>[ 252.399649] CPU 28: hi: 0, btch: 1 usd: 0
- <4>[ 252.399837] CPU 29: hi: 0, btch: 1 usd: 0
- <4>[ 252.400027] CPU 30: hi: 0, btch: 1 usd: 0
- <4>[ 252.400215] CPU 31: hi: 0, btch: 1 usd: 0
- <4>[ 252.400403] Node 0 DMA32 per-cpu:
- <4>[ 252.400668] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 252.400859] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 252.401051] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 252.401243] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 252.401434] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 252.401624] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 252.401813] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 252.402003] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 252.402192] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 252.402380] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 252.402568] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 252.402757] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 252.402948] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 252.403137] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 252.403328] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 252.403517] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 252.403705] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 252.403894] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 252.404084] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 252.404273] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 252.404462] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 252.404651] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 252.404844] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 252.405036] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 252.405228] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 252.405418] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 252.405608] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 252.405796] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 252.405986] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 252.406175] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 252.406364] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 252.406552] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 252.406742] Node 0 Normal per-cpu:
- <4>[ 252.407010] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 252.407200] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 252.407390] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 252.407579] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 252.407768] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 252.407957] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 252.408146] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 252.408335] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 252.408524] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 252.408714] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 252.408907] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 252.409098] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 252.409291] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 252.409480] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 252.409673] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 252.409863] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 252.410054] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 252.410247] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 252.410435] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 252.410626] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 252.410814] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 252.411006] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 252.411195] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 252.411385] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 252.411573] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 252.411758] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 252.411944] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 252.412190] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 252.412374] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 252.412558] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 252.412742] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 252.412929] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 252.413113] Node 1 Normal per-cpu:
- <4>[ 252.413378] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 252.413568] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 252.413758] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 252.413949] CPU 3: hi: 186, btch: 31 usd: 118
- <4>[ 252.414139] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 252.414327] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 252.414515] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 252.414704] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 252.414894] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 252.415086] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 252.415278] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 252.415470] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 252.415662] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 252.415851] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 252.416041] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 252.416230] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 252.416419] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 252.416607] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 252.416797] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 252.416988] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 252.417177] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 252.417367] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 252.417556] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 252.417744] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 252.417934] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 252.418122] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 252.418310] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 252.418498] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 252.418687] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 252.418879] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 252.419071] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 252.419264] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 252.419459] active_anon:870 inactive_anon:600 isolated_anon:0
- <4>[ 252.419460] active_file:298 inactive_file:402 isolated_file:0
- <4>[ 252.419460] unevictable:31 dirty:0 writeback:0 unstable:0
- <4>[ 252.419461] free:53025 slab_reclaimable:1794 slab_unreclaimable:44906
- <4>[ 252.419463] mapped:293 shmem:54 pagetables:414 bounce:0
- <4>[ 252.420412] Node 0 DMA free:15744kB min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15356kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
- <4>[ 252.421244] lowmem_reserve[]: 0 2955 32245 32245
- <4>[ 252.421833] Node 0 DMA32 free:120436kB min:4120kB low:5148kB high:6180kB active_anon:0kB inactive_anon:0kB active_file:4kB inactive_file:8kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3026080kB mlocked:0kB dirty:0kB writeback:0kB mapped:20kB shmem:0kB slab_reclaimable:20kB slab_unreclaimable:16600kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
- <4>[ 252.422669] lowmem_reserve[]: 0 0 29290 29290
- <4>[ 252.423259] Node 0 Normal free:38032kB min:40868kB low:51084kB high:61300kB active_anon:1932kB inactive_anon:732kB active_file:692kB inactive_file:816kB unevictable:108kB isolated(anon):0kB isolated(file):0kB present:29992960kB mlocked:48kB dirty:0kB writeback:0kB mapped:572kB shmem:136kB slab_reclaimable:3660kB slab_unreclaimable:75160kB kernel_stack:4456kB pagetables:808kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
- <4>[ 252.424112] lowmem_reserve[]: 0 0 0 0
- <4>[ 252.424699] Node 1 Normal free:37888kB min:45096kB low:56368kB high:67644kB active_anon:1548kB inactive_anon:1668kB active_file:496kB inactive_file:784kB unevictable:16kB isolated(anon):0kB isolated(file):0kB present:33095680kB mlocked:24kB dirty:0kB writeback:0kB mapped:580kB shmem:80kB slab_reclaimable:3496kB slab_unreclaimable:87864kB kernel_stack:256kB pagetables:848kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:2223 all_unreclaimable? yes
- <4>[ 252.425538] lowmem_reserve[]: 0 0 0 0
- <4>[ 252.426122] Node 0 DMA: 2*4kB 1*8kB 1*16kB 1*32kB 1*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15744kB
- <4>[ 252.427491] Node 0 DMA32: 47*4kB 7*8kB 4*16kB 6*32kB 10*64kB 10*128kB 7*256kB 9*512kB 7*1024kB 5*2048kB 23*4096kB = 120436kB
- <4>[ 252.428839] Node 0 Normal: 898*4kB 565*8kB 310*16kB 181*32kB 82*64kB 49*128kB 9*256kB 3*512kB 1*1024kB 0*2048kB 1*4096kB = 39344kB
- <4>[ 252.430192] Node 1 Normal: 724*4kB 442*8kB 281*16kB 183*32kB 113*64kB 32*128kB 6*256kB 1*512kB 0*1024kB 2*2048kB 1*4096kB = 38352kB
- <4>[ 252.431544] 967 total pagecache pages
- <4>[ 252.431729] 0 pages in swap cache
- <4>[ 252.431915] Swap cache stats: add 0, delete 0, find 0/0
- <4>[ 252.432105] Free swap = 0kB
- <4>[ 252.432289] Total swap = 0kB
- <6>[ 252.595670] 16777215 pages RAM
- <6>[ 252.597870] 294628 pages reserved
- <6>[ 252.598054] 116461 pages shared
- <6>[ 252.598249] 16393079 pages non-shared
- <6>[ 252.598439] [ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
- <6>[ 252.598830] [ 1047] 0 1047 2797 289 2 -17 -1000 udevd
- <6>[ 252.599133] [ 3171] 0 3171 6909 140 3 -17 -1000 auditd
- <6>[ 252.599432] [ 3772] 0 3772 16018 231 0 -17 -1000 sshd
- <6>[ 252.599730] [ 4924] 0 4924 1015 103 9 0 0 mingetty
- <6>[ 252.600028] [ 4926] 0 4926 1015 103 5 0 0 mingetty
- <6>[ 252.600334] [ 4928] 0 4928 1015 104 21 0 0 mingetty
- <6>[ 252.600634] [ 4930] 0 4930 1015 104 3 0 0 mingetty
- <6>[ 252.600937] [ 4932] 0 4932 1015 104 2 0 0 mingetty
- <6>[ 252.601236] [ 4934] 0 4934 1015 104 18 0 0 mingetty
- <6>[ 252.601535] [ 4936] 0 4936 2796 282 4 -17 -1000 udevd
- <6>[ 252.601834] [ 4937] 0 4937 2796 282 5 -17 -1000 udevd
- <6>[ 252.602130] [ 5060] 0 5060 23954 342 2 0 0 sshd
- <6>[ 252.602432] [ 5078] 1033 5078 23954 270 1 0 0 sshd
- <6>[ 252.602728] [ 5079] 1033 5079 27075 188 1 0 0 bash
- <6>[ 252.603025] [ 5257] 0 5257 61 30 17 0 0 jnx_mlnxsnmp_da
- <3>[ 252.603324] Out of memory: Kill process 4924 (mingetty) score 1 or sacrifice child
- <3>[ 252.603622] Killed process 4924, UID 0, (mingetty) total-vm:4060kB, anon-rss:80kB, file-rss:300kB
- <4>[ 252.605883] init invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0, oom_score_adj=0
- <6>[ 252.606184] init cpuset=/ mems_allowed=0-1
- <4>[ 252.606375] Pid: 1, comm: init Tainted: G W --------------- 2.6.32-279.5.2.el6.x86_64 #1
- <4>[ 252.606675] Call Trace:
- <4>[ 252.606887] [<ffffffff810c4bf1>] ? cpuset_print_task_mems_allowed+0x91/0xb0
- <4>[ 252.607085] [<ffffffff81117360>] ? dump_header+0x90/0x1b0
- <4>[ 252.607281] [<ffffffff810e37de>] ? __delayacct_freepages_end+0x2e/0x30
- <4>[ 252.607482] [<ffffffff8121494c>] ? security_real_capable_noaudit+0x3c/0x70
- <4>[ 252.607681] [<ffffffff811177e2>] ? oom_kill_process+0x82/0x2a0
- <4>[ 252.607878] [<ffffffff81117721>] ? select_bad_process+0xe1/0x120
- <4>[ 252.608074] [<ffffffff81117c20>] ? out_of_memory+0x220/0x3c0
- <4>[ 252.608274] [<ffffffff8112793e>] ? __alloc_pages_nodemask+0x89e/0x940
- <4>[ 252.608473] [<ffffffff8115c45a>] ? alloc_pages_current+0xaa/0x110
- <4>[ 252.608670] [<ffffffff81114767>] ? __page_cache_alloc+0x87/0x90
- <4>[ 252.608869] [<ffffffff81190140>] ? pollwake+0x0/0x60
- <4>[ 252.609061] [<ffffffff8112a38b>] ? __do_page_cache_readahead+0xdb/0x210
- <4>[ 252.609258] [<ffffffff81190140>] ? pollwake+0x0/0x60
- <4>[ 252.609448] [<ffffffff8112a4e1>] ? ra_submit+0x21/0x30
- <4>[ 252.609642] [<ffffffff81115a93>] ? filemap_fault+0x4c3/0x500
- <4>[ 252.609838] [<ffffffff8113ee94>] ? __do_fault+0x54/0x510
- <4>[ 252.610033] [<ffffffff8113f447>] ? handle_pte_fault+0xf7/0xb50
- <4>[ 252.610233] [<ffffffff81081a5d>] ? __sigqueue_free+0x3d/0x50
- <4>[ 252.610431] [<ffffffff810851a2>] ? __dequeue_signal+0x102/0x200
- <4>[ 252.610628] [<ffffffff8108537a>] ? dequeue_signal+0xda/0x170
- <4>[ 252.610823] [<ffffffff81140084>] ? handle_mm_fault+0x1e4/0x2b0
- <4>[ 252.611015] [<ffffffff81044479>] ? __do_page_fault+0x139/0x480
- <4>[ 252.611321] [<ffffffff8119a5b0>] ? mntput_no_expire+0x30/0x110
- <4>[ 252.611513] [<ffffffff815034ee>] ? do_page_fault+0x3e/0xa0
- <4>[ 252.611708] [<ffffffff815008a5>] ? page_fault+0x25/0x30
- <6>[ 252.611902] Mem-Info:
- <4>[ 252.612081] Node 0 DMA per-cpu:
- <4>[ 252.612343] CPU 0: hi: 0, btch: 1 usd: 0
- <4>[ 252.612530] CPU 1: hi: 0, btch: 1 usd: 0
- <4>[ 252.612725] CPU 2: hi: 0, btch: 1 usd: 0
- <4>[ 252.612916] CPU 3: hi: 0, btch: 1 usd: 0
- <4>[ 252.613105] CPU 4: hi: 0, btch: 1 usd: 0
- <4>[ 252.613293] CPU 5: hi: 0, btch: 1 usd: 0
- <4>[ 252.613481] CPU 6: hi: 0, btch: 1 usd: 0
- <4>[ 252.613668] CPU 7: hi: 0, btch: 1 usd: 0
- <4>[ 252.613864] CPU 8: hi: 0, btch: 1 usd: 0
- <4>[ 252.614051] CPU 9: hi: 0, btch: 1 usd: 0
- <4>[ 252.614242] CPU 10: hi: 0, btch: 1 usd: 0
- <4>[ 252.614431] CPU 11: hi: 0, btch: 1 usd: 0
- <4>[ 252.614628] CPU 12: hi: 0, btch: 1 usd: 0
- <4>[ 252.614820] CPU 13: hi: 0, btch: 1 usd: 0
- <4>[ 252.615008] CPU 14: hi: 0, btch: 1 usd: 0
- <4>[ 252.615196] CPU 15: hi: 0, btch: 1 usd: 0
- <4>[ 252.615384] CPU 16: hi: 0, btch: 1 usd: 0
- <4>[ 252.615572] CPU 17: hi: 0, btch: 1 usd: 0
- <4>[ 252.615768] CPU 18: hi: 0, btch: 1 usd: 0
- <4>[ 252.615957] CPU 19: hi: 0, btch: 1 usd: 0
- <4>[ 252.616145] CPU 20: hi: 0, btch: 1 usd: 0
- <4>[ 252.616333] CPU 21: hi: 0, btch: 1 usd: 0
- <4>[ 252.616526] CPU 22: hi: 0, btch: 1 usd: 0
- <4>[ 252.616714] CPU 23: hi: 0, btch: 1 usd: 0
- <4>[ 252.616909] CPU 24: hi: 0, btch: 1 usd: 0
- <4>[ 252.617098] CPU 25: hi: 0, btch: 1 usd: 0
- <4>[ 252.617286] CPU 26: hi: 0, btch: 1 usd: 0
- <4>[ 252.617475] CPU 27: hi: 0, btch: 1 usd: 0
- <4>[ 252.617663] CPU 28: hi: 0, btch: 1 usd: 0
- <4>[ 252.617853] CPU 29: hi: 0, btch: 1 usd: 0
- <4>[ 252.618042] CPU 30: hi: 0, btch: 1 usd: 0
- <4>[ 252.618234] CPU 31: hi: 0, btch: 1 usd: 0
- <4>[ 252.618423] Node 0 DMA32 per-cpu:
- <4>[ 252.618692] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 252.618884] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 252.619072] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 252.619261] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 252.619450] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 252.619639] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 252.619828] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 252.620017] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 252.620205] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 252.620394] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 252.620582] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 252.620772] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 252.620961] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 252.621148] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 252.621341] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 252.621531] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 252.621724] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 252.621915] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 252.622106] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 252.622304] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 252.622500] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 252.622695] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 252.622894] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 252.623086] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 252.623284] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 252.623475] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 252.623665] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 252.623862] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 252.624051] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 252.624242] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 252.624436] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 252.624629] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 252.624824] Node 0 Normal per-cpu:
- <4>[ 252.625085] CPU 0: hi: 186, btch: 31 usd: 21
- <4>[ 252.625269] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 252.625555] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 252.625739] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 252.625925] CPU 4: hi: 186, btch: 31 usd: 17
- <4>[ 252.626110] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 252.626294] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 252.626478] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 252.626675] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 252.626867] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 252.627056] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 252.627245] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 252.627440] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 252.627630] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 252.627821] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 252.628010] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 252.628207] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 252.628397] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 252.628588] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 252.628783] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 252.628973] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 252.629164] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 252.629354] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 252.629543] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 252.629734] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 252.629931] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 252.630122] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 252.630311] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 252.630510] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 252.630699] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 252.630891] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 252.631083] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 252.631281] Node 1 Normal per-cpu:
- <4>[ 252.631549] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 252.631738] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 252.631929] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 252.632117] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 252.632308] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 252.632499] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 252.632693] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 252.632887] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 252.633080] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 252.635221] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 252.635409] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 252.635598] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 252.635788] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 252.635979] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 252.636177] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 252.636368] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 252.636558] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 252.636746] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 252.636936] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 252.637125] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 252.637314] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 252.637503] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 252.637691] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 252.637880] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 252.638068] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 252.638256] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 252.638444] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 252.638632] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 252.638822] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 252.639012] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 252.639200] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 252.639384] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 252.639577] active_anon:591 inactive_anon:551 isolated_anon:0
- <4>[ 252.639577] active_file:137 inactive_file:0 isolated_file:55
- <4>[ 252.639578] unevictable:0 dirty:0 writeback:0 unstable:0
- <4>[ 252.639579] free:53854 slab_reclaimable:1789 slab_unreclaimable:44898
- <4>[ 252.639580] mapped:138 shmem:54 pagetables:248 bounce:0
- <4>[ 252.640559] Node 0 DMA free:15744kB min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15356kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
- <4>[ 252.641387] lowmem_reserve[]: 0 2955 32245 32245
- <4>[ 252.641976] Node 0 DMA32 free:120436kB min:4120kB low:5148kB high:6180kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:32kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3026080kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:20kB slab_unreclaimable:16600kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:1 all_unreclaimable? no
- <4>[ 252.642817] lowmem_reserve[]: 0 0 29290 29290
- <4>[ 252.643409] Node 0 Normal free:40020kB min:40868kB low:51084kB high:61300kB active_anon:1596kB inactive_anon:536kB active_file:260kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:29992960kB mlocked:0kB dirty:0kB writeback:0kB mapped:460kB shmem:136kB slab_reclaimable:3640kB slab_unreclaimable:75128kB kernel_stack:4448kB pagetables:428kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:338 all_unreclaimable? no
- <4>[ 252.644263] lowmem_reserve[]: 0 0 0 0
- <4>[ 252.644852] Node 1 Normal free:39216kB min:45096kB low:56368kB high:67644kB active_anon:768kB inactive_anon:1668kB active_file:288kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):220kB present:33095680kB mlocked:0kB dirty:0kB writeback:0kB mapped:92kB shmem:80kB slab_reclaimable:3496kB slab_unreclaimable:87864kB kernel_stack:216kB pagetables:564kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:106 all_unreclaimable? no
- <4>[ 252.645695] lowmem_reserve[]: 0 0 0 0
- <4>[ 252.646285] Node 0 DMA: 2*4kB 1*8kB 1*16kB 1*32kB 1*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15744kB
- <4>[ 252.647629] Node 0 DMA32: 41*4kB 8*8kB 7*16kB 6*32kB 10*64kB 10*128kB 7*256kB 9*512kB 7*1024kB 5*2048kB 23*4096kB = 120468kB
- <4>[ 252.648978] Node 0 Normal: 880*4kB 550*8kB 292*16kB 182*32kB 85*64kB 48*128kB 12*256kB 4*512kB 1*1024kB 0*2048kB 1*4096kB = 40240kB
- <4>[ 252.650343] Node 1 Normal: 760*4kB 444*8kB 256*16kB 181*32kB 122*64kB 38*128kB 7*256kB 0*512kB 1*1024kB 2*2048kB 1*4096kB = 40160kB
- <4>[ 252.651703] 392 total pagecache pages
- <4>[ 252.651891] 0 pages in swap cache
- <4>[ 252.652080] Swap cache stats: add 0, delete 0, find 0/0
- <4>[ 252.652270] Free swap = 0kB
- <4>[ 252.652456] Total swap = 0kB
- <6>[ 252.815467] 16777215 pages RAM
- <6>[ 252.815656] 294628 pages reserved
- <6>[ 252.815842] 115078 pages shared
- <6>[ 252.816026] 16393004 pages non-shared
- <6>[ 252.816212] [ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
- <6>[ 252.816576] [ 1047] 0 1047 2797 237 2 -17 -1000 udevd
- <6>[ 252.816877] [ 3171] 0 3171 6909 60 3 -17 -1000 auditd
- <6>[ 252.817182] [ 3772] 0 3772 16018 167 0 -17 -1000 sshd
- <6>[ 252.817481] [ 4926] 0 4926 1015 21 5 0 0 mingetty
- <6>[ 252.817778] [ 4928] 0 4928 1015 22 21 0 0 mingetty
- <6>[ 252.818074] [ 4930] 0 4930 1015 22 3 0 0 mingetty
- <6>[ 252.818382] [ 4932] 0 4932 1015 22 2 0 0 mingetty
- <6>[ 252.818675] [ 4934] 0 4934 1015 22 18 0 0 mingetty
- <6>[ 252.818968] [ 4936] 0 4936 2796 237 4 -17 -1000 udevd
- <6>[ 252.819259] [ 4937] 0 4937 2796 237 5 -17 -1000 udevd
- <6>[ 252.819551] [ 5060] 0 5060 23954 222 2 0 0 sshd
- <6>[ 252.819860] [ 5078] 1033 5078 23954 223 1 0 0 sshd
- <6>[ 252.820159] [ 5079] 1033 5079 27075 89 1 0 0 bash
- <6>[ 252.820462] [ 5257] 0 5257 61 8 17 0 0 jnx_mlnxsnmp_da
- <3>[ 252.820757] Out of memory: Kill process 4926 (mingetty) score 1 or sacrifice child
- <3>[ 252.821049] Killed process 4926, UID 0, (mingetty) total-vm:4060kB, anon-rss:80kB, file-rss:4kB
- <4>[ 252.822711] init invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0, oom_score_adj=0
- <6>[ 252.823007] init cpuset=/ mems_allowed=0-1
- <4>[ 252.823197] Pid: 1, comm: init Tainted: G W --------------- 2.6.32-279.5.2.el6.x86_64 #1
- <4>[ 252.823491] Call Trace:
- <4>[ 252.823696] [<ffffffff810c4bf1>] ? cpuset_print_task_mems_allowed+0x91/0xb0
- <4>[ 252.823893] [<ffffffff81117360>] ? dump_header+0x90/0x1b0
- <4>[ 252.824088] [<ffffffff810e37de>] ? __delayacct_freepages_end+0x2e/0x30
- <4>[ 252.824281] [<ffffffff8121494c>] ? security_real_capable_noaudit+0x3c/0x70
- <4>[ 252.824473] [<ffffffff811177e2>] ? oom_kill_process+0x82/0x2a0
- <4>[ 252.824768] [<ffffffff81117721>] ? select_bad_process+0xe1/0x120
- <4>[ 252.824957] [<ffffffff81117c20>] ? out_of_memory+0x220/0x3c0
- <4>[ 252.825150] [<ffffffff8112793e>] ? __alloc_pages_nodemask+0x89e/0x940
- <4>[ 252.825342] [<ffffffff8115c45a>] ? alloc_pages_current+0xaa/0x110
- <4>[ 252.825536] [<ffffffff81114767>] ? __page_cache_alloc+0x87/0x90
- <4>[ 252.825735] [<ffffffff81190140>] ? pollwake+0x0/0x60
- <4>[ 252.825926] [<ffffffff8112a38b>] ? __do_page_cache_readahead+0xdb/0x210
- <4>[ 252.826128] [<ffffffff81190140>] ? pollwake+0x0/0x60
- <4>[ 252.826325] [<ffffffff8112a4e1>] ? ra_submit+0x21/0x30
- <4>[ 252.826518] [<ffffffff81115a93>] ? filemap_fault+0x4c3/0x500
- <4>[ 252.826714] [<ffffffff8113ee94>] ? __do_fault+0x54/0x510
- <4>[ 252.826920] [<ffffffff8113f447>] ? handle_pte_fault+0xf7/0xb50
- <4>[ 252.827116] [<ffffffff81081a5d>] ? __sigqueue_free+0x3d/0x50
- <4>[ 252.827310] [<ffffffff810851a2>] ? __dequeue_signal+0x102/0x200
- <4>[ 252.827504] [<ffffffff8108537a>] ? dequeue_signal+0xda/0x170
- <4>[ 252.827710] [<ffffffff81140084>] ? handle_mm_fault+0x1e4/0x2b0
- <4>[ 252.827907] [<ffffffff81044479>] ? __do_page_fault+0x139/0x480
- <4>[ 252.828105] [<ffffffff8119a5b0>] ? mntput_no_expire+0x30/0x110
- <4>[ 252.828312] [<ffffffff815034ee>] ? do_page_fault+0x3e/0xa0
- <4>[ 252.828504] [<ffffffff815008a5>] ? page_fault+0x25/0x30
- <6>[ 252.828695] Mem-Info:
- <4>[ 252.828878] Node 0 DMA per-cpu:
- <4>[ 252.829143] CPU 0: hi: 0, btch: 1 usd: 0
- <4>[ 252.829332] CPU 1: hi: 0, btch: 1 usd: 0
- <4>[ 252.829522] CPU 2: hi: 0, btch: 1 usd: 0
- <4>[ 252.829718] CPU 3: hi: 0, btch: 1 usd: 0
- <4>[ 252.829906] CPU 4: hi: 0, btch: 1 usd: 0
- <4>[ 252.830166] CPU 5: hi: 0, btch: 1 usd: 0
- <4>[ 252.830357] CPU 6: hi: 0, btch: 1 usd: 0
- <4>[ 252.830553] CPU 7: hi: 0, btch: 1 usd: 0
- <4>[ 252.830743] CPU 8: hi: 0, btch: 1 usd: 0
- <4>[ 252.830938] CPU 9: hi: 0, btch: 1 usd: 0
- <4>[ 252.831127] CPU 10: hi: 0, btch: 1 usd: 0
- <4>[ 252.831322] CPU 11: hi: 0, btch: 1 usd: 0
- <4>[ 252.831511] CPU 12: hi: 0, btch: 1 usd: 0
- <4>[ 252.831710] CPU 13: hi: 0, btch: 1 usd: 0
- <4>[ 252.831899] CPU 14: hi: 0, btch: 1 usd: 0
- <4>[ 252.832097] CPU 15: hi: 0, btch: 1 usd: 0
- <4>[ 252.832289] CPU 16: hi: 0, btch: 1 usd: 0
- <4>[ 252.832490] CPU 17: hi: 0, btch: 1 usd: 0
- <4>[ 252.832679] CPU 18: hi: 0, btch: 1 usd: 0
- <4>[ 252.832875] CPU 19: hi: 0, btch: 1 usd: 0
- <4>[ 252.833064] CPU 20: hi: 0, btch: 1 usd: 0
- <4>[ 252.833253] CPU 21: hi: 0, btch: 1 usd: 0
- <4>[ 252.833450] CPU 22: hi: 0, btch: 1 usd: 0
- <4>[ 252.833641] CPU 23: hi: 0, btch: 1 usd: 0
- <4>[ 252.833829] CPU 24: hi: 0, btch: 1 usd: 0
- <4>[ 252.834017] CPU 25: hi: 0, btch: 1 usd: 0
- <4>[ 252.834206] CPU 26: hi: 0, btch: 1 usd: 0
- <4>[ 252.834401] CPU 27: hi: 0, btch: 1 usd: 0
- <4>[ 252.834589] CPU 28: hi: 0, btch: 1 usd: 0
- <4>[ 252.834780] CPU 29: hi: 0, btch: 1 usd: 0
- <4>[ 252.834973] CPU 30: hi: 0, btch: 1 usd: 0
- <4>[ 252.835169] CPU 31: hi: 0, btch: 1 usd: 0
- <4>[ 252.835357] Node 0 DMA32 per-cpu:
- <4>[ 252.835622] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 252.835817] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 252.836008] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 252.836205] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 252.836397] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 252.836597] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 252.836789] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 252.839028] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 252.839212] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 252.839403] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 252.839587] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 252.839780] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 252.839965] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 252.840161] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 252.840348] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 252.840545] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 252.840738] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 252.840925] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 252.841115] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 252.841303] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 252.841492] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 252.841683] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 252.841873] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 252.842062] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 252.842253] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 252.842451] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 252.842646] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 252.842844] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 252.843035] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 252.843231] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 252.843418] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 252.843615] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 252.843802] Node 0 Normal per-cpu:
- <4>[ 252.844068] CPU 0: hi: 186, btch: 31 usd: 21
- <4>[ 252.844255] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 252.844444] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 252.844643] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 252.844832] CPU 4: hi: 186, btch: 31 usd: 17
- <4>[ 252.845020] CPU 5: hi: 186, btch: 31 usd: 32
- <4>[ 252.845208] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 252.845404] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 252.845593] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 252.845790] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 252.845978] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 252.846167] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 252.846359] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 252.846558] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 252.846752] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 252.846943] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 252.847134] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 252.847324] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 252.847516] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 252.847715] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 252.847904] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 252.848093] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 252.848284] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 252.848480] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 252.848671] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 252.848872] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 252.849060] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 252.849248] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 252.849438] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 252.849630] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 252.849818] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 252.850008] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 252.850203] Node 1 Normal per-cpu:
- <4>[ 252.850478] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 252.850679] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 252.850872] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 252.851070] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 252.851261] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 252.851450] CPU 5: hi: 186, btch: 31 usd: 1
- <4>[ 252.851641] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 252.851830] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 252.852020] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 252.852209] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 252.852403] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 252.852592] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 252.852779] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 252.852963] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 252.853217] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 252.853408] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 252.853592] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 252.853779] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 252.853963] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 252.854154] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 252.854341] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 252.854538] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 252.854727] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 252.854922] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 252.855109] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 252.855305] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 252.855493] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 252.855690] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 252.855879] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 252.856077] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 252.856269] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 252.856467] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 252.856661] active_anon:591 inactive_anon:551 isolated_anon:0
- <4>[ 252.856662] active_file:137 inactive_file:0 isolated_file:55
- <4>[ 252.856663] unevictable:0 dirty:0 writeback:0 unstable:0
- <4>[ 252.856664] free:53854 slab_reclaimable:1789 slab_unreclaimable:44898
- <4>[ 252.856665] mapped:138 shmem:54 pagetables:248 bounce:0
- <4>[ 252.857617] Node 0 DMA free:15744kB min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15356kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
- <4>[ 252.858448] lowmem_reserve[]: 0 2955 32245 32245
- <4>[ 252.859038] Node 0 DMA32 free:120436kB min:4120kB low:5148kB high:6180kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:32kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3026080kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:20kB slab_unreclaimable:16600kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:1 all_unreclaimable? no
- <4>[ 252.859874] lowmem_reserve[]: 0 0 29290 29290
- <4>[ 252.860466] Node 0 Normal free:40020kB min:40868kB low:51084kB high:61300kB active_anon:1596kB inactive_anon:536kB active_file:260kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:29992960kB mlocked:0kB dirty:0kB writeback:0kB mapped:460kB shmem:136kB slab_reclaimable:3640kB slab_unreclaimable:75128kB kernel_stack:4448kB pagetables:428kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:338 all_unreclaimable? no
- <4>[ 252.861313] lowmem_reserve[]: 0 0 0 0
- <4>[ 252.861900] Node 1 Normal free:39216kB min:45096kB low:56368kB high:67644kB active_anon:768kB inactive_anon:1668kB active_file:288kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):220kB present:33095680kB mlocked:0kB dirty:0kB writeback:0kB mapped:92kB shmem:80kB slab_reclaimable:3496kB slab_unreclaimable:87864kB kernel_stack:216kB pagetables:564kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:106 all_unreclaimable? no
- <4>[ 252.862745] lowmem_reserve[]: 0 0 0 0
- <4>[ 252.863333] Node 0 DMA: 2*4kB 1*8kB 1*16kB 1*32kB 1*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15744kB
- <4>[ 252.864680] Node 0 DMA32: 41*4kB 8*8kB 7*16kB 6*32kB 10*64kB 10*128kB 7*256kB 9*512kB 7*1024kB 5*2048kB 23*4096kB = 120468kB
- <4>[ 252.866028] Node 0 Normal: 880*4kB 550*8kB 292*16kB 182*32kB 85*64kB 48*128kB 12*256kB 4*512kB 1*1024kB 0*2048kB 1*4096kB = 40240kB
- <4>[ 252.867442] Node 1 Normal: 760*4kB 444*8kB 256*16kB 181*32kB 122*64kB 38*128kB 7*256kB 0*512kB 1*1024kB 2*2048kB 1*4096kB = 40160kB
- <4>[ 252.868797] 392 total pagecache pages
- <4>[ 252.868982] 0 pages in swap cache
- <4>[ 252.869167] Swap cache stats: add 0, delete 0, find 0/0
- <4>[ 252.869356] Free swap = 0kB
- <4>[ 252.869539] Total swap = 0kB
- <6>[ 253.032577] 16777215 pages RAM
- <6>[ 253.032765] 294628 pages reserved
- <6>[ 253.032951] 115077 pages shared
- <6>[ 253.033138] 16392971 pages non-shared
- <6>[ 253.033325] [ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
- <6>[ 253.033690] [ 1047] 0 1047 2797 237 2 -17 -1000 udevd
- <6>[ 253.033988] [ 3171] 0 3171 6909 60 3 -17 -1000 auditd
- <6>[ 253.034282] [ 3772] 0 3772 16018 167 0 -17 -1000 sshd
- <6>[ 253.034579] [ 4928] 0 4928 1015 22 21 0 0 mingetty
- <6>[ 253.034871] [ 4930] 0 4930 1015 22 3 0 0 mingetty
- <6>[ 253.035179] [ 4932] 0 4932 1015 22 2 0 0 mingetty
- <6>[ 253.035473] [ 4934] 0 4934 1015 22 18 0 0 mingetty
- <6>[ 253.035766] [ 4936] 0 4936 2796 237 4 -17 -1000 udevd
- <6>[ 253.036057] [ 4937] 0 4937 2796 237 5 -17 -1000 udevd
- <6>[ 253.036348] [ 5060] 0 5060 23954 222 2 0 0 sshd
- <6>[ 253.036651] [ 5078] 1033 5078 23954 223 1 0 0 sshd
- <6>[ 253.036949] [ 5079] 1033 5079 27075 89 1 0 0 bash
- <6>[ 253.037252] [ 5257] 0 5257 61 8 17 0 0 jnx_mlnxsnmp_da
- <3>[ 253.037558] Out of memory: Kill process 4928 (mingetty) score 1 or sacrifice child
- <3>[ 253.037844] Killed process 4928, UID 0, (mingetty) total-vm:4060kB, anon-rss:84kB, file-rss:4kB
- <4>[ 253.038545] init invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0, oom_score_adj=0
- <6>[ 253.038832] init cpuset=/ mems_allowed=0-1
- <4>[ 253.039018] Pid: 1, comm: init Tainted: G W --------------- 2.6.32-279.5.2.el6.x86_64 #1
- <4>[ 253.039320] Call Trace:
- <4>[ 253.039516] [<ffffffff810c4bf1>] ? cpuset_print_task_mems_allowed+0x91/0xb0
- <4>[ 253.041699] [<ffffffff81117360>] ? dump_header+0x90/0x1b0
- <4>[ 253.041894] [<ffffffff810e37de>] ? __delayacct_freepages_end+0x2e/0x30
- <4>[ 253.042091] [<ffffffff8121494c>] ? security_real_capable_noaudit+0x3c/0x70
- <4>[ 253.042287] [<ffffffff811177e2>] ? oom_kill_process+0x82/0x2a0
- <4>[ 253.042482] [<ffffffff81117721>] ? select_bad_process+0xe1/0x120
- <4>[ 253.042678] [<ffffffff81117c20>] ? out_of_memory+0x220/0x3c0
- <4>[ 253.042876] [<ffffffff8112793e>] ? __alloc_pages_nodemask+0x89e/0x940
- <4>[ 253.043075] [<ffffffff8115c45a>] ? alloc_pages_current+0xaa/0x110
- <4>[ 253.043273] [<ffffffff81114767>] ? __page_cache_alloc+0x87/0x90
- <4>[ 253.043473] [<ffffffff81190140>] ? pollwake+0x0/0x60
- <4>[ 253.043667] [<ffffffff8112a38b>] ? __do_page_cache_readahead+0xdb/0x210
- <4>[ 253.043872] [<ffffffff81190140>] ? pollwake+0x0/0x60
- <4>[ 253.044062] [<ffffffff8112a4e1>] ? ra_submit+0x21/0x30
- <4>[ 253.044255] [<ffffffff81115a93>] ? filemap_fault+0x4c3/0x500
- <4>[ 253.044458] [<ffffffff8113ee94>] ? __do_fault+0x54/0x510
- <4>[ 253.044654] [<ffffffff8113f447>] ? handle_pte_fault+0xf7/0xb50
- <4>[ 253.044852] [<ffffffff81081a5d>] ? __sigqueue_free+0x3d/0x50
- <4>[ 253.045049] [<ffffffff810851a2>] ? __dequeue_signal+0x102/0x200
- <4>[ 253.045252] [<ffffffff8108537a>] ? dequeue_signal+0xda/0x170
- <4>[ 253.045445] [<ffffffff81140084>] ? handle_mm_fault+0x1e4/0x2b0
- <4>[ 253.045642] [<ffffffff81044479>] ? __do_page_fault+0x139/0x480
- <4>[ 253.045838] [<ffffffff8119a5b0>] ? mntput_no_expire+0x30/0x110
- <4>[ 253.046042] [<ffffffff815034ee>] ? do_page_fault+0x3e/0xa0
- <4>[ 253.046236] [<ffffffff815008a5>] ? page_fault+0x25/0x30
- <6>[ 253.046436] Mem-Info:
- <4>[ 253.046621] Node 0 DMA per-cpu:
- <4>[ 253.046887] CPU 0: hi: 0, btch: 1 usd: 0
- <4>[ 253.047077] CPU 1: hi: 0, btch: 1 usd: 0
- <4>[ 253.047267] CPU 2: hi: 0, btch: 1 usd: 0
- <4>[ 253.047457] CPU 3: hi: 0, btch: 1 usd: 0
- <4>[ 253.047648] CPU 4: hi: 0, btch: 1 usd: 0
- <4>[ 253.047840] CPU 5: hi: 0, btch: 1 usd: 0
- <4>[ 253.048027] CPU 6: hi: 0, btch: 1 usd: 0
- <4>[ 253.048222] CPU 7: hi: 0, btch: 1 usd: 0
- <4>[ 253.048411] CPU 8: hi: 0, btch: 1 usd: 0
- <4>[ 253.048608] CPU 9: hi: 0, btch: 1 usd: 0
- <4>[ 253.048798] CPU 10: hi: 0, btch: 1 usd: 0
- <4>[ 253.048987] CPU 11: hi: 0, btch: 1 usd: 0
- <4>[ 253.049184] CPU 12: hi: 0, btch: 1 usd: 0
- <4>[ 253.049382] CPU 13: hi: 0, btch: 1 usd: 0
- <4>[ 253.049573] CPU 14: hi: 0, btch: 1 usd: 0
- <4>[ 253.049761] CPU 15: hi: 0, btch: 1 usd: 0
- <4>[ 253.049951] CPU 16: hi: 0, btch: 1 usd: 0
- <4>[ 253.050146] CPU 17: hi: 0, btch: 1 usd: 0
- <4>[ 253.050335] CPU 18: hi: 0, btch: 1 usd: 0
- <4>[ 253.050526] CPU 19: hi: 0, btch: 1 usd: 0
- <4>[ 253.050714] CPU 20: hi: 0, btch: 1 usd: 0
- <4>[ 253.050902] CPU 21: hi: 0, btch: 1 usd: 0
- <4>[ 253.051096] CPU 22: hi: 0, btch: 1 usd: 0
- <4>[ 253.051291] CPU 23: hi: 0, btch: 1 usd: 0
- <4>[ 253.051480] CPU 24: hi: 0, btch: 1 usd: 0
- <4>[ 253.051669] CPU 25: hi: 0, btch: 1 usd: 0
- <4>[ 253.051854] CPU 26: hi: 0, btch: 1 usd: 0
- <4>[ 253.052039] CPU 27: hi: 0, btch: 1 usd: 0
- <4>[ 253.052322] CPU 28: hi: 0, btch: 1 usd: 0
- <4>[ 253.052515] CPU 29: hi: 0, btch: 1 usd: 0
- <4>[ 253.052699] CPU 30: hi: 0, btch: 1 usd: 0
- <4>[ 253.052883] CPU 31: hi: 0, btch: 1 usd: 0
- <4>[ 253.053067] Node 0 DMA32 per-cpu:
- <4>[ 253.053328] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 253.053519] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 253.053707] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 253.053896] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 253.054084] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 253.054279] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 253.054470] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 253.054658] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 253.054847] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 253.055036] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 253.055225] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 253.055422] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 253.055614] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 253.055806] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 253.055994] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 253.056182] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 253.056370] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 253.056563] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 253.056751] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 253.056941] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 253.057131] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 253.057327] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 253.057520] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 253.057712] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 253.057903] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 253.058093] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 253.058283] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 253.058474] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 253.058665] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 253.058856] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 253.059046] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 253.059244] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 253.059436] Node 0 Normal per-cpu:
- <4>[ 253.059705] CPU 0: hi: 186, btch: 31 usd: 21
- <4>[ 253.059895] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 253.060084] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 253.060282] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 253.060474] CPU 4: hi: 186, btch: 31 usd: 17
- <4>[ 253.060663] CPU 5: hi: 186, btch: 31 usd: 32
- <4>[ 253.060850] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 253.061040] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 253.061229] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 253.061425] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 253.061616] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 253.061805] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 253.061995] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 253.062184] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 253.062371] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 253.062563] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 253.062755] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 253.062946] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 253.063136] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 253.063334] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 253.063526] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 253.063718] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 253.063910] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 253.064100] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 253.064290] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 253.064481] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 253.064670] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 253.064860] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 253.065049] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 253.065246] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 253.065437] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 253.065630] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 253.065820] Node 1 Normal per-cpu:
- <4>[ 253.066083] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 253.066267] CPU 1: hi: 186, btch: 31 usd: 33
- <4>[ 253.066553] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 253.066737] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 253.066923] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 253.067108] CPU 5: hi: 186, btch: 31 usd: 1
- <4>[ 253.067293] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 253.067480] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 253.067671] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 253.067860] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 253.068050] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 253.068246] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 253.068438] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 253.068629] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 253.068818] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 253.069007] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 253.069196] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 253.069394] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 253.069587] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 253.069779] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 253.069968] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 253.070158] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 253.070347] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 253.070537] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 253.070725] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 253.070913] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 253.071102] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 253.071297] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 253.071487] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 253.071675] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 253.071863] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 253.072052] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 253.072243] active_anon:591 inactive_anon:551 isolated_anon:0
- <4>[ 253.072244] active_file:137 inactive_file:0 isolated_file:55
- <4>[ 253.072244] unevictable:0 dirty:0 writeback:0 unstable:0
- <4>[ 253.072245] free:53854 slab_reclaimable:1789 slab_unreclaimable:44898
- <4>[ 253.072246] mapped:138 shmem:54 pagetables:248 bounce:0
- <4>[ 253.073196] Node 0 DMA free:15744kB min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15356kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
- <4>[ 253.074034] lowmem_reserve[]: 0 2955 32245 32245
- <4>[ 253.074624] Node 0 DMA32 free:120436kB min:4120kB low:5148kB high:6180kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:32kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3026080kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:20kB slab_unreclaimable:16600kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:1 all_unreclaimable? no
- <4>[ 253.075467] lowmem_reserve[]: 0 0 29290 29290
- <4>[ 253.076057] Node 0 Normal free:40020kB min:40868kB low:51084kB high:61300kB active_anon:1596kB inactive_anon:536kB active_file:260kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:29992960kB mlocked:0kB dirty:0kB writeback:0kB mapped:460kB shmem:136kB slab_reclaimable:3640kB slab_unreclaimable:75128kB kernel_stack:4448kB pagetables:428kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:338 all_unreclaimable? no
- <4>[ 253.078890] lowmem_reserve[]: 0 0 0 0
- <4>[ 253.079482] Node 1 Normal free:39216kB min:45096kB low:56368kB high:67644kB active_anon:768kB inactive_anon:1668kB active_file:288kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):220kB present:33095680kB mlocked:0kB dirty:0kB writeback:0kB mapped:92kB shmem:80kB slab_reclaimable:3496kB slab_unreclaimable:87864kB kernel_stack:216kB pagetables:564kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:106 all_unreclaimable? no
- <4>[ 253.080316] lowmem_reserve[]: 0 0 0 0
- <4>[ 253.080991] Node 0 DMA: 2*4kB 1*8kB 1*16kB 1*32kB 1*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15744kB
- <4>[ 253.082333] Node 0 DMA32: 41*4kB 8*8kB 7*16kB 6*32kB 10*64kB 10*128kB 7*256kB 9*512kB 7*1024kB 5*2048kB 23*4096kB = 120468kB
- <4>[ 253.083681] Node 0 Normal: 880*4kB 550*8kB 292*16kB 182*32kB 85*64kB 48*128kB 12*256kB 4*512kB 1*1024kB 0*2048kB 1*4096kB = 40240kB
- <4>[ 253.085034] Node 1 Normal: 760*4kB 444*8kB 256*16kB 181*32kB 122*64kB 38*128kB 7*256kB 0*512kB 1*1024kB 2*2048kB 1*4096kB = 40160kB
- <4>[ 253.086392] 392 total pagecache pages
- <4>[ 253.086583] 0 pages in swap cache
- <4>[ 253.086772] Swap cache stats: add 0, delete 0, find 0/0
- <4>[ 253.086965] Free swap = 0kB
- <4>[ 253.087151] Total swap = 0kB
- <6>[ 253.250307] 16777215 pages RAM
- <6>[ 253.250498] 294628 pages reserved
- <6>[ 253.250683] 115076 pages shared
- <6>[ 253.250870] 16392938 pages non-shared
- <6>[ 253.251051] [ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
- <6>[ 253.251403] [ 1047] 0 1047 2797 237 2 -17 -1000 udevd
- <6>[ 253.251693] [ 3171] 0 3171 6909 60 3 -17 -1000 auditd
- <6>[ 253.251976] [ 3772] 0 3772 16018 167 0 -17 -1000 sshd
- <6>[ 253.252263] [ 4930] 0 4930 1015 22 3 0 0 mingetty
- <6>[ 253.252549] [ 4932] 0 4932 1015 22 2 0 0 mingetty
- <6>[ 253.252842] [ 4934] 0 4934 1015 22 18 0 0 mingetty
- <6>[ 253.253133] [ 4936] 0 4936 2796 237 4 -17 -1000 udevd
- <6>[ 253.253431] [ 4937] 0 4937 2796 237 5 -17 -1000 udevd
- <6>[ 253.253732] [ 5060] 0 5060 23954 222 2 0 0 sshd
- <6>[ 253.254026] [ 5078] 1033 5078 23954 223 1 0 0 sshd
- <6>[ 253.254321] [ 5079] 1033 5079 27075 89 1 0 0 bash
- <6>[ 253.254613] [ 5257] 0 5257 61 8 17 0 0 jnx_mlnxsnmp_da
- <3>[ 253.254908] Out of memory: Kill process 4930 (mingetty) score 1 or sacrifice child
- <3>[ 253.255200] Killed process 4930, UID 0, (mingetty) total-vm:4060kB, anon-rss:84kB, file-rss:4kB
- <3>[ 253.257391] Out of memory: Kill process 4932 (mingetty) score 1 or sacrifice child
- <3>[ 253.257684] Killed process 4932, UID 0, (mingetty) total-vm:4060kB, anon-rss:84kB, file-rss:4kB
- <3>[ 253.259357] Out of memory: Kill process 4934 (mingetty) score 1 or sacrifice child
- <3>[ 253.259649] Killed process 4934, UID 0, (mingetty) total-vm:4060kB, anon-rss:84kB, file-rss:4kB
- <3>[ 253.261353] Out of memory: Kill process 5060 (sshd) score 1 or sacrifice child
- <3>[ 253.261645] Killed process 5078, UID 1033, (sshd) total-vm:95816kB, anon-rss:892kB, file-rss:0kB
- <3>[ 253.263365] Out of memory: Kill process 5060 (sshd) score 1 or sacrifice child
- <3>[ 253.263653] Killed process 5060, UID 0, (sshd) total-vm:95816kB, anon-rss:880kB, file-rss:8kB
- <3>[ 253.264392] Out of memory: Kill process 5079 (bash) score 1 or sacrifice child
- <3>[ 253.264684] Killed process 5079, UID 1033, (bash) total-vm:108300kB, anon-rss:352kB, file-rss:4kB
- <3>[ 253.266352] Out of memory: Kill process 5257 (jnx_mlnxsnmp_da) score 1 or sacrifice child
- <3>[ 253.266638] Killed process 5257, UID 0, (jnx_mlnxsnmp_da) total-vm:244kB, anon-rss:28kB, file-rss:4kB
- <4>[ 253.318448] sshd invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=-17, oom_score_adj=-1000
- <6>[ 253.318741] sshd cpuset=/ mems_allowed=0-1
- <4>[ 253.318927] Pid: 3772, comm: sshd Tainted: G W --------------- 2.6.32-279.5.2.el6.x86_64 #1
- <4>[ 253.319219] Call Trace:
- <4>[ 253.319419] [<ffffffff810c4bf1>] ? cpuset_print_task_mems_allowed+0x91/0xb0
- <4>[ 253.319611] [<ffffffff81117360>] ? dump_header+0x90/0x1b0
- <4>[ 253.319802] [<ffffffff81117721>] ? select_bad_process+0xe1/0x120
- <4>[ 253.319995] [<ffffffff81117d7a>] ? out_of_memory+0x37a/0x3c0
- <4>[ 253.320189] [<ffffffff8112793e>] ? __alloc_pages_nodemask+0x89e/0x940
- <4>[ 253.320384] [<ffffffff8115c45a>] ? alloc_pages_current+0xaa/0x110
- <4>[ 253.320575] [<ffffffff81114767>] ? __page_cache_alloc+0x87/0x90
- <4>[ 253.320765] [<ffffffff8112a38b>] ? __do_page_cache_readahead+0xdb/0x210
- <4>[ 253.320956] [<ffffffff8112a4e1>] ? ra_submit+0x21/0x30
- <4>[ 253.321145] [<ffffffff81115a93>] ? filemap_fault+0x4c3/0x500
- <4>[ 253.321336] [<ffffffff8113ee94>] ? __do_fault+0x54/0x510
- <4>[ 253.321524] [<ffffffff8113f447>] ? handle_pte_fault+0xf7/0xb50
- <4>[ 253.321717] [<ffffffff81081a5d>] ? __sigqueue_free+0x3d/0x50
- <4>[ 253.321910] [<ffffffff810851a2>] ? __dequeue_signal+0x102/0x200
- <4>[ 253.322100] [<ffffffff8108537a>] ? dequeue_signal+0xda/0x170
- <4>[ 253.322287] [<ffffffff81140084>] ? handle_mm_fault+0x1e4/0x2b0
- <4>[ 253.322474] [<ffffffff81044479>] ? __do_page_fault+0x139/0x480
- <4>[ 253.322699] [<ffffffff8119a5b0>] ? mntput_no_expire+0x30/0x110
- <4>[ 253.322887] [<ffffffff815034ee>] ? do_page_fault+0x3e/0xa0
- <4>[ 253.323071] [<ffffffff815008a5>] ? page_fault+0x25/0x30
- <6>[ 253.323259] Mem-Info:
- <4>[ 253.323434] Node 0 DMA per-cpu:
- <4>[ 253.323692] CPU 0: hi: 0, btch: 1 usd: 0
- <4>[ 253.323878] CPU 1: hi: 0, btch: 1 usd: 0
- <4>[ 253.324064] CPU 2: hi: 0, btch: 1 usd: 0
- <4>[ 253.324252] CPU 3: hi: 0, btch: 1 usd: 0
- <4>[ 253.324436] CPU 4: hi: 0, btch: 1 usd: 0
- <4>[ 253.324621] CPU 5: hi: 0, btch: 1 usd: 0
- <4>[ 253.324806] CPU 6: hi: 0, btch: 1 usd: 0
- <4>[ 253.324991] CPU 7: hi: 0, btch: 1 usd: 0
- <4>[ 253.325175] CPU 8: hi: 0, btch: 1 usd: 0
- <4>[ 253.325362] CPU 9: hi: 0, btch: 1 usd: 0
- <4>[ 253.325550] CPU 10: hi: 0, btch: 1 usd: 0
- <4>[ 253.325737] CPU 11: hi: 0, btch: 1 usd: 0
- <4>[ 253.325926] CPU 12: hi: 0, btch: 1 usd: 0
- <4>[ 253.326115] CPU 13: hi: 0, btch: 1 usd: 0
- <4>[ 253.326303] CPU 14: hi: 0, btch: 1 usd: 0
- <4>[ 253.326491] CPU 15: hi: 0, btch: 1 usd: 0
- <4>[ 253.326678] CPU 16: hi: 0, btch: 1 usd: 0
- <4>[ 253.326863] CPU 17: hi: 0, btch: 1 usd: 0
- <4>[ 253.327047] CPU 18: hi: 0, btch: 1 usd: 0
- <4>[ 253.327234] CPU 19: hi: 0, btch: 1 usd: 0
- <4>[ 253.327419] CPU 20: hi: 0, btch: 1 usd: 0
- <4>[ 253.327604] CPU 21: hi: 0, btch: 1 usd: 0
- <4>[ 253.327789] CPU 22: hi: 0, btch: 1 usd: 0
- <4>[ 253.327975] CPU 23: hi: 0, btch: 1 usd: 0
- <4>[ 253.328165] CPU 24: hi: 0, btch: 1 usd: 0
- <4>[ 253.328354] CPU 25: hi: 0, btch: 1 usd: 0
- <4>[ 253.328539] CPU 26: hi: 0, btch: 1 usd: 0
- <4>[ 253.328725] CPU 27: hi: 0, btch: 1 usd: 0
- <4>[ 253.328910] CPU 28: hi: 0, btch: 1 usd: 0
- <4>[ 253.329097] CPU 29: hi: 0, btch: 1 usd: 0
- <4>[ 253.329284] CPU 30: hi: 0, btch: 1 usd: 0
- <4>[ 253.329472] CPU 31: hi: 0, btch: 1 usd: 0
- <4>[ 253.329661] Node 0 DMA32 per-cpu:
- <4>[ 253.329926] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 253.330112] CPU 1: hi: 186, btch: 31 usd: 0
- <4>[ 253.330300] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 253.330485] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 253.330669] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 253.330854] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 253.331040] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 253.331227] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 253.331412] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 253.331599] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 253.331785] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 253.331972] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 253.332162] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 253.332354] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 253.332538] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 253.332725] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 253.332912] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 253.333100] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 253.333292] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 253.333482] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 253.333669] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 253.333862] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 253.334050] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 253.334239] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 253.334430] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 253.334615] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 253.334801] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 253.334987] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 253.335173] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 253.335361] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 253.335549] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 253.335735] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 253.335921] Node 0 Normal per-cpu:
- <4>[ 253.336182] CPU 0: hi: 186, btch: 31 usd: 30
- <4>[ 253.336370] CPU 1: hi: 186, btch: 31 usd: 15
- <4>[ 253.336551] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 253.336827] CPU 3: hi: 186, btch: 31 usd: 17
- <4>[ 253.337009] CPU 4: hi: 186, btch: 31 usd: 173
- <4>[ 253.339097] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 253.339288] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 253.339477] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 253.339666] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 253.339853] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 253.340038] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 253.340225] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 253.340410] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 253.340595] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 253.340779] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 253.340964] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 253.341148] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 253.341335] CPU 17: hi: 186, btch: 31 usd: 30
- <4>[ 253.341520] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 253.341705] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 253.341889] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 253.342074] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 253.342261] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 253.342446] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 253.342631] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 253.342822] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 253.343011] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 253.343201] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 253.343390] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 253.343576] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 253.343761] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 253.343948] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 253.344131] Node 1 Normal per-cpu:
- <4>[ 253.344392] CPU 0: hi: 186, btch: 31 usd: 0
- <4>[ 253.344577] CPU 1: hi: 186, btch: 31 usd: 19
- <4>[ 253.344762] CPU 2: hi: 186, btch: 31 usd: 0
- <4>[ 253.344947] CPU 3: hi: 186, btch: 31 usd: 0
- <4>[ 253.345132] CPU 4: hi: 186, btch: 31 usd: 0
- <4>[ 253.345319] CPU 5: hi: 186, btch: 31 usd: 0
- <4>[ 253.345504] CPU 6: hi: 186, btch: 31 usd: 0
- <4>[ 253.345688] CPU 7: hi: 186, btch: 31 usd: 0
- <4>[ 253.345872] CPU 8: hi: 186, btch: 31 usd: 0
- <4>[ 253.346058] CPU 9: hi: 186, btch: 31 usd: 0
- <4>[ 253.346253] CPU 10: hi: 186, btch: 31 usd: 0
- <4>[ 253.346441] CPU 11: hi: 186, btch: 31 usd: 0
- <4>[ 253.346631] CPU 12: hi: 186, btch: 31 usd: 0
- <4>[ 253.346824] CPU 13: hi: 186, btch: 31 usd: 0
- <4>[ 253.347012] CPU 14: hi: 186, btch: 31 usd: 0
- <4>[ 253.347202] CPU 15: hi: 186, btch: 31 usd: 0
- <4>[ 253.347396] CPU 16: hi: 186, btch: 31 usd: 0
- <4>[ 253.347585] CPU 17: hi: 186, btch: 31 usd: 0
- <4>[ 253.347771] CPU 18: hi: 186, btch: 31 usd: 0
- <4>[ 253.347960] CPU 19: hi: 186, btch: 31 usd: 0
- <4>[ 253.348148] CPU 20: hi: 186, btch: 31 usd: 0
- <4>[ 253.348340] CPU 21: hi: 186, btch: 31 usd: 0
- <4>[ 253.348526] CPU 22: hi: 186, btch: 31 usd: 0
- <4>[ 253.348714] CPU 23: hi: 186, btch: 31 usd: 0
- <4>[ 253.348901] CPU 24: hi: 186, btch: 31 usd: 0
- <4>[ 253.349089] CPU 25: hi: 186, btch: 31 usd: 0
- <4>[ 253.349276] CPU 26: hi: 186, btch: 31 usd: 0
- <4>[ 253.349464] CPU 27: hi: 186, btch: 31 usd: 0
- <4>[ 253.349650] CPU 28: hi: 186, btch: 31 usd: 0
- <4>[ 253.349834] CPU 29: hi: 186, btch: 31 usd: 0
- <4>[ 253.350023] CPU 30: hi: 186, btch: 31 usd: 0
- <4>[ 253.350213] CPU 31: hi: 186, btch: 31 usd: 0
- <4>[ 253.350409] active_anon:342 inactive_anon:551 isolated_anon:0
- <4>[ 253.350410] active_file:137 inactive_file:0 isolated_file:55
- <4>[ 253.350411] unevictable:0 dirty:0 writeback:0 unstable:0
- <4>[ 253.350412] free:54164 slab_reclaimable:1789 slab_unreclaimable:44898
- <4>[ 253.350413] mapped:138 shmem:54 pagetables:248 bounce:0
- <4>[ 253.351427] Node 0 DMA free:15744kB min:20kB low:24kB high:28kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15356kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
- <4>[ 253.352234] lowmem_reserve[]: 0 2955 32245 32245
- <4>[ 253.352812] Node 0 DMA32 free:120436kB min:4120kB low:5148kB high:6180kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:32kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3026080kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:20kB slab_unreclaimable:16600kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:1 all_unreclaimable? no
- <4>[ 253.353637] lowmem_reserve[]: 0 0 29290 29290
- <4>[ 253.354216] Node 0 Normal free:40580kB min:40868kB low:51084kB high:61300kB active_anon:956kB inactive_anon:536kB active_file:260kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:29992960kB mlocked:0kB dirty:0kB writeback:0kB mapped:460kB shmem:136kB slab_reclaimable:3640kB slab_unreclaimable:75128kB kernel_stack:4448kB pagetables:428kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
- <4>[ 253.355047] lowmem_reserve[]: 0 0 0 0
- <4>[ 253.355624] Node 1 Normal free:39896kB min:45096kB low:56368kB high:67644kB active_anon:412kB inactive_anon:1668kB active_file:288kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):220kB present:33095680kB mlocked:0kB dirty:0kB writeback:0kB mapped:92kB shmem:80kB slab_reclaimable:3496kB slab_unreclaimable:87864kB kernel_stack:216kB pagetables:564kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
- <4>[ 253.356457] lowmem_reserve[]: 0 0 0 0
- <4>[ 253.357034] Node 0 DMA: 2*4kB 1*8kB 1*16kB 1*32kB 1*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15744kB
- <4>[ 253.358351] Node 0 DMA32: 41*4kB 8*8kB 7*16kB 6*32kB 10*64kB 10*128kB 7*256kB 9*512kB 7*1024kB 5*2048kB 23*4096kB = 120468kB
- <4>[ 253.359674] Node 0 Normal: 718*4kB 558*8kB 278*16kB 169*32kB 88*64kB 47*128kB 13*256kB 5*512kB 0*1024kB 1*2048kB 1*4096kB = 40872kB
- <4>[ 253.360995] Node 1 Normal: 876*4kB 447*8kB 249*16kB 174*32kB 116*64kB 40*128kB 8*256kB 1*512kB 1*1024kB 2*2048kB 1*4096kB = 40952kB
- <4>[ 253.362319] 154 total pagecache pages
- <4>[ 253.362502] 0 pages in swap cache
- <4>[ 253.362684] Swap cache stats: add 0, delete 0, find 0/0
- <4>[ 253.362869] Free swap = 0kB
- <4>[ 253.363050] Total swap = 0kB
- <6>[ 253.526814] 16777215 pages RAM
- <6>[ 253.526999] 294628 pages reserved
- <6>[ 253.527190] 114911 pages shared
- <6>[ 253.527372] 16392561 pages non-shared
- <6>[ 253.527555] [ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
- <6>[ 253.527882] [ 1047] 0 1047 2797 237 2 -17 -1000 udevd
- <6>[ 253.528175] [ 3171] 0 3171 6909 60 3 -17 -1000 auditd
- <6>[ 253.528465] [ 3772] 0 3772 16018 167 0 -17 -1000 sshd
- <6>[ 253.528760] [ 4936] 0 4936 2796 237 4 -17 -1000 udevd
- <6>[ 253.529046] [ 4937] 0 4937 2796 237 5 -17 -1000 udevd
- <0>[ 253.529344] Kernel panic - not syncing: Out of memory and no killable processes...
- <0>[ 253.529345]
- <4>[ 253.529809] Pid: 3772, comm: sshd Tainted: G W --------------- 2.6.32-279.5.2.el6.x86_64 #1
- <4>[ 253.530103] Call Trace:
- <4>[ 253.530296] [<ffffffff814fd39a>] ? panic+0xa0/0x168
- <4>[ 253.530484] [<ffffffff811173dd>] ? dump_header+0x10d/0x1b0
- <4>[ 253.530674] [<ffffffff81117d8f>] ? out_of_memory+0x38f/0x3c0
- <4>[ 253.530866] [<ffffffff8112793e>] ? __alloc_pages_nodemask+0x89e/0x940
- <4>[ 253.531059] [<ffffffff8115c45a>] ? alloc_pages_current+0xaa/0x110
- <4>[ 253.531255] [<ffffffff81114767>] ? __page_cache_alloc+0x87/0x90
- <4>[ 253.531449] [<ffffffff8112a38b>] ? __do_page_cache_readahead+0xdb/0x210
- <4>[ 253.531649] [<ffffffff8112a4e1>] ? ra_submit+0x21/0x30
- <4>[ 253.531838] [<ffffffff81115a93>] ? filemap_fault+0x4c3/0x500
- <4>[ 253.532031] [<ffffffff8113ee94>] ? __do_fault+0x54/0x510
- <4>[ 253.532228] [<ffffffff8113f447>] ? handle_pte_fault+0xf7/0xb50
- <4>[ 253.532424] [<ffffffff81081a5d>] ? __sigqueue_free+0x3d/0x50
- <4>[ 253.532620] [<ffffffff810851a2>] ? __dequeue_signal+0x102/0x200
- <4>[ 253.532810] [<ffffffff8108537a>] ? dequeue_signal+0xda/0x170
- <4>[ 253.532999] [<ffffffff81140084>] ? handle_mm_fault+0x1e4/0x2b0
- <4>[ 253.533208] [<ffffffff81044479>] ? __do_page_fault+0x139/0x480
- <4>[ 253.533399] [<ffffffff8119a5b0>] ? mntput_no_expire+0x30/0x110
- <4>[ 253.533590] [<ffffffff815034ee>] ? do_page_fault+0x3e/0xa0
- <4>[ 253.533785] [<ffffffff815008a5>] ? page_fault+0x25/0x30
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement