Advertisement
Guest User

Untitled

a guest
May 7th, 2015
471
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 123.82 KB | None | 0 0
  1. May 6 17:35:58 rd2 kernel: [141931.368656] jbd2/dm-3-8 invoked oom-killer: gfp_mask=0x20858, order=0, oom_score_adj=0
  2. May 6 17:35:58 rd2 kernel: [141931.374233] jbd2/dm-3-8 cpuset=/ mems_allowed=0
  3. May 6 17:35:58 rd2 kernel: [141931.380442] CPU: 3 PID: 1553 Comm: jbd2/dm-3-8 Not tainted 3.19.5.at.dell1950+ixgbe10g #1
  4. May 6 17:35:58 rd2 kernel: [141931.388196] Hardware name: Dell Inc. PowerEdge 1950/0M788G, BIOS 2.6.1 04/20/2009
  5. May 6 17:35:58 rd2 kernel: [141931.396300] 00000000 c134422f f6e0aa50 c1342f1c c141ff23 f6e0ad38 00020858 00000000
  6. May 6 17:35:58 rd2 kernel: [141931.404138] 00000000 00000000 00000008 f24ce494 00000000 00000000 c14b9fec c142012e
  7. May 6 17:35:58 rd2 kernel: [141931.413110] f27a0a90 0000000e 00000000 c10b76ef 00000000 c11a1a1b 00020858 f24c6a90
  8. May 6 17:35:58 rd2 kernel: [141931.423734] Call Trace:
  9. May 6 17:35:58 rd2 kernel: [141931.431840] [<c134422f>] ? dump_stack+0x3e/0x4e
  10. May 6 17:35:58 rd2 kernel: [141931.439848] [<c1342f1c>] ? dump_header.isra.9+0x53/0x174
  11. May 6 17:35:58 rd2 kernel: [141931.448443] [<c10b76ef>] ? oom_kill_process+0x6f/0x29e
  12. May 6 17:35:58 rd2 kernel: [141931.455468] [<c11a1a1b>] ? __bitmap_intersects+0x28/0x3d
  13. May 6 17:35:58 rd2 kernel: [141931.462476] [<c114b98b>] ? security_capable_noaudit+0xc/0xf
  14. May 6 17:35:58 rd2 kernel: [141931.469367] [<c10b7df4>] ? out_of_memory+0x395/0x3c4
  15. May 6 17:35:58 rd2 kernel: [141931.476712] [<c10bb249>] ? __alloc_pages_nodemask+0x5bf/0x6b8
  16. May 6 17:35:58 rd2 kernel: [141931.483833] [<c10e6828>] ? alloc_pages_current+0x86/0xa2
  17. May 6 17:35:59 rd2 kernel: [141931.490538] [<c10b562a>] ? pagecache_get_page+0xae/0x13e
  18. May 6 17:35:59 rd2 kernel: [141931.497097] [<c111500c>] ? __getblk_slow+0x159/0x2a9
  19. May 6 17:35:59 rd2 kernel: [141931.504143] [<c1115189>] ? __getblk_gfp+0x2d/0x59
  20. May 6 17:35:59 rd2 kernel: [141931.511194] [<f82709af>] ? jbd2_journal_get_descriptor_buffer+0x32/0x65 [jbd2]
  21. May 6 17:35:59 rd2 kernel: [141931.518407] [<f826b6af>] ? jbd2_journal_commit_transaction+0x568/0x11a1 [jbd2]
  22. May 6 17:35:59 rd2 kernel: [141931.525254] [<c1050404>] ? __update_tg_runnable_avg+0x24/0x50
  23. May 6 17:35:59 rd2 kernel: [141931.531803] [<c104f7f3>] ? get_sd_balance_interval+0x12/0x27
  24. May 6 17:35:59 rd2 kernel: [141931.538372] [<c104fe14>] ? update_next_balance.constprop.61+0xd/0x19
  25. May 6 17:35:59 rd2 kernel: [141931.545829] [<c134534e>] ? __schedule+0x3be/0x4a0
  26. May 6 17:35:59 rd2 kernel: [141931.552489] [<c1347b99>] ? apic_timer_interrupt+0x2d/0x34
  27. May 6 17:35:59 rd2 kernel: [141931.560432] [<f826f5a9>] ? kjournald2+0x99/0x1e0 [jbd2]
  28. May 6 17:35:59 rd2 kernel: [141931.567328] [<c105636c>] ? woken_wake_function+0x12/0x12
  29. May 6 17:35:59 rd2 kernel: [141931.574345] [<f826f510>] ? journal_init_common+0x115/0x115 [jbd2]
  30. May 6 17:35:59 rd2 kernel: [141931.581842] [<c1044d4f>] ? kthread+0x7c/0x81
  31. May 6 17:35:59 rd2 kernel: [141931.588545] [<c10f4c13>] ? vfs_write+0xe9/0x102
  32. May 6 17:35:59 rd2 kernel: [141931.595979] [<c1040000>] ? max_active_show+0x3/0x1a
  33. May 6 17:35:59 rd2 kernel: [141931.603264] [<c1347281>] ? ret_from_kernel_thread+0x21/0x30
  34. May 6 17:35:59 rd2 kernel: [141931.610820] [<c1044cd3>] ? __kthread_parkme+0x4c/0x4c
  35. May 6 17:35:59 rd2 kernel: [141931.619310] Mem-Info:
  36. May 6 17:35:59 rd2 kernel: [141931.626371] Node 0 DMA per-cpu:
  37. May 6 17:35:59 rd2 kernel: [141931.634044] CPU 0: hi: 0, btch: 1 usd: 0
  38. May 6 17:35:59 rd2 kernel: [141931.640428] CPU 1: hi: 0, btch: 1 usd: 0
  39. May 6 17:35:59 rd2 kernel: [141931.647108] CPU 2: hi: 0, btch: 1 usd: 0
  40. May 6 17:35:59 rd2 kernel: [141931.653826] CPU 3: hi: 0, btch: 1 usd: 0
  41. May 6 17:35:59 rd2 kernel: [141931.660841] Node 0 Normal per-cpu:
  42. May 6 17:35:59 rd2 kernel: [141931.668676] CPU 0: hi: 186, btch: 31 usd: 0
  43. May 6 17:35:59 rd2 kernel: [141931.675456] CPU 1: hi: 186, btch: 31 usd: 0
  44. May 6 17:35:59 rd2 kernel: [141931.682088] CPU 2: hi: 186, btch: 31 usd: 0
  45. May 6 17:35:59 rd2 kernel: [141931.688362] CPU 3: hi: 186, btch: 31 usd: 0
  46. May 6 17:35:59 rd2 kernel: [141931.694451] Node 0 HighMem per-cpu:
  47. May 6 17:35:59 rd2 kernel: [141931.700525] CPU 0: hi: 186, btch: 31 usd: 0
  48. May 6 17:35:59 rd2 kernel: [141931.706917] CPU 1: hi: 186, btch: 31 usd: 0
  49. May 6 17:35:59 rd2 kernel: [141931.712713] CPU 2: hi: 186, btch: 31 usd: 0
  50. May 6 17:35:59 rd2 kernel: [141931.718582] CPU 3: hi: 186, btch: 31 usd: 0
  51. May 6 17:35:59 rd2 kernel: [141931.724966] active_anon:215188 inactive_anon:26985 isolated_anon:0
  52. May 6 17:35:59 rd2 kernel: [141931.724966] active_file:14629 inactive_file:3008 isolated_file:0
  53. May 6 17:35:59 rd2 kernel: [141931.724966] unevictable:0 dirty:0 writeback:0 unstable:0
  54. May 6 17:35:59 rd2 kernel: [141931.724966] free:1625498 slab_reclaimable:2466 slab_unreclaimable:97280
  55. May 6 17:35:59 rd2 kernel: [141931.724966] mapped:7182 shmem:3795 pagetables:1002 bounce:0
  56. May 6 17:35:59 rd2 kernel: [141931.724966] free_cma:0
  57. May 6 17:35:59 rd2 kernel: [141931.754064] Node 0 DMA free:5660kB min:2496kB low:3120kB high:3744kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15996kB managed:15912kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:100kB slab_unreclaimable:7128kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
  58. May 6 17:35:59 rd2 kernel: [141931.777499] lowmem_reserve[]: 0 798 8096 8096
  59. May 6 17:35:59 rd2 kernel: [141931.784517] Node 0 Normal free:80812kB min:128572kB low:160712kB high:192856kB active_anon:0kB inactive_anon:0kB active_file:152kB inactive_file:100kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:894968kB managed:818540kB mlocked:0kB dirty:0kB writeback:0kB mapped:4kB shmem:0kB slab_reclaimable:9764kB slab_unreclaimable:383492kB kernel_stack:1688kB pagetables:24kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:280 all_unreclaimable? no
  60. May 6 17:35:59 rd2 kernel: [141931.808094] lowmem_reserve[]: 0 0 58378 58378
  61. May 6 17:35:59 rd2 kernel: [141931.816412] Node 0 HighMem free:6413656kB min:512kB low:293944kB high:587380kB active_anon:860752kB inactive_anon:107940kB active_file:58344kB inactive_file:11924kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:7472456kB managed:7472456kB mlocked:4kB dirty:0kB writeback:0kB mapped:28724kB shmem:15180kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:3984kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
  62. May 6 17:35:59 rd2 kernel: [141931.842358] lowmem_reserve[]: 0 0 0 0
  63. May 6 17:35:59 rd2 kernel: [141931.851245] Node 0 DMA: 14*4kB (UMR) 1*8kB (R) 1*16kB (R) 1*32kB (M) 0*64kB 0*128kB 0*256kB 1*512kB (R) 1*1024kB (R) 0*2048kB 1*4096kB (R) = 5744kB
  64. May 6 17:35:59 rd2 kernel: [141931.868096] Node 0 Normal: 770*4kB (UEM) 443*8kB (UEM) 251*16kB (UEM) 165*32kB (UEM) 90*64kB (UEM) 52*128kB (UEM) 26*256kB (UEM) 15*512kB (EM) 12*1024kB (UEM) 10*2048kB (UEMR) 1*4096kB (R) = 79536kB
  65. May 6 17:35:59 rd2 kernel: [141931.890321] Node 0 HighMem: 5704*4kB (UM) 2839*8kB (UM) 1242*16kB (UM) 694*32kB (UM) 473*64kB (UM) 262*128kB (UM) 120*256kB (M) 55*512kB (M) 26*1024kB (M) 16*2048kB (MR) 1500*4096kB (UM) = 6413688kB
  66. May 6 17:35:59 rd2 kernel: [141931.910224] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
  67. May 6 17:35:59 rd2 kernel: [141931.918538] 21434 total pagecache pages
  68. May 6 17:35:59 rd2 kernel: [141931.927030] 24 pages in swap cache
  69. May 6 17:35:59 rd2 kernel: [141931.935604] Swap cache stats: add 3541, delete 3517, find 44/68
  70. May 6 17:35:59 rd2 kernel: [141931.944503] Free swap = 16751104kB
  71. May 6 17:35:59 rd2 kernel: [141931.952811] Total swap = 16764924kB
  72. May 6 17:35:59 rd2 kernel: [141931.961533] 2095855 pages RAM
  73. May 6 17:35:59 rd2 kernel: [141931.970027] 1868114 pages HighMem/MovableOnly
  74. May 6 17:35:59 rd2 kernel: [141931.978330] 19128 pages reserved
  75. May 6 17:35:59 rd2 kernel: [141931.986539] [ pid ] uid tgid total_vm rss nr_ptes swapents oom_score_adj name
  76. May 6 17:35:59 rd2 kernel: [141931.996358] [ 462] 0 462 656 548 5 0 -1000 udevd
  77. May 6 17:35:59 rd2 kernel: [141932.005586] [ 2121] 0 2121 598 478 5 0 0 rpcbind
  78. May 6 17:35:59 rd2 kernel: [141932.014438] [ 2152] 102 2152 666 580 5 0 0 rpc.statd
  79. May 6 17:35:59 rd2 kernel: [141932.024151] [ 2166] 0 2166 648 44 6 0 0 rpc.idmapd
  80. May 6 17:35:59 rd2 kernel: [141932.033060] [ 2364] 0 2364 537 26 5 0 0 netserver
  81. May 6 17:35:59 rd2 kernel: [141932.043138] [ 2528] 0 2528 516 366 5 0 0 vnstatd
  82. May 6 17:35:59 rd2 kernel: [141932.053049] [ 2550] 0 2550 7311 636 7 140 0 rsyslogd
  83. May 6 17:35:59 rd2 kernel: [141932.061805] [ 2553] 0 2553 9514 3068 12 12 0 glusterd
  84. May 6 17:35:59 rd2 kernel: [141932.071293] [ 2631] 0 2631 542 31 4 0 0 atd
  85. May 6 17:35:59 rd2 kernel: [141932.080284] [ 2700] 0 2700 473 355 5 0 0 acpid
  86. May 6 17:35:59 rd2 kernel: [141932.089082] [ 2734] 0 2734 1100 516 6 0 0 cron
  87. May 6 17:35:59 rd2 kernel: [141932.098530] [ 2752] 105 2752 758 55 5 0 0 dbus-daemon
  88. May 6 17:35:59 rd2 kernel: [141932.107594] [ 2777] 0 2777 1423 684 6 0 0 ha_logd
  89. May 6 17:35:59 rd2 kernel: [141932.116653] [ 2781] 109 2781 1838 563 7 2 0 zabbix_agentd
  90. May 6 17:35:59 rd2 kernel: [141932.126033] [ 2782] 109 2782 1838 631 7 2 0 zabbix_agentd
  91. May 6 17:35:59 rd2 kernel: [141932.134822] [ 2783] 109 2783 1838 648 7 2 0 zabbix_agentd
  92. May 6 17:35:59 rd2 kernel: [141932.143442] [ 2784] 109 2784 1838 648 7 2 0 zabbix_agentd
  93. May 6 17:35:59 rd2 kernel: [141932.151744] [ 2785] 109 2785 1838 643 7 2 0 zabbix_agentd
  94. May 6 17:35:59 rd2 kernel: [141932.159992] [ 2786] 109 2786 1838 621 7 2 0 zabbix_agentd
  95. May 6 17:35:59 rd2 kernel: [141932.168230] [ 2787] 109 2787 1838 621 7 2 0 zabbix_agentd
  96. May 6 17:35:59 rd2 kernel: [141932.176628] [ 2788] 109 2788 2005 811 7 2 0 zabbix_agentd
  97. May 6 17:35:59 rd2 kernel: [141932.184716] [ 2789] 0 2789 1423 615 6 0 0 ha_logd
  98. May 6 17:35:59 rd2 kernel: [141932.192557] [ 2792] 0 2792 16281 1651 23 0 0 corosync
  99. May 6 17:35:59 rd2 kernel: [141932.200069] [ 2859] 106 2859 3306 1751 9 0 0 cib
  100. May 6 17:35:59 rd2 kernel: [141932.207323] [ 2860] 0 2860 3042 1075 10 0 0 stonithd
  101. May 6 17:35:59 rd2 kernel: [141932.214635] [ 2861] 0 2861 2599 1303 9 0 0 lrmd
  102. May 6 17:35:59 rd2 kernel: [141932.221870] [ 2862] 106 2862 3101 1044 10 0 0 attrd
  103. May 6 17:35:59 rd2 kernel: [141932.228887] [ 2863] 106 2863 2222 1373 8 0 0 pengine
  104. May 6 17:35:59 rd2 kernel: [141932.235511] [ 2864] 106 2864 3122 1450 10 0 0 crmd
  105. May 6 17:35:59 rd2 kernel: [141932.242157] [ 2878] 0 2878 1620 747 6 0 -1000 sshd
  106. May 6 17:35:59 rd2 kernel: [141932.248803] [ 3038] 0 3038 14525 6735 21 77 0 glusterfs
  107. May 6 17:35:59 rd2 kernel: [141932.255343] [ 3072] 0 3072 13759 3948 20 32 0 glusterfsd
  108. May 6 17:35:59 rd2 kernel: [141932.261661] [ 3076] 0 3076 13502 6769 19 0 0 glusterfs
  109. May 6 17:35:59 rd2 kernel: [141932.267486] [ 3135] 65534 3135 13922 11932 30 0 0 squid
  110. May 6 17:35:59 rd2 kernel: [141932.273278] [ 3138] 65534 3138 92217 91667 183 0 0 squid
  111. May 6 17:35:59 rd2 kernel: [141932.278945] [ 3139] 0 3139 641 359 5 0 0 flow-capture
  112. May 6 17:35:59 rd2 kernel: [141932.284538] [ 3140] 0 3140 9108 411 9 0 0 iperf
  113. May 6 17:35:59 rd2 kernel: [141932.289877] [ 5407] 0 5407 470 329 4 0 0 startpar
  114. May 6 17:35:59 rd2 kernel: [141932.294901] [ 5408] 0 5408 1086 421 6 0 0 getty
  115. May 6 17:35:59 rd2 kernel: [141932.299517] [ 5409] 0 5409 1086 468 6 0 0 getty
  116. May 6 17:35:59 rd2 kernel: [141932.304213] [ 5410] 0 5410 1086 464 6 0 0 getty
  117. May 6 17:35:59 rd2 kernel: [141932.309045] [ 5411] 0 5411 1086 440 6 0 0 getty
  118. May 6 17:35:59 rd2 kernel: [141932.313619] [ 5412] 0 5412 1086 463 6 0 0 getty
  119. May 6 17:35:59 rd2 kernel: [141932.318439] [ 5413] 0 5413 1086 463 5 0 0 getty
  120. May 6 17:35:59 rd2 kernel: [141932.323394] [ 5501] 1000 5501 1709 741 7 1 0 screen
  121. May 6 17:35:59 rd2 kernel: [141932.328271] [ 5502] 1000 5502 1871 1115 7 0 0 bash
  122. May 6 17:35:59 rd2 kernel: [141932.332961] [ 5546] 1000 5546 1506 726 6 0 0 su
  123. May 6 17:35:59 rd2 kernel: [141932.337517] [ 5547] 0 5547 1577 1101 6 0 0 bash
  124. May 6 17:35:59 rd2 kernel: [141932.341995] [15382] 0 15382 655 506 5 0 -1000 udevd
  125. May 6 17:35:59 rd2 kernel: [141932.346498] [10153] 1000 10153 1871 1087 6 0 0 bash
  126. May 6 17:35:59 rd2 kernel: [141932.352093] [10198] 1000 10198 1506 695 6 0 0 su
  127. May 6 17:35:59 rd2 kernel: [141932.357387] [10199] 0 10199 1573 1085 6 1 0 bash
  128. May 6 17:35:59 rd2 kernel: [141932.361914] [17115] 0 17115 2334 1203 8 0 0 sshd
  129. May 6 17:35:59 rd2 kernel: [141932.366917] [17121] 1000 17121 2334 834 8 0 0 sshd
  130. May 6 17:35:59 rd2 kernel: [141932.372615] [17122] 1000 17122 2013 1265 7 0 0 bash
  131. May 6 17:35:59 rd2 kernel: [141932.377317] [14457] 0 14457 655 253 5 0 -1000 udevd
  132. May 6 17:35:59 rd2 kernel: [141932.381786] [ 1510] 107 1510 1713 689 6 0 0 dnsmasq
  133. May 6 17:35:59 rd2 kernel: [141932.386525] [ 1615] 0 1615 1602 615 6 0 0 screen
  134. May 6 17:35:59 rd2 kernel: [141932.391113] [ 1619] 0 1619 487 79 4 0 0 sh
  135. May 6 17:35:59 rd2 kernel: [141932.395870] [ 1620] 0 1620 479 385 5 0 0 netcat
  136. May 6 17:35:59 rd2 kernel: [141932.400817] [ 1621] 0 1621 1269 461 6 0 0 tee
  137. May 6 17:35:59 rd2 kernel: [141932.405396] [ 7372] 108 7372 40019 38834 80 718 0 zebra
  138. May 6 17:35:59 rd2 kernel: [141932.409921] [ 7376] 108 7376 73844 72094 146 1464 0 bgpd
  139. May 6 17:35:59 rd2 kernel: [141932.414712] [ 7380] 108 7380 1049 736 6 0 0 ospfd
  140. May 6 17:35:59 rd2 kernel: [141932.419449] [ 7385] 0 7385 646 386 4 0 0 watchquagga
  141. May 6 17:35:59 rd2 kernel: [141932.424695] [24077] 65534 24077 855 253 5 0 0 log_file_daemon
  142. May 6 17:35:59 rd2 kernel: [141932.429983] [28870] 1000 28870 1871 1114 6 0 0 bash
  143. May 6 17:35:59 rd2 kernel: [141932.435029] [28915] 1000 28915 1506 694 7 0 0 su
  144. May 6 17:35:59 rd2 kernel: [141932.440122] [28929] 0 28929 1557 1050 7 0 0 bash
  145. May 6 17:35:59 rd2 kernel: [141932.445157] [ 1255] 0 1255 1740 1173 7 0 0 vi
  146. May 6 17:35:59 rd2 kernel: [141932.450052] [14851] 0 14851 2389 1239 7 0 0 sshd
  147. May 6 17:35:59 rd2 kernel: [141932.454845] [14864] 1000 14864 2389 863 7 0 0 sshd
  148. May 6 17:35:59 rd2 kernel: [141932.459889] [14865] 1000 14865 1724 1213 7 0 0 bash
  149. May 6 17:35:59 rd2 kernel: [141932.465049] [14966] 1000 14966 1218 649 6 0 0 su
  150. May 6 17:35:59 rd2 kernel: [141932.470095] [14969] 0 14969 1329 823 6 0 0 bash
  151. May 6 17:35:59 rd2 kernel: [141932.475019] [23948] 0 23948 2334 1219 7 0 0 sshd
  152. May 6 17:35:59 rd2 kernel: [141932.479920] [23951] 1000 23951 2369 855 7 0 0 sshd
  153. May 6 17:35:59 rd2 kernel: [141932.484777] [23952] 1000 23952 2014 1282 7 0 0 bash
  154. May 6 17:35:59 rd2 kernel: [141932.489513] [24054] 1000 24054 1529 663 6 0 0 screen
  155. May 6 17:36:00 rd2 kernel: [141932.494186] [28181] 0 28181 1314 610 6 0 0 screen
  156. May 6 17:36:00 rd2 kernel: [141932.499094] [28182] 0 28182 1335 861 6 0 0 bash
  157. May 6 17:36:00 rd2 kernel: [141932.503760] [28775] 0 28775 529 371 4 0 0 vnstat
  158. May 6 17:36:00 rd2 kernel: [141932.632570] squid invoked oom-killer: gfp_mask=0x2142d0, order=0, oom_score_adj=0
  159. May 6 17:36:00 rd2 kernel: [141932.636121] squid cpuset=/ mems_allowed=0
  160. May 6 17:36:00 rd2 kernel: [141932.640292] CPU: 0 PID: 3138 Comm: squid Not tainted 3.19.5.at.dell1950+ixgbe10g #1
  161. May 6 17:36:00 rd2 kernel: [141932.644634] Hardware name: Dell Inc. PowerEdge 1950/0M788G, BIOS 2.6.1 04/20/2009
  162. May 6 17:36:00 rd2 kernel: [141932.649593] 00000000 c134422f f27a0a90 c1342f1c c141ff23 f27a0d78 002142d0 00000000
  163. May 6 17:36:00 rd2 kernel: [141932.654401] 00000000 00008116 44245cc8 00008116 44245cc8 00008116 c14b9fec c142012e
  164. May 6 17:36:00 rd2 kernel: [141932.659846] f27a0a90 0000000e 00000000 c10b76ef 00000000 f6d35050 002142d0 f24c6a90
  165. May 6 17:36:00 rd2 kernel: [141932.666128] Call Trace:
  166. May 6 17:36:00 rd2 kernel: [141932.670845] [<c134422f>] ? dump_stack+0x3e/0x4e
  167. May 6 17:36:00 rd2 kernel: [141932.675668] [<c1342f1c>] ? dump_header.isra.9+0x53/0x174
  168. May 6 17:36:00 rd2 kernel: [141932.680538] [<c10b76ef>] ? oom_kill_process+0x6f/0x29e
  169. May 6 17:36:00 rd2 kernel: [141932.685430] [<c114b98b>] ? security_capable_noaudit+0xc/0xf
  170. May 6 17:36:00 rd2 kernel: [141932.690331] [<c10b7df4>] ? out_of_memory+0x395/0x3c4
  171. May 6 17:36:00 rd2 kernel: [141932.695252] [<c10bb249>] ? __alloc_pages_nodemask+0x5bf/0x6b8
  172. May 6 17:36:00 rd2 kernel: [141932.700056] [<c102277d>] ? lapic_next_event+0xc/0xf
  173. May 6 17:36:00 rd2 kernel: [141932.704882] [<c10eb2ad>] ? kmem_getpages+0x43/0x9c
  174. May 6 17:36:00 rd2 kernel: [141932.709718] [<c10eb999>] ? fallback_alloc+0x115/0x18d
  175. May 6 17:36:00 rd2 kernel: [141932.714537] [<c10eba6a>] ? kmem_cache_alloc_node_trace+0x59/0xd4
  176. May 6 17:36:00 rd2 kernel: [141932.719385] [<c12803d5>] ? __kmalloc_reserve.isra.47+0x1a/0x5d
  177. May 6 17:36:00 rd2 kernel: [141932.724276] [<c128099b>] ? __alloc_skb+0x69/0x17c
  178. May 6 17:36:00 rd2 kernel: [141932.730643] [<c12c2eee>] ? skb_do_copy_data_nocache+0xdf/0xf3
  179. May 6 17:36:00 rd2 kernel: [141932.737215] [<c12c40a2>] ? sk_stream_alloc_skb+0x23/0xad
  180. May 6 17:36:00 rd2 kernel: [141932.743671] [<c12c47d7>] ? tcp_sendmsg+0x2f5/0x780
  181. May 6 17:36:00 rd2 kernel: [141932.750876] [<c1005dfc>] ? nvidia_force_enable_hpet+0x49/0x7e
  182. May 6 17:36:00 rd2 kernel: [141932.757669] [<c12e0cbc>] ? inet_sendmsg+0x2d/0x4e
  183. May 6 17:36:00 rd2 kernel: [141932.765121] [<c1279b60>] ? __sock_sendmsg_nosec+0x20/0x24
  184. May 6 17:36:00 rd2 kernel: [141932.774386] [<c127b0f4>] ? sock_aio_write+0xa6/0xb6
  185. May 6 17:36:00 rd2 kernel: [141932.785123] [<c12c3bf8>] ? tcp_poll+0x11f/0x187
  186. May 6 17:36:00 rd2 kernel: [141932.795054] [<c10f4221>] ? do_sync_write+0x4c/0x73
  187. May 6 17:36:00 rd2 kernel: [141932.802651] [<c10f4bbf>] ? vfs_write+0x95/0x102
  188. May 6 17:36:00 rd2 kernel: [141932.811051] [<c10f4db6>] ? SyS_write+0x3c/0x6a
  189. May 6 17:36:00 rd2 kernel: [141932.818719] [<c1347348>] ? sysenter_do_call+0x12/0x12
  190. May 6 17:36:00 rd2 kernel: [141932.824918] Mem-Info:
  191. May 6 17:36:00 rd2 kernel: [141932.831303] Node 0 DMA per-cpu:
  192. May 6 17:36:00 rd2 kernel: [141932.838417] CPU 0: hi: 0, btch: 1 usd: 0
  193. May 6 17:36:00 rd2 kernel: [141932.844988] CPU 1: hi: 0, btch: 1 usd: 0
  194. May 6 17:36:00 rd2 kernel: [141932.852729] CPU 2: hi: 0, btch: 1 usd: 0
  195. May 6 17:36:00 rd2 kernel: [141932.859376] CPU 3: hi: 0, btch: 1 usd: 0
  196. May 6 17:36:00 rd2 kernel: [141932.866253] Node 0 Normal per-cpu:
  197. May 6 17:36:00 rd2 kernel: [141932.873790] CPU 0: hi: 186, btch: 31 usd: 0
  198. May 6 17:36:00 rd2 kernel: [141932.880776] CPU 1: hi: 186, btch: 31 usd: 0
  199. May 6 17:36:00 rd2 kernel: [141932.888214] CPU 2: hi: 186, btch: 31 usd: 0
  200. May 6 17:36:00 rd2 kernel: [141932.894469] CPU 3: hi: 186, btch: 31 usd: 30
  201. May 6 17:36:00 rd2 kernel: [141932.901416] Node 0 HighMem per-cpu:
  202. May 6 17:36:00 rd2 kernel: [141932.907927] CPU 0: hi: 186, btch: 31 usd: 0
  203. May 6 17:36:00 rd2 kernel: [141932.914290] CPU 1: hi: 186, btch: 31 usd: 0
  204. May 6 17:36:00 rd2 kernel: [141932.920695] CPU 2: hi: 186, btch: 31 usd: 0
  205. May 6 17:36:00 rd2 kernel: [141932.926986] CPU 3: hi: 186, btch: 31 usd: 0
  206. May 6 17:36:00 rd2 kernel: [141932.933026] active_anon:215146 inactive_anon:27032 isolated_anon:0
  207. May 6 17:36:00 rd2 kernel: [141932.933026] active_file:8541 inactive_file:2995 isolated_file:0
  208. May 6 17:36:00 rd2 kernel: [141932.933026] unevictable:0 dirty:0 writeback:0 unstable:0
  209. May 6 17:36:00 rd2 kernel: [141932.933026] free:1626906 slab_reclaimable:2432 slab_unreclaimable:97663
  210. May 6 17:36:00 rd2 kernel: [141932.933026] mapped:7187 shmem:3795 pagetables:1002 bounce:0
  211. May 6 17:36:00 rd2 kernel: [141932.933026] free_cma:0
  212. May 6 17:36:00 rd2 kernel: [141932.960119] Node 0 DMA free:5596kB min:2496kB low:3120kB high:3744kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15996kB managed:15912kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:100kB slab_unreclaimable:7272kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
  213. May 6 17:36:00 rd2 kernel: [141932.981952] lowmem_reserve[]: 0 798 8096 8096
  214. May 6 17:36:00 rd2 kernel: [141932.989343] Node 0 Normal free:64444kB min:128572kB low:160712kB high:192856kB active_anon:0kB inactive_anon:0kB active_file:52kB inactive_file:48kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:894968kB managed:818540kB mlocked:0kB dirty:0kB writeback:0kB mapped:4kB shmem:0kB slab_reclaimable:9628kB slab_unreclaimable:382880kB kernel_stack:1688kB pagetables:24kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:416 all_unreclaimable? no
  215. May 6 17:36:00 rd2 kernel: [141933.011495] lowmem_reserve[]: 0 0 58378 58378
  216. May 6 17:36:00 rd2 kernel: [141933.018154] Node 0 HighMem free:6437908kB min:512kB low:293944kB high:587380kB active_anon:860584kB inactive_anon:108212kB active_file:34080kB inactive_file:11912kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:7472456kB managed:7472456kB mlocked:4kB dirty:4kB writeback:0kB mapped:28744kB shmem:15180kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:3984kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
  217. May 6 17:36:00 rd2 kernel: [141933.044833] lowmem_reserve[]: 0 0 0 0
  218. May 6 17:36:00 rd2 kernel: [141933.052643] Node 0 DMA: 0*4kB 1*8kB (R) 0*16kB 1*32kB (R) 1*64kB (R) 1*128kB (R) 0*256kB 0*512kB 0*1024kB 0*2048kB 1*4096kB (R) = 4328kB
  219. May 6 17:36:00 rd2 kernel: [141933.070306] Node 0 Normal: 741*4kB (UEM) 455*8kB (UEM) 254*16kB (UEM) 171*32kB (UEM) 87*64kB (EM) 47*128kB (EM) 24*256kB (EM) 14*512kB (EM) 11*1024kB (EM) 4*2048kB (MR) 1*4096kB (R) = 64588kB
  220. May 6 17:36:00 rd2 kernel: [141933.088479] Node 0 HighMem: 7343*4kB (UM) 2920*8kB (UM) 1273*16kB (UM) 704*32kB (UM) 474*64kB (UM) 275*128kB (UM) 129*256kB (M) 59*512kB (M) 28*1024kB (M) 18*2048kB (MR) 1501*4096kB (UM) = 6438028kB
  221. May 6 17:36:00 rd2 kernel: [141933.106407] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
  222. May 6 17:36:00 rd2 kernel: [141933.114540] 15435 total pagecache pages
  223. May 6 17:36:00 rd2 kernel: [141933.123148] 47 pages in swap cache
  224. May 6 17:36:00 rd2 kernel: [141933.131757] Swap cache stats: add 3588, delete 3533, find 79/131
  225. May 6 17:36:00 rd2 kernel: [141933.140312] Free swap = 16751168kB
  226. May 6 17:36:00 rd2 kernel: [141933.148977] Total swap = 16764924kB
  227. May 6 17:36:00 rd2 kernel: [141933.157330] 2095855 pages RAM
  228. May 6 17:36:00 rd2 kernel: [141933.165890] 1868114 pages HighMem/MovableOnly
  229. May 6 17:36:00 rd2 kernel: [141933.174145] 19128 pages reserved
  230. May 6 17:36:00 rd2 kernel: [141933.182682] [ pid ] uid tgid total_vm rss nr_ptes swapents oom_score_adj name
  231. May 6 17:36:00 rd2 kernel: [141933.191042] [ 462] 0 462 656 548 5 0 -1000 udevd
  232. May 6 17:36:00 rd2 kernel: [141933.199880] [ 2121] 0 2121 598 478 5 0 0 rpcbind
  233. May 6 17:36:00 rd2 kernel: [141933.208781] [ 2152] 102 2152 666 580 5 0 0 rpc.statd
  234. May 6 17:36:00 rd2 kernel: [141933.217499] [ 2166] 0 2166 648 44 6 0 0 rpc.idmapd
  235. May 6 17:36:00 rd2 kernel: [141933.226651] [ 2364] 0 2364 537 26 5 0 0 netserver
  236. May 6 17:36:00 rd2 kernel: [141933.235771] [ 2528] 0 2528 516 366 5 0 0 vnstatd
  237. May 6 17:36:00 rd2 kernel: [141933.245050] [ 2550] 0 2550 7311 636 7 140 0 rsyslogd
  238. May 6 17:36:00 rd2 kernel: [141933.254032] [ 2553] 0 2553 9514 3068 12 12 0 glusterd
  239. May 6 17:36:00 rd2 kernel: [141933.263848] [ 2631] 0 2631 542 31 4 0 0 atd
  240. May 6 17:36:00 rd2 kernel: [141933.273611] [ 2700] 0 2700 473 355 5 0 0 acpid
  241. May 6 17:36:00 rd2 kernel: [141933.283051] [ 2734] 0 2734 1100 516 6 0 0 cron
  242. May 6 17:36:00 rd2 kernel: [141933.292205] [ 2752] 105 2752 758 55 5 0 0 dbus-daemon
  243. May 6 17:36:00 rd2 kernel: [141933.302224] [ 2777] 0 2777 1423 684 6 0 0 ha_logd
  244. May 6 17:36:00 rd2 kernel: [141933.311067] [ 2781] 109 2781 1838 563 7 2 0 zabbix_agentd
  245. May 6 17:36:00 rd2 kernel: [141933.321261] [ 2782] 109 2782 1838 631 7 2 0 zabbix_agentd
  246. May 6 17:36:00 rd2 kernel: [141933.330534] [ 2783] 109 2783 1838 648 7 2 0 zabbix_agentd
  247. May 6 17:36:00 rd2 kernel: [141933.340154] [ 2784] 109 2784 1838 648 7 2 0 zabbix_agentd
  248. May 6 17:36:00 rd2 kernel: [141933.350021] [ 2785] 109 2785 1838 643 7 2 0 zabbix_agentd
  249. May 6 17:36:00 rd2 kernel: [141933.359618] [ 2786] 109 2786 1838 621 7 2 0 zabbix_agentd
  250. May 6 17:36:00 rd2 kernel: [141933.368634] [ 2787] 109 2787 1838 621 7 2 0 zabbix_agentd
  251. May 6 17:36:00 rd2 kernel: [141933.377027] [ 2788] 109 2788 2005 811 7 2 0 zabbix_agentd
  252. May 6 17:36:00 rd2 kernel: [141933.385248] [ 2789] 0 2789 1423 615 6 0 0 ha_logd
  253. May 6 17:36:00 rd2 kernel: [141933.394602] [ 2792] 0 2792 16281 1651 23 0 0 corosync
  254. May 6 17:36:00 rd2 kernel: [141933.402314] [ 2859] 106 2859 3306 1751 9 0 0 cib
  255. May 6 17:36:00 rd2 kernel: [141933.410049] [ 2860] 0 2860 3042 1075 10 0 0 stonithd
  256. May 6 17:36:00 rd2 kernel: [141933.417448] [ 2861] 0 2861 2599 1303 9 0 0 lrmd
  257. May 6 17:36:00 rd2 kernel: [141933.424708] [ 2862] 106 2862 3101 1044 10 0 0 attrd
  258. May 6 17:36:00 rd2 kernel: [141933.431765] [ 2863] 106 2863 2222 1373 8 0 0 pengine
  259. May 6 17:36:00 rd2 kernel: [141933.438763] [ 2864] 106 2864 3122 1450 10 0 0 crmd
  260. May 6 17:36:00 rd2 kernel: [141933.445645] [ 2878] 0 2878 1620 747 6 0 -1000 sshd
  261. May 6 17:36:00 rd2 kernel: [141933.452168] [ 3038] 0 3038 14525 6735 21 77 0 glusterfs
  262. May 6 17:36:00 rd2 kernel: [141933.458743] [ 3072] 0 3072 13759 3948 20 32 0 glusterfsd
  263. May 6 17:36:00 rd2 kernel: [141933.465392] [ 3076] 0 3076 13502 6769 19 0 0 glusterfs
  264. May 6 17:36:00 rd2 kernel: [141933.471911] [ 3135] 65534 3135 13922 11932 30 0 0 squid
  265. May 6 17:36:00 rd2 kernel: [141933.477845] [ 3138] 65534 3138 92217 91667 183 0 0 squid
  266. May 6 17:36:00 rd2 kernel: [141933.483513] [ 3139] 0 3139 641 359 5 0 0 flow-capture
  267. May 6 17:36:00 rd2 kernel: [141933.489101] [ 3140] 0 3140 9108 411 9 0 0 iperf
  268. May 6 17:36:01 rd2 kernel: [141933.494628] [ 5407] 0 5407 470 329 4 0 0 startpar
  269. May 6 17:36:01 rd2 kernel: [141933.500121] [ 5408] 0 5408 1086 421 6 0 0 getty
  270. May 6 17:36:01 rd2 kernel: [141933.505304] [ 5409] 0 5409 1086 468 6 0 0 getty
  271. May 6 17:36:01 rd2 kernel: [141933.510479] [ 5410] 0 5410 1086 464 6 0 0 getty
  272. May 6 17:36:01 rd2 kernel: [141933.515545] [ 5411] 0 5411 1086 440 6 0 0 getty
  273. May 6 17:36:01 rd2 kernel: [141933.520421] [ 5412] 0 5412 1086 463 6 0 0 getty
  274. May 6 17:36:01 rd2 kernel: [141933.525213] [ 5413] 0 5413 1086 463 5 0 0 getty
  275. May 6 17:36:01 rd2 kernel: [141933.531221] [ 5501] 1000 5501 1709 741 7 1 0 screen
  276. May 6 17:36:01 rd2 kernel: [141933.535924] [ 5502] 1000 5502 1871 1115 7 0 0 bash
  277. May 6 17:36:01 rd2 kernel: [141933.541261] [ 5546] 1000 5546 1506 726 6 0 0 su
  278. May 6 17:36:01 rd2 kernel: [141933.546184] [ 5547] 0 5547 1577 1101 6 0 0 bash
  279. May 6 17:36:01 rd2 kernel: [141933.550981] [15382] 0 15382 655 506 5 0 -1000 udevd
  280. May 6 17:36:01 rd2 kernel: [141933.556156] [10153] 1000 10153 1871 1087 6 0 0 bash
  281. May 6 17:36:01 rd2 kernel: [141933.560912] [10198] 1000 10198 1506 695 6 0 0 su
  282. May 6 17:36:01 rd2 kernel: [141933.565416] [10199] 0 10199 1573 1085 6 1 0 bash
  283. May 6 17:36:01 rd2 kernel: [141933.571187] [17115] 0 17115 2334 1203 8 0 0 sshd
  284. May 6 17:36:01 rd2 kernel: [141933.576145] [17121] 1000 17121 2334 834 8 0 0 sshd
  285. May 6 17:36:01 rd2 kernel: [141933.580953] [17122] 1000 17122 2013 1265 7 0 0 bash
  286. May 6 17:36:01 rd2 kernel: [141933.585768] [14457] 0 14457 655 253 5 0 -1000 udevd
  287. May 6 17:36:01 rd2 kernel: [141933.590547] [ 1510] 107 1510 1713 689 6 0 0 dnsmasq
  288. May 6 17:36:01 rd2 kernel: [141933.595389] [ 1615] 0 1615 1602 615 6 0 0 screen
  289. May 6 17:36:01 rd2 kernel: [141933.600224] [ 1619] 0 1619 487 79 4 0 0 sh
  290. May 6 17:36:01 rd2 kernel: [141933.604902] [ 1620] 0 1620 479 385 5 0 0 netcat
  291. May 6 17:36:01 rd2 kernel: [141933.609510] [ 1621] 0 1621 1269 461 6 0 0 tee
  292. May 6 17:36:01 rd2 kernel: [141933.614232] [ 7372] 108 7372 40019 38834 80 718 0 zebra
  293. May 6 17:36:01 rd2 kernel: [141933.619171] [ 7376] 108 7376 73844 72207 146 1381 0 bgpd
  294. May 6 17:36:01 rd2 kernel: [141933.624181] [ 7380] 108 7380 1049 736 6 0 0 ospfd
  295. May 6 17:36:01 rd2 kernel: [141933.628971] [ 7385] 0 7385 646 386 4 0 0 watchquagga
  296. May 6 17:36:01 rd2 kernel: [141933.633850] [28870] 1000 28870 1871 1114 6 0 0 bash
  297. May 6 17:36:01 rd2 kernel: [141933.638685] [28915] 1000 28915 1506 694 7 0 0 su
  298. May 6 17:36:01 rd2 kernel: [141933.644077] [28929] 0 28929 1557 1050 7 0 0 bash
  299. May 6 17:36:01 rd2 kernel: [141933.649577] [ 1255] 0 1255 1740 1173 7 0 0 vi
  300. May 6 17:36:01 rd2 kernel: [141933.654545] [14851] 0 14851 2389 1239 7 0 0 sshd
  301. May 6 17:36:01 rd2 kernel: [141933.659891] [14864] 1000 14864 2389 863 7 0 0 sshd
  302. May 6 17:36:01 rd2 kernel: [141933.665242] [14865] 1000 14865 1724 1213 7 0 0 bash
  303. May 6 17:36:01 rd2 kernel: [141933.670246] [14966] 1000 14966 1218 649 6 0 0 su
  304. May 6 17:36:01 rd2 kernel: [141933.675143] [14969] 0 14969 1329 823 6 0 0 bash
  305. May 6 17:36:01 rd2 kernel: [141933.680226] [23948] 0 23948 2334 1219 7 0 0 sshd
  306. May 6 17:36:01 rd2 kernel: [141933.685058] [23951] 1000 23951 2369 855 7 0 0 sshd
  307. May 6 17:36:01 rd2 kernel: [141933.689752] [23952] 1000 23952 2014 1282 7 0 0 bash
  308. May 6 17:36:01 rd2 kernel: [141933.694298] [24054] 1000 24054 1529 663 6 0 0 screen
  309. May 6 17:36:01 rd2 kernel: [141933.699165] [28181] 0 28181 1314 610 6 0 0 screen
  310. May 6 17:36:01 rd2 kernel: [141933.704133] [28182] 0 28182 1335 861 6 0 0 bash
  311. May 6 17:36:01 rd2 kernel: [141933.709215] [28775] 0 28775 529 371 4 0 0 vnstat
  312. May 6 17:36:01 rd2 squid[3135]: Squid Parent: (squid-1) process 3138 exited due to signal 9 with status 0
  313. May 6 17:36:05 rd2 kernel: [141937.689840] hrtimer: interrupt took 2361 ns
  314. May 6 17:40:54 rd2 squid[6271]: Squid Parent: will start 1 kids
  315. May 6 17:40:54 rd2 squid[6271]: Squid Parent: (squid-1) process 6273 started
  316. May 6 17:43:53 rd2 kernel: [142406.049458] squid invoked oom-killer: gfp_mask=0x2040d0, order=0, oom_score_adj=0
  317. May 6 17:43:53 rd2 kernel: [142406.054471] squid cpuset=/ mems_allowed=0
  318. May 6 17:43:53 rd2 kernel: [142406.060542] CPU: 3 PID: 6273 Comm: squid Not tainted 3.19.5.at.dell1950+ixgbe10g #1
  319. May 6 17:43:53 rd2 kernel: [142406.067414] Hardware name: Dell Inc. PowerEdge 1950/0M788G, BIOS 2.6.1 04/20/2009
  320. May 6 17:43:53 rd2 kernel: [142406.074327] 00000000 c134422f f27cd010 c1342f1c c141ff23 f27cd2f8 002040d0 00000000
  321. May 6 17:43:53 rd2 kernel: [142406.083638] 00000000 00008184 7dfd83ba 00008184 7dfd83ba 00008184 c14b9fec c142012e
  322. May 6 17:43:53 rd2 kernel: [142406.091567] f6da6530 0000000b 00000000 c10b76ef 00000000 f6da6530 002040d0 f1c31570
  323. May 6 17:43:53 rd2 kernel: [142406.101449] Call Trace:
  324. May 6 17:43:53 rd2 kernel: [142406.108692] [<c134422f>] ? dump_stack+0x3e/0x4e
  325. May 6 17:43:53 rd2 kernel: [142406.116357] [<c1342f1c>] ? dump_header.isra.9+0x53/0x174
  326. May 6 17:43:53 rd2 kernel: [142406.123165] [<c10b76ef>] ? oom_kill_process+0x6f/0x29e
  327. May 6 17:43:53 rd2 kernel: [142406.129766] [<c114b98b>] ? security_capable_noaudit+0xc/0xf
  328. May 6 17:43:53 rd2 kernel: [142406.136121] [<c10b7df4>] ? out_of_memory+0x395/0x3c4
  329. May 6 17:43:53 rd2 kernel: [142406.142640] [<c10bb249>] ? __alloc_pages_nodemask+0x5bf/0x6b8
  330. May 6 17:43:53 rd2 kernel: [142406.148964] [<c10eb2ad>] ? kmem_getpages+0x43/0x9c
  331. May 6 17:43:53 rd2 kernel: [142406.155575] [<c10eb999>] ? fallback_alloc+0x115/0x18d
  332. May 6 17:43:53 rd2 kernel: [142406.162198] [<c10eb5b8>] ? kmem_cache_alloc_node+0x59/0xda
  333. May 6 17:43:53 rd2 kernel: [142406.168799] [<c1280970>] ? __alloc_skb+0x3e/0x17c
  334. May 6 17:43:53 rd2 kernel: [142406.175983] [<c12c2eee>] ? skb_do_copy_data_nocache+0xdf/0xf3
  335. May 6 17:43:53 rd2 kernel: [142406.183421] [<c12c40a2>] ? sk_stream_alloc_skb+0x23/0xad
  336. May 6 17:43:53 rd2 kernel: [142406.189943] [<c12c47d7>] ? tcp_sendmsg+0x2f5/0x780
  337. May 6 17:43:53 rd2 kernel: [142406.196218] [<c1005dfc>] ? nvidia_force_enable_hpet+0x49/0x7e
  338. May 6 17:43:53 rd2 kernel: [142406.202666] [<c12e0cbc>] ? inet_sendmsg+0x2d/0x4e
  339. May 6 17:43:53 rd2 kernel: [142406.208916] [<c1279b60>] ? __sock_sendmsg_nosec+0x20/0x24
  340. May 6 17:43:53 rd2 kernel: [142406.215651] [<c127b0f4>] ? sock_aio_write+0xa6/0xb6
  341. May 6 17:43:53 rd2 kernel: [142406.222207] [<c12c3bf8>] ? tcp_poll+0x11f/0x187
  342. May 6 17:43:53 rd2 kernel: [142406.228723] [<c10f4221>] ? do_sync_write+0x4c/0x73
  343. May 6 17:43:53 rd2 kernel: [142406.235166] [<c10f4bbf>] ? vfs_write+0x95/0x102
  344. May 6 17:43:53 rd2 kernel: [142406.241624] [<c10f4db6>] ? SyS_write+0x3c/0x6a
  345. May 6 17:43:53 rd2 kernel: [142406.248046] [<c1347348>] ? sysenter_do_call+0x12/0x12
  346. May 6 17:43:53 rd2 kernel: [142406.254531] Mem-Info:
  347. May 6 17:43:53 rd2 kernel: [142406.260707] Node 0 DMA per-cpu:
  348. May 6 17:43:53 rd2 kernel: [142406.267642] CPU 0: hi: 0, btch: 1 usd: 0
  349. May 6 17:43:53 rd2 kernel: [142406.273406] CPU 1: hi: 0, btch: 1 usd: 0
  350. May 6 17:43:53 rd2 kernel: [142406.282765] CPU 2: hi: 0, btch: 1 usd: 0
  351. May 6 17:43:53 rd2 kernel: [142406.290284] CPU 3: hi: 0, btch: 1 usd: 0
  352. May 6 17:43:53 rd2 kernel: [142406.296526] Node 0 Normal per-cpu:
  353. May 6 17:43:53 rd2 kernel: [142406.302726] CPU 0: hi: 186, btch: 31 usd: 0
  354. May 6 17:43:53 rd2 kernel: [142406.309391] CPU 1: hi: 186, btch: 31 usd: 0
  355. May 6 17:43:53 rd2 kernel: [142406.315764] CPU 2: hi: 186, btch: 31 usd: 0
  356. May 6 17:43:53 rd2 kernel: [142406.322078] CPU 3: hi: 186, btch: 31 usd: 15
  357. May 6 17:43:53 rd2 kernel: [142406.327898] Node 0 HighMem per-cpu:
  358. May 6 17:43:53 rd2 kernel: [142406.334262] CPU 0: hi: 186, btch: 31 usd: 0
  359. May 6 17:43:53 rd2 kernel: [142406.340239] CPU 1: hi: 186, btch: 31 usd: 0
  360. May 6 17:43:53 rd2 kernel: [142406.345992] CPU 2: hi: 186, btch: 31 usd: 0
  361. May 6 17:43:53 rd2 kernel: [142406.352065] CPU 3: hi: 186, btch: 31 usd: 0
  362. May 6 17:43:53 rd2 kernel: [142406.358361] active_anon:149474 inactive_anon:22438 isolated_anon:0
  363. May 6 17:43:53 rd2 kernel: [142406.358361] active_file:8683 inactive_file:3071 isolated_file:32
  364. May 6 17:43:53 rd2 kernel: [142406.358361] unevictable:0 dirty:0 writeback:0 unstable:0
  365. May 6 17:43:53 rd2 kernel: [142406.358361] free:1704036 slab_reclaimable:2089 slab_unreclaimable:69792
  366. May 6 17:43:53 rd2 kernel: [142406.358361] mapped:7255 shmem:3795 pagetables:870 bounce:0
  367. May 6 17:43:53 rd2 kernel: [142406.358361] free_cma:0
  368. May 6 17:43:53 rd2 kernel: [142406.387249] Node 0 DMA free:5624kB min:2496kB low:3120kB high:3744kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15996kB managed:15912kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:84kB slab_unreclaimable:4740kB kernel_stack:8kB pagetables:0kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
  369. May 6 17:43:53 rd2 kernel: [142406.405512] lowmem_reserve[]: 0 798 8096 8096
  370. May 6 17:43:53 rd2 kernel: [142406.413186] Node 0 Normal free:90536kB min:128572kB low:160712kB high:192856kB active_anon:0kB inactive_anon:0kB active_file:212kB inactive_file:152kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:894968kB managed:818540kB mlocked:0kB dirty:0kB writeback:0kB mapped:4kB shmem:0kB slab_reclaimable:8272kB slab_unreclaimable:275128kB kernel_stack:1704kB pagetables:24kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
  371. May 6 17:43:53 rd2 kernel: [142406.435100] lowmem_reserve[]: 0 0 58378 58378
  372. May 6 17:43:53 rd2 kernel: [142406.443654] Node 0 HighMem free:6719092kB min:512kB low:293944kB high:587380kB active_anon:597896kB inactive_anon:89752kB active_file:34520kB inactive_file:12132kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:7472456kB managed:7472456kB mlocked:4kB dirty:0kB writeback:0kB mapped:29016kB shmem:15180kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:3456kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
  373. May 6 17:43:53 rd2 kernel: [142406.469486] lowmem_reserve[]: 0 0 0 0
  374. May 6 17:43:54 rd2 kernel: [142406.478139] Node 0 DMA: 34*4kB (UR) 3*8kB (UR) 1*16kB (R) 0*32kB 0*64kB 1*128kB (R) 3*256kB (R) 1*512kB (R) 0*1024kB 0*2048kB 1*4096kB (R) = 5680kB
  375. May 6 17:43:54 rd2 kernel: [142406.495308] Node 0 Normal: 657*4kB (EM) 425*8kB (UEM) 234*16kB (UEM) 173*32kB (UEM) 93*64kB (UEM) 45*128kB (EM) 89*256kB (UEM) 38*512kB (UEM) 10*1024kB (EM) 4*2048kB (MR) 1*4096kB (R) = 91788kB
  376. May 6 17:43:54 rd2 kernel: [142406.516706] Node 0 HighMem: 886*4kB (UM) 118*8kB (UM) 47*16kB (UM) 1130*32kB (UM) 943*64kB (UM) 532*128kB (M) 311*256kB (UM) 140*512kB (M) 62*1024kB (M) 29*2048kB (MR) 1532*4096kB (UM) = 6719096kB
  377. May 6 17:43:54 rd2 kernel: [142406.538246] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
  378. May 6 17:43:54 rd2 kernel: [142406.546627] 15793 total pagecache pages
  379. May 6 17:43:54 rd2 kernel: [142406.554789] 263 pages in swap cache
  380. May 6 17:43:54 rd2 kernel: [142406.563058] Swap cache stats: add 5440, delete 5177, find 1701/2885
  381. May 6 17:43:54 rd2 kernel: [142406.571913] Free swap = 16757088kB
  382. May 6 17:43:54 rd2 kernel: [142406.580389] Total swap = 16764924kB
  383. May 6 17:43:54 rd2 kernel: [142406.589974] 2095855 pages RAM
  384. May 6 17:43:54 rd2 kernel: [142406.599354] 1868114 pages HighMem/MovableOnly
  385. May 6 17:43:54 rd2 kernel: [142406.608796] 19128 pages reserved
  386. May 6 17:43:54 rd2 kernel: [142406.617302] [ pid ] uid tgid total_vm rss nr_ptes swapents oom_score_adj name
  387. May 6 17:43:54 rd2 kernel: [142406.626131] [ 462] 0 462 656 548 5 0 -1000 udevd
  388. May 6 17:43:54 rd2 kernel: [142406.634915] [ 2121] 0 2121 598 478 5 0 0 rpcbind
  389. May 6 17:43:54 rd2 kernel: [142406.644595] [ 2152] 102 2152 666 580 5 0 0 rpc.statd
  390. May 6 17:43:54 rd2 kernel: [142406.654155] [ 2166] 0 2166 648 44 6 0 0 rpc.idmapd
  391. May 6 17:43:54 rd2 kernel: [142406.664054] [ 2364] 0 2364 537 26 5 0 0 netserver
  392. May 6 17:43:54 rd2 kernel: [142406.672560] [ 2528] 0 2528 516 366 5 0 0 vnstatd
  393. May 6 17:43:54 rd2 kernel: [142406.683116] [ 2550] 0 2550 7311 636 7 140 0 rsyslogd
  394. May 6 17:43:54 rd2 kernel: [142406.692314] [ 2553] 0 2553 9514 3068 12 12 0 glusterd
  395. May 6 17:43:54 rd2 kernel: [142406.701693] [ 2631] 0 2631 542 31 4 0 0 atd
  396. May 6 17:43:54 rd2 kernel: [142406.710405] [ 2700] 0 2700 473 355 5 0 0 acpid
  397. May 6 17:43:54 rd2 kernel: [142406.719386] [ 2734] 0 2734 1100 516 6 0 0 cron
  398. May 6 17:43:54 rd2 kernel: [142406.729208] [ 2752] 105 2752 758 55 5 0 0 dbus-daemon
  399. May 6 17:43:54 rd2 kernel: [142406.738632] [ 2777] 0 2777 1423 684 6 0 0 ha_logd
  400. May 6 17:43:54 rd2 kernel: [142406.747274] [ 2781] 109 2781 1838 563 7 2 0 zabbix_agentd
  401. May 6 17:43:54 rd2 kernel: [142406.756578] [ 2782] 109 2782 1838 631 7 2 0 zabbix_agentd
  402. May 6 17:43:54 rd2 kernel: [142406.766020] [ 2783] 109 2783 1838 648 7 2 0 zabbix_agentd
  403. May 6 17:43:54 rd2 kernel: [142406.775417] [ 2784] 109 2784 1838 648 7 2 0 zabbix_agentd
  404. May 6 17:43:54 rd2 kernel: [142406.784951] [ 2785] 109 2785 1838 643 7 2 0 zabbix_agentd
  405. May 6 17:43:54 rd2 kernel: [142406.793354] [ 2786] 109 2786 1838 621 7 2 0 zabbix_agentd
  406. May 6 17:43:54 rd2 kernel: [142406.802450] [ 2787] 109 2787 1838 621 7 2 0 zabbix_agentd
  407. May 6 17:43:54 rd2 kernel: [142406.810444] [ 2788] 109 2788 2005 811 7 2 0 zabbix_agentd
  408. May 6 17:43:54 rd2 kernel: [142406.819036] [ 2789] 0 2789 1423 615 6 0 0 ha_logd
  409. May 6 17:43:54 rd2 kernel: [142406.826760] [ 2792] 0 2792 16281 1651 23 0 0 corosync
  410. May 6 17:43:54 rd2 kernel: [142406.834779] [ 2859] 106 2859 3306 1751 9 0 0 cib
  411. May 6 17:43:54 rd2 kernel: [142406.842343] [ 2860] 0 2860 3042 1075 10 0 0 stonithd
  412. May 6 17:43:54 rd2 kernel: [142406.849853] [ 2861] 0 2861 2599 1303 9 0 0 lrmd
  413. May 6 17:43:54 rd2 kernel: [142406.857547] [ 2862] 106 2862 3101 1044 10 0 0 attrd
  414. May 6 17:43:54 rd2 kernel: [142406.865389] [ 2863] 106 2863 2222 1373 8 0 0 pengine
  415. May 6 17:43:54 rd2 kernel: [142406.872970] [ 2864] 106 2864 3122 1450 10 0 0 crmd
  416. May 6 17:43:54 rd2 kernel: [142406.880843] [ 2878] 0 2878 1620 747 6 0 -1000 sshd
  417. May 6 17:43:54 rd2 kernel: [142406.888165] [ 3038] 0 3038 14525 6923 21 65 0 glusterfs
  418. May 6 17:43:54 rd2 kernel: [142406.895594] [ 3072] 0 3072 14016 3948 21 32 0 glusterfsd
  419. May 6 17:43:54 rd2 kernel: [142406.902260] [ 3076] 0 3076 13502 6769 19 0 0 glusterfs
  420. May 6 17:43:54 rd2 kernel: [142406.908982] [ 3139] 0 3139 641 359 5 0 0 flow-capture
  421. May 6 17:43:54 rd2 kernel: [142406.914743] [ 3140] 0 3140 9108 411 9 0 0 iperf
  422. May 6 17:43:54 rd2 kernel: [142406.920936] [ 5407] 0 5407 470 329 4 0 0 startpar
  423. May 6 17:43:54 rd2 kernel: [142406.927628] [ 5408] 0 5408 1086 421 6 0 0 getty
  424. May 6 17:43:54 rd2 kernel: [142406.933641] [ 5409] 0 5409 1086 468 6 0 0 getty
  425. May 6 17:43:54 rd2 kernel: [142406.938990] [ 5410] 0 5410 1086 464 6 0 0 getty
  426. May 6 17:43:54 rd2 kernel: [142406.944112] [ 5411] 0 5411 1086 440 6 0 0 getty
  427. May 6 17:43:54 rd2 kernel: [142406.949364] [ 5412] 0 5412 1086 463 6 0 0 getty
  428. May 6 17:43:54 rd2 kernel: [142406.954743] [ 5413] 0 5413 1086 463 5 0 0 getty
  429. May 6 17:43:54 rd2 kernel: [142406.959875] [ 5501] 1000 5501 1709 741 7 1 0 screen
  430. May 6 17:43:54 rd2 kernel: [142406.965035] [ 5502] 1000 5502 1871 1115 7 0 0 bash
  431. May 6 17:43:54 rd2 kernel: [142406.970033] [ 5546] 1000 5546 1506 726 6 0 0 su
  432. May 6 17:43:54 rd2 kernel: [142406.975235] [ 5547] 0 5547 1577 1101 6 0 0 bash
  433. May 6 17:43:54 rd2 kernel: [142406.980271] [15382] 0 15382 655 506 5 0 -1000 udevd
  434. May 6 17:43:54 rd2 kernel: [142406.985439] [10153] 1000 10153 1871 1087 6 0 0 bash
  435. May 6 17:43:54 rd2 kernel: [142406.990639] [10198] 1000 10198 1506 695 6 0 0 su
  436. May 6 17:43:54 rd2 kernel: [142406.995600] [10199] 0 10199 1575 1088 6 0 0 bash
  437. May 6 17:43:54 rd2 kernel: [142407.000486] [17115] 0 17115 2334 1203 8 0 0 sshd
  438. May 6 17:43:54 rd2 kernel: [142407.005336] [17121] 1000 17121 2334 834 8 0 0 sshd
  439. May 6 17:43:54 rd2 kernel: [142407.010387] [17122] 1000 17122 2013 1265 7 0 0 bash
  440. May 6 17:43:54 rd2 kernel: [142407.015354] [14457] 0 14457 655 253 5 0 -1000 udevd
  441. May 6 17:43:54 rd2 kernel: [142407.020143] [ 1510] 107 1510 1713 689 6 0 0 dnsmasq
  442. May 6 17:43:54 rd2 kernel: [142407.024954] [ 1615] 0 1615 1602 615 6 0 0 screen
  443. May 6 17:43:54 rd2 kernel: [142407.029890] [ 1619] 0 1619 487 79 4 0 0 sh
  444. May 6 17:43:54 rd2 kernel: [142407.035089] [ 1620] 0 1620 479 385 5 0 0 netcat
  445. May 6 17:43:54 rd2 kernel: [142407.040280] [ 1621] 0 1621 1269 461 6 0 0 tee
  446. May 6 17:43:54 rd2 kernel: [142407.045139] [ 7372] 108 7372 40019 38913 80 639 0 zebra
  447. May 6 17:43:54 rd2 kernel: [142407.049948] [ 7376] 108 7376 73844 73566 146 22 0 bgpd
  448. May 6 17:43:54 rd2 kernel: [142407.054714] [ 7380] 108 7380 1049 736 6 0 0 ospfd
  449. May 6 17:43:54 rd2 kernel: [142407.059746] [ 7385] 0 7385 646 386 4 0 0 watchquagga
  450. May 6 17:43:54 rd2 kernel: [142407.065081] [28870] 1000 28870 1871 1114 6 0 0 bash
  451. May 6 17:43:54 rd2 kernel: [142407.069895] [28915] 1000 28915 1506 694 7 0 0 su
  452. May 6 17:43:54 rd2 kernel: [142407.074679] [28929] 0 28929 1557 1050 7 0 0 bash
  453. May 6 17:43:54 rd2 kernel: [142407.079504] [ 1255] 0 1255 1740 1173 7 0 0 vi
  454. May 6 17:43:54 rd2 kernel: [142407.085034] [14851] 0 14851 2389 1239 7 0 0 sshd
  455. May 6 17:43:54 rd2 kernel: [142407.090687] [14864] 1000 14864 2389 863 7 0 0 sshd
  456. May 6 17:43:54 rd2 kernel: [142407.095515] [14865] 1000 14865 1724 1213 7 0 0 bash
  457. May 6 17:43:54 rd2 kernel: [142407.100655] [14966] 1000 14966 1218 649 6 0 0 su
  458. May 6 17:43:54 rd2 kernel: [142407.105761] [14969] 0 14969 1329 823 6 0 0 bash
  459. May 6 17:43:54 rd2 kernel: [142407.110533] [23948] 0 23948 2334 1219 7 0 0 sshd
  460. May 6 17:43:54 rd2 kernel: [142407.115039] [23951] 1000 23951 2369 910 7 0 0 sshd
  461. May 6 17:43:54 rd2 kernel: [142407.119932] [23952] 1000 23952 2014 1282 7 0 0 bash
  462. May 6 17:43:54 rd2 kernel: [142407.124783] [24054] 1000 24054 1529 663 6 0 0 screen
  463. May 6 17:43:54 rd2 kernel: [142407.129670] [28181] 0 28181 1314 610 6 0 0 screen
  464. May 6 17:43:54 rd2 kernel: [142407.134495] [28182] 0 28182 1335 861 6 0 0 bash
  465. May 6 17:43:54 rd2 kernel: [142407.139102] [28775] 0 28775 529 371 4 0 0 vnstat
  466. May 6 17:43:54 rd2 kernel: [142407.143891] [ 6271] 65534 6271 14193 12214 31 0 0 squid
  467. May 6 17:43:54 rd2 kernel: [142407.148565] [ 6273] 65534 6273 24675 19040 43 57 0 squid
  468. May 6 17:43:54 rd2 kernel: [142407.153346] [ 6274] 65534 6274 855 257 6 0 0 log_file_daemon
  469. May 6 17:43:54 rd2 kernel: [142407.158453] [ 6296] 0 6296 1268 664 5 0 0 top
  470. May 6 17:43:55 rd2 kernel: [142408.000921] zebra invoked oom-killer: gfp_mask=0x20858, order=0, oom_score_adj=0
  471. May 6 17:43:55 rd2 kernel: [142408.004858] zebra cpuset=/ mems_allowed=0
  472. May 6 17:43:55 rd2 kernel: [142408.008858] CPU: 1 PID: 7372 Comm: zebra Not tainted 3.19.5.at.dell1950+ixgbe10g #1
  473. May 6 17:43:55 rd2 kernel: [142408.013072] Hardware name: Dell Inc. PowerEdge 1950/0M788G, BIOS 2.6.1 04/20/2009
  474. May 6 17:43:55 rd2 kernel: [142408.017613] 00000000 c134422f f7036010 c1342f1c c141ff23 f70362f8 00020858 00000000
  475. May 6 17:43:55 rd2 kernel: [142408.022407] 00000000 c1022e06 f714ea90 c1347b99 f714ea90 f714ecf8 c14b9fec c142012e
  476. May 6 17:43:55 rd2 kernel: [142408.027134] f7036010 00000006 00000000 c10b76ef 00000000 005f00d8 00020858 f1c31570
  477. May 6 17:43:55 rd2 kernel: [142408.031782] Call Trace:
  478. May 6 17:43:55 rd2 kernel: [142408.036535] [<c134422f>] ? dump_stack+0x3e/0x4e
  479. May 6 17:43:55 rd2 kernel: [142408.041119] [<c1342f1c>] ? dump_header.isra.9+0x53/0x174
  480. May 6 17:43:55 rd2 kernel: [142408.045603] [<c1022e06>] ? smp_apic_timer_interrupt+0x22/0x2b
  481. May 6 17:43:55 rd2 kernel: [142408.050037] [<c1347b99>] ? apic_timer_interrupt+0x2d/0x34
  482. May 6 17:43:55 rd2 kernel: [142408.054467] [<c10b76ef>] ? oom_kill_process+0x6f/0x29e
  483. May 6 17:43:55 rd2 kernel: [142408.058610] [<c114b98b>] ? security_capable_noaudit+0xc/0xf
  484. May 6 17:43:55 rd2 kernel: [142408.063184] [<c10b7df4>] ? out_of_memory+0x395/0x3c4
  485. May 6 17:43:55 rd2 kernel: [142408.068430] [<c10bb249>] ? __alloc_pages_nodemask+0x5bf/0x6b8
  486. May 6 17:43:55 rd2 kernel: [142408.073436] [<c10e6828>] ? alloc_pages_current+0x86/0xa2
  487. May 6 17:43:55 rd2 kernel: [142408.078466] [<c10b562a>] ? pagecache_get_page+0xae/0x13e
  488. May 6 17:43:55 rd2 kernel: [142408.083717] [<c111500c>] ? __getblk_slow+0x159/0x2a9
  489. May 6 17:43:55 rd2 kernel: [142408.088784] [<c1115189>] ? __getblk_gfp+0x2d/0x59
  490. May 6 17:43:55 rd2 kernel: [142408.094267] [<f842b9e7>] ? __ext4_get_inode_loc+0xcd/0x3a7 [ext4]
  491. May 6 17:43:55 rd2 kernel: [142408.099714] [<f8269830>] ? jbd2__journal_start+0x42/0x13e [jbd2]
  492. May 6 17:43:55 rd2 kernel: [142408.104904] [<f842e5a0>] ? ext4_reserve_inode_write+0x13/0x5b [ext4]
  493. May 6 17:43:55 rd2 kernel: [142408.110069] [<f8430985>] ? ext4_dirty_inode+0x2f/0x45 [ext4]
  494. May 6 17:43:55 rd2 kernel: [142408.115089] [<f842e638>] ? ext4_mark_inode_dirty+0x50/0x1c8 [ext4]
  495. May 6 17:43:55 rd2 kernel: [142408.120367] [<f8430985>] ? ext4_dirty_inode+0x2f/0x45 [ext4]
  496. May 6 17:43:55 rd2 kernel: [142408.125591] [<c110f073>] ? __mark_inode_dirty+0x43/0x1a4
  497. May 6 17:43:55 rd2 kernel: [142408.130963] [<c1104f1f>] ? update_time+0x86/0x8f
  498. May 6 17:43:55 rd2 kernel: [142408.136069] [<c110573f>] ? file_update_time+0x71/0x8a
  499. May 6 17:43:55 rd2 kernel: [142408.141142] [<c10b61aa>] ? __generic_file_write_iter+0xa8/0x1e2
  500. May 6 17:43:55 rd2 kernel: [142408.146669] [<c10faccb>] ? path_cleanup+0x17/0x2d
  501. May 6 17:43:55 rd2 kernel: [142408.152298] [<c10eac5e>] ? __cache_free.isra.48+0x1b3/0x1bb
  502. May 6 17:43:55 rd2 kernel: [142408.157928] [<f84289d6>] ? ext4_file_write_iter+0x379/0x44f [ext4]
  503. May 6 17:43:55 rd2 kernel: [142408.163622] [<c10fed47>] ? user_path_at_empty+0x46/0x64
  504. May 6 17:43:55 rd2 kernel: [142408.169184] [<c11a0407>] ? __copy_to_user_ll+0x1c/0x4e
  505. May 6 17:43:55 rd2 kernel: [142408.175110] [<c10f7c95>] ? cp_new_stat64+0x11d/0x12e
  506. May 6 17:43:55 rd2 kernel: [142408.180846] [<c10f415b>] ? do_sync_readv_writev+0x65/0x65
  507. May 6 17:43:55 rd2 kernel: [142408.187153] [<c10f41af>] ? new_sync_write+0x54/0x7a
  508. May 6 17:43:55 rd2 kernel: [142408.193134] [<c10f4bad>] ? vfs_write+0x83/0x102
  509. May 6 17:43:55 rd2 kernel: [142408.198922] [<c10f4db6>] ? SyS_write+0x3c/0x6a
  510. May 6 17:43:55 rd2 kernel: [142408.204620] [<c1347348>] ? sysenter_do_call+0x12/0x12
  511. May 6 17:43:55 rd2 kernel: [142408.210259] [<c1340000>] ? __next_mem_range_rev+0x176/0x291
  512. May 6 17:43:55 rd2 kernel: [142408.215685] Mem-Info:
  513. May 6 17:43:55 rd2 kernel: [142408.221440] Node 0 DMA per-cpu:
  514. May 6 17:43:55 rd2 kernel: [142408.226908] CPU 0: hi: 0, btch: 1 usd: 0
  515. May 6 17:43:55 rd2 kernel: [142408.232491] CPU 1: hi: 0, btch: 1 usd: 0
  516. May 6 17:43:55 rd2 kernel: [142408.238175] CPU 2: hi: 0, btch: 1 usd: 0
  517. May 6 17:43:55 rd2 kernel: [142408.243598] CPU 3: hi: 0, btch: 1 usd: 0
  518. May 6 17:43:55 rd2 kernel: [142408.248392] Node 0 Normal per-cpu:
  519. May 6 17:43:55 rd2 kernel: [142408.253405] CPU 0: hi: 186, btch: 31 usd: 0
  520. May 6 17:43:55 rd2 kernel: [142408.258292] CPU 1: hi: 186, btch: 31 usd: 0
  521. May 6 17:43:55 rd2 kernel: [142408.263453] CPU 2: hi: 186, btch: 31 usd: 0
  522. May 6 17:43:55 rd2 kernel: [142408.268426] CPU 3: hi: 186, btch: 31 usd: 0
  523. May 6 17:43:55 rd2 kernel: [142408.273281] Node 0 HighMem per-cpu:
  524. May 6 17:43:55 rd2 kernel: [142408.277693] CPU 0: hi: 186, btch: 31 usd: 0
  525. May 6 17:43:55 rd2 kernel: [142408.282101] CPU 1: hi: 186, btch: 31 usd: 0
  526. May 6 17:43:55 rd2 kernel: [142408.286082] CPU 2: hi: 186, btch: 31 usd: 0
  527. May 6 17:43:55 rd2 kernel: [142408.290104] CPU 3: hi: 186, btch: 31 usd: 0
  528. May 6 17:43:55 rd2 kernel: [142408.294302] active_anon:77966 inactive_anon:21427 isolated_anon:0
  529. May 6 17:43:55 rd2 kernel: [142408.294302] active_file:8566 inactive_file:3000 isolated_file:0
  530. May 6 17:43:55 rd2 kernel: [142408.294302] unevictable:0 dirty:0 writeback:0 unstable:0
  531. May 6 17:43:55 rd2 kernel: [142408.294302] free:1778351 slab_reclaimable:2088 slab_unreclaimable:68466
  532. May 6 17:43:55 rd2 kernel: [142408.294302] mapped:7129 shmem:3795 pagetables:725 bounce:0
  533. May 6 17:43:55 rd2 kernel: [142408.294302] free_cma:0
  534. May 6 17:43:55 rd2 kernel: [142408.317481] Node 0 DMA free:5560kB min:2496kB low:3120kB high:3744kB active_anon:0kB inactive_anon:0kB active_file:92kB inactive_file:16kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15996kB managed:15912kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:88kB slab_unreclaimable:4820kB kernel_stack:8kB pagetables:0kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:812 all_unreclaimable? yes
  535. May 6 17:43:55 rd2 kernel: [142408.335996] lowmem_reserve[]: 0 798 8096 8096
  536. May 6 17:43:55 rd2 kernel: [142408.342629] Node 0 Normal free:97340kB min:128572kB low:160712kB high:192856kB active_anon:0kB inactive_anon:0kB active_file:268kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:894968kB managed:818540kB mlocked:0kB dirty:0kB writeback:0kB mapped:4kB shmem:0kB slab_reclaimable:8264kB slab_unreclaimable:269044kB kernel_stack:1688kB pagetables:16kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
  537. May 6 17:43:55 rd2 kernel: [142408.362616] lowmem_reserve[]: 0 0 58378 58378
  538. May 6 17:43:55 rd2 kernel: [142408.368804] Node 0 HighMem free:7010468kB min:512kB low:293944kB high:587380kB active_anon:311864kB inactive_anon:85708kB active_file:33904kB inactive_file:12024kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:7472456kB managed:7472456kB mlocked:4kB dirty:0kB writeback:0kB mapped:28512kB shmem:15180kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:2884kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
  539. May 6 17:43:55 rd2 kernel: [142408.391550] lowmem_reserve[]: 0 0 0 0
  540. May 6 17:43:55 rd2 kernel: [142408.398360] Node 0 DMA: 45*4kB (UR) 4*8kB (U) 2*16kB (UR) 0*32kB 0*64kB 0*128kB 3*256kB (R) 1*512kB (R) 0*1024kB 0*2048kB 1*4096kB (R) = 5620kB
  541. May 6 17:43:55 rd2 kernel: [142408.412711] Node 0 Normal: 994*4kB (UEM) 649*8kB (UEM) 323*16kB (UEM) 271*32kB (UEM) 106*64kB (UEM) 47*128kB (UEM) 73*256kB (UEM) 39*512kB (UEM) 10*1024kB (EM) 4*2048kB (MR) 1*4096kB (R) = 96992kB
  542. May 6 17:43:55 rd2 kernel: [142408.428776] Node 0 HighMem: 3003*4kB (UM) 1073*8kB (UM) 809*16kB (UM) 1873*32kB (UM) 1646*64kB (UM) 856*128kB (M) 414*256kB (UM) 163*512kB (M) 74*1024kB (M) 35*2048kB (MR) 1554*4096kB (UM) = 7010468kB
  543. May 6 17:43:55 rd2 kernel: [142408.446519] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
  544. May 6 17:43:55 rd2 kernel: [142408.454080] 15407 total pagecache pages
  545. May 6 17:43:55 rd2 kernel: [142408.461648] 36 pages in swap cache
  546. May 6 17:43:55 rd2 kernel: [142408.469229] Swap cache stats: add 5893, delete 5857, find 2330/3709
  547. May 6 17:43:55 rd2 kernel: [142408.476962] Free swap = 16759808kB
  548. May 6 17:43:55 rd2 kernel: [142408.484808] Total swap = 16764924kB
  549. May 6 17:43:56 rd2 kernel: [142408.492943] 2095855 pages RAM
  550. May 6 17:43:56 rd2 kernel: [142408.501158] 1868114 pages HighMem/MovableOnly
  551. May 6 17:43:56 rd2 kernel: [142408.509381] 19128 pages reserved
  552. May 6 17:43:56 rd2 kernel: [142408.517771] [ pid ] uid tgid total_vm rss nr_ptes swapents oom_score_adj name
  553. May 6 17:43:56 rd2 kernel: [142408.526043] [ 462] 0 462 656 548 5 0 -1000 udevd
  554. May 6 17:43:56 rd2 kernel: [142408.534334] [ 2121] 0 2121 598 478 5 0 0 rpcbind
  555. May 6 17:43:56 rd2 kernel: [142408.542525] [ 2152] 102 2152 666 580 5 0 0 rpc.statd
  556. May 6 17:43:56 rd2 kernel: [142408.551138] [ 2166] 0 2166 648 44 6 0 0 rpc.idmapd
  557. May 6 17:43:56 rd2 kernel: [142408.559920] [ 2364] 0 2364 537 26 5 0 0 netserver
  558. May 6 17:43:56 rd2 kernel: [142408.568908] [ 2528] 0 2528 516 366 5 0 0 vnstatd
  559. May 6 17:43:56 rd2 kernel: [142408.577293] [ 2550] 0 2550 7311 636 7 140 0 rsyslogd
  560. May 6 17:43:56 rd2 kernel: [142408.585729] [ 2553] 0 2553 9514 3068 12 12 0 glusterd
  561. May 6 17:43:56 rd2 kernel: [142408.594356] [ 2631] 0 2631 542 31 4 0 0 atd
  562. May 6 17:43:56 rd2 kernel: [142408.602934] [ 2700] 0 2700 473 355 5 0 0 acpid
  563. May 6 17:43:56 rd2 kernel: [142408.611766] [ 2734] 0 2734 1100 516 6 0 0 cron
  564. May 6 17:43:56 rd2 kernel: [142408.620692] [ 2752] 105 2752 758 55 5 0 0 dbus-daemon
  565. May 6 17:43:56 rd2 kernel: [142408.629400] [ 2777] 0 2777 1423 684 6 0 0 ha_logd
  566. May 6 17:43:56 rd2 kernel: [142408.638166] [ 2781] 109 2781 1838 563 7 2 0 zabbix_agentd
  567. May 6 17:43:56 rd2 kernel: [142408.646872] [ 2782] 109 2782 1838 631 7 2 0 zabbix_agentd
  568. May 6 17:43:56 rd2 kernel: [142408.655727] [ 2783] 109 2783 1838 648 7 2 0 zabbix_agentd
  569. May 6 17:43:56 rd2 kernel: [142408.664251] [ 2784] 109 2784 1838 648 7 2 0 zabbix_agentd
  570. May 6 17:43:56 rd2 kernel: [142408.672545] [ 2785] 109 2785 1838 643 7 2 0 zabbix_agentd
  571. May 6 17:43:56 rd2 kernel: [142408.680613] [ 2786] 109 2786 1838 621 7 2 0 zabbix_agentd
  572. May 6 17:43:56 rd2 kernel: [142408.688502] [ 2787] 109 2787 1838 621 7 2 0 zabbix_agentd
  573. May 6 17:43:56 rd2 kernel: [142408.696073] [ 2788] 109 2788 2005 811 7 2 0 zabbix_agentd
  574. May 6 17:43:56 rd2 kernel: [142408.703757] [ 2789] 0 2789 1423 615 6 0 0 ha_logd
  575. May 6 17:43:56 rd2 kernel: [142408.711264] [ 2792] 0 2792 16281 1651 23 0 0 corosync
  576. May 6 17:43:56 rd2 kernel: [142408.718711] [ 2859] 106 2859 3306 1751 9 0 0 cib
  577. May 6 17:43:56 rd2 kernel: [142408.725968] [ 2860] 0 2860 3042 1075 10 0 0 stonithd
  578. May 6 17:43:56 rd2 kernel: [142408.732732] [ 2861] 0 2861 2599 1303 9 0 0 lrmd
  579. May 6 17:43:56 rd2 kernel: [142408.739518] [ 2862] 106 2862 3101 1044 10 0 0 attrd
  580. May 6 17:43:56 rd2 kernel: [142408.746224] [ 2863] 106 2863 2222 1373 8 0 0 pengine
  581. May 6 17:43:56 rd2 kernel: [142408.752871] [ 2864] 106 2864 3122 1450 10 0 0 crmd
  582. May 6 17:43:56 rd2 kernel: [142408.759403] [ 2878] 0 2878 1620 747 6 0 -1000 sshd
  583. May 6 17:43:56 rd2 kernel: [142408.765866] [ 3038] 0 3038 14525 6923 21 65 0 glusterfs
  584. May 6 17:43:56 rd2 kernel: [142408.772162] [ 3072] 0 3072 14016 3986 21 32 0 glusterfsd
  585. May 6 17:43:56 rd2 kernel: [142408.777754] [ 3076] 0 3076 13502 6769 19 0 0 glusterfs
  586. May 6 17:43:56 rd2 kernel: [142408.783439] [ 3139] 0 3139 641 359 5 0 0 flow-capture
  587. May 6 17:43:56 rd2 kernel: [142408.789244] [ 3140] 0 3140 9108 411 9 0 0 iperf
  588. May 6 17:43:56 rd2 kernel: [142408.794712] [ 5407] 0 5407 470 329 4 0 0 startpar
  589. May 6 17:43:56 rd2 kernel: [142408.799933] [ 5408] 0 5408 1086 421 6 0 0 getty
  590. May 6 17:43:56 rd2 kernel: [142408.805065] [ 5409] 0 5409 1086 468 6 0 0 getty
  591. May 6 17:43:56 rd2 kernel: [142408.809794] [ 5410] 0 5410 1086 464 6 0 0 getty
  592. May 6 17:43:56 rd2 kernel: [142408.814814] [ 5411] 0 5411 1086 440 6 0 0 getty
  593. May 6 17:43:56 rd2 kernel: [142408.819316] [ 5412] 0 5412 1086 463 6 0 0 getty
  594. May 6 17:43:56 rd2 kernel: [142408.824001] [ 5413] 0 5413 1086 463 5 0 0 getty
  595. May 6 17:43:56 rd2 kernel: [142408.829017] [ 5501] 1000 5501 1709 741 7 1 0 screen
  596. May 6 17:43:56 rd2 kernel: [142408.833368] [ 5502] 1000 5502 1871 1115 7 0 0 bash
  597. May 6 17:43:56 rd2 kernel: [142408.837512] [ 5546] 1000 5546 1506 726 6 0 0 su
  598. May 6 17:43:56 rd2 kernel: [142408.841952] [ 5547] 0 5547 1577 1101 6 0 0 bash
  599. May 6 17:43:56 rd2 kernel: [142408.846210] [15382] 0 15382 655 506 5 0 -1000 udevd
  600. May 6 17:43:56 rd2 kernel: [142408.850495] [10153] 1000 10153 1871 1087 6 0 0 bash
  601. May 6 17:43:56 rd2 kernel: [142408.854776] [10198] 1000 10198 1506 695 6 0 0 su
  602. May 6 17:43:56 rd2 kernel: [142408.859046] [10199] 0 10199 1575 1088 6 0 0 bash
  603. May 6 17:43:56 rd2 kernel: [142408.863385] [17115] 0 17115 2334 1203 8 0 0 sshd
  604. May 6 17:43:56 rd2 kernel: [142408.867561] [17121] 1000 17121 2334 834 8 0 0 sshd
  605. May 6 17:43:56 rd2 kernel: [142408.871791] [17122] 1000 17122 2013 1265 7 0 0 bash
  606. May 6 17:43:56 rd2 kernel: [142408.876222] [14457] 0 14457 655 253 5 0 -1000 udevd
  607. May 6 17:43:56 rd2 kernel: [142408.880704] [ 1510] 107 1510 1713 689 6 0 0 dnsmasq
  608. May 6 17:43:56 rd2 kernel: [142408.885175] [ 1615] 0 1615 1602 615 6 0 0 screen
  609. May 6 17:43:56 rd2 kernel: [142408.889709] [ 1619] 0 1619 487 79 4 0 0 sh
  610. May 6 17:43:56 rd2 kernel: [142408.894009] [ 1620] 0 1620 479 385 5 0 0 netcat
  611. May 6 17:43:56 rd2 kernel: [142408.897967] [ 1621] 0 1621 1269 461 6 0 0 tee
  612. May 6 17:43:56 rd2 kernel: [142408.902185] [ 7372] 108 7372 40019 39544 80 8 0 zebra
  613. May 6 17:43:56 rd2 kernel: [142408.906435] [ 7380] 108 7380 1049 736 6 0 0 ospfd
  614. May 6 17:43:56 rd2 kernel: [142408.910795] [ 7385] 0 7385 646 386 4 0 0 watchquagga
  615. May 6 17:43:56 rd2 kernel: [142408.915114] [28870] 1000 28870 1871 1114 6 0 0 bash
  616. May 6 17:43:56 rd2 kernel: [142408.919518] [28915] 1000 28915 1506 694 7 0 0 su
  617. May 6 17:43:56 rd2 kernel: [142408.923882] [28929] 0 28929 1557 1050 7 0 0 bash
  618. May 6 17:43:56 rd2 kernel: [142408.928413] [ 1255] 0 1255 1740 1173 7 0 0 vi
  619. May 6 17:43:56 rd2 kernel: [142408.932757] [14851] 0 14851 2389 1239 7 0 0 sshd
  620. May 6 17:43:56 rd2 kernel: [142408.937330] [14864] 1000 14864 2389 863 7 0 0 sshd
  621. May 6 17:43:56 rd2 kernel: [142408.941956] [14865] 1000 14865 1724 1213 7 0 0 bash
  622. May 6 17:43:56 rd2 kernel: [142408.946581] [14966] 1000 14966 1218 649 6 0 0 su
  623. May 6 17:43:56 rd2 kernel: [142408.951062] [14969] 0 14969 1329 823 6 0 0 bash
  624. May 6 17:43:56 rd2 kernel: [142408.955530] [23948] 0 23948 2334 1219 7 0 0 sshd
  625. May 6 17:43:56 rd2 kernel: [142408.959801] [23951] 1000 23951 2369 910 7 0 0 sshd
  626. May 6 17:43:56 rd2 kernel: [142408.964061] [23952] 1000 23952 2014 1282 7 0 0 bash
  627. May 6 17:43:56 rd2 kernel: [142408.968459] [24054] 1000 24054 1529 663 6 0 0 screen
  628. May 6 17:43:56 rd2 kernel: [142408.972869] [28181] 0 28181 1314 610 6 0 0 screen
  629. May 6 17:43:56 rd2 kernel: [142408.977328] [28182] 0 28182 1335 861 6 0 0 bash
  630. May 6 17:43:56 rd2 kernel: [142408.981564] [28775] 0 28775 529 371 4 0 0 vnstat
  631. May 6 17:43:56 rd2 kernel: [142408.985830] [ 6271] 65534 6271 14193 12214 31 0 0 squid
  632. May 6 17:43:56 rd2 kernel: [142408.989991] [ 6273] 65534 6273 24703 19050 44 54 0 squid
  633. May 6 17:43:56 rd2 kernel: [142408.994665] [ 6274] 65534 6274 855 257 6 0 0 log_file_daemon
  634. May 6 17:43:56 rd2 kernel: [142408.999623] [ 6296] 0 6296 1268 664 5 0 0 top
  635. May 6 17:44:04 rd2 kernel: [142415.999277] zabbix_agentd invoked oom-killer: gfp_mask=0x2040d0, order=0, oom_score_adj=0
  636. May 6 17:44:04 rd2 kernel: [142416.002846] zabbix_agentd cpuset=/ mems_allowed=0
  637. May 6 17:44:04 rd2 kernel: [142416.006440] CPU: 3 PID: 2782 Comm: zabbix_agentd Not tainted 3.19.5.at.dell1950+ixgbe10g #1
  638. May 6 17:44:04 rd2 kernel: [142416.010204] Hardware name: Dell Inc. PowerEdge 1950/0M788G, BIOS 2.6.1 04/20/2009
  639. May 6 17:44:04 rd2 kernel: [142416.014214] 00000000 c134422f f7380a50 c1342f1c c141ff23 f7380d38 002040d0 00000000
  640. May 6 17:44:04 rd2 kernel: [142416.018310] 00000000 f183fe10 00000000 c119a9ca 00000046 00000046 c14b9fec c142012e
  641. May 6 17:44:04 rd2 kernel: [142416.022440] f27cd010 00000003 00000000 c10b76ef 00000000 005fa436 002040d0 f1c31570
  642. May 6 17:44:04 rd2 kernel: [142416.026735] Call Trace:
  643. May 6 17:44:04 rd2 kernel: [142416.030898] [<c134422f>] ? dump_stack+0x3e/0x4e
  644. May 6 17:44:04 rd2 kernel: [142416.035068] [<c1342f1c>] ? dump_header.isra.9+0x53/0x174
  645. May 6 17:44:04 rd2 kernel: [142416.039235] [<c119a9ca>] ? radix_tree_lookup+0x9/0xb
  646. May 6 17:44:04 rd2 kernel: [142416.043376] [<c10b76ef>] ? oom_kill_process+0x6f/0x29e
  647. May 6 17:44:04 rd2 kernel: [142416.047545] [<c114b98b>] ? security_capable_noaudit+0xc/0xf
  648. May 6 17:44:04 rd2 kernel: [142416.051808] [<c10b7df4>] ? out_of_memory+0x395/0x3c4
  649. May 6 17:44:04 rd2 kernel: [142416.055979] [<c10bb249>] ? __alloc_pages_nodemask+0x5bf/0x6b8
  650. May 6 17:44:04 rd2 kernel: [142416.060285] [<c10eb2ad>] ? kmem_getpages+0x43/0x9c
  651. May 6 17:44:04 rd2 kernel: [142416.064515] [<c10eb999>] ? fallback_alloc+0x115/0x18d
  652. May 6 17:44:04 rd2 kernel: [142416.068713] [<c10ec4e1>] ? kmem_cache_alloc+0x6a/0xd6
  653. May 6 17:44:04 rd2 kernel: [142416.072857] [<c10fe3d4>] ? getname_flags+0x24/0x107
  654. May 6 17:44:04 rd2 kernel: [142416.077002] [<c10f3e04>] ? do_sys_open+0x2e/0xce
  655. May 6 17:44:04 rd2 kernel: [142416.081189] [<c10f3ebc>] ? SyS_open+0x18/0x1a
  656. May 6 17:44:04 rd2 kernel: [142416.085352] [<c1347348>] ? sysenter_do_call+0x12/0x12
  657. May 6 17:44:04 rd2 kernel: [142416.089690] Mem-Info:
  658. May 6 17:44:04 rd2 kernel: [142416.094104] Node 0 DMA per-cpu:
  659. May 6 17:44:04 rd2 kernel: [142416.098261] CPU 0: hi: 0, btch: 1 usd: 0
  660. May 6 17:44:04 rd2 kernel: [142416.102419] CPU 1: hi: 0, btch: 1 usd: 0
  661. May 6 17:44:04 rd2 kernel: [142416.106491] CPU 2: hi: 0, btch: 1 usd: 0
  662. May 6 17:44:04 rd2 kernel: [142416.110630] CPU 3: hi: 0, btch: 1 usd: 0
  663. May 6 17:44:04 rd2 kernel: [142416.114618] Node 0 Normal per-cpu:
  664. May 6 17:44:04 rd2 kernel: [142416.118602] CPU 0: hi: 186, btch: 31 usd: 0
  665. May 6 17:44:04 rd2 kernel: [142416.122778] CPU 1: hi: 186, btch: 31 usd: 0
  666. May 6 17:44:04 rd2 kernel: [142416.126768] CPU 2: hi: 186, btch: 31 usd: 0
  667. May 6 17:44:04 rd2 kernel: [142416.130690] CPU 3: hi: 186, btch: 31 usd: 0
  668. May 6 17:44:04 rd2 kernel: [142416.134556] Node 0 HighMem per-cpu:
  669. May 6 17:44:04 rd2 kernel: [142416.138467] CPU 0: hi: 186, btch: 31 usd: 0
  670. May 6 17:44:04 rd2 kernel: [142416.142562] CPU 1: hi: 186, btch: 31 usd: 0
  671. May 6 17:44:04 rd2 kernel: [142416.146592] CPU 2: hi: 186, btch: 31 usd: 0
  672. May 6 17:44:04 rd2 kernel: [142416.150587] CPU 3: hi: 186, btch: 31 usd: 0
  673. May 6 17:44:04 rd2 kernel: [142416.154500] active_anon:39591 inactive_anon:20719 isolated_anon:0
  674. May 6 17:44:04 rd2 kernel: [142416.154500] active_file:8524 inactive_file:3003 isolated_file:0
  675. May 6 17:44:04 rd2 kernel: [142416.154500] unevictable:0 dirty:3 writeback:0 unstable:0
  676. May 6 17:44:04 rd2 kernel: [142416.154500] free:1814327 slab_reclaimable:2077 slab_unreclaimable:66689
  677. May 6 17:44:04 rd2 kernel: [142416.154500] mapped:7081 shmem:3795 pagetables:645 bounce:0
  678. May 6 17:44:04 rd2 kernel: [142416.154500] free_cma:0
  679. May 6 17:44:04 rd2 kernel: [142416.177966] Node 0 DMA free:5652kB min:2496kB low:3120kB high:3744kB active_anon:0kB inactive_anon:0kB active_file:112kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15996kB managed:15912kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:88kB slab_unreclaimable:4828kB kernel_stack:8kB pagetables:0kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
  680. May 6 17:44:04 rd2 kernel: [142416.194944] lowmem_reserve[]: 0 798 8096 8096
  681. May 6 17:44:04 rd2 kernel: [142416.199196] Node 0 Normal free:84492kB min:128572kB low:160712kB high:192856kB active_anon:0kB inactive_anon:0kB active_file:172kB inactive_file:4kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:894968kB managed:818540kB mlocked:0kB dirty:8kB writeback:0kB mapped:4kB shmem:0kB slab_reclaimable:8220kB slab_unreclaimable:261928kB kernel_stack:1680kB pagetables:12kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:48 all_unreclaimable? no
  682. May 6 17:44:04 rd2 kernel: [142416.217060] lowmem_reserve[]: 0 0 58378 58378
  683. May 6 17:44:04 rd2 kernel: [142416.221737] Node 0 HighMem free:7167228kB min:512kB low:293944kB high:587380kB active_anon:158364kB inactive_anon:82876kB active_file:33812kB inactive_file:12008kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:7472456kB managed:7472456kB mlocked:4kB dirty:4kB writeback:0kB mapped:28320kB shmem:15180kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:2568kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
  684. May 6 17:44:04 rd2 kernel: [142416.241061] lowmem_reserve[]: 0 0 0 0
  685. May 6 17:44:04 rd2 kernel: [142416.246308] Node 0 DMA: 33*4kB (UR) 10*8kB (UR) 3*16kB (R) 1*32kB (R) 0*64kB 0*128kB 3*256kB (R) 1*512kB (R) 0*1024kB 0*2048kB 1*4096kB (R) = 5668kB
  686. May 6 17:44:04 rd2 kernel: [142416.257439] Node 0 Normal: 2156*4kB (UEM) 621*8kB (UEM) 247*16kB (UEM) 223*32kB (UEM) 109*64kB (UEM) 48*128kB (UEM) 29*256kB (UEM) 27*512kB (UEM) 7*1024kB (EM) 5*2048kB (MR) 2*4096kB (MR) = 84648kB
  687. May 6 17:44:04 rd2 kernel: [142416.269764] Node 0 HighMem: 3133*4kB (UM) 535*8kB (UM) 201*16kB (UM) 1246*32kB (UM) 1026*64kB (UM) 591*128kB (M) 353*256kB (UM) 169*512kB (M) 88*1024kB (M) 55*2048kB (MR) 1608*4096kB (UM) = 7167228kB
  688. May 6 17:44:04 rd2 kernel: [142416.282433] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
  689. May 6 17:44:04 rd2 kernel: [142416.288735] 15362 total pagecache pages
  690. May 6 17:44:04 rd2 kernel: [142416.295311] 40 pages in swap cache
  691. May 6 17:44:04 rd2 kernel: [142416.301647] Swap cache stats: add 5903, delete 5863, find 2336/3717
  692. May 6 17:44:04 rd2 kernel: [142416.308271] Free swap = 16759832kB
  693. May 6 17:44:04 rd2 kernel: [142416.315095] Total swap = 16764924kB
  694. May 6 17:44:04 rd2 kernel: [142416.322018] 2095855 pages RAM
  695. May 6 17:44:04 rd2 kernel: [142416.328669] 1868114 pages HighMem/MovableOnly
  696. May 6 17:44:04 rd2 kernel: [142416.335327] 19128 pages reserved
  697. May 6 17:44:04 rd2 kernel: [142416.341906] [ pid ] uid tgid total_vm rss nr_ptes swapents oom_score_adj name
  698. May 6 17:44:04 rd2 kernel: [142416.348727] [ 462] 0 462 656 548 5 0 -1000 udevd
  699. May 6 17:44:04 rd2 kernel: [142416.355632] [ 2121] 0 2121 598 478 5 0 0 rpcbind
  700. May 6 17:44:04 rd2 kernel: [142416.362457] [ 2152] 102 2152 666 580 5 0 0 rpc.statd
  701. May 6 17:44:04 rd2 kernel: [142416.369381] [ 2166] 0 2166 648 44 6 0 0 rpc.idmapd
  702. May 6 17:44:04 rd2 kernel: [142416.376293] [ 2364] 0 2364 537 26 5 0 0 netserver
  703. May 6 17:44:04 rd2 kernel: [142416.383243] [ 2528] 0 2528 516 366 5 0 0 vnstatd
  704. May 6 17:44:04 rd2 kernel: [142416.390449] [ 2550] 0 2550 7311 636 7 140 0 rsyslogd
  705. May 6 17:44:04 rd2 kernel: [142416.397407] [ 2553] 0 2553 9514 3068 12 12 0 glusterd
  706. May 6 17:44:04 rd2 kernel: [142416.404698] [ 2631] 0 2631 542 31 4 0 0 atd
  707. May 6 17:44:04 rd2 kernel: [142416.412031] [ 2700] 0 2700 473 355 5 0 0 acpid
  708. May 6 17:44:04 rd2 kernel: [142416.419267] [ 2734] 0 2734 1100 516 6 0 0 cron
  709. May 6 17:44:04 rd2 kernel: [142416.426375] [ 2752] 105 2752 758 55 5 0 0 dbus-daemon
  710. May 6 17:44:04 rd2 kernel: [142416.433524] [ 2777] 0 2777 1423 684 6 0 0 ha_logd
  711. May 6 17:44:04 rd2 kernel: [142416.440615] [ 2781] 109 2781 1838 563 7 2 0 zabbix_agentd
  712. May 6 17:44:04 rd2 kernel: [142416.447791] [ 2782] 109 2782 1838 631 7 2 0 zabbix_agentd
  713. May 6 17:44:04 rd2 kernel: [142416.454812] [ 2783] 109 2783 1838 648 7 2 0 zabbix_agentd
  714. May 6 17:44:04 rd2 kernel: [142416.461765] [ 2784] 109 2784 1838 648 7 2 0 zabbix_agentd
  715. May 6 17:44:04 rd2 kernel: [142416.468549] [ 2785] 109 2785 1838 643 7 2 0 zabbix_agentd
  716. May 6 17:44:04 rd2 kernel: [142416.475362] [ 2786] 109 2786 1838 621 7 2 0 zabbix_agentd
  717. May 6 17:44:04 rd2 kernel: [142416.481759] [ 2787] 109 2787 1838 621 7 2 0 zabbix_agentd
  718. May 6 17:44:04 rd2 kernel: [142416.487921] [ 2788] 109 2788 2005 811 7 2 0 zabbix_agentd
  719. May 6 17:44:04 rd2 kernel: [142416.493987] [ 2789] 0 2789 1423 615 6 0 0 ha_logd
  720. May 6 17:44:04 rd2 kernel: [142416.500053] [ 2792] 0 2792 16281 1651 23 0 0 corosync
  721. May 6 17:44:04 rd2 kernel: [142416.505941] [ 2859] 106 2859 3306 1751 9 0 0 cib
  722. May 6 17:44:04 rd2 kernel: [142416.511937] [ 2860] 0 2860 3042 1075 10 0 0 stonithd
  723. May 6 17:44:04 rd2 kernel: [142416.517832] [ 2861] 0 2861 2599 1303 9 0 0 lrmd
  724. May 6 17:44:04 rd2 kernel: [142416.523517] [ 2862] 106 2862 3101 1044 10 0 0 attrd
  725. May 6 17:44:04 rd2 kernel: [142416.528898] [ 2863] 106 2863 2222 1373 8 0 0 pengine
  726. May 6 17:44:04 rd2 kernel: [142416.534286] [ 2864] 106 2864 3122 1450 10 0 0 crmd
  727. May 6 17:44:04 rd2 kernel: [142416.539483] [ 2878] 0 2878 1620 747 6 0 -1000 sshd
  728. May 6 17:44:04 rd2 kernel: [142416.544761] [ 3038] 0 3038 14525 6923 21 65 0 glusterfs
  729. May 6 17:44:04 rd2 kernel: [142416.549894] [ 3072] 0 3072 14016 3986 21 32 0 glusterfsd
  730. May 6 17:44:04 rd2 kernel: [142416.554736] [ 3076] 0 3076 13502 6769 19 0 0 glusterfs
  731. May 6 17:44:04 rd2 kernel: [142416.559252] [ 3139] 0 3139 641 359 5 0 0 flow-capture
  732. May 6 17:44:04 rd2 kernel: [142416.563623] [ 3140] 0 3140 9108 411 9 0 0 iperf
  733. May 6 17:44:04 rd2 kernel: [142416.567736] [ 5407] 0 5407 470 329 4 0 0 startpar
  734. May 6 17:44:04 rd2 kernel: [142416.571766] [ 5408] 0 5408 1086 421 6 0 0 getty
  735. May 6 17:44:04 rd2 kernel: [142416.575607] [ 5409] 0 5409 1086 468 6 0 0 getty
  736. May 6 17:44:04 rd2 kernel: [142416.579398] [ 5410] 0 5410 1086 464 6 0 0 getty
  737. May 6 17:44:04 rd2 kernel: [142416.583047] [ 5411] 0 5411 1086 440 6 0 0 getty
  738. May 6 17:44:04 rd2 kernel: [142416.586601] [ 5412] 0 5412 1086 463 6 0 0 getty
  739. May 6 17:44:04 rd2 kernel: [142416.590072] [ 5413] 0 5413 1086 463 5 0 0 getty
  740. May 6 17:44:04 rd2 kernel: [142416.593365] [ 5501] 1000 5501 1709 741 7 1 0 screen
  741. May 6 17:44:04 rd2 kernel: [142416.596749] [ 5502] 1000 5502 1871 1115 7 0 0 bash
  742. May 6 17:44:04 rd2 kernel: [142416.600061] [ 5546] 1000 5546 1506 726 6 0 0 su
  743. May 6 17:44:04 rd2 kernel: [142416.603467] [ 5547] 0 5547 1577 1101 6 0 0 bash
  744. May 6 17:44:04 rd2 kernel: [142416.606776] [15382] 0 15382 655 506 5 0 -1000 udevd
  745. May 6 17:44:04 rd2 kernel: [142416.610093] [10153] 1000 10153 1871 1087 6 0 0 bash
  746. May 6 17:44:04 rd2 kernel: [142416.613338] [10198] 1000 10198 1506 695 6 0 0 su
  747. May 6 17:44:04 rd2 kernel: [142416.616594] [10199] 0 10199 1575 1088 6 0 0 bash
  748. May 6 17:44:04 rd2 kernel: [142416.619794] [17115] 0 17115 2334 1203 8 0 0 sshd
  749. May 6 17:44:04 rd2 kernel: [142416.623038] [17121] 1000 17121 2334 834 8 0 0 sshd
  750. May 6 17:44:04 rd2 kernel: [142416.626072] [17122] 1000 17122 2013 1265 7 0 0 bash
  751. May 6 17:44:04 rd2 kernel: [142416.629144] [14457] 0 14457 655 253 5 0 -1000 udevd
  752. May 6 17:44:04 rd2 kernel: [142416.632210] [ 1510] 107 1510 1713 689 6 0 0 dnsmasq
  753. May 6 17:44:04 rd2 kernel: [142416.635597] [ 1615] 0 1615 1602 615 6 0 0 screen
  754. May 6 17:44:04 rd2 kernel: [142416.638760] [ 1619] 0 1619 487 79 4 0 0 sh
  755. May 6 17:44:04 rd2 kernel: [142416.641870] [ 1620] 0 1620 479 385 5 0 0 netcat
  756. May 6 17:44:04 rd2 kernel: [142416.645000] [ 1621] 0 1621 1269 461 6 0 0 tee
  757. May 6 17:44:04 rd2 kernel: [142416.648009] [ 7380] 108 7380 1049 736 6 0 0 ospfd
  758. May 6 17:44:04 rd2 kernel: [142416.651027] [ 7385] 0 7385 646 386 4 0 0 watchquagga
  759. May 6 17:44:04 rd2 kernel: [142416.654147] [28870] 1000 28870 1871 1114 6 0 0 bash
  760. May 6 17:44:04 rd2 kernel: [142416.657288] [28915] 1000 28915 1506 694 7 0 0 su
  761. May 6 17:44:04 rd2 kernel: [142416.660405] [28929] 0 28929 1557 1050 7 0 0 bash
  762. May 6 17:44:04 rd2 kernel: [142416.663596] [ 1255] 0 1255 1740 1173 7 0 0 vi
  763. May 6 17:44:04 rd2 kernel: [142416.666804] [14851] 0 14851 2389 1239 7 0 0 sshd
  764. May 6 17:44:04 rd2 kernel: [142416.670021] [14864] 1000 14864 2389 863 7 0 0 sshd
  765. May 6 17:44:04 rd2 kernel: [142416.673274] [14865] 1000 14865 1724 1213 7 0 0 bash
  766. May 6 17:44:04 rd2 kernel: [142416.676655] [14966] 1000 14966 1218 649 6 0 0 su
  767. May 6 17:44:04 rd2 kernel: [142416.679917] [14969] 0 14969 1329 823 6 0 0 bash
  768. May 6 17:44:04 rd2 kernel: [142416.683172] [23948] 0 23948 2334 1219 7 0 0 sshd
  769. May 6 17:44:04 rd2 kernel: [142416.686378] [23951] 1000 23951 2369 910 7 0 0 sshd
  770. May 6 17:44:04 rd2 kernel: [142416.689600] [23952] 1000 23952 2014 1282 7 0 0 bash
  771. May 6 17:44:04 rd2 kernel: [142416.692767] [24054] 1000 24054 1529 663 6 0 0 screen
  772. May 6 17:44:04 rd2 kernel: [142416.695984] [28181] 0 28181 1314 610 6 0 0 screen
  773. May 6 17:44:04 rd2 kernel: [142416.699170] [28182] 0 28182 1335 861 6 0 0 bash
  774. May 6 17:44:04 rd2 kernel: [142416.702585] [28775] 0 28775 529 371 4 0 0 vnstat
  775. May 6 17:44:04 rd2 kernel: [142416.705862] [ 6271] 65534 6271 14193 12214 31 0 0 squid
  776. May 6 17:44:04 rd2 kernel: [142416.709037] [ 6273] 65534 6273 24739 19050 44 54 0 squid
  777. May 6 17:44:04 rd2 kernel: [142416.712242] [ 6274] 65534 6274 855 257 6 0 0 log_file_daemon
  778. May 6 17:44:04 rd2 kernel: [142416.715465] [ 6296] 0 6296 1268 664 5 0 0 top
  779. May 6 17:44:05 rd2 kernel: [142417.993333] watchquagga invoked oom-killer: gfp_mask=0x20858, order=0, oom_score_adj=0
  780. May 6 17:44:05 rd2 kernel: [142417.996966] watchquagga cpuset=/ mems_allowed=0
  781. May 6 17:44:05 rd2 kernel: [142418.000860] CPU: 2 PID: 7385 Comm: watchquagga Not tainted 3.19.5.at.dell1950+ixgbe10g #1
  782. May 6 17:44:05 rd2 kernel: [142418.004618] Hardware name: Dell Inc. PowerEdge 1950/0M788G, BIOS 2.6.1 04/20/2009
  783. May 6 17:44:05 rd2 kernel: [142418.008706] 00000000 c134422f f6ce5a50 c1342f1c c141ff23 f6ce5d38 00020858 00000000
  784. May 6 17:44:05 rd2 kernel: [142418.012869] 00000000 00000001 00000003 00000003 00000000 c1032c3d c14b9fec c142012e
  785. May 6 17:44:05 rd2 kernel: [142418.017025] f27cd010 00000003 00000000 c10b76ef 00000000 c104571a 00020858 f1c31570
  786. May 6 17:44:05 rd2 kernel: [142418.021345] Call Trace:
  787. May 6 17:44:05 rd2 kernel: [142418.025816] [<c134422f>] ? dump_stack+0x3e/0x4e
  788. May 6 17:44:05 rd2 kernel: [142418.030175] [<c1342f1c>] ? dump_header.isra.9+0x53/0x174
  789. May 6 17:44:05 rd2 kernel: [142418.034691] [<c1032c3d>] ? put_online_cpus+0x18/0x63
  790. May 6 17:44:05 rd2 kernel: [142418.039057] [<c10b76ef>] ? oom_kill_process+0x6f/0x29e
  791. May 6 17:44:05 rd2 kernel: [142418.043449] [<c104571a>] ? notifier_call_chain+0x20/0x42
  792. May 6 17:44:05 rd2 kernel: [142418.047915] [<c114b98b>] ? security_capable_noaudit+0xc/0xf
  793. May 6 17:44:05 rd2 kernel: [142418.052212] [<c10b7df4>] ? out_of_memory+0x395/0x3c4
  794. May 6 17:44:05 rd2 kernel: [142418.056566] [<c10bb249>] ? __alloc_pages_nodemask+0x5bf/0x6b8
  795. May 6 17:44:05 rd2 kernel: [142418.060940] [<c10e6828>] ? alloc_pages_current+0x86/0xa2
  796. May 6 17:44:05 rd2 kernel: [142418.065460] [<c10b562a>] ? pagecache_get_page+0xae/0x13e
  797. May 6 17:44:05 rd2 kernel: [142418.070080] [<c111500c>] ? __getblk_slow+0x159/0x2a9
  798. May 6 17:44:05 rd2 kernel: [142418.074522] [<c1115189>] ? __getblk_gfp+0x2d/0x59
  799. May 6 17:44:05 rd2 kernel: [142418.079160] [<f842b9e7>] ? __ext4_get_inode_loc+0xcd/0x3a7 [ext4]
  800. May 6 17:44:05 rd2 kernel: [142418.083642] [<c110541c>] ? inode_sb_list_add+0x38/0x3a
  801. May 6 17:44:05 rd2 kernel: [142418.088053] [<f842cf2b>] ? ext4_iget+0x52/0x6fb [ext4]
  802. May 6 17:44:05 rd2 kernel: [142418.092485] [<f8433cee>] ? ext4_lookup+0x7e/0xbd [ext4]
  803. May 6 17:44:05 rd2 kernel: [142418.096941] [<c10fac15>] ? lookup_real+0x1d/0x31
  804. May 6 17:44:05 rd2 kernel: [142418.101392] [<c10fb133>] ? __lookup_hash+0x29/0x2d
  805. May 6 17:44:05 rd2 kernel: [142418.105917] [<c10fc778>] ? walk_component+0x5e/0x13e
  806. May 6 17:44:05 rd2 kernel: [142418.110664] [<c10fc9fa>] ? link_path_walk+0x177/0x38c
  807. May 6 17:44:05 rd2 kernel: [142418.115398] [<c10fd7bc>] ? path_init+0x103/0x2b6
  808. May 6 17:44:05 rd2 kernel: [142418.120034] [<c10fd982>] ? path_lookupat+0x13/0x1f2
  809. May 6 17:44:05 rd2 kernel: [142418.124492] [<c10fdb80>] ? filename_lookup+0x1f/0x6c
  810. May 6 17:44:05 rd2 kernel: [142418.128964] [<c10fed3e>] ? user_path_at_empty+0x3d/0x64
  811. May 6 17:44:05 rd2 kernel: [142418.133503] [<c10ec4ec>] ? kmem_cache_alloc+0x75/0xd6
  812. May 6 17:44:05 rd2 kernel: [142418.138030] [<c1045d58>] ? prepare_creds+0x13/0xa1
  813. May 6 17:44:05 rd2 kernel: [142418.142615] [<c10fed70>] ? user_path_at+0xb/0xe
  814. May 6 17:44:05 rd2 kernel: [142418.147113] [<c10f2f83>] ? SYSC_faccessat+0x9f/0x17a
  815. May 6 17:44:05 rd2 kernel: [142418.151657] [<c1071b60>] ? do_gettimeofday+0xd/0x26
  816. May 6 17:44:05 rd2 kernel: [142418.156335] [<c10f39b3>] ? SyS_access+0x24/0x28
  817. May 6 17:44:05 rd2 kernel: [142418.161095] [<c1347348>] ? sysenter_do_call+0x12/0x12
  818. May 6 17:44:05 rd2 kernel: [142418.165643] [<c1340000>] ? __next_mem_range_rev+0x176/0x291
  819. May 6 17:44:05 rd2 kernel: [142418.170213] Mem-Info:
  820. May 6 17:44:05 rd2 kernel: [142418.174753] Node 0 DMA per-cpu:
  821. May 6 17:44:05 rd2 kernel: [142418.179273] CPU 0: hi: 0, btch: 1 usd: 0
  822. May 6 17:44:05 rd2 kernel: [142418.183987] CPU 1: hi: 0, btch: 1 usd: 0
  823. May 6 17:44:05 rd2 kernel: [142418.188682] CPU 2: hi: 0, btch: 1 usd: 0
  824. May 6 17:44:05 rd2 kernel: [142418.193280] CPU 3: hi: 0, btch: 1 usd: 0
  825. May 6 17:44:05 rd2 kernel: [142418.197670] Node 0 Normal per-cpu:
  826. May 6 17:44:05 rd2 kernel: [142418.202008] CPU 0: hi: 186, btch: 31 usd: 0
  827. May 6 17:44:05 rd2 kernel: [142418.206267] CPU 1: hi: 186, btch: 31 usd: 0
  828. May 6 17:44:05 rd2 kernel: [142418.210356] CPU 2: hi: 186, btch: 31 usd: 25
  829. May 6 17:44:05 rd2 kernel: [142418.214316] CPU 3: hi: 186, btch: 31 usd: 0
  830. May 6 17:44:05 rd2 kernel: [142418.218240] Node 0 HighMem per-cpu:
  831. May 6 17:44:05 rd2 kernel: [142418.221998] CPU 0: hi: 186, btch: 31 usd: 0
  832. May 6 17:44:05 rd2 kernel: [142418.225676] CPU 1: hi: 186, btch: 31 usd: 0
  833. May 6 17:44:05 rd2 kernel: [142418.229282] CPU 2: hi: 186, btch: 31 usd: 0
  834. May 6 17:44:05 rd2 kernel: [142418.232801] CPU 3: hi: 186, btch: 31 usd: 0
  835. May 6 17:44:05 rd2 kernel: [142418.236299] active_anon:39565 inactive_anon:20731 isolated_anon:0
  836. May 6 17:44:05 rd2 kernel: [142418.236299] active_file:8535 inactive_file:3010 isolated_file:0
  837. May 6 17:44:05 rd2 kernel: [142418.236299] unevictable:0 dirty:3 writeback:0 unstable:0
  838. May 6 17:44:05 rd2 kernel: [142418.236299] free:1814606 slab_reclaimable:2069 slab_unreclaimable:66221
  839. May 6 17:44:05 rd2 kernel: [142418.236299] mapped:7077 shmem:3795 pagetables:639 bounce:0
  840. May 6 17:44:05 rd2 kernel: [142418.236299] free_cma:0
  841. May 6 17:44:05 rd2 kernel: [142418.256669] Node 0 DMA free:5544kB min:2496kB low:3120kB high:3744kB active_anon:0kB inactive_anon:0kB active_file:264kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15996kB managed:15912kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:88kB slab_unreclaimable:4800kB kernel_stack:8kB pagetables:0kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:124232 all_unreclaimable? yes
  842. May 6 17:44:05 rd2 kernel: [142418.271736] lowmem_reserve[]: 0 798 8096 8096
  843. May 6 17:44:05 rd2 kernel: [142418.275747] Node 0 Normal free:85728kB min:128572kB low:160712kB high:192856kB active_anon:0kB inactive_anon:0kB active_file:68kB inactive_file:80kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:894968kB managed:818540kB mlocked:0kB dirty:12kB writeback:0kB mapped:4kB shmem:0kB slab_reclaimable:8188kB slab_unreclaimable:260084kB kernel_stack:1672kB pagetables:12kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
  844. May 6 17:44:05 rd2 kernel: [142418.292979] lowmem_reserve[]: 0 0 58378 58378
  845. May 6 17:44:05 rd2 kernel: [142418.298288] Node 0 HighMem free:7167336kB min:512kB low:293944kB high:587380kB active_anon:158260kB inactive_anon:82924kB active_file:33808kB inactive_file:11984kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:7472456kB managed:7472456kB mlocked:4kB dirty:0kB writeback:0kB mapped:28304kB shmem:15180kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:2544kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
  846. May 6 17:44:05 rd2 kernel: [142418.318470] lowmem_reserve[]: 0 0 0 0
  847. May 6 17:44:05 rd2 kernel: [142418.323585] Node 0 DMA: 39*4kB (UR) 7*8kB (UR) 1*16kB (R) 1*32kB (R) 0*64kB 0*128kB 3*256kB (R) 1*512kB (R) 0*1024kB 0*2048kB 1*4096kB (R) = 5636kB
  848. May 6 17:44:05 rd2 kernel: [142418.335033] Node 0 Normal: 2138*4kB (UEM) 654*8kB (UEM) 258*16kB (UEM) 237*32kB (UEM) 106*64kB (UEM) 46*128kB (UEM) 30*256kB (UEM) 26*512kB (UEM) 6*1024kB (EM) 4*2048kB (MR) 3*4096kB (MR) = 85784kB
  849. May 6 17:44:05 rd2 kernel: [142418.348092] Node 0 HighMem: 3124*4kB (UM) 545*8kB (UM) 203*16kB (UM) 1247*32kB (UM) 1026*64kB (UM) 591*128kB (M) 353*256kB (UM) 169*512kB (M) 88*1024kB (M) 55*2048kB (MR) 1608*4096kB (UM) = 7167336kB
  850. May 6 17:44:05 rd2 kernel: [142418.361131] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
  851. May 6 17:44:05 rd2 kernel: [142418.367875] 15413 total pagecache pages
  852. May 6 17:44:05 rd2 kernel: [142418.374484] 52 pages in swap cache
  853. May 6 17:44:05 rd2 kernel: [142418.380912] Swap cache stats: add 5915, delete 5863, find 2350/3735
  854. May 6 17:44:05 rd2 kernel: [142418.387588] Free swap = 16759832kB
  855. May 6 17:44:05 rd2 kernel: [142418.394358] Total swap = 16764924kB
  856. May 6 17:44:05 rd2 kernel: [142418.401019] 2095855 pages RAM
  857. May 6 17:44:05 rd2 kernel: [142418.407549] 1868114 pages HighMem/MovableOnly
  858. May 6 17:44:05 rd2 kernel: [142418.414377] 19128 pages reserved
  859. May 6 17:44:05 rd2 kernel: [142418.420975] [ pid ] uid tgid total_vm rss nr_ptes swapents oom_score_adj name
  860. May 6 17:44:05 rd2 kernel: [142418.427650] [ 462] 0 462 656 548 5 0 -1000 udevd
  861. May 6 17:44:05 rd2 kernel: [142418.434743] [ 2121] 0 2121 598 478 5 0 0 rpcbind
  862. May 6 17:44:05 rd2 kernel: [142418.442287] [ 2152] 102 2152 666 580 5 0 0 rpc.statd
  863. May 6 17:44:05 rd2 kernel: [142418.449705] [ 2166] 0 2166 648 44 6 0 0 rpc.idmapd
  864. May 6 17:44:05 rd2 kernel: [142418.456963] [ 2364] 0 2364 537 26 5 0 0 netserver
  865. May 6 17:44:05 rd2 kernel: [142418.464161] [ 2528] 0 2528 516 366 5 0 0 vnstatd
  866. May 6 17:44:05 rd2 kernel: [142418.471490] [ 2550] 0 2550 7311 636 7 140 0 rsyslogd
  867. May 6 17:44:05 rd2 kernel: [142418.478532] [ 2553] 0 2553 9514 3068 12 12 0 glusterd
  868. May 6 17:44:06 rd2 kernel: [142418.485824] [ 2631] 0 2631 542 31 4 0 0 atd
  869. May 6 17:44:06 rd2 kernel: [142418.493102] [ 2700] 0 2700 473 355 5 0 0 acpid
  870. May 6 17:44:06 rd2 kernel: [142418.500703] [ 2734] 0 2734 1100 516 6 0 0 cron
  871. May 6 17:44:06 rd2 kernel: [142418.507983] [ 2752] 105 2752 758 55 5 0 0 dbus-daemon
  872. May 6 17:44:06 rd2 kernel: [142418.515508] [ 2777] 0 2777 1423 684 6 0 0 ha_logd
  873. May 6 17:44:06 rd2 kernel: [142418.522914] [ 2781] 109 2781 1838 563 7 2 0 zabbix_agentd
  874. May 6 17:44:06 rd2 kernel: [142418.530648] [ 2782] 109 2782 1838 631 7 2 0 zabbix_agentd
  875. May 6 17:44:06 rd2 kernel: [142418.538614] [ 2783] 109 2783 1838 648 7 2 0 zabbix_agentd
  876. May 6 17:44:06 rd2 kernel: [142418.546180] [ 2784] 109 2784 1838 648 7 2 0 zabbix_agentd
  877. May 6 17:44:06 rd2 kernel: [142418.553220] [ 2785] 109 2785 1838 643 7 2 0 zabbix_agentd
  878. May 6 17:44:06 rd2 kernel: [142418.560268] [ 2786] 109 2786 1838 621 7 2 0 zabbix_agentd
  879. May 6 17:44:06 rd2 kernel: [142418.566959] [ 2787] 109 2787 1838 621 7 2 0 zabbix_agentd
  880. May 6 17:44:06 rd2 kernel: [142418.573353] [ 2788] 109 2788 2005 811 7 2 0 zabbix_agentd
  881. May 6 17:44:06 rd2 kernel: [142418.579723] [ 2789] 0 2789 1423 615 6 0 0 ha_logd
  882. May 6 17:44:06 rd2 kernel: [142418.585800] [ 2792] 0 2792 16281 1651 23 0 0 corosync
  883. May 6 17:44:06 rd2 kernel: [142418.591760] [ 2859] 106 2859 3306 1751 9 0 0 cib
  884. May 6 17:44:06 rd2 kernel: [142418.597479] [ 2860] 0 2860 3042 1075 10 0 0 stonithd
  885. May 6 17:44:06 rd2 kernel: [142418.603273] [ 2861] 0 2861 2599 1303 9 0 0 lrmd
  886. May 6 17:44:06 rd2 kernel: [142418.608815] [ 2862] 106 2862 3101 1044 10 0 0 attrd
  887. May 6 17:44:06 rd2 kernel: [142418.614356] [ 2863] 106 2863 2222 1373 8 0 0 pengine
  888. May 6 17:44:06 rd2 kernel: [142418.619641] [ 2864] 106 2864 3122 1450 10 0 0 crmd
  889. May 6 17:44:06 rd2 kernel: [142418.624726] [ 2878] 0 2878 1620 747 6 0 -1000 sshd
  890. May 6 17:44:06 rd2 kernel: [142418.629886] [ 3038] 0 3038 14525 6923 21 65 0 glusterfs
  891. May 6 17:44:06 rd2 kernel: [142418.634970] [ 3072] 0 3072 14016 3986 21 32 0 glusterfsd
  892. May 6 17:44:06 rd2 kernel: [142418.640027] [ 3076] 0 3076 13502 6769 19 0 0 glusterfs
  893. May 6 17:44:06 rd2 kernel: [142418.644768] [ 3139] 0 3139 641 359 5 0 0 flow-capture
  894. May 6 17:44:06 rd2 kernel: [142418.649218] [ 3140] 0 3140 9108 411 9 0 0 iperf
  895. May 6 17:44:06 rd2 kernel: [142418.653659] [ 5407] 0 5407 470 329 4 0 0 startpar
  896. May 6 17:44:06 rd2 kernel: [142418.657846] [ 5408] 0 5408 1086 421 6 0 0 getty
  897. May 6 17:44:06 rd2 kernel: [142418.661689] [ 5409] 0 5409 1086 468 6 0 0 getty
  898. May 6 17:44:06 rd2 kernel: [142418.665515] [ 5410] 0 5410 1086 464 6 0 0 getty
  899. May 6 17:44:06 rd2 kernel: [142418.669075] [ 5411] 0 5411 1086 440 6 0 0 getty
  900. May 6 17:44:06 rd2 kernel: [142418.672512] [ 5412] 0 5412 1086 463 6 0 0 getty
  901. May 6 17:44:06 rd2 kernel: [142418.675816] [ 5413] 0 5413 1086 463 5 0 0 getty
  902. May 6 17:44:06 rd2 kernel: [142418.679130] [ 5501] 1000 5501 1709 741 7 1 0 screen
  903. May 6 17:44:06 rd2 kernel: [142418.682422] [ 5502] 1000 5502 1871 1115 7 0 0 bash
  904. May 6 17:44:06 rd2 kernel: [142418.685741] [ 5546] 1000 5546 1506 726 6 0 0 su
  905. May 6 17:44:06 rd2 kernel: [142418.689017] [ 5547] 0 5547 1577 1101 6 0 0 bash
  906. May 6 17:44:06 rd2 kernel: [142418.692340] [15382] 0 15382 655 506 5 0 -1000 udevd
  907. May 6 17:44:06 rd2 kernel: [142418.695768] [10153] 1000 10153 1871 1087 6 0 0 bash
  908. May 6 17:44:06 rd2 kernel: [142418.699088] [10198] 1000 10198 1506 695 6 0 0 su
  909. May 6 17:44:06 rd2 kernel: [142418.702411] [10199] 0 10199 1575 1088 6 0 0 bash
  910. May 6 17:44:06 rd2 kernel: [142418.705664] [17115] 0 17115 2334 1203 8 0 0 sshd
  911. May 6 17:44:06 rd2 kernel: [142418.708923] [17121] 1000 17121 2334 834 8 0 0 sshd
  912. May 6 17:44:06 rd2 kernel: [142418.712079] [17122] 1000 17122 2013 1265 7 0 0 bash
  913. May 6 17:44:06 rd2 kernel: [142418.715238] [14457] 0 14457 655 253 5 0 -1000 udevd
  914. May 6 17:44:06 rd2 kernel: [142418.718480] [ 1510] 107 1510 1713 689 6 0 0 dnsmasq
  915. May 6 17:44:06 rd2 kernel: [142418.721680] [ 1615] 0 1615 1602 615 6 0 0 screen
  916. May 6 17:44:06 rd2 kernel: [142418.724819] [ 1619] 0 1619 487 79 4 0 0 sh
  917. May 6 17:44:06 rd2 kernel: [142418.727901] [ 1620] 0 1620 479 385 5 0 0 netcat
  918. May 6 17:44:06 rd2 kernel: [142418.731034] [ 1621] 0 1621 1269 461 6 0 0 tee
  919. May 6 17:44:06 rd2 kernel: [142418.734163] [ 7380] 108 7380 1049 736 6 0 0 ospfd
  920. May 6 17:44:06 rd2 kernel: [142418.737184] [ 7385] 0 7385 646 386 4 0 0 watchquagga
  921. May 6 17:44:06 rd2 kernel: [142418.740202] [28870] 1000 28870 1871 1114 6 0 0 bash
  922. May 6 17:44:06 rd2 kernel: [142418.743318] [28915] 1000 28915 1506 694 7 0 0 su
  923. May 6 17:44:06 rd2 kernel: [142418.746500] [28929] 0 28929 1557 1050 7 0 0 bash
  924. May 6 17:44:06 rd2 kernel: [142418.749663] [ 1255] 0 1255 1740 1173 7 0 0 vi
  925. May 6 17:44:06 rd2 kernel: [142418.753000] [14851] 0 14851 2389 1239 7 0 0 sshd
  926. May 6 17:44:06 rd2 kernel: [142418.756226] [14864] 1000 14864 2389 863 7 0 0 sshd
  927. May 6 17:44:06 rd2 kernel: [142418.759595] [14865] 1000 14865 1724 1213 7 0 0 bash
  928. May 6 17:44:06 rd2 kernel: [142418.763370] [14966] 1000 14966 1218 649 6 0 0 su
  929. May 6 17:44:06 rd2 kernel: [142418.766876] [14969] 0 14969 1329 823 6 0 0 bash
  930. May 6 17:44:06 rd2 kernel: [142418.770258] [23948] 0 23948 2334 1219 7 0 0 sshd
  931. May 6 17:44:06 rd2 kernel: [142418.773557] [23951] 1000 23951 2369 910 7 0 0 sshd
  932. May 6 17:44:06 rd2 kernel: [142418.776802] [23952] 1000 23952 2014 1282 7 0 0 bash
  933. May 6 17:44:06 rd2 kernel: [142418.780041] [24054] 1000 24054 1529 663 6 0 0 screen
  934. May 6 17:44:06 rd2 kernel: [142418.783303] [28181] 0 28181 1314 610 6 0 0 screen
  935. May 6 17:44:06 rd2 kernel: [142418.786586] [28182] 0 28182 1335 861 6 0 0 bash
  936. May 6 17:44:06 rd2 kernel: [142418.789956] [28775] 0 28775 529 371 4 0 0 vnstat
  937. May 6 17:44:06 rd2 kernel: [142418.793258] [ 6271] 65534 6271 14193 12214 31 0 0 squid
  938. May 6 17:44:06 rd2 kernel: [142418.796624] [ 6273] 65534 6273 24774 19107 44 41 0 squid
  939. May 6 17:44:06 rd2 kernel: [142418.799901] [ 6296] 0 6296 1268 664 5 0 0 top
  940. May 6 17:44:06 rd2 kernel: [142418.851173] watchquagga invoked oom-killer: gfp_mask=0x20858, order=0, oom_score_adj=0
  941. May 6 17:44:06 rd2 kernel: [142418.854634] watchquagga cpuset=/ mems_allowed=0
  942. May 6 17:44:06 rd2 kernel: [142418.858196] CPU: 3 PID: 7385 Comm: watchquagga Not tainted 3.19.5.at.dell1950+ixgbe10g #1
  943. May 6 17:44:06 rd2 kernel: [142418.862093] Hardware name: Dell Inc. PowerEdge 1950/0M788G, BIOS 2.6.1 04/20/2009
  944. May 6 17:44:06 rd2 kernel: [142418.865997] 00000000 c134422f f6ce5a50 c1342f1c c141ff23 f6ce5d38 00020858 00000000
  945. May 6 17:44:06 rd2 kernel: [142418.869973] 00000000 f717b530 f717b6c4 c1347a31 f717b530 f717b798 c14b9fec c142012e
  946. May 6 17:44:06 rd2 kernel: [142418.874082] f25bd530 00000001 00000000 c10b76ef 00000000 c10400d8 00020858 f1c31570
  947. May 6 17:44:06 rd2 kernel: [142418.878364] Call Trace:
  948. May 6 17:44:06 rd2 kernel: [142418.882844] [<c134422f>] ? dump_stack+0x3e/0x4e
  949. May 6 17:44:06 rd2 kernel: [142418.887163] [<c1342f1c>] ? dump_header.isra.9+0x53/0x174
  950. May 6 17:44:06 rd2 kernel: [142418.891440] [<c1347a31>] ? call_function_single_interrupt+0x2d/0x34
  951. May 6 17:44:06 rd2 kernel: [142418.895861] [<c10b76ef>] ? oom_kill_process+0x6f/0x29e
  952. May 6 17:44:06 rd2 kernel: [142418.900141] [<c10400d8>] ? perf_fetch_caller_regs+0x21/0x26
  953. May 6 17:44:06 rd2 kernel: [142418.904401] [<c114b98b>] ? security_capable_noaudit+0xc/0xf
  954. May 6 17:44:06 rd2 kernel: [142418.908671] [<c10b7df4>] ? out_of_memory+0x395/0x3c4
  955. May 6 17:44:06 rd2 kernel: [142418.913076] [<c10bb249>] ? __alloc_pages_nodemask+0x5bf/0x6b8
  956. May 6 17:44:06 rd2 kernel: [142418.917498] [<c10e6828>] ? alloc_pages_current+0x86/0xa2
  957. May 6 17:44:06 rd2 kernel: [142418.922086] [<c10b562a>] ? pagecache_get_page+0xae/0x13e
  958. May 6 17:44:06 rd2 kernel: [142418.926997] [<c111500c>] ? __getblk_slow+0x159/0x2a9
  959. May 6 17:44:06 rd2 kernel: [142418.931979] [<c1115189>] ? __getblk_gfp+0x2d/0x59
  960. May 6 17:44:06 rd2 kernel: [142418.937001] [<f842b9e7>] ? __ext4_get_inode_loc+0xcd/0x3a7 [ext4]
  961. May 6 17:44:06 rd2 squid[6271]: Squid Parent: (squid-1) process 6273 exited due to signal 9 with status 0
  962. May 6 17:44:06 rd2 kernel: [142418.941658] [<c110541c>] ? inode_sb_list_add+0x38/0x3a
  963. May 6 17:44:06 rd2 kernel: [142418.946434] [<f842cf2b>] ? ext4_iget+0x52/0x6fb [ext4]
  964. May 6 17:44:06 rd2 kernel: [142418.951411] [<f8433cee>] ? ext4_lookup+0x7e/0xbd [ext4]
  965. May 6 17:44:06 rd2 kernel: [142418.956154] [<c10fac15>] ? lookup_real+0x1d/0x31
  966. May 6 17:44:06 rd2 kernel: [142418.961101] [<c10fb133>] ? __lookup_hash+0x29/0x2d
  967. May 6 17:44:06 rd2 kernel: [142418.965831] [<c10fc778>] ? walk_component+0x5e/0x13e
  968. May 6 17:44:06 rd2 kernel: [142418.970780] [<c10fc9fa>] ? link_path_walk+0x177/0x38c
  969. May 6 17:44:06 rd2 kernel: [142418.975563] [<c10fd7bc>] ? path_init+0x103/0x2b6
  970. May 6 17:44:06 rd2 kernel: [142418.980178] [<c10fd982>] ? path_lookupat+0x13/0x1f2
  971. May 6 17:44:06 rd2 kernel: [142418.984818] [<c10fdb80>] ? filename_lookup+0x1f/0x6c
  972. May 6 17:44:06 rd2 kernel: [142418.989520] [<c10fed3e>] ? user_path_at_empty+0x3d/0x64
  973. May 6 17:44:06 rd2 kernel: [142418.994169] [<c10ec4ec>] ? kmem_cache_alloc+0x75/0xd6
  974. May 6 17:44:06 rd2 kernel: [142418.998846] [<c1045d58>] ? prepare_creds+0x13/0xa1
  975. May 6 17:44:06 rd2 kernel: [142419.003501] [<c10fed70>] ? user_path_at+0xb/0xe
  976. May 6 17:44:06 rd2 kernel: [142419.008160] [<c10f2f83>] ? SYSC_faccessat+0x9f/0x17a
  977. May 6 17:44:06 rd2 kernel: [142419.013022] [<c1071b60>] ? do_gettimeofday+0xd/0x26
  978. May 6 17:44:06 rd2 kernel: [142419.018036] [<c10f39b3>] ? SyS_access+0x24/0x28
  979. May 6 17:44:06 rd2 kernel: [142419.022829] [<c1347348>] ? sysenter_do_call+0x12/0x12
  980. May 6 17:44:06 rd2 kernel: [142419.027583] [<c1340000>] ? __next_mem_range_rev+0x176/0x291
  981. May 6 17:44:06 rd2 kernel: [142419.032442] Mem-Info:
  982. May 6 17:44:06 rd2 kernel: [142419.037119] Node 0 DMA per-cpu:
  983. May 6 17:44:06 rd2 kernel: [142419.041858] CPU 0: hi: 0, btch: 1 usd: 0
  984. May 6 17:44:06 rd2 kernel: [142419.046674] CPU 1: hi: 0, btch: 1 usd: 0
  985. May 6 17:44:06 rd2 kernel: [142419.051615] CPU 2: hi: 0, btch: 1 usd: 0
  986. May 6 17:44:06 rd2 kernel: [142419.056229] CPU 3: hi: 0, btch: 1 usd: 0
  987. May 6 17:44:06 rd2 kernel: [142419.060611] Node 0 Normal per-cpu:
  988. May 6 17:44:06 rd2 kernel: [142419.065001] CPU 0: hi: 186, btch: 31 usd: 174
  989. May 6 17:44:06 rd2 kernel: [142419.069266] CPU 1: hi: 186, btch: 31 usd: 35
  990. May 6 17:44:06 rd2 kernel: [142419.073535] CPU 2: hi: 186, btch: 31 usd: 43
  991. May 6 17:44:06 rd2 kernel: [142419.077638] CPU 3: hi: 186, btch: 31 usd: 40
  992. May 6 17:44:06 rd2 kernel: [142419.081662] Node 0 HighMem per-cpu:
  993. May 6 17:44:06 rd2 kernel: [142419.085601] CPU 0: hi: 186, btch: 31 usd: 162
  994. May 6 17:44:06 rd2 kernel: [142419.089240] CPU 1: hi: 186, btch: 31 usd: 26
  995. May 6 17:44:06 rd2 kernel: [142419.092690] CPU 2: hi: 186, btch: 31 usd: 19
  996. May 6 17:44:06 rd2 kernel: [142419.096227] CPU 3: hi: 186, btch: 31 usd: 0
  997. May 6 17:44:06 rd2 kernel: [142419.099669] active_anon:10602 inactive_anon:20688 isolated_anon:0
  998. May 6 17:44:06 rd2 kernel: [142419.099669] active_file:8855 inactive_file:2958 isolated_file:0
  999. May 6 17:44:06 rd2 kernel: [142419.099669] unevictable:0 dirty:6 writeback:18 unstable:0
  1000. May 6 17:44:06 rd2 kernel: [142419.099669] free:1940283 slab_reclaimable:2067 slab_unreclaimable:65971
  1001. May 6 17:44:06 rd2 kernel: [142419.099669] mapped:6069 shmem:3795 pagetables:584 bounce:0
  1002. May 6 17:44:06 rd2 kernel: [142419.099669] free_cma:0
  1003. May 6 17:44:06 rd2 kernel: [142419.120242] Node 0 DMA free:10368kB min:2496kB low:3120kB high:3744kB active_anon:0kB inactive_anon:0kB active_file:116kB inactive_file:168kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15996kB managed:15912kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:88kB slab_unreclaimable:4788kB kernel_stack:8kB pagetables:0kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:20 all_unreclaimable? no
  1004. May 6 17:44:06 rd2 kernel: [142419.136204] lowmem_reserve[]: 0 798 8096 8096
  1005. May 6 17:44:06 rd2 kernel: [142419.140238] Node 0 Normal free:467728kB min:128572kB low:160712kB high:192856kB active_anon:0kB inactive_anon:0kB active_file:1196kB inactive_file:132kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:894968kB managed:818540kB mlocked:0kB dirty:0kB writeback:0kB mapped:4kB shmem:0kB slab_reclaimable:8180kB slab_unreclaimable:259096kB kernel_stack:1688kB pagetables:12kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
  1006. May 6 17:44:06 rd2 kernel: [142419.158263] lowmem_reserve[]: 0 0 58378 58378
  1007. May 6 17:44:06 rd2 kernel: [142419.163161] Node 0 HighMem free:7282912kB min:512kB low:293944kB high:587380kB active_anon:42408kB inactive_anon:82752kB active_file:34208kB inactive_file:11532kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:7472456kB managed:7472456kB mlocked:4kB dirty:24kB writeback:72kB mapped:24272kB shmem:15180kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:2324kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
  1008. May 6 17:44:06 rd2 kernel: [142419.183688] lowmem_reserve[]: 0 0 0 0
  1009. May 6 17:44:06 rd2 kernel: [142419.189029] Node 0 DMA: 351*4kB (UR) 141*8kB (UR) 56*16kB (UR) 39*32kB (UR) 5*64kB (U) 0*128kB 3*256kB (R) 1*512kB (R) 0*1024kB 0*2048kB 1*4096kB (R) = 10372kB
  1010. May 6 17:44:06 rd2 kernel: [142419.200764] Node 0 Normal: 17994*4kB (UEM) 9409*8kB (UE) 4449*16kB (UEM) 3229*32kB (UE) 1157*64kB (UEM) 186*128kB (UEM) 32*256kB (UEM) 26*512kB (UEM) 6*1024kB (EM) 4*2048kB (MR) 3*4096kB (MR) = 467744kB
  1011. May 6 17:44:06 rd2 kernel: [142419.213755] Node 0 HighMem: 6886*4kB (UM) 4734*8kB (UM) 2914*16kB (UM) 1588*32kB (UM) 971*64kB (UM) 566*128kB (M) 331*256kB (UM) 156*512kB (M) 85*1024kB (M) 46*2048kB (MR) 1621*4096kB (UM) = 7282920kB
  1012. May 6 17:44:06 rd2 kernel: [142419.226992] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
  1013. May 6 17:44:06 rd2 kernel: [142419.233704] 15698 total pagecache pages
  1014. May 6 17:44:06 rd2 kernel: [142419.240590] 27 pages in swap cache
  1015. May 6 17:44:06 rd2 kernel: [142419.247298] Swap cache stats: add 5915, delete 5888, find 2350/3735
  1016. May 6 17:44:06 rd2 kernel: [142419.254187] Free swap = 16760032kB
  1017. May 6 17:44:06 rd2 kernel: [142419.260952] Total swap = 16764924kB
  1018. May 6 17:44:06 rd2 kernel: [142419.267718] 2095855 pages RAM
  1019. May 6 17:44:06 rd2 kernel: [142419.274538] 1868114 pages HighMem/MovableOnly
  1020. May 6 17:44:06 rd2 kernel: [142419.281668] 19128 pages reserved
  1021. May 6 17:44:06 rd2 kernel: [142419.288539] [ pid ] uid tgid total_vm rss nr_ptes swapents oom_score_adj name
  1022. May 6 17:44:06 rd2 kernel: [142419.295610] [ 462] 0 462 656 548 5 0 -1000 udevd
  1023. May 6 17:44:06 rd2 kernel: [142419.302539] [ 2121] 0 2121 598 478 5 0 0 rpcbind
  1024. May 6 17:44:06 rd2 kernel: [142419.309565] [ 2152] 102 2152 666 580 5 0 0 rpc.statd
  1025. May 6 17:44:06 rd2 kernel: [142419.316735] [ 2166] 0 2166 648 44 6 0 0 rpc.idmapd
  1026. May 6 17:44:06 rd2 kernel: [142419.323843] [ 2364] 0 2364 537 26 5 0 0 netserver
  1027. May 6 17:44:06 rd2 kernel: [142419.331166] [ 2528] 0 2528 516 366 5 0 0 vnstatd
  1028. May 6 17:44:06 rd2 kernel: [142419.338385] [ 2550] 0 2550 7311 636 7 140 0 rsyslogd
  1029. May 6 17:44:06 rd2 kernel: [142419.345477] [ 2553] 0 2553 9514 3068 12 12 0 glusterd
  1030. May 6 17:44:06 rd2 kernel: [142419.352837] [ 2631] 0 2631 542 31 4 0 0 atd
  1031. May 6 17:44:06 rd2 kernel: [142419.360149] [ 2700] 0 2700 473 355 5 0 0 acpid
  1032. May 6 17:44:06 rd2 kernel: [142419.367451] [ 2734] 0 2734 1100 516 6 0 0 cron
  1033. May 6 17:44:06 rd2 kernel: [142419.374531] [ 2752] 105 2752 758 55 5 0 0 dbus-daemon
  1034. May 6 17:44:06 rd2 kernel: [142419.382053] [ 2777] 0 2777 1423 684 6 0 0 ha_logd
  1035. May 6 17:44:06 rd2 kernel: [142419.389367] [ 2781] 109 2781 1838 563 7 2 0 zabbix_agentd
  1036. May 6 17:44:06 rd2 kernel: [142419.396554] [ 2782] 109 2782 1838 631 7 2 0 zabbix_agentd
  1037. May 6 17:44:06 rd2 kernel: [142419.403909] [ 2783] 109 2783 1838 648 7 2 0 zabbix_agentd
  1038. May 6 17:44:06 rd2 kernel: [142419.411222] [ 2784] 109 2784 1838 648 7 2 0 zabbix_agentd
  1039. May 6 17:44:06 rd2 kernel: [142419.418225] [ 2785] 109 2785 1838 643 7 2 0 zabbix_agentd
  1040. May 6 17:44:06 rd2 kernel: [142419.425120] [ 2786] 109 2786 1838 621 7 2 0 zabbix_agentd
  1041. May 6 17:44:06 rd2 kernel: [142419.431880] [ 2787] 109 2787 1838 621 7 2 0 zabbix_agentd
  1042. May 6 17:44:06 rd2 kernel: [142419.438391] [ 2788] 109 2788 2005 811 7 2 0 zabbix_agentd
  1043. May 6 17:44:06 rd2 kernel: [142419.444924] [ 2789] 0 2789 1423 615 6 0 0 ha_logd
  1044. May 6 17:44:06 rd2 kernel: [142419.451156] [ 2792] 0 2792 16281 1651 23 0 0 corosync
  1045. May 6 17:44:06 rd2 kernel: [142419.457339] [ 2859] 106 2859 3306 1751 9 0 0 cib
  1046. May 6 17:44:06 rd2 kernel: [142419.463227] [ 2860] 0 2860 3042 1075 10 0 0 stonithd
  1047. May 6 17:44:06 rd2 kernel: [142419.469095] [ 2861] 0 2861 2599 1303 9 0 0 lrmd
  1048. May 6 17:44:06 rd2 kernel: [142419.474809] [ 2862] 106 2862 3101 1044 10 0 0 attrd
  1049. May 6 17:44:06 rd2 kernel: [142419.480476] [ 2863] 106 2863 2222 1373 8 0 0 pengine
  1050. May 6 17:44:07 rd2 kernel: [142419.485895] [ 2864] 106 2864 3122 1450 10 0 0 crmd
  1051. May 6 17:44:07 rd2 kernel: [142419.491398] [ 2878] 0 2878 1620 747 6 0 -1000 sshd
  1052. May 6 17:44:07 rd2 kernel: [142419.496722] [ 3038] 0 3038 14525 6923 21 65 0 glusterfs
  1053. May 6 17:44:07 rd2 kernel: [142419.501853] [ 3072] 0 3072 14016 3986 21 32 0 glusterfsd
  1054. May 6 17:44:07 rd2 kernel: [142419.506884] [ 3076] 0 3076 13502 6769 19 0 0 glusterfs
  1055. May 6 17:44:07 rd2 kernel: [142419.511676] [ 3139] 0 3139 641 359 5 0 0 flow-capture
  1056. May 6 17:44:07 rd2 kernel: [142419.516328] [ 3140] 0 3140 9108 411 9 0 0 iperf
  1057. May 6 17:44:07 rd2 kernel: [142419.520634] [ 5407] 0 5407 470 329 4 0 0 startpar
  1058. May 6 17:44:07 rd2 kernel: [142419.524997] [ 5408] 0 5408 1086 421 6 0 0 getty
  1059. May 6 17:44:07 rd2 kernel: [142419.529010] [ 5409] 0 5409 1086 468 6 0 0 getty
  1060. May 6 17:44:07 rd2 kernel: [142419.533001] [ 5410] 0 5410 1086 464 6 0 0 getty
  1061. May 6 17:44:07 rd2 kernel: [142419.536994] [ 5411] 0 5411 1086 440 6 0 0 getty
  1062. May 6 17:44:07 rd2 kernel: [142419.540925] [ 5412] 0 5412 1086 463 6 0 0 getty
  1063. May 6 17:44:07 rd2 kernel: [142419.544714] [ 5413] 0 5413 1086 463 5 0 0 getty
  1064. May 6 17:44:07 rd2 kernel: [142419.548303] [ 5501] 1000 5501 1709 741 7 1 0 screen
  1065. May 6 17:44:07 rd2 kernel: [142419.552015] [ 5502] 1000 5502 1871 1115 7 0 0 bash
  1066. May 6 17:44:07 rd2 kernel: [142419.555584] [ 5546] 1000 5546 1506 726 6 0 0 su
  1067. May 6 17:44:07 rd2 kernel: [142419.559116] [ 5547] 0 5547 1577 1101 6 0 0 bash
  1068. May 6 17:44:07 rd2 kernel: [142419.562707] [15382] 0 15382 655 506 5 0 -1000 udevd
  1069. May 6 17:44:07 rd2 kernel: [142419.566134] [10153] 1000 10153 1871 1087 6 0 0 bash
  1070. May 6 17:44:07 rd2 kernel: [142419.569587] [10198] 1000 10198 1506 695 6 0 0 su
  1071. May 6 17:44:07 rd2 kernel: [142419.573088] [10199] 0 10199 1575 1088 6 0 0 bash
  1072. May 6 17:44:07 rd2 kernel: [142419.576441] [17115] 0 17115 2334 1203 8 0 0 sshd
  1073. May 6 17:44:07 rd2 kernel: [142419.579663] [17121] 1000 17121 2334 834 8 0 0 sshd
  1074. May 6 17:44:07 rd2 kernel: [142419.582919] [17122] 1000 17122 2013 1265 7 0 0 bash
  1075. May 6 17:44:07 rd2 kernel: [142419.586308] [14457] 0 14457 655 253 5 0 -1000 udevd
  1076. May 6 17:44:07 rd2 kernel: [142419.589501] [ 1510] 107 1510 1713 689 6 0 0 dnsmasq
  1077. May 6 17:44:07 rd2 kernel: [142419.592856] [ 1615] 0 1615 1602 615 6 0 0 screen
  1078. May 6 17:44:07 rd2 kernel: [142419.596243] [ 1619] 0 1619 487 79 4 0 0 sh
  1079. May 6 17:44:07 rd2 kernel: [142419.599709] [ 1620] 0 1620 479 385 5 0 0 netcat
  1080. May 6 17:44:07 rd2 kernel: [142419.603093] [ 1621] 0 1621 1269 461 6 0 0 tee
  1081. May 6 17:44:07 rd2 kernel: [142419.606277] [ 7380] 108 7380 1049 736 6 0 0 ospfd
  1082. May 6 17:44:07 rd2 kernel: [142419.609512] [ 7385] 0 7385 646 386 4 0 0 watchquagga
  1083. May 6 17:44:07 rd2 kernel: [142419.612778] [28870] 1000 28870 1871 1114 6 0 0 bash
  1084. May 6 17:44:07 rd2 kernel: [142419.616096] [28915] 1000 28915 1506 694 7 0 0 su
  1085. May 6 17:44:07 rd2 kernel: [142419.619225] [28929] 0 28929 1557 1050 7 0 0 bash
  1086. May 6 17:44:07 rd2 kernel: [142419.622351] [ 1255] 0 1255 1740 1173 7 0 0 vi
  1087. May 6 17:44:07 rd2 kernel: [142419.625542] [14851] 0 14851 2389 1239 7 0 0 sshd
  1088. May 6 17:44:07 rd2 kernel: [142419.628779] [14864] 1000 14864 2389 863 7 0 0 sshd
  1089. May 6 17:44:07 rd2 kernel: [142419.632071] [14865] 1000 14865 1724 1213 7 0 0 bash
  1090. May 6 17:44:07 rd2 kernel: [142419.635370] [14966] 1000 14966 1218 649 6 0 0 su
  1091. May 6 17:44:07 rd2 kernel: [142419.638898] [14969] 0 14969 1329 823 6 0 0 bash
  1092. May 6 17:44:07 rd2 kernel: [142419.642262] [23948] 0 23948 2334 1219 7 0 0 sshd
  1093. May 6 17:44:07 rd2 kernel: [142419.645561] [23951] 1000 23951 2369 910 7 0 0 sshd
  1094. May 6 17:44:07 rd2 kernel: [142419.648828] [23952] 1000 23952 2014 1282 7 0 0 bash
  1095. May 6 17:44:07 rd2 kernel: [142419.652038] [24054] 1000 24054 1529 663 6 0 0 screen
  1096. May 6 17:44:07 rd2 kernel: [142419.655315] [28181] 0 28181 1314 610 6 0 0 screen
  1097. May 6 17:44:07 rd2 kernel: [142419.658507] [28182] 0 28182 1335 861 6 0 0 bash
  1098. May 6 17:44:07 rd2 kernel: [142419.661695] [28775] 0 28775 529 371 4 0 0 vnstat
  1099. May 6 17:44:07 rd2 kernel: [142419.665376] [ 6296] 0 6296 1268 664 5 0 0 top
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement