Kernal Log

May 19 12:33:51 Express-Athletics-WEB kernel: [148849.835136] Out of memory: Kill process 14472 (apache2) score 59 or sacrifice child
May 19 12:33:51 Express-Athletics-WEB kernel: [148849.835274] Killed process 14472 (apache2) total-vm:403892kB, anon-rss:28196kB, file-rss:32048kB
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209177] mysqld invoked oom-killer: gfp_mask=0x201da, order=0, oom_score_adj=0
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209215] mysqld cpuset=/ mems_allowed=0
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209244] CPU: 0 PID: 14762 Comm: mysqld Not tainted 3.13.0-86-generic #131-Ubuntu
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209247] Hardware name: DigitalOcean Droplet, BIOS 20160425 04/25/2016
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209259]  0000000000000000 ffff880026f2b968 ffffffff8172a394 ffff88003cb3b000
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209275]  0000000000000000 ffff880026f2b9f0 ffffffff8172493d ffffffff81069b76
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209279]  ffff880026f2b9c8 ffffffff810ca5ac ffff88003fffae28 0000000000000000
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209288] Call Trace:
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209364]  [<ffffffff8172a394>] dump_stack+0x64/0x82
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209372]  [<ffffffff8172493d>] dump_header+0x7f/0x1f1
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209412]  [<ffffffff81069b76>] ? put_online_cpus+0x56/0x80
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209426]  [<ffffffff810ca5ac>] ? rcu_oom_notify+0xcc/0xf0
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209452]  [<ffffffff81113f6e>] ? __delayacct_freepages_end+0x2e/0x30
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209468]  [<ffffffff81155c9e>] oom_kill_process+0x1ce/0x330
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209500]  [<ffffffff812dcdf5>] ? security_capable_noaudit+0x15/0x20
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209505]  [<ffffffff811563d4>] out_of_memory+0x414/0x450
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209511]  [<ffffffff8115c70c>] __alloc_pages_nodemask+0xa6c/0xb90
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209531]  [<ffffffff8119b003>] alloc_pages_current+0xa3/0x160
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209543]  [<ffffffff811527f7>] __page_cache_alloc+0x97/0xc0
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209548]  [<ffffffff81154265>] filemap_fault+0x185/0x410
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209567]  [<ffffffff811794bf>] __do_fault+0x6f/0x530
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209573]  [<ffffffff8117d342>] handle_mm_fault+0x482/0xf10
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209644]  [<ffffffff816131de>] ? sock_aio_read.part.5+0xfe/0x120
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209652]  [<ffffffff81179ac5>] ? tlb_finish_mmu+0x55/0x60
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209665]  [<ffffffff81736594>] __do_page_fault+0x184/0x570
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209675]  [<ffffffff81613221>] ? sock_aio_read+0x21/0x30
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209697]  [<ffffffff811c0e3a>] ? do_sync_read+0x5a/0x90
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209704]  [<ffffffff8173699a>] do_page_fault+0x1a/0x70
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209709]  [<ffffffff81736009>] do_async_page_fault+0x29/0xe0
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209714]  [<ffffffff81732cd8>] async_page_fault+0x28/0x30
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209717] Mem-Info:
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209726] Node 0 DMA per-cpu:
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209735] CPU    0: hi:    0, btch:   1 usd:   0
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209737] Node 0 DMA32 per-cpu:
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209740] CPU    0: hi:  186, btch:  31 usd:  83
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209747] active_anon:217701 inactive_anon:3579 isolated_anon:0
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209747]  active_file:122 inactive_file:229 isolated_file:0
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209747]  unevictable:0 dirty:0 writeback:0 unstable:0
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209747]  free:12208 slab_reclaimable:1973 slab_unreclaimable:4660
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209747]  mapped:7746 shmem:10372 pagetables:9155 bounce:0
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209747]  free_cma:0
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209753] Node 0 DMA free:4604kB min:704kB low:880kB high:1056kB active_anon:10304kB inactive_anon:184kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15992kB managed:15908kB mlocked:0kB dirty:0kB writeback:0kB mapped:360kB shmem:540kB slab_reclaimable:148kB slab_unreclaimable:184kB kernel_stack:0kB pagetables:264kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209768] lowmem_reserve[]: 0 975 975 975
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209777] Node 0 DMA32 free:44228kB min:44348kB low:55432kB high:66520kB active_anon:860500kB inactive_anon:14132kB active_file:488kB inactive_file:916kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:1032184kB managed:1001924kB mlocked:0kB dirty:0kB writeback:0kB mapped:30624kB shmem:40948kB slab_reclaimable:7744kB slab_unreclaimable:18456kB kernel_stack:1952kB pagetables:36356kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:2314 all_unreclaimable? yes
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209785] lowmem_reserve[]: 0 0 0 0
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209789] Node 0 DMA: 13*4kB (UE) 13*8kB (UE) 8*16kB (UE) 7*32kB (UEM) 2*64kB (UM) 9*128kB (UM) 5*256kB (UM) 1*512kB (U) 1*1024kB (E) 0*2048kB 0*4096kB = 4604kB
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209823] Node 0 DMA32: 207*4kB (UE) 227*8kB (UEM) 187*16kB (UEM) 214*32kB (UEM) 96*64kB (UEM) 58*128kB (UEM) 39*256kB (UEM) 12*512kB (UEM) 0*1024kB 1*2048kB (R) 0*4096kB = 44228kB
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209853] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209856] 10731 total pagecache pages
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209871] 0 pages in swap cache
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209873] Swap cache stats: add 0, delete 0, find 0/0
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209875] Free swap  = 0kB
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209877] Total swap = 0kB
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209879] 262044 pages RAM
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209880] 0 pages HighMem/MovableOnly
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209882] 7565 pages reserved
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209884] [ pid ]   uid  tgid total_vm      rss nr_ptes swapents oom_score_adj name
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209893] [  346]     0   346     4868       77      13        0             0 upstart-udev-br
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209903] [  351]     0   351    12814      145      28        0         -1000 systemd-udevd
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209907] [  696]     0   696     3880      109      11        0             0 upstart-socket-
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209911] [  887]   102   887     9806       97      23        0             0 dbus-daemon
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209914] [  933]     0   933    10862       91      26        0             0 systemd-logind
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209917] [  935]   101   935    63960     1811      30        0             0 rsyslogd
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209920] [  954]     0   954     3818       67      13        0             0 upstart-file-br
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209924] [ 1021]     0  1021     3954       41      13        0             0 getty
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209927] [ 1024]     0  1024     3954       41      13        0             0 getty
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209930] [ 1030]     0  1030     3954       42      13        0             0 getty
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209933] [ 1032]     0  1032     3954       41      13        0             0 getty
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209936] [ 1035]     0  1035     3954       41      13        0             0 getty
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209962] [ 1059]     0  1059    15344      170      33        0         -1000 sshd
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209967] [ 1063]     0  1063     1091       36       8        0             0 acpid
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209970] [ 1065]     0  1065     5913       65      17        0             0 cron
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209973] [ 1066]     0  1066     4784       43      13        0             0 atd
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209977] [ 1141]   999  1141     4238       39      13        0             0 nrsysmond
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209980] [ 1143]   999  1143    79256      832      26        0             0 nrsysmond
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209983] [ 1356]     0  1356     3954       41      13        0             0 getty
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209987] [13824]     0 13824    26410      252      53        0             0 sshd
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209990] [13907]     0 13907     5616      478      16        0             0 bash
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209993] [13977]     0 13977    26444      290      55        0             0 sshd
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.209996] [14027]     0 14027     3261      116      11        0             0 sftp-server
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210000] [14468]     0 14468    95000     2907     118        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210004] [14475]    33 14475    99041    12060     142        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210008] [14510]   106 14510   224672    13104      77        0             0 mysqld
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210011] [14549]    33 14549    99231    12274     144        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210014] [14648]    33 14648    98563    11280     142        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210017] [14649]    33 14649   113694    11913     145        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210020] [14651]     0 14651     6600      318      18        0             0 htop
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210023] [14652]    33 14652   113113    11169     144        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210026] [14653]    33 14653   113390    11482     144        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210030] [14654]    33 14654    96729    10168     141        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210033] [14655]    33 14655   113113    10429     144        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210036] [14660]    33 14660    97819    10066     141        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210039] [14661]    33 14661   112859    10305     142        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210042] [14662]    33 14662   112792    10900     143        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210045] [14663]    33 14663    97009    11435     143        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210049] [14664]    33 14664   112792    10258     142        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210052] [14665]    33 14665   114104    10047     142        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210055] [14666]    33 14666   112856     9902     141        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210058] [14667]    33 14667    96472    10245     140        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210061] [14674]    33 14674   114163    12203     146        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210064] [14675]    33 14675    97780    10159     141        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210067] [14676]    33 14676   112792    10836     143        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210070] [14677]    33 14677   112856    10425     143        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210074] [14679]    33 14679   112792    10116     143        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210077] [14682]    33 14682   112856    10925     143        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210080] [14683]    33 14683   112858    10940     143        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210083] [14684]    33 14684   113722    10077     141        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210086] [14685]    33 14685   112859    10980     143        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210090] [14686]    33 14686    97849    10164     141        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210093] [14688]    33 14688   112792    10906     143        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210096] [14717]    33 14717   112794    10827     143        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210099] [14722]    33 14722    97849    10142     141        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210102] [14727]    33 14727   112860     9896     143        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210121] [14737]    33 14737   112792    10521     143        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210126] [14740]    33 14740   114167    12218     146        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210129] [14741]    33 14741   112699    10801     143        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210133] [14749]    33 14749   114078    12133     146        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210136] [14750]    33 14750   112792     9807     143        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210139] [14760]    33 14760   112699    10263     143        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210142] [14761]    33 14761   114163    12242     146        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210145] [14766]    33 14766   112856    10911     143        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210148] [14767]    33 14767   112699     9678     143        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210152] [14768]    33 14768   114163    12266     146        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210155] [14769]    33 14769   112856    10924     143        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210158] [14779]    33 14779   112792    10887     143        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210161] [14780]    33 14780   112699    10143     143        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210165] [14787]    33 14787   112699     9963     143        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210168] [14788]    33 14788   114163    12252     146        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210171] [14797]    33 14797   112699    10704     143        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210174] [14798]    33 14798   112699    10807     143        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210177] [14803]    33 14803   112700     9716     142        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210180] [14867]    33 14867   112750    10121     139        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210184] [14868]    33 14868   112108    10211     141        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210187] [14869]    33 14869   112685    10106     140        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210190] [14870]    33 14870   112108    10244     141        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210193] [14949]    33 14949    95537     7593     128        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210197] [14950]    33 14950    95637     8042     130        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210200] [14951]    33 14951    95637     7626     128        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210203] [14952]    33 14952    95407     8318     131        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210207] [14953]    33 14953    95374     7915     130        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210210] [14954]    33 14954    95407     7518     128        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210213] [14955]    33 14955    95211     7287     127        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210216] [14956]    33 14956    95081     7168     126        0             0 apache2
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210219] Out of memory: Kill process 14510 (mysqld) score 51 or sacrifice child
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.210375] Killed process 14510 (mysqld) total-vm:898688kB, anon-rss:52416kB, file-rss:0kB
May 19 12:33:56 Express-Athletics-WEB kernel: [148855.452729] type=1400 audit(1463675636.615:30): apparmor="STATUS" operation="profile_replace" profile="unconfined" name="/usr/sbin/mysqld" pid=14978 comm="apparmor_parser"
May 19 12:33:57 Express-Athletics-WEB kernel: [148856.694437] type=1400 audit(1463675637.855:31): apparmor="STATUS" operation="profile_replace" profile="unconfined" name="/usr/sbin/mysqld" pid=15016 comm="apparmor_parser"