Advertisement
Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- Dec 13 19:17:01 pve01 CRON[1102116]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
- Dec 13 19:17:01 pve01 CRON[1102117]: (root) CMD (cd / && run-parts --report /etc/cron.hourly)
- Dec 13 19:17:01 pve01 CRON[1102116]: pam_unix(cron:session): session closed for user root
- Dec 13 19:36:22 pve01 pmxcfs[1752]: [dcdb] notice: data verification successful
- Dec 13 19:56:18 pve01 systemd: systemd-journald.service: State 'stop-watchdog' timed out. Killing.
- Dec 13 19:56:18 pve01 systemd: systemd-journald.service: Killing process 653 (systemd-journal) with signal SIGKILL.
- Dec 13 19:56:18 pve01 kernel: oom_reaper: reaped process 653 (systemd-journal), now anon-rss:0kB, file-rss:64kB, shmem-rss:0kB
- Dec 13 19:56:18 pve01 systemd: systemd-journald.service: Processes still around after SIGKILL. Ignoring.
- Dec 13 19:56:18 pve01 systemd: systemd-journald.service: State 'final-sigterm' timed out. Killing.
- Dec 13 19:56:18 pve01 systemd: systemd-journald.service: Killing process 653 (systemd-journal) with signal SIGKILL.
- Dec 13 19:56:18 pve01 systemd: systemd-journald.service: Main process exited, code=killed, status=9/KILL
- Dec 13 19:56:18 pve01 systemd: systemd-journald.service: Failed with result 'watchdog'.
- Dec 13 19:56:18 pve01 systemd: systemd-journald.service: Consumed 3.790s CPU time.
- Dec 13 19:56:18 pve01 systemd: systemd-journald.service: Scheduled restart job, restart counter is at 1.
- Dec 13 19:56:18 pve01 systemd: Stopped systemd-journald.service - Journal Service.
- Dec 13 19:56:18 pve01 systemd: systemd-journald.service: Consumed 3.790s CPU time.
- Dec 13 19:56:18 pve01 kernel: systemd invoked oom-killer: gfp_mask=0x40dc0(GFP_KERNEL|__GFP_COMP|__GFP_ZERO), order=2, oom_score_adj=0
- Dec 13 19:56:18 pve01 kernel: CPU: 11 PID: 1 Comm: systemd Tainted: P O 6.5.11-7-pve #1
- Dec 13 19:56:18 pve01 kernel: Hardware name: FUJITSU PRIMERGY RX2520 M1/D3169-A1, BIOS V4.6.5.4 R1.17.0 for D3169-A1x 02/09/2016
- Dec 13 19:56:18 pve01 kernel: Call Trace:
- Dec 13 19:56:18 pve01 kernel: <TASK>
- Dec 13 19:56:18 pve01 kernel: dump_stack_lvl+0x48/0x70
- Dec 13 19:56:18 pve01 kernel: dump_stack+0x10/0x20
- Dec 13 19:56:18 pve01 kernel: dump_header+0x4f/0x260
- Dec 13 19:56:18 pve01 kernel: oom_kill_process+0x10d/0x1c0
- Dec 13 19:56:18 pve01 kernel: out_of_memory+0x270/0x560
- Dec 13 19:56:18 pve01 kernel: __alloc_pages+0x114f/0x12e0
- Dec 13 19:56:18 pve01 kernel: __kmalloc_large_node+0x7e/0x160
- Dec 13 19:56:18 pve01 kernel: kmalloc_large+0x22/0xc0
- Dec 13 19:56:18 pve01 kernel: bpf_check+0x7c/0x2d40
- Dec 13 19:56:18 pve01 kernel: ? do_user_addr_fault+0x238/0x6a0
- Dec 13 19:56:18 pve01 kernel: ? exc_page_fault+0x94/0x1b0
- Dec 13 19:56:18 pve01 kernel: ? strncpy_from_user+0xa8/0x170
- Dec 13 19:56:18 pve01 kernel: ? __pfx_read_tsc+0x10/0x10
- Dec 13 19:56:18 pve01 kernel: bpf_prog_load+0x862/0xbf0
- Dec 13 19:56:18 pve01 kernel: __sys_bpf+0x777/0x2680
- Dec 13 19:56:18 pve01 kernel: ? __handle_mm_fault+0x6cc/0xc30
- Dec 13 19:56:18 pve01 kernel: __x64_sys_bpf+0x1a/0x30
- Dec 13 19:56:18 pve01 kernel: do_syscall_64+0x5b/0x90
- Dec 13 19:56:18 pve01 kernel: ? exit_to_user_mode_prepare+0x39/0x190
- Dec 13 19:56:18 pve01 kernel: ? irqentry_exit_to_user_mode+0x17/0x20
- Dec 13 19:56:18 pve01 kernel: ? irqentry_exit+0x43/0x50
- Dec 13 19:56:18 pve01 kernel: ? exc_page_fault+0x94/0x1b0
- Dec 13 19:56:18 pve01 kernel: entry_SYSCALL_64_after_hwframe+0x6e/0xd8
- Dec 13 19:56:18 pve01 kernel: RIP: 0033:0x7fad04b39559
- Dec 13 19:56:18 pve01 kernel: Code: 08 89 e8 5b 5d c3 66 2e 0f 1f 84 00 00 00 00 00 90 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 77 08 0d 00 f7 d8 64 89 01 48
- Dec 13 19:56:18 pve01 kernel: RSP: 002b:00007ffe99da5238 EFLAGS: 00000246 ORIG_RAX: 0000000000000141
- Dec 13 19:56:18 pve01 kernel: RAX: ffffffffffffffda RBX: 0000557f394ba560 RCX: 00007fad04b39559
- Dec 13 19:56:18 pve01 kernel: RDX: 0000000000000090 RSI: 00007ffe99da5240 RDI: 0000000000000005
- Dec 13 19:56:18 pve01 kernel: RBP: 00007ffe99da5240 R08: 0000000000000000 R09: 0000003f0000000f
- Dec 13 19:56:18 pve01 kernel: R10: 0000000000000004 R11: 0000000000000246 R12: 0000000000000002
- Dec 13 19:56:18 pve01 kernel: R13: 0000000000000006 R14: 00007ffe99da5310 R15: 0000557f394b7020
- Dec 13 19:56:18 pve01 kernel: </TASK>
- Dec 13 19:56:18 pve01 kernel: Mem-Info:
- Dec 13 19:56:18 pve01 kernel: active_anon:713273 inactive_anon:4735294 isolated_anon:0
- active_file:0 inactive_file:0 isolated_file:0
- unevictable:38194 dirty:4 writeback:14
- slab_reclaimable:7109 slab_unreclaimable:1144890
- mapped:21001 shmem:17723 pagetables:15051
- sec_pagetables:12163 bounce:0
- kernel_misc_reclaimable:0
- free:457262 free_pcp:36 free_cma:0
- Dec 13 19:56:18 pve01 kernel: Node 0 active_anon:19402448kB inactive_anon:2392056kB active_file:116kB inactive_file:560kB unevictable:152776kB isolated(anon):0kB isolated(file):0kB mapped:84652kB dirty:16kB writeback:56kB shmem:70892kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 303104kB writeback_tmp:0kB kernel_stack:7952kB pagetables:60204kB sec_pagetables:48652kB all_unreclaimable? no
- Dec 13 19:56:18 pve01 kernel: Node 0 DMA free:11264kB boost:0kB min:20kB low:32kB high:44kB reserved_highatomic:0KB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15996kB managed:15360kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
- Dec 13 19:56:18 pve01 kernel: lowmem_reserve[]: 0 1862 48038 48038 48038
- Dec 13 19:56:18 pve01 kernel: Node 0 DMA32 free:186004kB boost:0kB min:2616kB low:4520kB high:6424kB reserved_highatomic:2048KB active_anon:1355136kB inactive_anon:276344kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:2031304kB managed:1965496kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
- Dec 13 19:56:18 pve01 kernel: lowmem_reserve[]: 0 0 46175 46175 46175
- Dec 13 19:56:18 pve01 kernel: Node 0 Normal free:1631216kB boost:129024kB min:193964kB low:241248kB high:288532kB reserved_highatomic:2048KB active_anon:17941688kB inactive_anon:2221476kB active_file:0kB inactive_file:40kB unevictable:152776kB writepending:72kB present:48234496kB managed:47292404kB mlocked:152776kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
- Dec 13 19:56:18 pve01 kernel: lowmem_reserve[]: 0 0 0 0 0
- Dec 13 19:56:18 pve01 kernel: Node 0 DMA: 0*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 1*1024kB (U) 1*2048kB (M) 2*4096kB (M) = 11264kB
- Dec 13 19:56:18 pve01 kernel: Node 0 DMA32: 872*4kB (ME) 17*8kB (ME) 6*16kB (UME) 7*32kB (UME) 5*64kB (UME) 8*128kB (UME) 144*256kB (UME) 143*512kB (UM) 67*1024kB (UE) 1*2048kB (M) 0*4096kB = 186024kB
- Dec 13 19:56:18 pve01 kernel: Node 0 Normal: 6571*4kB (UM) 200568*8kB (UE) 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 1630828kB
- Dec 13 19:56:18 pve01 kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
- Dec 13 19:56:18 pve01 kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
- Dec 13 19:56:18 pve01 kernel: 22682 total pagecache pages
- Dec 13 19:56:18 pve01 kernel: 0 pages in swap cache
- Dec 13 19:56:18 pve01 kernel: Free swap = 0kB
- Dec 13 19:56:18 pve01 kernel: Total swap = 0kB
- Dec 13 19:56:18 pve01 kernel: 12570449 pages RAM
- Dec 13 19:56:18 pve01 kernel: 0 pages HighMem/MovableOnly
- Dec 13 19:56:18 pve01 kernel: 252134 pages reserved
- Dec 13 19:56:18 pve01 kernel: 0 pages hwpoisoned
- Dec 13 19:56:18 pve01 kernel: Tasks state (memory values in pages):
- Dec 13 19:56:18 pve01 kernel: [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name
- Dec 13 19:56:18 pve01 kernel: [ 680] 0 680 6867 1024 73728 0 -1000 systemd-udevd
- Dec 13 19:56:18 pve01 kernel: [ 1349] 103 1349 1969 544 49152 0 0 rpcbind
- Dec 13 19:56:18 pve01 kernel: [ 1351] 102 1351 2293 672 53248 0 -900 dbus-daemon
- Dec 13 19:56:18 pve01 kernel: [ 1355] 0 1355 38187 320 61440 0 -1000 lxcfs
- Dec 13 19:56:18 pve01 kernel: [ 1357] 0 1357 1766 435 49152 0 0 ksmtuned
- Dec 13 19:56:18 pve01 kernel: [ 1358] 0 1358 69539 448 86016 0 0 pve-lxc-syscall
- Dec 13 19:56:18 pve01 kernel: [ 1365] 0 1365 55444 672 77824 0 0 rsyslogd
- Dec 13 19:56:18 pve01 kernel: [ 1366] 0 1366 1327 352 49152 0 0 qmeventd
- Dec 13 19:56:18 pve01 kernel: [ 1371] 0 1371 3063 840 57344 0 0 smartd
- Dec 13 19:56:18 pve01 kernel: [ 1372] 0 1372 4163 1088 69632 0 0 systemd-logind
- Dec 13 19:56:18 pve01 kernel: [ 1373] 0 1373 583 256 36864 0 -1000 watchdog-mux
- Dec 13 19:56:18 pve01 kernel: [ 1380] 0 1380 60197 960 86016 0 0 zed
- Dec 13 19:56:18 pve01 kernel: [ 1620] 0 1620 1256 320 49152 0 0 lxc-monitord
- Dec 13 19:56:18 pve01 kernel: [ 1632] 112 1632 6120 1856 86016 0 0 snmpd
- Dec 13 19:56:18 pve01 kernel: [ 1643] 0 1643 3333 396 61440 0 0 iscsid
- Dec 13 19:56:18 pve01 kernel: [ 1644] 0 1644 3459 3343 65536 0 -17 iscsid
- Dec 13 19:56:18 pve01 kernel: [ 1653] 0 1653 3852 1376 69632 0 -1000 sshd
- Dec 13 19:56:18 pve01 kernel: [ 1656] 0 1656 1468 416 53248 0 0 agetty
- Dec 13 19:56:18 pve01 kernel: [ 1692] 101 1692 4715 746 61440 0 0 chronyd
- Dec 13 19:56:18 pve01 kernel: [ 1696] 101 1696 2633 530 61440 0 0 chronyd
- Dec 13 19:56:18 pve01 kernel: [ 1725] 0 1725 181857 756 180224 0 0 rrdcached
- Dec 13 19:56:18 pve01 kernel: [ 1752] 0 1752 211885 15847 446464 0 0 pmxcfs
- Dec 13 19:56:18 pve01 kernel: [ 1823] 0 1823 10664 613 69632 0 0 master
- Dec 13 19:56:18 pve01 kernel: [ 1825] 106 1825 10774 768 73728 0 0 qmgr
- Dec 13 19:56:18 pve01 kernel: [ 1830] 0 1830 139331 41162 397312 0 0 corosync
- Dec 13 19:56:18 pve01 kernel: [ 1831] 0 1831 1652 576 53248 0 0 cron
- Dec 13 19:56:18 pve01 kernel: [ 1848] 0 1848 72412 24657 319488 0 0 pve-firewall
- Dec 13 19:56:18 pve01 kernel: [ 1851] 0 1851 72366 25413 323584 0 0 pvestatd
- Dec 13 19:56:18 pve01 kernel: [ 1853] 0 1853 615 224 40960 0 0 bpfilter_umh
- Dec 13 19:56:18 pve01 kernel: [ 1878] 0 1878 91374 33964 413696 0 0 pvedaemon
- Dec 13 19:56:18 pve01 kernel: [ 1885] 0 1885 87928 27919 376832 0 0 pve-ha-crm
- Dec 13 19:56:18 pve01 kernel: [ 1925] 33 1925 91726 35620 458752 0 0 pveproxy
- Dec 13 19:56:18 pve01 kernel: [ 1961] 33 1961 20197 14208 200704 0 0 spiceproxy
- Dec 13 19:56:18 pve01 kernel: [ 1963] 0 1963 87791 27823 380928 0 0 pve-ha-lrm
- Dec 13 19:56:18 pve01 kernel: [ 1978] 0 1978 3290 1255 61440 0 0 swtpm
- Dec 13 19:56:18 pve01 kernel: [ 1986] 0 1986 7804326 6309420 52912128 0 0 kvm
- Dec 13 19:56:18 pve01 kernel: [ 2281] 0 2281 86713 28151 368640 0 0 pvescheduler
- Dec 13 19:56:18 pve01 kernel: [ 119516] 0 119516 93573 35149 430080 0 0 pvedaemon worke
- Dec 13 19:56:18 pve01 kernel: [ 121139] 0 121139 93573 35149 430080 0 0 pvedaemon worke
- Dec 13 19:56:18 pve01 kernel: [ 128336] 0 128336 93573 34989 430080 0 0 pvedaemon worke
- Dec 13 19:56:18 pve01 kernel: [ 744165] 0 744165 19796 480 49152 0 0 pvefw-logger
- Dec 13 19:56:18 pve01 kernel: [ 744169] 33 744169 20247 13131 184320 0 0 spiceproxy work
- Dec 13 19:56:18 pve01 kernel: [ 744171] 33 744171 91759 35021 421888 0 0 pveproxy worker
- Dec 13 19:56:18 pve01 kernel: [ 744172] 33 744172 91759 35053 421888 0 0 pveproxy worker
- Dec 13 19:56:18 pve01 kernel: [ 744173] 33 744173 91759 35021 421888 0 0 pveproxy worker
- Dec 13 19:56:18 pve01 kernel: [1087653] 106 1087653 10763 800 73728 0 0 pickup
- Dec 13 19:56:18 pve01 kernel: [1111509] 0 1111509 88521 28247 380928 0 0 pvescheduler
- Dec 13 19:56:18 pve01 kernel: [1111510] 0 1111510 88521 28151 393216 0 0 pvescheduler
- Dec 13 19:56:18 pve01 kernel: [1111723] 0 1111723 1366 352 49152 0 0 sleep
- Dec 13 19:56:18 pve01 kernel: [1111769] 0 1111769 72412 23635 303104 0 0 pve-firewall
- Dec 13 19:56:18 pve01 kernel: oom-kill:constraint=CONSTRAINT_NONE,nodemask=(null),cpuset=init.scope,mems_allowed=0,global_oom,task_memcg=/qemu.slice/102.scope,task=kvm,pid=1986,uid=0
- Dec 13 19:56:18 pve01 kernel: Out of memory: Killed process 1986 (kvm) total-vm:31217304kB, anon-rss:25235120kB, file-rss:2560kB, shmem-rss:0kB, UID:0 pgtables:51672kB oom_score_adj:0
- Dec 13 19:56:18 pve01 systemd: Starting systemd-journald.service - Journal Service...
- Dec 13 19:56:18 pve01 systemd: 102.scope: A process of this unit has been killed by the OOM killer.
- Dec 13 19:56:18 pve01 systemd: 102.scope: Failed with result 'oom-kill'.
- Dec 13 19:56:18 pve01 systemd: 102.scope: Consumed 1w 4d 43min 40.536s CPU time.
- Dec 13 19:56:18 pve01 kernel: zd16: p1
- Dec 13 19:56:18 pve01 systemd-journald[1111771]: Journal started
- Dec 13 19:56:18 pve01 systemd-journald[1111771]: System Journal (/var/log/journal/5e3855d3c35e41a7bb73a557f49189db) is 284.8M, max 4.0G, 3.7G free.
- Dec 13 19:56:18 pve01 systemd[1]: systemd-journald.service: Watchdog timeout (limit 3min)!
- Dec 13 19:56:18 pve01 pve-ha-lrm[1963]: loop take too long (49 seconds)
- Dec 13 19:56:18 pve01 systemd: Started systemd-journald.service - Journal Service.
- Dec 13 19:56:18 pve01 systemd[1]: systemd-journald.service: Killing process 653 (systemd-journal) with signal SIGABRT.
- Dec 13 19:56:18 pve01 pvestatd[1851]: closing with write buffer at /usr/share/perl5/IO/Multiplex.pm line 928.
- Dec 13 19:56:18 pve01 pvestatd[1851]: VM 102 qmp command failed - VM 102 qmp command 'query-proxmox-support' failed - got timeout
- Dec 13 19:56:18 pve01 pve-ha-lrm[1963]: loop take too long (52 seconds)
- Dec 13 19:56:18 pve01 pvestatd[1851]: got timeout
- Dec 13 19:56:18 pve01 pvestatd[1851]: unable to activate storage 'local' - directory '/var/lib/vz' does not exist or is unreachable
- Dec 13 19:56:18 pve01 pvestatd[1851]: command 'zfs get -o value -Hp available,used rpool/data' failed: got timeout
- Dec 13 19:56:18 pve01 pve-ha-lrm[1963]: loop take too long (65 seconds)
- Dec 13 19:56:18 pve01 pve-firewall[1848]: firewall update time (209.158 seconds)
- Dec 13 19:56:18 pve01 pve-ha-lrm[1963]: loop take too long (62 seconds)
- Dec 13 19:56:18 pve01 pve-ha-lrm[1963]: loop take too long (55 seconds)
- Dec 13 19:56:18 pve01 pve-firewall[1848]: firewall update time (196.009 seconds)
- Dec 13 19:56:18 pve01 pve-ha-crm[1885]: loop take too long (32 seconds)
- Dec 13 19:56:18 pve01 pvestatd[1851]: proxmox-backup-client failed: Error: channel closed
- Dec 13 19:56:18 pve01 pve-ha-lrm[1963]: loop take too long (69 seconds)
- Dec 13 19:56:18 pve01 pve-firewall[1848]: firewall update time (31.817 seconds)
- Dec 13 19:56:18 pve01 pvestatd[1851]: status update time (456.473 seconds)
- Dec 13 19:56:18 pve01 pve-firewall[1848]: firewall update time (9.455 seconds)
- Dec 13 19:56:18 pve01 pve-firewall[1848]: firewall update time (5.962 seconds)
- Dec 13 19:56:18 pve01 pve-firewall[1848]: firewall update time (8.533 seconds)
- Dec 13 19:56:18 pve01 pve-firewall[1848]: firewall update time (7.883 seconds)
- Dec 13 19:56:18 pve01 pvescheduler[1111510]: jobs: 'file-jobs_cfg'-locked command timed out - aborting
- Dec 13 19:56:18 pve01 pve-firewall[1848]: firewall update time (8.454 seconds)
- Dec 13 19:56:19 pve01 kernel: fwbr102i0: port 2(tap102i0) entered disabled state
- Dec 13 19:56:19 pve01 kernel: tap102i0 (unregistering): left allmulticast mode
- Dec 13 19:56:19 pve01 kernel: fwbr102i0: port 2(tap102i0) entered disabled state
- Dec 13 19:56:20 pve01 qmeventd[1111804]: Starting cleanup for 102
- Dec 13 19:56:20 pve01 kernel: fwbr102i0: port 1(fwln102i0) entered disabled state
- Dec 13 19:56:20 pve01 kernel: vmbr0: port 2(fwpr102p0) entered disabled state
- Dec 13 19:56:20 pve01 kernel: fwln102i0 (unregistering): left allmulticast mode
- Dec 13 19:56:20 pve01 kernel: fwln102i0 (unregistering): left promiscuous mode
- Dec 13 19:56:20 pve01 kernel: fwbr102i0: port 1(fwln102i0) entered disabled state
- Dec 13 19:56:20 pve01 kernel: fwpr102p0 (unregistering): left allmulticast mode
- Dec 13 19:56:20 pve01 kernel: fwpr102p0 (unregistering): left promiscuous mode
- Dec 13 19:56:20 pve01 kernel: vmbr0: port 2(fwpr102p0) entered disabled state
- Dec 13 19:56:21 pve01 qmeventd[1111804]: Finished cleanup for 102
- Dec 13 19:56:21 pve01 kernel: oom_reaper: reaped process 1986 (kvm), now anon-rss:272kB, file-rss:468kB, shmem-rss:0kB
- Dec 13 19:56:22 pve01 systemd[1]: qemu.slice: A process of this unit has been killed by the OOM killer.
- Dec 13 19:57:19 pve01 pvestatd[1851]: status update time (110.661 seconds)
- Dec 13 19:57:28 pve01 kernel: zd64: p1 p2
- Dec 13 19:57:28 pve01 kernel: zd32: p1 p2 p3 p4
- Dec 13 20:02:26 pve01 systemd[1]: Starting apt-daily.service - Daily apt download activities...
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement