API tools faq
paste
Guest User

Untitled

a guest
Oct 20th, 2023
221
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 17.49 KB | None | 0 0
raw download clone embed print report
  1. 2023-10-20T03:57:00.416882+02:00 pvesrv kernel: [1169061.815497] kvm invoked oom-killer: gfp_mask=0x140cca(GFP_HIGHUSER_MOVABLE|__GFP_COMP), order=0, oom_score_adj=0
  2. 2023-10-20T03:57:00.469155+02:00 pvesrv kernel: [1169061.815520] CPU: 0 PID: 2582625 Comm: kvm Tainted: P O 6.2.16-3-pve #1
  3. 2023-10-20T03:57:00.478447+02:00 pvesrv kernel: [1169061.815526] Hardware name: Default string Default string/ZimaBoard 832, BIOS 5.12 07/26/2022
  4. 2023-10-20T03:57:00.478465+02:00 pvesrv kernel: [1169061.815529] Call Trace:
  5. 2023-10-20T03:57:00.478466+02:00 pvesrv kernel: [1169061.815534] <TASK>
  6. 2023-10-20T03:57:00.478467+02:00 pvesrv kernel: [1169061.815541] dump_stack_lvl+0x48/0x70
  7. 2023-10-20T03:57:00.478468+02:00 pvesrv kernel: [1169061.815553] dump_stack+0x10/0x20
  8. 2023-10-20T03:57:00.478469+02:00 pvesrv kernel: [1169061.815556] dump_header+0x50/0x290
  9. 2023-10-20T03:57:00.478470+02:00 pvesrv kernel: [1169061.815562] oom_kill_process+0x10d/0x1c0
  10. 2023-10-20T03:57:00.478481+02:00 pvesrv kernel: [1169061.815566] out_of_memory+0x23c/0x570
  11. 2023-10-20T03:57:00.478482+02:00 pvesrv kernel: [1169061.815570] __alloc_pages+0x1180/0x13a0
  12. 2023-10-20T03:57:00.478483+02:00 pvesrv kernel: [1169061.815579] alloc_pages+0x90/0x1a0
  13. 2023-10-20T03:57:00.478484+02:00 pvesrv kernel: [1169061.815584] ? raw_spin_rq_unlock+0x10/0x40
  14. 2023-10-20T03:57:00.478484+02:00 pvesrv kernel: [1169061.815591] folio_alloc+0x1d/0x60
  15. 2023-10-20T03:57:00.478485+02:00 pvesrv kernel: [1169061.815595] filemap_alloc_folio+0xfd/0x110
  16. 2023-10-20T03:57:00.478486+02:00 pvesrv kernel: [1169061.815600] __filemap_get_folio+0x1d4/0x3c0
  17. 2023-10-20T03:57:00.478487+02:00 pvesrv kernel: [1169061.815605] filemap_fault+0x14a/0x940
  18. 2023-10-20T03:57:00.478488+02:00 pvesrv kernel: [1169061.815609] ? filemap_map_pages+0x14b/0x6f0
  19. 2023-10-20T03:57:00.478489+02:00 pvesrv kernel: [1169061.815614] __do_fault+0x39/0x150
  20. 2023-10-20T03:57:00.478490+02:00 pvesrv kernel: [1169061.815620] do_fault+0x1c7/0x430
  21. 2023-10-20T03:57:00.478490+02:00 pvesrv kernel: [1169061.815623] __handle_mm_fault+0x6d9/0x1070
  22. 2023-10-20T03:57:00.478491+02:00 pvesrv kernel: [1169061.815629] handle_mm_fault+0x119/0x330
  23. 2023-10-20T03:57:00.478492+02:00 pvesrv kernel: [1169061.815633] do_user_addr_fault+0x1c1/0x720
  24. 2023-10-20T03:57:00.478493+02:00 pvesrv kernel: [1169061.815639] exc_page_fault+0x80/0x1b0
  25. 2023-10-20T03:57:00.478494+02:00 pvesrv kernel: [1169061.815645] asm_exc_page_fault+0x27/0x30
  26. 2023-10-20T03:57:00.478495+02:00 pvesrv kernel: [1169061.815652] RIP: 0033:0x55e84f79ffc3
  27. 2023-10-20T03:57:00.478496+02:00 pvesrv kernel: [1169061.815667] Code: Unable to access opcode bytes at 0x55e84f79ff99.
  28. 2023-10-20T03:57:00.478497+02:00 pvesrv kernel: [1169061.815668] RSP: 002b:00007ffde4a03cf0 EFLAGS: 00010202
  29. 2023-10-20T03:57:00.478497+02:00 pvesrv kernel: [1169061.815675] RAX: 0000000000000000 RBX: 000055e850c3bcb8 RCX: 0000000000000000
  30. 2023-10-20T03:57:00.478498+02:00 pvesrv kernel: [1169061.815677] RDX: 0000000000000001 RSI: 0000000000000000 RDI: 000055e850c3bcb8
  31. 2023-10-20T03:57:00.478499+02:00 pvesrv kernel: [1169061.815679] RBP: 000055e84f7e6680 R08: 0000000000000000 R09: 0000000000000000
  32. 2023-10-20T03:57:00.478500+02:00 pvesrv kernel: [1169061.815681] R10: 0000000000000000 R11: 0000000000000000 R12: 000000000000007a
  33. 2023-10-20T03:57:00.478501+02:00 pvesrv kernel: [1169061.815683] R13: 000055e85008f810 R14: 000055e8500b0f68 R15: 00007ffde4a03da0
  34. 2023-10-20T03:57:00.478502+02:00 pvesrv kernel: [1169061.815689] </TASK>
  35. 2023-10-20T03:57:00.478503+02:00 pvesrv kernel: [1169061.815691] Mem-Info:
  36. 2023-10-20T03:57:00.478503+02:00 pvesrv kernel: [1169061.815695] active_anon:1456757 inactive_anon:387623 isolated_anon:0
  37. 2023-10-20T03:57:00.478504+02:00 pvesrv kernel: [1169061.815695] active_file:497 inactive_file:1451 isolated_file:59
  38. 2023-10-20T03:57:00.478506+02:00 pvesrv kernel: [1169061.815695] unevictable:6385 dirty:0 writeback:0
  39. 2023-10-20T03:57:00.478507+02:00 pvesrv kernel: [1169061.815695] slab_reclaimable:8529 slab_unreclaimable:54578
  40. 2023-10-20T03:57:00.478507+02:00 pvesrv kernel: [1169061.815695] mapped:12882 shmem:10453 pagetables:7277
  41. 2023-10-20T03:57:00.478508+02:00 pvesrv kernel: [1169061.815695] sec_pagetables:3519 bounce:0
  42. 2023-10-20T03:57:00.478509+02:00 pvesrv kernel: [1169061.815695] kernel_misc_reclaimable:0
  43. 2023-10-20T03:57:00.478510+02:00 pvesrv kernel: [1169061.815695] free:26315 free_pcp:88 free_cma:0
  44. 2023-10-20T03:57:00.478511+02:00 pvesrv kernel: [1169061.815704] Node 0 active_anon:5827028kB inactive_anon:1550492kB active_file:1988kB inactive_file:5976kB unevictable:25540kB isolated(anon):0kB isolated(file):236kB mapped:51528kB dirty:0kB writeback:0kB shmem:41812kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 1050624kB writeback_tmp:0kB kernel_stack:4624kB pagetables:29108kB sec_pagetables:14076kB all_unreclaimable? yes
  45. 2023-10-20T03:57:00.478512+02:00 pvesrv kernel: [1169061.815712] Node 0 DMA free:14336kB boost:0kB min:128kB low:160kB high:192kB reserved_highatomic:0KB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15988kB managed:15360kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
  46. 2023-10-20T03:57:00.478514+02:00 pvesrv kernel: [1169061.815721] lowmem_reserve[]: 0 1753 7695 7695 7695
  47. 2023-10-20T03:57:00.478514+02:00 pvesrv kernel: [1169061.815728] Node 0 DMA32 free:39068kB boost:0kB min:15368kB low:19208kB high:23048kB reserved_highatomic:0KB active_anon:1499716kB inactive_anon:257124kB active_file:1224kB inactive_file:4236kB unevictable:0kB writepending:0kB present:1921536kB managed:1855996kB mlocked:0kB bounce:0kB free_pcp:52kB local_pcp:0kB free_cma:0kB
  48. 2023-10-20T03:57:00.478515+02:00 pvesrv kernel: [1169061.815737] lowmem_reserve[]: 0 0 5942 5942 5942
  49. 2023-10-20T03:57:00.478516+02:00 pvesrv kernel: [1169061.815743] Node 0 Normal free:51856kB boost:0kB min:52080kB low:65100kB high:78120kB reserved_highatomic:0KB active_anon:4327124kB inactive_anon:1293368kB active_file:644kB inactive_file:1912kB unevictable:25540kB writepending:0kB present:6291456kB managed:6093224kB mlocked:25416kB bounce:0kB free_pcp:300kB local_pcp:60kB free_cma:0kB
  50. 2023-10-20T03:57:00.478517+02:00 pvesrv kernel: [1169061.815752] lowmem_reserve[]: 0 0 0 0 0
  51. 2023-10-20T03:57:00.478518+02:00 pvesrv kernel: [1169061.815759] Node 0 DMA: 0*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB (M) 3*4096kB (M) = 14336kB
  52. 2023-10-20T03:57:00.478519+02:00 pvesrv kernel: [1169061.815778] Node 0 DMA32: 1364*4kB (UME) 1311*8kB (UME) 632*16kB (UME) 182*32kB (UME) 39*64kB (UME) 10*128kB (UME) 3*256kB (U) 3*512kB (UM) 2*1024kB (U) 0*2048kB 0*4096kB = 40008kB
  53. 2023-10-20T03:57:00.478520+02:00 pvesrv kernel: [1169061.815803] Node 0 Normal: 1646*4kB (UME) 697*8kB (UME) 437*16kB (UME) 217*32kB (UME) 94*64kB (UME) 41*128kB (UE) 19*256kB (UM) 10*512kB (U) 5*1024kB (UM) 0*2048kB 0*4096kB = 52464kB
  54. 2023-10-20T03:57:00.478521+02:00 pvesrv kernel: [1169061.815829] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
  55. 2023-10-20T03:57:00.478522+02:00 pvesrv kernel: [1169061.815832] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
  56. 2023-10-20T03:57:00.478522+02:00 pvesrv kernel: [1169061.815835] 15254 total pagecache pages
  57. 2023-10-20T03:57:00.478523+02:00 pvesrv kernel: [1169061.815836] 0 pages in swap cache
  58. 2023-10-20T03:57:00.478524+02:00 pvesrv kernel: [1169061.815838] Free swap = 0kB
  59. 2023-10-20T03:57:00.478525+02:00 pvesrv kernel: [1169061.815839] Total swap = 0kB
  60. 2023-10-20T03:57:00.478525+02:00 pvesrv kernel: [1169061.815841] 2057245 pages RAM
  61. 2023-10-20T03:57:00.478526+02:00 pvesrv kernel: [1169061.815842] 0 pages HighMem/MovableOnly
  62. 2023-10-20T03:57:00.478527+02:00 pvesrv kernel: [1169061.815843] 66100 pages reserved
  63. 2023-10-20T03:57:00.478528+02:00 pvesrv kernel: [1169061.815845] 0 pages hwpoisoned
  64. 2023-10-20T03:57:00.478529+02:00 pvesrv kernel: [1169061.815847] Tasks state (memory values in pages):
  65. 2023-10-20T03:57:00.478529+02:00 pvesrv kernel: [1169061.815848] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name
  66. 2023-10-20T03:57:00.478530+02:00 pvesrv kernel: [1169061.815867] [ 333] 0 333 14408 992 143360 0 -250 systemd-journal
  67. 2023-10-20T03:57:00.478531+02:00 pvesrv kernel: [1169061.815874] [ 352] 0 352 20145 6272 94208 0 -1000 dmeventd
  68. 2023-10-20T03:57:00.478532+02:00 pvesrv kernel: [1169061.815881] [ 367] 0 367 6775 1045 81920 0 -1000 systemd-udevd
  69. 2023-10-20T03:57:00.478533+02:00 pvesrv kernel: [1169061.815887] [ 596] 103 596 1969 800 61440 0 0 rpcbind
  70. 2023-10-20T03:57:00.478533+02:00 pvesrv kernel: [1169061.815892] [ 605] 0 605 1208 320 49152 0 0 blkmapd
  71. 2023-10-20T03:57:00.478534+02:00 pvesrv kernel: [1169061.815897] [ 694] 101 694 2316 960 53248 0 -900 dbus-daemon
  72. 2023-10-20T03:57:00.478535+02:00 pvesrv kernel: [1169061.815902] [ 699] 0 699 38187 480 61440 0 -1000 lxcfs
  73. 2023-10-20T03:57:00.478536+02:00 pvesrv kernel: [1169061.815906] [ 705] 0 705 1766 275 49152 0 0 ksmtuned
  74. 2023-10-20T03:57:00.478536+02:00 pvesrv kernel: [1169061.815911] [ 711] 0 711 69539 800 81920 0 0 pve-lxc-syscall
  75. 2023-10-20T03:57:00.478537+02:00 pvesrv kernel: [1169061.815916] [ 716] 0 716 55444 1088 81920 0 0 rsyslogd
  76. 2023-10-20T03:57:00.478538+02:00 pvesrv kernel: [1169061.815921] [ 718] 0 718 2926 1120 61440 0 0 smartd
  77. 2023-10-20T03:57:00.478539+02:00 pvesrv kernel: [1169061.815926] [ 723] 0 723 1327 352 49152 0 0 qmeventd
  78. 2023-10-20T03:57:00.478539+02:00 pvesrv kernel: [1169061.815930] [ 729] 0 729 12486 928 94208 0 0 systemd-logind
  79. 2023-10-20T03:57:00.478540+02:00 pvesrv kernel: [1169061.815934] [ 731] 0 731 583 320 40960 0 -1000 watchdog-mux
  80. 2023-10-20T03:57:00.478541+02:00 pvesrv kernel: [1169061.815939] [ 736] 0 736 41731 832 77824 0 0 zed
  81. 2023-10-20T03:57:00.478542+02:00 pvesrv kernel: [1169061.815944] [ 756] 0 756 1256 512 45056 0 0 lxc-monitord
  82. 2023-10-20T03:57:00.478542+02:00 pvesrv kernel: [1169061.815948] [ 767] 0 767 3851 1088 69632 0 -1000 sshd
  83. 2023-10-20T03:57:00.478543+02:00 pvesrv kernel: [1169061.815953] [ 769] 0 769 1468 384 49152 0 0 agetty
  84. 2023-10-20T03:57:00.478544+02:00 pvesrv kernel: [1169061.815958] [ 818] 0 818 237160 823 192512 0 0 rrdcached
  85. 2023-10-20T03:57:00.478545+02:00 pvesrv kernel: [1169061.815962] [ 849] 0 849 276071 13575 430080 0 0 pmxcfs
  86. 2023-10-20T03:57:00.478546+02:00 pvesrv kernel: [1169061.815966] [ 948] 0 948 10664 549 81920 0 0 master
  87. 2023-10-20T03:57:00.478546+02:00 pvesrv kernel: [1169061.815971] [ 950] 104 950 10809 640 77824 0 0 qmgr
  88. 2023-10-20T03:57:00.478547+02:00 pvesrv kernel: [1169061.815976] [ 955] 0 955 1652 480 53248 0 0 cron
  89. 2023-10-20T03:57:00.478548+02:00 pvesrv kernel: [1169061.815981] [ 962] 0 962 37381 23069 278528 0 0 pve-firewall
  90. 2023-10-20T03:57:00.478548+02:00 pvesrv kernel: [1169061.815985] [ 965] 0 965 36120 21752 290816 0 0 pvestatd
  91. 2023-10-20T03:57:00.478549+02:00 pvesrv kernel: [1169061.815990] [ 967] 0 967 615 256 45056 0 0 bpfilter_umh
  92. 2023-10-20T03:57:00.478550+02:00 pvesrv kernel: [1169061.815995] [ 992] 0 992 55809 31785 368640 0 0 pvedaemon
  93. 2023-10-20T03:57:00.478551+02:00 pvesrv kernel: [1169061.816000] [ 1000] 0 1000 52837 26391 331776 0 0 pve-ha-crm
  94. 2023-10-20T03:57:00.478610+02:00 pvesrv kernel: [1169061.816005] [ 1001] 33 1001 56225 32686 434176 0 0 pveproxy
  95. 2023-10-20T03:57:00.478612+02:00 pvesrv kernel: [1169061.816009] [ 1008] 33 1008 19668 13120 200704 0 0 spiceproxy
  96. 2023-10-20T03:57:00.478613+02:00 pvesrv kernel: [1169061.816013] [ 1010] 0 1010 52706 26260 335872 0 0 pve-ha-lrm
  97. 2023-10-20T03:57:00.478614+02:00 pvesrv kernel: [1169061.816018] [ 1065] 0 1065 585415 267213 3260416 0 0 kvm
  98. 2023-10-20T03:57:00.478615+02:00 pvesrv kernel: [1169061.816025] [ 1235] 106 1235 1133 457 49152 0 0 rpc.statd
  99. 2023-10-20T03:57:00.478616+02:00 pvesrv kernel: [1169061.816030] [ 1339] 0 1339 51612 26377 327680 0 0 pvescheduler
  100. 2023-10-20T03:57:00.478617+02:00 pvesrv kernel: [1169061.816035] [ 1576] 0 1576 621642 399449 4169728 0 0 kvm
  101. 2023-10-20T03:57:00.478617+02:00 pvesrv kernel: [1169061.816040] [ 1633] 0 1633 623441 403017 4157440 0 0 kvm
  102. 2023-10-20T03:57:00.478618+02:00 pvesrv kernel: [1169061.816045] [2286374] 0 2286374 141847 805 143360 0 0 automount
  103. 2023-10-20T03:57:00.478619+02:00 pvesrv kernel: [1169061.816050] [2582625] 0 2582625 464913 259032 3141632 0 0 kvm
  104. 2023-10-20T03:57:00.478620+02:00 pvesrv kernel: [1169061.816056] [3060017] 0 3060017 58171 32730 421888 0 0 pvedaemon worke
  105. 2023-10-20T03:57:00.478621+02:00 pvesrv kernel: [1169061.816060] [3465124] 0 3465124 1016828 792847 7352320 0 0 kvm
  106. 2023-10-20T03:57:00.478622+02:00 pvesrv kernel: [1169061.816065] [3465881] 0 3465881 58023 32426 405504 0 0 pvedaemon worke
  107. 2023-10-20T03:57:00.478623+02:00 pvesrv kernel: [1169061.816070] [3466614] 0 3466614 58066 32362 405504 0 0 pvedaemon worke
  108. 2023-10-20T03:57:00.478624+02:00 pvesrv kernel: [1169061.816074] [3495491] 0 3495491 19796 384 53248 0 0 pvefw-logger
  109. 2023-10-20T03:57:00.478624+02:00 pvesrv kernel: [1169061.816078] [3495496] 33 3495496 19730 12942 180224 0 0 spiceproxy work
  110. 2023-10-20T03:57:00.478625+02:00 pvesrv kernel: [1169061.816083] [3495497] 33 3495497 56264 32347 393216 0 0 pveproxy worker
  111. 2023-10-20T03:57:00.478628+02:00 pvesrv kernel: [1169061.816087] [3495498] 33 3495498 56264 32379 393216 0 0 pveproxy worker
  112. 2023-10-20T03:57:00.478628+02:00 pvesrv kernel: [1169061.816091] [3495499] 33 3495499 56264 32347 393216 0 0 pveproxy worker
  113. 2023-10-20T03:57:00.478629+02:00 pvesrv kernel: [1169061.816096] [3524734] 104 3524734 10764 704 77824 0 0 pickup
  114. 2023-10-20T03:57:00.478630+02:00 pvesrv kernel: [1169061.816105] [3537655] 0 3537655 1894 448 57344 0 0 ebtables-save
  115. 2023-10-20T03:57:00.478631+02:00 pvesrv kernel: [1169061.816109] [3537659] 0 3537659 53420 26441 339968 0 0 pvescheduler
  116. 2023-10-20T03:57:00.478632+02:00 pvesrv kernel: [1169061.816114] [3537667] 0 3537667 1766 247 49152 0 0 ksmtuned
  117. 2023-10-20T03:57:00.478633+02:00 pvesrv kernel: [1169061.816119] [3537668] 0 3537668 2771 896 61440 0 0 ps
  118. 2023-10-20T03:57:00.478634+02:00 pvesrv kernel: [1169061.816123] [3537669] 0 3537669 1637 416 53248 0 0 awk
  119. 2023-10-20T03:57:00.478635+02:00 pvesrv kernel: [1169061.816128] oom-kill:constraint=CONSTRAINT_NONE,nodemask=(null),cpuset=qemu.slice,mems_allowed=0,global_oom,task_memcg=/qemu.slice/101.scope,task=kvm,pid=3465124,uid=0
  120. 2023-10-20T03:57:00.478636+02:00 pvesrv kernel: [1169061.816197] Out of memory: Killed process 3465124 (kvm) total-vm:4067312kB, anon-rss:3169724kB, file-rss:1664kB, shmem-rss:0kB, UID:0 pgtables:7180kB oom_score_adj:0
  121. 2023-10-20T03:57:00.848655+02:00 pvesrv pvescheduler[3537660]: jobs: cfs-lock 'file-jobs_cfg' error: got lock request timeout
  122. 2023-10-20T03:57:00.856413+02:00 pvesrv systemd[1]: 101.scope: A process of this unit has been killed by the OOM killer.
  123. 2023-10-20T03:57:00.865962+02:00 pvesrv pvescheduler[3537659]: replication: cfs-lock 'file-replication_cfg' error: got lock request timeout
  124. 2023-10-20T03:57:00.866190+02:00 pvesrv systemd[1]: 101.scope: Failed with result 'oom-kill'.
  125. 2023-10-20T03:57:00.866924+02:00 pvesrv pve-firewall[962]: firewall update time (134.615 seconds)
  126. 2023-10-20T03:57:00.868014+02:00 pvesrv systemd[1]: 101.scope: Consumed 2h 43min 51.866s CPU time.
  127. 2023-10-20T03:57:00.997318+02:00 pvesrv kernel: [1169062.582703] vmbr0: port 3(tap101i0) entered disabled state
  128. 2023-10-20T03:57:00.997352+02:00 pvesrv kernel: [1169062.583853] vmbr0: port 3(tap101i0) entered disabled state
  129. 2023-10-20T03:57:01.259237+02:00 pvesrv pvestatd[965]: status update time (133.583 seconds)
  130. 2023-10-20T03:57:03.928787+02:00 pvesrv qmeventd[3537723]: Starting cleanup for 101
  131. 2023-10-20T03:57:03.981969+02:00 pvesrv qmeventd[3537723]: Finished cleanup for 101
  132. 2023-10-20T03:57:05.451050+02:00 pvesrv pve-ha-crm[1000]: loop take too long (32 seconds)
  133. 2023-10-20T03:57:05.554632+02:00 pvesrv pve-ha-lrm[1010]: loop take too long (90 seconds)
Advertisement
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!