Advertisement
Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- root@pve3[03:27 PM]:~ pveversion
- pve-manager/6.4-13/9f411e79 (running kernel: 5.4.65-1-pve)
- root@pve3[03:27 PM]:~ uname -r
- 5.4.65-1-pve
- root@pve3[03:27 PM]:~ dpkg -l|grep linstor
- ii linstor-client 1.10.2-1 all Linstor client command line tool
- ii linstor-common 1.16.0-1 all DRBD distributed resource management utility
- ii linstor-proxmox 5.2.2-1 all DRBD distributed resource management utility
- ii linstor-satellite 1.16.0-1 all DRBD distributed resource management utility
- ii python-linstor 1.10.2-1 all Linstor python api library
- root@pve3[03:27 PM]:~ dpkg -l|grep drbd
- ii drbd-utils 9.19.0-1 amd64 RAID 1 over TCP/IP for Linux (user utilities)
- ii drbdtop 0.2.3-1 amd64 like top, but for drbd
- On PVE3:
- 2021-11-23 11:58:18 use dedicated network address for sending migration traffic (10.10.13.4)
- 2021-11-23 11:58:18 starting migration of VM 107 to node 'pve4' (10.10.13.4)
- 2021-11-23 11:58:18 found local disk 'local-zfs:vm-107-disk-0' (in current VM config)
- 2021-11-23 11:58:18 starting VM 107 on remote node 'pve4'
- 2021-11-23 11:58:28 volume 'local-zfs:vm-107-disk-0' is 'linstor-thinlvm:vm-107-disk-2' on the target
- 2021-11-23 11:58:29 start remote tunnel
- 2021-11-23 11:58:29 ssh tunnel ver 1
- 2021-11-23 11:58:29 starting storage migration
- 2021-11-23 11:58:29 scsi0: start migration to nbd:10.10.13.4:60001:exportname=drive-scsi0
- drive mirror is starting for drive-scsi0
- drive-scsi0: Cancelling block job
- drive-scsi0: Done.
- 2021-11-23 11:58:30 ERROR: online migrate failure - block job (mirror) error: drive-scsi0: 'mirror' has been cancelled
- 2021-11-23 11:58:30 aborting phase 2 - cleanup resources
- 2021-11-23 11:58:30 migrate_cancel
- 2021-11-23 11:58:34 ERROR: migration finished with problems (duration 00:00:16)
- TASK ERROR: migration problems
- On PVE3:
- Nov 23 11:58:17 pve3 pvedaemon[3279335]: <root@pam> starting task UPID:pve3:003246B4:0153005A:619CD759:qmigrate:107:root@pam:
- Nov 23 11:58:19 pve3 pmxcfs[2579]: [status] notice: received log
- Nov 23 11:58:24 pve3 Satellite[2344]: 11:58:24.035 [MainWorkerPool-5] INFO LINSTOR/Satellite - SYSTEM - Resource 'vm-107-disk-2' created for node 'pve3'.
- Nov 23 11:58:24 pve3 Satellite[2344]: 11:58:24.036 [MainWorkerPool-5] INFO LINSTOR/Satellite - SYSTEM - Resource 'vm-107-disk-2' created for node 'pve4'.
- Nov 23 11:58:24 pve3 kernel: drbd vm-107-disk-2: Starting worker thread (from drbdsetup [3295219])
- Nov 23 11:58:24 pve3 kernel: drbd vm-107-disk-2 pve4: Starting sender thread (from drbdsetup [3295224])
- Nov 23 11:58:24 pve3 kernel: drbd vm-107-disk-2/0 drbd1004: meta-data IO uses: blk-bio
- Nov 23 11:58:24 pve3 kernel: drbd vm-107-disk-2/0 drbd1004: disk( Diskless -> Attaching )
- Nov 23 11:58:24 pve3 kernel: drbd vm-107-disk-2/0 drbd1004: Maximum number of peer devices = 7
- Nov 23 11:58:24 pve3 kernel: drbd vm-107-disk-2: Method to ensure write ordering: flush
- Nov 23 11:58:24 pve3 kernel: drbd vm-107-disk-2/0 drbd1004: drbd_bm_resize called with capacity == 23071856
- Nov 23 11:58:24 pve3 kernel: drbd vm-107-disk-2/0 drbd1004: resync bitmap: bits=2883982 words=315441 pages=617
- Nov 23 11:58:24 pve3 kernel: drbd1004: detected capacity change from 0 to 11812790272
- Nov 23 11:58:24 pve3 kernel: drbd vm-107-disk-2/0 drbd1004: size = 11 GB (11535928 KB)
- Nov 23 11:58:24 pve3 kernel: drbd vm-107-disk-2/0 drbd1004: recounting of set bits took additional 0ms
- Nov 23 11:58:24 pve3 kernel: drbd vm-107-disk-2/0 drbd1004: disk( Attaching -> UpToDate )
- Nov 23 11:58:24 pve3 kernel: drbd vm-107-disk-2/0 drbd1004: attached to current UUID: 9DDABB2CA8320376
- Nov 23 11:58:24 pve3 kernel: drbd vm-107-disk-2/0 drbd1004: size = 11 GB (11535928 KB)
- Nov 23 11:58:24 pve3 kernel: drbd vm-107-disk-2 pve4: conn( StandAlone -> Unconnected )
- Nov 23 11:58:24 pve3 kernel: drbd vm-107-disk-2 pve4: Starting receiver thread (from drbd_w_vm-107-d [3295220])
- Nov 23 11:58:24 pve3 kernel: drbd vm-107-disk-2 pve4: conn( Unconnected -> Connecting )
- Nov 23 11:58:25 pve3 kernel: drbd vm-107-disk-2 pve4: Handshake to peer 0 successful: Agreed network protocol version 120
- Nov 23 11:58:25 pve3 kernel: drbd vm-107-disk-2 pve4: Feature flags enabled on protocol level: 0xf TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES.
- Nov 23 11:58:25 pve3 kernel: drbd vm-107-disk-2 pve4: Peer authenticated using 20 bytes HMAC
- Nov 23 11:58:25 pve3 kernel: drbd vm-107-disk-2 pve4: Starting ack_recv thread (from drbd_r_vm-107-d [3295237])
- Nov 23 11:58:25 pve3 kernel: drbd vm-107-disk-2 pve4: Preparing remote state change 1198145819
- Nov 23 11:58:25 pve3 kernel: drbd vm-107-disk-2/0 drbd1004 pve4: drbd_sync_handshake:
- Nov 23 11:58:25 pve3 kernel: drbd vm-107-disk-2/0 drbd1004 pve4: self 9DDABB2CA8320376:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:20
- Nov 23 11:58:25 pve3 kernel: drbd vm-107-disk-2/0 drbd1004 pve4: peer 9DDABB2CA8320376:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:20
- Nov 23 11:58:25 pve3 kernel: drbd vm-107-disk-2/0 drbd1004 pve4: uuid_compare()=no-sync by rule=both-off
- Nov 23 11:58:25 pve3 kernel: drbd vm-107-disk-2 pve4: Committing remote state change 1198145819 (primary_nodes=0)
- Nov 23 11:58:25 pve3 kernel: drbd vm-107-disk-2 pve4: conn( Connecting -> Connected ) peer( Unknown -> Secondary )
- Nov 23 11:58:25 pve3 kernel: drbd vm-107-disk-2/0 drbd1004 pve4: pdsk( DUnknown -> UpToDate ) repl( Off -> Established )
- Nov 23 11:58:25 pve3 Satellite[2344]: 11:58:25.425 [MainWorkerPool-7] INFO LINSTOR/Satellite - SYSTEM - Resource 'vm-107-disk-2' updated for node 'pve3'.
- Nov 23 11:58:25 pve3 Satellite[2344]: 11:58:25.426 [MainWorkerPool-7] INFO LINSTOR/Satellite - SYSTEM - Resource 'vm-107-disk-2' updated for node 'pve4'.
- Nov 23 11:58:26 pve3 kernel: drbd vm-107-disk-2/0 drbd1004 pve4: received new current UUID: 1C113980A4AC5F98 weak_nodes=FFFFFFFFFFFFFFFC
- Nov 23 11:58:28 pve3 kernel: drbd vm-107-disk-2 pve4: Preparing remote state change 3724339323
- Nov 23 11:58:28 pve3 kernel: drbd vm-107-disk-2 pve4: Committing remote state change 3724339323 (primary_nodes=1)
- Nov 23 11:58:28 pve3 kernel: drbd vm-107-disk-2 pve4: peer( Secondary -> Primary )
- Nov 23 11:58:28 pve3 pmxcfs[2579]: [status] notice: received log
- Nov 23 11:58:30 pve3 pvedaemon[3294900]: VM 107 qmp command failed - VM 107 qmp command 'block-job-cancel' failed - Block job 'drive-scsi0' not found
- Nov 23 11:58:31 pve3 pmxcfs[2579]: [status] notice: received log
- Nov 23 11:58:31 pve3 kernel: drbd vm-107-disk-2 pve4: peer( Primary -> Secondary )
- Nov 23 11:58:31 pve3 pmxcfs[2579]: [status] notice: received log
- Nov 23 11:58:31 pve3 pmxcfs[2579]: [status] notice: received log
- Nov 23 11:58:32 pve3 Satellite[2344]: 11:58:32.625 [MainWorkerPool-1] INFO LINSTOR/Satellite - SYSTEM - Resource 'vm-107-disk-2' updated for node 'pve3'.
- Nov 23 11:58:32 pve3 Satellite[2344]: 11:58:32.625 [MainWorkerPool-1] INFO LINSTOR/Satellite - SYSTEM - Resource 'vm-107-disk-2' updated for node 'pve4'.
- Nov 23 11:58:32 pve3 kernel: drbd vm-107-disk-2 pve4: Preparing remote state change 3001061611
- Nov 23 11:58:32 pve3 kernel: drbd vm-107-disk-2 pve4: Committing remote state change 3001061611 (primary_nodes=0)
- Nov 23 11:58:32 pve3 kernel: drbd vm-107-disk-2 pve4: conn( Connected -> TearDown ) peer( Secondary -> Unknown )
- Nov 23 11:58:32 pve3 kernel: drbd vm-107-disk-2/0 drbd1004 pve4: pdsk( UpToDate -> DUnknown ) repl( Established -> Off )
- Nov 23 11:58:32 pve3 kernel: drbd vm-107-disk-2 pve4: ack_receiver terminated
- Nov 23 11:58:32 pve3 kernel: drbd vm-107-disk-2 pve4: Terminating ack_recv thread
- Nov 23 11:58:32 pve3 kernel: drbd vm-107-disk-2 pve4: Terminating sender thread
- Nov 23 11:58:32 pve3 kernel: drbd vm-107-disk-2 pve4: Starting sender thread (from drbd_r_vm-107-d [3295237])
- Nov 23 11:58:32 pve3 kernel: drbd vm-107-disk-2 pve4: conn( TearDown -> Disconnecting )
- Nov 23 11:58:32 pve3 kernel: drbd vm-107-disk-2 pve4: Connection closed
- Nov 23 11:58:32 pve3 kernel: drbd vm-107-disk-2 pve4: helper command: /sbin/drbdadm disconnected
- Nov 23 11:58:32 pve3 kernel: drbd vm-107-disk-2 pve4: helper command: /sbin/drbdadm disconnected exit code 0
- Nov 23 11:58:32 pve3 kernel: drbd vm-107-disk-2 pve4: conn( Disconnecting -> StandAlone )
- Nov 23 11:58:32 pve3 kernel: drbd vm-107-disk-2 pve4: Terminating receiver thread
- Nov 23 11:58:32 pve3 kernel: drbd vm-107-disk-2 pve4: Terminating sender thread
- Nov 23 11:58:32 pve3 kernel: drbd vm-107-disk-2/0 drbd1004: disk( UpToDate -> Detaching )
- Nov 23 11:58:32 pve3 kernel: drbd vm-107-disk-2/0 drbd1004: disk( Detaching -> Diskless )
- Nov 23 11:58:32 pve3 kernel: drbd vm-107-disk-2/0 drbd1004: drbd_bm_resize called with capacity == 0
- Nov 23 11:58:32 pve3 kernel: drbd vm-107-disk-2: Terminating worker thread
- Nov 23 11:58:33 pve3 pmxcfs[2579]: [status] notice: received log
- Nov 23 11:58:34 pve3 pvedaemon[3294900]: migration problems
- Nov 23 11:58:34 pve3 pvedaemon[3279335]: <root@pam> end task UPID:pve3:003246B4:0153005A:619CD759:qmigrate:107:root@pam: migration problems
- On PVE4:
- Nov 23 11:58:17 pve4 pmxcfs[1793]: [status] notice: received log
- Nov 23 11:58:18 pve4 sshd[9296]: Accepted publickey for root from 10.1.2.10 port 59752 ssh2: RSA SHA256:UAPE5J83ADYWPGOsDfzGUsAAjCcRsIY/Ox7BKNnYFuA
- Nov 23 11:58:18 pve4 sshd[9296]: pam_unix(sshd:session): session opened for user root by (uid=0)
- Nov 23 11:58:18 pve4 systemd[1]: Created slice User Slice of UID 0.
- Nov 23 11:58:18 pve4 systemd[1]: Starting User Runtime Directory /run/user/0...
- Nov 23 11:58:18 pve4 systemd-logind[1106]: New session 14118 of user root.
- Nov 23 11:58:18 pve4 systemd[1]: Started User Runtime Directory /run/user/0.
- Nov 23 11:58:18 pve4 systemd[1]: Starting User Manager for UID 0...
- Nov 23 11:58:18 pve4 systemd[9308]: pam_unix(systemd-user:session): session opened for user root by (uid=0)
- Nov 23 11:58:18 pve4 systemd[9308]: Reached target Timers.
- Nov 23 11:58:18 pve4 systemd[9308]: Reached target Paths.
- Nov 23 11:58:18 pve4 systemd[9308]: Listening on GnuPG network certificate management daemon.
- Nov 23 11:58:18 pve4 systemd[9308]: Listening on GnuPG cryptographic agent and passphrase cache (access for web browsers).
- Nov 23 11:58:18 pve4 systemd[9308]: Listening on GnuPG cryptographic agent and passphrase cache.
- Nov 23 11:58:18 pve4 systemd[9308]: Listening on GnuPG cryptographic agent (ssh-agent emulation).
- Nov 23 11:58:18 pve4 systemd[9308]: Listening on GnuPG cryptographic agent and passphrase cache (restricted).
- Nov 23 11:58:18 pve4 systemd[9308]: Reached target Sockets.
- Nov 23 11:58:18 pve4 systemd[9308]: Reached target Basic System.
- Nov 23 11:58:18 pve4 systemd[1]: Started User Manager for UID 0.
- Nov 23 11:58:18 pve4 systemd[9308]: Reached target Default.
- Nov 23 11:58:18 pve4 systemd[9308]: Startup finished in 58ms.
- Nov 23 11:58:18 pve4 systemd[1]: Started Session 14118 of user root.
- Nov 23 11:58:18 pve4 sshd[9296]: Received disconnect from 10.1.2.10 port 59752:11: disconnected by user
- Nov 23 11:58:18 pve4 sshd[9296]: Disconnected from user root 10.1.2.10 port 59752
- Nov 23 11:58:18 pve4 sshd[9296]: pam_unix(sshd:session): session closed for user root
- Nov 23 11:58:18 pve4 systemd[1]: session-14118.scope: Succeeded.
- Nov 23 11:58:18 pve4 systemd-logind[1106]: Session 14118 logged out. Waiting for processes to exit.
- Nov 23 11:58:18 pve4 systemd-logind[1106]: Removed session 14118.
- Nov 23 11:58:18 pve4 sshd[9351]: Accepted publickey for root from 10.10.13.3 port 47784 ssh2: RSA SHA256:UAPE5J83ADYWPGOsDfzGUsAAjCcRsIY/Ox7BKNnYFuA
- Nov 23 11:58:18 pve4 sshd[9351]: pam_unix(sshd:session): session opened for user root by (uid=0)
- Nov 23 11:58:18 pve4 systemd[1]: Started Session 14120 of user root.
- Nov 23 11:58:18 pve4 systemd-logind[1106]: New session 14120 of user root.
- Nov 23 11:58:18 pve4 sshd[9351]: Received disconnect from 10.10.13.3 port 47784:11: disconnected by user
- Nov 23 11:58:18 pve4 sshd[9351]: Disconnected from user root 10.10.13.3 port 47784
- Nov 23 11:58:18 pve4 sshd[9351]: pam_unix(sshd:session): session closed for user root
- Nov 23 11:58:18 pve4 systemd[1]: session-14120.scope: Succeeded.
- Nov 23 11:58:18 pve4 systemd-logind[1106]: Session 14120 logged out. Waiting for processes to exit.
- Nov 23 11:58:18 pve4 systemd-logind[1106]: Removed session 14120.
- Nov 23 11:58:18 pve4 sshd[9370]: Accepted publickey for root from 10.10.13.3 port 47786 ssh2: RSA SHA256:UAPE5J83ADYWPGOsDfzGUsAAjCcRsIY/Ox7BKNnYFuA
- Nov 23 11:58:18 pve4 sshd[9370]: pam_unix(sshd:session): session opened for user root by (uid=0)
- Nov 23 11:58:18 pve4 systemd-logind[1106]: New session 14121 of user root.
- Nov 23 11:58:18 pve4 systemd[1]: Started Session 14121 of user root.
- Nov 23 11:58:18 pve4 sshd[9370]: Received disconnect from 10.10.13.3 port 47786:11: disconnected by user
- Nov 23 11:58:18 pve4 sshd[9370]: Disconnected from user root 10.10.13.3 port 47786
- Nov 23 11:58:18 pve4 sshd[9370]: pam_unix(sshd:session): session closed for user root
- Nov 23 11:58:18 pve4 systemd[1]: session-14121.scope: Succeeded.
- Nov 23 11:58:18 pve4 systemd-logind[1106]: Session 14121 logged out. Waiting for processes to exit.
- Nov 23 11:58:18 pve4 systemd-logind[1106]: Removed session 14121.
- Nov 23 11:58:18 pve4 sshd[9387]: Accepted publickey for root from 10.10.13.3 port 47788 ssh2: RSA SHA256:UAPE5J83ADYWPGOsDfzGUsAAjCcRsIY/Ox7BKNnYFuA
- Nov 23 11:58:18 pve4 sshd[9387]: pam_unix(sshd:session): session opened for user root by (uid=0)
- Nov 23 11:58:19 pve4 systemd-logind[1106]: New session 14122 of user root.
- Nov 23 11:58:19 pve4 systemd[1]: Started Session 14122 of user root.
- Nov 23 11:58:19 pve4 qm[9416]: <root@pam> starting task UPID:pve4:000024C9:04EDDC74:619CD75B:qmstart:107:root@pam:
- Nov 23 11:58:19 pve4 qm[9417]: start VM 107: UPID:pve4:000024C9:04EDDC74:619CD75B:qmstart:107:root@pam:
- Nov 23 11:58:21 pve4 Satellite[3419]: 11:58:21.676 [MainWorkerPool-5] INFO LINSTOR/Satellite - SYSTEM - Resource 'vm-107-disk-2' created for node 'pve4'.
- Nov 23 11:58:22 pve4 kernel: drbd vm-107-disk-2: Starting worker thread (from drbdsetup [9611])
- Nov 23 11:58:22 pve4 kernel: drbd vm-107-disk-2/0 drbd1004: meta-data IO uses: blk-bio
- Nov 23 11:58:22 pve4 kernel: drbd vm-107-disk-2/0 drbd1004: disk( Diskless -> Attaching )
- Nov 23 11:58:22 pve4 kernel: drbd vm-107-disk-2/0 drbd1004: Maximum number of peer devices = 7
- Nov 23 11:58:22 pve4 kernel: drbd vm-107-disk-2: Method to ensure write ordering: flush
- Nov 23 11:58:22 pve4 kernel: drbd vm-107-disk-2/0 drbd1004: drbd_bm_resize called with capacity == 23071856
- Nov 23 11:58:22 pve4 kernel: drbd vm-107-disk-2/0 drbd1004: resync bitmap: bits=2883982 words=315441 pages=617
- Nov 23 11:58:22 pve4 kernel: drbd1004: detected capacity change from 0 to 11812790272
- Nov 23 11:58:22 pve4 kernel: drbd vm-107-disk-2/0 drbd1004: size = 11 GB (11535928 KB)
- Nov 23 11:58:22 pve4 kernel: drbd vm-107-disk-2/0 drbd1004: recounting of set bits took additional 0ms
- Nov 23 11:58:22 pve4 kernel: drbd vm-107-disk-2/0 drbd1004: disk( Attaching -> UpToDate )
- Nov 23 11:58:22 pve4 kernel: drbd vm-107-disk-2/0 drbd1004: attached to current UUID: 9DDABB2CA8320376
- Nov 23 11:58:22 pve4 kernel: drbd vm-107-disk-2/0 drbd1004: size = 11 GB (11535928 KB)
- Nov 23 11:58:22 pve4 Satellite[3419]: 11:58:22.958 [MainWorkerPool-6] INFO LINSTOR/Satellite - SYSTEM - Primary Resource vm-107-disk-2
- Nov 23 11:58:22 pve4 Satellite[3419]: 11:58:22.958 [MainWorkerPool-6] INFO LINSTOR/Satellite - SYSTEM - Primary bool set on Resource vm-107-disk-2
- Nov 23 11:58:22 pve4 Satellite[3419]: 11:58:22.973 [MainWorkerPool-8] INFO LINSTOR/Satellite - SYSTEM - Resource 'vm-107-disk-2' updated for node 'pve4'.
- Nov 23 11:58:23 pve4 kernel: drbd vm-107-disk-2: Preparing cluster-wide state change 13306911 (0->-1 3/1)
- Nov 23 11:58:23 pve4 kernel: drbd vm-107-disk-2: Committing cluster-wide state change 13306911 (0ms)
- Nov 23 11:58:23 pve4 kernel: drbd vm-107-disk-2: role( Secondary -> Primary )
- Nov 23 11:58:23 pve4 kernel: drbd vm-107-disk-2: role( Primary -> Secondary )
- Nov 23 11:58:24 pve4 Satellite[3419]: 11:58:24.025 [MainWorkerPool-3] INFO LINSTOR/Satellite - SYSTEM - Resource 'vm-107-disk-2' created for node 'pve3'.
- Nov 23 11:58:24 pve4 Satellite[3419]: 11:58:24.025 [MainWorkerPool-3] INFO LINSTOR/Satellite - SYSTEM - Resource 'vm-107-disk-2' updated for node 'pve4'.
- Nov 23 11:58:24 pve4 kernel: drbd vm-107-disk-2 pve3: Starting sender thread (from drbdsetup [9730])
- Nov 23 11:58:24 pve4 kernel: drbd vm-107-disk-2 pve3: conn( StandAlone -> Unconnected )
- Nov 23 11:58:24 pve4 kernel: drbd vm-107-disk-2 pve3: Starting receiver thread (from drbd_w_vm-107-d [9612])
- Nov 23 11:58:24 pve4 kernel: drbd vm-107-disk-2 pve3: conn( Unconnected -> Connecting )
- Nov 23 11:58:25 pve4 kernel: drbd vm-107-disk-2 pve3: Handshake to peer 1 successful: Agreed network protocol version 120
- Nov 23 11:58:25 pve4 kernel: drbd vm-107-disk-2 pve3: Feature flags enabled on protocol level: 0xf TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES.
- Nov 23 11:58:25 pve4 kernel: drbd vm-107-disk-2 pve3: Peer authenticated using 20 bytes HMAC
- Nov 23 11:58:25 pve4 kernel: drbd vm-107-disk-2 pve3: Starting ack_recv thread (from drbd_r_vm-107-d [9735])
- Nov 23 11:58:25 pve4 kernel: drbd vm-107-disk-2: Preparing cluster-wide state change 1198145819 (0->1 499/146)
- Nov 23 11:58:25 pve4 kernel: drbd vm-107-disk-2/0 drbd1004 pve3: drbd_sync_handshake:
- Nov 23 11:58:25 pve4 kernel: drbd vm-107-disk-2/0 drbd1004 pve3: self 9DDABB2CA8320376:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:20
- Nov 23 11:58:25 pve4 kernel: drbd vm-107-disk-2/0 drbd1004 pve3: peer 9DDABB2CA8320376:0000000000000000:0000000000000000:0000000000000000 bits:0 flags:20
- Nov 23 11:58:25 pve4 kernel: drbd vm-107-disk-2/0 drbd1004 pve3: uuid_compare()=no-sync by rule=both-off
- Nov 23 11:58:25 pve4 kernel: drbd vm-107-disk-2: State change 1198145819: primary_nodes=0, weak_nodes=0
- Nov 23 11:58:25 pve4 kernel: drbd vm-107-disk-2: Committing cluster-wide state change 1198145819 (24ms)
- Nov 23 11:58:25 pve4 kernel: drbd vm-107-disk-2 pve3: conn( Connecting -> Connected ) peer( Unknown -> Secondary )
- Nov 23 11:58:25 pve4 kernel: drbd vm-107-disk-2/0 drbd1004 pve3: pdsk( DUnknown -> UpToDate ) repl( Off -> Established )
- Nov 23 11:58:25 pve4 Satellite[3419]: 11:58:25.420 [MainWorkerPool-5] INFO LINSTOR/Satellite - SYSTEM - Resource 'vm-107-disk-2' updated for node 'pve3'.
- Nov 23 11:58:25 pve4 Satellite[3419]: 11:58:25.420 [MainWorkerPool-5] INFO LINSTOR/Satellite - SYSTEM - Resource 'vm-107-disk-2' updated for node 'pve4'.
- Nov 23 11:58:26 pve4 systemd[1]: Started 107.scope.
- Nov 23 11:58:26 pve4 kernel: drbd vm-107-disk-2/0 drbd1004: new current UUID: 1C113980A4AC5F98 weak: FFFFFFFFFFFFFFFC
- Nov 23 11:58:26 pve4 systemd-udevd[9794]: Using default interface naming scheme 'v240'.
- Nov 23 11:58:26 pve4 systemd-udevd[9794]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable.
- Nov 23 11:58:26 pve4 systemd-udevd[9794]: Could not generate persistent MAC address for tap107i0: No such file or directory
- Nov 23 11:58:27 pve4 kernel: device tap107i0 entered promiscuous mode
- Nov 23 11:58:27 pve4 ovs-vsctl[9843]: ovs|00001|vsctl|INFO|Called as /usr/bin/ovs-vsctl del-port tap107i0
- Nov 23 11:58:27 pve4 ovs-vsctl[9843]: ovs|00002|db_ctl_base|ERR|no port named tap107i0
- Nov 23 11:58:27 pve4 ovs-vsctl[9844]: ovs|00001|vsctl|INFO|Called as /usr/bin/ovs-vsctl del-port fwln107i0
- Nov 23 11:58:27 pve4 ovs-vsctl[9844]: ovs|00002|db_ctl_base|ERR|no port named fwln107i0
- Nov 23 11:58:27 pve4 systemd-udevd[9794]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable.
- Nov 23 11:58:27 pve4 systemd-udevd[9794]: Could not generate persistent MAC address for fwbr107i0: No such file or directory
- Nov 23 11:58:27 pve4 kernel: fwbr107i0: port 1(tap107i0) entered blocking state
- Nov 23 11:58:27 pve4 kernel: fwbr107i0: port 1(tap107i0) entered disabled state
- Nov 23 11:58:27 pve4 kernel: fwbr107i0: port 1(tap107i0) entered blocking state
- Nov 23 11:58:27 pve4 kernel: fwbr107i0: port 1(tap107i0) entered forwarding state
- Nov 23 11:58:27 pve4 ovs-vsctl[9850]: ovs|00001|vsctl|INFO|Called as /usr/bin/ovs-vsctl -- add-port vmbr4 fwln107o0 -- set Interface fwln107o0 type=internal
- Nov 23 11:58:27 pve4 systemd-udevd[9794]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable.
- Nov 23 11:58:27 pve4 systemd-udevd[9794]: Could not generate persistent MAC address for fwln107o0: No such file or directory
- Nov 23 11:58:27 pve4 kernel: device fwln107o0 entered promiscuous mode
- Nov 23 11:58:27 pve4 kernel: fwbr107i0: port 2(fwln107o0) entered blocking state
- Nov 23 11:58:27 pve4 kernel: fwbr107i0: port 2(fwln107o0) entered disabled state
- Nov 23 11:58:27 pve4 kernel: fwbr107i0: port 2(fwln107o0) entered blocking state
- Nov 23 11:58:27 pve4 kernel: fwbr107i0: port 2(fwln107o0) entered forwarding state
- Nov 23 11:58:27 pve4 systemd-udevd[9794]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable.
- Nov 23 11:58:27 pve4 systemd-udevd[9794]: Could not generate persistent MAC address for tap107i1: No such file or directory
- Nov 23 11:58:27 pve4 kernel: device tap107i1 entered promiscuous mode
- Nov 23 11:58:27 pve4 ovs-vsctl[9891]: ovs|00001|vsctl|INFO|Called as /usr/bin/ovs-vsctl del-port tap107i1
- Nov 23 11:58:27 pve4 ovs-vsctl[9891]: ovs|00002|db_ctl_base|ERR|no port named tap107i1
- Nov 23 11:58:27 pve4 ovs-vsctl[9892]: ovs|00001|vsctl|INFO|Called as /usr/bin/ovs-vsctl del-port fwln107i1
- Nov 23 11:58:27 pve4 ovs-vsctl[9892]: ovs|00002|db_ctl_base|ERR|no port named fwln107i1
- Nov 23 11:58:27 pve4 systemd-udevd[9794]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable.
- Nov 23 11:58:27 pve4 systemd-udevd[9794]: Could not generate persistent MAC address for fwbr107i1: No such file or directory
- Nov 23 11:58:27 pve4 kernel: fwbr107i1: port 1(tap107i1) entered blocking state
- Nov 23 11:58:27 pve4 kernel: fwbr107i1: port 1(tap107i1) entered disabled state
- Nov 23 11:58:27 pve4 kernel: fwbr107i1: port 1(tap107i1) entered blocking state
- Nov 23 11:58:27 pve4 kernel: fwbr107i1: port 1(tap107i1) entered forwarding state
- Nov 23 11:58:27 pve4 ovs-vsctl[9897]: ovs|00001|vsctl|INFO|Called as /usr/bin/ovs-vsctl -- add-port vmbr2 fwln107o1 -- set Interface fwln107o1 type=internal
- Nov 23 11:58:27 pve4 systemd-udevd[9794]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable.
- Nov 23 11:58:27 pve4 kernel: device fwln107o1 entered promiscuous mode
- Nov 23 11:58:27 pve4 systemd-udevd[9794]: Could not generate persistent MAC address for fwln107o1: No such file or directory
- Nov 23 11:58:28 pve4 kernel: fwbr107i1: port 2(fwln107o1) entered blocking state
- Nov 23 11:58:28 pve4 kernel: fwbr107i1: port 2(fwln107o1) entered disabled state
- Nov 23 11:58:28 pve4 kernel: fwbr107i1: port 2(fwln107o1) entered blocking state
- Nov 23 11:58:28 pve4 kernel: fwbr107i1: port 2(fwln107o1) entered forwarding state
- Nov 23 11:58:28 pve4 systemd-udevd[9794]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable.
- Nov 23 11:58:28 pve4 systemd-udevd[9794]: Could not generate persistent MAC address for tap107i2: No such file or directory
- Nov 23 11:58:28 pve4 kernel: device tap107i2 entered promiscuous mode
- Nov 23 11:58:28 pve4 ovs-vsctl[9952]: ovs|00001|vsctl|INFO|Called as /usr/bin/ovs-vsctl del-port tap107i2
- Nov 23 11:58:28 pve4 ovs-vsctl[9952]: ovs|00002|db_ctl_base|ERR|no port named tap107i2
- Nov 23 11:58:28 pve4 ovs-vsctl[9953]: ovs|00001|vsctl|INFO|Called as /usr/bin/ovs-vsctl del-port fwln107i2
- Nov 23 11:58:28 pve4 ovs-vsctl[9953]: ovs|00002|db_ctl_base|ERR|no port named fwln107i2
- Nov 23 11:58:28 pve4 systemd-udevd[9794]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable.
- Nov 23 11:58:28 pve4 systemd-udevd[9794]: Could not generate persistent MAC address for fwbr107i2: No such file or directory
- Nov 23 11:58:28 pve4 kernel: fwbr107i2: port 1(tap107i2) entered blocking state
- Nov 23 11:58:28 pve4 kernel: fwbr107i2: port 1(tap107i2) entered disabled state
- Nov 23 11:58:28 pve4 kernel: fwbr107i2: port 1(tap107i2) entered blocking state
- Nov 23 11:58:28 pve4 kernel: fwbr107i2: port 1(tap107i2) entered forwarding state
- Nov 23 11:58:28 pve4 ovs-vsctl[9961]: ovs|00001|vsctl|INFO|Called as /usr/bin/ovs-vsctl -- add-port vmbr3 fwln107o2 -- set Interface fwln107o2 type=internal
- Nov 23 11:58:28 pve4 systemd-udevd[9794]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable.
- Nov 23 11:58:28 pve4 systemd-udevd[9794]: Could not generate persistent MAC address for fwln107o2: No such file or directory
- Nov 23 11:58:28 pve4 kernel: device fwln107o2 entered promiscuous mode
- Nov 23 11:58:28 pve4 kernel: fwbr107i2: port 2(fwln107o2) entered blocking state
- Nov 23 11:58:28 pve4 kernel: fwbr107i2: port 2(fwln107o2) entered disabled state
- Nov 23 11:58:28 pve4 kernel: fwbr107i2: port 2(fwln107o2) entered blocking state
- Nov 23 11:58:28 pve4 kernel: fwbr107i2: port 2(fwln107o2) entered forwarding state
- Nov 23 11:58:28 pve4 kernel: drbd vm-107-disk-2: Preparing cluster-wide state change 3724339323 (0->-1 3/1)
- Nov 23 11:58:28 pve4 kernel: drbd vm-107-disk-2: State change 3724339323: primary_nodes=1, weak_nodes=FFFFFFFFFFFFFFFC
- Nov 23 11:58:28 pve4 kernel: drbd vm-107-disk-2: Committing cluster-wide state change 3724339323 (0ms)
- Nov 23 11:58:28 pve4 kernel: drbd vm-107-disk-2: role( Secondary -> Primary )
- Nov 23 11:58:28 pve4 qm[9416]: <root@pam> end task UPID:pve4:000024C9:04EDDC74:619CD75B:qmstart:107:root@pam: OK
- Nov 23 11:58:29 pve4 sshd[9387]: Received disconnect from 10.10.13.3 port 47788:11: disconnected by user
- Nov 23 11:58:29 pve4 sshd[9387]: Disconnected from user root 10.10.13.3 port 47788
- Nov 23 11:58:29 pve4 sshd[9387]: pam_unix(sshd:session): session closed for user root
- Nov 23 11:58:29 pve4 systemd[1]: session-14122.scope: Succeeded.
- Nov 23 11:58:29 pve4 systemd-logind[1106]: Session 14122 logged out. Waiting for processes to exit.
- Nov 23 11:58:29 pve4 systemd-logind[1106]: Removed session 14122.
- Nov 23 11:58:29 pve4 sshd[9987]: Accepted publickey for root from 10.10.13.3 port 47818 ssh2: RSA SHA256:UAPE5J83ADYWPGOsDfzGUsAAjCcRsIY/Ox7BKNnYFuA
- Nov 23 11:58:29 pve4 sshd[9987]: pam_unix(sshd:session): session opened for user root by (uid=0)
- Nov 23 11:58:29 pve4 systemd-logind[1106]: New session 14123 of user root.
- Nov 23 11:58:29 pve4 systemd[1]: Started Session 14123 of user root.
- Nov 23 11:58:30 pve4 sshd[10021]: Accepted publickey for root from 10.10.13.3 port 47822 ssh2: RSA SHA256:UAPE5J83ADYWPGOsDfzGUsAAjCcRsIY/Ox7BKNnYFuA
- Nov 23 11:58:30 pve4 sshd[10021]: pam_unix(sshd:session): session opened for user root by (uid=0)
- Nov 23 11:58:30 pve4 systemd-logind[1106]: New session 14124 of user root.
- Nov 23 11:58:30 pve4 systemd[1]: Started Session 14124 of user root.
- Nov 23 11:58:31 pve4 qm[10027]: <root@pam> starting task UPID:pve4:00002756:04EDE0DE:619CD767:qmstop:107:root@pam:
- Nov 23 11:58:31 pve4 qm[10070]: stop VM 107: UPID:pve4:00002756:04EDE0DE:619CD767:qmstop:107:root@pam:
- Nov 23 11:58:31 pve4 QEMU[9834]: kvm: terminating on signal 15 from pid 10070 (task UPID:pve4:00002756:04EDE0DE:619CD767:qmstop:107:root@pam:)
- Nov 23 11:58:31 pve4 kernel: drbd vm-107-disk-2: role( Primary -> Secondary )
- Nov 23 11:58:31 pve4 qm[10027]: <root@pam> end task UPID:pve4:00002756:04EDE0DE:619CD767:qmstop:107:root@pam: OK
- Nov 23 11:58:31 pve4 sshd[10021]: Received disconnect from 10.10.13.3 port 47822:11: disconnected by user
- Nov 23 11:58:31 pve4 sshd[10021]: Disconnected from user root 10.10.13.3 port 47822
- Nov 23 11:58:31 pve4 sshd[10021]: pam_unix(sshd:session): session closed for user root
- Nov 23 11:58:31 pve4 systemd[1]: session-14124.scope: Succeeded.
- Nov 23 11:58:31 pve4 systemd-logind[1106]: Session 14124 logged out. Waiting for processes to exit.
- Nov 23 11:58:31 pve4 systemd-logind[1106]: Removed session 14124.
- Nov 23 11:58:31 pve4 sshd[10075]: Accepted publickey for root from 10.10.13.3 port 47846 ssh2: RSA SHA256:UAPE5J83ADYWPGOsDfzGUsAAjCcRsIY/Ox7BKNnYFuA
- Nov 23 11:58:31 pve4 sshd[10075]: pam_unix(sshd:session): session opened for user root by (uid=0)
- Nov 23 11:58:31 pve4 systemd-logind[1106]: New session 14125 of user root.
- Nov 23 11:58:31 pve4 systemd[1]: Started Session 14125 of user root.
- Nov 23 11:58:31 pve4 kernel: fwbr107i0: port 1(tap107i0) entered disabled state
- Nov 23 11:58:31 pve4 ovs-vsctl[10086]: ovs|00001|vsctl|INFO|Called as /usr/bin/ovs-vsctl del-port fwln107o0
- Nov 23 11:58:31 pve4 kernel: fwbr107i0: port 2(fwln107o0) entered disabled state
- Nov 23 11:58:31 pve4 kernel: device fwln107o0 left promiscuous mode
- Nov 23 11:58:31 pve4 kernel: fwbr107i0: port 2(fwln107o0) entered disabled state
- Nov 23 11:58:31 pve4 ovs-vsctl[10089]: ovs|00001|vsctl|INFO|Called as /usr/bin/ovs-vsctl del-port fwln107i0
- Nov 23 11:58:31 pve4 ovs-vsctl[10089]: ovs|00002|db_ctl_base|ERR|no port named fwln107i0
- Nov 23 11:58:31 pve4 ovs-vsctl[10092]: ovs|00001|vsctl|INFO|Called as /usr/bin/ovs-vsctl del-port tap107i0
- Nov 23 11:58:31 pve4 ovs-vsctl[10092]: ovs|00002|db_ctl_base|ERR|no port named tap107i0
- Nov 23 11:58:31 pve4 kernel: fwbr107i1: port 1(tap107i1) entered disabled state
- Nov 23 11:58:31 pve4 ovs-vsctl[10117]: ovs|00001|vsctl|INFO|Called as /usr/bin/ovs-vsctl del-port fwln107o1
- Nov 23 11:58:31 pve4 kernel: fwbr107i1: port 2(fwln107o1) entered disabled state
- Nov 23 11:58:31 pve4 kernel: device fwln107o1 left promiscuous mode
- Nov 23 11:58:31 pve4 kernel: fwbr107i1: port 2(fwln107o1) entered disabled state
- Nov 23 11:58:31 pve4 ovs-vsctl[10118]: ovs|00001|vsctl|INFO|Called as /usr/bin/ovs-vsctl del-port fwln107i1
- Nov 23 11:58:31 pve4 ovs-vsctl[10118]: ovs|00002|db_ctl_base|ERR|no port named fwln107i1
- Nov 23 11:58:31 pve4 ovs-vsctl[10120]: ovs|00001|vsctl|INFO|Called as /usr/bin/ovs-vsctl del-port tap107i1
- Nov 23 11:58:31 pve4 ovs-vsctl[10120]: ovs|00002|db_ctl_base|ERR|no port named tap107i1
- Nov 23 11:58:31 pve4 pvesm[10084]: <root@pam> starting task UPID:pve4:00002789:04EDE12F:619CD767:imgdel:107@linstor-thinlvm:root@pam:
- Nov 23 11:58:32 pve4 kernel: fwbr107i2: port 1(tap107i2) entered disabled state
- Nov 23 11:58:32 pve4 ovs-vsctl[10151]: ovs|00001|vsctl|INFO|Called as /usr/bin/ovs-vsctl del-port fwln107o2
- Nov 23 11:58:32 pve4 kernel: fwbr107i2: port 2(fwln107o2) entered disabled state
- Nov 23 11:58:32 pve4 kernel: device fwln107o2 left promiscuous mode
- Nov 23 11:58:32 pve4 kernel: fwbr107i2: port 2(fwln107o2) entered disabled state
- Nov 23 11:58:32 pve4 ovs-vsctl[10155]: ovs|00001|vsctl|INFO|Called as /usr/bin/ovs-vsctl del-port fwln107i2
- Nov 23 11:58:32 pve4 ovs-vsctl[10155]: ovs|00002|db_ctl_base|ERR|no port named fwln107i2
- Nov 23 11:58:32 pve4 ovs-vsctl[10160]: ovs|00001|vsctl|INFO|Called as /usr/bin/ovs-vsctl del-port tap107i2
- Nov 23 11:58:32 pve4 ovs-vsctl[10160]: ovs|00002|db_ctl_base|ERR|no port named tap107i2
- Nov 23 11:58:32 pve4 qmeventd[1104]: read: Connection reset by peer
- Nov 23 11:58:32 pve4 systemd[1]: 107.scope: Succeeded.
- Nov 23 11:58:32 pve4 Satellite[3419]: 11:58:32.621 [MainWorkerPool-7] INFO LINSTOR/Satellite - SYSTEM - Resource 'vm-107-disk-2' updated for node 'pve3'.
- Nov 23 11:58:32 pve4 Satellite[3419]: 11:58:32.621 [MainWorkerPool-7] INFO LINSTOR/Satellite - SYSTEM - Resource 'vm-107-disk-2' updated for node 'pve4'.
- Nov 23 11:58:32 pve4 kernel: drbd vm-107-disk-2: Preparing cluster-wide state change 3001061611 (0->1 496/16)
- Nov 23 11:58:32 pve4 kernel: drbd vm-107-disk-2: State change 3001061611: primary_nodes=0, weak_nodes=0
- Nov 23 11:58:32 pve4 kernel: drbd vm-107-disk-2 pve3: Cluster is now split
- Nov 23 11:58:32 pve4 kernel: drbd vm-107-disk-2: Committing cluster-wide state change 3001061611 (0ms)
- Nov 23 11:58:32 pve4 kernel: drbd vm-107-disk-2 pve3: conn( Connected -> Disconnecting ) peer( Secondary -> Unknown )
- Nov 23 11:58:32 pve4 kernel: drbd vm-107-disk-2/0 drbd1004 pve3: pdsk( UpToDate -> DUnknown ) repl( Established -> Off )
- Nov 23 11:58:32 pve4 kernel: drbd vm-107-disk-2 pve3: ack_receiver terminated
- Nov 23 11:58:32 pve4 kernel: drbd vm-107-disk-2 pve3: Terminating ack_recv thread
- Nov 23 11:58:32 pve4 kernel: drbd vm-107-disk-2 pve3: Terminating sender thread
- Nov 23 11:58:32 pve4 kernel: drbd vm-107-disk-2 pve3: Starting sender thread (from drbd_r_vm-107-d [9735])
- Nov 23 11:58:32 pve4 kernel: drbd vm-107-disk-2 pve3: Connection closed
- Nov 23 11:58:32 pve4 kernel: drbd vm-107-disk-2 pve3: helper command: /sbin/drbdadm disconnected
- Nov 23 11:58:32 pve4 kernel: drbd vm-107-disk-2 pve3: helper command: /sbin/drbdadm disconnected exit code 0
- Nov 23 11:58:32 pve4 kernel: drbd vm-107-disk-2 pve3: conn( Disconnecting -> StandAlone )
- Nov 23 11:58:32 pve4 kernel: drbd vm-107-disk-2 pve3: Terminating receiver thread
- Nov 23 11:58:32 pve4 kernel: drbd vm-107-disk-2 pve3: Terminating sender thread
- Nov 23 11:58:32 pve4 kernel: drbd vm-107-disk-2/0 drbd1004: disk( UpToDate -> Detaching )
- Nov 23 11:58:32 pve4 kernel: drbd vm-107-disk-2/0 drbd1004: disk( Detaching -> Diskless )
- Nov 23 11:58:32 pve4 kernel: drbd vm-107-disk-2/0 drbd1004: drbd_bm_resize called with capacity == 0
- Nov 23 11:58:32 pve4 kernel: drbd vm-107-disk-2: Terminating worker thread
- Nov 23 11:58:33 pve4 pvesm[10084]: <root@pam> end task UPID:pve4:00002789:04EDE12F:619CD767:imgdel:107@linstor-thinlvm:root@pam: OK
- Nov 23 11:58:33 pve4 sshd[10075]: Received disconnect from 10.10.13.3 port 47846:11: disconnected by user
- Nov 23 11:58:33 pve4 sshd[10075]: Disconnected from user root 10.10.13.3 port 47846
- Nov 23 11:58:33 pve4 sshd[10075]: pam_unix(sshd:session): session closed for user root
- Nov 23 11:58:33 pve4 systemd[1]: session-14125.scope: Succeeded.
- Nov 23 11:58:33 pve4 systemd-logind[1106]: Session 14125 logged out. Waiting for processes to exit.
- Nov 23 11:58:33 pve4 systemd-logind[1106]: Removed session 14125.
- Nov 23 11:58:33 pve4 sshd[9987]: Received disconnect from 10.10.13.3 port 47818:11: disconnected by user
- Nov 23 11:58:33 pve4 sshd[9987]: Disconnected from user root 10.10.13.3 port 47818
- Nov 23 11:58:33 pve4 sshd[9987]: pam_unix(sshd:session): session closed for user root
- Nov 23 11:58:33 pve4 systemd[1]: session-14123.scope: Succeeded.
- Nov 23 11:58:33 pve4 systemd-logind[1106]: Session 14123 logged out. Waiting for processes to exit.
- Nov 23 11:58:33 pve4 systemd-logind[1106]: Removed session 14123.
- Nov 23 11:58:34 pve4 pmxcfs[1793]: [status] notice: received log
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement