valeriol

gluster.log

Mar 29th, 2021
36
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
  1. [2021-03-28 07:39:02.569345] I [glusterfsd-mgmt.c:2204:mgmt_getspec_cbk] 0-glusterfs: No change in volfile,continuing
  2. [2021-03-29 13:40:17.199788] I [fuse-bridge.c:6237:fuse_thread_proc] 0-fuse: initiating unmount of /gluster
  3. [2021-03-29 13:40:17.199916] W [glusterfsd.c:1439:cleanup_and_exit] (-->/lib64/libpthread.so.0(+0x814a) [0x7f4788ca114a] -->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xfd) [0x55c7bec03b5d] -->/usr/sbin/glusterfs(cleanup_and_exit+0x58) [0x55c7bec039a8] ) 0-: received signum (15), shutting down
  4. [2021-03-29 13:40:17.199939] I [fuse-bridge.c:7069:fini] 0-fuse: Unmounting '/gluster'.
  5. [2021-03-29 13:40:17.199945] I [fuse-bridge.c:7074:fini] 0-fuse: Closing fuse connection to '/gluster'.
  6. [2021-03-29 13:40:36.065744] I [MSGID: 100030] [glusterfsd.c:2867:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 7.9 (args: /usr/sbin/glusterfs --acl --process-name fuse --volfile-server=hydra1 --volfile-id=/MRIData /gluster)
  7. [2021-03-29 13:40:36.066586] I [glusterfsd.c:2594:daemonize] 0-glusterfs: Pid of current running process is 108435
  8. [2021-03-29 13:40:36.071838] I [MSGID: 101190] [event-epoll.c:682:event_dispatch_epoll_worker] 0-epoll: Started thread with index 0
  9. [2021-03-29 13:40:36.071848] I [MSGID: 101190] [event-epoll.c:682:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1
  10. [2021-03-29 13:40:36.085745] I [MSGID: 114020] [client.c:2436:notify] 0-MRIData-client-0: parent translators are ready, attempting connect on transport
  11. [2021-03-29 13:40:36.087284] I [MSGID: 114020] [client.c:2436:notify] 0-MRIData-client-1: parent translators are ready, attempting connect on transport
  12. [2021-03-29 13:40:36.087877] I [rpc-clnt.c:1971:rpc_clnt_reconfig] 0-MRIData-client-0: changing port to 49152 (from 0)
  13. [2021-03-29 13:40:36.087926] I [socket.c:865:__socket_shutdown] 0-MRIData-client-0: intentional socket shutdown(13)
  14. [2021-03-29 13:40:36.088867] I [MSGID: 114020] [client.c:2436:notify] 0-MRIData-client-12: parent translators are ready, attempting connect on transport
  15. [2021-03-29 13:40:36.089960] I [rpc-clnt.c:1971:rpc_clnt_reconfig] 0-MRIData-client-1: changing port to 49153 (from 0)
  16. [2021-03-29 13:40:36.089977] I [socket.c:865:__socket_shutdown] 0-MRIData-client-1: intentional socket shutdown(14)
  17. [2021-03-29 13:40:36.090006] I [MSGID: 114057] [client-handshake.c:1375:select_server_supported_programs] 0-MRIData-client-0: Using Program GlusterFS 4.x v1, Num (1298437), Version (400)
  18. [2021-03-29 13:40:36.090363] I [MSGID: 114020] [client.c:2436:notify] 0-MRIData-client-2: parent translators are ready, attempting connect on transport
  19. [2021-03-29 13:40:36.091591] I [MSGID: 114046] [client-handshake.c:1105:client_setvolume_cbk] 0-MRIData-client-0: Connected to MRIData-client-0, attached to remote volume '/gluster1/data'.
  20. [2021-03-29 13:40:36.091611] I [MSGID: 108005] [afr-common.c:5232:__afr_handle_child_up_event] 0-MRIData-replicate-0: Subvolume 'MRIData-client-0' came back up; going online.
  21. [2021-03-29 13:40:36.091818] I [MSGID: 114020] [client.c:2436:notify] 0-MRIData-client-3: parent translators are ready, attempting connect on transport
  22. [2021-03-29 13:40:36.092486] I [rpc-clnt.c:1971:rpc_clnt_reconfig] 0-MRIData-client-12: changing port to 49154 (from 0)
  23. [2021-03-29 13:40:36.092501] I [socket.c:865:__socket_shutdown] 0-MRIData-client-12: intentional socket shutdown(16)
  24. [2021-03-29 13:40:36.092512] I [MSGID: 114057] [client-handshake.c:1375:select_server_supported_programs] 0-MRIData-client-1: Using Program GlusterFS 4.x v1, Num (1298437), Version (400)
  25. [2021-03-29 13:40:36.093272] I [MSGID: 114020] [client.c:2436:notify] 0-MRIData-client-13: parent translators are ready, attempting connect on transport
  26. [2021-03-29 13:40:36.093957] I [MSGID: 114046] [client-handshake.c:1105:client_setvolume_cbk] 0-MRIData-client-1: Connected to MRIData-client-1, attached to remote volume '/gluster2/data'.
  27. [2021-03-29 13:40:36.093969] I [MSGID: 108002] [afr-common.c:5599:afr_notify] 0-MRIData-replicate-0: Client-quorum is met
  28. [2021-03-29 13:40:36.094112] I [rpc-clnt.c:1971:rpc_clnt_reconfig] 0-MRIData-client-2: changing port to 49155 (from 0)
  29. [2021-03-29 13:40:36.094126] I [socket.c:865:__socket_shutdown] 0-MRIData-client-2: intentional socket shutdown(14)
  30. [2021-03-29 13:40:36.094549] I [MSGID: 114020] [client.c:2436:notify] 0-MRIData-client-4: parent translators are ready, attempting connect on transport
  31. [2021-03-29 13:40:36.095417] I [MSGID: 114057] [client-handshake.c:1375:select_server_supported_programs] 0-MRIData-client-12: Using Program GlusterFS 4.x v1, Num (1298437), Version (400)
  32. [2021-03-29 13:40:36.095636] I [rpc-clnt.c:1971:rpc_clnt_reconfig] 0-MRIData-client-3: changing port to 49152 (from 0)
  33. [2021-03-29 13:40:36.095647] I [socket.c:865:__socket_shutdown] 0-MRIData-client-3: intentional socket shutdown(17)
  34. [2021-03-29 13:40:36.095871] I [MSGID: 114020] [client.c:2436:notify] 0-MRIData-client-5: parent translators are ready, attempting connect on transport
  35. [2021-03-29 13:40:36.097140] I [MSGID: 114057] [client-handshake.c:1375:select_server_supported_programs] 0-MRIData-client-2: Using Program GlusterFS 4.x v1, Num (1298437), Version (400)
  36. [2021-03-29 13:40:36.097200] I [MSGID: 114046] [client-handshake.c:1105:client_setvolume_cbk] 0-MRIData-client-12: Connected to MRIData-client-12, attached to remote volume '/arbiter/1'.
  37. [2021-03-29 13:40:36.097265] I [rpc-clnt.c:1971:rpc_clnt_reconfig] 0-MRIData-client-13: changing port to 49156 (from 0)
  38. [2021-03-29 13:40:36.097274] I [socket.c:865:__socket_shutdown] 0-MRIData-client-13: intentional socket shutdown(19)
  39. [2021-03-29 13:40:36.097308] I [MSGID: 114020] [client.c:2436:notify] 0-MRIData-client-14: parent translators are ready, attempting connect on transport
  40. [2021-03-29 13:40:36.098581] I [MSGID: 114057] [client-handshake.c:1375:select_server_supported_programs] 0-MRIData-client-3: Using Program GlusterFS 4.x v1, Num (1298437), Version (400)
  41. [2021-03-29 13:40:36.098627] I [MSGID: 114020] [client.c:2436:notify] 0-MRIData-client-6: parent translators are ready, attempting connect on transport
  42. [2021-03-29 13:40:36.098674] I [MSGID: 114046] [client-handshake.c:1105:client_setvolume_cbk] 0-MRIData-client-2: Connected to MRIData-client-2, attached to remote volume '/gluster3/data'.
  43. [2021-03-29 13:40:36.098681] I [MSGID: 108005] [afr-common.c:5232:__afr_handle_child_up_event] 0-MRIData-replicate-1: Subvolume 'MRIData-client-2' came back up; going online.
  44. [2021-03-29 13:40:36.098871] I [rpc-clnt.c:1971:rpc_clnt_reconfig] 0-MRIData-client-4: changing port to 49153 (from 0)
  45. [2021-03-29 13:40:36.098883] I [socket.c:865:__socket_shutdown] 0-MRIData-client-4: intentional socket shutdown(20)
  46. [2021-03-29 13:40:36.100147] I [MSGID: 114020] [client.c:2436:notify] 0-MRIData-client-7: parent translators are ready, attempting connect on transport
  47. [2021-03-29 13:40:36.100376] I [rpc-clnt.c:1971:rpc_clnt_reconfig] 0-MRIData-client-5: changing port to 49154 (from 0)
  48. [2021-03-29 13:40:36.100405] I [socket.c:865:__socket_shutdown] 0-MRIData-client-5: intentional socket shutdown(17)
  49. [2021-03-29 13:40:36.100416] I [MSGID: 114057] [client-handshake.c:1375:select_server_supported_programs] 0-MRIData-client-13: Using Program GlusterFS 4.x v1, Num (1298437), Version (400)
  50. [2021-03-29 13:40:36.100468] I [MSGID: 114046] [client-handshake.c:1105:client_setvolume_cbk] 0-MRIData-client-3: Connected to MRIData-client-3, attached to remote volume '/gluster1/data'.
  51. [2021-03-29 13:40:36.100475] I [MSGID: 108002] [afr-common.c:5599:afr_notify] 0-MRIData-replicate-1: Client-quorum is met
  52. [2021-03-29 13:40:36.101606] I [MSGID: 114020] [client.c:2436:notify] 0-MRIData-client-15: parent translators are ready, attempting connect on transport
  53. [2021-03-29 13:40:36.102179] I [MSGID: 114046] [client-handshake.c:1105:client_setvolume_cbk] 0-MRIData-client-13: Connected to MRIData-client-13, attached to remote volume '/arbiter/2'.
  54. [2021-03-29 13:40:36.102217] I [rpc-clnt.c:1971:rpc_clnt_reconfig] 0-MRIData-client-14: changing port to 49155 (from 0)
  55. [2021-03-29 13:40:36.102226] I [socket.c:865:__socket_shutdown] 0-MRIData-client-14: intentional socket shutdown(19)
  56. [2021-03-29 13:40:36.103069] I [MSGID: 114020] [client.c:2436:notify] 0-MRIData-client-8: parent translators are ready, attempting connect on transport
  57. [2021-03-29 13:40:36.103668] I [MSGID: 114057] [client-handshake.c:1375:select_server_supported_programs] 0-MRIData-client-4: Using Program GlusterFS 4.x v1, Num (1298437), Version (400)
  58. [2021-03-29 13:40:36.103702] I [rpc-clnt.c:1971:rpc_clnt_reconfig] 0-MRIData-client-6: changing port to 49152 (from 0)
  59. [2021-03-29 13:40:36.103711] I [socket.c:865:__socket_shutdown] 0-MRIData-client-6: intentional socket shutdown(22)
  60. [2021-03-29 13:40:36.104553] I [MSGID: 114020] [client.c:2436:notify] 0-MRIData-client-9: parent translators are ready, attempting connect on transport
  61. [2021-03-29 13:40:36.105269] I [MSGID: 114057] [client-handshake.c:1375:select_server_supported_programs] 0-MRIData-client-5: Using Program GlusterFS 4.x v1, Num (1298437), Version (400)
  62. [2021-03-29 13:40:36.105310] I [MSGID: 114046] [client-handshake.c:1105:client_setvolume_cbk] 0-MRIData-client-4: Connected to MRIData-client-4, attached to remote volume '/gluster2/data'.
  63. [2021-03-29 13:40:36.105316] I [MSGID: 108005] [afr-common.c:5232:__afr_handle_child_up_event] 0-MRIData-replicate-2: Subvolume 'MRIData-client-4' came back up; going online.
  64. [2021-03-29 13:40:36.105453] I [rpc-clnt.c:1971:rpc_clnt_reconfig] 0-MRIData-client-7: changing port to 49153 (from 0)
  65. [2021-03-29 13:40:36.105462] I [socket.c:865:__socket_shutdown] 0-MRIData-client-7: intentional socket shutdown(24)
  66. [2021-03-29 13:40:36.105475] I [MSGID: 114057] [client-handshake.c:1375:select_server_supported_programs] 0-MRIData-client-14: Using Program GlusterFS 4.x v1, Num (1298437), Version (400)
  67. [2021-03-29 13:40:36.105995] I [MSGID: 114020] [client.c:2436:notify] 0-MRIData-client-16: parent translators are ready, attempting connect on transport
  68. [2021-03-29 13:40:36.106881] I [rpc-clnt.c:1971:rpc_clnt_reconfig] 0-MRIData-client-15: changing port to 49155 (from 0)
  69. [2021-03-29 13:40:36.106896] I [socket.c:865:__socket_shutdown] 0-MRIData-client-15: intentional socket shutdown(25)
  70. [2021-03-29 13:40:36.106905] I [MSGID: 114057] [client-handshake.c:1375:select_server_supported_programs] 0-MRIData-client-6: Using Program GlusterFS 4.x v1, Num (1298437), Version (400)
  71. [2021-03-29 13:40:36.106951] I [MSGID: 114046] [client-handshake.c:1105:client_setvolume_cbk] 0-MRIData-client-5: Connected to MRIData-client-5, attached to remote volume '/gluster3/data'.
  72. [2021-03-29 13:40:36.106957] I [MSGID: 108002] [afr-common.c:5599:afr_notify] 0-MRIData-replicate-2: Client-quorum is met
  73. [2021-03-29 13:40:36.107119] I [MSGID: 114046] [client-handshake.c:1105:client_setvolume_cbk] 0-MRIData-client-14: Connected to MRIData-client-14, attached to remote volume '/arbiter/1'.
  74. [2021-03-29 13:40:36.107379] I [MSGID: 114020] [client.c:2436:notify] 0-MRIData-client-10: parent translators are ready, attempting connect on transport
  75. [2021-03-29 13:40:36.108763] I [MSGID: 114046] [client-handshake.c:1105:client_setvolume_cbk] 0-MRIData-client-6: Connected to MRIData-client-6, attached to remote volume '/gluster1/data'.
  76. [2021-03-29 13:40:36.108776] I [MSGID: 108005] [afr-common.c:5232:__afr_handle_child_up_event] 0-MRIData-replicate-3: Subvolume 'MRIData-client-6' came back up; going online.
  77. [2021-03-29 13:40:36.108901] I [rpc-clnt.c:1971:rpc_clnt_reconfig] 0-MRIData-client-8: changing port to 49154 (from 0)
  78. [2021-03-29 13:40:36.108913] I [socket.c:865:__socket_shutdown] 0-MRIData-client-8: intentional socket shutdown(26)
  79. [2021-03-29 13:40:36.108917] I [MSGID: 114020] [client.c:2436:notify] 0-MRIData-client-11: parent translators are ready, attempting connect on transport
  80. [2021-03-29 13:40:36.108931] I [MSGID: 114057] [client-handshake.c:1375:select_server_supported_programs] 0-MRIData-client-7: Using Program GlusterFS 4.x v1, Num (1298437), Version (400)
  81. [2021-03-29 13:40:36.110351] I [MSGID: 114020] [client.c:2436:notify] 0-MRIData-client-17: parent translators are ready, attempting connect on transport
  82. [2021-03-29 13:40:36.110444] I [rpc-clnt.c:1971:rpc_clnt_reconfig] 0-MRIData-client-9: changing port to 49152 (from 0)
  83. [2021-03-29 13:40:36.110461] I [socket.c:865:__socket_shutdown] 0-MRIData-client-9: intentional socket shutdown(27)
  84. [2021-03-29 13:40:36.110474] I [MSGID: 114057] [client-handshake.c:1375:select_server_supported_programs] 0-MRIData-client-15: Using Program GlusterFS 4.x v1, Num (1298437), Version (400)
  85. [2021-03-29 13:40:36.110525] I [MSGID: 114046] [client-handshake.c:1105:client_setvolume_cbk] 0-MRIData-client-7: Connected to MRIData-client-7, attached to remote volume '/gluster2/data'.
  86. [2021-03-29 13:40:36.110531] I [MSGID: 108002] [afr-common.c:5599:afr_notify] 0-MRIData-replicate-3: Client-quorum is met
  87. Final graph:
  88. +------------------------------------------------------------------------------+
  89. 1: volume MRIData-client-0
  90. 2: type protocol/client
  91. 3: option opversion 70200
  92. 4: option clnt-lk-version 1
  93. 5: option volfile-checksum 0
  94. 6: option volfile-key /MRIData
  95. 7: option client-version 7.9
  96. 8: option process-name fuse
  97. 9: option process-uuid CTX_ID:56832a6f-8531-4d4f-91cf-bac9eacd0529-GRAPH_ID:0-PID:108435-HOST:argus.cbi.fas.nyu.edu-PC_NAME:MRIData-client-0-RECON_NO:-0
  98. 10: option fops-version 1298437
  99. 11: option ping-timeout 10
  100. 12: option remote-host hydra1
  101. 13: option remote-subvolume /gluster1/data
  102. 14: option transport-type socket
  103. 15: option transport.address-family inet
  104. 16: option filter-O_DIRECT enable
  105. 17: option transport.tcp-user-timeout 0
  106. 18: option transport.socket.keepalive-time 20
  107. 19: option transport.socket.keepalive-interval 2
  108. 20: option transport.socket.keepalive-count 9
  109. 21: option send-gids true
  110. 22: end-volume
  111. 23:
  112. 24: volume MRIData-client-1
  113. 25: type protocol/client
  114. 26: option opversion 70200
  115. 27: option clnt-lk-version 1
  116. 28: option volfile-checksum 0
  117. 29: option volfile-key /MRIData
  118. 30: option client-version 7.9
  119. 31: option process-name fuse
  120. 32: option process-uuid CTX_ID:56832a6f-8531-4d4f-91cf-bac9eacd0529-GRAPH_ID:0-PID:108435-HOST:argus.cbi.fas.nyu.edu-PC_NAME:MRIData-client-1-RECON_NO:-0
  121. 33: option fops-version 1298437
  122. 34: option ping-timeout 10
  123. 35: option remote-host hydra1
  124. 36: option remote-subvolume /gluster2/data
  125. 37: option transport-type socket
  126. 38: option transport.address-family inet
  127. 39: option filter-O_DIRECT enable
  128. 40: option transport.tcp-user-timeout 0
  129. 41: option transport.socket.keepalive-time 20
  130. 42: option transport.socket.keepalive-interval 2
  131. 43: option transport.socket.keepalive-count 9
  132. 44: option send-gids true
  133. 45: end-volume
  134. 46:
  135. 47: volume MRIData-client-12
  136. 48: type protocol/client
  137. 49: option opversion 70200
  138. 50: option clnt-lk-version 1
  139. 51: option volfile-checksum 0
  140. 52: option volfile-key /MRIData
  141. 53: option client-version 7.9
  142. 54: option process-name fuse
  143. 55: option process-uuid CTX_ID:56832a6f-8531-4d4f-91cf-bac9eacd0529-GRAPH_ID:0-PID:108435-HOST:argus.cbi.fas.nyu.edu-PC_NAME:MRIData-client-12-RECON_NO:-0
  144. 56: option fops-version 1298437
  145. 57: option ping-timeout 10
  146. 58: option remote-host hydra1
  147. 59: option remote-subvolume /arbiter/1
  148. 60: option transport-type socket
  149. 61: option transport.address-family inet
  150. 62: option filter-O_DIRECT enable
  151. 63: option transport.tcp-user-timeout 0
  152. 64: option transport.socket.keepalive-time 20
  153. 65: option transport.socket.keepalive-interval 2
  154. 66: option transport.socket.keepalive-count 9
  155. 67: option send-gids true
  156. 68: end-volume
  157. 69:
  158. 70: volume MRIData-replicate-0
  159. 71: type cluster/replicate
  160. 72: option afr-pending-xattr MRIData-client-0,MRIData-client-1,MRIData-client-12
  161. 73: option arbiter-count 1
  162. 74: option metadata-self-heal on
  163. 75: option data-self-heal on
  164. 76: option entry-self-heal on
  165. 77: option data-self-heal-algorithm full
  166. 78: option eager-lock enable
  167. 79: option quorum-type auto
  168. 80: option choose-local off
  169. 81: option shd-max-threads 8
  170. 82: option shd-wait-qlength 10000
  171. 83: option locking-scheme granular
  172. 84: option use-compound-fops off
  173. 85: subvolumes MRIData-client-0 MRIData-client-1 MRIData-client-12
  174. 86: end-volume
  175. 87:
  176. 88: volume MRIData-client-2
  177. 89: type protocol/client
  178. 90: option opversion 70200
  179. 91: option clnt-lk-version 1
  180. 92: option volfile-checksum 0
  181. 93: option volfile-key /MRIData
  182. 94: option client-version 7.9
  183. 95: option process-name fuse
  184. 96: option process-uuid CTX_ID:56832a6f-8531-4d4f-91cf-bac9eacd0529-GRAPH_ID:0-PID:108435-HOST:argus.cbi.fas.nyu.edu-PC_NAME:MRIData-client-2-RECON_NO:-0
  185. 97: option fops-version 1298437
  186. 98: option ping-timeout 10
  187. 99: option remote-host hydra1
  188. 100: option remote-subvolume /gluster3/data
  189. 101: option transport-type socket
  190. 102: option transport.address-family inet
  191. 103: option filter-O_DIRECT enable
  192. 104: option transport.tcp-user-timeout 0
  193. 105: option transport.socket.keepalive-time 20
  194. 106: option transport.socket.keepalive-interval 2
  195. 107: option transport.socket.keepalive-count 9
  196. 108: option send-gids true
  197. 109: end-volume
  198. 110:
  199. 111: volume MRIData-client-3
  200. 112: type protocol/client
  201. 113: option opversion 70200
  202. 114: option clnt-lk-version 1
  203. 115: option volfile-checksum 0
  204. 116: option volfile-key /MRIData
  205. 117: option client-version 7.9
  206. 118: option process-name fuse
  207. 119: option process-uuid CTX_ID:56832a6f-8531-4d4f-91cf-bac9eacd0529-GRAPH_ID:0-PID:108435-HOST:argus.cbi.fas.nyu.edu-PC_NAME:MRIData-client-3-RECON_NO:-0
  208. 120: option fops-version 1298437
  209. 121: option ping-timeout 10
  210. 122: option remote-host hydra2
  211. 123: option remote-subvolume /gluster1/data
  212. 124: option transport-type socket
  213. 125: option transport.address-family inet
  214. 126: option filter-O_DIRECT enable
  215. 127: option transport.tcp-user-timeout 0
  216. 128: option transport.socket.keepalive-time 20
  217. 129: option transport.socket.keepalive-interval 2
  218. 130: option transport.socket.keepalive-count 9
  219. 131: option send-gids true
  220. 132: end-volume
  221. 133:
  222. 134: volume MRIData-client-13
  223. 135: type protocol/client
  224. 136: option opversion 70200
  225. 137: option clnt-lk-version 1
  226. 138: option volfile-checksum 0
  227. 139: option volfile-key /MRIData
  228. 140: option client-version 7.9
  229. 141: option process-name fuse
  230. 142: option process-uuid CTX_ID:56832a6f-8531-4d4f-91cf-bac9eacd0529-GRAPH_ID:0-PID:108435-HOST:argus.cbi.fas.nyu.edu-PC_NAME:MRIData-client-13-RECON_NO:-0
  231. 143: option fops-version 1298437
  232. 144: option ping-timeout 10
  233. 145: option remote-host hydra1
  234. 146: option remote-subvolume /arbiter/2
  235. 147: option transport-type socket
  236. 148: option transport.address-family inet
  237. 149: option filter-O_DIRECT enable
  238. 150: option transport.tcp-user-timeout 0
  239. 151: option transport.socket.keepalive-time 20
  240. 152: option transport.socket.keepalive-interval 2
  241. 153: option transport.socket.keepalive-count 9
  242. 154: option send-gids true
  243. 155: end-volume
  244. 156:
  245. 157: volume MRIData-replicate-1
  246. 158: type cluster/replicate
  247. 159: option afr-pending-xattr MRIData-client-2,MRIData-client-3,MRIData-client-13
  248. 160: option arbiter-count 1
  249. 161: option metadata-self-heal on
  250. 162: option data-self-heal on
  251. 163: option entry-self-heal on
  252. 164: option data-self-heal-algorithm full
  253. 165: option eager-lock enable
  254. 166: option quorum-type auto
  255. 167: option choose-local off
  256. 168: option shd-max-threads 8
  257. 169: option shd-wait-qlength 10000
  258. 170: option locking-scheme granular
  259. 171: option use-compound-fops off
  260. 172: subvolumes MRIData-client-2 MRIData-client-3 MRIData-client-13
  261. 173: end-volume
  262. 174:
  263. 175: volume MRIData-client-4
  264. 176: type protocol/client
  265. 177: option opversion 70200
  266. 178: option clnt-lk-version 1
  267. 179: option volfile-checksum 0
  268. 180: option volfile-key /MRIData
  269. 181: option client-version 7.9
  270. 182: option process-name fuse
  271. 183: option process-uuid CTX_ID:56832a6f-8531-4d4f-91cf-bac9eacd0529-GRAPH_ID:0-PID:108435-HOST:argus.cbi.fas.nyu.edu-PC_NAME:MRIData-client-4-RECON_NO:-0
  272. 184: option fops-version 1298437
  273. 185: option ping-timeout 10
  274. 186: option remote-host hydra2
  275. 187: option remote-subvolume /gluster2/data
  276. 188: option transport-type socket
  277. 189: option transport.address-family inet
  278. 190: option filter-O_DIRECT enable
  279. 191: option transport.tcp-user-timeout 0
  280. 192: option transport.socket.keepalive-time 20
  281. 193: option transport.socket.keepalive-interval 2
  282. 194: option transport.socket.keepalive-count 9
  283. 195: option send-gids true
  284. 196: end-volume
  285. 197:
  286. 198: volume MRIData-client-5
  287. 199: type protocol/client
  288. 200: option opversion 70200
  289. 201: option clnt-lk-version 1
  290. 202: option volfile-checksum 0
  291. 203: option volfile-key /MRIData
  292. 204: option client-version 7.9
  293. 205: option process-name fuse
  294. 206: option process-uuid CTX_ID:56832a6f-8531-4d4f-91cf-bac9eacd0529-GRAPH_ID:0-PID:108435-HOST:argus.cbi.fas.nyu.edu-PC_NAME:MRIData-client-5-RECON_NO:-0
  295. 207: option fops-version 1298437
  296. 208: option ping-timeout 10
  297. 209: option remote-host hydra2
  298. 210: option remote-subvolume /gluster3/data
  299. 211: option transport-type socket
  300. 212: option transport.address-family inet
  301. 213: option filter-O_DIRECT enable
  302. 214: option transport.tcp-user-timeout 0
  303. 215: option transport.socket.keepalive-time 20
  304. 216: option transport.socket.keepalive-interval 2
  305. 217: option transport.socket.keepalive-count 9
  306. 218: option send-gids true
  307. 219: end-volume
  308. 220:
  309. 221: volume MRIData-client-14
  310. 222: type protocol/client
  311. 223: option opversion 70200
  312. 224: option clnt-lk-version 1
  313. [2021-03-29 13:40:36.112007] I [rpc-clnt.c:1971:rpc_clnt_reconfig] 0-MRIData-client-16: changing port to 49156 (from 0)
  314. 225: option volfile-checksum 0
  315. 226: option volfile-key /MRIData
  316. 227: option client-version 7.9
  317. 228: option process-name fuse
  318. 229: option process-uuid CTX_ID:56832a6f-8531-4d4f-91cf-bac9eacd0529-GRAPH_ID:0-PID:108435-HOST:argus.cbi.fas.nyu.edu-PC_NAME:MRIData-client-14-RECON_NO:-0
  319. [2021-03-29 13:40:36.112024] I [socket.c:865:__socket_shutdown] 0-MRIData-client-16: intentional socket shutdown(28)
  320. 230: option fops-version 1298437
  321. 231: option ping-timeout 10
  322. 232: option remote-host hydra2
  323. 233: option remote-subvolume /arbiter/1
  324. 234: option transport-type socket
  325. 235: option transport.address-family inet
  326. 236: option filter-O_DIRECT enable
  327. 237: option transport.tcp-user-timeout 0
  328. 238: option transport.socket.keepalive-time 20
  329. 239: option transport.socket.keepalive-interval 2
  330. 240: option transport.socket.keepalive-count 9
  331. 241: option send-gids true
  332. 242: end-volume
  333. 243:
  334. 244: volume MRIData-replicate-2
  335. 245: type cluster/replicate
  336. 246: option afr-pending-xattr MRIData-client-4,MRIData-client-5,MRIData-client-14
  337. 247: option arbiter-count 1
  338. 248: option metadata-self-heal on
  339. 249: option data-self-heal on
  340. 250: option entry-self-heal on
  341. 251: option data-self-heal-algorithm full
  342. 252: option eager-lock enable
  343. 253: option quorum-type auto
  344. 254: option choose-local off
  345. 255: option shd-max-threads 8
  346. 256: option shd-wait-qlength 10000
  347. 257: option locking-scheme granular
  348. 258: option use-compound-fops off
  349. 259: subvolumes MRIData-client-4 MRIData-client-5 MRIData-client-14
  350. 260: end-volume
  351. 261:
  352. 262: volume MRIData-client-6
  353. 263: type protocol/client
  354. 264: option opversion 70200
  355. 265: option clnt-lk-version 1
  356. 266: option volfile-checksum 0
  357. 267: option volfile-key /MRIData
  358. 268: option client-version 7.9
  359. 269: option process-name fuse
  360. 270: option process-uuid CTX_ID:56832a6f-8531-4d4f-91cf-bac9eacd0529-GRAPH_ID:0-PID:108435-HOST:argus.cbi.fas.nyu.edu-PC_NAME:MRIData-client-6-RECON_NO:-0
  361. 271: option fops-version 1298437
  362. 272: option ping-timeout 10
  363. 273: option remote-host hydra3
  364. 274: option remote-subvolume /gluster1/data
  365. 275: option transport-type socket
  366. 276: option transport.address-family inet
  367. 277: option filter-O_DIRECT enable
  368. 278: option transport.tcp-user-timeout 0
  369. 279: option transport.socket.keepalive-time 20
  370. 280: option transport.socket.keepalive-interval 2
  371. 281: option transport.socket.keepalive-count 9
  372. 282: option send-gids true
  373. 283: end-volume
  374. 284:
  375. 285: volume MRIData-client-7
  376. 286: type protocol/client
  377. 287: option opversion 70200
  378. 288: option clnt-lk-version 1
  379. 289: option volfile-checksum 0
  380. 290: option volfile-key /MRIData
  381. 291: option client-version 7.9
  382. 292: option process-name fuse
  383. 293: option process-uuid CTX_ID:56832a6f-8531-4d4f-91cf-bac9eacd0529-GRAPH_ID:0-PID:108435-HOST:argus.cbi.fas.nyu.edu-PC_NAME:MRIData-client-7-RECON_NO:-0
  384. 294: option fops-version 1298437
  385. 295: option ping-timeout 10
  386. 296: option remote-host hydra3
  387. 297: option remote-subvolume /gluster2/data
  388. 298: option transport-type socket
  389. 299: option transport.address-family inet
  390. 300: option filter-O_DIRECT enable
  391. 301: option transport.tcp-user-timeout 0
  392. 302: option transport.socket.keepalive-time 20
  393. 303: option transport.socket.keepalive-interval 2
  394. 304: option transport.socket.keepalive-count 9
  395. 305: option send-gids true
  396. 306: end-volume
  397. 307:
  398. 308: volume MRIData-client-15
  399. 309: type protocol/client
  400. 310: option opversion 70200
  401. 311: option clnt-lk-version 1
  402. 312: option volfile-checksum 0
  403. 313: option volfile-key /MRIData
  404. 314: option client-version 7.9
  405. 315: option process-name fuse
  406. 316: option process-uuid CTX_ID:56832a6f-8531-4d4f-91cf-bac9eacd0529-GRAPH_ID:0-PID:108435-HOST:argus.cbi.fas.nyu.edu-PC_NAME:MRIData-client-15-RECON_NO:-0
  407. 317: option fops-version 1298437
  408. 318: option ping-timeout 10
  409. 319: option remote-host hydra3
  410. 320: option remote-subvolume /arbiter/1
  411. 321: option transport-type socket
  412. 322: option transport.address-family inet
  413. 323: option filter-O_DIRECT enable
  414. 324: option transport.tcp-user-timeout 0
  415. 325: option transport.socket.keepalive-time 20
  416. 326: option transport.socket.keepalive-interval 2
  417. 327: option transport.socket.keepalive-count 9
  418. 328: option send-gids true
  419. 329: end-volume
  420. 330:
  421. 331: volume MRIData-replicate-3
  422. 332: type cluster/replicate
  423. 333: option afr-pending-xattr MRIData-client-6,MRIData-client-7,MRIData-client-15
  424. 334: option arbiter-count 1
  425. 335: option metadata-self-heal on
  426. 336: option data-self-heal on
  427. 337: option entry-self-heal on
  428. 338: option data-self-heal-algorithm full
  429. 339: option eager-lock enable
  430. 340: option quorum-type auto
  431. 341: option choose-local off
  432. 342: option shd-max-threads 8
  433. 343: option shd-wait-qlength 10000
  434. 344: option locking-scheme granular
  435. 345: option use-compound-fops off
  436. 346: subvolumes MRIData-client-6 MRIData-client-7 MRIData-client-15
  437. 347: end-volume
  438. 348:
  439. 349: volume MRIData-client-8
  440. 350: type protocol/client
  441. 351: option ping-timeout 10
  442. 352: option remote-host hydra3
  443. 353: option remote-subvolume /gluster3/data
  444. 354: option transport-type socket
  445. 355: option transport.address-family inet
  446. 356: option filter-O_DIRECT enable
  447. 357: option transport.tcp-user-timeout 0
  448. 358: option transport.socket.keepalive-time 20
  449. 359: option transport.socket.keepalive-interval 2
  450. 360: option transport.socket.keepalive-count 9
  451. 361: option send-gids true
  452. 362: end-volume
  453. 363:
  454. 364: volume MRIData-client-9
  455. 365: type protocol/client
  456. 366: option ping-timeout 10
  457. 367: option remote-host hydra4
  458. 368: option remote-subvolume /gluster1/data
  459. 369: option transport-type socket
  460. 370: option transport.address-family inet
  461. 371: option filter-O_DIRECT enable
  462. 372: option transport.tcp-user-timeout 0
  463. 373: option transport.socket.keepalive-time 20
  464. 374: option transport.socket.keepalive-interval 2
  465. 375: option transport.socket.keepalive-count 9
  466. 376: option send-gids true
  467. 377: end-volume
  468. 378:
  469. 379: volume MRIData-client-16
  470. 380: type protocol/client
  471. 381: option ping-timeout 10
  472. 382: option remote-host hydra3
  473. 383: option remote-subvolume /arbiter/2
  474. 384: option transport-type socket
  475. 385: option transport.address-family inet
  476. 386: option filter-O_DIRECT enable
  477. 387: option transport.tcp-user-timeout 0
  478. 388: option transport.socket.keepalive-time 20
  479. 389: option transport.socket.keepalive-interval 2
  480. 390: option transport.socket.keepalive-count 9
  481. 391: option send-gids true
  482. 392: end-volume
  483. 393:
  484. 394: volume MRIData-replicate-4
  485. 395: type cluster/replicate
  486. 396: option afr-pending-xattr MRIData-client-8,MRIData-client-9,MRIData-client-16
  487. 397: option arbiter-count 1
  488. 398: option metadata-self-heal on
  489. 399: option data-self-heal on
  490. 400: option entry-self-heal on
  491. 401: option data-self-heal-algorithm full
  492. 402: option eager-lock enable
  493. 403: option quorum-type auto
  494. 404: option choose-local off
  495. 405: option shd-max-threads 8
  496. 406: option shd-wait-qlength 10000
  497. 407: option locking-scheme granular
  498. 408: option use-compound-fops off
  499. 409: subvolumes MRIData-client-8 MRIData-client-9 MRIData-client-16
  500. 410: end-volume
  501. 411:
  502. 412: volume MRIData-client-10
  503. 413: type protocol/client
  504. 414: option ping-timeout 10
  505. 415: option remote-host hydra4
  506. 416: option remote-subvolume /gluster2/data
  507. 417: option transport-type socket
  508. 418: option transport.address-family inet
  509. 419: option filter-O_DIRECT enable
  510. 420: option transport.tcp-user-timeout 0
  511. 421: option transport.socket.keepalive-time 20
  512. 422: option transport.socket.keepalive-interval 2
  513. 423: option transport.socket.keepalive-count 9
  514. 424: option send-gids true
  515. 425: end-volume
  516. 426:
  517. 427: volume MRIData-client-11
  518. 428: type protocol/client
  519. 429: option ping-timeout 10
  520. 430: option remote-host hydra4
  521. 431: option remote-subvolume /gluster3/data
  522. 432: option transport-type socket
  523. 433: option transport.address-family inet
  524. 434: option filter-O_DIRECT enable
  525. 435: option transport.tcp-user-timeout 0
  526. 436: option transport.socket.keepalive-time 20
  527. 437: option transport.socket.keepalive-interval 2
  528. 438: option transport.socket.keepalive-count 9
  529. 439: option send-gids true
  530. 440: end-volume
  531. 441:
  532. 442: volume MRIData-client-17
  533. 443: type protocol/client
  534. 444: option ping-timeout 10
  535. 445: option remote-host hydra4
  536. 446: option remote-subvolume /arbiter/1
  537. 447: option transport-type socket
  538. 448: option transport.address-family inet
  539. 449: option filter-O_DIRECT enable
  540. 450: option transport.tcp-user-timeout 0
  541. 451: option transport.socket.keepalive-time 20
  542. 452: option transport.socket.keepalive-interval 2
  543. 453: option transport.socket.keepalive-count 9
  544. 454: option send-gids true
  545. 455: end-volume
  546. 456:
  547. 457: volume MRIData-replicate-5
  548. 458: type cluster/replicate
  549. 459: option afr-pending-xattr MRIData-client-10,MRIData-client-11,MRIData-client-17
  550. 460: option arbiter-count 1
  551. 461: option metadata-self-heal on
  552. 462: option data-self-heal on
  553. 463: option entry-self-heal on
  554. 464: option data-self-heal-algorithm full
  555. 465: option eager-lock enable
  556. 466: option quorum-type auto
  557. 467: option choose-local off
  558. 468: option shd-max-threads 8
  559. 469: option shd-wait-qlength 10000
  560. 470: option locking-scheme granular
  561. 471: option use-compound-fops off
  562. 472: subvolumes MRIData-client-10 MRIData-client-11 MRIData-client-17
  563. 473: end-volume
  564. 474:
  565. 475: volume MRIData-dht
  566. 476: type cluster/distribute
  567. 477: option lock-migration off
  568. 478: option force-migration off
  569. 479: subvolumes MRIData-replicate-0 MRIData-replicate-1 MRIData-replicate-2 MRIData-replicate-3 MRIData-replicate-4 MRIData-replicate-5
  570. 480: end-volume
  571. 481:
  572. 482: volume MRIData-shard
  573. 483: type features/shard
  574. 484: subvolumes MRIData-dht
  575. 485: end-volume
  576. 486:
  577. 487: volume MRIData-write-behind
  578. 488: type performance/write-behind
  579. 489: subvolumes MRIData-shard
  580. 490: end-volume
  581. 491:
  582. 492: volume MRIData-readdir-ahead
  583. 493: type performance/readdir-ahead
  584. 494: option parallel-readdir off
  585. 495: option rda-request-size 131072
  586. 496: option rda-cache-limit 10MB
  587. 497: subvolumes MRIData-write-behind
  588. 498: end-volume
  589. 499:
  590. 500: volume MRIData-open-behind
  591. 501: type performance/open-behind
  592. 502: subvolumes MRIData-readdir-ahead
  593. 503: end-volume
  594. 504:
  595. 505: volume MRIData-md-cache
  596. 506: type performance/md-cache
  597. 507: option cache-posix-acl true
  598. 508: subvolumes MRIData-open-behind
  599. 509: end-volume
  600. 510:
  601. 511: volume MRIData
  602. 512: type debug/io-stats
  603. 513: option log-level INFO
  604. 514: option latency-measurement off
  605. 515: option count-fop-hits off
  606. 516: subvolumes MRIData-md-cache
  607. 517: end-volume
  608. 518:
  609. 519: volume posix-acl-autoload
  610. 520: type system/posix-acl
  611. 521: subvolumes MRIData
  612. 522: end-volume
  613. 523:
  614. 524: volume meta-autoload
  615. 525: type meta
  616. 526: subvolumes posix-acl-autoload
  617. 527: end-volume
  618. 528:
  619. +------------------------------------------------------------------------------+
  620. [2021-03-29 13:40:36.112557] I [MSGID: 114046] [client-handshake.c:1105:client_setvolume_cbk] 0-MRIData-client-15: Connected to MRIData-client-15, attached to remote volume '/arbiter/1'.
  621. [2021-03-29 13:40:36.112675] I [MSGID: 114057] [client-handshake.c:1375:select_server_supported_programs] 0-MRIData-client-8: Using Program GlusterFS 4.x v1, Num (1298437), Version (400)
  622. [2021-03-29 13:40:36.112735] I [rpc-clnt.c:1971:rpc_clnt_reconfig] 0-MRIData-client-10: changing port to 49153 (from 0)
  623. [2021-03-29 13:40:36.112750] I [socket.c:865:__socket_shutdown] 0-MRIData-client-10: intentional socket shutdown(30)
  624. [2021-03-29 13:40:36.113581] I [rpc-clnt.c:1971:rpc_clnt_reconfig] 0-MRIData-client-11: changing port to 49154 (from 0)
  625. [2021-03-29 13:40:36.113595] I [socket.c:865:__socket_shutdown] 0-MRIData-client-11: intentional socket shutdown(25)
  626. [2021-03-29 13:40:36.113606] I [MSGID: 114057] [client-handshake.c:1375:select_server_supported_programs] 0-MRIData-client-9: Using Program GlusterFS 4.x v1, Num (1298437), Version (400)
  627. [2021-03-29 13:40:36.113638] I [rpc-clnt.c:1971:rpc_clnt_reconfig] 0-MRIData-client-17: changing port to 49155 (from 0)
  628. [2021-03-29 13:40:36.113646] I [socket.c:865:__socket_shutdown] 0-MRIData-client-17: intentional socket shutdown(31)
  629. [2021-03-29 13:40:36.113676] I [MSGID: 114046] [client-handshake.c:1105:client_setvolume_cbk] 0-MRIData-client-8: Connected to MRIData-client-8, attached to remote volume '/gluster3/data'.
  630. [2021-03-29 13:40:36.113682] I [MSGID: 108005] [afr-common.c:5232:__afr_handle_child_up_event] 0-MRIData-replicate-4: Subvolume 'MRIData-client-8' came back up; going online.
  631. [2021-03-29 13:40:36.115329] I [MSGID: 114046] [client-handshake.c:1105:client_setvolume_cbk] 0-MRIData-client-9: Connected to MRIData-client-9, attached to remote volume '/gluster1/data'.
  632. [2021-03-29 13:40:36.115342] I [MSGID: 108002] [afr-common.c:5599:afr_notify] 0-MRIData-replicate-4: Client-quorum is met
  633. [2021-03-29 13:40:36.115493] I [MSGID: 114057] [client-handshake.c:1375:select_server_supported_programs] 0-MRIData-client-16: Using Program GlusterFS 4.x v1, Num (1298437), Version (400)
  634. [2021-03-29 13:40:36.115524] I [MSGID: 114057] [client-handshake.c:1375:select_server_supported_programs] 0-MRIData-client-10: Using Program GlusterFS 4.x v1, Num (1298437), Version (400)
  635. [2021-03-29 13:40:36.115615] I [MSGID: 114057] [client-handshake.c:1375:select_server_supported_programs] 0-MRIData-client-11: Using Program GlusterFS 4.x v1, Num (1298437), Version (400)
  636. [2021-03-29 13:40:36.116168] I [MSGID: 114057] [client-handshake.c:1375:select_server_supported_programs] 0-MRIData-client-17: Using Program GlusterFS 4.x v1, Num (1298437), Version (400)
  637. [2021-03-29 13:40:36.116190] I [MSGID: 114046] [client-handshake.c:1105:client_setvolume_cbk] 0-MRIData-client-16: Connected to MRIData-client-16, attached to remote volume '/arbiter/2'.
  638. [2021-03-29 13:40:36.116282] I [MSGID: 114046] [client-handshake.c:1105:client_setvolume_cbk] 0-MRIData-client-10: Connected to MRIData-client-10, attached to remote volume '/gluster2/data'.
  639. [2021-03-29 13:40:36.116288] I [MSGID: 108005] [afr-common.c:5232:__afr_handle_child_up_event] 0-MRIData-replicate-5: Subvolume 'MRIData-client-10' came back up; going online.
  640. [2021-03-29 13:40:36.116301] I [MSGID: 114046] [client-handshake.c:1105:client_setvolume_cbk] 0-MRIData-client-11: Connected to MRIData-client-11, attached to remote volume '/gluster3/data'.
  641. [2021-03-29 13:40:36.116422] I [MSGID: 108002] [afr-common.c:5599:afr_notify] 0-MRIData-replicate-5: Client-quorum is met
  642. [2021-03-29 13:40:36.116932] I [MSGID: 114046] [client-handshake.c:1105:client_setvolume_cbk] 0-MRIData-client-17: Connected to MRIData-client-17, attached to remote volume '/arbiter/1'.
  643. [2021-03-29 13:40:36.117714] I [fuse-bridge.c:5266:fuse_init] 0-glusterfs-fuse: FUSE inited with protocol versions: glusterfs 7.24 kernel 7.31
  644. [2021-03-29 13:40:36.117725] I [fuse-bridge.c:5894:fuse_graph_sync] 0-fuse: switched to graph 0
  645. [2021-03-29 13:40:49.453627] I [MSGID: 133022] [shard.c:3697:shard_delete_shards] 0-MRIData-shard: Deleted shards of gfid=576b0072-4a0c-474f-b2df-a09c35f4127f from backend
  646. [2021-03-29 15:00:07.025848] I [MSGID: 133022] [shard.c:3697:shard_delete_shards] 0-MRIData-shard: Deleted shards of gfid=da84920b-a9d6-4d89-8c0a-67f09b938513 from backend
  647. [2021-03-29 15:00:07.029979] I [MSGID: 133022] [shard.c:3697:shard_delete_shards] 0-MRIData-shard: Deleted shards of gfid=a3dd2241-74f1-4a59-ad5a-2b44df5ff728 from backend
  648. [2021-03-29 15:00:07.032765] I [MSGID: 133022] [shard.c:3697:shard_delete_shards] 0-MRIData-shard: Deleted shards of gfid=4eb8995f-e679-4473-80e5-88ef159722e2 from backend
  649. [2021-03-29 15:00:07.063603] I [MSGID: 133022] [shard.c:3697:shard_delete_shards] 0-MRIData-shard: Deleted shards of gfid=e0d68f8f-882b-4fba-a989-8013b76d73b2 from backend
  650. [2021-03-29 15:00:07.065735] I [MSGID: 133022] [shard.c:3697:shard_delete_shards] 0-MRIData-shard: Deleted shards of gfid=36b83499-2c98-486b-aba7-35d84a4d57e1 from backend
  651. [2021-03-29 15:00:07.081940] I [MSGID: 133022] [shard.c:3697:shard_delete_shards] 0-MRIData-shard: Deleted shards of gfid=36b83499-2c98-486b-aba7-35d84a4d57e1 from backend
  652. [2021-03-29 15:00:07.327442] I [MSGID: 133022] [shard.c:3697:shard_delete_shards] 0-MRIData-shard: Deleted shards of gfid=c6d6f998-b0ad-4254-817a-7bec68504d08 from backend
  653. [2021-03-29 15:00:07.393018] I [MSGID: 133022] [shard.c:3697:shard_delete_shards] 0-MRIData-shard: Deleted shards of gfid=1d4c5673-98cd-4d94-a55d-5ff3fda74198 from backend
  654. [2021-03-29 15:00:07.395997] I [MSGID: 133022] [shard.c:3697:shard_delete_shards] 0-MRIData-shard: Deleted shards of gfid=afe448e9-3183-4179-906c-a90deea9c202 from backend
  655. [2021-03-29 15:00:07.423084] I [MSGID: 133022] [shard.c:3697:shard_delete_shards] 0-MRIData-shard: Deleted shards of gfid=47eac564-f087-44d3-9d7b-e42170e9f933 from backend
  656. [2021-03-29 15:00:07.427787] I [MSGID: 133022] [shard.c:3697:shard_delete_shards] 0-MRIData-shard: Deleted shards of gfid=afe448e9-3183-4179-906c-a90deea9c202 from backend
  657. [2021-03-29 15:00:07.450384] I [MSGID: 133022] [shard.c:3697:shard_delete_shards] 0-MRIData-shard: Deleted shards of gfid=47eac564-f087-44d3-9d7b-e42170e9f933 from backend
  658. [2021-03-29 15:00:07.479572] I [MSGID: 133022] [shard.c:3697:shard_delete_shards] 0-MRIData-shard: Deleted shards of gfid=d44f602a-0364-4474-82af-16581ed6bee8 from backend
  659. [2021-03-29 15:00:07.498314] I [MSGID: 133022] [shard.c:3697:shard_delete_shards] 0-MRIData-shard: Deleted shards of gfid=12eca677-8ece-4421-831d-069440fc2732 from backend
  660. [2021-03-29 15:00:07.503315] I [MSGID: 133022] [shard.c:3697:shard_delete_shards] 0-MRIData-shard: Deleted shards of gfid=61152776-0c59-4251-b1d0-fe3ad54d2476 from backend
  661. [2021-03-29 15:00:07.549471] I [MSGID: 133022] [shard.c:3697:shard_delete_shards] 0-MRIData-shard: Deleted shards of gfid=20ed8c4d-3c7b-4544-bd9c-c94cf2d78a3a from backend
  662. [2021-03-29 15:00:07.550253] I [MSGID: 133022] [shard.c:3697:shard_delete_shards] 0-MRIData-shard: Deleted shards of gfid=c4ee5448-7e86-4747-a594-7881741f3125 from backend
  663. [2021-03-29 15:00:07.865901] I [MSGID: 133022] [shard.c:3697:shard_delete_shards] 0-MRIData-shard: Deleted shards of gfid=c4ee5448-7e86-4747-a594-7881741f3125 from backend
  664. [2021-03-29 15:00:07.870200] I [MSGID: 133022] [shard.c:3697:shard_delete_shards] 0-MRIData-shard: Deleted shards of gfid=d1904c12-61f3-4709-81b8-5b3f06b3f1bb from backend
  665. [2021-03-29 15:00:07.872448] I [MSGID: 133022] [shard.c:3697:shard_delete_shards] 0-MRIData-shard: Deleted shards of gfid=5f630f72-48fb-4921-b535-40f57fb9365b from backend
  666. [2021-03-29 15:00:07.874646] I [MSGID: 133022] [shard.c:3697:shard_delete_shards] 0-MRIData-shard: Deleted shards of gfid=4b801cc7-55b6-4b75-99b4-b944ac50e529 from backend
  667. [2021-03-29 15:00:07.876650] I [MSGID: 133022] [shard.c:3697:shard_delete_shards] 0-MRIData-shard: Deleted shards of gfid=dea88eee-90aa-45c5-8245-785913fc484b from backend
  668. [2021-03-29 15:00:07.881506] I [MSGID: 133022] [shard.c:3697:shard_delete_shards] 0-MRIData-shard: Deleted shards of gfid=148d0d25-3139-4a2c-8226-cda63f6a3a17 from backend
  669. [2021-03-29 15:00:07.882210] I [MSGID: 133022] [shard.c:3697:shard_delete_shards] 0-MRIData-shard: Deleted shards of gfid=cdd73963-a0ae-47a3-87f8-edecdb4aae64 from backend
  670. [2021-03-29 15:00:07.927320] I [MSGID: 133022] [shard.c:3697:shard_delete_shards] 0-MRIData-shard: Deleted shards of gfid=7d35ce9c-a94a-407f-a5c4-d296b5442389 from backend
  671. [2021-03-29 15:00:07.931178] I [MSGID: 133022] [shard.c:3697:shard_delete_shards] 0-MRIData-shard: Deleted shards of gfid=68c30627-dd03-4b8a-b4d8-8f19f30878f9 from backend
  672. [2021-03-29 15:00:07.934819] I [MSGID: 133022] [shard.c:3697:shard_delete_shards] 0-MRIData-shard: Deleted shards of gfid=cdd73963-a0ae-47a3-87f8-edecdb4aae64 from backend
  673. [2021-03-29 15:00:08.138333] I [MSGID: 133022] [shard.c:3697:shard_delete_shards] 0-MRIData-shard: Deleted shards of gfid=cdd73963-a0ae-47a3-87f8-edecdb4aae64 from backend
  674. [2021-03-29 15:00:08.168359] I [MSGID: 133022] [shard.c:3697:shard_delete_shards] 0-MRIData-shard: Deleted shards of gfid=31bbc24e-7291-4377-8c00-7c2d807fc656 from backend
  675. [2021-03-29 15:00:08.175009] I [MSGID: 133022] [shard.c:3697:shard_delete_shards] 0-MRIData-shard: Deleted shards of gfid=4520901a-1bb3-4a6e-945e-c7fe3e984de3 from backend
  676. The message "I [MSGID: 133022] [shard.c:3697:shard_delete_shards] 0-MRIData-shard: Deleted shards of gfid=4eb8995f-e679-4473-80e5-88ef159722e2 from backend" repeated 2 times between [2021-03-29 15:00:07.032765] and [2021-03-29 15:00:07.056362]
RAW Paste Data