[2019-01-24 07:03:28.938745] W [MSGID: 108001] [afr-transaction.c:1062:afr_handle_quorum] 0-persistent-replicate-0: 7212652e-c437-426c-a0a9-a47f5972fffe: Failing WRITE as quorum is not met [Transport endpoint is not connected]
[2019-01-24 07:03:28.939280] E [mem-pool.c:331:__gf_free] (-->/usr/lib/x86_64-linux-gnu/glusterfs/5.3/xlator/cluster/replicate.so(+0x5be8c) [0x7eff84248e8c] -->/usr/lib/x86_64-linux-gnu/glusterfs/5.3/xlator/cluster/replicate.so(+0x5be18) [0x7eff84248e18] -->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(__gf_free+0xf6) [0x7eff8a9485a6] ) 0-: Assertion failed: GF_MEM_TRAILER_MAGIC == *(uint32_t *)((char *)free_ptr + header->size)
[2019-01-24 07:03:32.420891] E [mem-pool.c:331:__gf_free] (-->/usr/lib/x86_64-linux-gnu/glusterfs/5.3/xlator/cluster/replicate.so(+0x252d3) [0x7eff842122d3] -->/usr/lib/x86_64-linux-gnu/glusterfs/5.3/xlator/cluster/replicate.so(+0x5bf12) [0x7eff84248f12] -->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(__gf_free+0xf6) [0x7eff8a9485a6] ) 0-: Assertion failed: GF_MEM_TRAILER_MAGIC == *(uint32_t *)((char *)free_ptr + header->size)
[2019-01-24 07:03:32.426106] E [mem-pool.c:331:__gf_free] (-->/usr/lib/x86_64-linux-gnu/glusterfs/5.3/xlator/cluster/replicate.so(+0x36584) [0x7eff84223584] -->/usr/lib/x86_64-linux-gnu/glusterfs/5.3/xlator/cluster/replicate.so(+0x5bf2a) [0x7eff84248f2a] -->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(__gf_free+0xf6) [0x7eff8a9485a6] ) 0-: Assertion failed: GF_MEM_TRAILER_MAGIC == *(uint32_t *)((char *)free_ptr + header->size)
[2019-01-24 07:03:32.576456] E [mem-pool.c:331:__gf_free] (-->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(+0x18e15) [0x7eff8a913e15] -->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(data_destroy+0x4b) [0x7eff8a91340b] -->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(__gf_free+0xf6) [0x7eff8a9485a6] ) 0-: Assertion failed: GF_MEM_TRAILER_MAGIC == *(uint32_t *)((char *)free_ptr + header->size)
pending frames:
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
patchset: git://git.gluster.org/glusterfs.git
signal received: 11
time of crash:
2019-01-24 07:03:34
configuration details:
argp 1
backtrace 1
dlfcn 1
libpthread 1
llistxattr 1
setfsid 1
spinlock 1
epoll.h 1
xattr.h 1
st_atim.tv_nsec 1
package-string: glusterfs 5.3
/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(+0x2428a)[0x7eff8a91f28a]
/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(gf_print_trace+0x2f7)[0x7eff8a929697]
/lib/x86_64-linux-gnu/libc.so.6(+0x33060)[0x7eff89390060]
/lib/x86_64-linux-gnu/libc.so.6(+0x7789b)[0x7eff893d489b]
/usr/lib/x86_64-linux-gnu/glusterfs/5.3/xlator/cluster/distribute.so(+0x8356)[0x7eff7fb3e356]
/usr/lib/x86_64-linux-gnu/glusterfs/5.3/xlator/cluster/distribute.so(+0x6e338)[0x7eff7fba4338]
/usr/lib/x86_64-linux-gnu/glusterfs/5.3/xlator/performance/readdir-ahead.so(+0x7cc3)[0x7eff7fdf7cc3]
/usr/lib/x86_64-linux-gnu/glusterfs/5.3/xlator/cluster/replicate.so(+0x252b7)[0x7eff842122b7]
/usr/lib/x86_64-linux-gnu/glusterfs/5.3/xlator/cluster/replicate.so(+0x2583e)[0x7eff8421283e]
/usr/lib/x86_64-linux-gnu/glusterfs/5.3/xlator/protocol/client.so(+0x55865)[0x7eff844da865]
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(+0xe130)[0x7eff8a6ed130]
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(+0xe48f)[0x7eff8a6ed48f]
/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_transport_notify+0x23)[0x7eff8a6e9893]
/usr/lib/x86_64-linux-gnu/glusterfs/5.3/rpc-transport/socket.so(+0x9671)[0x7eff853a1671]
/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(+0x81945)[0x7eff8a97c945]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x7494)[0x7eff89b9c494]
/lib/x86_64-linux-gnu/libc.so.6(clone+0x3f)[0x7eff89445acf]
---------