Advertisement
Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- [2015-09-22 07:09:02.203893] I [rpc-clnt.c:1819:rpc_clnt_reconfig] 0-vmstore-client-1: changing port to 49152 (from 0)
- [2015-09-22 07:09:02.209567] E [socket.c:2332:socket_connect_finish] 0-vmstore-client-1: connection to 10.70.40.13:49152 failed (Connection refused)
- [2015-09-22 07:09:06.207689] I [rpc-clnt.c:1819:rpc_clnt_reconfig] 0-vmstore-client-1: changing port to 49152 (from 0)
- [2015-09-22 07:09:06.211628] E [socket.c:2332:socket_connect_finish] 0-vmstore-client-1: connection to 10.70.40.13:49152 failed (Connection refused)
- [2015-09-22 07:09:09.207027] C [rpc-clnt-ping.c:161:rpc_clnt_ping_timer_expired] 0-vmstore-client-0: server 10.70.45.17:49217 has not responded in the last 42 seconds, disconnecting.
- [2015-09-22 07:09:09.207572] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FINODELK(30)) called at 2015-09-22 07:08:11.973632 (xid=0x5f16cd)
- [2015-09-22 07:09:09.207608] E [MSGID: 114031] [client-rpc-fops.c:1673:client3_3_finodelk_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.207987] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.233075 (xid=0x5f0e91)
- [2015-09-22 07:09:09.208015] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.208059] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.208086] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.208914] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292101: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.209272] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding framq:qe type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.233628 (xid=0x5f0e95)
- [2015-09-22 07:09:09.209493] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292121: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.209692] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.234316 (xid=0x5f0e9c)
- [2015-09-22 07:09:09.209979] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292123: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.210091] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.234886 (xid=0x5f0e9f)
- [2015-09-22 07:09:09.210376] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292125: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.210437] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.235016 (xid=0x5f0ea1)
- [2015-09-22 07:09:09.210761] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292127: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.210812] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.235333 (xid=0x5f0ea4)
- [2015-09-22 07:09:09.211188] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292129: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.211185] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.235560 (xid=0x5f0ea6)
- [2015-09-22 07:09:09.211543] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292131: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.211542] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.235629 (xid=0x5f0ea7)
- [2015-09-22 07:09:09.211699] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292133: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.211890] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292135: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.211899] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.235707 (xid=0x5f0ea8)
- [2015-09-22 07:09:09.212032] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292137: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.212170] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292139: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.212206] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.235774 (xid=0x5f0ea9)
- [2015-09-22 07:09:09.212250] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292141: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.212354] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292143: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.212438] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292145: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.212518] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292147: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.212513] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.235905 (xid=0x5f0eaa)
- [2015-09-22 07:09:09.212595] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292149: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.212703] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292151: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.212807] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292153: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.212862] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.235970 (xid=0x5f0eab)
- [2015-09-22 07:09:09.212912] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292155: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.213021] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292157: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.213099] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292159: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.213188] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292161: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.213208] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.236087 (xid=0x5f0eac)
- [2015-09-22 07:09:09.213264] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292163: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.213353] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292165: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.213431] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292167: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.213427] I [socket.c:3362:socket_submit_request] 0-vmstore-client-0: not connected (priv->connected = 0)
- [2015-09-22 07:09:09.213451] W [rpc-clnt.c:1571:rpc_clnt_submit] 0-vmstore-client-0: failed to submit rpc-request (XID: 0x5f16d4 Program: GlusterFS 3.3, ProgVers: 330, Proc: 30) to rpc-transport (vmstore-client-0)
- [2015-09-22 07:09:09.213511] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292169: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.213512] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.236167 (xid=0x5f0ead)
- [2015-09-22 07:09:09.213590] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292171: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.213708] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292173: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.213833] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292175: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.213834] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.236229 (xid=0x5f0eae)
- [2015-09-22 07:09:09.213941] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292177: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.214047] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292179: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.214123] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292181: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.214124] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.236292 (xid=0x5f0eaf)
- [2015-09-22 07:09:09.214154] I [rpc-clnt.c:1819:rpc_clnt_reconfig] 0-vmstore-client-0: changing port to 49217 (from 0)
- [2015-09-22 07:09:09.214197] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292183: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.214266] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292114: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.214289] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292185: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.214452] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292187: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.214457] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.236357 (xid=0x5f0eb0)
- [2015-09-22 07:09:09.214544] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292189: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.214649] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292191: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.214736] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292193: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.214796] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.236419 (xid=0x5f0eb1)
- [2015-09-22 07:09:09.214819] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292195: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.214920] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292197: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.215027] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292199: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.215100] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.236484 (xid=0x5f0eb2)
- [2015-09-22 07:09:09.215151] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292201: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.215253] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292203: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.215338] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292205: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.215376] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.236552 (xid=0x5f0eb3)
- [2015-09-22 07:09:09.215456] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292207: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.215559] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292209: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.215643] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.236618 (xid=0x5f0eb4)
- [2015-09-22 07:09:09.215684] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292211: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.215803] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292213: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.215894] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292215: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.215921] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.236688 (xid=0x5f0eb5)
- [2015-09-22 07:09:09.215981] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292217: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.216075] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292219: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.216155] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292221: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.216194] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.236747 (xid=0x5f0eb6)
- [2015-09-22 07:09:09.216230] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292223: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.216319] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292225: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.216397] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292227: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.216473] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292229: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.216465] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.462689 (xid=0x5f12c5)
- [2015-09-22 07:09:09.216551] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292231: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.216636] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292233: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.216730] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292235: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.216759] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.463638 (xid=0x5f12d2)
- [2015-09-22 07:09:09.216810] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292237: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.216920] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292239: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.217005] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292241: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.217024] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.463892 (xid=0x5f12d5)
- [2015-09-22 07:09:09.217085] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292243: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.217187] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292245: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.217282] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.463959 (xid=0x5f12d6)
- [2015-09-22 07:09:09.217299] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292247: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.217420] W [MSGID: 114061] [client-rpc-fops.c:4507:client3_3_fsync] 0-vmstore-client-0: (f465a1b6-96d8-4045-80c8-1cf2a851edce) remote_fd is -1. EBADFD [File descriptor in bad state]
- [2015-09-22 07:09:09.217537] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292250: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.217565] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.464229 (xid=0x5f12d9)
- [2015-09-22 07:09:09.217628] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292252: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.217753] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292254: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.217845] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292256: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.217879] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.464508 (xid=0x5f12dc)
- [2015-09-22 07:09:09.217927] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292258: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.218029] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292260: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.218113] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292262: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.218149] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.465098 (xid=0x5f12e3)
- [2015-09-22 07:09:09.218197] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292264: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.218296] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292266: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.218378] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292268: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.218404] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.465291 (xid=0x5f12e4)
- [2015-09-22 07:09:09.218472] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292270: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.218594] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292272: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.218654] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.465765 (xid=0x5f12eb)
- [2015-09-22 07:09:09.218687] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292274: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.218798] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292276: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.218917] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292278: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.218944] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.466109 (xid=0x5f12ef)
- [2015-09-22 07:09:09.219042] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292280: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.219135] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292282: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.219188] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.466301 (xid=0x5f12f0)
- The message "W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met" repeated 33 times between [2015-09-22 07:09:09.208086] and [2015-09-22 07:09:09.219220]
- [2015-09-22 07:09:09.219404] I [MSGID: 114057] [client-handshake.c:1437:select_server_supported_programs] 0-vmstore-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330)
- [2015-09-22 07:09:09.219449] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.466387 (xid=0x5f12f2)
- [2015-09-22 07:09:09.219458] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292286: WRITE => -1 (Read-only file system)
- The message "W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]" repeated 34 times between [2015-09-22 07:09:09.208059] and [2015-09-22 07:09:09.219478]
- [2015-09-22 07:09:09.219497] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.219564] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292288: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.219759] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.466527 (xid=0x5f12f4)
- [2015-09-22 07:09:09.219765] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292290: WRITE => -1 (Read-only file system)
- The message "W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]" repeated 35 times between [2015-09-22 07:09:09.208015] and [2015-09-22 07:09:09.219789]
- [2015-09-22 07:09:09.219804] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.219938] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292292: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.220048] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292294: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.220044] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.466582 (xid=0x5f12f5)
- [2015-09-22 07:09:09.219838] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.220082] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.220110] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.220114] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.220224] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292296: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.220328] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292298: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.220351] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.466820 (xid=0x5f12f8)
- [2015-09-22 07:09:09.220372] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.220377] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.220443] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292300: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.220612] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.466947 (xid=0x5f12f9)
- [2015-09-22 07:09:09.220619] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292302: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.220404] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.220636] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.220663] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.220676] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.220767] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292304: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.220917] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.467040 (xid=0x5f12fa)
- [2015-09-22 07:09:09.220927] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292306: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.220942] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.220956] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.221124] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292308: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.221193] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.469258 (xid=0x5f12fe)
- [2015-09-22 07:09:09.220984] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.221213] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.221233] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292310: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.221251] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.221255] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.221350] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292312: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.221480] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.477937 (xid=0x5f1319)
- [2015-09-22 07:09:09.221503] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292314: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.221501] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.221506] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.221606] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292316: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.221747] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292318: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.221768] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.479203 (xid=0x5f132b)
- [2015-09-22 07:09:09.221532] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.221788] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.221812] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.221816] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.221891] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292320: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.222047] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.479563 (xid=0x5f132f)
- [2015-09-22 07:09:09.222067] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.222071] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.222103] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292322: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.222223] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292324: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.222304] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.479618 (xid=0x5f1330)
- [2015-09-22 07:09:09.222316] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292326: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.222096] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.222333] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.222358] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.222362] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.222449] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292328: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.222577] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292330: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.222589] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.479988 (xid=0x5f1335)
- [2015-09-22 07:09:09.222608] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.222615] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.222687] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292332: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.222794] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292334: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.222856] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.480407 (xid=0x5f1339)
- [2015-09-22 07:09:09.222639] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.222876] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.222888] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292336: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.222912] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.222917] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.222992] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292338: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.223093] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292340: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.223127] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.480747 (xid=0x5f133d)
- [2015-09-22 07:09:09.223152] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.223157] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.223195] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292342: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.223290] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292344: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.223376] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.481100 (xid=0x5f1340)
- [2015-09-22 07:09:09.223182] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.223395] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.223401] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292346: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.223432] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.223436] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.223553] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292348: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.223652] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292350: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.223659] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.481326 (xid=0x5f1345)
- [2015-09-22 07:09:09.223687] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.223692] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.223754] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292352: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.223888] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292354: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.223902] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.481472 (xid=0x5f1346)
- [2015-09-22 07:09:09.223718] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.223927] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.223952] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.223956] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.223983] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292356: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.224093] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292358: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.224184] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.481612 (xid=0x5f1349)
- [2015-09-22 07:09:09.224199] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292360: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.224203] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.224218] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.224301] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292362: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.224414] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292364: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.224436] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.481906 (xid=0x5f134c)
- [2015-09-22 07:09:09.224244] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.224456] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.224479] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.224483] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.224540] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292366: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.224653] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292368: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.224711] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.482040 (xid=0x5f134f)
- [2015-09-22 07:09:09.224735] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.224740] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.224797] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292370: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.224892] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292372: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.224938] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.482154 (xid=0x5f1351)
- [2015-09-22 07:09:09.224763] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.224958] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.224981] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.224988] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292374: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.224985] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.225115] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292376: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.225185] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.482307 (xid=0x5f1353)
- [2015-09-22 07:09:09.225204] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.225208] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.225409] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.482606 (xid=0x5f1357)
- [2015-09-22 07:09:09.225231] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.225432] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.225458] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.225461] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.225656] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.483158 (xid=0x5f135c)
- [2015-09-22 07:09:09.225683] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.225688] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.225885] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.483250 (xid=0x5f135e)
- [2015-09-22 07:09:09.225712] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.225903] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.225926] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.225930] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.226130] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.483502 (xid=0x5f1360)
- [2015-09-22 07:09:09.226157] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.226153] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.226156] I [MSGID: 114046] [client-handshake.c:1213:client_setvolume_cbk] 0-vmstore-client-0: Connected to vmstore-client-0, attached to remote volume '/bricks/b1'.
- [2015-09-22 07:09:09.226188] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.226195] I [MSGID: 114047] [client-handshake.c:1224:client_setvolume_cbk] 0-vmstore-client-0: Server and Client lk-version numbers are not same, reopening the fds
- [2015-09-22 07:09:09.226215] I [MSGID: 114042] [client-handshake.c:1056:client_post_handshake] 0-vmstore-client-0: 8 fds open - Delaying child_up until they are re-opened
- [2015-09-22 07:09:09.226370] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.483558 (xid=0x5f1361)
- [2015-09-22 07:09:09.226388] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.226405] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.226409] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.226590] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.483813 (xid=0x5f1365)
- [2015-09-22 07:09:09.226608] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.226612] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.226821] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.484096 (xid=0x5f1368)
- [2015-09-22 07:09:09.226635] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.226841] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.226872] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.226879] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.227067] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.484251 (xid=0x5f136b)
- [2015-09-22 07:09:09.227084] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.227089] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.227287] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.484375 (xid=0x5f136d)
- [2015-09-22 07:09:09.227114] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.227305] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.227327] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.227331] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.227522] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.484580 (xid=0x5f1370)
- [2015-09-22 07:09:09.227540] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.227544] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.227757] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.484727 (xid=0x5f1372)
- [2015-09-22 07:09:09.227568] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.227781] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.227804] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.227808] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.228003] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.484786 (xid=0x5f1373)
- [2015-09-22 07:09:09.228021] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.228026] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.228219] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.484866 (xid=0x5f1374)
- [2015-09-22 07:09:09.228049] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.228238] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.228260] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.228264] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.228458] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.484933 (xid=0x5f1375)
- [2015-09-22 07:09:09.228480] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.228485] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.228695] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.485019 (xid=0x5f1376)
- [2015-09-22 07:09:09.228509] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.228715] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.228738] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.228742] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.228928] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.487178 (xid=0x5f137a)
- [2015-09-22 07:09:09.228946] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.228954] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.229152] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.499836 (xid=0x5f1386)
- [2015-09-22 07:09:09.228978] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.229169] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.229192] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.229196] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.229399] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.500131 (xid=0x5f1389)
- [2015-09-22 07:09:09.229417] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.229422] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.229617] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.500409 (xid=0x5f138d)
- [2015-09-22 07:09:09.229446] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.229635] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.229657] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.229661] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.229863] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.500622 (xid=0x5f138f)
- [2015-09-22 07:09:09.229881] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.229886] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.230081] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.500822 (xid=0x5f1391)
- [2015-09-22 07:09:09.229909] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.230099] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.230127] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.230131] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.230319] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.501012 (xid=0x5f1392)
- [2015-09-22 07:09:09.230337] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.230350] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.230539] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.513436 (xid=0x5f1396)
- [2015-09-22 07:09:09.230374] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.230557] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.230580] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.230594] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.230634] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292063: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.230827] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.517378 (xid=0x5f139d)
- [2015-09-22 07:09:09.230847] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.230863] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.230866] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.230903] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292379: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.231067] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.517455 (xid=0x5f139e)
- [2015-09-22 07:09:09.231085] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.231090] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.231138] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292381: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.231290] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.522976 (xid=0x5f13d2)
- [2015-09-22 07:09:09.231115] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.231315] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292383: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.231309] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.231344] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.231358] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.231443] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292385: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.231524] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.527474 (xid=0x5f1410)
- [2015-09-22 07:09:09.231542] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.231558] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.231562] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.231623] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292387: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.231755] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292389: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.231782] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.527723 (xid=0x5f1413)
- [2015-09-22 07:09:09.231800] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.231804] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.231871] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292391: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.231984] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.528104 (xid=0x5f1417)
- [2015-09-22 07:09:09.231826] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.232007] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292393: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.232003] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.232033] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.232037] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.232152] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292395: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.232224] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.528396 (xid=0x5f141c)
- [2015-09-22 07:09:09.232241] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.232245] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.232271] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292397: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.232426] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292399: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.232460] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.528969 (xid=0x5f1422)
- [2015-09-22 07:09:09.232274] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.232478] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.232500] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.232503] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.232540] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292401: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.232662] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292403: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.232693] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.529712 (xid=0x5f142b)
- [2015-09-22 07:09:09.232713] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.232718] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.232793] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292405: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.232901] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.530153 (xid=0x5f1430)
- [2015-09-22 07:09:09.232740] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.232918] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.232935] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292407: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.232939] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.232962] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.233065] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292409: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.233147] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.530484 (xid=0x5f1435)
- [2015-09-22 07:09:09.233167] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292411: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.233164] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.233169] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.233266] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292413: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.233355] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.530983 (xid=0x5f143c)
- [2015-09-22 07:09:09.233365] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292415: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.233191] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.233381] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.233404] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.233408] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.233504] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292417: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.233585] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.531143 (xid=0x5f143e)
- [2015-09-22 07:09:09.233603] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.233619] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292419: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.233607] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.233754] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292421: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.233827] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.531287 (xid=0x5f143f)
- [2015-09-22 07:09:09.233636] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.233845] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.233867] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.233871] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.233875] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292423: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.233990] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292425: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.234065] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.531714 (xid=0x5f1445)
- [2015-09-22 07:09:09.234083] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.234095] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292427: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.234087] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.234221] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292429: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.234278] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.532061 (xid=0x5f1448)
- [2015-09-22 07:09:09.234112] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.234295] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.234325] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292431: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.234323] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.234326] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.234466] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292433: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.234512] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.532358 (xid=0x5f144b)
- [2015-09-22 07:09:09.234529] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.234534] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.234564] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292435: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.234693] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292437: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.234752] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.532422 (xid=0x5f144d)
- [2015-09-22 07:09:09.234556] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.234770] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.234790] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.234794] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.234812] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292439: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.234911] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292441: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.234965] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.532479 (xid=0x5f144e)
- [2015-09-22 07:09:09.234987] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.234991] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.235012] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292443: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.235112] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292445: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.235179] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.532741 (xid=0x5f1452)
- [2015-09-22 07:09:09.235013] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.235196] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.235216] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.235220] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.235245] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292447: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.235352] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292449: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.235395] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.532910 (xid=0x5f1454)
- [2015-09-22 07:09:09.235411] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.235416] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.235503] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292451: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.235584] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.533077 (xid=0x5f1456)
- [2015-09-22 07:09:09.235601] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292453: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.235436] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.235606] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.235627] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.235630] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.235702] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292455: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.235804] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292457: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.235809] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.533269 (xid=0x5f1458)
- [2015-09-22 07:09:09.235827] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.235831] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.235904] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292459: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.236000] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292461: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.236010] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.533576 (xid=0x5f145b)
- [2015-09-22 07:09:09.235852] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.236027] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.236047] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.236051] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.236094] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292463: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.236209] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292465: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.236215] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.533635 (xid=0x5f145c)
- [2015-09-22 07:09:09.236232] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.236236] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.236321] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292467: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.236425] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.533808 (xid=0x5f145e)
- [2015-09-22 07:09:09.236434] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292470: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.236257] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.236446] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.236467] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.236470] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.236641] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.533976 (xid=0x5f1460)
- [2015-09-22 07:09:09.236658] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.236662] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.236732] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292474: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.236838] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292476: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.236846] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.534126 (xid=0x5f1462)
- [2015-09-22 07:09:09.236693] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.236868] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.236889] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.236892] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.236944] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292478: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.237045] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292480: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.237062] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.534329 (xid=0x5f1464)
- [2015-09-22 07:09:09.237078] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.237082] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.237141] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292482: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.237240] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292484: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.237250] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.534582 (xid=0x5f1467)
- [2015-09-22 07:09:09.237103] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.237267] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.237286] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.237290] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.237338] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292486: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.237433] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292488: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.237468] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.534660 (xid=0x5f1468)
- [2015-09-22 07:09:09.237485] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.237489] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.237556] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292490: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.237659] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292492: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.237658] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.534893 (xid=0x5f146b)
- [2015-09-22 07:09:09.237510] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.237684] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.237705] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.237709] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.237838] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292494: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.237871] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.534956 (xid=0x5f146c)
- [2015-09-22 07:09:09.237888] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.237892] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.237951] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292496: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.238070] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292498: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.238072] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.535211 (xid=0x5f146e)
- [2015-09-22 07:09:09.237913] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.238089] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.238109] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.238112] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.238167] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292500: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.238275] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292502: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.238278] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.535310 (xid=0x5f1470)
- [2015-09-22 07:09:09.238295] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.238300] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.238321] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.238378] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292504: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.238475] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292506: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.238483] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.535448 (xid=0x5f1472)
- [2015-09-22 07:09:09.238500] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.238514] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.238582] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292508: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.238697] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292510: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.238701] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.535508 (xid=0x5f1473)
- [2015-09-22 07:09:09.238532] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.238718] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.238738] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.238741] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.238802] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292512: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.238896] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292514: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.238915] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.535580 (xid=0x5f1474)
- [2015-09-22 07:09:09.238932] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.238936] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.239003] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292516: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.239114] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292518: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.239118] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.535707 (xid=0x5f1476)
- [2015-09-22 07:09:09.238957] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.239135] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.239161] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.239164] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.239211] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292520: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.239333] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.535760 (xid=0x5f1477)
- [2015-09-22 07:09:09.239350] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292522: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.239349] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.239354] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.239379] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.239457] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292524: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.239557] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.535884 (xid=0x5f1479)
- [2015-09-22 07:09:09.239563] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292526: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.239577] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.239592] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.239677] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292528: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.239761] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.536079 (xid=0x5f147c)
- [2015-09-22 07:09:09.239604] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.239783] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292530: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.239777] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.239816] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.239820] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.239899] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292532: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.239997] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292534: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.239995] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.536209 (xid=0x5f147e)
- [2015-09-22 07:09:09.240012] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.240017] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.240038] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.240097] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292536: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.240189] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292538: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.240197] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.536268 (xid=0x5f147f)
- [2015-09-22 07:09:09.240214] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.240228] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.240283] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292540: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.240375] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292542: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.240393] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.536321 (xid=0x5f1480)
- [2015-09-22 07:09:09.240240] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.240415] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.240436] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.240448] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.240466] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292544: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.240567] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292546: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.240602] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.536372 (xid=0x5f1481)
- [2015-09-22 07:09:09.240618] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.240633] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.240637] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.240678] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292548: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.240779] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292550: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.240816] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.536436 (xid=0x5f1482)
- [2015-09-22 07:09:09.240832] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.240837] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.240866] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.240874] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292552: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.240979] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292554: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.241016] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.536496 (xid=0x5f1483)
- [2015-09-22 07:09:09.241037] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.241052] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.241069] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292556: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.241165] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292558: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.241218] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.536552 (xid=0x5f1484)
- [2015-09-22 07:09:09.241064] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.241235] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.241257] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292560: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.241256] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.241278] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.241358] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292562: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.241431] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.536605 (xid=0x5f1485)
- [2015-09-22 07:09:09.241448] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292564: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.241448] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.241463] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.241467] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.241546] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292566: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.241645] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292568: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.241645] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.536661 (xid=0x5f1486)
- [2015-09-22 07:09:09.241662] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.241672] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.241719] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.241766] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292570: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.241856] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292572: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.241868] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.536729 (xid=0x5f1487)
- [2015-09-22 07:09:09.241884] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.241897] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.241909] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.241947] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292574: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.242038] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292576: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.242060] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.536791 (xid=0x5f1488)
- [2015-09-22 07:09:09.242076] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.242090] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.242125] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292578: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.242219] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292580: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.242256] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.536849 (xid=0x5f1489)
- [2015-09-22 07:09:09.242107] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.242272] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.242292] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.242295] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.242307] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292582: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.242403] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292584: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.242458] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.536903 (xid=0x5f148a)
- [2015-09-22 07:09:09.242474] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.242477] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.242496] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292586: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.242589] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292588: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.242640] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.536956 (xid=0x5f148b)
- [2015-09-22 07:09:09.242498] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.242656] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.242686] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292590: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.242684] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.242687] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.242791] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292592: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.242863] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.537082 (xid=0x5f148d)
- [2015-09-22 07:09:09.242880] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292594: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.242879] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.242883] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.242985] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292596: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:09.243045] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.537136 (xid=0x5f148e)
- [2015-09-22 07:09:09.242903] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.243061] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.243084] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.243087] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.243246] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.537209 (xid=0x5f148f)
- [2015-09-22 07:09:09.243262] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.243267] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.243436] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.537294 (xid=0x5f1490)
- [2015-09-22 07:09:09.243292] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.243452] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.243471] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.243475] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.243630] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.537350 (xid=0x5f1491)
- [2015-09-22 07:09:09.243646] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.243650] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.243821] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.537403 (xid=0x5f1492)
- [2015-09-22 07:09:09.243680] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.243837] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.243859] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.243862] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.244023] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.537457 (xid=0x5f1493)
- [2015-09-22 07:09:09.244044] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.244048] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.244209] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.542354 (xid=0x5f1497)
- [2015-09-22 07:09:09.244069] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.244225] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.244244] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.244248] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.244408] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.610378 (xid=0x5f14bb)
- [2015-09-22 07:09:09.244423] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.244430] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.244594] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.612498 (xid=0x5f14d8)
- [2015-09-22 07:09:09.244450] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.244610] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.244630] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.244633] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.244801] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.612764 (xid=0x5f14db)
- [2015-09-22 07:09:09.244819] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.244823] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.244980] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.613087 (xid=0x5f14df)
- [2015-09-22 07:09:09.244844] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.244996] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.245016] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.245019] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.245183] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.613230 (xid=0x5f14e0)
- [2015-09-22 07:09:09.245198] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.245202] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.245369] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.614363 (xid=0x5f14eb)
- [2015-09-22 07:09:09.245222] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.245389] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.245410] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.245414] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.245570] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.614953 (xid=0x5f14f1)
- [2015-09-22 07:09:09.245586] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.245592] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.245754] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.615438 (xid=0x5f14f3)
- [2015-09-22 07:09:09.245614] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.245771] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.245791] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.245794] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.245948] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.615829 (xid=0x5f14f7)
- [2015-09-22 07:09:09.245964] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.245969] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.246134] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.615985 (xid=0x5f14f9)
- [2015-09-22 07:09:09.245996] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.246150] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.246171] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.246175] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.246329] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.616265 (xid=0x5f14fd)
- [2015-09-22 07:09:09.246345] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.246351] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.246514] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.616469 (xid=0x5f1500)
- [2015-09-22 07:09:09.246372] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.246530] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.246549] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.246553] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.246718] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.616749 (xid=0x5f1503)
- [2015-09-22 07:09:09.246740] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.246746] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.246914] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.616938 (xid=0x5f1506)
- [2015-09-22 07:09:09.246768] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.246930] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.246953] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.246956] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.247107] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.617134 (xid=0x5f1509)
- [2015-09-22 07:09:09.247123] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.247127] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.247280] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.617383 (xid=0x5f150d)
- [2015-09-22 07:09:09.247146] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.247295] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.247315] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.247318] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.247482] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.617561 (xid=0x5f150f)
- [2015-09-22 07:09:09.247498] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.247502] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.247657] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.618005 (xid=0x5f1515)
- [2015-09-22 07:09:09.247522] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.247686] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.247718] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.247721] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.247872] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.618236 (xid=0x5f1518)
- [2015-09-22 07:09:09.247887] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.247895] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.248047] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.618369 (xid=0x5f151a)
- [2015-09-22 07:09:09.247914] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.248067] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.248086] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.248089] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.248234] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.618501 (xid=0x5f151c)
- [2015-09-22 07:09:09.248249] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.248253] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.248402] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.618684 (xid=0x5f151f)
- [2015-09-22 07:09:09.248272] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.248417] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.248436] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.248439] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.248593] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.619091 (xid=0x5f1521)
- [2015-09-22 07:09:09.248608] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.248612] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.248781] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.619220 (xid=0x5f1522)
- [2015-09-22 07:09:09.248637] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.248797] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.248821] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.248824] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.248973] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.619339 (xid=0x5f1523)
- [2015-09-22 07:09:09.248988] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.248995] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.249152] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.619480 (xid=0x5f1524)
- [2015-09-22 07:09:09.249014] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.249167] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.249188] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.249191] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.249335] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.619597 (xid=0x5f1525)
- [2015-09-22 07:09:09.249355] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.249361] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.249518] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.619730 (xid=0x5f1526)
- [2015-09-22 07:09:09.249384] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.249533] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.249552] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.249556] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.249708] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.619884 (xid=0x5f1527)
- [2015-09-22 07:09:09.249725] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.249732] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.249887] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.619943 (xid=0x5f1528)
- [2015-09-22 07:09:09.249752] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.249902] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.249921] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.249925] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.250078] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.619997 (xid=0x5f1529)
- [2015-09-22 07:09:09.250093] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.250099] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.250250] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.620100 (xid=0x5f152b)
- [2015-09-22 07:09:09.250118] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.250265] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.250285] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.250288] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.250433] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.620192 (xid=0x5f152c)
- [2015-09-22 07:09:09.250448] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.250452] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.250599] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.620243 (xid=0x5f152d)
- [2015-09-22 07:09:09.250471] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.250619] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.250638] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.250641] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.250791] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.620295 (xid=0x5f152e)
- [2015-09-22 07:09:09.250808] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.250815] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.250963] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.620351 (xid=0x5f152f)
- [2015-09-22 07:09:09.250834] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.250979] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.250997] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.251000] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.251141] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.620404 (xid=0x5f1530)
- [2015-09-22 07:09:09.251156] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.251161] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.251332] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.620458 (xid=0x5f1531)
- [2015-09-22 07:09:09.251186] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.251347] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.251368] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.251371] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.251517] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.620841 (xid=0x5f1534)
- [2015-09-22 07:09:09.251532] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.251538] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.251696] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.622102 (xid=0x5f1537)
- [2015-09-22 07:09:09.251557] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.251713] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.251733] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.251736] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.251881] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.641513 (xid=0x5f1559)
- [2015-09-22 07:09:09.251900] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.251905] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.252055] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.642318 (xid=0x5f1563)
- [2015-09-22 07:09:09.251925] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.252070] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.252092] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.252095] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.252237] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.642966 (xid=0x5f1569)
- [2015-09-22 07:09:09.252252] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.252256] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.252410] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.643189 (xid=0x5f156c)
- [2015-09-22 07:09:09.252276] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.252425] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.252444] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.252448] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.252602] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.643326 (xid=0x5f156e)
- [2015-09-22 07:09:09.252617] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.252621] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.252777] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.643563 (xid=0x5f1571)
- [2015-09-22 07:09:09.252640] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.252794] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.252817] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.252820] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.252966] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.643709 (xid=0x5f1574)
- [2015-09-22 07:09:09.252981] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.252987] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.253136] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.643913 (xid=0x5f1577)
- [2015-09-22 07:09:09.253007] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.253156] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.253175] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.253178] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.253329] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.643975 (xid=0x5f1579)
- [2015-09-22 07:09:09.253344] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.253348] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.253496] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.644384 (xid=0x5f157f)
- [2015-09-22 07:09:09.253367] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.253511] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.253532] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.253535] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.253683] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.644615 (xid=0x5f1582)
- [2015-09-22 07:09:09.253700] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.253704] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.253863] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.644812 (xid=0x5f1584)
- [2015-09-22 07:09:09.253729] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.253878] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.253899] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.253902] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.254048] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.644968 (xid=0x5f1586)
- [2015-09-22 07:09:09.254063] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.254069] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.254215] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.645110 (xid=0x5f1588)
- [2015-09-22 07:09:09.254089] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.254230] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.254250] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.254253] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.254393] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.645264 (xid=0x5f158a)
- [2015-09-22 07:09:09.254412] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.254416] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.254567] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.645329 (xid=0x5f158b)
- [2015-09-22 07:09:09.254436] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.254583] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.254602] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.254605] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.254752] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.645468 (xid=0x5f158d)
- [2015-09-22 07:09:09.254769] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.254774] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.254924] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.645530 (xid=0x5f158e)
- [2015-09-22 07:09:09.254796] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.254939] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.254961] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.254964] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.255112] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.645589 (xid=0x5f158f)
- [2015-09-22 07:09:09.255127] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.255133] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.255283] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.645656 (xid=0x5f1590)
- [2015-09-22 07:09:09.255152] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.255298] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.255320] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.255324] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.255464] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.645726 (xid=0x5f1591)
- [2015-09-22 07:09:09.255479] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.255483] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.255638] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.645795 (xid=0x5f1592)
- [2015-09-22 07:09:09.255502] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.255657] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.255687] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.255690] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.255841] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.645869 (xid=0x5f1593)
- [2015-09-22 07:09:09.255856] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.255861] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.256007] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.658797 (xid=0x5f159a)
- [2015-09-22 07:09:09.255881] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.256022] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.256043] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.256055] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.256186] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.658994 (xid=0x5f159b)
- [2015-09-22 07:09:09.256201] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.256217] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.256233] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.256370] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.674158 (xid=0x5f159f)
- [2015-09-22 07:09:09.256385] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.256399] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.256402] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.256542] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.681406 (xid=0x5f15cc)
- [2015-09-22 07:09:09.256557] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.256563] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.256583] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.256725] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.681817 (xid=0x5f15d1)
- [2015-09-22 07:09:09.256742] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.256759] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.256771] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.256903] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.683988 (xid=0x5f15ea)
- [2015-09-22 07:09:09.256922] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.256936] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.257082] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.684170 (xid=0x5f15ed)
- [2015-09-22 07:09:09.256947] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.257096] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.257120] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.257123] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.257266] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.684430 (xid=0x5f15f1)
- [2015-09-22 07:09:09.257281] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.257288] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.257437] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.684576 (xid=0x5f15f4)
- [2015-09-22 07:09:09.257308] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.257452] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.257473] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.257476] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.257626] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.684845 (xid=0x5f15f8)
- [2015-09-22 07:09:09.257641] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.257646] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.257814] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.685037 (xid=0x5f15fa)
- [2015-09-22 07:09:09.257665] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.257835] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.257853] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.257857] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.257999] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.685199 (xid=0x5f15fc)
- [2015-09-22 07:09:09.258013] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.258017] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.258159] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.685324 (xid=0x5f15fe)
- [2015-09-22 07:09:09.258039] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.258178] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.258196] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.258203] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.258340] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.685476 (xid=0x5f1600)
- [2015-09-22 07:09:09.258355] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.258360] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.258503] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.685719 (xid=0x5f1604)
- [2015-09-22 07:09:09.258378] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.258517] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.258535] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.258546] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.258684] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.685885 (xid=0x5f1606)
- [2015-09-22 07:09:09.258701] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.258714] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.258717] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.258856] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.686007 (xid=0x5f1608)
- [2015-09-22 07:09:09.258870] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.258874] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.259012] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.686134 (xid=0x5f160a)
- [2015-09-22 07:09:09.258892] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.259027] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.259045] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.259048] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.259187] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.686265 (xid=0x5f160c)
- [2015-09-22 07:09:09.259201] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.259205] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.259348] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.686477 (xid=0x5f160f)
- [2015-09-22 07:09:09.259224] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.259367] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.259386] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.259389] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.259527] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.686761 (xid=0x5f1612)
- [2015-09-22 07:09:09.259541] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.259545] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.259695] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.686888 (xid=0x5f1614)
- [2015-09-22 07:09:09.259564] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.259711] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.259729] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.259740] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.259872] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.686944 (xid=0x5f1615)
- [2015-09-22 07:09:09.259886] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.259906] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.259913] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.260058] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.687014 (xid=0x5f1616)
- [2015-09-22 07:09:09.260072] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.260078] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.260227] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.687072 (xid=0x5f1617)
- [2015-09-22 07:09:09.260097] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.260241] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.260259] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.260274] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.260407] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.687126 (xid=0x5f1618)
- [2015-09-22 07:09:09.260421] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.260440] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.260443] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.260585] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.687305 (xid=0x5f1619)
- [2015-09-22 07:09:09.260604] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.260608] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.260627] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.260763] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.687361 (xid=0x5f161a)
- [2015-09-22 07:09:09.260779] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.260792] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.260927] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.687418 (xid=0x5f161c)
- [2015-09-22 07:09:09.260803] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.260941] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.260959] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.260962] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.261096] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.687499 (xid=0x5f161d)
- [2015-09-22 07:09:09.261111] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.261115] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.261265] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.687572 (xid=0x5f161e)
- [2015-09-22 07:09:09.261139] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.261280] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.261298] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.261302] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.261441] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.687695 (xid=0x5f1620)
- [2015-09-22 07:09:09.261455] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.261459] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.261833] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.687753 (xid=0x5f1621)
- [2015-09-22 07:09:09.261478] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.261850] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.261872] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.261884] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.262174] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.687815 (xid=0x5f1622)
- [2015-09-22 07:09:09.262196] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.262210] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.262213] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.262515] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.687872 (xid=0x5f1623)
- [2015-09-22 07:09:09.262530] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.262536] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.262685] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.688599 (xid=0x5f1626)
- [2015-09-22 07:09:09.262555] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.262701] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.262720] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.262731] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.262864] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.689182 (xid=0x5f1627)
- [2015-09-22 07:09:09.262878] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.262900] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.262912] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.263044] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.691767 (xid=0x5f162b)
- [2015-09-22 07:09:09.263059] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.263071] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.263075] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.263212] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.706680 (xid=0x5f162f)
- [2015-09-22 07:09:09.263226] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.263230] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.263249] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.263381] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.726601 (xid=0x5f163d)
- [2015-09-22 07:09:09.263396] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.263409] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.263542] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.726680 (xid=0x5f163e)
- [2015-09-22 07:09:09.263419] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.263561] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.263583] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.263586] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.263729] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.727028 (xid=0x5f1640)
- [2015-09-22 07:09:09.263745] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.263750] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.263893] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.727339 (xid=0x5f1644)
- [2015-09-22 07:09:09.263769] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.263907] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.263931] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.263934] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.264069] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.728113 (xid=0x5f1648)
- [2015-09-22 07:09:09.264084] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.264093] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.264119] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.264254] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.728375 (xid=0x5f1649)
- [2015-09-22 07:09:09.264268] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.264285] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.264296] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.264428] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.728847 (xid=0x5f164b)
- [2015-09-22 07:09:09.264443] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.264455] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.264584] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.732245 (xid=0x5f164f)
- [2015-09-22 07:09:09.264465] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.264599] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.264619] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.264622] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.264771] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.737904 (xid=0x5f1669)
- [2015-09-22 07:09:09.264791] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.264809] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.264829] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.264961] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.738312 (xid=0x5f166d)
- [2015-09-22 07:09:09.264976] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.264989] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.264999] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.265133] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.738966 (xid=0x5f1678)
- [2015-09-22 07:09:09.265147] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.265165] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.265177] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.265309] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.740746 (xid=0x5f168b)
- [2015-09-22 07:09:09.265324] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.265341] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.265645] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.741075 (xid=0x5f1690)
- [2015-09-22 07:09:09.265352] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.265662] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.265693] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.265704] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.265833] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.741371 (xid=0x5f1692)
- [2015-09-22 07:09:09.265848] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.265860] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.265866] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.266005] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.741887 (xid=0x5f1697)
- [2015-09-22 07:09:09.266019] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.266027] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.266046] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.266182] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.742206 (xid=0x5f169b)
- [2015-09-22 07:09:09.266201] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.266214] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.266355] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.742572 (xid=0x5f169f)
- [2015-09-22 07:09:09.266225] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.266369] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.266388] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.266391] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.266524] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.742812 (xid=0x5f16a1)
- [2015-09-22 07:09:09.266538] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.266542] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.266686] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.743037 (xid=0x5f16a4)
- [2015-09-22 07:09:09.266560] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.266703] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.266735] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.266738] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.266879] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.743539 (xid=0x5f16a8)
- [2015-09-22 07:09:09.266894] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.266897] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.267045] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.744114 (xid=0x5f16ae)
- [2015-09-22 07:09:09.266916] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.267059] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.267077] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.267087] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.267276] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.744186 (xid=0x5f16b0)
- [2015-09-22 07:09:09.267291] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.267304] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.267307] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.267449] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.744629 (xid=0x5f16b6)
- [2015-09-22 07:09:09.267468] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.267472] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.267618] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(WRITE(13)) called at 2015-09-22 07:08:00.744894 (xid=0x5f16b8)
- [2015-09-22 07:09:09.267491] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.267636] W [MSGID: 114031] [client-rpc-fops.c:904:client3_3_writev_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.267677] W [MSGID: 114061] [client-rpc-fops.c:4507:client3_3_fsync] 0-vmstore-client-0: (e16d1e40-2b6e-4f19-977d-e099f465dfc6) remote_fd is -1. EBADFD [File descriptor in bad state]
- [2015-09-22 07:09:09.267692] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [File descriptor in bad state]
- [2015-09-22 07:09:09.267857] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FXATTROP(34)) called at 2015-09-22 07:08:00.744958 (xid=0x5f16b9)
- [2015-09-22 07:09:09.267872] W [MSGID: 114031] [client-rpc-fops.c:1914:client3_3_fxattrop_cbk] 0-vmstore-client-0: remote operation failed
- [2015-09-22 07:09:09.268057] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(WRITE(13)) called at 2015-09-22 07:08:00.745010 (xid=0x5f16ba)
- [2015-09-22 07:09:09.268071] W [MSGID: 114031] [client-rpc-fops.c:904:client3_3_writev_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.268091] W [MSGID: 114061] [client-rpc-fops.c:4507:client3_3_fsync] 0-vmstore-client-0: (e16d1e40-2b6e-4f19-977d-e099f465dfc6) remote_fd is -1. EBADFD [File descriptor in bad state]
- [2015-09-22 07:09:09.268102] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [File descriptor in bad state]
- [2015-09-22 07:09:09.268180] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.268260] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.745079 (xid=0x5f16bb)
- [2015-09-22 07:09:09.268274] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.268288] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.268297] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.268435] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(WRITE(13)) called at 2015-09-22 07:08:00.745236 (xid=0x5f16bc)
- [2015-09-22 07:09:09.268450] W [MSGID: 114031] [client-rpc-fops.c:904:client3_3_writev_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.268469] W [MSGID: 114061] [client-rpc-fops.c:4507:client3_3_fsync] 0-vmstore-client-0: (e16d1e40-2b6e-4f19-977d-e099f465dfc6) remote_fd is -1. EBADFD [File descriptor in bad state]
- [2015-09-22 07:09:09.268480] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [File descriptor in bad state]
- [2015-09-22 07:09:09.268616] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.745309 (xid=0x5f16bd)
- [2015-09-22 07:09:09.268630] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.268633] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.268651] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.268967] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FXATTROP(34)) called at 2015-09-22 07:08:00.745383 (xid=0x5f16be)
- [2015-09-22 07:09:09.268909] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.268988] W [MSGID: 114031] [client-rpc-fops.c:1914:client3_3_fxattrop_cbk] 0-vmstore-client-0: remote operation failed
- [2015-09-22 07:09:09.269094] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.269178] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.745403 (xid=0x5f16bf)
- [2015-09-22 07:09:09.269192] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.269205] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.269216] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.269439] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(WRITE(13)) called at 2015-09-22 07:08:00.745491 (xid=0x5f16c0)
- [2015-09-22 07:09:09.269453] W [MSGID: 114031] [client-rpc-fops.c:904:client3_3_writev_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.269473] W [MSGID: 114061] [client-rpc-fops.c:4507:client3_3_fsync] 0-vmstore-client-0: (e16d1e40-2b6e-4f19-977d-e099f465dfc6) remote_fd is -1. EBADFD [File descriptor in bad state]
- [2015-09-22 07:09:09.269616] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.745594 (xid=0x5f16c1)
- [2015-09-22 07:09:09.269484] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [File descriptor in bad state]
- [2015-09-22 07:09:09.269634] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.269653] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.269663] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.269813] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(WRITE(13)) called at 2015-09-22 07:08:00.745688 (xid=0x5f16c2)
- [2015-09-22 07:09:09.269827] W [MSGID: 114031] [client-rpc-fops.c:904:client3_3_writev_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.269846] W [MSGID: 114061] [client-rpc-fops.c:4507:client3_3_fsync] 0-vmstore-client-0: (e16d1e40-2b6e-4f19-977d-e099f465dfc6) remote_fd is -1. EBADFD [File descriptor in bad state]
- [2015-09-22 07:09:09.269848] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [File descriptor in bad state]
- [2015-09-22 07:09:09.270000] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.745758 (xid=0x5f16c3)
- [2015-09-22 07:09:09.270014] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.270026] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.270041] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.270302] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(WRITE(13)) called at 2015-09-22 07:08:00.745820 (xid=0x5f16c4)
- [2015-09-22 07:09:09.270316] W [MSGID: 114031] [client-rpc-fops.c:904:client3_3_writev_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.270333] W [MSGID: 114061] [client-rpc-fops.c:4507:client3_3_fsync] 0-vmstore-client-0: (e16d1e40-2b6e-4f19-977d-e099f465dfc6) remote_fd is -1. EBADFD [File descriptor in bad state]
- [2015-09-22 07:09:09.270351] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [File descriptor in bad state]
- [2015-09-22 07:09:09.270496] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.745880 (xid=0x5f16c5)
- The message "W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met" repeated 2 times between [2015-09-22 07:09:09.270041] and [2015-09-22 07:09:09.270438]
- [2015-09-22 07:09:09.270515] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.270542] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.270552] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.270682] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.745934 (xid=0x5f16c6)
- [2015-09-22 07:09:09.270698] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.270710] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.270720] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.270850] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(WRITE(13)) called at 2015-09-22 07:08:00.746003 (xid=0x5f16c7)
- [2015-09-22 07:09:09.270750] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.270864] W [MSGID: 114031] [client-rpc-fops.c:904:client3_3_writev_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.270893] W [MSGID: 114061] [client-rpc-fops.c:4507:client3_3_fsync] 0-vmstore-client-0: (e16d1e40-2b6e-4f19-977d-e099f465dfc6) remote_fd is -1. EBADFD [File descriptor in bad state]
- [2015-09-22 07:09:09.271033] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.746073 (xid=0x5f16c8)
- [2015-09-22 07:09:09.270904] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [File descriptor in bad state]
- [2015-09-22 07:09:09.271047] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.271071] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.271081] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.271218] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(WRITE(13)) called at 2015-09-22 07:08:00.746132 (xid=0x5f16c9)
- [2015-09-22 07:09:09.271232] W [MSGID: 114031] [client-rpc-fops.c:904:client3_3_writev_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.271251] W [MSGID: 114061] [client-rpc-fops.c:4507:client3_3_fsync] 0-vmstore-client-0: (e16d1e40-2b6e-4f19-977d-e099f465dfc6) remote_fd is -1. EBADFD [File descriptor in bad state]
- [2015-09-22 07:09:09.271254] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [File descriptor in bad state]
- [2015-09-22 07:09:09.271257] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.271396] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.746197 (xid=0x5f16ca)
- [2015-09-22 07:09:09.271411] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:09.271424] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
- [2015-09-22 07:09:09.271434] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.271561] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(LOOKUP(27)) called at 2015-09-22 07:08:07.992129 (xid=0x5f16cb)
- [2015-09-22 07:09:09.271578] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: / (00000000-0000-0000-0000-000000000001) [Transport endpoint is not connected]
- [2015-09-22 07:09:09.271585] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:09.271736] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(LOOKUP(27)) called at 2015-09-22 07:08:08.890808 (xid=0x5f16cc)
- [2015-09-22 07:09:09.271755] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: / (00000000-0000-0000-0000-000000000001) [Transport endpoint is not connected]
- [2015-09-22 07:09:09.272009] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(LOOKUP(27)) called at 2015-09-22 07:08:15.819826 (xid=0x5f16ce)
- [2015-09-22 07:09:09.272230] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(LOOKUP(27)) called at 2015-09-22 07:08:18.173119 (xid=0x5f16cf)
- [2015-09-22 07:09:09.272395] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GF-DUMP) op(NULL(2)) called at 2015-09-22 07:08:27.002157 (xid=0x5f16d0)
- [2015-09-22 07:09:09.272410] W [rpc-clnt-ping.c:199:rpc_clnt_ping_cbk] 0-vmstore-client-0: socket or ib related error
- [2015-09-22 07:09:09.272506] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(LOOKUP(27)) called at 2015-09-22 07:08:33.326302 (xid=0x5f16d1)
- [2015-09-22 07:09:09.272671] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(LOOKUP(27)) called at 2015-09-22 07:08:39.852148 (xid=0x5f16d2)
- [2015-09-22 07:09:09.272839] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(LOOKUP(27)) called at 2015-09-22 07:09:07.998435 (xid=0x5f16d3)
- The message "W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: / (00000000-0000-0000-0000-000000000001) [Transport endpoint is not connected]" repeated 5 times between [2015-09-22 07:09:09.271755] and [2015-09-22 07:09:09.272861]
- [2015-09-22 07:09:09.272911] I [MSGID: 114018] [client.c:2042:client_rpc_notify] 0-vmstore-client-0: disconnected from vmstore-client-0. Client process will keep trying to connect to glusterd until brick's port is available
- [2015-09-22 07:09:09.272936] W [MSGID: 108001] [afr-common.c:4043:afr_notify] 0-vmstore-replicate-0: Client-quorum is not met
- [2015-09-22 07:09:09.724874] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292614: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:10.212977] I [rpc-clnt.c:1819:rpc_clnt_reconfig] 0-vmstore-client-1: changing port to 49152 (from 0)
- [2015-09-22 07:09:10.218084] E [socket.c:2332:socket_connect_finish] 0-vmstore-client-1: connection to 10.70.40.13:49152 failed (Connection refused)
- [2015-09-22 07:09:10.228474] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292625: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:10.732420] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292636: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:11.236284] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292647: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:11.740210] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292658: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:14.219129] I [rpc-clnt.c:1819:rpc_clnt_reconfig] 0-vmstore-client-1: changing port to 49152 (from 0)
- [2015-09-22 07:09:14.224609] E [socket.c:2332:socket_connect_finish] 0-vmstore-client-1: connection to 10.70.40.13:49152 failed (Connection refused)
- [2015-09-22 07:09:15.829279] I [MSGID: 108031] [afr-common.c:1745:afr_local_discovery_cbk] 0-vmstore-replicate-0: selecting local read_child vmstore-client-2
- [2015-09-22 07:09:18.223710] I [rpc-clnt.c:1819:rpc_clnt_reconfig] 0-vmstore-client-1: changing port to 49152 (from 0)
- [2015-09-22 07:09:18.227733] E [socket.c:2332:socket_connect_finish] 0-vmstore-client-1: connection to 10.70.40.13:49152 failed (Connection refused)
- [2015-09-22 07:09:18.932624] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292684: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:22.230706] I [rpc-clnt.c:1819:rpc_clnt_reconfig] 0-vmstore-client-1: changing port to 49152 (from 0)
- [2015-09-22 07:09:22.236888] E [socket.c:2332:socket_connect_finish] 0-vmstore-client-1: connection to 10.70.40.13:49152 failed (Connection refused)
- [2015-09-22 07:09:26.237714] I [rpc-clnt.c:1819:rpc_clnt_reconfig] 0-vmstore-client-1: changing port to 49152 (from 0)
- [2015-09-22 07:09:26.243947] E [socket.c:2332:socket_connect_finish] 0-vmstore-client-1: connection to 10.70.40.13:49152 failed (Connection refused)
- [2015-09-22 07:09:28.965463] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292705: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:31.199627] I [rpc-clnt.c:1819:rpc_clnt_reconfig] 0-vmstore-client-1: changing port to 49152 (from 0)
- [2015-09-22 07:09:31.205201] E [socket.c:2332:socket_connect_finish] 0-vmstore-client-1: connection to 10.70.40.13:49152 failed (Connection refused)
- [2015-09-22 07:09:34.248724] I [rpc-clnt.c:1819:rpc_clnt_reconfig] 0-vmstore-client-1: changing port to 49152 (from 0)
- [2015-09-22 07:09:34.253975] E [socket.c:2332:socket_connect_finish] 0-vmstore-client-1: connection to 10.70.40.13:49152 failed (Connection refused)
- [2015-09-22 07:09:38.254736] I [rpc-clnt.c:1819:rpc_clnt_reconfig] 0-vmstore-client-1: changing port to 49152 (from 0)
- [2015-09-22 07:09:38.260170] E [socket.c:2332:socket_connect_finish] 0-vmstore-client-1: connection to 10.70.40.13:49152 failed (Connection refused)
- [2015-09-22 07:09:38.998578] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292731: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:42.261133] I [rpc-clnt.c:1819:rpc_clnt_reconfig] 0-vmstore-client-1: changing port to 49152 (from 0)
- [2015-09-22 07:09:42.266598] E [socket.c:2332:socket_connect_finish] 0-vmstore-client-1: connection to 10.70.40.13:49152 failed (Connection refused)
- [2015-09-22 07:09:46.267150] I [rpc-clnt.c:1819:rpc_clnt_reconfig] 0-vmstore-client-1: changing port to 49152 (from 0)
- [2015-09-22 07:09:46.272761] E [socket.c:2332:socket_connect_finish] 0-vmstore-client-1: connection to 10.70.40.13:49152 failed (Connection refused)
- [2015-09-22 07:09:49.028956] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292755: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:50.273182] I [rpc-clnt.c:1819:rpc_clnt_reconfig] 0-vmstore-client-1: changing port to 49152 (from 0)
- [2015-09-22 07:09:50.278675] E [socket.c:2332:socket_connect_finish] 0-vmstore-client-1: connection to 10.70.40.13:49152 failed (Connection refused)
- [2015-09-22 07:09:52.272547] C [rpc-clnt-ping.c:161:rpc_clnt_ping_timer_expired] 0-vmstore-client-0: server 10.70.45.17:49217 has not responded in the last 42 seconds, disconnecting.
- [2015-09-22 07:09:52.272888] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FINODELK(30)) called at 2015-09-22 07:09:09.226502 (xid=0x5f16e3)
- [2015-09-22 07:09:52.273109] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FINODELK(30)) called at 2015-09-22 07:09:09.236579 (xid=0x5f16e4)
- [2015-09-22 07:09:52.273341] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FINODELK(30)) called at 2015-09-22 07:09:09.267142 (xid=0x5f16e5)
- [2015-09-22 07:09:52.274340] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(OPEN(11)) called at 2015-09-22 07:09:09.226395 (xid=0x5f16e0)
- The message "E [MSGID: 114031] [client-rpc-fops.c:1673:client3_3_finodelk_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]" repeated 6 times between [2015-09-22 07:09:09.207608] and [2015-09-22 07:09:52.273697]
- [2015-09-22 07:09:52.274381] W [MSGID: 114032] [client-handshake.c:706:client3_3_reopen_cbk] 0-vmstore-client-0: received RPC status error, returning ENOTCONN [Transport endpoint is not connected]
- [2015-09-22 07:09:52.274599] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(OPEN(11)) called at 2015-09-22 07:09:09.226420 (xid=0x5f16e1)
- [2015-09-22 07:09:52.274795] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(OPEN(11)) called at 2015-09-22 07:09:09.226443 (xid=0x5f16e2)
- The message "W [MSGID: 114032] [client-handshake.c:706:client3_3_reopen_cbk] 0-vmstore-client-0: received RPC status error, returning ENOTCONN [Transport endpoint is not connected]" repeated 2 times between [2015-09-22 07:09:52.274381] and [2015-09-22 07:09:52.274815]
- [2015-09-22 07:09:52.274820] I [MSGID: 114041] [client-handshake.c:678:client_child_up_reopen_done] 0-vmstore-client-0: last fd open'd/lock-self-heal'd - notifying CHILD-UP
- [2015-09-22 07:09:52.274871] W [MSGID: 114032] [client-handshake.c:182:client_set_lk_version_cbk] 0-vmstore-client-0: received RPC status error [Transport endpoint is not connected]
- [2015-09-22 07:09:52.274891] I [MSGID: 108002] [afr-common.c:4039:afr_notify] 0-vmstore-replicate-0: Client-quorum is met
- [2015-09-22 07:09:52.275120] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(WRITE(13)) called at 2015-09-22 07:09:09.267924 (xid=0x5f16e6)
- [2015-09-22 07:09:52.275146] W [MSGID: 114031] [client-rpc-fops.c:904:client3_3_writev_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:52.275203] W [MSGID: 114061] [client-rpc-fops.c:4507:client3_3_fsync] 0-vmstore-client-0: (e16d1e40-2b6e-4f19-977d-e099f465dfc6) remote_fd is -1. EBADFD [File descriptor in bad state]
- [2015-09-22 07:09:52.275240] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [File descriptor in bad state]
- [2015-09-22 07:09:52.275463] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(WRITE(13)) called at 2015-09-22 07:09:09.269043 (xid=0x5f16e7)
- [2015-09-22 07:09:52.275498] W [MSGID: 114031] [client-rpc-fops.c:904:client3_3_writev_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:52.275543] W [MSGID: 114061] [client-rpc-fops.c:4507:client3_3_fsync] 0-vmstore-client-0: (e16d1e40-2b6e-4f19-977d-e099f465dfc6) remote_fd is -1. EBADFD [File descriptor in bad state]
- [2015-09-22 07:09:52.275559] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [File descriptor in bad state]
- [2015-09-22 07:09:52.275807] W [fuse-bridge.c:1230:fuse_err_cbk] 0-glusterfs-fuse: 5292758: FSYNC() ERR => -1 (Read-only file system)
- [2015-09-22 07:09:52.275806] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:52.275811] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(LOOKUP(27)) called at 2015-09-22 07:09:09.271971 (xid=0x5f16e8)
- [2015-09-22 07:09:52.275864] E [MSGID: 114031] [client-rpc-fops.c:1673:client3_3_finodelk_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:52.275870] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: /a7883778-47a0-4c37-a43d-84b5c103eebf (f2fdc88c-e824-4314-bd7d-df9b6902fade) [Transport endpoint is not connected]
- [2015-09-22 07:09:52.276200] W [fuse-bridge.c:1230:fuse_err_cbk] 0-glusterfs-fuse: 5292760: FSYNC() ERR => -1 (Read-only file system)
- [2015-09-22 07:09:52.276221] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
- [2015-09-22 07:09:52.276241] E [MSGID: 114031] [client-rpc-fops.c:1673:client3_3_finodelk_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:52.276288] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292761: WRITE => -1 (Read-only file system)
- [2015-09-22 07:09:52.276479] W [fuse-bridge.c:1230:fuse_err_cbk] 0-glusterfs-fuse: 5292762: FSYNC() ERR => -1 (Read-only file system)
- [2015-09-22 07:09:52.277653] W [fuse-bridge.c:1230:fuse_err_cbk] 0-glusterfs-fuse: 5292763: FSYNC() ERR => -1 (Read-only file system)
- [2015-09-22 07:09:52.278099] W [fuse-bridge.c:1230:fuse_err_cbk] 0-glusterfs-fuse: 5292764: FSYNC() ERR => -1 (Read-only file system)
- [2015-09-22 07:09:52.278528] W [fuse-bridge.c:1230:fuse_err_cbk] 0-glusterfs-fuse: 5292765: FSYNC() ERR => -1 (Read-only file system)
- [2015-09-22 07:09:52.278594] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(LOOKUP(27)) called at 2015-09-22 07:09:09.272132 (xid=0x5f16e9)
- [2015-09-22 07:09:52.278623] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: /a7883778-47a0-4c37-a43d-84b5c103eebf (f2fdc88c-e824-4314-bd7d-df9b6902fade) [Transport endpoint is not connected]
- [2015-09-22 07:09:52.278626] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: (null) (00000000-0000-0000-0000-000000000000) [Transport endpoint is not connected]
- [2015-09-22 07:09:52.278909] W [fuse-bridge.c:1230:fuse_err_cbk] 0-glusterfs-fuse: 5292766: FSYNC() ERR => -1 (Read-only file system)
- [2015-09-22 07:09:52.279221] E [MSGID: 114031] [client-rpc-fops.c:1727:client3_3_entrylk_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:52.280392] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: (null) (00000000-0000-0000-0000-000000000000) [Transport endpoint is not connected]
- [2015-09-22 07:09:52.281191] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: /a7883778-47a0-4c37-a43d-84b5c103eebf (f2fdc88c-e824-4314-bd7d-df9b6902fade) [Transport endpoint is not connected]
- [2015-09-22 07:09:52.281644] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: (null) (00000000-0000-0000-0000-000000000000) [Transport endpoint is not connected]
- [2015-09-22 07:09:52.281703] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(LOOKUP(27)) called at 2015-09-22 07:09:09.272236 (xid=0x5f16ea)
- [2015-09-22 07:09:52.281733] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: /a7883778-47a0-4c37-a43d-84b5c103eebf (f2fdc88c-e824-4314-bd7d-df9b6902fade) [Transport endpoint is not connected]
- [2015-09-22 07:09:52.282420] E [MSGID: 114031] [client-rpc-fops.c:1727:client3_3_entrylk_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:52.282459] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: /a7883778-47a0-4c37-a43d-84b5c103eebf/images (cda425e2-d87f-4e83-841f-135b4620bb56) [Transport endpoint is not connected]
- [2015-09-22 07:09:52.282729] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: (null) (00000000-0000-0000-0000-000000000000) [Transport endpoint is not connected]
- [2015-09-22 07:09:52.283267] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(LOOKUP(27)) called at 2015-09-22 07:09:09.272335 (xid=0x5f16eb)
- [2015-09-22 07:09:52.283328] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: /a7883778-47a0-4c37-a43d-84b5c103eebf (f2fdc88c-e824-4314-bd7d-df9b6902fade) [Transport endpoint is not connected]
- [2015-09-22 07:09:52.285551] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: (null) (00000000-0000-0000-0000-000000000000) [Transport endpoint is not connected]
- [2015-09-22 07:09:52.285613] E [MSGID: 114031] [client-rpc-fops.c:1727:client3_3_entrylk_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:52.285721] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: (null) (00000000-0000-0000-0000-000000000000) [Transport endpoint is not connected]
- [2015-09-22 07:09:52.286326] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(LOOKUP(27)) called at 2015-09-22 07:09:09.272620 (xid=0x5f16ec)
- [2015-09-22 07:09:52.285736] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: (null) (00000000-0000-0000-0000-000000000000) [Transport endpoint is not connected]
- [2015-09-22 07:09:52.286369] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: /a7883778-47a0-4c37-a43d-84b5c103eebf (f2fdc88c-e824-4314-bd7d-df9b6902fade) [Transport endpoint is not connected]
- [2015-09-22 07:09:52.286510] E [MSGID: 114031] [client-rpc-fops.c:1727:client3_3_entrylk_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:52.287059] E [MSGID: 114031] [client-rpc-fops.c:1727:client3_3_entrylk_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:52.287061] W [MSGID: 114031] [client-rpc-fops.c:842:client3_3_statfs_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
- [2015-09-22 07:09:52.287175] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: (null) (00000000-0000-0000-0000-000000000000) [Transport endpoint is not connected]
- [2015-09-22 07:09:52.287486] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: / (00000000-0000-0000-0000-000000000001) [Transport endpoint is not connected]
- [2015-09-22 07:09:52.287643] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: (null) (00000000-0000-0000-0000-000000000000) [Transport endpoint is not connected]
- [2015-09-22 07:09:52.287812] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: / (00000000-0000-0000-0000-000000000001) [Transport endpoint is not connected]
- [2015-09-22 07:09:52.288358] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: /a7883778-47a0-4c37-a43d-84b5c103eebf/images (cda425e2-d87f-4e83-841f-135b4620bb56) [Transport endpoint is not connected]
- [2015-09-22 07:09:52.288387] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: / (00000000-0000-0000-0000-000000000001) [Transport endpoint is not connected]
- [2015-09-22 07:09:52.288526] I [MSGID: 108031] [afr-common.c:1745:afr_local_discovery_cbk] 0-vmstore-replicate-0: selecting local read_child vmstore-client-2
- [2015-09-22 07:09:52.288592] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: /a7883778-47a0-4c37-a43d-84b5c103eebf/images (cda425e2-d87f-4e83-841f-135b4620bb56) [Transport endpoint is not connected]
- [2015-09-22 07:09:52.288732] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: (null) (00000000-0000-0000-0000-000000000000) [Transport endpoint is not connected]
- [2015-09-22 07:09:52.289138] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GF-DUMP) op(NULL(2)) called at 2015-09-22 07:09:09.272636 (xid=0x5f16ed)
- [2015-09-22 07:09:52.289164] W [rpc-clnt-ping.c:204:rpc_clnt_ping_cbk] 0-vmstore-client-0: socket disconnected
- [2015-09-22 07:09:52.289883] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(LOOKUP(27)) called at 2015-09-22 07:09:09.272786 (xid=0x5f16ee)
- [2015-09-22 07:09:52.288966] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: (null) (00000000-0000-0000-0000-000000000000) [Transport endpoint is not connected]
- [2015-09-22 07:09:52.289928] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: /a7883778-47a0-4c37-a43d-84b5c103eebf (f2fdc88c-e824-4314-bd7d-df9b6902fade) [Transport endpoint is not connected]
- [2015-09-22 07:09:52.290540] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: (null) (00000000-0000-0000-0000-000000000000) [Transport endpoint is not connected]
- [2015-09-22 07:09:52.290897] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(LOOKUP(27)) called at 2015-09-22 07:09:09.272956 (xid=0x5f16ef)
- [2015-09-22 07:09:52.290938] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: /a7883778-47a0-4c37-a43d-84b5c103eebf (f2fdc88c-e824-4314-bd7d-df9b6902fade) [Transport endpoint is not connected]
- [2015-09-22 07:09:52.291524] W [MSGID: 108001] [afr-common.c:4043:afr_notify] 0-vmstore-replicate-0: Client-quorum is not met
- [2015-09-22 07:09:52.293938] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: (null) (00000000-0000-0000-0000-000000000000) [Transport endpoint is not connected]
- [2015-09-22 07:09:54.280613] I [rpc-clnt.c:1819:rpc_clnt_reconfig] 0-vmstore-client-1: changing port to 49152 (from 0)
- [2015-09-22 07:09:54.286461] E [socket.c:2332:socket_connect_finish] 0-vmstore-client-1: connection to 10.70.40.13:49152 failed (Connection refused)
- [2015-09-22 07:09:58.285686] I [rpc-clnt.c:1819:rpc_clnt_reconfig] 0-vmstore-client-1: changing port to 49152 (from 0)
- [2015-09-22 07:09:58.290488] E [socket.c:2332:socket_connect_finish] 0-vmstore-client-1: connection to 10.70.40.13:49152 failed (Connection refused)
- The message "W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: (null) (00000000-0000-0000-0000-000000000000) [Transport endpoint is not connected]" repeated 4 times between [2015-09-22 07:09:52.293938] and [2015-09-22 07:09:52.295688]
- [2015-09-22 07:09:59.025130] I [MSGID: 108031] [afr-common.c:1745:afr_local_discovery_cbk] 0-vmstore-replicate-0: selecting local read_child vmstore-client-2
- [2015-09-22 07:09:59.058408] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292804: WRITE => -1 (Read-only file system)
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement