Advertisement
Guest User

Untitled

a guest
Sep 22nd, 2015
120
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 375.02 KB | None | 0 0
  1. [2015-09-22 07:09:02.203893] I [rpc-clnt.c:1819:rpc_clnt_reconfig] 0-vmstore-client-1: changing port to 49152 (from 0)
  2. [2015-09-22 07:09:02.209567] E [socket.c:2332:socket_connect_finish] 0-vmstore-client-1: connection to 10.70.40.13:49152 failed (Connection refused)
  3. [2015-09-22 07:09:06.207689] I [rpc-clnt.c:1819:rpc_clnt_reconfig] 0-vmstore-client-1: changing port to 49152 (from 0)
  4. [2015-09-22 07:09:06.211628] E [socket.c:2332:socket_connect_finish] 0-vmstore-client-1: connection to 10.70.40.13:49152 failed (Connection refused)
  5. [2015-09-22 07:09:09.207027] C [rpc-clnt-ping.c:161:rpc_clnt_ping_timer_expired] 0-vmstore-client-0: server 10.70.45.17:49217 has not responded in the last 42 seconds, disconnecting.
  6. [2015-09-22 07:09:09.207572] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FINODELK(30)) called at 2015-09-22 07:08:11.973632 (xid=0x5f16cd)
  7. [2015-09-22 07:09:09.207608] E [MSGID: 114031] [client-rpc-fops.c:1673:client3_3_finodelk_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  8. [2015-09-22 07:09:09.207987] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.233075 (xid=0x5f0e91)
  9. [2015-09-22 07:09:09.208015] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  10. [2015-09-22 07:09:09.208059] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  11. [2015-09-22 07:09:09.208086] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  12. [2015-09-22 07:09:09.208914] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292101: WRITE => -1 (Read-only file system)
  13. [2015-09-22 07:09:09.209272] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding framq:qe type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.233628 (xid=0x5f0e95)
  14. [2015-09-22 07:09:09.209493] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292121: WRITE => -1 (Read-only file system)
  15. [2015-09-22 07:09:09.209692] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.234316 (xid=0x5f0e9c)
  16. [2015-09-22 07:09:09.209979] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292123: WRITE => -1 (Read-only file system)
  17. [2015-09-22 07:09:09.210091] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.234886 (xid=0x5f0e9f)
  18. [2015-09-22 07:09:09.210376] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292125: WRITE => -1 (Read-only file system)
  19. [2015-09-22 07:09:09.210437] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.235016 (xid=0x5f0ea1)
  20. [2015-09-22 07:09:09.210761] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292127: WRITE => -1 (Read-only file system)
  21. [2015-09-22 07:09:09.210812] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.235333 (xid=0x5f0ea4)
  22. [2015-09-22 07:09:09.211188] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292129: WRITE => -1 (Read-only file system)
  23. [2015-09-22 07:09:09.211185] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.235560 (xid=0x5f0ea6)
  24. [2015-09-22 07:09:09.211543] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292131: WRITE => -1 (Read-only file system)
  25. [2015-09-22 07:09:09.211542] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.235629 (xid=0x5f0ea7)
  26. [2015-09-22 07:09:09.211699] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292133: WRITE => -1 (Read-only file system)
  27. [2015-09-22 07:09:09.211890] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292135: WRITE => -1 (Read-only file system)
  28. [2015-09-22 07:09:09.211899] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.235707 (xid=0x5f0ea8)
  29. [2015-09-22 07:09:09.212032] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292137: WRITE => -1 (Read-only file system)
  30. [2015-09-22 07:09:09.212170] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292139: WRITE => -1 (Read-only file system)
  31. [2015-09-22 07:09:09.212206] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.235774 (xid=0x5f0ea9)
  32. [2015-09-22 07:09:09.212250] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292141: WRITE => -1 (Read-only file system)
  33. [2015-09-22 07:09:09.212354] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292143: WRITE => -1 (Read-only file system)
  34. [2015-09-22 07:09:09.212438] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292145: WRITE => -1 (Read-only file system)
  35. [2015-09-22 07:09:09.212518] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292147: WRITE => -1 (Read-only file system)
  36. [2015-09-22 07:09:09.212513] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.235905 (xid=0x5f0eaa)
  37. [2015-09-22 07:09:09.212595] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292149: WRITE => -1 (Read-only file system)
  38. [2015-09-22 07:09:09.212703] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292151: WRITE => -1 (Read-only file system)
  39. [2015-09-22 07:09:09.212807] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292153: WRITE => -1 (Read-only file system)
  40. [2015-09-22 07:09:09.212862] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.235970 (xid=0x5f0eab)
  41. [2015-09-22 07:09:09.212912] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292155: WRITE => -1 (Read-only file system)
  42. [2015-09-22 07:09:09.213021] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292157: WRITE => -1 (Read-only file system)
  43. [2015-09-22 07:09:09.213099] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292159: WRITE => -1 (Read-only file system)
  44. [2015-09-22 07:09:09.213188] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292161: WRITE => -1 (Read-only file system)
  45. [2015-09-22 07:09:09.213208] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.236087 (xid=0x5f0eac)
  46. [2015-09-22 07:09:09.213264] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292163: WRITE => -1 (Read-only file system)
  47. [2015-09-22 07:09:09.213353] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292165: WRITE => -1 (Read-only file system)
  48. [2015-09-22 07:09:09.213431] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292167: WRITE => -1 (Read-only file system)
  49. [2015-09-22 07:09:09.213427] I [socket.c:3362:socket_submit_request] 0-vmstore-client-0: not connected (priv->connected = 0)
  50. [2015-09-22 07:09:09.213451] W [rpc-clnt.c:1571:rpc_clnt_submit] 0-vmstore-client-0: failed to submit rpc-request (XID: 0x5f16d4 Program: GlusterFS 3.3, ProgVers: 330, Proc: 30) to rpc-transport (vmstore-client-0)
  51. [2015-09-22 07:09:09.213511] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292169: WRITE => -1 (Read-only file system)
  52. [2015-09-22 07:09:09.213512] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.236167 (xid=0x5f0ead)
  53. [2015-09-22 07:09:09.213590] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292171: WRITE => -1 (Read-only file system)
  54. [2015-09-22 07:09:09.213708] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292173: WRITE => -1 (Read-only file system)
  55. [2015-09-22 07:09:09.213833] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292175: WRITE => -1 (Read-only file system)
  56. [2015-09-22 07:09:09.213834] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.236229 (xid=0x5f0eae)
  57. [2015-09-22 07:09:09.213941] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292177: WRITE => -1 (Read-only file system)
  58. [2015-09-22 07:09:09.214047] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292179: WRITE => -1 (Read-only file system)
  59. [2015-09-22 07:09:09.214123] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292181: WRITE => -1 (Read-only file system)
  60. [2015-09-22 07:09:09.214124] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.236292 (xid=0x5f0eaf)
  61. [2015-09-22 07:09:09.214154] I [rpc-clnt.c:1819:rpc_clnt_reconfig] 0-vmstore-client-0: changing port to 49217 (from 0)
  62. [2015-09-22 07:09:09.214197] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292183: WRITE => -1 (Read-only file system)
  63. [2015-09-22 07:09:09.214266] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292114: WRITE => -1 (Read-only file system)
  64. [2015-09-22 07:09:09.214289] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292185: WRITE => -1 (Read-only file system)
  65. [2015-09-22 07:09:09.214452] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292187: WRITE => -1 (Read-only file system)
  66. [2015-09-22 07:09:09.214457] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.236357 (xid=0x5f0eb0)
  67. [2015-09-22 07:09:09.214544] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292189: WRITE => -1 (Read-only file system)
  68. [2015-09-22 07:09:09.214649] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292191: WRITE => -1 (Read-only file system)
  69. [2015-09-22 07:09:09.214736] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292193: WRITE => -1 (Read-only file system)
  70. [2015-09-22 07:09:09.214796] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.236419 (xid=0x5f0eb1)
  71. [2015-09-22 07:09:09.214819] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292195: WRITE => -1 (Read-only file system)
  72. [2015-09-22 07:09:09.214920] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292197: WRITE => -1 (Read-only file system)
  73. [2015-09-22 07:09:09.215027] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292199: WRITE => -1 (Read-only file system)
  74. [2015-09-22 07:09:09.215100] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.236484 (xid=0x5f0eb2)
  75. [2015-09-22 07:09:09.215151] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292201: WRITE => -1 (Read-only file system)
  76. [2015-09-22 07:09:09.215253] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292203: WRITE => -1 (Read-only file system)
  77. [2015-09-22 07:09:09.215338] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292205: WRITE => -1 (Read-only file system)
  78. [2015-09-22 07:09:09.215376] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.236552 (xid=0x5f0eb3)
  79. [2015-09-22 07:09:09.215456] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292207: WRITE => -1 (Read-only file system)
  80. [2015-09-22 07:09:09.215559] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292209: WRITE => -1 (Read-only file system)
  81. [2015-09-22 07:09:09.215643] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.236618 (xid=0x5f0eb4)
  82. [2015-09-22 07:09:09.215684] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292211: WRITE => -1 (Read-only file system)
  83. [2015-09-22 07:09:09.215803] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292213: WRITE => -1 (Read-only file system)
  84. [2015-09-22 07:09:09.215894] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292215: WRITE => -1 (Read-only file system)
  85. [2015-09-22 07:09:09.215921] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.236688 (xid=0x5f0eb5)
  86. [2015-09-22 07:09:09.215981] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292217: WRITE => -1 (Read-only file system)
  87. [2015-09-22 07:09:09.216075] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292219: WRITE => -1 (Read-only file system)
  88. [2015-09-22 07:09:09.216155] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292221: WRITE => -1 (Read-only file system)
  89. [2015-09-22 07:09:09.216194] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.236747 (xid=0x5f0eb6)
  90. [2015-09-22 07:09:09.216230] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292223: WRITE => -1 (Read-only file system)
  91. [2015-09-22 07:09:09.216319] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292225: WRITE => -1 (Read-only file system)
  92. [2015-09-22 07:09:09.216397] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292227: WRITE => -1 (Read-only file system)
  93. [2015-09-22 07:09:09.216473] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292229: WRITE => -1 (Read-only file system)
  94. [2015-09-22 07:09:09.216465] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.462689 (xid=0x5f12c5)
  95. [2015-09-22 07:09:09.216551] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292231: WRITE => -1 (Read-only file system)
  96. [2015-09-22 07:09:09.216636] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292233: WRITE => -1 (Read-only file system)
  97. [2015-09-22 07:09:09.216730] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292235: WRITE => -1 (Read-only file system)
  98. [2015-09-22 07:09:09.216759] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.463638 (xid=0x5f12d2)
  99. [2015-09-22 07:09:09.216810] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292237: WRITE => -1 (Read-only file system)
  100. [2015-09-22 07:09:09.216920] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292239: WRITE => -1 (Read-only file system)
  101. [2015-09-22 07:09:09.217005] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292241: WRITE => -1 (Read-only file system)
  102. [2015-09-22 07:09:09.217024] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.463892 (xid=0x5f12d5)
  103. [2015-09-22 07:09:09.217085] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292243: WRITE => -1 (Read-only file system)
  104. [2015-09-22 07:09:09.217187] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292245: WRITE => -1 (Read-only file system)
  105. [2015-09-22 07:09:09.217282] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.463959 (xid=0x5f12d6)
  106. [2015-09-22 07:09:09.217299] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292247: WRITE => -1 (Read-only file system)
  107. [2015-09-22 07:09:09.217420] W [MSGID: 114061] [client-rpc-fops.c:4507:client3_3_fsync] 0-vmstore-client-0: (f465a1b6-96d8-4045-80c8-1cf2a851edce) remote_fd is -1. EBADFD [File descriptor in bad state]
  108. [2015-09-22 07:09:09.217537] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292250: WRITE => -1 (Read-only file system)
  109. [2015-09-22 07:09:09.217565] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.464229 (xid=0x5f12d9)
  110. [2015-09-22 07:09:09.217628] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292252: WRITE => -1 (Read-only file system)
  111. [2015-09-22 07:09:09.217753] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292254: WRITE => -1 (Read-only file system)
  112. [2015-09-22 07:09:09.217845] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292256: WRITE => -1 (Read-only file system)
  113. [2015-09-22 07:09:09.217879] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.464508 (xid=0x5f12dc)
  114. [2015-09-22 07:09:09.217927] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292258: WRITE => -1 (Read-only file system)
  115. [2015-09-22 07:09:09.218029] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292260: WRITE => -1 (Read-only file system)
  116. [2015-09-22 07:09:09.218113] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292262: WRITE => -1 (Read-only file system)
  117. [2015-09-22 07:09:09.218149] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.465098 (xid=0x5f12e3)
  118. [2015-09-22 07:09:09.218197] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292264: WRITE => -1 (Read-only file system)
  119. [2015-09-22 07:09:09.218296] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292266: WRITE => -1 (Read-only file system)
  120. [2015-09-22 07:09:09.218378] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292268: WRITE => -1 (Read-only file system)
  121. [2015-09-22 07:09:09.218404] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.465291 (xid=0x5f12e4)
  122. [2015-09-22 07:09:09.218472] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292270: WRITE => -1 (Read-only file system)
  123. [2015-09-22 07:09:09.218594] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292272: WRITE => -1 (Read-only file system)
  124. [2015-09-22 07:09:09.218654] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.465765 (xid=0x5f12eb)
  125. [2015-09-22 07:09:09.218687] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292274: WRITE => -1 (Read-only file system)
  126. [2015-09-22 07:09:09.218798] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292276: WRITE => -1 (Read-only file system)
  127. [2015-09-22 07:09:09.218917] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292278: WRITE => -1 (Read-only file system)
  128. [2015-09-22 07:09:09.218944] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.466109 (xid=0x5f12ef)
  129. [2015-09-22 07:09:09.219042] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292280: WRITE => -1 (Read-only file system)
  130. [2015-09-22 07:09:09.219135] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292282: WRITE => -1 (Read-only file system)
  131. [2015-09-22 07:09:09.219188] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.466301 (xid=0x5f12f0)
  132. The message "W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met" repeated 33 times between [2015-09-22 07:09:09.208086] and [2015-09-22 07:09:09.219220]
  133. [2015-09-22 07:09:09.219404] I [MSGID: 114057] [client-handshake.c:1437:select_server_supported_programs] 0-vmstore-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330)
  134. [2015-09-22 07:09:09.219449] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.466387 (xid=0x5f12f2)
  135. [2015-09-22 07:09:09.219458] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292286: WRITE => -1 (Read-only file system)
  136. The message "W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]" repeated 34 times between [2015-09-22 07:09:09.208059] and [2015-09-22 07:09:09.219478]
  137. [2015-09-22 07:09:09.219497] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  138. [2015-09-22 07:09:09.219564] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292288: WRITE => -1 (Read-only file system)
  139. [2015-09-22 07:09:09.219759] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.466527 (xid=0x5f12f4)
  140. [2015-09-22 07:09:09.219765] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292290: WRITE => -1 (Read-only file system)
  141. The message "W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]" repeated 35 times between [2015-09-22 07:09:09.208015] and [2015-09-22 07:09:09.219789]
  142. [2015-09-22 07:09:09.219804] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  143. [2015-09-22 07:09:09.219938] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292292: WRITE => -1 (Read-only file system)
  144. [2015-09-22 07:09:09.220048] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292294: WRITE => -1 (Read-only file system)
  145. [2015-09-22 07:09:09.220044] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.466582 (xid=0x5f12f5)
  146. [2015-09-22 07:09:09.219838] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  147. [2015-09-22 07:09:09.220082] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  148. [2015-09-22 07:09:09.220110] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  149. [2015-09-22 07:09:09.220114] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  150. [2015-09-22 07:09:09.220224] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292296: WRITE => -1 (Read-only file system)
  151. [2015-09-22 07:09:09.220328] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292298: WRITE => -1 (Read-only file system)
  152. [2015-09-22 07:09:09.220351] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.466820 (xid=0x5f12f8)
  153. [2015-09-22 07:09:09.220372] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  154. [2015-09-22 07:09:09.220377] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  155. [2015-09-22 07:09:09.220443] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292300: WRITE => -1 (Read-only file system)
  156. [2015-09-22 07:09:09.220612] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.466947 (xid=0x5f12f9)
  157. [2015-09-22 07:09:09.220619] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292302: WRITE => -1 (Read-only file system)
  158. [2015-09-22 07:09:09.220404] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  159. [2015-09-22 07:09:09.220636] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  160. [2015-09-22 07:09:09.220663] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  161. [2015-09-22 07:09:09.220676] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  162. [2015-09-22 07:09:09.220767] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292304: WRITE => -1 (Read-only file system)
  163. [2015-09-22 07:09:09.220917] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.467040 (xid=0x5f12fa)
  164. [2015-09-22 07:09:09.220927] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292306: WRITE => -1 (Read-only file system)
  165. [2015-09-22 07:09:09.220942] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  166. [2015-09-22 07:09:09.220956] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  167. [2015-09-22 07:09:09.221124] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292308: WRITE => -1 (Read-only file system)
  168. [2015-09-22 07:09:09.221193] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.469258 (xid=0x5f12fe)
  169. [2015-09-22 07:09:09.220984] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  170. [2015-09-22 07:09:09.221213] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  171. [2015-09-22 07:09:09.221233] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292310: WRITE => -1 (Read-only file system)
  172. [2015-09-22 07:09:09.221251] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  173. [2015-09-22 07:09:09.221255] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  174. [2015-09-22 07:09:09.221350] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292312: WRITE => -1 (Read-only file system)
  175. [2015-09-22 07:09:09.221480] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.477937 (xid=0x5f1319)
  176. [2015-09-22 07:09:09.221503] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292314: WRITE => -1 (Read-only file system)
  177. [2015-09-22 07:09:09.221501] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  178. [2015-09-22 07:09:09.221506] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  179. [2015-09-22 07:09:09.221606] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292316: WRITE => -1 (Read-only file system)
  180. [2015-09-22 07:09:09.221747] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292318: WRITE => -1 (Read-only file system)
  181. [2015-09-22 07:09:09.221768] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.479203 (xid=0x5f132b)
  182. [2015-09-22 07:09:09.221532] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  183. [2015-09-22 07:09:09.221788] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  184. [2015-09-22 07:09:09.221812] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  185. [2015-09-22 07:09:09.221816] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  186. [2015-09-22 07:09:09.221891] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292320: WRITE => -1 (Read-only file system)
  187. [2015-09-22 07:09:09.222047] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.479563 (xid=0x5f132f)
  188. [2015-09-22 07:09:09.222067] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  189. [2015-09-22 07:09:09.222071] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  190. [2015-09-22 07:09:09.222103] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292322: WRITE => -1 (Read-only file system)
  191. [2015-09-22 07:09:09.222223] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292324: WRITE => -1 (Read-only file system)
  192. [2015-09-22 07:09:09.222304] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.479618 (xid=0x5f1330)
  193. [2015-09-22 07:09:09.222316] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292326: WRITE => -1 (Read-only file system)
  194. [2015-09-22 07:09:09.222096] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  195. [2015-09-22 07:09:09.222333] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  196. [2015-09-22 07:09:09.222358] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  197. [2015-09-22 07:09:09.222362] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  198. [2015-09-22 07:09:09.222449] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292328: WRITE => -1 (Read-only file system)
  199. [2015-09-22 07:09:09.222577] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292330: WRITE => -1 (Read-only file system)
  200. [2015-09-22 07:09:09.222589] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.479988 (xid=0x5f1335)
  201. [2015-09-22 07:09:09.222608] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  202. [2015-09-22 07:09:09.222615] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  203. [2015-09-22 07:09:09.222687] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292332: WRITE => -1 (Read-only file system)
  204. [2015-09-22 07:09:09.222794] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292334: WRITE => -1 (Read-only file system)
  205. [2015-09-22 07:09:09.222856] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.480407 (xid=0x5f1339)
  206. [2015-09-22 07:09:09.222639] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  207. [2015-09-22 07:09:09.222876] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  208. [2015-09-22 07:09:09.222888] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292336: WRITE => -1 (Read-only file system)
  209. [2015-09-22 07:09:09.222912] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  210. [2015-09-22 07:09:09.222917] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  211. [2015-09-22 07:09:09.222992] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292338: WRITE => -1 (Read-only file system)
  212. [2015-09-22 07:09:09.223093] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292340: WRITE => -1 (Read-only file system)
  213. [2015-09-22 07:09:09.223127] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.480747 (xid=0x5f133d)
  214. [2015-09-22 07:09:09.223152] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  215. [2015-09-22 07:09:09.223157] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  216. [2015-09-22 07:09:09.223195] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292342: WRITE => -1 (Read-only file system)
  217. [2015-09-22 07:09:09.223290] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292344: WRITE => -1 (Read-only file system)
  218. [2015-09-22 07:09:09.223376] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.481100 (xid=0x5f1340)
  219. [2015-09-22 07:09:09.223182] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  220. [2015-09-22 07:09:09.223395] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  221. [2015-09-22 07:09:09.223401] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292346: WRITE => -1 (Read-only file system)
  222. [2015-09-22 07:09:09.223432] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  223. [2015-09-22 07:09:09.223436] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  224. [2015-09-22 07:09:09.223553] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292348: WRITE => -1 (Read-only file system)
  225. [2015-09-22 07:09:09.223652] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292350: WRITE => -1 (Read-only file system)
  226. [2015-09-22 07:09:09.223659] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.481326 (xid=0x5f1345)
  227. [2015-09-22 07:09:09.223687] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  228. [2015-09-22 07:09:09.223692] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  229. [2015-09-22 07:09:09.223754] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292352: WRITE => -1 (Read-only file system)
  230. [2015-09-22 07:09:09.223888] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292354: WRITE => -1 (Read-only file system)
  231. [2015-09-22 07:09:09.223902] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.481472 (xid=0x5f1346)
  232. [2015-09-22 07:09:09.223718] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  233. [2015-09-22 07:09:09.223927] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  234. [2015-09-22 07:09:09.223952] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  235. [2015-09-22 07:09:09.223956] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  236. [2015-09-22 07:09:09.223983] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292356: WRITE => -1 (Read-only file system)
  237. [2015-09-22 07:09:09.224093] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292358: WRITE => -1 (Read-only file system)
  238. [2015-09-22 07:09:09.224184] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.481612 (xid=0x5f1349)
  239. [2015-09-22 07:09:09.224199] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292360: WRITE => -1 (Read-only file system)
  240. [2015-09-22 07:09:09.224203] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  241. [2015-09-22 07:09:09.224218] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  242. [2015-09-22 07:09:09.224301] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292362: WRITE => -1 (Read-only file system)
  243. [2015-09-22 07:09:09.224414] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292364: WRITE => -1 (Read-only file system)
  244. [2015-09-22 07:09:09.224436] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.481906 (xid=0x5f134c)
  245. [2015-09-22 07:09:09.224244] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  246. [2015-09-22 07:09:09.224456] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  247. [2015-09-22 07:09:09.224479] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  248. [2015-09-22 07:09:09.224483] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  249. [2015-09-22 07:09:09.224540] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292366: WRITE => -1 (Read-only file system)
  250. [2015-09-22 07:09:09.224653] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292368: WRITE => -1 (Read-only file system)
  251. [2015-09-22 07:09:09.224711] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.482040 (xid=0x5f134f)
  252. [2015-09-22 07:09:09.224735] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  253. [2015-09-22 07:09:09.224740] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  254. [2015-09-22 07:09:09.224797] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292370: WRITE => -1 (Read-only file system)
  255. [2015-09-22 07:09:09.224892] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292372: WRITE => -1 (Read-only file system)
  256. [2015-09-22 07:09:09.224938] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.482154 (xid=0x5f1351)
  257. [2015-09-22 07:09:09.224763] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  258. [2015-09-22 07:09:09.224958] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  259. [2015-09-22 07:09:09.224981] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  260. [2015-09-22 07:09:09.224988] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292374: WRITE => -1 (Read-only file system)
  261. [2015-09-22 07:09:09.224985] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  262. [2015-09-22 07:09:09.225115] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292376: WRITE => -1 (Read-only file system)
  263. [2015-09-22 07:09:09.225185] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.482307 (xid=0x5f1353)
  264. [2015-09-22 07:09:09.225204] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  265. [2015-09-22 07:09:09.225208] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  266. [2015-09-22 07:09:09.225409] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.482606 (xid=0x5f1357)
  267. [2015-09-22 07:09:09.225231] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  268. [2015-09-22 07:09:09.225432] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  269. [2015-09-22 07:09:09.225458] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  270. [2015-09-22 07:09:09.225461] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  271. [2015-09-22 07:09:09.225656] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.483158 (xid=0x5f135c)
  272. [2015-09-22 07:09:09.225683] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  273. [2015-09-22 07:09:09.225688] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  274. [2015-09-22 07:09:09.225885] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.483250 (xid=0x5f135e)
  275. [2015-09-22 07:09:09.225712] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  276. [2015-09-22 07:09:09.225903] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  277. [2015-09-22 07:09:09.225926] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  278. [2015-09-22 07:09:09.225930] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  279. [2015-09-22 07:09:09.226130] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.483502 (xid=0x5f1360)
  280. [2015-09-22 07:09:09.226157] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  281. [2015-09-22 07:09:09.226153] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  282. [2015-09-22 07:09:09.226156] I [MSGID: 114046] [client-handshake.c:1213:client_setvolume_cbk] 0-vmstore-client-0: Connected to vmstore-client-0, attached to remote volume '/bricks/b1'.
  283. [2015-09-22 07:09:09.226188] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  284. [2015-09-22 07:09:09.226195] I [MSGID: 114047] [client-handshake.c:1224:client_setvolume_cbk] 0-vmstore-client-0: Server and Client lk-version numbers are not same, reopening the fds
  285. [2015-09-22 07:09:09.226215] I [MSGID: 114042] [client-handshake.c:1056:client_post_handshake] 0-vmstore-client-0: 8 fds open - Delaying child_up until they are re-opened
  286. [2015-09-22 07:09:09.226370] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.483558 (xid=0x5f1361)
  287. [2015-09-22 07:09:09.226388] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  288. [2015-09-22 07:09:09.226405] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  289. [2015-09-22 07:09:09.226409] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  290. [2015-09-22 07:09:09.226590] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.483813 (xid=0x5f1365)
  291. [2015-09-22 07:09:09.226608] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  292. [2015-09-22 07:09:09.226612] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  293. [2015-09-22 07:09:09.226821] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.484096 (xid=0x5f1368)
  294. [2015-09-22 07:09:09.226635] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  295. [2015-09-22 07:09:09.226841] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  296. [2015-09-22 07:09:09.226872] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  297. [2015-09-22 07:09:09.226879] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  298. [2015-09-22 07:09:09.227067] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.484251 (xid=0x5f136b)
  299. [2015-09-22 07:09:09.227084] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  300. [2015-09-22 07:09:09.227089] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  301. [2015-09-22 07:09:09.227287] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.484375 (xid=0x5f136d)
  302. [2015-09-22 07:09:09.227114] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  303. [2015-09-22 07:09:09.227305] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  304. [2015-09-22 07:09:09.227327] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  305. [2015-09-22 07:09:09.227331] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  306. [2015-09-22 07:09:09.227522] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.484580 (xid=0x5f1370)
  307. [2015-09-22 07:09:09.227540] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  308. [2015-09-22 07:09:09.227544] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  309. [2015-09-22 07:09:09.227757] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.484727 (xid=0x5f1372)
  310. [2015-09-22 07:09:09.227568] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  311. [2015-09-22 07:09:09.227781] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  312. [2015-09-22 07:09:09.227804] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  313. [2015-09-22 07:09:09.227808] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  314. [2015-09-22 07:09:09.228003] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.484786 (xid=0x5f1373)
  315. [2015-09-22 07:09:09.228021] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  316. [2015-09-22 07:09:09.228026] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  317. [2015-09-22 07:09:09.228219] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.484866 (xid=0x5f1374)
  318. [2015-09-22 07:09:09.228049] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  319. [2015-09-22 07:09:09.228238] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  320. [2015-09-22 07:09:09.228260] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  321. [2015-09-22 07:09:09.228264] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  322. [2015-09-22 07:09:09.228458] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.484933 (xid=0x5f1375)
  323. [2015-09-22 07:09:09.228480] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  324. [2015-09-22 07:09:09.228485] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  325. [2015-09-22 07:09:09.228695] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.485019 (xid=0x5f1376)
  326. [2015-09-22 07:09:09.228509] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  327. [2015-09-22 07:09:09.228715] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  328. [2015-09-22 07:09:09.228738] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  329. [2015-09-22 07:09:09.228742] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  330. [2015-09-22 07:09:09.228928] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.487178 (xid=0x5f137a)
  331. [2015-09-22 07:09:09.228946] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  332. [2015-09-22 07:09:09.228954] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  333. [2015-09-22 07:09:09.229152] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.499836 (xid=0x5f1386)
  334. [2015-09-22 07:09:09.228978] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  335. [2015-09-22 07:09:09.229169] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  336. [2015-09-22 07:09:09.229192] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  337. [2015-09-22 07:09:09.229196] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  338. [2015-09-22 07:09:09.229399] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.500131 (xid=0x5f1389)
  339. [2015-09-22 07:09:09.229417] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  340. [2015-09-22 07:09:09.229422] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  341. [2015-09-22 07:09:09.229617] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.500409 (xid=0x5f138d)
  342. [2015-09-22 07:09:09.229446] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  343. [2015-09-22 07:09:09.229635] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  344. [2015-09-22 07:09:09.229657] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  345. [2015-09-22 07:09:09.229661] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  346. [2015-09-22 07:09:09.229863] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.500622 (xid=0x5f138f)
  347. [2015-09-22 07:09:09.229881] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  348. [2015-09-22 07:09:09.229886] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  349. [2015-09-22 07:09:09.230081] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.500822 (xid=0x5f1391)
  350. [2015-09-22 07:09:09.229909] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  351. [2015-09-22 07:09:09.230099] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  352. [2015-09-22 07:09:09.230127] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  353. [2015-09-22 07:09:09.230131] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  354. [2015-09-22 07:09:09.230319] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.501012 (xid=0x5f1392)
  355. [2015-09-22 07:09:09.230337] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  356. [2015-09-22 07:09:09.230350] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  357. [2015-09-22 07:09:09.230539] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.513436 (xid=0x5f1396)
  358. [2015-09-22 07:09:09.230374] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  359. [2015-09-22 07:09:09.230557] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  360. [2015-09-22 07:09:09.230580] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  361. [2015-09-22 07:09:09.230594] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
  362. [2015-09-22 07:09:09.230634] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292063: WRITE => -1 (Read-only file system)
  363. [2015-09-22 07:09:09.230827] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.517378 (xid=0x5f139d)
  364. [2015-09-22 07:09:09.230847] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  365. [2015-09-22 07:09:09.230863] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  366. [2015-09-22 07:09:09.230866] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  367. [2015-09-22 07:09:09.230903] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292379: WRITE => -1 (Read-only file system)
  368. [2015-09-22 07:09:09.231067] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.517455 (xid=0x5f139e)
  369. [2015-09-22 07:09:09.231085] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  370. [2015-09-22 07:09:09.231090] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  371. [2015-09-22 07:09:09.231138] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292381: WRITE => -1 (Read-only file system)
  372. [2015-09-22 07:09:09.231290] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.522976 (xid=0x5f13d2)
  373. [2015-09-22 07:09:09.231115] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  374. [2015-09-22 07:09:09.231315] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292383: WRITE => -1 (Read-only file system)
  375. [2015-09-22 07:09:09.231309] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  376. [2015-09-22 07:09:09.231344] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  377. [2015-09-22 07:09:09.231358] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
  378. [2015-09-22 07:09:09.231443] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292385: WRITE => -1 (Read-only file system)
  379. [2015-09-22 07:09:09.231524] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.527474 (xid=0x5f1410)
  380. [2015-09-22 07:09:09.231542] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  381. [2015-09-22 07:09:09.231558] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  382. [2015-09-22 07:09:09.231562] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  383. [2015-09-22 07:09:09.231623] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292387: WRITE => -1 (Read-only file system)
  384. [2015-09-22 07:09:09.231755] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292389: WRITE => -1 (Read-only file system)
  385. [2015-09-22 07:09:09.231782] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.527723 (xid=0x5f1413)
  386. [2015-09-22 07:09:09.231800] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  387. [2015-09-22 07:09:09.231804] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  388. [2015-09-22 07:09:09.231871] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292391: WRITE => -1 (Read-only file system)
  389. [2015-09-22 07:09:09.231984] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.528104 (xid=0x5f1417)
  390. [2015-09-22 07:09:09.231826] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  391. [2015-09-22 07:09:09.232007] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292393: WRITE => -1 (Read-only file system)
  392. [2015-09-22 07:09:09.232003] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  393. [2015-09-22 07:09:09.232033] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  394. [2015-09-22 07:09:09.232037] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  395. [2015-09-22 07:09:09.232152] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292395: WRITE => -1 (Read-only file system)
  396. [2015-09-22 07:09:09.232224] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.528396 (xid=0x5f141c)
  397. [2015-09-22 07:09:09.232241] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  398. [2015-09-22 07:09:09.232245] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  399. [2015-09-22 07:09:09.232271] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292397: WRITE => -1 (Read-only file system)
  400. [2015-09-22 07:09:09.232426] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292399: WRITE => -1 (Read-only file system)
  401. [2015-09-22 07:09:09.232460] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.528969 (xid=0x5f1422)
  402. [2015-09-22 07:09:09.232274] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  403. [2015-09-22 07:09:09.232478] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  404. [2015-09-22 07:09:09.232500] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  405. [2015-09-22 07:09:09.232503] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  406. [2015-09-22 07:09:09.232540] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292401: WRITE => -1 (Read-only file system)
  407. [2015-09-22 07:09:09.232662] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292403: WRITE => -1 (Read-only file system)
  408. [2015-09-22 07:09:09.232693] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.529712 (xid=0x5f142b)
  409. [2015-09-22 07:09:09.232713] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  410. [2015-09-22 07:09:09.232718] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  411. [2015-09-22 07:09:09.232793] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292405: WRITE => -1 (Read-only file system)
  412. [2015-09-22 07:09:09.232901] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.530153 (xid=0x5f1430)
  413. [2015-09-22 07:09:09.232740] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  414. [2015-09-22 07:09:09.232918] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  415. [2015-09-22 07:09:09.232935] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292407: WRITE => -1 (Read-only file system)
  416. [2015-09-22 07:09:09.232939] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  417. [2015-09-22 07:09:09.232962] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  418. [2015-09-22 07:09:09.233065] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292409: WRITE => -1 (Read-only file system)
  419. [2015-09-22 07:09:09.233147] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.530484 (xid=0x5f1435)
  420. [2015-09-22 07:09:09.233167] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292411: WRITE => -1 (Read-only file system)
  421. [2015-09-22 07:09:09.233164] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  422. [2015-09-22 07:09:09.233169] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  423. [2015-09-22 07:09:09.233266] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292413: WRITE => -1 (Read-only file system)
  424. [2015-09-22 07:09:09.233355] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.530983 (xid=0x5f143c)
  425. [2015-09-22 07:09:09.233365] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292415: WRITE => -1 (Read-only file system)
  426. [2015-09-22 07:09:09.233191] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  427. [2015-09-22 07:09:09.233381] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  428. [2015-09-22 07:09:09.233404] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  429. [2015-09-22 07:09:09.233408] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  430. [2015-09-22 07:09:09.233504] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292417: WRITE => -1 (Read-only file system)
  431. [2015-09-22 07:09:09.233585] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.531143 (xid=0x5f143e)
  432. [2015-09-22 07:09:09.233603] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  433. [2015-09-22 07:09:09.233619] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292419: WRITE => -1 (Read-only file system)
  434. [2015-09-22 07:09:09.233607] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  435. [2015-09-22 07:09:09.233754] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292421: WRITE => -1 (Read-only file system)
  436. [2015-09-22 07:09:09.233827] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.531287 (xid=0x5f143f)
  437. [2015-09-22 07:09:09.233636] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  438. [2015-09-22 07:09:09.233845] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  439. [2015-09-22 07:09:09.233867] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  440. [2015-09-22 07:09:09.233871] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  441. [2015-09-22 07:09:09.233875] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292423: WRITE => -1 (Read-only file system)
  442. [2015-09-22 07:09:09.233990] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292425: WRITE => -1 (Read-only file system)
  443. [2015-09-22 07:09:09.234065] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.531714 (xid=0x5f1445)
  444. [2015-09-22 07:09:09.234083] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  445. [2015-09-22 07:09:09.234095] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292427: WRITE => -1 (Read-only file system)
  446. [2015-09-22 07:09:09.234087] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  447. [2015-09-22 07:09:09.234221] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292429: WRITE => -1 (Read-only file system)
  448. [2015-09-22 07:09:09.234278] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.532061 (xid=0x5f1448)
  449. [2015-09-22 07:09:09.234112] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  450. [2015-09-22 07:09:09.234295] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  451. [2015-09-22 07:09:09.234325] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292431: WRITE => -1 (Read-only file system)
  452. [2015-09-22 07:09:09.234323] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  453. [2015-09-22 07:09:09.234326] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  454. [2015-09-22 07:09:09.234466] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292433: WRITE => -1 (Read-only file system)
  455. [2015-09-22 07:09:09.234512] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.532358 (xid=0x5f144b)
  456. [2015-09-22 07:09:09.234529] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  457. [2015-09-22 07:09:09.234534] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  458. [2015-09-22 07:09:09.234564] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292435: WRITE => -1 (Read-only file system)
  459. [2015-09-22 07:09:09.234693] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292437: WRITE => -1 (Read-only file system)
  460. [2015-09-22 07:09:09.234752] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.532422 (xid=0x5f144d)
  461. [2015-09-22 07:09:09.234556] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  462. [2015-09-22 07:09:09.234770] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  463. [2015-09-22 07:09:09.234790] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  464. [2015-09-22 07:09:09.234794] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  465. [2015-09-22 07:09:09.234812] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292439: WRITE => -1 (Read-only file system)
  466. [2015-09-22 07:09:09.234911] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292441: WRITE => -1 (Read-only file system)
  467. [2015-09-22 07:09:09.234965] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.532479 (xid=0x5f144e)
  468. [2015-09-22 07:09:09.234987] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  469. [2015-09-22 07:09:09.234991] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  470. [2015-09-22 07:09:09.235012] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292443: WRITE => -1 (Read-only file system)
  471. [2015-09-22 07:09:09.235112] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292445: WRITE => -1 (Read-only file system)
  472. [2015-09-22 07:09:09.235179] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.532741 (xid=0x5f1452)
  473. [2015-09-22 07:09:09.235013] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  474. [2015-09-22 07:09:09.235196] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  475. [2015-09-22 07:09:09.235216] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  476. [2015-09-22 07:09:09.235220] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  477. [2015-09-22 07:09:09.235245] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292447: WRITE => -1 (Read-only file system)
  478. [2015-09-22 07:09:09.235352] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292449: WRITE => -1 (Read-only file system)
  479. [2015-09-22 07:09:09.235395] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.532910 (xid=0x5f1454)
  480. [2015-09-22 07:09:09.235411] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  481. [2015-09-22 07:09:09.235416] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  482. [2015-09-22 07:09:09.235503] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292451: WRITE => -1 (Read-only file system)
  483. [2015-09-22 07:09:09.235584] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.533077 (xid=0x5f1456)
  484. [2015-09-22 07:09:09.235601] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292453: WRITE => -1 (Read-only file system)
  485. [2015-09-22 07:09:09.235436] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  486. [2015-09-22 07:09:09.235606] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  487. [2015-09-22 07:09:09.235627] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  488. [2015-09-22 07:09:09.235630] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  489. [2015-09-22 07:09:09.235702] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292455: WRITE => -1 (Read-only file system)
  490. [2015-09-22 07:09:09.235804] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292457: WRITE => -1 (Read-only file system)
  491. [2015-09-22 07:09:09.235809] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.533269 (xid=0x5f1458)
  492. [2015-09-22 07:09:09.235827] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  493. [2015-09-22 07:09:09.235831] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  494. [2015-09-22 07:09:09.235904] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292459: WRITE => -1 (Read-only file system)
  495. [2015-09-22 07:09:09.236000] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292461: WRITE => -1 (Read-only file system)
  496. [2015-09-22 07:09:09.236010] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.533576 (xid=0x5f145b)
  497. [2015-09-22 07:09:09.235852] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  498. [2015-09-22 07:09:09.236027] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  499. [2015-09-22 07:09:09.236047] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  500. [2015-09-22 07:09:09.236051] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  501. [2015-09-22 07:09:09.236094] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292463: WRITE => -1 (Read-only file system)
  502. [2015-09-22 07:09:09.236209] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292465: WRITE => -1 (Read-only file system)
  503. [2015-09-22 07:09:09.236215] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.533635 (xid=0x5f145c)
  504. [2015-09-22 07:09:09.236232] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  505. [2015-09-22 07:09:09.236236] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  506. [2015-09-22 07:09:09.236321] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292467: WRITE => -1 (Read-only file system)
  507. [2015-09-22 07:09:09.236425] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.533808 (xid=0x5f145e)
  508. [2015-09-22 07:09:09.236434] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292470: WRITE => -1 (Read-only file system)
  509. [2015-09-22 07:09:09.236257] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  510. [2015-09-22 07:09:09.236446] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  511. [2015-09-22 07:09:09.236467] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  512. [2015-09-22 07:09:09.236470] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  513. [2015-09-22 07:09:09.236641] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.533976 (xid=0x5f1460)
  514. [2015-09-22 07:09:09.236658] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  515. [2015-09-22 07:09:09.236662] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  516. [2015-09-22 07:09:09.236732] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292474: WRITE => -1 (Read-only file system)
  517. [2015-09-22 07:09:09.236838] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292476: WRITE => -1 (Read-only file system)
  518. [2015-09-22 07:09:09.236846] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.534126 (xid=0x5f1462)
  519. [2015-09-22 07:09:09.236693] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  520. [2015-09-22 07:09:09.236868] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  521. [2015-09-22 07:09:09.236889] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  522. [2015-09-22 07:09:09.236892] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  523. [2015-09-22 07:09:09.236944] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292478: WRITE => -1 (Read-only file system)
  524. [2015-09-22 07:09:09.237045] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292480: WRITE => -1 (Read-only file system)
  525. [2015-09-22 07:09:09.237062] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.534329 (xid=0x5f1464)
  526. [2015-09-22 07:09:09.237078] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  527. [2015-09-22 07:09:09.237082] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  528. [2015-09-22 07:09:09.237141] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292482: WRITE => -1 (Read-only file system)
  529. [2015-09-22 07:09:09.237240] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292484: WRITE => -1 (Read-only file system)
  530. [2015-09-22 07:09:09.237250] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.534582 (xid=0x5f1467)
  531. [2015-09-22 07:09:09.237103] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  532. [2015-09-22 07:09:09.237267] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  533. [2015-09-22 07:09:09.237286] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  534. [2015-09-22 07:09:09.237290] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  535. [2015-09-22 07:09:09.237338] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292486: WRITE => -1 (Read-only file system)
  536. [2015-09-22 07:09:09.237433] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292488: WRITE => -1 (Read-only file system)
  537. [2015-09-22 07:09:09.237468] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.534660 (xid=0x5f1468)
  538. [2015-09-22 07:09:09.237485] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  539. [2015-09-22 07:09:09.237489] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  540. [2015-09-22 07:09:09.237556] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292490: WRITE => -1 (Read-only file system)
  541. [2015-09-22 07:09:09.237659] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292492: WRITE => -1 (Read-only file system)
  542. [2015-09-22 07:09:09.237658] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.534893 (xid=0x5f146b)
  543. [2015-09-22 07:09:09.237510] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  544. [2015-09-22 07:09:09.237684] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  545. [2015-09-22 07:09:09.237705] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  546. [2015-09-22 07:09:09.237709] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  547. [2015-09-22 07:09:09.237838] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292494: WRITE => -1 (Read-only file system)
  548. [2015-09-22 07:09:09.237871] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.534956 (xid=0x5f146c)
  549. [2015-09-22 07:09:09.237888] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  550. [2015-09-22 07:09:09.237892] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  551. [2015-09-22 07:09:09.237951] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292496: WRITE => -1 (Read-only file system)
  552. [2015-09-22 07:09:09.238070] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292498: WRITE => -1 (Read-only file system)
  553. [2015-09-22 07:09:09.238072] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.535211 (xid=0x5f146e)
  554. [2015-09-22 07:09:09.237913] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  555. [2015-09-22 07:09:09.238089] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  556. [2015-09-22 07:09:09.238109] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  557. [2015-09-22 07:09:09.238112] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  558. [2015-09-22 07:09:09.238167] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292500: WRITE => -1 (Read-only file system)
  559. [2015-09-22 07:09:09.238275] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292502: WRITE => -1 (Read-only file system)
  560. [2015-09-22 07:09:09.238278] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.535310 (xid=0x5f1470)
  561. [2015-09-22 07:09:09.238295] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  562. [2015-09-22 07:09:09.238300] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  563. [2015-09-22 07:09:09.238321] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
  564. [2015-09-22 07:09:09.238378] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292504: WRITE => -1 (Read-only file system)
  565. [2015-09-22 07:09:09.238475] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292506: WRITE => -1 (Read-only file system)
  566. [2015-09-22 07:09:09.238483] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.535448 (xid=0x5f1472)
  567. [2015-09-22 07:09:09.238500] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  568. [2015-09-22 07:09:09.238514] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  569. [2015-09-22 07:09:09.238582] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292508: WRITE => -1 (Read-only file system)
  570. [2015-09-22 07:09:09.238697] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292510: WRITE => -1 (Read-only file system)
  571. [2015-09-22 07:09:09.238701] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.535508 (xid=0x5f1473)
  572. [2015-09-22 07:09:09.238532] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  573. [2015-09-22 07:09:09.238718] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  574. [2015-09-22 07:09:09.238738] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  575. [2015-09-22 07:09:09.238741] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  576. [2015-09-22 07:09:09.238802] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292512: WRITE => -1 (Read-only file system)
  577. [2015-09-22 07:09:09.238896] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292514: WRITE => -1 (Read-only file system)
  578. [2015-09-22 07:09:09.238915] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.535580 (xid=0x5f1474)
  579. [2015-09-22 07:09:09.238932] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  580. [2015-09-22 07:09:09.238936] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  581. [2015-09-22 07:09:09.239003] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292516: WRITE => -1 (Read-only file system)
  582. [2015-09-22 07:09:09.239114] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292518: WRITE => -1 (Read-only file system)
  583. [2015-09-22 07:09:09.239118] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.535707 (xid=0x5f1476)
  584. [2015-09-22 07:09:09.238957] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  585. [2015-09-22 07:09:09.239135] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  586. [2015-09-22 07:09:09.239161] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  587. [2015-09-22 07:09:09.239164] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  588. [2015-09-22 07:09:09.239211] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292520: WRITE => -1 (Read-only file system)
  589. [2015-09-22 07:09:09.239333] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.535760 (xid=0x5f1477)
  590. [2015-09-22 07:09:09.239350] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292522: WRITE => -1 (Read-only file system)
  591. [2015-09-22 07:09:09.239349] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  592. [2015-09-22 07:09:09.239354] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  593. [2015-09-22 07:09:09.239379] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
  594. [2015-09-22 07:09:09.239457] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292524: WRITE => -1 (Read-only file system)
  595. [2015-09-22 07:09:09.239557] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.535884 (xid=0x5f1479)
  596. [2015-09-22 07:09:09.239563] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292526: WRITE => -1 (Read-only file system)
  597. [2015-09-22 07:09:09.239577] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  598. [2015-09-22 07:09:09.239592] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  599. [2015-09-22 07:09:09.239677] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292528: WRITE => -1 (Read-only file system)
  600. [2015-09-22 07:09:09.239761] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.536079 (xid=0x5f147c)
  601. [2015-09-22 07:09:09.239604] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  602. [2015-09-22 07:09:09.239783] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292530: WRITE => -1 (Read-only file system)
  603. [2015-09-22 07:09:09.239777] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  604. [2015-09-22 07:09:09.239816] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  605. [2015-09-22 07:09:09.239820] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  606. [2015-09-22 07:09:09.239899] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292532: WRITE => -1 (Read-only file system)
  607. [2015-09-22 07:09:09.239997] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292534: WRITE => -1 (Read-only file system)
  608. [2015-09-22 07:09:09.239995] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.536209 (xid=0x5f147e)
  609. [2015-09-22 07:09:09.240012] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  610. [2015-09-22 07:09:09.240017] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  611. [2015-09-22 07:09:09.240038] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
  612. [2015-09-22 07:09:09.240097] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292536: WRITE => -1 (Read-only file system)
  613. [2015-09-22 07:09:09.240189] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292538: WRITE => -1 (Read-only file system)
  614. [2015-09-22 07:09:09.240197] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.536268 (xid=0x5f147f)
  615. [2015-09-22 07:09:09.240214] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  616. [2015-09-22 07:09:09.240228] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  617. [2015-09-22 07:09:09.240283] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292540: WRITE => -1 (Read-only file system)
  618. [2015-09-22 07:09:09.240375] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292542: WRITE => -1 (Read-only file system)
  619. [2015-09-22 07:09:09.240393] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.536321 (xid=0x5f1480)
  620. [2015-09-22 07:09:09.240240] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  621. [2015-09-22 07:09:09.240415] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  622. [2015-09-22 07:09:09.240436] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  623. [2015-09-22 07:09:09.240448] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
  624. [2015-09-22 07:09:09.240466] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292544: WRITE => -1 (Read-only file system)
  625. [2015-09-22 07:09:09.240567] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292546: WRITE => -1 (Read-only file system)
  626. [2015-09-22 07:09:09.240602] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.536372 (xid=0x5f1481)
  627. [2015-09-22 07:09:09.240618] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  628. [2015-09-22 07:09:09.240633] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  629. [2015-09-22 07:09:09.240637] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  630. [2015-09-22 07:09:09.240678] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292548: WRITE => -1 (Read-only file system)
  631. [2015-09-22 07:09:09.240779] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292550: WRITE => -1 (Read-only file system)
  632. [2015-09-22 07:09:09.240816] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.536436 (xid=0x5f1482)
  633. [2015-09-22 07:09:09.240832] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  634. [2015-09-22 07:09:09.240837] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  635. [2015-09-22 07:09:09.240866] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
  636. [2015-09-22 07:09:09.240874] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292552: WRITE => -1 (Read-only file system)
  637. [2015-09-22 07:09:09.240979] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292554: WRITE => -1 (Read-only file system)
  638. [2015-09-22 07:09:09.241016] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.536496 (xid=0x5f1483)
  639. [2015-09-22 07:09:09.241037] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  640. [2015-09-22 07:09:09.241052] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  641. [2015-09-22 07:09:09.241069] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292556: WRITE => -1 (Read-only file system)
  642. [2015-09-22 07:09:09.241165] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292558: WRITE => -1 (Read-only file system)
  643. [2015-09-22 07:09:09.241218] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.536552 (xid=0x5f1484)
  644. [2015-09-22 07:09:09.241064] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  645. [2015-09-22 07:09:09.241235] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  646. [2015-09-22 07:09:09.241257] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292560: WRITE => -1 (Read-only file system)
  647. [2015-09-22 07:09:09.241256] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  648. [2015-09-22 07:09:09.241278] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
  649. [2015-09-22 07:09:09.241358] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292562: WRITE => -1 (Read-only file system)
  650. [2015-09-22 07:09:09.241431] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.536605 (xid=0x5f1485)
  651. [2015-09-22 07:09:09.241448] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292564: WRITE => -1 (Read-only file system)
  652. [2015-09-22 07:09:09.241448] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  653. [2015-09-22 07:09:09.241463] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  654. [2015-09-22 07:09:09.241467] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  655. [2015-09-22 07:09:09.241546] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292566: WRITE => -1 (Read-only file system)
  656. [2015-09-22 07:09:09.241645] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292568: WRITE => -1 (Read-only file system)
  657. [2015-09-22 07:09:09.241645] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.536661 (xid=0x5f1486)
  658. [2015-09-22 07:09:09.241662] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  659. [2015-09-22 07:09:09.241672] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  660. [2015-09-22 07:09:09.241719] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
  661. [2015-09-22 07:09:09.241766] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292570: WRITE => -1 (Read-only file system)
  662. [2015-09-22 07:09:09.241856] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292572: WRITE => -1 (Read-only file system)
  663. [2015-09-22 07:09:09.241868] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.536729 (xid=0x5f1487)
  664. [2015-09-22 07:09:09.241884] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  665. [2015-09-22 07:09:09.241897] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  666. [2015-09-22 07:09:09.241909] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
  667. [2015-09-22 07:09:09.241947] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292574: WRITE => -1 (Read-only file system)
  668. [2015-09-22 07:09:09.242038] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292576: WRITE => -1 (Read-only file system)
  669. [2015-09-22 07:09:09.242060] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.536791 (xid=0x5f1488)
  670. [2015-09-22 07:09:09.242076] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  671. [2015-09-22 07:09:09.242090] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  672. [2015-09-22 07:09:09.242125] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292578: WRITE => -1 (Read-only file system)
  673. [2015-09-22 07:09:09.242219] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292580: WRITE => -1 (Read-only file system)
  674. [2015-09-22 07:09:09.242256] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.536849 (xid=0x5f1489)
  675. [2015-09-22 07:09:09.242107] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  676. [2015-09-22 07:09:09.242272] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  677. [2015-09-22 07:09:09.242292] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  678. [2015-09-22 07:09:09.242295] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  679. [2015-09-22 07:09:09.242307] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292582: WRITE => -1 (Read-only file system)
  680. [2015-09-22 07:09:09.242403] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292584: WRITE => -1 (Read-only file system)
  681. [2015-09-22 07:09:09.242458] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.536903 (xid=0x5f148a)
  682. [2015-09-22 07:09:09.242474] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  683. [2015-09-22 07:09:09.242477] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  684. [2015-09-22 07:09:09.242496] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292586: WRITE => -1 (Read-only file system)
  685. [2015-09-22 07:09:09.242589] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292588: WRITE => -1 (Read-only file system)
  686. [2015-09-22 07:09:09.242640] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.536956 (xid=0x5f148b)
  687. [2015-09-22 07:09:09.242498] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  688. [2015-09-22 07:09:09.242656] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  689. [2015-09-22 07:09:09.242686] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292590: WRITE => -1 (Read-only file system)
  690. [2015-09-22 07:09:09.242684] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  691. [2015-09-22 07:09:09.242687] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  692. [2015-09-22 07:09:09.242791] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292592: WRITE => -1 (Read-only file system)
  693. [2015-09-22 07:09:09.242863] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.537082 (xid=0x5f148d)
  694. [2015-09-22 07:09:09.242880] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292594: WRITE => -1 (Read-only file system)
  695. [2015-09-22 07:09:09.242879] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  696. [2015-09-22 07:09:09.242883] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  697. [2015-09-22 07:09:09.242985] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292596: WRITE => -1 (Read-only file system)
  698. [2015-09-22 07:09:09.243045] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.537136 (xid=0x5f148e)
  699. [2015-09-22 07:09:09.242903] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  700. [2015-09-22 07:09:09.243061] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  701. [2015-09-22 07:09:09.243084] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  702. [2015-09-22 07:09:09.243087] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  703. [2015-09-22 07:09:09.243246] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.537209 (xid=0x5f148f)
  704. [2015-09-22 07:09:09.243262] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  705. [2015-09-22 07:09:09.243267] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  706. [2015-09-22 07:09:09.243436] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.537294 (xid=0x5f1490)
  707. [2015-09-22 07:09:09.243292] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  708. [2015-09-22 07:09:09.243452] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  709. [2015-09-22 07:09:09.243471] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  710. [2015-09-22 07:09:09.243475] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  711. [2015-09-22 07:09:09.243630] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.537350 (xid=0x5f1491)
  712. [2015-09-22 07:09:09.243646] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  713. [2015-09-22 07:09:09.243650] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  714. [2015-09-22 07:09:09.243821] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.537403 (xid=0x5f1492)
  715. [2015-09-22 07:09:09.243680] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  716. [2015-09-22 07:09:09.243837] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  717. [2015-09-22 07:09:09.243859] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  718. [2015-09-22 07:09:09.243862] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  719. [2015-09-22 07:09:09.244023] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.537457 (xid=0x5f1493)
  720. [2015-09-22 07:09:09.244044] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  721. [2015-09-22 07:09:09.244048] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  722. [2015-09-22 07:09:09.244209] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.542354 (xid=0x5f1497)
  723. [2015-09-22 07:09:09.244069] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  724. [2015-09-22 07:09:09.244225] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  725. [2015-09-22 07:09:09.244244] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  726. [2015-09-22 07:09:09.244248] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  727. [2015-09-22 07:09:09.244408] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.610378 (xid=0x5f14bb)
  728. [2015-09-22 07:09:09.244423] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  729. [2015-09-22 07:09:09.244430] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  730. [2015-09-22 07:09:09.244594] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.612498 (xid=0x5f14d8)
  731. [2015-09-22 07:09:09.244450] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  732. [2015-09-22 07:09:09.244610] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  733. [2015-09-22 07:09:09.244630] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  734. [2015-09-22 07:09:09.244633] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  735. [2015-09-22 07:09:09.244801] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.612764 (xid=0x5f14db)
  736. [2015-09-22 07:09:09.244819] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  737. [2015-09-22 07:09:09.244823] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  738. [2015-09-22 07:09:09.244980] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.613087 (xid=0x5f14df)
  739. [2015-09-22 07:09:09.244844] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  740. [2015-09-22 07:09:09.244996] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  741. [2015-09-22 07:09:09.245016] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  742. [2015-09-22 07:09:09.245019] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  743. [2015-09-22 07:09:09.245183] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.613230 (xid=0x5f14e0)
  744. [2015-09-22 07:09:09.245198] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  745. [2015-09-22 07:09:09.245202] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  746. [2015-09-22 07:09:09.245369] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.614363 (xid=0x5f14eb)
  747. [2015-09-22 07:09:09.245222] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  748. [2015-09-22 07:09:09.245389] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  749. [2015-09-22 07:09:09.245410] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  750. [2015-09-22 07:09:09.245414] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  751. [2015-09-22 07:09:09.245570] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.614953 (xid=0x5f14f1)
  752. [2015-09-22 07:09:09.245586] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  753. [2015-09-22 07:09:09.245592] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  754. [2015-09-22 07:09:09.245754] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.615438 (xid=0x5f14f3)
  755. [2015-09-22 07:09:09.245614] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  756. [2015-09-22 07:09:09.245771] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  757. [2015-09-22 07:09:09.245791] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  758. [2015-09-22 07:09:09.245794] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  759. [2015-09-22 07:09:09.245948] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.615829 (xid=0x5f14f7)
  760. [2015-09-22 07:09:09.245964] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  761. [2015-09-22 07:09:09.245969] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  762. [2015-09-22 07:09:09.246134] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.615985 (xid=0x5f14f9)
  763. [2015-09-22 07:09:09.245996] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  764. [2015-09-22 07:09:09.246150] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  765. [2015-09-22 07:09:09.246171] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  766. [2015-09-22 07:09:09.246175] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  767. [2015-09-22 07:09:09.246329] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.616265 (xid=0x5f14fd)
  768. [2015-09-22 07:09:09.246345] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  769. [2015-09-22 07:09:09.246351] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  770. [2015-09-22 07:09:09.246514] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.616469 (xid=0x5f1500)
  771. [2015-09-22 07:09:09.246372] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  772. [2015-09-22 07:09:09.246530] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  773. [2015-09-22 07:09:09.246549] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  774. [2015-09-22 07:09:09.246553] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  775. [2015-09-22 07:09:09.246718] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.616749 (xid=0x5f1503)
  776. [2015-09-22 07:09:09.246740] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  777. [2015-09-22 07:09:09.246746] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  778. [2015-09-22 07:09:09.246914] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.616938 (xid=0x5f1506)
  779. [2015-09-22 07:09:09.246768] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  780. [2015-09-22 07:09:09.246930] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  781. [2015-09-22 07:09:09.246953] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  782. [2015-09-22 07:09:09.246956] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  783. [2015-09-22 07:09:09.247107] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.617134 (xid=0x5f1509)
  784. [2015-09-22 07:09:09.247123] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  785. [2015-09-22 07:09:09.247127] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  786. [2015-09-22 07:09:09.247280] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.617383 (xid=0x5f150d)
  787. [2015-09-22 07:09:09.247146] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  788. [2015-09-22 07:09:09.247295] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  789. [2015-09-22 07:09:09.247315] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  790. [2015-09-22 07:09:09.247318] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  791. [2015-09-22 07:09:09.247482] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.617561 (xid=0x5f150f)
  792. [2015-09-22 07:09:09.247498] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  793. [2015-09-22 07:09:09.247502] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  794. [2015-09-22 07:09:09.247657] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.618005 (xid=0x5f1515)
  795. [2015-09-22 07:09:09.247522] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  796. [2015-09-22 07:09:09.247686] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  797. [2015-09-22 07:09:09.247718] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  798. [2015-09-22 07:09:09.247721] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  799. [2015-09-22 07:09:09.247872] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.618236 (xid=0x5f1518)
  800. [2015-09-22 07:09:09.247887] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  801. [2015-09-22 07:09:09.247895] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  802. [2015-09-22 07:09:09.248047] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.618369 (xid=0x5f151a)
  803. [2015-09-22 07:09:09.247914] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  804. [2015-09-22 07:09:09.248067] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  805. [2015-09-22 07:09:09.248086] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  806. [2015-09-22 07:09:09.248089] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  807. [2015-09-22 07:09:09.248234] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.618501 (xid=0x5f151c)
  808. [2015-09-22 07:09:09.248249] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  809. [2015-09-22 07:09:09.248253] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  810. [2015-09-22 07:09:09.248402] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.618684 (xid=0x5f151f)
  811. [2015-09-22 07:09:09.248272] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  812. [2015-09-22 07:09:09.248417] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  813. [2015-09-22 07:09:09.248436] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  814. [2015-09-22 07:09:09.248439] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  815. [2015-09-22 07:09:09.248593] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.619091 (xid=0x5f1521)
  816. [2015-09-22 07:09:09.248608] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  817. [2015-09-22 07:09:09.248612] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  818. [2015-09-22 07:09:09.248781] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.619220 (xid=0x5f1522)
  819. [2015-09-22 07:09:09.248637] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  820. [2015-09-22 07:09:09.248797] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  821. [2015-09-22 07:09:09.248821] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  822. [2015-09-22 07:09:09.248824] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  823. [2015-09-22 07:09:09.248973] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.619339 (xid=0x5f1523)
  824. [2015-09-22 07:09:09.248988] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  825. [2015-09-22 07:09:09.248995] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  826. [2015-09-22 07:09:09.249152] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.619480 (xid=0x5f1524)
  827. [2015-09-22 07:09:09.249014] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  828. [2015-09-22 07:09:09.249167] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  829. [2015-09-22 07:09:09.249188] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  830. [2015-09-22 07:09:09.249191] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  831. [2015-09-22 07:09:09.249335] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.619597 (xid=0x5f1525)
  832. [2015-09-22 07:09:09.249355] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  833. [2015-09-22 07:09:09.249361] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  834. [2015-09-22 07:09:09.249518] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.619730 (xid=0x5f1526)
  835. [2015-09-22 07:09:09.249384] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  836. [2015-09-22 07:09:09.249533] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  837. [2015-09-22 07:09:09.249552] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  838. [2015-09-22 07:09:09.249556] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  839. [2015-09-22 07:09:09.249708] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.619884 (xid=0x5f1527)
  840. [2015-09-22 07:09:09.249725] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  841. [2015-09-22 07:09:09.249732] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  842. [2015-09-22 07:09:09.249887] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.619943 (xid=0x5f1528)
  843. [2015-09-22 07:09:09.249752] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  844. [2015-09-22 07:09:09.249902] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  845. [2015-09-22 07:09:09.249921] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  846. [2015-09-22 07:09:09.249925] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  847. [2015-09-22 07:09:09.250078] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.619997 (xid=0x5f1529)
  848. [2015-09-22 07:09:09.250093] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  849. [2015-09-22 07:09:09.250099] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  850. [2015-09-22 07:09:09.250250] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.620100 (xid=0x5f152b)
  851. [2015-09-22 07:09:09.250118] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  852. [2015-09-22 07:09:09.250265] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  853. [2015-09-22 07:09:09.250285] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  854. [2015-09-22 07:09:09.250288] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  855. [2015-09-22 07:09:09.250433] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.620192 (xid=0x5f152c)
  856. [2015-09-22 07:09:09.250448] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  857. [2015-09-22 07:09:09.250452] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  858. [2015-09-22 07:09:09.250599] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.620243 (xid=0x5f152d)
  859. [2015-09-22 07:09:09.250471] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  860. [2015-09-22 07:09:09.250619] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  861. [2015-09-22 07:09:09.250638] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  862. [2015-09-22 07:09:09.250641] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  863. [2015-09-22 07:09:09.250791] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.620295 (xid=0x5f152e)
  864. [2015-09-22 07:09:09.250808] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  865. [2015-09-22 07:09:09.250815] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  866. [2015-09-22 07:09:09.250963] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.620351 (xid=0x5f152f)
  867. [2015-09-22 07:09:09.250834] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  868. [2015-09-22 07:09:09.250979] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  869. [2015-09-22 07:09:09.250997] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  870. [2015-09-22 07:09:09.251000] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  871. [2015-09-22 07:09:09.251141] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.620404 (xid=0x5f1530)
  872. [2015-09-22 07:09:09.251156] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  873. [2015-09-22 07:09:09.251161] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  874. [2015-09-22 07:09:09.251332] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.620458 (xid=0x5f1531)
  875. [2015-09-22 07:09:09.251186] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  876. [2015-09-22 07:09:09.251347] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  877. [2015-09-22 07:09:09.251368] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  878. [2015-09-22 07:09:09.251371] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  879. [2015-09-22 07:09:09.251517] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.620841 (xid=0x5f1534)
  880. [2015-09-22 07:09:09.251532] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  881. [2015-09-22 07:09:09.251538] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  882. [2015-09-22 07:09:09.251696] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.622102 (xid=0x5f1537)
  883. [2015-09-22 07:09:09.251557] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  884. [2015-09-22 07:09:09.251713] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  885. [2015-09-22 07:09:09.251733] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  886. [2015-09-22 07:09:09.251736] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  887. [2015-09-22 07:09:09.251881] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.641513 (xid=0x5f1559)
  888. [2015-09-22 07:09:09.251900] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  889. [2015-09-22 07:09:09.251905] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  890. [2015-09-22 07:09:09.252055] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.642318 (xid=0x5f1563)
  891. [2015-09-22 07:09:09.251925] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  892. [2015-09-22 07:09:09.252070] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  893. [2015-09-22 07:09:09.252092] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  894. [2015-09-22 07:09:09.252095] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  895. [2015-09-22 07:09:09.252237] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.642966 (xid=0x5f1569)
  896. [2015-09-22 07:09:09.252252] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  897. [2015-09-22 07:09:09.252256] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  898. [2015-09-22 07:09:09.252410] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.643189 (xid=0x5f156c)
  899. [2015-09-22 07:09:09.252276] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  900. [2015-09-22 07:09:09.252425] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  901. [2015-09-22 07:09:09.252444] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  902. [2015-09-22 07:09:09.252448] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  903. [2015-09-22 07:09:09.252602] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.643326 (xid=0x5f156e)
  904. [2015-09-22 07:09:09.252617] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  905. [2015-09-22 07:09:09.252621] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  906. [2015-09-22 07:09:09.252777] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.643563 (xid=0x5f1571)
  907. [2015-09-22 07:09:09.252640] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  908. [2015-09-22 07:09:09.252794] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  909. [2015-09-22 07:09:09.252817] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  910. [2015-09-22 07:09:09.252820] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  911. [2015-09-22 07:09:09.252966] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.643709 (xid=0x5f1574)
  912. [2015-09-22 07:09:09.252981] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  913. [2015-09-22 07:09:09.252987] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  914. [2015-09-22 07:09:09.253136] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.643913 (xid=0x5f1577)
  915. [2015-09-22 07:09:09.253007] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  916. [2015-09-22 07:09:09.253156] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  917. [2015-09-22 07:09:09.253175] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  918. [2015-09-22 07:09:09.253178] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  919. [2015-09-22 07:09:09.253329] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.643975 (xid=0x5f1579)
  920. [2015-09-22 07:09:09.253344] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  921. [2015-09-22 07:09:09.253348] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  922. [2015-09-22 07:09:09.253496] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.644384 (xid=0x5f157f)
  923. [2015-09-22 07:09:09.253367] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  924. [2015-09-22 07:09:09.253511] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  925. [2015-09-22 07:09:09.253532] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  926. [2015-09-22 07:09:09.253535] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  927. [2015-09-22 07:09:09.253683] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.644615 (xid=0x5f1582)
  928. [2015-09-22 07:09:09.253700] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  929. [2015-09-22 07:09:09.253704] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  930. [2015-09-22 07:09:09.253863] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.644812 (xid=0x5f1584)
  931. [2015-09-22 07:09:09.253729] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  932. [2015-09-22 07:09:09.253878] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  933. [2015-09-22 07:09:09.253899] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  934. [2015-09-22 07:09:09.253902] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  935. [2015-09-22 07:09:09.254048] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.644968 (xid=0x5f1586)
  936. [2015-09-22 07:09:09.254063] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  937. [2015-09-22 07:09:09.254069] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  938. [2015-09-22 07:09:09.254215] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.645110 (xid=0x5f1588)
  939. [2015-09-22 07:09:09.254089] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  940. [2015-09-22 07:09:09.254230] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  941. [2015-09-22 07:09:09.254250] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  942. [2015-09-22 07:09:09.254253] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  943. [2015-09-22 07:09:09.254393] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.645264 (xid=0x5f158a)
  944. [2015-09-22 07:09:09.254412] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  945. [2015-09-22 07:09:09.254416] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  946. [2015-09-22 07:09:09.254567] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.645329 (xid=0x5f158b)
  947. [2015-09-22 07:09:09.254436] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  948. [2015-09-22 07:09:09.254583] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  949. [2015-09-22 07:09:09.254602] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  950. [2015-09-22 07:09:09.254605] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  951. [2015-09-22 07:09:09.254752] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.645468 (xid=0x5f158d)
  952. [2015-09-22 07:09:09.254769] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  953. [2015-09-22 07:09:09.254774] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  954. [2015-09-22 07:09:09.254924] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.645530 (xid=0x5f158e)
  955. [2015-09-22 07:09:09.254796] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  956. [2015-09-22 07:09:09.254939] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  957. [2015-09-22 07:09:09.254961] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  958. [2015-09-22 07:09:09.254964] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  959. [2015-09-22 07:09:09.255112] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.645589 (xid=0x5f158f)
  960. [2015-09-22 07:09:09.255127] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  961. [2015-09-22 07:09:09.255133] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  962. [2015-09-22 07:09:09.255283] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.645656 (xid=0x5f1590)
  963. [2015-09-22 07:09:09.255152] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  964. [2015-09-22 07:09:09.255298] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  965. [2015-09-22 07:09:09.255320] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  966. [2015-09-22 07:09:09.255324] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  967. [2015-09-22 07:09:09.255464] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.645726 (xid=0x5f1591)
  968. [2015-09-22 07:09:09.255479] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  969. [2015-09-22 07:09:09.255483] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  970. [2015-09-22 07:09:09.255638] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.645795 (xid=0x5f1592)
  971. [2015-09-22 07:09:09.255502] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  972. [2015-09-22 07:09:09.255657] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  973. [2015-09-22 07:09:09.255687] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  974. [2015-09-22 07:09:09.255690] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  975. [2015-09-22 07:09:09.255841] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.645869 (xid=0x5f1593)
  976. [2015-09-22 07:09:09.255856] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  977. [2015-09-22 07:09:09.255861] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  978. [2015-09-22 07:09:09.256007] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.658797 (xid=0x5f159a)
  979. [2015-09-22 07:09:09.255881] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  980. [2015-09-22 07:09:09.256022] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  981. [2015-09-22 07:09:09.256043] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  982. [2015-09-22 07:09:09.256055] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
  983. [2015-09-22 07:09:09.256186] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.658994 (xid=0x5f159b)
  984. [2015-09-22 07:09:09.256201] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  985. [2015-09-22 07:09:09.256217] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  986. [2015-09-22 07:09:09.256233] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
  987. [2015-09-22 07:09:09.256370] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.674158 (xid=0x5f159f)
  988. [2015-09-22 07:09:09.256385] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  989. [2015-09-22 07:09:09.256399] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  990. [2015-09-22 07:09:09.256402] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  991. [2015-09-22 07:09:09.256542] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.681406 (xid=0x5f15cc)
  992. [2015-09-22 07:09:09.256557] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  993. [2015-09-22 07:09:09.256563] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  994. [2015-09-22 07:09:09.256583] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
  995. [2015-09-22 07:09:09.256725] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.681817 (xid=0x5f15d1)
  996. [2015-09-22 07:09:09.256742] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  997. [2015-09-22 07:09:09.256759] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  998. [2015-09-22 07:09:09.256771] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
  999. [2015-09-22 07:09:09.256903] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.683988 (xid=0x5f15ea)
  1000. [2015-09-22 07:09:09.256922] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1001. [2015-09-22 07:09:09.256936] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1002. [2015-09-22 07:09:09.257082] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.684170 (xid=0x5f15ed)
  1003. [2015-09-22 07:09:09.256947] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1004. [2015-09-22 07:09:09.257096] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1005. [2015-09-22 07:09:09.257120] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1006. [2015-09-22 07:09:09.257123] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1007. [2015-09-22 07:09:09.257266] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.684430 (xid=0x5f15f1)
  1008. [2015-09-22 07:09:09.257281] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1009. [2015-09-22 07:09:09.257288] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1010. [2015-09-22 07:09:09.257437] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.684576 (xid=0x5f15f4)
  1011. [2015-09-22 07:09:09.257308] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1012. [2015-09-22 07:09:09.257452] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1013. [2015-09-22 07:09:09.257473] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1014. [2015-09-22 07:09:09.257476] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1015. [2015-09-22 07:09:09.257626] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.684845 (xid=0x5f15f8)
  1016. [2015-09-22 07:09:09.257641] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1017. [2015-09-22 07:09:09.257646] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1018. [2015-09-22 07:09:09.257814] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.685037 (xid=0x5f15fa)
  1019. [2015-09-22 07:09:09.257665] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1020. [2015-09-22 07:09:09.257835] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1021. [2015-09-22 07:09:09.257853] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1022. [2015-09-22 07:09:09.257857] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1023. [2015-09-22 07:09:09.257999] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.685199 (xid=0x5f15fc)
  1024. [2015-09-22 07:09:09.258013] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1025. [2015-09-22 07:09:09.258017] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1026. [2015-09-22 07:09:09.258159] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.685324 (xid=0x5f15fe)
  1027. [2015-09-22 07:09:09.258039] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1028. [2015-09-22 07:09:09.258178] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1029. [2015-09-22 07:09:09.258196] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1030. [2015-09-22 07:09:09.258203] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1031. [2015-09-22 07:09:09.258340] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.685476 (xid=0x5f1600)
  1032. [2015-09-22 07:09:09.258355] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1033. [2015-09-22 07:09:09.258360] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1034. [2015-09-22 07:09:09.258503] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.685719 (xid=0x5f1604)
  1035. [2015-09-22 07:09:09.258378] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1036. [2015-09-22 07:09:09.258517] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1037. [2015-09-22 07:09:09.258535] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1038. [2015-09-22 07:09:09.258546] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
  1039. [2015-09-22 07:09:09.258684] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.685885 (xid=0x5f1606)
  1040. [2015-09-22 07:09:09.258701] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1041. [2015-09-22 07:09:09.258714] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1042. [2015-09-22 07:09:09.258717] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1043. [2015-09-22 07:09:09.258856] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.686007 (xid=0x5f1608)
  1044. [2015-09-22 07:09:09.258870] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1045. [2015-09-22 07:09:09.258874] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1046. [2015-09-22 07:09:09.259012] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.686134 (xid=0x5f160a)
  1047. [2015-09-22 07:09:09.258892] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1048. [2015-09-22 07:09:09.259027] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1049. [2015-09-22 07:09:09.259045] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1050. [2015-09-22 07:09:09.259048] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1051. [2015-09-22 07:09:09.259187] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.686265 (xid=0x5f160c)
  1052. [2015-09-22 07:09:09.259201] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1053. [2015-09-22 07:09:09.259205] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1054. [2015-09-22 07:09:09.259348] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.686477 (xid=0x5f160f)
  1055. [2015-09-22 07:09:09.259224] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1056. [2015-09-22 07:09:09.259367] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1057. [2015-09-22 07:09:09.259386] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1058. [2015-09-22 07:09:09.259389] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1059. [2015-09-22 07:09:09.259527] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.686761 (xid=0x5f1612)
  1060. [2015-09-22 07:09:09.259541] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1061. [2015-09-22 07:09:09.259545] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1062. [2015-09-22 07:09:09.259695] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.686888 (xid=0x5f1614)
  1063. [2015-09-22 07:09:09.259564] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1064. [2015-09-22 07:09:09.259711] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1065. [2015-09-22 07:09:09.259729] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1066. [2015-09-22 07:09:09.259740] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
  1067. [2015-09-22 07:09:09.259872] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.686944 (xid=0x5f1615)
  1068. [2015-09-22 07:09:09.259886] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1069. [2015-09-22 07:09:09.259906] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1070. [2015-09-22 07:09:09.259913] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1071. [2015-09-22 07:09:09.260058] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.687014 (xid=0x5f1616)
  1072. [2015-09-22 07:09:09.260072] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1073. [2015-09-22 07:09:09.260078] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1074. [2015-09-22 07:09:09.260227] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.687072 (xid=0x5f1617)
  1075. [2015-09-22 07:09:09.260097] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1076. [2015-09-22 07:09:09.260241] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1077. [2015-09-22 07:09:09.260259] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1078. [2015-09-22 07:09:09.260274] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
  1079. [2015-09-22 07:09:09.260407] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.687126 (xid=0x5f1618)
  1080. [2015-09-22 07:09:09.260421] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1081. [2015-09-22 07:09:09.260440] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1082. [2015-09-22 07:09:09.260443] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1083. [2015-09-22 07:09:09.260585] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.687305 (xid=0x5f1619)
  1084. [2015-09-22 07:09:09.260604] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1085. [2015-09-22 07:09:09.260608] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1086. [2015-09-22 07:09:09.260627] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
  1087. [2015-09-22 07:09:09.260763] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.687361 (xid=0x5f161a)
  1088. [2015-09-22 07:09:09.260779] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1089. [2015-09-22 07:09:09.260792] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1090. [2015-09-22 07:09:09.260927] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.687418 (xid=0x5f161c)
  1091. [2015-09-22 07:09:09.260803] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1092. [2015-09-22 07:09:09.260941] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1093. [2015-09-22 07:09:09.260959] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1094. [2015-09-22 07:09:09.260962] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1095. [2015-09-22 07:09:09.261096] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.687499 (xid=0x5f161d)
  1096. [2015-09-22 07:09:09.261111] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1097. [2015-09-22 07:09:09.261115] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1098. [2015-09-22 07:09:09.261265] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.687572 (xid=0x5f161e)
  1099. [2015-09-22 07:09:09.261139] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1100. [2015-09-22 07:09:09.261280] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1101. [2015-09-22 07:09:09.261298] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1102. [2015-09-22 07:09:09.261302] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1103. [2015-09-22 07:09:09.261441] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.687695 (xid=0x5f1620)
  1104. [2015-09-22 07:09:09.261455] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1105. [2015-09-22 07:09:09.261459] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1106. [2015-09-22 07:09:09.261833] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.687753 (xid=0x5f1621)
  1107. [2015-09-22 07:09:09.261478] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1108. [2015-09-22 07:09:09.261850] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1109. [2015-09-22 07:09:09.261872] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1110. [2015-09-22 07:09:09.261884] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
  1111. [2015-09-22 07:09:09.262174] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.687815 (xid=0x5f1622)
  1112. [2015-09-22 07:09:09.262196] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1113. [2015-09-22 07:09:09.262210] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1114. [2015-09-22 07:09:09.262213] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1115. [2015-09-22 07:09:09.262515] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.687872 (xid=0x5f1623)
  1116. [2015-09-22 07:09:09.262530] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1117. [2015-09-22 07:09:09.262536] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1118. [2015-09-22 07:09:09.262685] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.688599 (xid=0x5f1626)
  1119. [2015-09-22 07:09:09.262555] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1120. [2015-09-22 07:09:09.262701] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1121. [2015-09-22 07:09:09.262720] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1122. [2015-09-22 07:09:09.262731] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
  1123. [2015-09-22 07:09:09.262864] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.689182 (xid=0x5f1627)
  1124. [2015-09-22 07:09:09.262878] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1125. [2015-09-22 07:09:09.262900] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1126. [2015-09-22 07:09:09.262912] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
  1127. [2015-09-22 07:09:09.263044] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.691767 (xid=0x5f162b)
  1128. [2015-09-22 07:09:09.263059] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1129. [2015-09-22 07:09:09.263071] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1130. [2015-09-22 07:09:09.263075] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1131. [2015-09-22 07:09:09.263212] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.706680 (xid=0x5f162f)
  1132. [2015-09-22 07:09:09.263226] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1133. [2015-09-22 07:09:09.263230] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1134. [2015-09-22 07:09:09.263249] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
  1135. [2015-09-22 07:09:09.263381] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.726601 (xid=0x5f163d)
  1136. [2015-09-22 07:09:09.263396] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1137. [2015-09-22 07:09:09.263409] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1138. [2015-09-22 07:09:09.263542] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.726680 (xid=0x5f163e)
  1139. [2015-09-22 07:09:09.263419] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1140. [2015-09-22 07:09:09.263561] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1141. [2015-09-22 07:09:09.263583] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1142. [2015-09-22 07:09:09.263586] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1143. [2015-09-22 07:09:09.263729] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.727028 (xid=0x5f1640)
  1144. [2015-09-22 07:09:09.263745] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1145. [2015-09-22 07:09:09.263750] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1146. [2015-09-22 07:09:09.263893] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.727339 (xid=0x5f1644)
  1147. [2015-09-22 07:09:09.263769] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1148. [2015-09-22 07:09:09.263907] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1149. [2015-09-22 07:09:09.263931] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1150. [2015-09-22 07:09:09.263934] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1151. [2015-09-22 07:09:09.264069] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.728113 (xid=0x5f1648)
  1152. [2015-09-22 07:09:09.264084] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1153. [2015-09-22 07:09:09.264093] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1154. [2015-09-22 07:09:09.264119] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
  1155. [2015-09-22 07:09:09.264254] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.728375 (xid=0x5f1649)
  1156. [2015-09-22 07:09:09.264268] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1157. [2015-09-22 07:09:09.264285] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1158. [2015-09-22 07:09:09.264296] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
  1159. [2015-09-22 07:09:09.264428] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.728847 (xid=0x5f164b)
  1160. [2015-09-22 07:09:09.264443] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1161. [2015-09-22 07:09:09.264455] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1162. [2015-09-22 07:09:09.264584] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.732245 (xid=0x5f164f)
  1163. [2015-09-22 07:09:09.264465] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1164. [2015-09-22 07:09:09.264599] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1165. [2015-09-22 07:09:09.264619] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1166. [2015-09-22 07:09:09.264622] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1167. [2015-09-22 07:09:09.264771] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.737904 (xid=0x5f1669)
  1168. [2015-09-22 07:09:09.264791] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1169. [2015-09-22 07:09:09.264809] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1170. [2015-09-22 07:09:09.264829] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
  1171. [2015-09-22 07:09:09.264961] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.738312 (xid=0x5f166d)
  1172. [2015-09-22 07:09:09.264976] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1173. [2015-09-22 07:09:09.264989] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1174. [2015-09-22 07:09:09.264999] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
  1175. [2015-09-22 07:09:09.265133] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.738966 (xid=0x5f1678)
  1176. [2015-09-22 07:09:09.265147] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1177. [2015-09-22 07:09:09.265165] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1178. [2015-09-22 07:09:09.265177] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
  1179. [2015-09-22 07:09:09.265309] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.740746 (xid=0x5f168b)
  1180. [2015-09-22 07:09:09.265324] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1181. [2015-09-22 07:09:09.265341] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1182. [2015-09-22 07:09:09.265645] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.741075 (xid=0x5f1690)
  1183. [2015-09-22 07:09:09.265352] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1184. [2015-09-22 07:09:09.265662] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1185. [2015-09-22 07:09:09.265693] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1186. [2015-09-22 07:09:09.265704] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
  1187. [2015-09-22 07:09:09.265833] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.741371 (xid=0x5f1692)
  1188. [2015-09-22 07:09:09.265848] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1189. [2015-09-22 07:09:09.265860] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1190. [2015-09-22 07:09:09.265866] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1191. [2015-09-22 07:09:09.266005] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.741887 (xid=0x5f1697)
  1192. [2015-09-22 07:09:09.266019] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1193. [2015-09-22 07:09:09.266027] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1194. [2015-09-22 07:09:09.266046] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
  1195. [2015-09-22 07:09:09.266182] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.742206 (xid=0x5f169b)
  1196. [2015-09-22 07:09:09.266201] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1197. [2015-09-22 07:09:09.266214] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1198. [2015-09-22 07:09:09.266355] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.742572 (xid=0x5f169f)
  1199. [2015-09-22 07:09:09.266225] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1200. [2015-09-22 07:09:09.266369] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1201. [2015-09-22 07:09:09.266388] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1202. [2015-09-22 07:09:09.266391] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1203. [2015-09-22 07:09:09.266524] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.742812 (xid=0x5f16a1)
  1204. [2015-09-22 07:09:09.266538] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1205. [2015-09-22 07:09:09.266542] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1206. [2015-09-22 07:09:09.266686] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.743037 (xid=0x5f16a4)
  1207. [2015-09-22 07:09:09.266560] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1208. [2015-09-22 07:09:09.266703] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1209. [2015-09-22 07:09:09.266735] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1210. [2015-09-22 07:09:09.266738] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1211. [2015-09-22 07:09:09.266879] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.743539 (xid=0x5f16a8)
  1212. [2015-09-22 07:09:09.266894] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1213. [2015-09-22 07:09:09.266897] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1214. [2015-09-22 07:09:09.267045] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.744114 (xid=0x5f16ae)
  1215. [2015-09-22 07:09:09.266916] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1216. [2015-09-22 07:09:09.267059] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1217. [2015-09-22 07:09:09.267077] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1218. [2015-09-22 07:09:09.267087] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: b29b8d7e-cdc5-49f5-ad28-ca9f0e3127cb: Failing WRITE as quorum is not met
  1219. [2015-09-22 07:09:09.267276] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.744186 (xid=0x5f16b0)
  1220. [2015-09-22 07:09:09.267291] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1221. [2015-09-22 07:09:09.267304] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1222. [2015-09-22 07:09:09.267307] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1223. [2015-09-22 07:09:09.267449] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.744629 (xid=0x5f16b6)
  1224. [2015-09-22 07:09:09.267468] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1225. [2015-09-22 07:09:09.267472] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1226. [2015-09-22 07:09:09.267618] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(WRITE(13)) called at 2015-09-22 07:08:00.744894 (xid=0x5f16b8)
  1227. [2015-09-22 07:09:09.267491] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1228. [2015-09-22 07:09:09.267636] W [MSGID: 114031] [client-rpc-fops.c:904:client3_3_writev_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1229. [2015-09-22 07:09:09.267677] W [MSGID: 114061] [client-rpc-fops.c:4507:client3_3_fsync] 0-vmstore-client-0: (e16d1e40-2b6e-4f19-977d-e099f465dfc6) remote_fd is -1. EBADFD [File descriptor in bad state]
  1230. [2015-09-22 07:09:09.267692] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [File descriptor in bad state]
  1231. [2015-09-22 07:09:09.267857] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FXATTROP(34)) called at 2015-09-22 07:08:00.744958 (xid=0x5f16b9)
  1232. [2015-09-22 07:09:09.267872] W [MSGID: 114031] [client-rpc-fops.c:1914:client3_3_fxattrop_cbk] 0-vmstore-client-0: remote operation failed
  1233. [2015-09-22 07:09:09.268057] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(WRITE(13)) called at 2015-09-22 07:08:00.745010 (xid=0x5f16ba)
  1234. [2015-09-22 07:09:09.268071] W [MSGID: 114031] [client-rpc-fops.c:904:client3_3_writev_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1235. [2015-09-22 07:09:09.268091] W [MSGID: 114061] [client-rpc-fops.c:4507:client3_3_fsync] 0-vmstore-client-0: (e16d1e40-2b6e-4f19-977d-e099f465dfc6) remote_fd is -1. EBADFD [File descriptor in bad state]
  1236. [2015-09-22 07:09:09.268102] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [File descriptor in bad state]
  1237. [2015-09-22 07:09:09.268180] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1238. [2015-09-22 07:09:09.268260] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.745079 (xid=0x5f16bb)
  1239. [2015-09-22 07:09:09.268274] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1240. [2015-09-22 07:09:09.268288] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1241. [2015-09-22 07:09:09.268297] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1242. [2015-09-22 07:09:09.268435] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(WRITE(13)) called at 2015-09-22 07:08:00.745236 (xid=0x5f16bc)
  1243. [2015-09-22 07:09:09.268450] W [MSGID: 114031] [client-rpc-fops.c:904:client3_3_writev_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1244. [2015-09-22 07:09:09.268469] W [MSGID: 114061] [client-rpc-fops.c:4507:client3_3_fsync] 0-vmstore-client-0: (e16d1e40-2b6e-4f19-977d-e099f465dfc6) remote_fd is -1. EBADFD [File descriptor in bad state]
  1245. [2015-09-22 07:09:09.268480] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [File descriptor in bad state]
  1246. [2015-09-22 07:09:09.268616] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.745309 (xid=0x5f16bd)
  1247. [2015-09-22 07:09:09.268630] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1248. [2015-09-22 07:09:09.268633] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1249. [2015-09-22 07:09:09.268651] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1250. [2015-09-22 07:09:09.268967] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FXATTROP(34)) called at 2015-09-22 07:08:00.745383 (xid=0x5f16be)
  1251. [2015-09-22 07:09:09.268909] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1252. [2015-09-22 07:09:09.268988] W [MSGID: 114031] [client-rpc-fops.c:1914:client3_3_fxattrop_cbk] 0-vmstore-client-0: remote operation failed
  1253. [2015-09-22 07:09:09.269094] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1254. [2015-09-22 07:09:09.269178] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.745403 (xid=0x5f16bf)
  1255. [2015-09-22 07:09:09.269192] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1256. [2015-09-22 07:09:09.269205] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1257. [2015-09-22 07:09:09.269216] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1258. [2015-09-22 07:09:09.269439] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(WRITE(13)) called at 2015-09-22 07:08:00.745491 (xid=0x5f16c0)
  1259. [2015-09-22 07:09:09.269453] W [MSGID: 114031] [client-rpc-fops.c:904:client3_3_writev_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1260. [2015-09-22 07:09:09.269473] W [MSGID: 114061] [client-rpc-fops.c:4507:client3_3_fsync] 0-vmstore-client-0: (e16d1e40-2b6e-4f19-977d-e099f465dfc6) remote_fd is -1. EBADFD [File descriptor in bad state]
  1261. [2015-09-22 07:09:09.269616] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.745594 (xid=0x5f16c1)
  1262. [2015-09-22 07:09:09.269484] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [File descriptor in bad state]
  1263. [2015-09-22 07:09:09.269634] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1264. [2015-09-22 07:09:09.269653] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1265. [2015-09-22 07:09:09.269663] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1266. [2015-09-22 07:09:09.269813] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(WRITE(13)) called at 2015-09-22 07:08:00.745688 (xid=0x5f16c2)
  1267. [2015-09-22 07:09:09.269827] W [MSGID: 114031] [client-rpc-fops.c:904:client3_3_writev_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1268. [2015-09-22 07:09:09.269846] W [MSGID: 114061] [client-rpc-fops.c:4507:client3_3_fsync] 0-vmstore-client-0: (e16d1e40-2b6e-4f19-977d-e099f465dfc6) remote_fd is -1. EBADFD [File descriptor in bad state]
  1269. [2015-09-22 07:09:09.269848] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [File descriptor in bad state]
  1270. [2015-09-22 07:09:09.270000] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.745758 (xid=0x5f16c3)
  1271. [2015-09-22 07:09:09.270014] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1272. [2015-09-22 07:09:09.270026] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1273. [2015-09-22 07:09:09.270041] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1274. [2015-09-22 07:09:09.270302] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(WRITE(13)) called at 2015-09-22 07:08:00.745820 (xid=0x5f16c4)
  1275. [2015-09-22 07:09:09.270316] W [MSGID: 114031] [client-rpc-fops.c:904:client3_3_writev_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1276. [2015-09-22 07:09:09.270333] W [MSGID: 114061] [client-rpc-fops.c:4507:client3_3_fsync] 0-vmstore-client-0: (e16d1e40-2b6e-4f19-977d-e099f465dfc6) remote_fd is -1. EBADFD [File descriptor in bad state]
  1277. [2015-09-22 07:09:09.270351] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [File descriptor in bad state]
  1278. [2015-09-22 07:09:09.270496] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.745880 (xid=0x5f16c5)
  1279. The message "W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met" repeated 2 times between [2015-09-22 07:09:09.270041] and [2015-09-22 07:09:09.270438]
  1280. [2015-09-22 07:09:09.270515] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1281. [2015-09-22 07:09:09.270542] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1282. [2015-09-22 07:09:09.270552] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1283. [2015-09-22 07:09:09.270682] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.745934 (xid=0x5f16c6)
  1284. [2015-09-22 07:09:09.270698] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1285. [2015-09-22 07:09:09.270710] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1286. [2015-09-22 07:09:09.270720] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1287. [2015-09-22 07:09:09.270850] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(WRITE(13)) called at 2015-09-22 07:08:00.746003 (xid=0x5f16c7)
  1288. [2015-09-22 07:09:09.270750] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1289. [2015-09-22 07:09:09.270864] W [MSGID: 114031] [client-rpc-fops.c:904:client3_3_writev_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1290. [2015-09-22 07:09:09.270893] W [MSGID: 114061] [client-rpc-fops.c:4507:client3_3_fsync] 0-vmstore-client-0: (e16d1e40-2b6e-4f19-977d-e099f465dfc6) remote_fd is -1. EBADFD [File descriptor in bad state]
  1291. [2015-09-22 07:09:09.271033] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.746073 (xid=0x5f16c8)
  1292. [2015-09-22 07:09:09.270904] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [File descriptor in bad state]
  1293. [2015-09-22 07:09:09.271047] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1294. [2015-09-22 07:09:09.271071] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1295. [2015-09-22 07:09:09.271081] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1296. [2015-09-22 07:09:09.271218] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(WRITE(13)) called at 2015-09-22 07:08:00.746132 (xid=0x5f16c9)
  1297. [2015-09-22 07:09:09.271232] W [MSGID: 114031] [client-rpc-fops.c:904:client3_3_writev_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1298. [2015-09-22 07:09:09.271251] W [MSGID: 114061] [client-rpc-fops.c:4507:client3_3_fsync] 0-vmstore-client-0: (e16d1e40-2b6e-4f19-977d-e099f465dfc6) remote_fd is -1. EBADFD [File descriptor in bad state]
  1299. [2015-09-22 07:09:09.271254] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [File descriptor in bad state]
  1300. [2015-09-22 07:09:09.271257] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1301. [2015-09-22 07:09:09.271396] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FSYNC(16)) called at 2015-09-22 07:08:00.746197 (xid=0x5f16ca)
  1302. [2015-09-22 07:09:09.271411] W [MSGID: 114031] [client-rpc-fops.c:1028:client3_3_fsync_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1303. [2015-09-22 07:09:09.271424] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [Transport endpoint is not connected]
  1304. [2015-09-22 07:09:09.271434] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1305. [2015-09-22 07:09:09.271561] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(LOOKUP(27)) called at 2015-09-22 07:08:07.992129 (xid=0x5f16cb)
  1306. [2015-09-22 07:09:09.271578] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: / (00000000-0000-0000-0000-000000000001) [Transport endpoint is not connected]
  1307. [2015-09-22 07:09:09.271585] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1308. [2015-09-22 07:09:09.271736] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(LOOKUP(27)) called at 2015-09-22 07:08:08.890808 (xid=0x5f16cc)
  1309. [2015-09-22 07:09:09.271755] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: / (00000000-0000-0000-0000-000000000001) [Transport endpoint is not connected]
  1310. [2015-09-22 07:09:09.272009] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(LOOKUP(27)) called at 2015-09-22 07:08:15.819826 (xid=0x5f16ce)
  1311. [2015-09-22 07:09:09.272230] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(LOOKUP(27)) called at 2015-09-22 07:08:18.173119 (xid=0x5f16cf)
  1312. [2015-09-22 07:09:09.272395] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GF-DUMP) op(NULL(2)) called at 2015-09-22 07:08:27.002157 (xid=0x5f16d0)
  1313. [2015-09-22 07:09:09.272410] W [rpc-clnt-ping.c:199:rpc_clnt_ping_cbk] 0-vmstore-client-0: socket or ib related error
  1314. [2015-09-22 07:09:09.272506] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(LOOKUP(27)) called at 2015-09-22 07:08:33.326302 (xid=0x5f16d1)
  1315. [2015-09-22 07:09:09.272671] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(LOOKUP(27)) called at 2015-09-22 07:08:39.852148 (xid=0x5f16d2)
  1316. [2015-09-22 07:09:09.272839] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(LOOKUP(27)) called at 2015-09-22 07:09:07.998435 (xid=0x5f16d3)
  1317. The message "W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: / (00000000-0000-0000-0000-000000000001) [Transport endpoint is not connected]" repeated 5 times between [2015-09-22 07:09:09.271755] and [2015-09-22 07:09:09.272861]
  1318. [2015-09-22 07:09:09.272911] I [MSGID: 114018] [client.c:2042:client_rpc_notify] 0-vmstore-client-0: disconnected from vmstore-client-0. Client process will keep trying to connect to glusterd until brick's port is available
  1319. [2015-09-22 07:09:09.272936] W [MSGID: 108001] [afr-common.c:4043:afr_notify] 0-vmstore-replicate-0: Client-quorum is not met
  1320. [2015-09-22 07:09:09.724874] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292614: WRITE => -1 (Read-only file system)
  1321. [2015-09-22 07:09:10.212977] I [rpc-clnt.c:1819:rpc_clnt_reconfig] 0-vmstore-client-1: changing port to 49152 (from 0)
  1322. [2015-09-22 07:09:10.218084] E [socket.c:2332:socket_connect_finish] 0-vmstore-client-1: connection to 10.70.40.13:49152 failed (Connection refused)
  1323. [2015-09-22 07:09:10.228474] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292625: WRITE => -1 (Read-only file system)
  1324. [2015-09-22 07:09:10.732420] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292636: WRITE => -1 (Read-only file system)
  1325. [2015-09-22 07:09:11.236284] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292647: WRITE => -1 (Read-only file system)
  1326. [2015-09-22 07:09:11.740210] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292658: WRITE => -1 (Read-only file system)
  1327. [2015-09-22 07:09:14.219129] I [rpc-clnt.c:1819:rpc_clnt_reconfig] 0-vmstore-client-1: changing port to 49152 (from 0)
  1328. [2015-09-22 07:09:14.224609] E [socket.c:2332:socket_connect_finish] 0-vmstore-client-1: connection to 10.70.40.13:49152 failed (Connection refused)
  1329. [2015-09-22 07:09:15.829279] I [MSGID: 108031] [afr-common.c:1745:afr_local_discovery_cbk] 0-vmstore-replicate-0: selecting local read_child vmstore-client-2
  1330. [2015-09-22 07:09:18.223710] I [rpc-clnt.c:1819:rpc_clnt_reconfig] 0-vmstore-client-1: changing port to 49152 (from 0)
  1331. [2015-09-22 07:09:18.227733] E [socket.c:2332:socket_connect_finish] 0-vmstore-client-1: connection to 10.70.40.13:49152 failed (Connection refused)
  1332. [2015-09-22 07:09:18.932624] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292684: WRITE => -1 (Read-only file system)
  1333. [2015-09-22 07:09:22.230706] I [rpc-clnt.c:1819:rpc_clnt_reconfig] 0-vmstore-client-1: changing port to 49152 (from 0)
  1334. [2015-09-22 07:09:22.236888] E [socket.c:2332:socket_connect_finish] 0-vmstore-client-1: connection to 10.70.40.13:49152 failed (Connection refused)
  1335. [2015-09-22 07:09:26.237714] I [rpc-clnt.c:1819:rpc_clnt_reconfig] 0-vmstore-client-1: changing port to 49152 (from 0)
  1336. [2015-09-22 07:09:26.243947] E [socket.c:2332:socket_connect_finish] 0-vmstore-client-1: connection to 10.70.40.13:49152 failed (Connection refused)
  1337. [2015-09-22 07:09:28.965463] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292705: WRITE => -1 (Read-only file system)
  1338. [2015-09-22 07:09:31.199627] I [rpc-clnt.c:1819:rpc_clnt_reconfig] 0-vmstore-client-1: changing port to 49152 (from 0)
  1339. [2015-09-22 07:09:31.205201] E [socket.c:2332:socket_connect_finish] 0-vmstore-client-1: connection to 10.70.40.13:49152 failed (Connection refused)
  1340. [2015-09-22 07:09:34.248724] I [rpc-clnt.c:1819:rpc_clnt_reconfig] 0-vmstore-client-1: changing port to 49152 (from 0)
  1341. [2015-09-22 07:09:34.253975] E [socket.c:2332:socket_connect_finish] 0-vmstore-client-1: connection to 10.70.40.13:49152 failed (Connection refused)
  1342. [2015-09-22 07:09:38.254736] I [rpc-clnt.c:1819:rpc_clnt_reconfig] 0-vmstore-client-1: changing port to 49152 (from 0)
  1343. [2015-09-22 07:09:38.260170] E [socket.c:2332:socket_connect_finish] 0-vmstore-client-1: connection to 10.70.40.13:49152 failed (Connection refused)
  1344. [2015-09-22 07:09:38.998578] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292731: WRITE => -1 (Read-only file system)
  1345. [2015-09-22 07:09:42.261133] I [rpc-clnt.c:1819:rpc_clnt_reconfig] 0-vmstore-client-1: changing port to 49152 (from 0)
  1346. [2015-09-22 07:09:42.266598] E [socket.c:2332:socket_connect_finish] 0-vmstore-client-1: connection to 10.70.40.13:49152 failed (Connection refused)
  1347. [2015-09-22 07:09:46.267150] I [rpc-clnt.c:1819:rpc_clnt_reconfig] 0-vmstore-client-1: changing port to 49152 (from 0)
  1348. [2015-09-22 07:09:46.272761] E [socket.c:2332:socket_connect_finish] 0-vmstore-client-1: connection to 10.70.40.13:49152 failed (Connection refused)
  1349. [2015-09-22 07:09:49.028956] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292755: WRITE => -1 (Read-only file system)
  1350. [2015-09-22 07:09:50.273182] I [rpc-clnt.c:1819:rpc_clnt_reconfig] 0-vmstore-client-1: changing port to 49152 (from 0)
  1351. [2015-09-22 07:09:50.278675] E [socket.c:2332:socket_connect_finish] 0-vmstore-client-1: connection to 10.70.40.13:49152 failed (Connection refused)
  1352. [2015-09-22 07:09:52.272547] C [rpc-clnt-ping.c:161:rpc_clnt_ping_timer_expired] 0-vmstore-client-0: server 10.70.45.17:49217 has not responded in the last 42 seconds, disconnecting.
  1353. [2015-09-22 07:09:52.272888] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FINODELK(30)) called at 2015-09-22 07:09:09.226502 (xid=0x5f16e3)
  1354. [2015-09-22 07:09:52.273109] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FINODELK(30)) called at 2015-09-22 07:09:09.236579 (xid=0x5f16e4)
  1355. [2015-09-22 07:09:52.273341] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(FINODELK(30)) called at 2015-09-22 07:09:09.267142 (xid=0x5f16e5)
  1356. [2015-09-22 07:09:52.274340] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(OPEN(11)) called at 2015-09-22 07:09:09.226395 (xid=0x5f16e0)
  1357. The message "E [MSGID: 114031] [client-rpc-fops.c:1673:client3_3_finodelk_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]" repeated 6 times between [2015-09-22 07:09:09.207608] and [2015-09-22 07:09:52.273697]
  1358. [2015-09-22 07:09:52.274381] W [MSGID: 114032] [client-handshake.c:706:client3_3_reopen_cbk] 0-vmstore-client-0: received RPC status error, returning ENOTCONN [Transport endpoint is not connected]
  1359. [2015-09-22 07:09:52.274599] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(OPEN(11)) called at 2015-09-22 07:09:09.226420 (xid=0x5f16e1)
  1360. [2015-09-22 07:09:52.274795] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(OPEN(11)) called at 2015-09-22 07:09:09.226443 (xid=0x5f16e2)
  1361. The message "W [MSGID: 114032] [client-handshake.c:706:client3_3_reopen_cbk] 0-vmstore-client-0: received RPC status error, returning ENOTCONN [Transport endpoint is not connected]" repeated 2 times between [2015-09-22 07:09:52.274381] and [2015-09-22 07:09:52.274815]
  1362. [2015-09-22 07:09:52.274820] I [MSGID: 114041] [client-handshake.c:678:client_child_up_reopen_done] 0-vmstore-client-0: last fd open'd/lock-self-heal'd - notifying CHILD-UP
  1363. [2015-09-22 07:09:52.274871] W [MSGID: 114032] [client-handshake.c:182:client_set_lk_version_cbk] 0-vmstore-client-0: received RPC status error [Transport endpoint is not connected]
  1364. [2015-09-22 07:09:52.274891] I [MSGID: 108002] [afr-common.c:4039:afr_notify] 0-vmstore-replicate-0: Client-quorum is met
  1365. [2015-09-22 07:09:52.275120] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(WRITE(13)) called at 2015-09-22 07:09:09.267924 (xid=0x5f16e6)
  1366. [2015-09-22 07:09:52.275146] W [MSGID: 114031] [client-rpc-fops.c:904:client3_3_writev_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1367. [2015-09-22 07:09:52.275203] W [MSGID: 114061] [client-rpc-fops.c:4507:client3_3_fsync] 0-vmstore-client-0: (e16d1e40-2b6e-4f19-977d-e099f465dfc6) remote_fd is -1. EBADFD [File descriptor in bad state]
  1368. [2015-09-22 07:09:52.275240] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [File descriptor in bad state]
  1369. [2015-09-22 07:09:52.275463] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(WRITE(13)) called at 2015-09-22 07:09:09.269043 (xid=0x5f16e7)
  1370. [2015-09-22 07:09:52.275498] W [MSGID: 114031] [client-rpc-fops.c:904:client3_3_writev_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1371. [2015-09-22 07:09:52.275543] W [MSGID: 114061] [client-rpc-fops.c:4507:client3_3_fsync] 0-vmstore-client-0: (e16d1e40-2b6e-4f19-977d-e099f465dfc6) remote_fd is -1. EBADFD [File descriptor in bad state]
  1372. [2015-09-22 07:09:52.275559] W [MSGID: 108035] [afr-transaction.c:1614:afr_changelog_fsync_cbk] 0-vmstore-replicate-0: fsync(e16d1e40-2b6e-4f19-977d-e099f465dfc6) failed on subvolume vmstore-client-0. Transaction was WRITE [File descriptor in bad state]
  1373. [2015-09-22 07:09:52.275807] W [fuse-bridge.c:1230:fuse_err_cbk] 0-glusterfs-fuse: 5292758: FSYNC() ERR => -1 (Read-only file system)
  1374. [2015-09-22 07:09:52.275806] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1375. [2015-09-22 07:09:52.275811] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(LOOKUP(27)) called at 2015-09-22 07:09:09.271971 (xid=0x5f16e8)
  1376. [2015-09-22 07:09:52.275864] E [MSGID: 114031] [client-rpc-fops.c:1673:client3_3_finodelk_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1377. [2015-09-22 07:09:52.275870] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: /a7883778-47a0-4c37-a43d-84b5c103eebf (f2fdc88c-e824-4314-bd7d-df9b6902fade) [Transport endpoint is not connected]
  1378. [2015-09-22 07:09:52.276200] W [fuse-bridge.c:1230:fuse_err_cbk] 0-glusterfs-fuse: 5292760: FSYNC() ERR => -1 (Read-only file system)
  1379. [2015-09-22 07:09:52.276221] W [MSGID: 108001] [afr-transaction.c:686:afr_handle_quorum] 0-vmstore-replicate-0: e16d1e40-2b6e-4f19-977d-e099f465dfc6: Failing WRITE as quorum is not met
  1380. [2015-09-22 07:09:52.276241] E [MSGID: 114031] [client-rpc-fops.c:1673:client3_3_finodelk_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1381. [2015-09-22 07:09:52.276288] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292761: WRITE => -1 (Read-only file system)
  1382. [2015-09-22 07:09:52.276479] W [fuse-bridge.c:1230:fuse_err_cbk] 0-glusterfs-fuse: 5292762: FSYNC() ERR => -1 (Read-only file system)
  1383. [2015-09-22 07:09:52.277653] W [fuse-bridge.c:1230:fuse_err_cbk] 0-glusterfs-fuse: 5292763: FSYNC() ERR => -1 (Read-only file system)
  1384. [2015-09-22 07:09:52.278099] W [fuse-bridge.c:1230:fuse_err_cbk] 0-glusterfs-fuse: 5292764: FSYNC() ERR => -1 (Read-only file system)
  1385. [2015-09-22 07:09:52.278528] W [fuse-bridge.c:1230:fuse_err_cbk] 0-glusterfs-fuse: 5292765: FSYNC() ERR => -1 (Read-only file system)
  1386. [2015-09-22 07:09:52.278594] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(LOOKUP(27)) called at 2015-09-22 07:09:09.272132 (xid=0x5f16e9)
  1387. [2015-09-22 07:09:52.278623] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: /a7883778-47a0-4c37-a43d-84b5c103eebf (f2fdc88c-e824-4314-bd7d-df9b6902fade) [Transport endpoint is not connected]
  1388. [2015-09-22 07:09:52.278626] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: (null) (00000000-0000-0000-0000-000000000000) [Transport endpoint is not connected]
  1389. [2015-09-22 07:09:52.278909] W [fuse-bridge.c:1230:fuse_err_cbk] 0-glusterfs-fuse: 5292766: FSYNC() ERR => -1 (Read-only file system)
  1390. [2015-09-22 07:09:52.279221] E [MSGID: 114031] [client-rpc-fops.c:1727:client3_3_entrylk_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1391. [2015-09-22 07:09:52.280392] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: (null) (00000000-0000-0000-0000-000000000000) [Transport endpoint is not connected]
  1392. [2015-09-22 07:09:52.281191] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: /a7883778-47a0-4c37-a43d-84b5c103eebf (f2fdc88c-e824-4314-bd7d-df9b6902fade) [Transport endpoint is not connected]
  1393. [2015-09-22 07:09:52.281644] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: (null) (00000000-0000-0000-0000-000000000000) [Transport endpoint is not connected]
  1394. [2015-09-22 07:09:52.281703] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(LOOKUP(27)) called at 2015-09-22 07:09:09.272236 (xid=0x5f16ea)
  1395. [2015-09-22 07:09:52.281733] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: /a7883778-47a0-4c37-a43d-84b5c103eebf (f2fdc88c-e824-4314-bd7d-df9b6902fade) [Transport endpoint is not connected]
  1396. [2015-09-22 07:09:52.282420] E [MSGID: 114031] [client-rpc-fops.c:1727:client3_3_entrylk_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1397. [2015-09-22 07:09:52.282459] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: /a7883778-47a0-4c37-a43d-84b5c103eebf/images (cda425e2-d87f-4e83-841f-135b4620bb56) [Transport endpoint is not connected]
  1398. [2015-09-22 07:09:52.282729] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: (null) (00000000-0000-0000-0000-000000000000) [Transport endpoint is not connected]
  1399. [2015-09-22 07:09:52.283267] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(LOOKUP(27)) called at 2015-09-22 07:09:09.272335 (xid=0x5f16eb)
  1400. [2015-09-22 07:09:52.283328] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: /a7883778-47a0-4c37-a43d-84b5c103eebf (f2fdc88c-e824-4314-bd7d-df9b6902fade) [Transport endpoint is not connected]
  1401. [2015-09-22 07:09:52.285551] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: (null) (00000000-0000-0000-0000-000000000000) [Transport endpoint is not connected]
  1402. [2015-09-22 07:09:52.285613] E [MSGID: 114031] [client-rpc-fops.c:1727:client3_3_entrylk_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1403. [2015-09-22 07:09:52.285721] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: (null) (00000000-0000-0000-0000-000000000000) [Transport endpoint is not connected]
  1404. [2015-09-22 07:09:52.286326] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(LOOKUP(27)) called at 2015-09-22 07:09:09.272620 (xid=0x5f16ec)
  1405. [2015-09-22 07:09:52.285736] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: (null) (00000000-0000-0000-0000-000000000000) [Transport endpoint is not connected]
  1406. [2015-09-22 07:09:52.286369] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: /a7883778-47a0-4c37-a43d-84b5c103eebf (f2fdc88c-e824-4314-bd7d-df9b6902fade) [Transport endpoint is not connected]
  1407. [2015-09-22 07:09:52.286510] E [MSGID: 114031] [client-rpc-fops.c:1727:client3_3_entrylk_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1408. [2015-09-22 07:09:52.287059] E [MSGID: 114031] [client-rpc-fops.c:1727:client3_3_entrylk_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1409. [2015-09-22 07:09:52.287061] W [MSGID: 114031] [client-rpc-fops.c:842:client3_3_statfs_cbk] 0-vmstore-client-0: remote operation failed [Transport endpoint is not connected]
  1410. [2015-09-22 07:09:52.287175] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: (null) (00000000-0000-0000-0000-000000000000) [Transport endpoint is not connected]
  1411. [2015-09-22 07:09:52.287486] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: / (00000000-0000-0000-0000-000000000001) [Transport endpoint is not connected]
  1412. [2015-09-22 07:09:52.287643] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: (null) (00000000-0000-0000-0000-000000000000) [Transport endpoint is not connected]
  1413. [2015-09-22 07:09:52.287812] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: / (00000000-0000-0000-0000-000000000001) [Transport endpoint is not connected]
  1414. [2015-09-22 07:09:52.288358] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: /a7883778-47a0-4c37-a43d-84b5c103eebf/images (cda425e2-d87f-4e83-841f-135b4620bb56) [Transport endpoint is not connected]
  1415. [2015-09-22 07:09:52.288387] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: / (00000000-0000-0000-0000-000000000001) [Transport endpoint is not connected]
  1416. [2015-09-22 07:09:52.288526] I [MSGID: 108031] [afr-common.c:1745:afr_local_discovery_cbk] 0-vmstore-replicate-0: selecting local read_child vmstore-client-2
  1417. [2015-09-22 07:09:52.288592] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: /a7883778-47a0-4c37-a43d-84b5c103eebf/images (cda425e2-d87f-4e83-841f-135b4620bb56) [Transport endpoint is not connected]
  1418. [2015-09-22 07:09:52.288732] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: (null) (00000000-0000-0000-0000-000000000000) [Transport endpoint is not connected]
  1419. [2015-09-22 07:09:52.289138] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GF-DUMP) op(NULL(2)) called at 2015-09-22 07:09:09.272636 (xid=0x5f16ed)
  1420. [2015-09-22 07:09:52.289164] W [rpc-clnt-ping.c:204:rpc_clnt_ping_cbk] 0-vmstore-client-0: socket disconnected
  1421. [2015-09-22 07:09:52.289883] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(LOOKUP(27)) called at 2015-09-22 07:09:09.272786 (xid=0x5f16ee)
  1422. [2015-09-22 07:09:52.288966] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: (null) (00000000-0000-0000-0000-000000000000) [Transport endpoint is not connected]
  1423. [2015-09-22 07:09:52.289928] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: /a7883778-47a0-4c37-a43d-84b5c103eebf (f2fdc88c-e824-4314-bd7d-df9b6902fade) [Transport endpoint is not connected]
  1424. [2015-09-22 07:09:52.290540] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: (null) (00000000-0000-0000-0000-000000000000) [Transport endpoint is not connected]
  1425. [2015-09-22 07:09:52.290897] E [rpc-clnt.c:362:saved_frames_unwind] (--> /lib64/libglusterfs.so.0(_gf_log_callingfn+0x196)[0x7f9da13e89e6] (--> /lib64/libgfrpc.so.0(saved_frames_unwind+0x1de)[0x7f9da11b39be] (--> /lib64/libgfrpc.so.0(saved_frames_destroy+0xe)[0x7f9da11b3ace] (--> /lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0x9c)[0x7f9da11b547c] (--> /lib64/libgfrpc.so.0(rpc_clnt_notify+0x48)[0x7f9da11b5c38] ))))) 0-vmstore-client-0: forced unwinding frame type(GlusterFS 3.3) op(LOOKUP(27)) called at 2015-09-22 07:09:09.272956 (xid=0x5f16ef)
  1426. [2015-09-22 07:09:52.290938] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: /a7883778-47a0-4c37-a43d-84b5c103eebf (f2fdc88c-e824-4314-bd7d-df9b6902fade) [Transport endpoint is not connected]
  1427. [2015-09-22 07:09:52.291524] W [MSGID: 108001] [afr-common.c:4043:afr_notify] 0-vmstore-replicate-0: Client-quorum is not met
  1428. [2015-09-22 07:09:52.293938] W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: (null) (00000000-0000-0000-0000-000000000000) [Transport endpoint is not connected]
  1429. [2015-09-22 07:09:54.280613] I [rpc-clnt.c:1819:rpc_clnt_reconfig] 0-vmstore-client-1: changing port to 49152 (from 0)
  1430. [2015-09-22 07:09:54.286461] E [socket.c:2332:socket_connect_finish] 0-vmstore-client-1: connection to 10.70.40.13:49152 failed (Connection refused)
  1431. [2015-09-22 07:09:58.285686] I [rpc-clnt.c:1819:rpc_clnt_reconfig] 0-vmstore-client-1: changing port to 49152 (from 0)
  1432. [2015-09-22 07:09:58.290488] E [socket.c:2332:socket_connect_finish] 0-vmstore-client-1: connection to 10.70.40.13:49152 failed (Connection refused)
  1433. The message "W [MSGID: 114031] [client-rpc-fops.c:2971:client3_3_lookup_cbk] 0-vmstore-client-0: remote operation failed. Path: (null) (00000000-0000-0000-0000-000000000000) [Transport endpoint is not connected]" repeated 4 times between [2015-09-22 07:09:52.293938] and [2015-09-22 07:09:52.295688]
  1434. [2015-09-22 07:09:59.025130] I [MSGID: 108031] [afr-common.c:1745:afr_local_discovery_cbk] 0-vmstore-replicate-0: selecting local read_child vmstore-client-2
  1435. [2015-09-22 07:09:59.058408] W [fuse-bridge.c:2240:fuse_writev_cbk] 0-glusterfs-fuse: 5292804: WRITE => -1 (Read-only file system)
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement