[2012-06-03 02:15:51.443152] C [client-handshake.c:126:rpc_client_ping_timer_expired] 0-svn-client-1: server 10.250.53.252:24016 has not responded in the last 5 seconds, disconnecting.
[2012-06-03 02:15:51.443429] E [rpc-clnt.c:373:saved_frames_unwind] (-->/usr/lib64/libgfrpc.so.0(rpc_clnt_notify+0x78) [0x7f731a1c37e8] (-->/usr/lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0xb0) [0x7f731a1c34a0] (-->/usr/lib64/libgfrpc.so.0(saved_frames_destroy+0xe) [0x7f731a1c2f0e]))) 0-svn-client-1: forced unwinding frame type(GlusterFS 3.1) op(ACCESS(22)) called at 2012-06-03 02:15:46.164112 (xid=0x71220x)
[2012-06-03 02:15:51.443448] W [client3_1-fops.c:1332:client3_1_access_cbk] 0-svn-client-1: remote operation failed: Transport endpoint is not connected
[2012-06-03 02:15:51.443533] E [rpc-clnt.c:373:saved_frames_unwind] (-->/usr/lib64/libgfrpc.so.0(rpc_clnt_notify+0x78) [0x7f731a1c37e8] (-->/usr/lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0xb0) [0x7f731a1c34a0] (-->/usr/lib64/libgfrpc.so.0(saved_frames_destroy+0xe) [0x7f731a1c2f0e]))) 0-svn-client-1: forced unwinding frame type(GlusterFS Handshake) op(PING(3)) called at 2012-06-03 02:15:46.164129 (xid=0x71221x)
[2012-06-03 02:15:51.443561] W [client-handshake.c:275:client_ping_cbk] 0-svn-client-1: timer must have expired
[2012-06-03 02:15:51.443577] I [client.c:2090:client_rpc_notify] 0-svn-client-1: disconnected
[2012-06-03 02:15:57.444177] C [client-handshake.c:126:rpc_client_ping_timer_expired] 0-svn-client-0: server 10.250.53.251:24016 has not responded in the last 5 seconds, disconnecting.
[2012-06-03 02:15:57.444322] E [rpc-clnt.c:373:saved_frames_unwind] (-->/usr/lib64/libgfrpc.so.0(rpc_clnt_notify+0x78) [0x7f731a1c37e8] (-->/usr/lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0xb0) [0x7f731a1c34a0] (-->/usr/lib64/libgfrpc.so.0(saved_frames_destroy+0xe) [0x7f731a1c2f0e]))) 0-svn-client-0: forced unwinding frame type(GlusterFS 3.1) op(LOOKUP(27)) called at 2012-06-03 02:15:51.444219 (xid=0x59627x)
[2012-06-03 02:15:57.444354] W [client3_1-fops.c:2630:client3_1_lookup_cbk] 0-svn-client-0: remote operation failed: Transport endpoint is not connected. Path: /etc (af2df49f-2865-4bc8-a0dc-39a382eb97bf)
[2012-06-03 02:15:57.444456] E [rpc-clnt.c:373:saved_frames_unwind] (-->/usr/lib64/libgfrpc.so.0(rpc_clnt_notify+0x78) [0x7f731a1c37e8] (-->/usr/lib64/libgfrpc.so.0(rpc_clnt_connection_cleanup+0xb0) [0x7f731a1c34a0] (-->/usr/lib64/libgfrpc.so.0(saved_frames_destroy+0xe) [0x7f731a1c2f0e]))) 0-svn-client-0: forced unwinding frame type(GlusterFS Handshake) op(PING(3)) called at 2012-06-03 02:15:51.444232 (xid=0x59628x)
[2012-06-03 02:15:57.444470] W [client-handshake.c:275:client_ping_cbk] 0-svn-client-0: timer must have expired
[2012-06-03 02:15:57.444478] I [client.c:2090:client_rpc_notify] 0-svn-client-0: disconnected
[2012-06-03 02:16:27.451514] E [socket.c:1715:socket_connect_finish] 0-svn-client-1: connection to 10.250.53.252:24016 failed (Connection timed out)
[2012-06-03 02:16:33.464598] E [socket.c:1715:socket_connect_finish] 0-svn-client-0: connection to 10.250.53.251:24016 failed (Connection timed out)
[2012-06-03 02:17:46.628693] I [client-handshake.c:1636:select_server_supported_programs] 0-svn-client-1: Using Program GlusterFS 3.3.0, Num (1298437), Version (330)
[2012-06-03 02:17:46.633856] I [client-handshake.c:1433:client_setvolume_cbk] 0-svn-client-1: Connected to 10.250.53.252:24016, attached to remote volume '/gluster/svn'.
[2012-06-03 02:17:46.633884] I [client-handshake.c:1445:client_setvolume_cbk] 0-svn-client-1: Server and Client lk-version numbers are not same, reopening the fds
[2012-06-03 02:17:46.638958] I [client-handshake.c:453:client_set_lk_version_cbk] 0-svn-client-1: Server lk version = 1
[2012-06-03 02:17:47.651361] I [client-handshake.c:1636:select_server_supported_programs] 0-svn-client-0: Using Program GlusterFS 3.3.0, Num (1298437), Version (330)
[2012-06-03 02:17:47.656608] I [client-handshake.c:1433:client_setvolume_cbk] 0-svn-client-0: Connected to 10.250.53.251:24016, attached to remote volume '/gluster/svn'.
[2012-06-03 02:17:47.656622] I [client-handshake.c:1445:client_setvolume_cbk] 0-svn-client-0: Server and Client lk-version numbers are not same, reopening the fds
[2012-06-03 02:17:47.661507] I [client-handshake.c:453:client_set_lk_version_cbk] 0-svn-client-0: Server lk version = 1