API tools faq
paste
Advertisement
Guest User

Untitled

a guest
Mar 15th, 2017
189
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 10.54 KB | None | 0 0
raw download clone embed print report
  1. $ stat /mnt/sieczka2/eodata-dev6.997
  2. stat: cannot stat '/mnt/sieczka2/eodata-dev6.997': Input/output error
  3.  
  4. nfs.log:
  5. [2017-03-15 15:32:45.656080] D [MSGID: 0] [nfs3-helpers.c:1660:nfs3_log_fh_entry_call] 0-nfs-nfsv3: XID: 3827081a, LOOKUP: args: FH: exportid 39ea64e4-241d-4bb2-81a2-e8fddaf4ceaf, gfid e6826053-ce19-45e6-bd46-27f371d04eab, mountid cc704761-0000-0000-0000-000000000000, name: eodata-dev6.997
  6. [2017-03-15 15:32:45.656517] D [MSGID: 0] [dht-common.c:2695:dht_lookup] 0-zupa-dht: Calling fresh lookup for <gfid:e6826053-ce19-45e6-bd46-27f371d04eab>/eodata-dev6.997 on zupa-readdir-ahead-0
  7. [2017-03-15 15:32:45.659044] D [MSGID: 0] [dht-common.c:2280:dht_lookup_cbk] 0-zupa-dht: fresh_lookup returned for <gfid:e6826053-ce19-45e6-bd46-27f371d04eab>/eodata-dev6.997 with op_ret 0
  8. [2017-03-15 15:32:45.659128] I [MSGID: 109045] [dht-common.c:2388:dht_lookup_cbk] 0-zupa-dht: linkfile not having link subvol for <gfid:e6826053-ce19-45e6-bd46-27f371d04eab>/eodata-dev6.997
  9. [2017-03-15 15:32:45.659156] D [MSGID: 0] [dht-common.c:2392:dht_lookup_cbk] 0-zupa-dht: linkfile not having link subvolume. path=<gfid:e6826053-ce19-45e6-bd46-27f371d04eab>/eodata-dev6.997
  10. [2017-03-15 15:32:45.659192] D [MSGID: 0] [dht-common.c:2064:dht_lookup_everywhere] 0-zupa-dht: winding lookup call to 2 subvols
  11. [2017-03-15 15:32:45.660946] D [MSGID: 0] [dht-common.c:1866:dht_lookup_everywhere_cbk] 0-zupa-dht: returned with op_ret 0 and op_errno 0 (<gfid:e6826053-ce19-45e6-bd46-27f371d04eab>/eodata-dev6.997) from subvol zupa-readdir-ahead-0
  12. [2017-03-15 15:32:45.661030] D [MSGID: 0] [dht-common.c:1899:dht_lookup_everywhere_cbk] 0-zupa-dht: found on zupa-readdir-ahead-0 linkfile <gfid:e6826053-ce19-45e6-bd46-27f371d04eab>/eodata-dev6.997 (-> '')
  13. [2017-03-15 15:32:45.661132] D [MSGID: 0] [dht-common.c:1980:dht_lookup_everywhere_cbk] 0-zupa-dht: Found one linkto file on hashed subvol zupa-readdir-ahead-0 for <gfid:e6826053-ce19-45e6-bd46-27f371d04eab>/eodata-dev6.997: Skipping unlinking till everywhere_done
  14. [2017-03-15 15:32:45.662679] D [MSGID: 0] [dht-common.c:1866:dht_lookup_everywhere_cbk] 0-zupa-dht: returned with op_ret 0 and op_errno 0 (<gfid:e6826053-ce19-45e6-bd46-27f371d04eab>/eodata-dev6.997) from subvol zupa-readdir-ahead-1
  15. [2017-03-15 15:32:45.662781] D [MSGID: 0] [dht-common.c:1921:dht_lookup_everywhere_cbk] 0-zupa-dht: found cached file on zupa-readdir-ahead-1 for <gfid:e6826053-ce19-45e6-bd46-27f371d04eab>/eodata-dev6.997
  16. [2017-03-15 15:32:45.663007] D [MSGID: 0] [dht-common.c:1932:dht_lookup_everywhere_cbk] 0-zupa-dht: storing cached on zupa-readdir-ahead-1 file <gfid:e6826053-ce19-45e6-bd46-27f371d04eab>/eodata-dev6.997
  17. [2017-03-15 15:32:45.663052] D [MSGID: 0] [dht-common.c:1531:dht_lookup_everywhere_done] 0-zupa-dht: STATUS: hashed_subvol zupa-readdir-ahead-0 cached_subvol zupa-readdir-ahead-1
  18. [2017-03-15 15:32:45.663072] D [MSGID: 0] [dht-common.c:1690:dht_lookup_everywhere_done] 0-zupa-dht: Linkto file found on hashed subvol and data file found on cached subvolume. But linkto points to different cached subvolume ( <nil>) path <gfid:e6826053-ce19-45e6-bd46-27f371d04eab>/eodata-dev6.997
  19. [2017-03-15 15:32:45.664950] W [MSGID: 114031] [client-rpc-fops.c:628:client3_3_unlink_cbk] 0-zupa-client-0: remote operation failed [Permission denied]
  20. [2017-03-15 15:32:45.665036] D [MSGID: 0] [client-rpc-fops.c:634:client3_3_unlink_cbk] 0-stack-trace: stack-address: 0x7ff340000b60, zupa-client-0 returned -1 error: Permission denied [Permission denied]
  21. [2017-03-15 15:32:45.665063] I [MSGID: 109069] [dht-common.c:1350:dht_lookup_unlink_of_false_linkto_cbk] 0-zupa-dht: lookup_unlink returned with op_ret -> -1 and op-errno -> 13 for <gfid:e6826053-ce19-45e6-bd46-27f371d04eab>/eodata-dev6.997
  22. [2017-03-15 15:32:45.665086] D [MSGID: 0] [dht-common.c:1381:dht_lookup_unlink_of_false_linkto_cbk] 0-stack-trace: stack-address: 0x7ff340000b60, zupa-dht returned -1 error: Input/output error [Input/output error]
  23. [2017-03-15 15:32:45.665151] D [MSGID: 0] [write-behind.c:2392:wb_lookup_cbk] 0-stack-trace: stack-address: 0x7ff340000b60, zupa-write-behind returned -1 error: Input/output error [Input/output error]
  24. [2017-03-15 15:32:45.665184] D [MSGID: 0] [io-cache.c:256:ioc_lookup_cbk] 0-stack-trace: stack-address: 0x7ff340000b60, zupa-io-cache returned -1 error: Input/output error [Input/output error]
  25. [2017-03-15 15:32:45.665215] D [MSGID: 0] [quick-read.c:447:qr_lookup_cbk] 0-stack-trace: stack-address: 0x7ff340000b60, zupa-quick-read returned -1 error: Input/output error [Input/output error]
  26. [2017-03-15 15:32:45.665272] D [MSGID: 0] [io-stats.c:2186:io_stats_lookup_cbk] 0-stack-trace: stack-address: 0x7ff340000b60, zupa returned -1 error: Input/output error [Input/output error]
  27. [2017-03-15 15:32:45.665339] W [MSGID: 112199] [nfs3-helpers.c:3515:nfs3_log_newfh_res] 0-nfs-nfsv3: <gfid:e6826053-ce19-45e6-bd46-27f371d04eab>/eodata-dev6.997 => (XID: 3827081a, LOOKUP: NFS: 5(I/O error), POSIX: 5(Input/output error)), FH: exportid 00000000-0000-0000-0000-000000000000, gfid 00000000-0000-0000-0000-000000000000, mountid 00000000-0000-0000-0000-000000000000
  28.  
  29. zfs-eo-brick.log:
  30. [2017-03-15 15:32:45.656315] D [client_t.c:328:gf_client_ref] (-->/usr/lib/x86_64-linux-gnu/glusterfs/3.10.0/xlator/protocol/server.so(+0x2d2cf) [0x7fb0c6b042cf] -->/usr/lib/x86_64-linux-gnu/glusterfs/3.10.0/xlator/protocol/server.so(+0xcde0) [0x7fb0c6ae3de0] -->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(gf_client_ref+0x55) [0x7fb0d3f3c625] ) 0-client_t: eodata-dev6.int.cfr-27140-2017/03/14-16:12:15:246976-zupa-client-0-0-0: ref-count 2
  31. [2017-03-15 15:32:45.657472] D [client_t.c:433:gf_client_unref] (-->/usr/lib/x86_64-linux-gnu/glusterfs/3.10.0/xlator/protocol/server.so(+0x2ca04) [0x7fb0c6b03a04] -->/usr/lib/x86_64-linux-gnu/glusterfs/3.10.0/xlator/protocol/server.so(+0x8810) [0x7fb0c6adf810] -->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(gf_client_unref+0x6a) [0x7fb0d3f3c75a] ) 0-client_t: eodata-dev6.int.cfr-27140-2017/03/14-16:12:15:246976-zupa-client-0-0-0: ref-count 1
  32. [2017-03-15 15:32:45.658473] D [client_t.c:328:gf_client_ref] (-->/usr/lib/x86_64-linux-gnu/glusterfs/3.10.0/xlator/protocol/server.so(+0x2d2cf) [0x7fb0c6b042cf] -->/usr/lib/x86_64-linux-gnu/glusterfs/3.10.0/xlator/protocol/server.so(+0xcde0) [0x7fb0c6ae3de0] -->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(gf_client_ref+0x55) [0x7fb0d3f3c625] ) 0-client_t: eodata-dev6.int.cfr-27140-2017/03/14-16:12:15:246976-zupa-client-0-0-0: ref-count 2
  33. [2017-03-15 15:32:45.659431] D [client_t.c:433:gf_client_unref] (-->/usr/lib/x86_64-linux-gnu/glusterfs/3.10.0/xlator/protocol/server.so(+0x2ca04) [0x7fb0c6b03a04] -->/usr/lib/x86_64-linux-gnu/glusterfs/3.10.0/xlator/protocol/server.so(+0x8810) [0x7fb0c6adf810] -->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(gf_client_unref+0x6a) [0x7fb0d3f3c75a] ) 0-client_t: eodata-dev6.int.cfr-27140-2017/03/14-16:12:15:246976-zupa-client-0-0-0: ref-count 1
  34. [2017-03-15 15:32:45.662386] D [client_t.c:328:gf_client_ref] (-->/usr/lib/x86_64-linux-gnu/glusterfs/3.10.0/xlator/protocol/server.so(+0x29ff0) [0x7fb0c6b00ff0] -->/usr/lib/x86_64-linux-gnu/glusterfs/3.10.0/xlator/protocol/server.so(+0xcde0) [0x7fb0c6ae3de0] -->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(gf_client_ref+0x55) [0x7fb0d3f3c625] ) 0-client_t: eodata-dev6.int.cfr-27140-2017/03/14-16:12:15:246976-zupa-client-0-0-0: ref-count 2
  35. [2017-03-15 15:32:45.662533] D [logging.c:1952:_gf_msg_internal] 0-logging-infra: Buffer overflow of a buffer whose size limit is 5. About to flush least recently used log message to disk
  36. The message "D [MSGID: 0] [io-threads.c:356:iot_schedule] 0-zupa-io-threads: LOOKUP scheduled as fast fop" repeated 3 times between [2017-03-15 15:32:36.645654] and [2017-03-15 15:32:45.658729]
  37. [2017-03-15 15:32:45.662531] D [MSGID: 0] [io-threads.c:356:iot_schedule] 0-zupa-io-threads: UNLINK scheduled as normal fop
  38. [2017-03-15 15:32:45.662727] I [MSGID: 139001] [posix-acl.c:265:posix_acl_log_permit_denied] 0-zupa-access-control: client: eodata-dev6.int.cfr-27140-2017/03/14-16:12:15:246976-zupa-client-0-0-0, gfid: e6826053-ce19-45e6-bd46-27f371d04eab, req(uid:1000,gid:1000,perm:3,ngrps:9), ctx(uid:0,gid:0,in-groups:0,perm:755,updated-fop:LOOKUP, acl:-) [Permission denied]
  39. [2017-03-15 15:32:45.662792] D [MSGID: 0] [posix-acl.c:1563:posix_acl_unlink] 0-stack-trace: stack-address: 0x7fb08c018550, zupa-access-control returned -1 error: Permission denied [Permission denied]
  40. [2017-03-15 15:32:45.662823] D [MSGID: 0] [posix.c:3912:pl_unlink_cbk] 0-stack-trace: stack-address: 0x7fb08c018550, zupa-locks returned -1 error: Permission denied [Permission denied]
  41. [2017-03-15 15:32:45.662849] D [MSGID: 0] [leases.c:434:leases_unlink_cbk] 0-stack-trace: stack-address: 0x7fb08c018550, zupa-leases returned -1 error: Permission denied [Permission denied]
  42. [2017-03-15 15:32:45.662909] D [MSGID: 0] [upcall.c:469:up_unlink_cbk] 0-stack-trace: stack-address: 0x7fb08c018550, zupa-upcall returned -1 error: Permission denied [Permission denied]
  43. [2017-03-15 15:32:45.662957] D [MSGID: 0] [defaults.c:1465:default_unlink_cbk] 0-stack-trace: stack-address: 0x7fb08c018550, zupa-io-threads returned -1 error: Permission denied [Permission denied]
  44. [2017-03-15 15:32:45.662985] D [MSGID: 0] [marker.c:1108:marker_unlink_cbk] 0-stack-trace: stack-address: 0x7fb08c018550, zupa-marker returned -1 error: Permission denied [Permission denied]
  45. [2017-03-15 15:32:45.663012] D [MSGID: 0] [barrier.c:230:barrier_unlink_cbk] 0-stack-trace: stack-address: 0x7fb08c018550, zupa-barrier returned -1 error: Permission denied [Permission denied]
  46. [2017-03-15 15:32:45.663066] D [MSGID: 0] [defaults.c:1465:default_unlink_cbk] 0-stack-trace: stack-address: 0x7fb08c018550, zupa-index returned -1 error: Permission denied [Permission denied]
  47. [2017-03-15 15:32:45.663181] D [MSGID: 0] [io-stats.c:2147:io_stats_unlink_cbk] 0-stack-trace: stack-address: 0x7fb08c018550, zupa-io-stats returned -1 error: Permission denied [Permission denied]
  48. [2017-03-15 15:32:45.663266] E [MSGID: 115062] [server-rpc-fops.c:1064:server_unlink_cbk] 0-zupa-server: 86: UNLINK <gfid:e6826053-ce19-45e6-bd46-27f371d04eab>/eodata-dev6.997 (e6826053-ce19-45e6-bd46-27f371d04eab/eodata-dev6.997), client: eodata-dev6.int.cfr-27140-2017/03/14-16:12:15:246976-zupa-client-0-0-0, error-xlator: zupa-access-control [Permission denied]
  49. [2017-03-15 15:32:45.663468] D [client_t.c:433:gf_client_unref] (-->/usr/lib/x86_64-linux-gnu/glusterfs/3.10.0/xlator/protocol/server.so(+0x1bf45) [0x7fb0c6af2f45] -->/usr/lib/x86_64-linux-gnu/glusterfs/3.10.0/xlator/protocol/server.so(+0x8810) [0x7fb0c6adf810] -->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(gf_client_unref+0x6a) [0x7fb0d3f3c75a] ) 0-client_t: eodata-dev6.int.cfr-27140-2017/03/14-16:12:15:246976-zupa-client-0-0-0: ref-count 1
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!