Guest User

Untitled

a guest
Jan 22nd, 2018
58
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 1.32 KB | None | 0 0
  1. user@machine:~/path/to/input$ find
  2. ./filename.yyyy-mm-dd-hh.machinename.gz
  3. ./filename.2016-12-10-08.machinename.gz
  4. ./filename.2015-12-10-08.machinename.gz
  5. ./filename.2015-10-10-08.machinename.gz
  6. ./filename.2015-10-11-08.machinename.gz
  7.  
  8. user@machine:~/path/to/input$ ls | awk -F"." '{print $1" "$2" "$3" "$4}' | awk -F"-" '{print $1" "$2" "$3" "$4" "$5" "$6" "$7}' | awk -F" " '{PATH=$2"/"$3"/"$4"/"$5; FNAME=$1"."$2"-"$3"-"$4"-"$5"."$6"."$7; system("mkdir -p "PATH); system("cp "FNAME" "PATH); }'
  9.  
  10. ./filename.yyyy-mm-dd-hh.machinename.gz
  11. ./yyyy
  12. ./yyyy/mm
  13. ./yyyy/mm/dd
  14. ./yyyy/mm/dd/hh
  15. ./yyyy/mm/dd/hh/filename.yyyy-mm-dd-hh.machinename.gz
  16.  
  17. ./filename.2016-12-10-08.machinename.gz
  18. ./2016
  19. ./2016/12
  20. ./2016/12/10
  21. ./2016/12/10/08
  22. ./2016/12/10/08/filename.2016-12-10-08.machinename.gz
  23.  
  24. ./filename.2015-12-10-08.machinename.gz
  25. ./2015
  26. ./2015/12
  27. ./2015/12/10
  28. ./2015/12/10/08
  29. ./2015/12/10/08/filename.2015-12-10-08.machinename.gz
  30.  
  31. ./filename.2015-10-11-08.machinename.gz
  32. ./2015/10
  33. ./2015/10/11
  34. ./2015/10/11/08
  35. ./2015/10/11/08/filename.2015-10-11-08.machinename.gz
  36.  
  37. ./filename.2015-10-10-08.machinename.gz
  38. ./2015/10/10
  39. ./2015/10/10/08
  40. ./2015/10/10/08/filename.2015-10-10-08.machinename.gz
  41.  
  42. hadoop distcp filename.yyyy-mm-dd-hh.machinename.gz s3n://<bucket-name>/yyyy/mm/dd/hh/filename.yyyy-mm-dd-hh.machinename.gz
Add Comment
Please, Sign In to add comment