API tools faq
paste
Advertisement
Guest User

Increased chunk size (32M) and limit transactions/sec to 3

a guest
Jul 26th, 2018
71
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 6.43 KB | None | 0 0
raw download clone embed print report
  1. $ rclone copy gcache-test:vietnam.mkv . --tpslimit 3 -v
  2. 2018/07/26 22:20:05 DEBUG : rclone: Version "v1.42" starting with parameters ["rclone" "-v" "copy" "gcache-test:vietnam.mkv" "." "--tpslimit" "3" "-v"]
  3. 2018/07/26 22:20:05 DEBUG : Using config file from "/home/kunio/.config/rclone/rclone.conf"
  4. 2018/07/26 22:20:05 INFO : Starting HTTP transaction limiter: max 3 transactions/s with burst 1
  5. 2018/07/26 22:20:05 DEBUG : pacer: Rate limited, sleeping for 1.998722935s (1 consecutive low level retries)
  6. 2018/07/26 22:20:05 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
  7. 2018/07/26 22:20:06 DEBUG : pacer: Resetting sleep to minimum 10ms on success
  8. 2018/07/26 22:20:08 DEBUG : gcache: wrapped gdrive:test at root test/vietnam.mkv
  9. 2018/07/26 22:20:08 INFO : gcache: Cache DB path: /home/kunio/.cache/rclone/cache-backend/gcache.db
  10. 2018/07/26 22:20:08 INFO : gcache: Cache chunk path: /home/kunio/.cache/rclone/cache-backend/gcache
  11. 2018/07/26 22:20:08 INFO : gcache: Chunk Memory: true
  12. 2018/07/26 22:20:08 INFO : gcache: Chunk Size: 32M
  13. 2018/07/26 22:20:08 INFO : gcache: Chunk Total Size: 2G
  14. 2018/07/26 22:20:08 INFO : gcache: Chunk Clean Interval: 1m0s
  15. 2018/07/26 22:20:08 INFO : gcache: Workers: 4
  16. 2018/07/26 22:20:08 INFO : gcache: File Age: 6h0m0s
  17. 2018/07/26 22:20:08 DEBUG : Adding path "cache/expire" to remote control registry
  18. 2018/07/26 22:20:08 DEBUG : Adding path "cache/stats" to remote control registry
  19. 2018/07/26 22:20:08 DEBUG : Cache remote gcache:test: new object 'vietnam.mkv'
  20. 2018/07/26 22:20:08 DEBUG : vietnam.mkv: find: error: couldn't open parent bucket for test
  21. 2018/07/26 22:20:09 DEBUG : Google drive root 'test': Checking for changes on remote
  22. 2018/07/26 22:20:09 DEBUG : vietnam.mkv: find: cached object
  23. 2018/07/26 22:20:09 DEBUG : vietnam.mkv: Couldn't find file - need to transfer
  24. 2018/07/26 22:20:09 DEBUG : Google drive root 'test': All changes were processed. Waiting for more.
  25. 2018/07/26 22:20:10 DEBUG : test/vietnam.mkv: moving offset set from 0 to 0
  26. 2018/07/26 22:20:10 DEBUG : test/vietnam.mkv: 0: chunk retry storage: 0
  27. 2018/07/26 22:20:10 DEBUG : test/vietnam.mkv: 0: chunk retry storage: 1
  28. 2018/07/26 22:20:11 DEBUG : worker-2 <vietnam.mkv>: downloaded chunk 67108864
  29. 2018/07/26 22:20:11 DEBUG : test/vietnam.mkv: 0: chunk retry storage: 2
  30. 2018/07/26 22:20:11 DEBUG : test/vietnam.mkv: 0: chunk retry storage: 3
  31. 2018/07/26 22:20:11 DEBUG : worker-0 <vietnam.mkv>: downloaded chunk 0
  32. 2018/07/26 22:20:12 DEBUG : worker-3 <vietnam.mkv>: downloaded chunk 100663296
  33. 2018/07/26 22:20:12 DEBUG : worker-1 <vietnam.mkv>: downloaded chunk 33554432
  34. 2018/07/26 22:20:12 DEBUG : test/vietnam.mkv: 134217728: chunk retry storage: 0
  35. 2018/07/26 22:20:13 DEBUG : test/vietnam.mkv: 134217728: chunk retry storage: 1
  36. 2018/07/26 22:20:13 DEBUG : worker-2 <vietnam.mkv>: downloaded chunk 134217728
  37. 2018/07/26 22:20:13 DEBUG : test/vietnam.mkv: 167772160: chunk retry storage: 0
  38. 2018/07/26 22:20:13 DEBUG : worker-0 <vietnam.mkv>: downloaded chunk 167772160
  39. 2018/07/26 22:20:13 DEBUG : worker-3 <vietnam.mkv>: downloaded chunk 201326592
  40. 2018/07/26 22:20:14 DEBUG : test/vietnam.mkv: 234881024: chunk retry storage: 0
  41. 2018/07/26 22:20:14 DEBUG : worker-2 <vietnam.mkv>: downloaded chunk 268435456
  42. 2018/07/26 22:20:14 DEBUG : test/vietnam.mkv: 234881024: chunk retry storage: 1
  43. 2018/07/26 22:20:15 DEBUG : pacer: Rate limited, sleeping for 1.377197343s (1 consecutive low level retries)
  44. 2018/07/26 22:20:15 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
  45. 2018/07/26 22:20:15 DEBUG : pacer: Rate limited, sleeping for 2.260173064s (2 consecutive low level retries)
  46. 2018/07/26 22:20:15 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
  47. 2018/07/26 22:20:15 DEBUG : pacer: Rate limited, sleeping for 4.691948514s (3 consecutive low level retries)
  48. 2018/07/26 22:20:15 DEBUG : pacer: low level retry 2/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
  49. 2018/07/26 22:20:15 DEBUG : test/vietnam.mkv: 234881024: chunk retry storage: 2
  50. 2018/07/26 22:20:15 DEBUG : worker-3 <vietnam.mkv>: downloaded chunk 335544320
  51. 2018/07/26 22:20:15 DEBUG : test/vietnam.mkv: 234881024: chunk retry storage: 3
  52. 2018/07/26 22:20:16 DEBUG : test/vietnam.mkv: 234881024: chunk retry storage: 4
  53. 2018/07/26 22:20:16 DEBUG : test/vietnam.mkv: 234881024: chunk retry storage: 5
  54. 2018/07/26 22:20:16 DEBUG : pacer: Resetting sleep to minimum 10ms on success
  55. 2018/07/26 22:20:17 DEBUG : worker-0 <vietnam.mkv>: downloaded chunk 301989888
  56. 2018/07/26 22:20:17 DEBUG : test/vietnam.mkv: 234881024: chunk retry storage: 6
  57. 2018/07/26 22:20:17 DEBUG : test/vietnam.mkv: 234881024: chunk retry storage: 7
  58. 2018/07/26 22:20:18 DEBUG : test/vietnam.mkv: 234881024: chunk retry storage: 8
  59. 2018/07/26 22:20:18 DEBUG : test/vietnam.mkv: 234881024: chunk retry storage: 9
  60. 2018/07/26 22:20:19 DEBUG : test/vietnam.mkv: 234881024: chunk retry storage: 10
  61. 2018/07/26 22:20:19 DEBUG : test/vietnam.mkv: 234881024: chunk retry storage: 11
  62. 2018/07/26 22:20:20 DEBUG : test/vietnam.mkv: 234881024: chunk retry storage: 12
  63. 2018/07/26 22:20:20 DEBUG : test/vietnam.mkv: 234881024: chunk retry storage: 13
  64. 2018/07/26 22:20:21 DEBUG : test/vietnam.mkv: 234881024: chunk retry storage: 14
  65. 2018/07/26 22:20:21 DEBUG : test/vietnam.mkv: 234881024: chunk retry storage: 15
  66. 2018/07/26 22:20:21 DEBUG : worker-1 <vietnam.mkv>: downloaded chunk 234881024
  67. 2018/07/26 22:20:22 DEBUG : test/vietnam.mkv: 369098752: chunk retry storage: 0
  68. 2018/07/26 22:20:22 DEBUG : test/vietnam.mkv: 369098752: chunk retry storage: 1
  69. 2018/07/26 22:20:23 DEBUG : worker-3 <vietnam.mkv>: partial downloaded chunk 384M
  70. 2018/07/26 22:20:23 DEBUG : worker-2 <vietnam.mkv>: downloaded chunk 369098752
  71. 2018/07/26 22:20:24 DEBUG : test/vietnam.mkv: cache reader closed 409285384
  72. 2018/07/26 22:20:24 DEBUG : vietnam.mkv: object hash cached: 57f79a8e5ab038df25c80a7bbc8f9a70
  73. 2018/07/26 22:20:24 INFO : vietnam.mkv: Copied (new)
  74. 2018/07/26 22:20:24 INFO :
  75. Transferred: 390.325 MBytes (20.822 MBytes/s)
  76. Errors: 0
  77. Checks: 0
  78. Transferred: 1
  79. Elapsed time: 18.7s
  80.  
  81. 2018/07/26 22:20:24 DEBUG : 16 go routines active
  82. 2018/07/26 22:20:24 DEBUG : rclone: Version "v1.42" finishing with parameters ["rclone" "-v" "copy" "gcache-test:vietnam.mkv" "." "--tpslimit" "3" "-v"]
  83. 2018/07/26 22:20:24 DEBUG : Cache remote gcache:test: Services stopped
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!