Advertisement
Guest User

Untitled

a guest
Jun 29th, 2018
162
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 22.89 KB | None | 0 0
  1. Jun 29 05:19:50 * Now talking on #500pieces
  2. Jun 29 05:19:50 * Topic for #500pieces is: https://500px.com/creativecommons shutting down. | Warrior project in 7 hours. | Resources needed! Spread the word.
  3. Jun 29 05:19:50 * Topic for #500pieces set by arkiver!~arkiver@2604:180:0:6e7::2 (Thu Jun 28 19:51:33 2018)
  4. Jun 29 05:20:32 <adinbied> AAARRGG I HATE WINDOWS UPDATE. Sigh, now to start getting things going...
  5. Jun 29 05:32:47 <ta9le> Trying to push the third instance out
  6. Jun 29 05:32:51 <ta9le> gonna take a while
  7. Jun 29 05:36:53 <ta9le> ...oh, fucking great, another thing to break without me knowing how it broke
  8. Jun 29 05:37:03 <ta9le> welp, this will take an even longer while then
  9. Jun 29 05:41:08 * jrwr has quit (Ping timeout: 257 seconds)
  10. Jun 29 05:42:20 * arkiver has quit (Ping timeout: 260 seconds)
  11. Jun 29 05:42:54 * HCross has quit (Ping timeout: 260 seconds)
  12. Jun 29 05:44:02 * odemg has quit (Ping timeout: 260 seconds)
  13. Jun 29 05:51:08 * arkiver (~arkiver@199.241.31.225) has joined
  14. Jun 29 05:57:59 <adinbied> https://archive.org/details/AttributionNoDerivativesLicense3APIServerResponses.7z
  15. Jun 29 05:59:46 <ta9le> Fucking what
  16. Jun 29 05:59:59 <ta9le> HOW DID MY DEBIAN SYSTEM BECOME READ-ONLY ALL OF A SUDDEN
  17. Jun 29 06:00:03 <adinbied> https://archive.org/details/AttributionShareAlikeLicense3APIServerResponses.7z
  18. Jun 29 06:00:51 <adinbied> @ta9le huh? Did a chmod go rogue?
  19. Jun 29 06:01:27 <ta9le> I have absolutely no idea, things just seem to randomly crap on me nowadays
  20. Jun 29 06:02:43 <atluxity> that might be a symptom of a deeper issue
  21. Jun 29 06:02:47 <atluxity> gl hf
  22. Jun 29 06:02:48 <ta9le> Welp, I've got only one instance surviving as of now, hope it goes fine
  23. Jun 29 06:02:59 <ta9le> Wait, gl hf?
  24. Jun 29 06:03:15 <adinbied> https://archive.org/details/AttributionNonCommercialLicense3APIServerResponses.7z
  25. Jun 29 06:03:29 <atluxity> ta9le: yes, good luck, have fun
  26. Jun 29 06:03:36 <ta9le> oh, nvm I'm dumb
  27. Jun 29 06:08:08 <adinbied> Added a few more of the API response IA URLS to the wiki page; will be afk for an hour or so, then I'll upload the rest of them
  28. Jun 29 06:09:40 <arkiver> I'm unfortunately away then
  29. Jun 29 06:09:52 <arkiver> I'll add good instructions to the repo on how to generate items
  30. Jun 29 06:14:13 * djsrv has quit (Quit: This computer has gone to sleep)
  31. Jun 29 06:15:17 * phuzion (~phuzion@45.55.90.225) has joined
  32. Jun 29 06:15:53 <phuzion> Did we already do discovery or is that phase one?
  33. Jun 29 06:16:32 <arkiver> discovery is being done by adinbien
  34. Jun 29 06:16:59 <phuzion> ok
  35. Jun 29 06:17:11 <phuzion> Got an ETA for when the grab's gonna start?
  36. Jun 29 06:17:21 <arkiver> already started
  37. Jun 29 06:17:26 <arkiver> https://tracker.archiveteam.org/500px/
  38. Jun 29 06:17:42 <phuzion> oh snap, alright
  39. Jun 29 06:17:46 <phuzion> let me grab scripts and get going
  40. Jun 29 06:18:04 <ta9le> ...yeah, it seems like my SD card for the third instance has gone basically unformattable
  41. Jun 29 06:18:28 <ta9le> after a week of it not being used in any way
  42. Jun 29 06:20:11 <phuzion> ta9le: amazon prime a new card?
  43. Jun 29 06:20:51 <ta9le> Nah, it's a Wasenda thing
  44. Jun 29 06:21:03 <ta9le> not really new, but it worked well enough before
  45. Jun 29 06:24:08 <ta9le> ...oh, right, I misunderstood the question; my allowances aren't really all that great for me to grab Prime
  46. Jun 29 06:34:06 <phuzion> ah gotcha
  47. Jun 29 06:34:12 <phuzion> I'm grabbing now, btw.
  48. Jun 29 06:35:56 <ta9le> Yay
  49. Jun 29 06:36:06 <ta9le> I'm reinstalling Xubuntu while we're at it
  50. Jun 29 06:39:19 <arkiver> I will be away in 30 minutes
  51. Jun 29 06:39:37 <arkiver> instructions on creating new item lists: https://github.com/ArchiveTeam/500px-items
  52. Jun 29 06:48:50 * djsrv (~djsrv@pool-74-102-75-157.nwrknj.fios.verizon.net) has joined
  53. Jun 29 06:49:22 <arkiver> scripts have been updated!
  54. Jun 29 06:49:44 <arkiver> Please update
  55. Jun 29 06:49:48 <arkiver> new version is 20180629.03
  56. Jun 29 06:49:54 <arkiver> is now minimum in tracker
  57. Jun 29 06:50:30 <arkiver> antomatic: odemg: phuzion: ^
  58. Jun 29 06:51:09 <phuzion> arkiver: it's been a minute, touch STOP, git pull, and restart, right?
  59. Jun 29 06:51:32 <antomatic> updated - ta
  60. Jun 29 06:51:44 <arkiver> yeah
  61. Jun 29 06:51:48 <arkiver> you can just force it to stop
  62. Jun 29 06:51:49 <phuzion> no need to recompile?
  63. Jun 29 06:51:53 <arkiver> no
  64. Jun 29 06:51:58 <arkiver> no need to recompile
  65. Jun 29 06:52:02 <arkiver> you can force stop it
  66. Jun 29 06:52:06 <arkiver> git pull and retsrta
  67. Jun 29 06:52:08 <arkiver> restart*
  68. Jun 29 06:52:16 <phuzion> cool, done.
  69. Jun 29 06:52:18 <phuzion> thanks.
  70. Jun 29 06:52:27 <arkiver> thanks :)
  71. Jun 29 06:52:44 * ThisAsYou (sid214210@ealing.irccloud.com) has joined
  72. Jun 29 07:03:25 <djsrv> Maybe I'm just clueless but the warrior doesn't seem to be working for this project
  73. Jun 29 07:03:29 <djsrv> Authentication failed for https://github.com/ArchiveTeam/500px-discovery/
  74. Jun 29 07:04:43 <ta9le> The warrior doesn't seem to be working for a load of people, myself included
  75. Jun 29 07:04:52 <ta9le> which is why I'm just running the scripts
  76. Jun 29 07:04:56 <antomatic> mm,me too
  77. Jun 29 07:05:09 <djsrv> hmm okay
  78. Jun 29 07:05:09 <antomatic> should warrior be running grab rather than discovery though?
  79. Jun 29 07:05:30 <ta9le> Yeah, it should, AFAIK
  80. Jun 29 07:09:48 <phuzion> djsrv: are you running the new warrior, or an old one from years ago?
  81. Jun 29 07:10:07 <djsrv> I just downloaded it last night
  82. Jun 29 07:10:11 <phuzion> ok
  83. Jun 29 07:24:24 * Kaz (~sid209527@2001:67c:2f08:3::3:3277) has joined
  84. Jun 29 07:24:30 <Kaz> Hello hello
  85. Jun 29 07:24:34 <Kaz> what do we need?
  86. Jun 29 07:24:45 <Kaz> other than dashcloud pikhq SketchCow to share ops <3
  87. Jun 29 07:27:44 <phuzion> Kaz: Looks like we just need more people running scripts/warriors at this point.
  88. Jun 29 07:28:57 <Kaz> has odemg turned up yet
  89. Jun 29 07:29:31 <ta9le> He's in second place now
  90. Jun 29 07:29:40 <ta9le> http://tracker.archiveteam.org/500px/#show-all
  91. Jun 29 07:31:26 * AGSPhoeni (~agsphoeni@23.28.37.160) has joined
  92. Jun 29 07:32:13 <antomatic> I think what this project most needs is IP addresses - can't really go over concurrent 5 per IP
  93. Jun 29 07:32:57 <antomatic> Once you start hitting 429s your IP is banned for about 90-120 minutes
  94. Jun 29 07:33:18 <AGSPhoeni> Do they support IPv6? Those are a dime a million.
  95. Jun 29 07:33:26 <antomatic> go too fast and the shutters will come down in as little as 5 minutes
  96. Jun 29 07:33:30 * AGSPhoeni is now known as Phoen1x
  97. Jun 29 07:33:43 <Phoen1x> damn EFnet 9 character nick limit...
  98. Jun 29 07:34:33 <antomatic> probably not, someone suggested earlier they don't do ipv6
  99. Jun 29 07:39:53 * arkiver has quit (Ping timeout: 600 seconds)
  100. Jun 29 07:39:58 <Phoen1x> confirmed, no AAAA record on api. or the main domain
  101. Jun 29 07:41:36 * ThisAsYou has quit (Read error: Connection reset by peer)
  102. Jun 29 07:42:44 <Phoen1x> So, any bright ideas other than throw cloud servers at the problem? 10 servers is €0.04 per hour at Hetzer, which isn't bad for short term stuff
  103. Jun 29 07:43:42 * jrwr (sid243436@id-243436.stonehaven.irccloud.com) has joined
  104. Jun 29 07:44:09 * arkiver (~arkiver@199.241.31.225) has joined
  105. Jun 29 07:44:18 <arkiver> djsrv: fixed.
  106. Jun 29 07:44:36 <arkiver> instruction on creating and adding items are here https://github.com/ArchiveTeam/500px-items
  107. Jun 29 07:44:39 <arkiver> I have to go now
  108. Jun 29 07:44:51 <arkiver> Kaz or some other admins can add items to the tracker
  109. Jun 29 07:45:13 <arkiver> jrwr and hcross have access too
  110. Jun 29 07:45:14 * arkiver needs to leave
  111. Jun 29 07:46:20 * JAA (~JAA@169.ip-142-44-240.net) has joined
  112. Jun 29 07:47:39 * ThisAsYou (sid214210@ealing.irccloud.com) has joined
  113. Jun 29 07:47:56 * ThisAsYou has quit (Read error: Connection reset by peer)
  114. Jun 29 07:48:11 * bakJAA (~bakJAA@185.194.143.29) has joined
  115. Jun 29 07:54:10 * ThisAsYou (sid214210@ealing.irccloud.com) has joined
  116. Jun 29 07:59:09 <djsrv> hmm, now I just get another error when I run the warrior https://pastebin.com/W5EMBjvr
  117. Jun 29 08:02:42 <Phoen1x> I had that issue several days back on zetaboards. I looked into it, and found some stuff saying it was due to the script not having a shebang line at the start, but another user told me it was due to some problem with wget-lua I never got any details about
  118. Jun 29 08:05:30 <phuzion> djsrv: try deleting the VM, and re-importing the VM, and see if the problem is still reproducible.
  119. Jun 29 08:09:50 <djsrv> I just got the same error
  120. Jun 29 08:23:19 <Phoen1x> Same error on multiple servers running the Docker version
  121. Jun 29 08:23:54 * SketchCow gives channel operator status to adinbied antomatic Aoede wp494
  122. Jun 29 08:23:54 * SketchCow gives channel operator status to Kaz jrwr JAA ivan
  123. Jun 29 08:23:54 * SketchCow gives channel operator status to Hecatz atluxity
  124. Jun 29 08:24:22 * SketchCow gives channel operator status to archodg arkiver bakJAA djsrv
  125. Jun 29 08:24:22 * SketchCow gives channel operator status to Muad-Dib Phoen1x phuzion ta9le
  126. Jun 29 08:24:22 * SketchCow gives channel operator status to ThisAsYou znak
  127. Jun 29 08:24:24 <SketchCow> OK then
  128. Jun 29 08:25:10 <Phoen1x> ...Wrong button?
  129. Jun 29 08:27:26 <JAA> "*You* get ops, *you* get ops, *EVERYONE* gets ops!"
  130. Jun 29 08:29:35 <SketchCow> No, this is a 2 day project. I am sure you can all conduct yourselves.
  131. Jun 29 08:29:46 <SketchCow> Let's light this fucker up
  132. Jun 29 08:31:47 <phuzion> SketchCow: Anything we need to be aware of with regard to not pissing people off? Or do we just wanna go full throttle with this?
  133. Jun 29 08:32:06 <phuzion> I'm assuming the latter, given "Let's light this fucker up"
  134. Jun 29 08:37:00 <Phoen1x> Currently trying to debug the problem with the warrior, anyone else working on it?
  135. Jun 29 08:37:09 <Phoen1x> Also, anyone using the warrior successfully?
  136. Jun 29 08:42:09 * ThisAsYou has quit (Read error: Connection reset by peer)
  137. Jun 29 08:44:16 <djsrv> For now I'm just setting up a Debian VM to see if I can get the scripts to work there
  138. Jun 29 08:44:52 <Kaz> Right, I haven't been around all day
  139. Jun 29 08:44:59 <Kaz> do we have a) a total size estimate
  140. Jun 29 08:45:08 <Kaz> b) a total amount of items (I haven't generated the lists yet)
  141. Jun 29 08:45:30 <Kaz> c) any idea of ratelimits (I see discussion of IP ratelimits from antomatic)
  142. Jun 29 08:57:27 <Phoen1x> All right, I've given up on debugging the warrior. Seesaw downloads a new copy of the repo every time you select a project, so I can't just edit the file in place and try again. I don't see any easy way to edit the repo address so I can test with a fork, and I don't really want to write a script to ninja edit the file right after the clone but before the install
  143. Jun 29 08:57:50 <Phoen1x> On the plus side, I have an ansible playbook that seems to be working for setting up new servers
  144. Jun 29 08:59:06 <jrwr> Docker Warrior best warrior
  145. Jun 29 08:59:07 <jrwr> :)
  146. Jun 29 08:59:16 <Phoen1x> I was using the Docker warrior
  147. Jun 29 09:00:36 <Phoen1x> Okay, I'm hitting 429s with concurrency 5
  148. Jun 29 09:01:37 * ThisAsYou (sid214210@ealing.irccloud.com) has joined
  149. Jun 29 09:01:38 * ThisAsYou has quit (Read error: Connection reset by peer)
  150. Jun 29 09:02:48 <SketchCow> FULL THROTTLE
  151. Jun 29 09:02:57 <SketchCow> Leave nothing standing
  152. Jun 29 09:06:15 <Phoen1x> Ansible playbook: https://gist.github.com/AGSPhoenix/11f7fcf687110a10855f502c29e93f9e
  153. Jun 29 09:06:28 <Phoen1x> Update nickname if you use it, obviously
  154. Jun 29 09:07:00 <Phoen1x> Only tested against Debian machines. Debian-likes will probably work, other distros probably not
  155. Jun 29 09:09:53 <Kaz> cheers Phoen1x
  156. Jun 29 09:09:57 <Kaz> so we need lots of IPs
  157. Jun 29 09:13:59 * equa (~eq@2605:6000:6f4d:2c00:d0a8:70d8:6750:86ba) has joined
  158. Jun 29 09:15:48 <phuzion> I'm bringing up 10 droplets, I should have them online within about 10 minutes or so.
  159. Jun 29 09:17:02 <antomatic> nice
  160. Jun 29 09:18:06 * ThisAsYou (sid214210@ealing.irccloud.com) has joined
  161. Jun 29 09:18:31 <antomatic> max concurrency does seem to depend on your connection speed - might need to back it off if you hit 429s (but there's a couple of hours to wait until the IP is unbanned, so take it slowly at first)
  162. Jun 29 09:21:10 * silasqwer (webchat@h216-170-138-203.rudsnm.broadband.dynamic.tds.net) has joined
  163. Jun 29 09:21:17 <antomatic> I can't safely exceed 5 but YMMV
  164. Jun 29 09:25:10 <phuzion> Phoen1x: I like how you named that last task in the playbook. "start thing" lol
  165. Jun 29 09:25:27 <Phoen1x> I sort of ran out of energy by the end
  166. Jun 29 09:26:17 * Disconnected (Connection reset by peer)
  167. **** ENDING LOGGING AT Fri Jun 29 09:26:17 2018
  168.  
  169. **** BEGIN LOGGING AT Fri Jun 29 09:28:48 2018
  170.  
  171. Jun 29 09:28:48 * Now talking on #500pieces
  172. Jun 29 09:28:48 * Topic for #500pieces is: https://500px.com/creativecommons shutting down. | Warrior project in 7 hours. | Resources needed! Spread the word.
  173. Jun 29 09:28:48 * Topic for #500pieces set by arkiver!~arkiver@2604:180:0:6e7::2 (Thu Jun 28 19:51:33 2018)
  174. Jun 29 09:29:02 * phuzion (~phuzion@45.55.90.225) has joined
  175. Jun 29 09:32:25 <Phoen1x> To anyone using my playbook, run `ansible -i hosts archivers -m command -a 'screen -ls'` afterwords
  176. Jun 29 09:32:46 <Phoen1x> About 10% of my hosts just end up with a dead screen and I'm not sure why yet
  177. Jun 29 09:35:35 <phuzion> How many hosts are you running?
  178. Jun 29 09:35:47 <Phoen1x> Just 10 right now
  179. Jun 29 09:36:28 <Phoen1x> ...actually, I don't remember an instance where I didn't have 1/10 of the hosts in this state
  180. Jun 29 09:37:02 <Phoen1x> It may just be the last one out of each run or something like that. I don't relaly understand the problem right noe
  181. Jun 29 09:37:30 <Phoen1x> really* now* off these typos
  182. Jun 29 09:37:35 <Phoen1x> oof* fuck me
  183. Jun 29 09:41:52 <silasqwer> Am I able to use the warrior for this? I have the project selected for it but it's not doing anything.
  184. Jun 29 09:42:32 <Phoen1x> Check the about tab and scroll down, does it say something like 'custom install failed: 9999'
  185. Jun 29 09:42:42 * ThisAsYou has quit (Read error: Connection reset by peer)
  186. Jun 29 09:43:36 <silasqwer> it does say somethig similar, 2018-06-29 16:11:15,698 - seesaw.warrior - ERROR - Custom project install file error
  187. Jun 29 09:44:13 <silasqwer> Do you want the traceback as well?
  188. Jun 29 09:44:44 <Phoen1x> Yeah, pretty sure it's the same error I was running into
  189. Jun 29 09:45:00 <silasqwer> Ok, here: Traceback (most recent call last): File "/home/warrior/warrior-code2/src/seesaw/seesaw/warrior.py", line 507, in install_project p.run() File "/home/warrior/warrior-code2/src/seesaw/seesaw/externalprocess.py", line 142, in run self.pipe = tornado.process.Subprocess(*self.args, **self.kwargs) File "/usr/local/lib/python3.5/dist-packages/tornado/process.py", line 244, in __init__ self.proc = subprocess.Popen(*
  190. Jun 29 09:45:13 <Phoen1x> Pastebin, if you would
  191. Jun 29 09:45:23 <silasqwer> Oh ok, sure
  192. Jun 29 09:45:56 <silasqwer> https://pastebin.com/fUjsG9GS
  193. Jun 29 09:46:28 <Phoen1x> Yep, same problem I and several other have had
  194. Jun 29 09:47:09 <Phoen1x> This project and zetaboard (and possibly others?) are broken on the Warrior and have to be run manually
  195. Jun 29 09:48:14 <silasqwer> I'm pretty sure most of the others are broken for me as well, URLTeam is the only one that runs consistently (that I've tried)
  196. Jun 29 09:48:42 <antomatic> same here, i've not been able to run a warrior project for some time now
  197. Jun 29 09:49:06 * ThisAsYou (sid214210@ealing.irccloud.com) has joined
  198. Jun 29 09:49:43 <silasqwer> good to know I'm not the only one
  199. Jun 29 09:49:44 <JAA> Yeah, others have been reporting that as well.
  200. Jun 29 09:51:11 <silasqwer> Will running it manually take up space on my computer, or is it going straight to some kind of ArchiveTeam server directly?
  201. Jun 29 09:52:35 <JAA> Data will be uploaded on the fly and deleted from your machine just like it does in the warrior, unless you pass a special option to run-pipeline.
  202. Jun 29 09:53:26 <silasqwer> Ok, thank you. I'll probably get the project pretty soon then since time is so limited
  203. Jun 29 10:03:50 <Phoen1x> Pull request with a possible fix put in, not I just need someone who knows what the hell they're doing to look at it, verify it works, and release it
  204. Jun 29 10:05:32 <JAA> arkiver: ^
  205. Jun 29 10:06:10 <Phoen1x> Anyone know when he'll be back?
  206. Jun 29 10:06:57 <JAA> ¯\_(ツ)_/¯
  207. Jun 29 10:07:04 <Phoen1x> Alternatively, is there anyone in the AT org in GitHub who could merge it?
  208. Jun 29 10:12:23 <silasqwer> What number --concurrent should I set? I have it at 2 right now, but my internet and computer could probably handle more. My download speed is about 60 mbps and my upload is about 4.
  209. Jun 29 10:20:17 <Phoen1x> generally, increase it until you start getting 429 errors, then back off 1 or 2
  210. Jun 29 10:21:18 <Phoen1x> Finding the exact value is a slow process, and it might shift over time
  211. Jun 29 10:21:54 <Phoen1x> Also, when you get 429s, you're banned form the site for a few hours, and you'll need to wait before resuming
  212. Jun 29 10:25:56 <silasqwer> Ok, I'll give that a shot. How do I gracefully stop the script?
  213. Jun 29 10:26:13 <Phoen1x> That's a good fuckin question
  214. Jun 29 10:26:19 <Phoen1x> I'd like to know that myself
  215. Jun 29 10:27:39 <silasqwer> Hmm ok
  216. Jun 29 10:27:40 <phuzion> execute `touch STOP` in the directory of pipeline.py
  217. Jun 29 10:27:52 <silasqwer> Oh ok thank you
  218. Jun 29 10:27:52 <phuzion> obviously sans the backticks
  219. Jun 29 10:28:13 <phuzion> That's the way to cleanly shut it down. It'll let any outstanding items finish, and not request new ones.
  220. Jun 29 10:28:26 <phuzion> Then the script will exit cleanly after all items are wrapped up
  221. Jun 29 10:29:29 <silasqwer> That's exactly what I was looking for, thank you!
  222. Jun 29 10:33:52 * djsrv has quit (Quit: This computer has gone to sleep)
  223. Jun 29 10:35:10 <Phoen1x> We seem to be rapidly running out of work to do
  224. Jun 29 10:35:30 <Phoen1x> 4500 done, 750 out, 650 left
  225. Jun 29 10:36:40 <silasqwer> Are those the final numbers, or is it still finding more?
  226. Jun 29 10:37:00 <phuzion> I don't know who's doing discovery, but if you are, please add some more items to the tracker
  227. Jun 29 10:38:02 <silasqwer> I'm not doing discovery, but if I can (and it's not too complicated), then I could help with that too
  228. Jun 29 10:39:49 <phuzion> https://github.com/ArchiveTeam/500px-items
  229. Jun 29 10:40:04 <phuzion> I'm not sure how exactly the discovery happens, but there's some info to read up on
  230. Jun 29 10:40:40 <silasqwer> Ok, I'll check that out. Would I be able to run both the discovery script and the grab script at the same time?
  231. Jun 29 10:41:19 <phuzion> Probably not advisable from the same IP
  232. Jun 29 10:41:45 <silasqwer> Ok, makes sense.
  233. Jun 29 10:43:14 * ThisAsYou has quit (Read error: Connection reset by peer)
  234. Jun 29 10:44:24 <silasqwer> Do we have a rough idea of how many items total there are supposed to be?
  235. Jun 29 10:46:22 * djsrv (~djsrv@pool-74-102-75-157.nwrknj.fios.verizon.net) has joined
  236. Jun 29 10:49:01 <adinbied> Hi all, sorry for the wait - I'll get discovery finished in the next few minutes
  237. Jun 29 10:49:14 <Phoen1x> Was just about to start pinging people
  238. Jun 29 10:49:17 <Phoen1x> Good timing
  239. Jun 29 11:02:12 <phuzion> 737 items out, do we wanna requeue those in about 30 minutes or so?
  240. Jun 29 11:03:39 <silasqwer> I was thinking the same thing. Could we do that now while we wait for new items to be discovered?
  241. Jun 29 11:06:52 <phuzion> I'm saying give it 30 minutes so there's time for some of them to come back in if they are going to.
  242. Jun 29 11:07:06 <adinbied> https://archive.org/details/AttributionNonCommercialNoDerivativesLicense3APIServerResponses.7z
  243. Jun 29 11:07:44 <silasqwer> Oh ok, that's a good idea then
  244. Jun 29 11:07:48 <antomatic> These aren't big items, so I suspect that anything that's out and not back yet has failed or is grinding through 429 retries
  245. Jun 29 11:08:30 <phuzion> Yeah, true. Most items are what, 20-50MB?
  246. Jun 29 11:08:45 <antomatic> if that. average seems to be 18
  247. Jun 29 11:09:23 <phuzion> Does someone here have tracker admin rights?
  248. Jun 29 11:09:41 <phuzion> I've only got urlteam admin, not the regular tracker.
  249. Jun 29 11:13:32 * ThisAsYou (sid214210@ealing.irccloud.com) has joined
  250. Jun 29 11:14:08 <adinbied> Dont have access to the tracker - arkiver was the one handling the actual tracker stuff
  251. Jun 29 11:16:54 <Phoen1x> Kaz, jrwr, hcross; could one of you do the needful?
  252. Jun 29 11:20:01 <adinbied> Final API grab: https://archive.org/details/AttributionNonCommercialShareAlikeLicense3APIServerResponses.7z
  253. Jun 29 11:20:50 <adinbied> Will take a look at https://github.com/ArchiveTeam/500px-items and see if I can get it parsed and ready for someone to add to the tracker
  254. Jun 29 11:21:03 * odemg (~odemg@200116b82cf25b00d09539f76c729327.dip.versatel-1u1.de) has joined
  255. Jun 29 11:21:35 <Phoen1x> Well if it isn't the new hotshot
  256. Jun 29 11:21:50 <Phoen1x> More items coming just as soon as we can get someone to add them to the tracker
  257. Jun 29 11:26:56 * archodg gives channel operator status to odemg
  258. Jun 29 11:43:01 * ubahn (webchat@92.117.103.143) has joined
  259. Jun 29 11:43:47 * ThisAsYou has quit (Read error: Connection reset by peer)
  260. Jun 29 11:44:04 <phuzion> adinbied: I am able to submit a pull request for your discovery if you want, I'm fairly certain I've got it ready to go.
  261. Jun 29 11:47:03 <adinbied> phuzion, beat me to it by a few seconds - was just about to submit a pull request myself. Go ahead! Just checking - the ADDED/0004_photos.txt & ADDED/0005_photos.txt total ~76.1KB, correct?
  262. Jun 29 11:47:33 <phuzion> adinbied: Oh if you're ready to submit, then yeah, go for it
  263. Jun 29 11:47:45 <phuzion> I'd still have to fork and fix up my git settings
  264. Jun 29 11:47:48 <adinbied> OK, will do
  265. Jun 29 11:49:36 * ThisAsYou (sid214210@ealing.irccloud.com) has joined
  266. Jun 29 11:49:56 * ThisAsYou has quit (Read error: Connection reset by peer)
  267. Jun 29 11:50:25 <ta9le> Okay, I guess we're done?
  268. Jun 29 11:51:12 <silasqwer> I don't think so, more items need to be found so that we can get them
  269. Jun 29 11:51:52 <silasqwer> Even if that is everything, there are still those 737 out that need to be done
  270. Jun 29 11:54:56 <ta9le> I don't think my script actually processes the remaining jobs right now, so might as well shut it down
  271. Jun 29 11:56:20 * ThisAsYou (sid214210@ealing.irccloud.com) has joined
  272. Jun 29 12:01:51 <SketchCow> Surely we have more.
  273. Jun 29 12:01:54 <SketchCow> How many did we grab
  274. Jun 29 12:03:04 * HCross (sid124762@id-124762.hathersage.irccloud.com) has joined
  275. Jun 29 12:03:16 <antomatic> an item seems to be 10 photos so... 51,240.
  276. Jun 29 12:03:37 <djsrv> There are way more than that
  277. Jun 29 12:03:42 <antomatic> yes
  278. Jun 29 12:03:46 <HCross> arkiver: did you answer my question on the collection please? IRCCloud died for most of the afternoon
  279. Jun 29 12:03:58 <antomatic> but they have to be (a) discovered, and (b) loaded into the tracker
  280. Jun 29 12:04:54 <antomatic> I think we're waiting for someone to (b)
  281. Jun 29 12:05:35 <antomatic> adinbied doing sterling work on (a)
  282. Jun 29 12:08:32 <adinbied> Currently having issues submitting a pull request - phuzion, are you able to do so?
  283. Jun 29 12:10:39 <phuzion> Maybe. Let me see once I get back to my desk.
  284. Jun 29 12:12:50 <HCross> Can someone post a backlog from about 2pm UK please?
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement