Advertisement
Guest User

Untitled

a guest
May 23rd, 2019
116
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 13.01 KB | None | 0 0
  1. ❯ ./build_and_run.sh test
  2. Sending build context to Docker daemon 260.6MB
  3. Step 1/13 : FROM ubuntu:18.10
  4. ---> 56908d9dce45
  5. Step 2/13 : RUN apt-get update && apt-get -y install curl libssl-dev pkg-config python3.6 python3-pip ca-certificates unzip && apt-get clean
  6. ---> Using cache
  7. ---> 851811543436
  8. Step 3/13 : RUN apt -y install apt-transport-https ca-certificates curl software-properties-common
  9. ---> Using cache
  10. ---> 3a61f31c9f96
  11. Step 4/13 : RUN curl -fsSL https://download.docker.com/linux/ubuntu/gpg | apt-key add -
  12. ---> Using cache
  13. ---> c5f0efa47209
  14. Step 5/13 : RUN add-apt-repository "deb [arch=amd64] https://download.docker.com/linux/ubuntu bionic stable"
  15. ---> Using cache
  16. ---> 7c1bb5387040
  17. Step 6/13 : RUN apt update
  18. ---> Using cache
  19. ---> 7caa09c4d862
  20. Step 7/13 : RUN apt-cache policy docker-ce
  21. ---> Using cache
  22. ---> 208df400b9e0
  23. Step 8/13 : RUN DEBIAN_FRONTEND=noninteractive apt -y install docker-ce
  24. ---> Using cache
  25. ---> 8100ec51d77e
  26. Step 9/13 : ADD requirements.txt /app/requirements.txt
  27. ---> Using cache
  28. ---> 449bc4b47787
  29. Step 10/13 : RUN pip3 install --requirement /app/requirements.txt
  30. ---> Using cache
  31. ---> 8c016be4b9fc
  32. Step 11/13 : ADD . /app
  33. ---> Using cache
  34. ---> 224e38f97125
  35. Step 12/13 : WORKDIR /app
  36. ---> Using cache
  37. ---> 80c3dafb7d1b
  38. Step 13/13 : CMD ["python3", "worker.py"]
  39. ---> Using cache
  40. ---> b6a0121bb192
  41. Successfully built b6a0121bb192
  42. Successfully tagged worker:latest
  43. Copying gs://kms-secrets-storage/xtx_worker_service_account.json.encrypted...
  44. / [1 files][ 2.4 KiB/ 2.4 KiB]
  45. Operation completed over 1 objects/2.4 KiB.
  46. Copying gs://kms-secrets-storage/correlation-cert.encrypted...
  47. / [1 files][ 8.0 KiB/ 8.0 KiB]
  48. Operation completed over 1 objects/8.0 KiB.
  49. [INFO ] Subscribed to topic projects/c1-testing-platform/subscriptions/xtx-test
  50. [DEBUG ] Making request: POST https://oauth2.googleapis.com/token
  51. [DEBUG ] Starting new HTTPS connection (1): oauth2.googleapis.com:443
  52. [DEBUG ] https://oauth2.googleapis.com:443 "POST /token HTTP/1.1" 200 None
  53. [INFO ] Received message {'task': {'id': 1, 'task_type': 0, 'created_at': '2019-05-23T23:44:25.262687Z', 'ended_at': None}, 'submission': {'challenge': 1, 'language': 0, 'file_submission': 'submissions/challenge_1/user_1_tester/XTXStarterKit.zip'}, 'dataset': {'id': 1, 'name': '', 'file_dataset': 'datasets/dataset_1_/test_files/datasets/data.csv'}, 'meta': {'created_at': '2019-05-23T23:44:25UTC'}}
  54. [INFO ] Deserialized Task
  55. [INFO ] Deserialized Submission
  56. [INFO ] Deserialized Dataset
  57. [INFO ] Message metadata:
  58. [INFO ] {'created_at': '2019-05-23T23:44:25UTC'}
  59. [DEBUG ] Starting new HTTP connection (1): host.docker.internal:8001
  60. [DEBUG ] http://host.docker.internal:8001 "POST /api/token/ HTTP/1.1" 200 438
  61. [INFO ] Saved token {'refresh': 'eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJ0b2tlbl90eXBlIjoicmVmcmVzaCIsImV4cCI6MTU1ODc0MTQ2NiwianRpIjoiZjNjZDY4YTRkYmZkNDE3N2IzN2YzMjZmMDY4YzU3NzIiLCJ1c2VyX2lkIjoyfQ.O992Q_JOyCuhfm8TkyY3yjBvAcL0F0qgXgKQedTupk4', 'access': 'eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJ0b2tlbl90eXBlIjoiYWNjZXNzIiwiZXhwIjoxNTU4OTU1MDY2LCJqdGkiOiI5YzY5Mjk1ZmQ2MDk0Y2ZkODcyYjU0Y2M5MmRhMzQyYSIsInVzZXJfaWQiOjJ9.D2uyHVP9alnPgl8d-h_YjR3J1Xr2JaS_NbTVQwaWx8A'}
  62. [DEBUG ] Starting new HTTP connection (1): host.docker.internal:8001
  63. [DEBUG ] http://host.docker.internal:8001 "POST /api/token/ HTTP/1.1" 200 438
  64. [INFO ] Saved token {'refresh': 'eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJ0b2tlbl90eXBlIjoicmVmcmVzaCIsImV4cCI6MTU1ODc0MTQ2NiwianRpIjoiYjE5NTQ3ODM2Y2FhNDFlYmEwNjNkOTg3ZjgxOWQ4MWUiLCJ1c2VyX2lkIjoyfQ.V5CBmEuktxZ9lOXFctwBvh80y5WbNaaRqdKPyqw7dr4', 'access': 'eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJ0b2tlbl90eXBlIjoiYWNjZXNzIiwiZXhwIjoxNTU4OTU1MDY2LCJqdGkiOiI2MTE2ZTkyMmE4Yzk0ZWIzYmI5YTNiYzc5MmU3ODM0NCIsInVzZXJfaWQiOjJ9.d_Bo1YVGyBjBB0-cIe7_WQ4u4-lHSXxmUiehpZc5OXc'}
  65. [DEBUG ] Starting new HTTP connection (1): host.docker.internal:8001
  66. [DEBUG ] http://host.docker.internal:8001 "PUT /api/task/1 HTTP/1.1" 200 31
  67. [INFO ] Received response from backend {'status': 'success', 'job_id': 1}, status 200
  68. [INFO ] Removing tasks/task_68_5b...
  69. [INFO ] Removing tasks/test...
  70. [INFO ] Downloading blob submissions/challenge_1/user_1_tester/XTXStarterKit.zip to tasks/task_1_642a758b/submission.zip
  71. [DEBUG ] Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None)
  72. [DEBUG ] Making request: POST https://oauth2.googleapis.com/token
  73. [DEBUG ] Starting new HTTPS connection (1): oauth2.googleapis.com:443
  74. [DEBUG ] https://oauth2.googleapis.com:443 "POST /token HTTP/1.1" 200 None
  75. [DEBUG ] Starting new HTTPS connection (1): www.googleapis.com:443
  76. [DEBUG ] https://www.googleapis.com:443 "GET /storage/v1/b/test-xtx-data?projection=noAcl HTTP/1.1" 200 438
  77. [DEBUG ] https://www.googleapis.com:443 "GET /download/storage/v1/b/test-xtx-data/o/submissions%2Fchallenge_1%2Fuser_1_tester%2FXTXStarterKit.zip?alt=media HTTP/1.1" 200 6246
  78. [INFO ] Blob submissions/challenge_1/user_1_tester/XTXStarterKit.zip downloaded to tasks/task_1_642a758b/submission.zip
  79. [INFO ] Downloading blob datasets/dataset_1_/test_files/datasets/data.csv to tasks/task_1_642a758b/data.csv
  80. [DEBUG ] Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None)
  81. [DEBUG ] Making request: POST https://oauth2.googleapis.com/token
  82. [DEBUG ] Starting new HTTPS connection (1): oauth2.googleapis.com:443
  83. [DEBUG ] https://oauth2.googleapis.com:443 "POST /token HTTP/1.1" 200 None
  84. [DEBUG ] Starting new HTTPS connection (1): www.googleapis.com:443
  85. [DEBUG ] https://www.googleapis.com:443 "GET /storage/v1/b/test-xtx-data?projection=noAcl HTTP/1.1" 200 438
  86. [DEBUG ] https://www.googleapis.com:443 "GET /download/storage/v1/b/test-xtx-data/o/datasets%2Fdataset_1_%2Ftest_files%2Fdatasets%2Fdata.csv?alt=media HTTP/1.1" 200 34208
  87. [INFO ] Blob datasets/dataset_1_/test_files/datasets/data.csv downloaded to tasks/task_1_642a758b/data.csv
  88. [INFO ] Unpacking submission zipfile to /tmp/tasks/task_1_642a758b
  89. [INFO ] Finding file submission.py in /tmp/tasks/task_1_642a758b
  90. [INFO ] Checking for a requirements.txt file
  91. [INFO ] Copying immutable files
  92. [INFO ] Creating result directory /tmp/tasks/task_1_642a758b/results/
  93. [INFO ] Task directory tasks/task_1_642a758b
  94. [INFO ] task_1_642a758b/
  95. [INFO ] submission.zip
  96. [INFO ] Dockerfile
  97. [INFO ] data.csv
  98. [INFO ] start_script.sh
  99. [INFO ] src/
  100. [INFO ] scorer.py
  101. [INFO ] model_tester.py
  102. [INFO ] python/
  103. [INFO ] requirements.txt
  104. [INFO ] submission.py
  105. [INFO ] core.py
  106. [INFO ] Building docker image
  107. Sending build context to Docker daemon 54.27kB
  108. Step 1/7 : FROM gcr.io/google_appengine/python
  109. ---> 59751e1615a4
  110. Step 2/7 : RUN virtualenv /env -p python3.6
  111. ---> Running in aa81a52ee1d4
  112. Running virtualenv with interpreter /opt/python3.6/bin/python3.6
  113. Using base prefix '/opt/python3.6'
  114. New python executable in /env/bin/python3.6
  115. Also creating executable in /env/bin/python
  116. Installing setuptools, pip, wheel...done.
  117. Removing intermediate container aa81a52ee1d4
  118. ---> 4faa4c5b7042
  119. Step 3/7 : ENV PATH /env/bin:$PATH
  120. ---> Running in 648f72fc2625
  121. Removing intermediate container 648f72fc2625
  122. ---> 7829bb406701
  123. Step 4/7 : ADD . /app
  124. ---> 39354cc0d210
  125. Step 5/7 : WORKDIR /app
  126. ---> Running in 2387f790f292
  127. Removing intermediate container 2387f790f292
  128. ---> 2ae81296be6c
  129. Step 6/7 : RUN pip3 install -r /app/python/requirements.txt
  130. ---> Running in 5053f4949066
  131. Removing intermediate container 5053f4949066
  132. ---> f74f73184d07
  133. Step 7/7 : CMD bash
  134. ---> Running in 0b6c24337a90
  135. Removing intermediate container 0b6c24337a90
  136. ---> eaf157e8ce6b
  137. Successfully built eaf157e8ce6b
  138. Successfully tagged sibling:latest
  139. [INFO ] Running command:
  140. [INFO ] docker run --network none --name task_1_642a758b -v /tmp/tasks/task_1_642a758b/results/:/app/results -itd sibling
  141. d1bcf994c0d10c1d88dfb552ff0ddeaf97e2438d2d64f3efbb49676e2ee279b7
  142. [DEBUG ] Starting new HTTP connection (1): host.docker.internal:8001
  143. [DEBUG ] http://host.docker.internal:8001 "POST /api/token/ HTTP/1.1" 200 438
  144. [INFO ] Saved token {'refresh': 'eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJ0b2tlbl90eXBlIjoicmVmcmVzaCIsImV4cCI6MTU1ODc0MTQ4NCwianRpIjoiNjJmMGJkOWNiOWY2NDIxOWJkNWRkZGQ4YmNiZDM3ZjUiLCJ1c2VyX2lkIjoyfQ.JRgqff-yTV4zbk5XbruWmBN0z2Xd94W6gwUXeNNNju8', 'access': 'eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJ0b2tlbl90eXBlIjoiYWNjZXNzIiwiZXhwIjoxNTU4OTU1MDg0LCJqdGkiOiJiNTk4NjlmM2FjNmU0NDM5YTljNWQ1YzJkMDExZDc5YyIsInVzZXJfaWQiOjJ9.SLSXP53k83nkuHliIhCVwTzZmz2NXgr1u2ouIx8ZqvQ'}
  145. [DEBUG ] Starting new HTTP connection (1): host.docker.internal:8001
  146. [DEBUG ] http://host.docker.internal:8001 "PUT /api/task/1 HTTP/1.1" 200 20
  147. [INFO ] Received response from backend {'status': 'success'}, status 200
  148. [INFO ] Executing start script
  149. [INFO ] Logging to file /tmp/tasks/task_1_642a758b/output.txt
  150. [INFO ] Polling process - try #0
  151. [SUBMISSION] You achieved an r2 value of -4.441121495327103.
  152.  
  153. [INFO ] Extending deadline for ack_id WBFOBCEhPjA-RVNEUAYWLF1GSFE3GQhoUQ5PXiM_NSAoRRMLUxNRXHYTTBBvM1x1B1ENGHQsNHJrXhcABkxZf1VbCTxofmNxBFMKGHR9aHdiWRcECkd7_fSY5uKpHEZJP7vdtaVIQe_khvEwZhg9XBJLLD5-PTJFQV5AEkw2B0RJUytDCyo
  154. [INFO ] Finished running sibling container
  155. [INFO ] Uploading file /tmp/tasks/task_1_642a758b/output.txt to output/output_1_1.txt
  156. [DEBUG ] Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None)
  157. [DEBUG ] Making request: POST https://oauth2.googleapis.com/token
  158. [DEBUG ] Starting new HTTPS connection (1): oauth2.googleapis.com:443
  159. [DEBUG ] https://oauth2.googleapis.com:443 "POST /token HTTP/1.1" 200 None
  160. [DEBUG ] Starting new HTTPS connection (1): www.googleapis.com:443
  161. [DEBUG ] https://www.googleapis.com:443 "GET /storage/v1/b/test-xtx-data?projection=noAcl HTTP/1.1" 200 438
  162. [DEBUG ] https://www.googleapis.com:443 "POST /upload/storage/v1/b/test-xtx-data/o?uploadType=multipart HTTP/1.1" 200 765
  163. [INFO ] File /tmp/tasks/task_1_642a758b/output.txt uploaded to output/output_1_1.txt.
  164. [INFO ] Uploading file /tmp/tasks/task_1_642a758b/results/result.txt to results/result_1_1.txt
  165. [DEBUG ] Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None)
  166. [DEBUG ] Making request: POST https://oauth2.googleapis.com/token
  167. [DEBUG ] Starting new HTTPS connection (1): oauth2.googleapis.com:443
  168. [DEBUG ] https://oauth2.googleapis.com:443 "POST /token HTTP/1.1" 200 None
  169. [DEBUG ] Starting new HTTPS connection (1): www.googleapis.com:443
  170. [DEBUG ] https://www.googleapis.com:443 "GET /storage/v1/b/test-xtx-data?projection=noAcl HTTP/1.1" 200 438
  171. [DEBUG ] https://www.googleapis.com:443 "POST /upload/storage/v1/b/test-xtx-data/o?uploadType=multipart HTTP/1.1" 200 771
  172. [INFO ] File /tmp/tasks/task_1_642a758b/results/result.txt uploaded to results/result_1_1.txt.
  173. [INFO ] Received r2_score -4.441121495327103
  174. [INFO ] Succeeding task 1
  175. [DEBUG ] Starting new HTTP connection (1): host.docker.internal:8001
  176. [DEBUG ] http://host.docker.internal:8001 "POST /api/token/ HTTP/1.1" 200 438
  177. [INFO ] Saved token {'refresh': 'eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJ0b2tlbl90eXBlIjoicmVmcmVzaCIsImV4cCI6MTU1ODc0MTQ4OSwianRpIjoiM2ZmNGNjZDI5ODI1NDdmZWExZWVlN2Y2YmY0OGMwMTUiLCJ1c2VyX2lkIjoyfQ.rth_6XA_G6yINP_KrA2aQ4Itjyd_xLCtrMy6ZcySIfk', 'access': 'eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJ0b2tlbl90eXBlIjoiYWNjZXNzIiwiZXhwIjoxNTU4OTU1MDg5LCJqdGkiOiI0NDFhOTFmZTQ2NTY0YWVlYTFlZWJjNmJlN2RmYTg4YiIsInVzZXJfaWQiOjJ9.bTNd4ueKwWlW-odRn9FtmcrIEmTcr0g3rGGENqoj8RM'}
  178. [DEBUG ] Starting new HTTP connection (1): host.docker.internal:8001
  179. [DEBUG ] http://host.docker.internal:8001 "PUT /api/task/1 HTTP/1.1" 200 20
  180. [INFO ] Received response from backend {'status': 'success'}, status 200
  181. [INFO ] Ack'd message WBFOBCEhPjA-RVNEUAYWLF1GSFE3GQhoUQ5PXiM_NSAoRRMLUxNRXHYTTBBvM1x1B1ENGHQsNHJrXhcABkxZf1VbCTxofmNxBFMKGHR9aHdiWRcECkd7_fSY5uKpHEZJP7vdtaVIQe_khvEwZhg9XBJLLD5-PTJFQV5AEkw2B0RJUytDCyo
  182. Deleted Containers:
  183. 8dca9f641116896f30b34345bf2029d59c8029017bcdb4cac5735938438a2649
  184. 60b8a49eb1c215e4ec4878c97137e9567014715afab322f4f153c0bed2f1e884
  185.  
  186. Total reclaimed space: 55.73kB
  187. [INFO ] Stopping container d1bcf994c0d1
  188. d1bcf994c0d1
  189. Untagged: sibling:latest
  190. Deleted: sha256:eaf157e8ce6b0b0a605e0487199d65bf9675ff4b9fd7ced98d87b101f2d0ac7c
  191. Deleted: sha256:f74f73184d0761cbe57587b90a064619a127b54b50f93e8aab07093f21622fb7
  192. Deleted: sha256:2ae81296be6ccaa7aee7554f1f0a639167897ace84d254439b98444e6189725a
  193. Deleted: sha256:39354cc0d210ab19fc1ecc0694c0de504d8371b18325daab04e83b96fd12de20
  194. Deleted: sha256:7829bb406701dbfba527a090adc0bd781864d486225841d6fdfe79c97df81683
  195. Deleted: sha256:4faa4c5b70421bd77c96aafe244b9309e1ab458a75da030e6918b74eecc95f6d
  196. [DEBUG ] Retrying due to 504 Deadline Exceeded, sleeping 0.1s ...
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement