Advertisement
Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- ❯ ./build_and_run.sh test
- Sending build context to Docker daemon 260.6MB
- Step 1/13 : FROM ubuntu:18.10
- ---> 56908d9dce45
- Step 2/13 : RUN apt-get update && apt-get -y install curl libssl-dev pkg-config python3.6 python3-pip ca-certificates unzip && apt-get clean
- ---> Using cache
- ---> 851811543436
- Step 3/13 : RUN apt -y install apt-transport-https ca-certificates curl software-properties-common
- ---> Using cache
- ---> 3a61f31c9f96
- Step 4/13 : RUN curl -fsSL https://download.docker.com/linux/ubuntu/gpg | apt-key add -
- ---> Using cache
- ---> c5f0efa47209
- Step 5/13 : RUN add-apt-repository "deb [arch=amd64] https://download.docker.com/linux/ubuntu bionic stable"
- ---> Using cache
- ---> 7c1bb5387040
- Step 6/13 : RUN apt update
- ---> Using cache
- ---> 7caa09c4d862
- Step 7/13 : RUN apt-cache policy docker-ce
- ---> Using cache
- ---> 208df400b9e0
- Step 8/13 : RUN DEBIAN_FRONTEND=noninteractive apt -y install docker-ce
- ---> Using cache
- ---> 8100ec51d77e
- Step 9/13 : ADD requirements.txt /app/requirements.txt
- ---> Using cache
- ---> 449bc4b47787
- Step 10/13 : RUN pip3 install --requirement /app/requirements.txt
- ---> Using cache
- ---> 8c016be4b9fc
- Step 11/13 : ADD . /app
- ---> Using cache
- ---> 224e38f97125
- Step 12/13 : WORKDIR /app
- ---> Using cache
- ---> 80c3dafb7d1b
- Step 13/13 : CMD ["python3", "worker.py"]
- ---> Using cache
- ---> b6a0121bb192
- Successfully built b6a0121bb192
- Successfully tagged worker:latest
- Copying gs://kms-secrets-storage/xtx_worker_service_account.json.encrypted...
- / [1 files][ 2.4 KiB/ 2.4 KiB]
- Operation completed over 1 objects/2.4 KiB.
- Copying gs://kms-secrets-storage/correlation-cert.encrypted...
- / [1 files][ 8.0 KiB/ 8.0 KiB]
- Operation completed over 1 objects/8.0 KiB.
- [INFO ] Subscribed to topic projects/c1-testing-platform/subscriptions/xtx-test
- [DEBUG ] Making request: POST https://oauth2.googleapis.com/token
- [DEBUG ] Starting new HTTPS connection (1): oauth2.googleapis.com:443
- [DEBUG ] https://oauth2.googleapis.com:443 "POST /token HTTP/1.1" 200 None
- [INFO ] Received message {'task': {'id': 1, 'task_type': 0, 'created_at': '2019-05-23T23:44:25.262687Z', 'ended_at': None}, 'submission': {'challenge': 1, 'language': 0, 'file_submission': 'submissions/challenge_1/user_1_tester/XTXStarterKit.zip'}, 'dataset': {'id': 1, 'name': '', 'file_dataset': 'datasets/dataset_1_/test_files/datasets/data.csv'}, 'meta': {'created_at': '2019-05-23T23:44:25UTC'}}
- [INFO ] Deserialized Task
- [INFO ] Deserialized Submission
- [INFO ] Deserialized Dataset
- [INFO ] Message metadata:
- [INFO ] {'created_at': '2019-05-23T23:44:25UTC'}
- [DEBUG ] Starting new HTTP connection (1): host.docker.internal:8001
- [DEBUG ] http://host.docker.internal:8001 "POST /api/token/ HTTP/1.1" 200 438
- [INFO ] Saved token {'refresh': 'eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJ0b2tlbl90eXBlIjoicmVmcmVzaCIsImV4cCI6MTU1ODc0MTQ2NiwianRpIjoiZjNjZDY4YTRkYmZkNDE3N2IzN2YzMjZmMDY4YzU3NzIiLCJ1c2VyX2lkIjoyfQ.O992Q_JOyCuhfm8TkyY3yjBvAcL0F0qgXgKQedTupk4', 'access': 'eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJ0b2tlbl90eXBlIjoiYWNjZXNzIiwiZXhwIjoxNTU4OTU1MDY2LCJqdGkiOiI5YzY5Mjk1ZmQ2MDk0Y2ZkODcyYjU0Y2M5MmRhMzQyYSIsInVzZXJfaWQiOjJ9.D2uyHVP9alnPgl8d-h_YjR3J1Xr2JaS_NbTVQwaWx8A'}
- [DEBUG ] Starting new HTTP connection (1): host.docker.internal:8001
- [DEBUG ] http://host.docker.internal:8001 "POST /api/token/ HTTP/1.1" 200 438
- [INFO ] Saved token {'refresh': 'eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJ0b2tlbl90eXBlIjoicmVmcmVzaCIsImV4cCI6MTU1ODc0MTQ2NiwianRpIjoiYjE5NTQ3ODM2Y2FhNDFlYmEwNjNkOTg3ZjgxOWQ4MWUiLCJ1c2VyX2lkIjoyfQ.V5CBmEuktxZ9lOXFctwBvh80y5WbNaaRqdKPyqw7dr4', 'access': 'eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJ0b2tlbl90eXBlIjoiYWNjZXNzIiwiZXhwIjoxNTU4OTU1MDY2LCJqdGkiOiI2MTE2ZTkyMmE4Yzk0ZWIzYmI5YTNiYzc5MmU3ODM0NCIsInVzZXJfaWQiOjJ9.d_Bo1YVGyBjBB0-cIe7_WQ4u4-lHSXxmUiehpZc5OXc'}
- [DEBUG ] Starting new HTTP connection (1): host.docker.internal:8001
- [DEBUG ] http://host.docker.internal:8001 "PUT /api/task/1 HTTP/1.1" 200 31
- [INFO ] Received response from backend {'status': 'success', 'job_id': 1}, status 200
- [INFO ] Removing tasks/task_68_5b...
- [INFO ] Removing tasks/test...
- [INFO ] Downloading blob submissions/challenge_1/user_1_tester/XTXStarterKit.zip to tasks/task_1_642a758b/submission.zip
- [DEBUG ] Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None)
- [DEBUG ] Making request: POST https://oauth2.googleapis.com/token
- [DEBUG ] Starting new HTTPS connection (1): oauth2.googleapis.com:443
- [DEBUG ] https://oauth2.googleapis.com:443 "POST /token HTTP/1.1" 200 None
- [DEBUG ] Starting new HTTPS connection (1): www.googleapis.com:443
- [DEBUG ] https://www.googleapis.com:443 "GET /storage/v1/b/test-xtx-data?projection=noAcl HTTP/1.1" 200 438
- [DEBUG ] https://www.googleapis.com:443 "GET /download/storage/v1/b/test-xtx-data/o/submissions%2Fchallenge_1%2Fuser_1_tester%2FXTXStarterKit.zip?alt=media HTTP/1.1" 200 6246
- [INFO ] Blob submissions/challenge_1/user_1_tester/XTXStarterKit.zip downloaded to tasks/task_1_642a758b/submission.zip
- [INFO ] Downloading blob datasets/dataset_1_/test_files/datasets/data.csv to tasks/task_1_642a758b/data.csv
- [DEBUG ] Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None)
- [DEBUG ] Making request: POST https://oauth2.googleapis.com/token
- [DEBUG ] Starting new HTTPS connection (1): oauth2.googleapis.com:443
- [DEBUG ] https://oauth2.googleapis.com:443 "POST /token HTTP/1.1" 200 None
- [DEBUG ] Starting new HTTPS connection (1): www.googleapis.com:443
- [DEBUG ] https://www.googleapis.com:443 "GET /storage/v1/b/test-xtx-data?projection=noAcl HTTP/1.1" 200 438
- [DEBUG ] https://www.googleapis.com:443 "GET /download/storage/v1/b/test-xtx-data/o/datasets%2Fdataset_1_%2Ftest_files%2Fdatasets%2Fdata.csv?alt=media HTTP/1.1" 200 34208
- [INFO ] Blob datasets/dataset_1_/test_files/datasets/data.csv downloaded to tasks/task_1_642a758b/data.csv
- [INFO ] Unpacking submission zipfile to /tmp/tasks/task_1_642a758b
- [INFO ] Finding file submission.py in /tmp/tasks/task_1_642a758b
- [INFO ] Checking for a requirements.txt file
- [INFO ] Copying immutable files
- [INFO ] Creating result directory /tmp/tasks/task_1_642a758b/results/
- [INFO ] Task directory tasks/task_1_642a758b
- [INFO ] task_1_642a758b/
- [INFO ] submission.zip
- [INFO ] Dockerfile
- [INFO ] data.csv
- [INFO ] start_script.sh
- [INFO ] src/
- [INFO ] scorer.py
- [INFO ] model_tester.py
- [INFO ] python/
- [INFO ] requirements.txt
- [INFO ] submission.py
- [INFO ] core.py
- [INFO ] Building docker image
- Sending build context to Docker daemon 54.27kB
- Step 1/7 : FROM gcr.io/google_appengine/python
- ---> 59751e1615a4
- Step 2/7 : RUN virtualenv /env -p python3.6
- ---> Running in aa81a52ee1d4
- Running virtualenv with interpreter /opt/python3.6/bin/python3.6
- Using base prefix '/opt/python3.6'
- New python executable in /env/bin/python3.6
- Also creating executable in /env/bin/python
- Installing setuptools, pip, wheel...done.
- Removing intermediate container aa81a52ee1d4
- ---> 4faa4c5b7042
- Step 3/7 : ENV PATH /env/bin:$PATH
- ---> Running in 648f72fc2625
- Removing intermediate container 648f72fc2625
- ---> 7829bb406701
- Step 4/7 : ADD . /app
- ---> 39354cc0d210
- Step 5/7 : WORKDIR /app
- ---> Running in 2387f790f292
- Removing intermediate container 2387f790f292
- ---> 2ae81296be6c
- Step 6/7 : RUN pip3 install -r /app/python/requirements.txt
- ---> Running in 5053f4949066
- Removing intermediate container 5053f4949066
- ---> f74f73184d07
- Step 7/7 : CMD bash
- ---> Running in 0b6c24337a90
- Removing intermediate container 0b6c24337a90
- ---> eaf157e8ce6b
- Successfully built eaf157e8ce6b
- Successfully tagged sibling:latest
- [INFO ] Running command:
- [INFO ] docker run --network none --name task_1_642a758b -v /tmp/tasks/task_1_642a758b/results/:/app/results -itd sibling
- d1bcf994c0d10c1d88dfb552ff0ddeaf97e2438d2d64f3efbb49676e2ee279b7
- [DEBUG ] Starting new HTTP connection (1): host.docker.internal:8001
- [DEBUG ] http://host.docker.internal:8001 "POST /api/token/ HTTP/1.1" 200 438
- [INFO ] Saved token {'refresh': 'eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJ0b2tlbl90eXBlIjoicmVmcmVzaCIsImV4cCI6MTU1ODc0MTQ4NCwianRpIjoiNjJmMGJkOWNiOWY2NDIxOWJkNWRkZGQ4YmNiZDM3ZjUiLCJ1c2VyX2lkIjoyfQ.JRgqff-yTV4zbk5XbruWmBN0z2Xd94W6gwUXeNNNju8', 'access': 'eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJ0b2tlbl90eXBlIjoiYWNjZXNzIiwiZXhwIjoxNTU4OTU1MDg0LCJqdGkiOiJiNTk4NjlmM2FjNmU0NDM5YTljNWQ1YzJkMDExZDc5YyIsInVzZXJfaWQiOjJ9.SLSXP53k83nkuHliIhCVwTzZmz2NXgr1u2ouIx8ZqvQ'}
- [DEBUG ] Starting new HTTP connection (1): host.docker.internal:8001
- [DEBUG ] http://host.docker.internal:8001 "PUT /api/task/1 HTTP/1.1" 200 20
- [INFO ] Received response from backend {'status': 'success'}, status 200
- [INFO ] Executing start script
- [INFO ] Logging to file /tmp/tasks/task_1_642a758b/output.txt
- [INFO ] Polling process - try #0
- [SUBMISSION] You achieved an r2 value of -4.441121495327103.
- [INFO ] Extending deadline for ack_id WBFOBCEhPjA-RVNEUAYWLF1GSFE3GQhoUQ5PXiM_NSAoRRMLUxNRXHYTTBBvM1x1B1ENGHQsNHJrXhcABkxZf1VbCTxofmNxBFMKGHR9aHdiWRcECkd7_fSY5uKpHEZJP7vdtaVIQe_khvEwZhg9XBJLLD5-PTJFQV5AEkw2B0RJUytDCyo
- [INFO ] Finished running sibling container
- [INFO ] Uploading file /tmp/tasks/task_1_642a758b/output.txt to output/output_1_1.txt
- [DEBUG ] Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None)
- [DEBUG ] Making request: POST https://oauth2.googleapis.com/token
- [DEBUG ] Starting new HTTPS connection (1): oauth2.googleapis.com:443
- [DEBUG ] https://oauth2.googleapis.com:443 "POST /token HTTP/1.1" 200 None
- [DEBUG ] Starting new HTTPS connection (1): www.googleapis.com:443
- [DEBUG ] https://www.googleapis.com:443 "GET /storage/v1/b/test-xtx-data?projection=noAcl HTTP/1.1" 200 438
- [DEBUG ] https://www.googleapis.com:443 "POST /upload/storage/v1/b/test-xtx-data/o?uploadType=multipart HTTP/1.1" 200 765
- [INFO ] File /tmp/tasks/task_1_642a758b/output.txt uploaded to output/output_1_1.txt.
- [INFO ] Uploading file /tmp/tasks/task_1_642a758b/results/result.txt to results/result_1_1.txt
- [DEBUG ] Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None)
- [DEBUG ] Making request: POST https://oauth2.googleapis.com/token
- [DEBUG ] Starting new HTTPS connection (1): oauth2.googleapis.com:443
- [DEBUG ] https://oauth2.googleapis.com:443 "POST /token HTTP/1.1" 200 None
- [DEBUG ] Starting new HTTPS connection (1): www.googleapis.com:443
- [DEBUG ] https://www.googleapis.com:443 "GET /storage/v1/b/test-xtx-data?projection=noAcl HTTP/1.1" 200 438
- [DEBUG ] https://www.googleapis.com:443 "POST /upload/storage/v1/b/test-xtx-data/o?uploadType=multipart HTTP/1.1" 200 771
- [INFO ] File /tmp/tasks/task_1_642a758b/results/result.txt uploaded to results/result_1_1.txt.
- [INFO ] Received r2_score -4.441121495327103
- [INFO ] Succeeding task 1
- [DEBUG ] Starting new HTTP connection (1): host.docker.internal:8001
- [DEBUG ] http://host.docker.internal:8001 "POST /api/token/ HTTP/1.1" 200 438
- [INFO ] Saved token {'refresh': 'eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJ0b2tlbl90eXBlIjoicmVmcmVzaCIsImV4cCI6MTU1ODc0MTQ4OSwianRpIjoiM2ZmNGNjZDI5ODI1NDdmZWExZWVlN2Y2YmY0OGMwMTUiLCJ1c2VyX2lkIjoyfQ.rth_6XA_G6yINP_KrA2aQ4Itjyd_xLCtrMy6ZcySIfk', 'access': 'eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJ0b2tlbl90eXBlIjoiYWNjZXNzIiwiZXhwIjoxNTU4OTU1MDg5LCJqdGkiOiI0NDFhOTFmZTQ2NTY0YWVlYTFlZWJjNmJlN2RmYTg4YiIsInVzZXJfaWQiOjJ9.bTNd4ueKwWlW-odRn9FtmcrIEmTcr0g3rGGENqoj8RM'}
- [DEBUG ] Starting new HTTP connection (1): host.docker.internal:8001
- [DEBUG ] http://host.docker.internal:8001 "PUT /api/task/1 HTTP/1.1" 200 20
- [INFO ] Received response from backend {'status': 'success'}, status 200
- [INFO ] Ack'd message WBFOBCEhPjA-RVNEUAYWLF1GSFE3GQhoUQ5PXiM_NSAoRRMLUxNRXHYTTBBvM1x1B1ENGHQsNHJrXhcABkxZf1VbCTxofmNxBFMKGHR9aHdiWRcECkd7_fSY5uKpHEZJP7vdtaVIQe_khvEwZhg9XBJLLD5-PTJFQV5AEkw2B0RJUytDCyo
- Deleted Containers:
- 8dca9f641116896f30b34345bf2029d59c8029017bcdb4cac5735938438a2649
- 60b8a49eb1c215e4ec4878c97137e9567014715afab322f4f153c0bed2f1e884
- Total reclaimed space: 55.73kB
- [INFO ] Stopping container d1bcf994c0d1
- d1bcf994c0d1
- Untagged: sibling:latest
- Deleted: sha256:eaf157e8ce6b0b0a605e0487199d65bf9675ff4b9fd7ced98d87b101f2d0ac7c
- Deleted: sha256:f74f73184d0761cbe57587b90a064619a127b54b50f93e8aab07093f21622fb7
- Deleted: sha256:2ae81296be6ccaa7aee7554f1f0a639167897ace84d254439b98444e6189725a
- Deleted: sha256:39354cc0d210ab19fc1ecc0694c0de504d8371b18325daab04e83b96fd12de20
- Deleted: sha256:7829bb406701dbfba527a090adc0bd781864d486225841d6fdfe79c97df81683
- Deleted: sha256:4faa4c5b70421bd77c96aafe244b9309e1ab458a75da030e6918b74eecc95f6d
- [DEBUG ] Retrying due to 504 Deadline Exceeded, sleeping 0.1s ...
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement