Airflow
DAGs
Data Profiling
Browse
Admin
Docs
About
2020-03-31 20:27:16 UTC
 DAG: airflow_rateshopper Airflow Rateshopperschedule: 0 13 * * *
 Graph View
 Tree View
 Task Duration
 Task Tries
 Landing Times
 Gantt
 Details
 Code
 Trigger DAG
 Refresh
 Delete
Task Instance: upload_data
2020-03-30 13:00:00
 Task Instance Details
 Rendered Template
 Log
 XCom
Log by attempts
1
2
3
4
Jump to end
Toggle wrap
*** Reading local file: /home/rmzg/Edmond/airflow/logs/airflow_rateshopper/upload_data/2020-03-30T13:00:00+00:00/4.log
[2020-03-31 20:15:27,586] {taskinstance.py:655} INFO - Dependencies all met for <TaskInstance: airflow_rateshopper.upload_data 2020-03-30T13:00:00+00:00 [queued]>
[2020-03-31 20:15:27,623] {taskinstance.py:655} INFO - Dependencies all met for <TaskInstance: airflow_rateshopper.upload_data 2020-03-30T13:00:00+00:00 [queued]>
[2020-03-31 20:15:27,623] {taskinstance.py:866} INFO -
--------------------------------------------------------------------------------
[2020-03-31 20:15:27,623] {taskinstance.py:867} INFO - Starting attempt 4 of 16
[2020-03-31 20:15:27,623] {taskinstance.py:868} INFO -
--------------------------------------------------------------------------------
[2020-03-31 20:15:27,632] {taskinstance.py:887} INFO - Executing <Task(PythonOperator): upload_data> on 2020-03-30T13:00:00+00:00
[2020-03-31 20:15:27,639] {standard_task_runner.py:52} INFO - Started process 46809 to run task
[2020-03-31 20:15:27,699] {logging_mixin.py:112} INFO - [2020-03-31 20:15:27,698] {dagbag.py:403} INFO - Filling up the DagBag from /home/rmzg/Edmond/airflow/dags/rateshopper-airflow.py
[2020-03-31 20:15:27,742] {logging_mixin.py:112} INFO - Running %s on host %s <TaskInstance: airflow_rateshopper.upload_data 2020-03-30T13:00:00+00:00 [running]> edmond-bbzg
[2020-03-31 20:15:27,776] {python_operator.py:105} INFO - Exporting the following env vars:
AIRFLOW_CTX_DAG_EMAIL=ivan.rezic@maistra.hr
AIRFLOW_CTX_DAG_OWNER=airflow
AIRFLOW_CTX_DAG_ID=airflow_rateshopper
AIRFLOW_CTX_TASK_ID=upload_data
AIRFLOW_CTX_EXECUTION_DATE=2020-03-30T13:00:00+00:00
AIRFLOW_CTX_DAG_RUN_ID=scheduled__2020-03-30T13:00:00+00:00
[2020-03-31 20:15:27,777] {logging_mixin.py:112} INFO - [2020-03-31 20:15:27,776] {upload_data.py:28} INFO - Creating TransferData
[2020-03-31 20:15:27,780] {logging_mixin.py:112} WARNING -
  0%|          | 0/6 [00:00<?, ?it/s]
[2020-03-31 20:15:27,780] {logging_mixin.py:112} INFO - [2020-03-31 20:15:27,780] {upload_data.py:36} INFO - Entering TransferData.upload_file
[2020-03-31 20:15:27,780] {logging_mixin.py:112} INFO - [2020-03-31 20:15:27,780] {upload_data.py:19} INFO - Creating dbx with access_token
[2020-03-31 20:15:27,799] {logging_mixin.py:112} INFO - [2020-03-31 20:15:27,799] {dropbox.py:358} INFO - Request to files/upload
[2020-03-31 20:15:27,933] {logging_mixin.py:112} WARNING -
  0%|          | 0/6 [00:00<?, ?it/s]
[2020-03-31 20:15:27,933] {logging_mixin.py:112} WARNING -
[2020-03-31 20:15:27,933] {taskinstance.py:1088} ERROR - HTTPSConnectionPool(host='content.dropboxapi.com', port=443): Max retries exceeded with url: /2/files/upload (Caused by SSLError(SSLError("bad handshake: Error([('SSL routines', 'tls_process_server_certificate', 'certificate verify failed')])")))
Traceback (most recent call last):
  File "/home/rmzg/anaconda3/envs/edmond-env/lib/python3.7/site-packages/urllib3/contrib/pyopenssl.py", line 485, in wrap_socket
    cnx.do_handshake()
  File "/home/rmzg/anaconda3/envs/edmond-env/lib/python3.7/site-packages/OpenSSL/SSL.py", line 1934, in do_handshake
    self._raise_ssl_error(self._ssl, result)
  File "/home/rmzg/anaconda3/envs/edmond-env/lib/python3.7/site-packages/OpenSSL/SSL.py", line 1671, in _raise_ssl_error
    _raise_current_error()
  File "/home/rmzg/anaconda3/envs/edmond-env/lib/python3.7/site-packages/OpenSSL/_util.py", line 54, in exception_from_error_queue
    raise exception_type(errors)
OpenSSL.SSL.Error: [('SSL routines', 'tls_process_server_certificate', 'certificate verify failed')]

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/rmzg/anaconda3/envs/edmond-env/lib/python3.7/site-packages/urllib3/connectionpool.py", line 672, in urlopen
    chunked=chunked,
  File "/home/rmzg/anaconda3/envs/edmond-env/lib/python3.7/site-packages/urllib3/connectionpool.py", line 376, in _make_request
    self._validate_conn(conn)
  File "/home/rmzg/anaconda3/envs/edmond-env/lib/python3.7/site-packages/urllib3/connectionpool.py", line 994, in _validate_conn
    conn.connect()
  File "/home/rmzg/anaconda3/envs/edmond-env/lib/python3.7/site-packages/urllib3/connection.py", line 360, in connect
    ssl_context=context,
  File "/home/rmzg/anaconda3/envs/edmond-env/lib/python3.7/site-packages/urllib3/util/ssl_.py", line 370, in ssl_wrap_socket
    return context.wrap_socket(sock, server_hostname=server_hostname)
  File "/home/rmzg/anaconda3/envs/edmond-env/lib/python3.7/site-packages/urllib3/contrib/pyopenssl.py", line 491, in wrap_socket
    raise ssl.SSLError("bad handshake: %r" % e)
ssl.SSLError: ("bad handshake: Error([('SSL routines', 'tls_process_server_certificate', 'certificate verify failed')])",)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/rmzg/anaconda3/envs/edmond-env/lib/python3.7/site-packages/requests/adapters.py", line 449, in send
    timeout=timeout
  File "/home/rmzg/anaconda3/envs/edmond-env/lib/python3.7/site-packages/urllib3/connectionpool.py", line 720, in urlopen
    method, url, error=e, _pool=self, _stacktrace=sys.exc_info()[2]
  File "/home/rmzg/anaconda3/envs/edmond-env/lib/python3.7/site-packages/urllib3/util/retry.py", line 436, in increment
    raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='content.dropboxapi.com', port=443): Max retries exceeded with url: /2/files/upload (Caused by SSLError(SSLError("bad handshake: Error([('SSL routines', 'tls_process_server_certificate', 'certificate verify failed')])")))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/rmzg/anaconda3/envs/edmond-env/lib/python3.7/site-packages/airflow/models/taskinstance.py", line 955, in _run_raw_task
    result = task_copy.execute(context=context)
  File "/home/rmzg/anaconda3/envs/edmond-env/lib/python3.7/site-packages/airflow/operators/python_operator.py", line 113, in execute
    return_value = self.execute_callable()
  File "/home/rmzg/anaconda3/envs/edmond-env/lib/python3.7/site-packages/airflow/operators/python_operator.py", line 118, in execute_callable
    return self.python_callable(*self.op_args, **self.op_kwargs)
  File "/home/rmzg/Edmond/src/rateshopper/upload_data.py", line 48, in main
    upload_last_state_data_to_dropbox(list_of_files)
  File "/home/rmzg/Edmond/src/rateshopper/upload_data.py", line 37, in upload_last_state_data_to_dropbox
    transferData.upload_file(file_from, file_to, )
  File "/home/rmzg/Edmond/src/rateshopper/upload_data.py", line 23, in upload_file
    dbx.files_upload(f.read(), file_to, mode=WriteMode('overwrite'))
  File "/home/rmzg/anaconda3/envs/edmond-env/lib/python3.7/site-packages/dropbox/base.py", line 2458, in files_upload
    f,
  File "/home/rmzg/anaconda3/envs/edmond-env/lib/python3.7/site-packages/dropbox/dropbox.py", line 274, in request
    timeout=timeout)
  File "/home/rmzg/anaconda3/envs/edmond-env/lib/python3.7/site-packages/dropbox/dropbox.py", line 365, in request_json_string_with_retry
    timeout=timeout)
  File "/home/rmzg/anaconda3/envs/edmond-env/lib/python3.7/site-packages/dropbox/dropbox.py", line 449, in request_json_string
    timeout=timeout,
  File "/home/rmzg/anaconda3/envs/edmond-env/lib/python3.7/site-packages/requests/sessions.py", line 578, in post
    return self.request('POST', url, data=data, json=json, **kwargs)
  File "/home/rmzg/anaconda3/envs/edmond-env/lib/python3.7/site-packages/requests/sessions.py", line 530, in request
    resp = self.send(prep, **send_kwargs)
  File "/home/rmzg/anaconda3/envs/edmond-env/lib/python3.7/site-packages/requests/sessions.py", line 643, in send
    r = adapter.send(request, **kwargs)
  File "/home/rmzg/anaconda3/envs/edmond-env/lib/python3.7/site-packages/requests/adapters.py", line 514, in send
    raise SSLError(e, request=request)
requests.exceptions.SSLError: HTTPSConnectionPool(host='content.dropboxapi.com', port=443): Max retries exceeded with url: /2/files/upload (Caused by SSLError(SSLError("bad handshake: Error([('SSL routines', 'tls_process_server_certificate', 'certificate verify failed')])")))
[2020-03-31 20:15:27,940] {taskinstance.py:1111} INFO - Marking task as UP_FOR_RETRY
[2020-03-31 20:15:37,552] {logging_mixin.py:112} INFO - [2020-03-31 20:15:37,551] {local_task_job.py:103} INFO - Task exited with return code 1