Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- ~~~~ Execution Summary ~~~~
- RUN_INGEST - {'errors': [],
- 'exec_id': 'baf06f55-65cb-47cd-97aa-6b4b85238eb9',
- 'infos': ['2022-06-20 09:45:14.228932 [exec_id=baf06f55-65cb-47cd-97aa-6b4b85238eb9] INFO: Starting execution for task with name=RUN_INGEST',
- '2022-06-20 09:46:57.667957 [exec_id=baf06f55-65cb-47cd-97aa-6b4b85238eb9] INFO: stdout=Requirement already satisfied: pip in '
- '/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages (21.2.4)\n'
- 'Collecting pip\n'
- ' Using cached pip-22.1.2-py3-none-any.whl (2.1 MB)\n'
- 'Collecting wheel\n'
- ' Using cached wheel-0.37.1-py2.py3-none-any.whl (35 kB)\n'
- 'Requirement already satisfied: setuptools in /tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages '
- '(58.1.0)\n'
- 'Collecting setuptools\n'
- ' Using cached setuptools-62.6.0-py3-none-any.whl (1.2 MB)\n'
- 'Installing collected packages: wheel, setuptools, pip\n'
- ' Attempting uninstall: setuptools\n'
- ' Found existing installation: setuptools 58.1.0\n'
- ' Uninstalling setuptools-58.1.0:\n'
- ' Successfully uninstalled setuptools-58.1.0\n'
- ' Attempting uninstall: pip\n'
- ' Found existing installation: pip 21.2.4\n'
- ' Uninstalling pip-21.2.4:\n'
- ' Successfully uninstalled pip-21.2.4\n'
- 'Successfully installed pip-22.1.2 setuptools-62.6.0 wheel-0.37.1\n'
- 'Collecting acryl-datahub[datahub-rest,postgres]==0.8.38\n'
- ' Using cached acryl_datahub-0.8.38-py3-none-any.whl (877 kB)\n'
- 'Collecting toml>=0.10.0\n'
- ' Using cached toml-0.10.2-py2.py3-none-any.whl (16 kB)\n'
- 'Collecting termcolor>=1.0.0\n'
- ' Using cached termcolor-1.1.0-py3-none-any.whl\n'
- 'Collecting packaging\n'
- ' Using cached packaging-21.3-py3-none-any.whl (40 kB)\n'
- 'Collecting PyYAML\n'
- ' Using cached PyYAML-6.0-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (661 kB)\n'
- 'Collecting psutil>=5.8.0\n'
- ' Using cached psutil-5.9.1-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (281 '
- 'kB)\n'
- 'Collecting entrypoints\n'
- ' Using cached entrypoints-0.4-py3-none-any.whl (5.3 kB)\n'
- 'Collecting python-dateutil>=2.8.0\n'
- ' Using cached python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB)\n'
- 'Collecting Deprecated\n'
- ' Using cached Deprecated-1.2.13-py2.py3-none-any.whl (9.6 kB)\n'
- 'Collecting typing-extensions>=3.10.0.2\n'
- ' Using cached typing_extensions-4.2.0-py3-none-any.whl (24 kB)\n'
- 'Collecting humanfriendly\n'
- ' Using cached humanfriendly-10.0-py2.py3-none-any.whl (86 kB)\n'
- 'Collecting tabulate\n'
- ' Using cached tabulate-0.8.9-py3-none-any.whl (25 kB)\n'
- 'Collecting click-default-group\n'
- ' Using cached click_default_group-1.2.2-py3-none-any.whl\n'
- 'Collecting avro<1.11,>=1.10.2\n'
- ' Using cached avro-1.10.2-py3-none-any.whl\n'
- 'Collecting docker\n'
- ' Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)\n'
- 'Collecting click>=6.0.0\n'
- ' Using cached click-8.1.3-py3-none-any.whl (96 kB)\n'
- 'Collecting avro-gen3==0.7.4\n'
- ' Using cached avro_gen3-0.7.4-py3-none-any.whl (26 kB)\n'
- 'Collecting mixpanel>=4.9.0\n'
- ' Using cached mixpanel-4.9.0-py2.py3-none-any.whl (8.9 kB)\n'
- 'Collecting pydantic>=1.5.1\n'
- ' Using cached pydantic-1.9.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (12.4 MB)\n'
- 'Collecting stackprinter\n'
- ' Using cached stackprinter-0.2.6-py3-none-any.whl (28 kB)\n'
- 'Collecting expandvars>=0.6.5\n'
- ' Using cached expandvars-0.9.0-py3-none-any.whl (6.6 kB)\n'
- 'Collecting types-termcolor>=1.0.0\n'
- ' Using cached types_termcolor-1.1.4-py3-none-any.whl (2.1 kB)\n'
- 'Collecting mypy-extensions>=0.4.3\n'
- ' Using cached mypy_extensions-0.4.3-py2.py3-none-any.whl (4.5 kB)\n'
- 'Collecting ratelimiter\n'
- ' Using cached ratelimiter-1.2.0.post0-py3-none-any.whl (6.6 kB)\n'
- 'Collecting markupsafe<=2.0.1,>=1.1.1\n'
- ' Using cached MarkupSafe-2.0.1-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (30 kB)\n'
- 'Collecting types-Deprecated\n'
- ' Using cached types_Deprecated-1.2.8-py3-none-any.whl (3.1 kB)\n'
- 'Collecting typing-inspect\n'
- ' Using cached typing_inspect-0.7.1-py3-none-any.whl (8.4 kB)\n'
- 'Collecting progressbar2\n'
- ' Using cached progressbar2-4.0.0-py2.py3-none-any.whl (26 kB)\n'
- 'Collecting GeoAlchemy2\n'
- ' Using cached GeoAlchemy2-0.12.1-py2.py3-none-any.whl (50 kB)\n'
- 'Collecting psycopg2-binary\n'
- ' Using cached psycopg2_binary-2.9.3-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)\n'
- 'Collecting greenlet\n'
- ' Using cached greenlet-1.1.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (153 kB)\n'
- 'Collecting Jinja2<3.1.0\n'
- ' Using cached Jinja2-3.0.3-py3-none-any.whl (133 kB)\n'
- 'Collecting great-expectations<0.15.3,>=0.14.11\n'
- ' Using cached great_expectations-0.15.2-py3-none-any.whl (5.0 MB)\n'
- 'Collecting sqlalchemy==1.3.24\n'
- ' Using cached SQLAlchemy-1.3.24-cp39-cp39-manylinux2010_x86_64.whl (1.3 MB)\n'
- 'Collecting traitlets<5.2.2\n'
- ' Using cached traitlets-5.2.1.post0-py3-none-any.whl (106 kB)\n'
- 'Collecting requests\n'
- ' Using cached requests-2.28.0-py3-none-any.whl (62 kB)\n'
- 'Collecting tzlocal\n'
- ' Using cached tzlocal-4.2-py3-none-any.whl (19 kB)\n'
- 'Collecting pytz\n'
- ' Using cached pytz-2022.1-py2.py3-none-any.whl (503 kB)\n'
- 'Collecting six\n'
- ' Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)\n'
- 'Collecting cryptography>=3.2\n'
- ' Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)\n'
- 'Collecting urllib3<1.27,>=1.25.4\n'
- ' Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)\n'
- 'Collecting ruamel.yaml<0.17.18,>=0.16\n'
- ' Using cached ruamel.yaml-0.17.17-py3-none-any.whl (109 kB)\n'
- 'Collecting jsonpatch>=1.22\n'
- ' Using cached jsonpatch-1.32-py2.py3-none-any.whl (12 kB)\n'
- 'Collecting altair<5,>=4.0.0\n'
- ' Using cached altair-4.2.0-py3-none-any.whl (812 kB)\n'
- 'Collecting importlib-metadata>=1.7.0\n'
- ' Using cached importlib_metadata-4.11.4-py3-none-any.whl (18 kB)\n'
- 'Collecting numpy>=1.14.1\n'
- ' Using cached numpy-1.22.4-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (16.8 MB)\n'
- 'Collecting scipy>=0.19.0\n'
- ' Using cached scipy-1.8.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (42.2 MB)\n'
- 'Collecting notebook>=6.4.10\n'
- ' Using cached notebook-6.4.12-py3-none-any.whl (9.9 MB)\n'
- 'Collecting tqdm>=4.59.0\n'
- ' Using cached tqdm-4.64.0-py2.py3-none-any.whl (78 kB)\n'
- 'Collecting colorama>=0.4.3\n'
- ' Using cached colorama-0.4.5-py2.py3-none-any.whl (16 kB)\n'
- 'Collecting nbformat>=5.0\n'
- ' Using cached nbformat-5.4.0-py3-none-any.whl (73 kB)\n'
- 'Collecting pyparsing<3,>=2.4\n'
- ' Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)\n'
- 'Collecting jsonschema>=2.5.1\n'
- ' Using cached jsonschema-4.6.0-py3-none-any.whl (80 kB)\n'
- 'Collecting mistune>=0.8.4\n'
- ' Using cached mistune-2.0.2-py2.py3-none-any.whl (24 kB)\n'
- 'Collecting Ipython>=7.16.3\n'
- ' Using cached ipython-8.4.0-py3-none-any.whl (750 kB)\n'
- 'Collecting pandas>=0.23.0\n'
- ' Using cached pandas-1.4.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.7 MB)\n'
- 'Collecting charset-normalizer~=2.0.0\n'
- ' Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)\n'
- 'Collecting certifi>=2017.4.17\n'
- ' Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)\n'
- 'Collecting idna<4,>=2.5\n'
- ' Using cached idna-3.3-py3-none-any.whl (61 kB)\n'
- 'Collecting wrapt<2,>=1.10\n'
- ' Using cached wrapt-1.14.1-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (77 kB)\n'
- 'Collecting websocket-client>=0.32.0\n'
- ' Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)\n'
- 'Collecting GeoAlchemy2\n'
- ' Using cached GeoAlchemy2-0.12.0-py2.py3-none-any.whl (50 kB)\n'
- ' Using cached GeoAlchemy2-0.11.1-py2.py3-none-any.whl (45 kB)\n'
- 'Collecting python-utils>=3.0.0\n'
- ' Using cached python_utils-3.3.3-py2.py3-none-any.whl (23 kB)\n'
- 'Collecting toolz\n'
- ' Using cached toolz-0.11.2-py3-none-any.whl (55 kB)\n'
- 'Collecting cffi>=1.12\n'
- ' Using cached cffi-1.15.0-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (444 kB)\n'
- 'Collecting zipp>=0.5\n'
- ' Using cached zipp-3.8.0-py3-none-any.whl (5.4 kB)\n'
- 'Collecting pygments>=2.4.0\n'
- ' Using cached Pygments-2.12.0-py3-none-any.whl (1.1 MB)\n'
- 'Collecting stack-data\n'
- ' Using cached stack_data-0.3.0-py3-none-any.whl (23 kB)\n'
- 'Collecting jedi>=0.16\n'
- ' Using cached jedi-0.18.1-py2.py3-none-any.whl (1.6 MB)\n'
- 'Collecting decorator\n'
- ' Using cached decorator-5.1.1-py3-none-any.whl (9.1 kB)\n'
- 'Collecting pexpect>4.3\n'
- ' Using cached pexpect-4.8.0-py2.py3-none-any.whl (59 kB)\n'
- 'Collecting pickleshare\n'
- ' Using cached pickleshare-0.7.5-py2.py3-none-any.whl (6.9 kB)\n'
- 'Requirement already satisfied: setuptools>=18.5 in '
- '/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages (from '
- 'Ipython>=7.16.3->great-expectations<0.15.3,>=0.14.11->acryl-datahub[datahub-rest,postgres]==0.8.38->-r '
- '/tmp/datahub/ingest/requirements-baf06f55-65cb-47cd-97aa-6b4b85238eb9.txt (line 1)) (62.6.0)\n'
- 'Collecting matplotlib-inline\n'
- ' Using cached matplotlib_inline-0.1.3-py3-none-any.whl (8.2 kB)\n'
- 'Collecting prompt-toolkit!=3.0.0,!=3.0.1,<3.1.0,>=2.0.0\n'
- ' Using cached prompt_toolkit-3.0.29-py3-none-any.whl (381 kB)\n'
- 'Collecting backcall\n'
- ' Using cached backcall-0.2.0-py2.py3-none-any.whl (11 kB)\n'
- 'Collecting jsonpointer>=1.9\n'
- ' Using cached jsonpointer-2.3-py2.py3-none-any.whl (7.8 kB)\n'
- 'Collecting pyrsistent!=0.17.0,!=0.17.1,!=0.17.2,>=0.14.0\n'
- ' Using cached pyrsistent-0.18.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (115 kB)\n'
- 'Collecting attrs>=17.4.0\n'
- ' Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)\n'
- 'Collecting fastjsonschema\n'
- ' Using cached fastjsonschema-2.15.3-py3-none-any.whl (22 kB)\n'
- 'Collecting jupyter-core\n'
- ' Using cached jupyter_core-4.10.0-py3-none-any.whl (87 kB)\n'
- 'Collecting ipython-genutils\n'
- ' Using cached ipython_genutils-0.2.0-py2.py3-none-any.whl (26 kB)\n'
- 'Collecting nbconvert>=5\n'
- ' Using cached nbconvert-6.5.0-py3-none-any.whl (561 kB)\n'
- 'Collecting terminado>=0.8.3\n'
- ' Using cached terminado-0.15.0-py3-none-any.whl (16 kB)\n'
- 'Collecting nest-asyncio>=1.5\n'
- ' Using cached nest_asyncio-1.5.5-py3-none-any.whl (5.2 kB)\n'
- 'Collecting ipykernel\n'
- ' Using cached ipykernel-6.15.0-py3-none-any.whl (133 kB)\n'
- 'Collecting Send2Trash>=1.8.0\n'
- ' Using cached Send2Trash-1.8.0-py3-none-any.whl (18 kB)\n'
- 'Collecting tornado>=6.1\n'
- ' Using cached tornado-6.1-cp39-cp39-manylinux2010_x86_64.whl (427 kB)\n'
- 'Collecting argon2-cffi\n'
- ' Using cached argon2_cffi-21.3.0-py3-none-any.whl (14 kB)\n'
- 'Collecting jupyter-client>=5.3.4\n'
- ' Using cached jupyter_client-7.3.4-py3-none-any.whl (132 kB)\n'
- 'Collecting pyzmq>=17\n'
- ' Using cached pyzmq-23.1.0-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (1.1 MB)\n'
- 'Collecting prometheus-client\n'
- ' Using cached prometheus_client-0.14.1-py3-none-any.whl (59 kB)\n'
- 'Collecting ruamel.yaml.clib>=0.1.2\n'
- ' Using cached ruamel.yaml.clib-0.2.6-cp39-cp39-manylinux1_x86_64.whl (539 kB)\n'
- 'Collecting pytz-deprecation-shim\n'
- ' Using cached pytz_deprecation_shim-0.1.0.post0-py2.py3-none-any.whl (15 kB)\n'
- 'Collecting pycparser\n'
- ' Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)\n'
- 'Collecting parso<0.9.0,>=0.8.0\n'
- ' Using cached parso-0.8.3-py2.py3-none-any.whl (100 kB)\n'
- 'Collecting beautifulsoup4\n'
- ' Using cached beautifulsoup4-4.11.1-py3-none-any.whl (128 kB)\n'
- 'Collecting mistune>=0.8.4\n'
- ' Using cached mistune-0.8.4-py2.py3-none-any.whl (16 kB)\n'
- 'Collecting bleach\n'
- ' Using cached bleach-5.0.0-py3-none-any.whl (160 kB)\n'
- 'Collecting jupyterlab-pygments\n'
- ' Using cached jupyterlab_pygments-0.2.2-py2.py3-none-any.whl (21 kB)\n'
- 'Collecting defusedxml\n'
- ' Using cached defusedxml-0.7.1-py2.py3-none-any.whl (25 kB)\n'
- 'Collecting tinycss2\n'
- ' Using cached tinycss2-1.1.1-py3-none-any.whl (21 kB)\n'
- 'Collecting nbclient>=0.5.0\n'
- ' Using cached nbclient-0.6.4-py3-none-any.whl (71 kB)\n'
- 'Collecting pandocfilters>=1.4.1\n'
- ' Using cached pandocfilters-1.5.0-py2.py3-none-any.whl (8.7 kB)\n'
- 'Collecting ptyprocess>=0.5\n'
- ' Using cached ptyprocess-0.7.0-py2.py3-none-any.whl (13 kB)\n'
- 'Collecting wcwidth\n'
- ' Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)\n'
- 'Collecting argon2-cffi-bindings\n'
- ' Using cached argon2_cffi_bindings-21.2.0-cp36-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (86 kB)\n'
- 'Collecting debugpy>=1.0\n'
- ' Using cached debugpy-1.6.0-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (1.8 MB)\n'
- 'Collecting tzdata\n'
- ' Using cached tzdata-2022.1-py2.py3-none-any.whl (339 kB)\n'
- 'Collecting pure-eval\n'
- ' Using cached pure_eval-0.2.2-py3-none-any.whl (11 kB)\n'
- 'Collecting executing\n'
- ' Using cached executing-0.8.3-py2.py3-none-any.whl (16 kB)\n'
- 'Collecting asttokens\n'
- ' Using cached asttokens-2.0.5-py2.py3-none-any.whl (20 kB)\n'
- 'Collecting nbclient>=0.5.0\n'
- ' Using cached nbclient-0.6.3-py3-none-any.whl (71 kB)\n'
- 'Collecting soupsieve>1.2\n'
- ' Using cached soupsieve-2.3.2.post1-py3-none-any.whl (37 kB)\n'
- 'Collecting webencodings\n'
- ' Using cached webencodings-0.5.1-py2.py3-none-any.whl (11 kB)\n'
- 'Installing collected packages: webencodings, wcwidth, types-termcolor, types-Deprecated, termcolor, tabulate, Send2Trash, ratelimiter, '
- 'pytz, pure-eval, ptyprocess, pickleshare, mypy-extensions, mistune, ipython-genutils, fastjsonschema, executing, backcall, zipp, wrapt, '
- 'websocket-client, urllib3, tzdata, typing-extensions, traitlets, tqdm, tornado, toolz, toml, tinycss2, stackprinter, sqlalchemy, '
- 'soupsieve, six, ruamel.yaml.clib, pyzmq, PyYAML, python-utils, pyrsistent, pyparsing, pygments, pycparser, psycopg2-binary, psutil, '
- 'prompt-toolkit, prometheus-client, pexpect, parso, pandocfilters, numpy, nest-asyncio, markupsafe, jupyterlab-pygments, jsonpointer, '
- 'idna, humanfriendly, greenlet, expandvars, entrypoints, defusedxml, decorator, debugpy, colorama, click, charset-normalizer, certifi, '
- 'avro, attrs, typing-inspect, terminado, scipy, ruamel.yaml, requests, pytz-deprecation-shim, python-dateutil, pydantic, progressbar2, '
- 'packaging, matplotlib-inline, jupyter-core, jsonschema, jsonpatch, Jinja2, jedi, importlib-metadata, Deprecated, click-default-group, '
- 'cffi, bleach, beautifulsoup4, asttokens, tzlocal, stack-data, pandas, nbformat, mixpanel, jupyter-client, GeoAlchemy2, docker, '
- 'cryptography, argon2-cffi-bindings, nbclient, Ipython, avro-gen3, argon2-cffi, altair, nbconvert, ipykernel, acryl-datahub, notebook, '
- 'great-expectations\n'
- 'Successfully installed Deprecated-1.2.13 GeoAlchemy2-0.11.1 Ipython-8.4.0 Jinja2-3.0.3 PyYAML-6.0 Send2Trash-1.8.0 acryl-datahub-0.8.38 '
- 'altair-4.2.0 argon2-cffi-21.3.0 argon2-cffi-bindings-21.2.0 asttokens-2.0.5 attrs-21.4.0 avro-1.10.2 avro-gen3-0.7.4 backcall-0.2.0 '
- 'beautifulsoup4-4.11.1 bleach-5.0.0 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 click-8.1.3 click-default-group-1.2.2 '
- 'colorama-0.4.5 cryptography-37.0.2 debugpy-1.6.0 decorator-5.1.1 defusedxml-0.7.1 docker-5.0.3 entrypoints-0.4 executing-0.8.3 '
- 'expandvars-0.9.0 fastjsonschema-2.15.3 great-expectations-0.15.2 greenlet-1.1.2 humanfriendly-10.0 idna-3.3 importlib-metadata-4.11.4 '
- 'ipykernel-6.15.0 ipython-genutils-0.2.0 jedi-0.18.1 jsonpatch-1.32 jsonpointer-2.3 jsonschema-4.6.0 jupyter-client-7.3.4 '
- 'jupyter-core-4.10.0 jupyterlab-pygments-0.2.2 markupsafe-2.0.1 matplotlib-inline-0.1.3 mistune-0.8.4 mixpanel-4.9.0 '
- 'mypy-extensions-0.4.3 nbclient-0.6.3 nbconvert-6.5.0 nbformat-5.4.0 nest-asyncio-1.5.5 notebook-6.4.12 numpy-1.22.4 packaging-21.3 '
- 'pandas-1.4.2 pandocfilters-1.5.0 parso-0.8.3 pexpect-4.8.0 pickleshare-0.7.5 progressbar2-4.0.0 prometheus-client-0.14.1 '
- 'prompt-toolkit-3.0.29 psutil-5.9.1 psycopg2-binary-2.9.3 ptyprocess-0.7.0 pure-eval-0.2.2 pycparser-2.21 pydantic-1.9.1 pygments-2.12.0 '
- 'pyparsing-2.4.7 pyrsistent-0.18.1 python-dateutil-2.8.2 python-utils-3.3.3 pytz-2022.1 pytz-deprecation-shim-0.1.0.post0 pyzmq-23.1.0 '
- 'ratelimiter-1.2.0.post0 requests-2.28.0 ruamel.yaml-0.17.17 ruamel.yaml.clib-0.2.6 scipy-1.8.1 six-1.16.0 soupsieve-2.3.2.post1 '
- 'sqlalchemy-1.3.24 stack-data-0.3.0 stackprinter-0.2.6 tabulate-0.8.9 termcolor-1.1.0 terminado-0.15.0 tinycss2-1.1.1 toml-0.10.2 '
- 'toolz-0.11.2 tornado-6.1 tqdm-4.64.0 traitlets-5.2.1.post0 types-Deprecated-1.2.8 types-termcolor-1.1.4 typing-extensions-4.2.0 '
- 'typing-inspect-0.7.1 tzdata-2022.1 tzlocal-4.2 urllib3-1.26.9 wcwidth-0.2.5 webencodings-0.5.1 websocket-client-1.3.3 wrapt-1.14.1 '
- 'zipp-3.8.0\n'
- '[2022-06-20 09:46:43,941] INFO {datahub.cli.ingest_cli:99} - DataHub CLI version: 0.8.38\n'
- '[2022-06-20 09:46:43,962] WARNING {urllib3.connectionpool:810} - Retrying (Retry(total=2, connect=None, read=None, redirect=None, '
- "status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7eff673b6400>: Failed to "
- "establish a new connection: [Errno 111] Connection refused')': /config\n"
- '[2022-06-20 09:46:47,965] WARNING {urllib3.connectionpool:810} - Retrying (Retry(total=1, connect=None, read=None, redirect=None, '
- "status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7eff673b6610>: Failed to "
- "establish a new connection: [Errno 111] Connection refused')': /config\n"
- '[2022-06-20 09:46:55,977] WARNING {urllib3.connectionpool:810} - Retrying (Retry(total=0, connect=None, read=None, redirect=None, '
- "status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7eff673b6820>: Failed to "
- "establish a new connection: [Errno 111] Connection refused')': /config\n"
- '[2022-06-20 09:46:56,770] ERROR {datahub.entrypoints:167} - File '
- '"/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/urllib3/connection.py", line 174, in '
- '_new_conn\n'
- ' 161 def _new_conn(self):\n'
- ' (...)\n'
- ' 170 if self.socket_options:\n'
- ' 171 extra_kw["socket_options"] = self.socket_options\n'
- ' 172 \n'
- ' 173 try:\n'
- '--> 174 conn = connection.create_connection(\n'
- ' 175 (self._dns_host, self.port), self.timeout, **extra_kw\n'
- '\n'
- 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/urllib3/util/connection.py", line 95, in '
- 'create_connection\n'
- ' 37 def create_connection(\n'
- ' 38 address,\n'
- ' 39 timeout=socket._GLOBAL_DEFAULT_TIMEOUT,\n'
- ' 40 source_address=None,\n'
- ' 41 socket_options=None,\n'
- ' 42 ):\n'
- ' (...)\n'
- ' 91 sock.close()\n'
- ' 92 sock = None\n'
- ' 93 \n'
- ' 94 if err is not None:\n'
- '--> 95 raise err\n'
- ' 96 \n'
- '\n'
- 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/urllib3/util/connection.py", line 85, in '
- 'create_connection\n'
- ' 37 def create_connection(\n'
- ' 38 address,\n'
- ' 39 timeout=socket._GLOBAL_DEFAULT_TIMEOUT,\n'
- ' 40 source_address=None,\n'
- ' 41 socket_options=None,\n'
- ' 42 ):\n'
- ' (...)\n'
- ' 81 if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT:\n'
- ' 82 sock.settimeout(timeout)\n'
- ' 83 if source_address:\n'
- ' 84 sock.bind(source_address)\n'
- '--> 85 sock.connect(sa)\n'
- ' 86 return sock\n'
- '\n'
- 'ConnectionRefusedError: [Errno 111] Connection refused\n'
- '\n'
- 'While handling the above exception, another exception occurred:\n'
- '\n'
- 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/urllib3/connectionpool.py", line 703, in '
- 'urlopen\n'
- ' 522 def urlopen(\n'
- ' 523 self,\n'
- ' 524 method,\n'
- ' 525 url,\n'
- ' 526 body=None,\n'
- ' 527 headers=None,\n'
- ' 528 retries=None,\n'
- ' 529 redirect=True,\n'
- ' 530 assert_same_host=True,\n'
- ' 531 timeout=_Default,\n'
- ' 532 pool_timeout=None,\n'
- ' 533 release_conn=None,\n'
- ' 534 chunked=False,\n'
- ' 535 body_pos=None,\n'
- ' 536 **response_kw\n'
- ' 537 ):\n'
- ' (...)\n'
- ' 699 if is_new_proxy_conn and http_tunnel_required:\n'
- ' 700 self._prepare_proxy(conn)\n'
- ' 701 \n'
- ' 702 # Make the request on the httplib connection object.\n'
- '--> 703 httplib_response = self._make_request(\n'
- ' 704 conn,\n'
- '\n'
- 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/urllib3/connectionpool.py", line 398, in '
- '_make_request\n'
- ' 361 def _make_request(\n'
- ' 362 self, conn, method, url, timeout=_Default, chunked=False, **httplib_request_kw\n'
- ' 363 ):\n'
- ' (...)\n'
- ' 394 try:\n'
- ' 395 if chunked:\n'
- ' 396 conn.request_chunked(method, url, **httplib_request_kw)\n'
- ' 397 else:\n'
- '--> 398 conn.request(method, url, **httplib_request_kw)\n'
- ' 399 \n'
- '\n'
- 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/urllib3/connection.py", line 239, in '
- 'request\n'
- ' 231 def request(self, method, url, body=None, headers=None):\n'
- ' (...)\n'
- ' 235 # Avoid modifying the headers passed into .request()\n'
- ' 236 headers = headers.copy()\n'
- ' 237 if "user-agent" not in (six.ensure_str(k.lower()) for k in headers):\n'
- ' 238 headers["User-Agent"] = _get_default_user_agent()\n'
- '--> 239 super(HTTPConnection, self).request(method, url, body=body, headers=headers)\n'
- '\n'
- 'File "/usr/local/lib/python3.9/http/client.py", line 1285, in request\n'
- ' 1282 def request(self, method, url, body=None, headers={}, *,\n'
- ' 1283 encode_chunked=False):\n'
- ' 1284 """Send a complete request to the server."""\n'
- '--> 1285 self._send_request(method, url, body, headers, encode_chunked)\n'
- '\n'
- 'File "/usr/local/lib/python3.9/http/client.py", line 1331, in _send_request\n'
- ' 1287 def _send_request(self, method, url, body, headers, encode_chunked):\n'
- ' (...)\n'
- ' 1327 if isinstance(body, str):\n'
- ' 1328 # RFC 2616 Section 3.7.1 says that text default has a\n'
- ' 1329 # default charset of iso-8859-1.\n'
- " 1330 body = _encode(body, 'body')\n"
- '--> 1331 self.endheaders(body, encode_chunked=encode_chunked)\n'
- '\n'
- 'File "/usr/local/lib/python3.9/http/client.py", line 1280, in endheaders\n'
- ' 1269 def endheaders(self, message_body=None, *, encode_chunked=False):\n'
- ' (...)\n'
- ' 1276 if self.__state == _CS_REQ_STARTED:\n'
- ' 1277 self.__state = _CS_REQ_SENT\n'
- ' 1278 else:\n'
- ' 1279 raise CannotSendHeader()\n'
- '--> 1280 self._send_output(message_body, encode_chunked=encode_chunked)\n'
- '\n'
- 'File "/usr/local/lib/python3.9/http/client.py", line 1040, in _send_output\n'
- ' 1031 def _send_output(self, message_body=None, encode_chunked=False):\n'
- ' (...)\n'
- ' 1036 """\n'
- ' 1037 self._buffer.extend((b"", b""))\n'
- ' 1038 msg = b"\\r\\n".join(self._buffer)\n'
- ' 1039 del self._buffer[:]\n'
- '--> 1040 self.send(msg)\n'
- ' 1041 \n'
- '\n'
- 'File "/usr/local/lib/python3.9/http/client.py", line 980, in send\n'
- ' 972 def send(self, data):\n'
- ' (...)\n'
- ' 976 """\n'
- ' 977 \n'
- ' 978 if self.sock is None:\n'
- ' 979 if self.auto_open:\n'
- '--> 980 self.connect()\n'
- ' 981 else:\n'
- '\n'
- 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/urllib3/connection.py", line 205, in '
- 'connect\n'
- ' 204 def connect(self):\n'
- '--> 205 conn = self._new_conn()\n'
- ' 206 self._prepare_conn(conn)\n'
- '\n'
- 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/urllib3/connection.py", line 186, in '
- '_new_conn\n'
- ' 161 def _new_conn(self):\n'
- ' (...)\n'
- ' 182 % (self.host, self.timeout),\n'
- ' 183 )\n'
- ' 184 \n'
- ' 185 except SocketError as e:\n'
- '--> 186 raise NewConnectionError(\n'
- ' 187 self, "Failed to establish a new connection: %s" % e\n'
- '\n'
- '---- (full traceback above) ----\n'
- 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/urllib3/connectionpool.py", line 703, in '
- 'urlopen\n'
- ' httplib_response = self._make_request(\n'
- 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/urllib3/connectionpool.py", line 398, in '
- '_make_request\n'
- ' conn.request(method, url, **httplib_request_kw)\n'
- 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/urllib3/connection.py", line 239, in '
- 'request\n'
- ' super(HTTPConnection, self).request(method, url, body=body, headers=headers)\n'
- 'File "/usr/local/lib/python3.9/http/client.py", line 1285, in request\n'
- ' self._send_request(method, url, body, headers, encode_chunked)\n'
- 'File "/usr/local/lib/python3.9/http/client.py", line 1331, in _send_request\n'
- ' self.endheaders(body, encode_chunked=encode_chunked)\n'
- 'File "/usr/local/lib/python3.9/http/client.py", line 1280, in endheaders\n'
- ' self._send_output(message_body, encode_chunked=encode_chunked)\n'
- 'File "/usr/local/lib/python3.9/http/client.py", line 1040, in _send_output\n'
- ' self.send(msg)\n'
- 'File "/usr/local/lib/python3.9/http/client.py", line 980, in send\n'
- ' self.connect()\n'
- 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/urllib3/connection.py", line 205, in '
- 'connect\n'
- ' conn = self._new_conn()\n'
- 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/urllib3/connection.py", line 186, in '
- '_new_conn\n'
- ' raise NewConnectionError(\n'
- '\n'
- 'NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7eff673b6a30>: Failed to establish a new connection: [Errno 111] '
- 'Connection refused\n'
- '\n'
- 'While handling the above exception, another exception occurred:\n'
- '\n'
- 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/requests/adapters.py", line 489, in '
- 'send\n'
- ' 436 def send(\n'
- ' 437 self, request, stream=False, timeout=None, verify=True, cert=None, proxies=None\n'
- ' 438 ):\n'
- ' (...)\n'
- ' 485 timeout = TimeoutSauce(connect=timeout, read=timeout)\n'
- ' 486 \n'
- ' 487 try:\n'
- ' 488 if not chunked:\n'
- '--> 489 resp = conn.urlopen(\n'
- ' 490 method=request.method,\n'
- '\n'
- 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/urllib3/connectionpool.py", line 813, in '
- 'urlopen\n'
- ' 522 def urlopen(\n'
- ' 523 self,\n'
- ' 524 method,\n'
- ' 525 url,\n'
- ' 526 body=None,\n'
- ' 527 headers=None,\n'
- ' 528 retries=None,\n'
- ' 529 redirect=True,\n'
- ' 530 assert_same_host=True,\n'
- ' 531 timeout=_Default,\n'
- ' 532 pool_timeout=None,\n'
- ' 533 release_conn=None,\n'
- ' 534 chunked=False,\n'
- ' 535 body_pos=None,\n'
- ' 536 **response_kw\n'
- ' 537 ):\n'
- ' (...)\n'
- ' 809 # Try again\n'
- ' 810 log.warning(\n'
- ' 811 "Retrying (%r) after connection broken by \'%r\': %s", retries, err, url\n'
- ' 812 )\n'
- '--> 813 return self.urlopen(\n'
- ' 814 method,\n'
- '\n'
- 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/urllib3/connectionpool.py", line 813, in '
- 'urlopen\n'
- ' 522 def urlopen(\n'
- ' 523 self,\n'
- ' 524 method,\n'
- ' 525 url,\n'
- ' 526 body=None,\n'
- ' 527 headers=None,\n'
- ' 528 retries=None,\n'
- ' 529 redirect=True,\n'
- ' 530 assert_same_host=True,\n'
- ' 531 timeout=_Default,\n'
- ' 532 pool_timeout=None,\n'
- ' 533 release_conn=None,\n'
- ' 534 chunked=False,\n'
- ' 535 body_pos=None,\n'
- ' 536 **response_kw\n'
- ' 537 ):\n'
- ' (...)\n'
- ' 809 # Try again\n'
- ' 810 log.warning(\n'
- ' 811 "Retrying (%r) after connection broken by \'%r\': %s", retries, err, url\n'
- ' 812 )\n'
- '--> 813 return self.urlopen(\n'
- ' 814 method,\n'
- '\n'
- 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/urllib3/connectionpool.py", line 813, in '
- 'urlopen\n'
- ' 522 def urlopen(\n'
- ' 523 self,\n'
- ' 524 method,\n'
- ' 525 url,\n'
- ' 526 body=None,\n'
- ' 527 headers=None,\n'
- ' 528 retries=None,\n'
- ' 529 redirect=True,\n'
- ' 530 assert_same_host=True,\n'
- ' 531 timeout=_Default,\n'
- ' 532 pool_timeout=None,\n'
- ' 533 release_conn=None,\n'
- ' 534 chunked=False,\n'
- ' 535 body_pos=None,\n'
- ' 536 **response_kw\n'
- ' 537 ):\n'
- ' (...)\n'
- ' 809 # Try again\n'
- ' 810 log.warning(\n'
- ' 811 "Retrying (%r) after connection broken by \'%r\': %s", retries, err, url\n'
- ' 812 )\n'
- '--> 813 return self.urlopen(\n'
- ' 814 method,\n'
- '\n'
- 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/urllib3/connectionpool.py", line 785, in '
- 'urlopen\n'
- ' 522 def urlopen(\n'
- ' 523 self,\n'
- ' 524 method,\n'
- ' 525 url,\n'
- ' 526 body=None,\n'
- ' 527 headers=None,\n'
- ' 528 retries=None,\n'
- ' 529 redirect=True,\n'
- ' 530 assert_same_host=True,\n'
- ' 531 timeout=_Default,\n'
- ' 532 pool_timeout=None,\n'
- ' 533 release_conn=None,\n'
- ' 534 chunked=False,\n'
- ' 535 body_pos=None,\n'
- ' 536 **response_kw\n'
- ' 537 ):\n'
- ' (...)\n'
- ' 781 e = ProxyError("Cannot connect to proxy.", e)\n'
- ' 782 elif isinstance(e, (SocketError, HTTPException)):\n'
- ' 783 e = ProtocolError("Connection aborted.", e)\n'
- ' 784 \n'
- '--> 785 retries = retries.increment(\n'
- ' 786 method, url, error=e, _pool=self, _stacktrace=sys.exc_info()[2]\n'
- '\n'
- 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/urllib3/util/retry.py", line 592, in '
- 'increment\n'
- ' 504 def increment(\n'
- ' 505 self,\n'
- ' 506 method=None,\n'
- ' 507 url=None,\n'
- ' 508 response=None,\n'
- ' 509 error=None,\n'
- ' 510 _pool=None,\n'
- ' 511 _stacktrace=None,\n'
- ' 512 ):\n'
- ' (...)\n'
- ' 588 history=history,\n'
- ' 589 )\n'
- ' 590 \n'
- ' 591 if new_retry.is_exhausted():\n'
- '--> 592 raise MaxRetryError(_pool, url, error or ResponseError(cause))\n'
- ' 593 \n'
- '\n'
- '---- (full traceback above) ----\n'
- 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/requests/adapters.py", line 489, in '
- 'send\n'
- ' resp = conn.urlopen(\n'
- 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/urllib3/connectionpool.py", line 813, in '
- 'urlopen\n'
- ' return self.urlopen(\n'
- 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/urllib3/connectionpool.py", line 813, in '
- 'urlopen\n'
- ' return self.urlopen(\n'
- 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/urllib3/connectionpool.py", line 813, in '
- 'urlopen\n'
- ' return self.urlopen(\n'
- 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/urllib3/connectionpool.py", line 785, in '
- 'urlopen\n'
- ' retries = retries.increment(\n'
- 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/urllib3/util/retry.py", line 592, in '
- 'increment\n'
- ' raise MaxRetryError(_pool, url, error or ResponseError(cause))\n'
- '\n'
- "MaxRetryError: HTTPConnectionPool(host='localhost', port=8080): Max retries exceeded with url: /config (Caused by "
- "NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7eff673b6a30>: Failed to establish a new connection: [Errno 111] "
- "Connection refused'))\n"
- '\n'
- 'While handling the above exception, another exception occurred:\n'
- '\n'
- 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/datahub/cli/ingest_cli.py", line 106, in '
- 'run\n'
- ' 88 def run(\n'
- ' 89 ctx: click.Context,\n'
- ' 90 config: str,\n'
- ' 91 dry_run: bool,\n'
- ' 92 preview: bool,\n'
- ' 93 strict_warnings: bool,\n'
- ' 94 preview_workunits: int,\n'
- ' 95 suppress_error_logs: bool,\n'
- ' 96 ) -> None:\n'
- ' (...)\n'
- ' 102 pipeline_config = load_config_file(config_file)\n'
- ' 103 \n'
- ' 104 try:\n'
- ' 105 logger.debug(f"Using config: {pipeline_config}")\n'
- '--> 106 pipeline = Pipeline.create(pipeline_config, dry_run, preview, preview_workunits)\n'
- ' 107 except ValidationError as e:\n'
- '\n'
- 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/datahub/ingestion/run/pipeline.py", line '
- '202, in create\n'
- ' 194 def create(\n'
- ' 195 cls,\n'
- ' 196 config_dict: dict,\n'
- ' 197 dry_run: bool = False,\n'
- ' 198 preview_mode: bool = False,\n'
- ' 199 preview_workunits: int = 10,\n'
- ' 200 ) -> "Pipeline":\n'
- ' 201 config = PipelineConfig.parse_obj(config_dict)\n'
- '--> 202 return cls(\n'
- ' 203 config,\n'
- '\n'
- 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/datahub/ingestion/run/pipeline.py", line '
- '134, in __init__\n'
- ' 123 def __init__(\n'
- ' 124 self,\n'
- ' 125 config: PipelineConfig,\n'
- ' 126 dry_run: bool = False,\n'
- ' 127 preview_mode: bool = False,\n'
- ' 128 preview_workunits: int = 10,\n'
- ' 129 ):\n'
- ' 130 self.config = config\n'
- ' 131 self.dry_run = dry_run\n'
- ' 132 self.preview_mode = preview_mode\n'
- ' 133 self.preview_workunits = preview_workunits\n'
- '--> 134 self.ctx = PipelineContext(\n'
- ' 135 run_id=self.config.run_id,\n'
- '\n'
- 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/datahub/ingestion/api/common.py", line '
- '54, in __init__\n'
- ' 45 def __init__(\n'
- ' 46 self,\n'
- ' 47 run_id: str,\n'
- ' 48 datahub_api: Optional[DatahubClientConfig] = None,\n'
- ' 49 pipeline_name: Optional[str] = None,\n'
- ' 50 dry_run: bool = False,\n'
- ' 51 preview_mode: bool = False,\n'
- ' 52 ) -> None:\n'
- ' 53 self.run_id = run_id\n'
- '--> 54 self.graph = DataHubGraph(datahub_api) if datahub_api is not None else None\n'
- ' 55 self.pipeline_name = pipeline_name\n'
- '\n'
- 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/datahub/ingestion/graph/client.py", line '
- '53, in __init__\n'
- ' 41 def __init__(self, config: DatahubClientConfig) -> None:\n'
- ' (...)\n'
- ' 49 retry_max_times=self.config.retry_max_times,\n'
- ' 50 extra_headers=self.config.extra_headers,\n'
- ' 51 ca_certificate_path=self.config.ca_certificate_path,\n'
- ' 52 )\n'
- '--> 53 self.test_connection()\n'
- ' 54 try:\n'
- '\n'
- 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/datahub/emitter/rest_emitter.py", line '
- '147, in test_connection\n'
- ' 146 def test_connection(self) -> dict:\n'
- '--> 147 response = self._session.get(f"{self._gms_server}/config")\n'
- ' 148 if response.status_code == 200:\n'
- '\n'
- 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/requests/sessions.py", line 600, in get\n'
- ' 591 def get(self, url, **kwargs):\n'
- ' (...)\n'
- ' 596 :rtype: requests.Response\n'
- ' 597 """\n'
- ' 598 \n'
- ' 599 kwargs.setdefault("allow_redirects", True)\n'
- '--> 600 return self.request("GET", url, **kwargs)\n'
- '\n'
- 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/requests/sessions.py", line 587, in '
- 'request\n'
- ' 500 def request(\n'
- ' 501 self,\n'
- ' 502 method,\n'
- ' 503 url,\n'
- ' 504 params=None,\n'
- ' 505 data=None,\n'
- ' 506 headers=None,\n'
- ' 507 cookies=None,\n'
- ' 508 files=None,\n'
- ' 509 auth=None,\n'
- ' 510 timeout=None,\n'
- ' 511 allow_redirects=True,\n'
- ' 512 proxies=None,\n'
- ' 513 hooks=None,\n'
- ' 514 stream=None,\n'
- ' 515 verify=None,\n'
- ' 516 cert=None,\n'
- ' 517 json=None,\n'
- ' 518 ):\n'
- ' (...)\n'
- ' 583 "timeout": timeout,\n'
- ' 584 "allow_redirects": allow_redirects,\n'
- ' 585 }\n'
- ' 586 send_kwargs.update(settings)\n'
- '--> 587 resp = self.send(prep, **send_kwargs)\n'
- ' 588 \n'
- '\n'
- 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/requests/sessions.py", line 701, in '
- 'send\n'
- ' 671 def send(self, request, **kwargs):\n'
- ' (...)\n'
- ' 697 # Start time (approximately) of the request\n'
- ' 698 start = preferred_clock()\n'
- ' 699 \n'
- ' 700 # Send the request\n'
- '--> 701 r = adapter.send(request, **kwargs)\n'
- ' 702 \n'
- '\n'
- 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/requests/adapters.py", line 565, in '
- 'send\n'
- ' 436 def send(\n'
- ' 437 self, request, stream=False, timeout=None, verify=True, cert=None, proxies=None\n'
- ' 438 ):\n'
- ' (...)\n'
- ' 561 if isinstance(e.reason, _SSLError):\n'
- ' 562 # This branch is for urllib3 v1.22 and later.\n'
- ' 563 raise SSLError(e, request=request)\n'
- ' 564 \n'
- '--> 565 raise ConnectionError(e, request=request)\n'
- ' 566 \n'
- '\n'
- '---- (full traceback above) ----\n'
- 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/datahub/cli/ingest_cli.py", line 106, in '
- 'run\n'
- ' pipeline = Pipeline.create(pipeline_config, dry_run, preview, preview_workunits)\n'
- 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/datahub/ingestion/run/pipeline.py", line '
- '202, in create\n'
- ' return cls(\n'
- 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/datahub/ingestion/run/pipeline.py", line '
- '134, in __init__\n'
- ' self.ctx = PipelineContext(\n'
- 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/datahub/ingestion/api/common.py", line '
- '54, in __init__\n'
- ' self.graph = DataHubGraph(datahub_api) if datahub_api is not None else None\n'
- 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/datahub/ingestion/graph/client.py", line '
- '53, in __init__\n'
- ' self.test_connection()\n'
- 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/datahub/emitter/rest_emitter.py", line '
- '147, in test_connection\n'
- ' response = self._session.get(f"{self._gms_server}/config")\n'
- 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/requests/sessions.py", line 600, in get\n'
- ' return self.request("GET", url, **kwargs)\n'
- 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/requests/sessions.py", line 587, in '
- 'request\n'
- ' resp = self.send(prep, **send_kwargs)\n'
- 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/requests/sessions.py", line 701, in '
- 'send\n'
- ' r = adapter.send(request, **kwargs)\n'
- 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/requests/adapters.py", line 565, in '
- 'send\n'
- ' raise ConnectionError(e, request=request)\n'
- '\n'
- "ConnectionError: HTTPConnectionPool(host='localhost', port=8080): Max retries exceeded with url: /config (Caused by "
- "NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7eff673b6a30>: Failed to establish a new connection: [Errno 111] "
- "Connection refused'))\n"
- '[2022-06-20 09:46:56,770] INFO {datahub.entrypoints:176} - DataHub CLI version: 0.8.38 at '
- '/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/datahub/__init__.py\n'
- '[2022-06-20 09:46:56,770] INFO {datahub.entrypoints:179} - Python version: 3.9.9 (main, Dec 21 2021, 10:03:34) \n'
- '[GCC 10.2.1 20210110] at /tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/bin/python3 on '
- 'Linux-5.13.0-51-generic-x86_64-with-glibc2.31\n'
- '[2022-06-20 09:46:56,770] INFO {datahub.entrypoints:182} - GMS config {}\n',
- "2022-06-20 09:46:57.668307 [exec_id=baf06f55-65cb-47cd-97aa-6b4b85238eb9] INFO: Failed to execute 'datahub ingest'",
- '2022-06-20 09:46:57.669094 [exec_id=baf06f55-65cb-47cd-97aa-6b4b85238eb9] INFO: Caught exception EXECUTING '
- 'task_id=baf06f55-65cb-47cd-97aa-6b4b85238eb9, name=RUN_INGEST, stacktrace=Traceback (most recent call last):\n'
- ' File "/usr/local/lib/python3.9/site-packages/acryl/executor/execution/default_executor.py", line 121, in execute_task\n'
- ' self.event_loop.run_until_complete(task_future)\n'
- ' File "/usr/local/lib/python3.9/site-packages/nest_asyncio.py", line 89, in run_until_complete\n'
- ' return f.result()\n'
- ' File "/usr/local/lib/python3.9/asyncio/futures.py", line 201, in result\n'
- ' raise self._exception\n'
- ' File "/usr/local/lib/python3.9/asyncio/tasks.py", line 256, in __step\n'
- ' result = coro.send(None)\n'
- ' File "/usr/local/lib/python3.9/site-packages/acryl/executor/execution/sub_process_ingestion_task.py", line 115, in execute\n'
- ' raise TaskError("Failed to execute \'datahub ingest\'")\n'
- "acryl.executor.execution.task.TaskError: Failed to execute 'datahub ingest'\n"]}
- Execution finished with errors.
Advertisement
Add Comment
Please, Sign In to add comment