Guest User

Datahub ingest log

a guest
Jun 20th, 2022
32
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 51.71 KB | None | 0 0
  1. ~~~~ Execution Summary ~~~~
  2.  
  3. RUN_INGEST - {'errors': [],
  4. 'exec_id': 'baf06f55-65cb-47cd-97aa-6b4b85238eb9',
  5. 'infos': ['2022-06-20 09:45:14.228932 [exec_id=baf06f55-65cb-47cd-97aa-6b4b85238eb9] INFO: Starting execution for task with name=RUN_INGEST',
  6. '2022-06-20 09:46:57.667957 [exec_id=baf06f55-65cb-47cd-97aa-6b4b85238eb9] INFO: stdout=Requirement already satisfied: pip in '
  7. '/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages (21.2.4)\n'
  8. 'Collecting pip\n'
  9. ' Using cached pip-22.1.2-py3-none-any.whl (2.1 MB)\n'
  10. 'Collecting wheel\n'
  11. ' Using cached wheel-0.37.1-py2.py3-none-any.whl (35 kB)\n'
  12. 'Requirement already satisfied: setuptools in /tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages '
  13. '(58.1.0)\n'
  14. 'Collecting setuptools\n'
  15. ' Using cached setuptools-62.6.0-py3-none-any.whl (1.2 MB)\n'
  16. 'Installing collected packages: wheel, setuptools, pip\n'
  17. ' Attempting uninstall: setuptools\n'
  18. ' Found existing installation: setuptools 58.1.0\n'
  19. ' Uninstalling setuptools-58.1.0:\n'
  20. ' Successfully uninstalled setuptools-58.1.0\n'
  21. ' Attempting uninstall: pip\n'
  22. ' Found existing installation: pip 21.2.4\n'
  23. ' Uninstalling pip-21.2.4:\n'
  24. ' Successfully uninstalled pip-21.2.4\n'
  25. 'Successfully installed pip-22.1.2 setuptools-62.6.0 wheel-0.37.1\n'
  26. 'Collecting acryl-datahub[datahub-rest,postgres]==0.8.38\n'
  27. ' Using cached acryl_datahub-0.8.38-py3-none-any.whl (877 kB)\n'
  28. 'Collecting toml>=0.10.0\n'
  29. ' Using cached toml-0.10.2-py2.py3-none-any.whl (16 kB)\n'
  30. 'Collecting termcolor>=1.0.0\n'
  31. ' Using cached termcolor-1.1.0-py3-none-any.whl\n'
  32. 'Collecting packaging\n'
  33. ' Using cached packaging-21.3-py3-none-any.whl (40 kB)\n'
  34. 'Collecting PyYAML\n'
  35. ' Using cached PyYAML-6.0-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (661 kB)\n'
  36. 'Collecting psutil>=5.8.0\n'
  37. ' Using cached psutil-5.9.1-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (281 '
  38. 'kB)\n'
  39. 'Collecting entrypoints\n'
  40. ' Using cached entrypoints-0.4-py3-none-any.whl (5.3 kB)\n'
  41. 'Collecting python-dateutil>=2.8.0\n'
  42. ' Using cached python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB)\n'
  43. 'Collecting Deprecated\n'
  44. ' Using cached Deprecated-1.2.13-py2.py3-none-any.whl (9.6 kB)\n'
  45. 'Collecting typing-extensions>=3.10.0.2\n'
  46. ' Using cached typing_extensions-4.2.0-py3-none-any.whl (24 kB)\n'
  47. 'Collecting humanfriendly\n'
  48. ' Using cached humanfriendly-10.0-py2.py3-none-any.whl (86 kB)\n'
  49. 'Collecting tabulate\n'
  50. ' Using cached tabulate-0.8.9-py3-none-any.whl (25 kB)\n'
  51. 'Collecting click-default-group\n'
  52. ' Using cached click_default_group-1.2.2-py3-none-any.whl\n'
  53. 'Collecting avro<1.11,>=1.10.2\n'
  54. ' Using cached avro-1.10.2-py3-none-any.whl\n'
  55. 'Collecting docker\n'
  56. ' Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB)\n'
  57. 'Collecting click>=6.0.0\n'
  58. ' Using cached click-8.1.3-py3-none-any.whl (96 kB)\n'
  59. 'Collecting avro-gen3==0.7.4\n'
  60. ' Using cached avro_gen3-0.7.4-py3-none-any.whl (26 kB)\n'
  61. 'Collecting mixpanel>=4.9.0\n'
  62. ' Using cached mixpanel-4.9.0-py2.py3-none-any.whl (8.9 kB)\n'
  63. 'Collecting pydantic>=1.5.1\n'
  64. ' Using cached pydantic-1.9.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (12.4 MB)\n'
  65. 'Collecting stackprinter\n'
  66. ' Using cached stackprinter-0.2.6-py3-none-any.whl (28 kB)\n'
  67. 'Collecting expandvars>=0.6.5\n'
  68. ' Using cached expandvars-0.9.0-py3-none-any.whl (6.6 kB)\n'
  69. 'Collecting types-termcolor>=1.0.0\n'
  70. ' Using cached types_termcolor-1.1.4-py3-none-any.whl (2.1 kB)\n'
  71. 'Collecting mypy-extensions>=0.4.3\n'
  72. ' Using cached mypy_extensions-0.4.3-py2.py3-none-any.whl (4.5 kB)\n'
  73. 'Collecting ratelimiter\n'
  74. ' Using cached ratelimiter-1.2.0.post0-py3-none-any.whl (6.6 kB)\n'
  75. 'Collecting markupsafe<=2.0.1,>=1.1.1\n'
  76. ' Using cached MarkupSafe-2.0.1-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (30 kB)\n'
  77. 'Collecting types-Deprecated\n'
  78. ' Using cached types_Deprecated-1.2.8-py3-none-any.whl (3.1 kB)\n'
  79. 'Collecting typing-inspect\n'
  80. ' Using cached typing_inspect-0.7.1-py3-none-any.whl (8.4 kB)\n'
  81. 'Collecting progressbar2\n'
  82. ' Using cached progressbar2-4.0.0-py2.py3-none-any.whl (26 kB)\n'
  83. 'Collecting GeoAlchemy2\n'
  84. ' Using cached GeoAlchemy2-0.12.1-py2.py3-none-any.whl (50 kB)\n'
  85. 'Collecting psycopg2-binary\n'
  86. ' Using cached psycopg2_binary-2.9.3-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)\n'
  87. 'Collecting greenlet\n'
  88. ' Using cached greenlet-1.1.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (153 kB)\n'
  89. 'Collecting Jinja2<3.1.0\n'
  90. ' Using cached Jinja2-3.0.3-py3-none-any.whl (133 kB)\n'
  91. 'Collecting great-expectations<0.15.3,>=0.14.11\n'
  92. ' Using cached great_expectations-0.15.2-py3-none-any.whl (5.0 MB)\n'
  93. 'Collecting sqlalchemy==1.3.24\n'
  94. ' Using cached SQLAlchemy-1.3.24-cp39-cp39-manylinux2010_x86_64.whl (1.3 MB)\n'
  95. 'Collecting traitlets<5.2.2\n'
  96. ' Using cached traitlets-5.2.1.post0-py3-none-any.whl (106 kB)\n'
  97. 'Collecting requests\n'
  98. ' Using cached requests-2.28.0-py3-none-any.whl (62 kB)\n'
  99. 'Collecting tzlocal\n'
  100. ' Using cached tzlocal-4.2-py3-none-any.whl (19 kB)\n'
  101. 'Collecting pytz\n'
  102. ' Using cached pytz-2022.1-py2.py3-none-any.whl (503 kB)\n'
  103. 'Collecting six\n'
  104. ' Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)\n'
  105. 'Collecting cryptography>=3.2\n'
  106. ' Using cached cryptography-37.0.2-cp36-abi3-manylinux_2_24_x86_64.whl (4.0 MB)\n'
  107. 'Collecting urllib3<1.27,>=1.25.4\n'
  108. ' Using cached urllib3-1.26.9-py2.py3-none-any.whl (138 kB)\n'
  109. 'Collecting ruamel.yaml<0.17.18,>=0.16\n'
  110. ' Using cached ruamel.yaml-0.17.17-py3-none-any.whl (109 kB)\n'
  111. 'Collecting jsonpatch>=1.22\n'
  112. ' Using cached jsonpatch-1.32-py2.py3-none-any.whl (12 kB)\n'
  113. 'Collecting altair<5,>=4.0.0\n'
  114. ' Using cached altair-4.2.0-py3-none-any.whl (812 kB)\n'
  115. 'Collecting importlib-metadata>=1.7.0\n'
  116. ' Using cached importlib_metadata-4.11.4-py3-none-any.whl (18 kB)\n'
  117. 'Collecting numpy>=1.14.1\n'
  118. ' Using cached numpy-1.22.4-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (16.8 MB)\n'
  119. 'Collecting scipy>=0.19.0\n'
  120. ' Using cached scipy-1.8.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (42.2 MB)\n'
  121. 'Collecting notebook>=6.4.10\n'
  122. ' Using cached notebook-6.4.12-py3-none-any.whl (9.9 MB)\n'
  123. 'Collecting tqdm>=4.59.0\n'
  124. ' Using cached tqdm-4.64.0-py2.py3-none-any.whl (78 kB)\n'
  125. 'Collecting colorama>=0.4.3\n'
  126. ' Using cached colorama-0.4.5-py2.py3-none-any.whl (16 kB)\n'
  127. 'Collecting nbformat>=5.0\n'
  128. ' Using cached nbformat-5.4.0-py3-none-any.whl (73 kB)\n'
  129. 'Collecting pyparsing<3,>=2.4\n'
  130. ' Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)\n'
  131. 'Collecting jsonschema>=2.5.1\n'
  132. ' Using cached jsonschema-4.6.0-py3-none-any.whl (80 kB)\n'
  133. 'Collecting mistune>=0.8.4\n'
  134. ' Using cached mistune-2.0.2-py2.py3-none-any.whl (24 kB)\n'
  135. 'Collecting Ipython>=7.16.3\n'
  136. ' Using cached ipython-8.4.0-py3-none-any.whl (750 kB)\n'
  137. 'Collecting pandas>=0.23.0\n'
  138. ' Using cached pandas-1.4.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.7 MB)\n'
  139. 'Collecting charset-normalizer~=2.0.0\n'
  140. ' Using cached charset_normalizer-2.0.12-py3-none-any.whl (39 kB)\n'
  141. 'Collecting certifi>=2017.4.17\n'
  142. ' Using cached certifi-2022.6.15-py3-none-any.whl (160 kB)\n'
  143. 'Collecting idna<4,>=2.5\n'
  144. ' Using cached idna-3.3-py3-none-any.whl (61 kB)\n'
  145. 'Collecting wrapt<2,>=1.10\n'
  146. ' Using cached wrapt-1.14.1-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (77 kB)\n'
  147. 'Collecting websocket-client>=0.32.0\n'
  148. ' Using cached websocket_client-1.3.3-py3-none-any.whl (54 kB)\n'
  149. 'Collecting GeoAlchemy2\n'
  150. ' Using cached GeoAlchemy2-0.12.0-py2.py3-none-any.whl (50 kB)\n'
  151. ' Using cached GeoAlchemy2-0.11.1-py2.py3-none-any.whl (45 kB)\n'
  152. 'Collecting python-utils>=3.0.0\n'
  153. ' Using cached python_utils-3.3.3-py2.py3-none-any.whl (23 kB)\n'
  154. 'Collecting toolz\n'
  155. ' Using cached toolz-0.11.2-py3-none-any.whl (55 kB)\n'
  156. 'Collecting cffi>=1.12\n'
  157. ' Using cached cffi-1.15.0-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (444 kB)\n'
  158. 'Collecting zipp>=0.5\n'
  159. ' Using cached zipp-3.8.0-py3-none-any.whl (5.4 kB)\n'
  160. 'Collecting pygments>=2.4.0\n'
  161. ' Using cached Pygments-2.12.0-py3-none-any.whl (1.1 MB)\n'
  162. 'Collecting stack-data\n'
  163. ' Using cached stack_data-0.3.0-py3-none-any.whl (23 kB)\n'
  164. 'Collecting jedi>=0.16\n'
  165. ' Using cached jedi-0.18.1-py2.py3-none-any.whl (1.6 MB)\n'
  166. 'Collecting decorator\n'
  167. ' Using cached decorator-5.1.1-py3-none-any.whl (9.1 kB)\n'
  168. 'Collecting pexpect>4.3\n'
  169. ' Using cached pexpect-4.8.0-py2.py3-none-any.whl (59 kB)\n'
  170. 'Collecting pickleshare\n'
  171. ' Using cached pickleshare-0.7.5-py2.py3-none-any.whl (6.9 kB)\n'
  172. 'Requirement already satisfied: setuptools>=18.5 in '
  173. '/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages (from '
  174. 'Ipython>=7.16.3->great-expectations<0.15.3,>=0.14.11->acryl-datahub[datahub-rest,postgres]==0.8.38->-r '
  175. '/tmp/datahub/ingest/requirements-baf06f55-65cb-47cd-97aa-6b4b85238eb9.txt (line 1)) (62.6.0)\n'
  176. 'Collecting matplotlib-inline\n'
  177. ' Using cached matplotlib_inline-0.1.3-py3-none-any.whl (8.2 kB)\n'
  178. 'Collecting prompt-toolkit!=3.0.0,!=3.0.1,<3.1.0,>=2.0.0\n'
  179. ' Using cached prompt_toolkit-3.0.29-py3-none-any.whl (381 kB)\n'
  180. 'Collecting backcall\n'
  181. ' Using cached backcall-0.2.0-py2.py3-none-any.whl (11 kB)\n'
  182. 'Collecting jsonpointer>=1.9\n'
  183. ' Using cached jsonpointer-2.3-py2.py3-none-any.whl (7.8 kB)\n'
  184. 'Collecting pyrsistent!=0.17.0,!=0.17.1,!=0.17.2,>=0.14.0\n'
  185. ' Using cached pyrsistent-0.18.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (115 kB)\n'
  186. 'Collecting attrs>=17.4.0\n'
  187. ' Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)\n'
  188. 'Collecting fastjsonschema\n'
  189. ' Using cached fastjsonschema-2.15.3-py3-none-any.whl (22 kB)\n'
  190. 'Collecting jupyter-core\n'
  191. ' Using cached jupyter_core-4.10.0-py3-none-any.whl (87 kB)\n'
  192. 'Collecting ipython-genutils\n'
  193. ' Using cached ipython_genutils-0.2.0-py2.py3-none-any.whl (26 kB)\n'
  194. 'Collecting nbconvert>=5\n'
  195. ' Using cached nbconvert-6.5.0-py3-none-any.whl (561 kB)\n'
  196. 'Collecting terminado>=0.8.3\n'
  197. ' Using cached terminado-0.15.0-py3-none-any.whl (16 kB)\n'
  198. 'Collecting nest-asyncio>=1.5\n'
  199. ' Using cached nest_asyncio-1.5.5-py3-none-any.whl (5.2 kB)\n'
  200. 'Collecting ipykernel\n'
  201. ' Using cached ipykernel-6.15.0-py3-none-any.whl (133 kB)\n'
  202. 'Collecting Send2Trash>=1.8.0\n'
  203. ' Using cached Send2Trash-1.8.0-py3-none-any.whl (18 kB)\n'
  204. 'Collecting tornado>=6.1\n'
  205. ' Using cached tornado-6.1-cp39-cp39-manylinux2010_x86_64.whl (427 kB)\n'
  206. 'Collecting argon2-cffi\n'
  207. ' Using cached argon2_cffi-21.3.0-py3-none-any.whl (14 kB)\n'
  208. 'Collecting jupyter-client>=5.3.4\n'
  209. ' Using cached jupyter_client-7.3.4-py3-none-any.whl (132 kB)\n'
  210. 'Collecting pyzmq>=17\n'
  211. ' Using cached pyzmq-23.1.0-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (1.1 MB)\n'
  212. 'Collecting prometheus-client\n'
  213. ' Using cached prometheus_client-0.14.1-py3-none-any.whl (59 kB)\n'
  214. 'Collecting ruamel.yaml.clib>=0.1.2\n'
  215. ' Using cached ruamel.yaml.clib-0.2.6-cp39-cp39-manylinux1_x86_64.whl (539 kB)\n'
  216. 'Collecting pytz-deprecation-shim\n'
  217. ' Using cached pytz_deprecation_shim-0.1.0.post0-py2.py3-none-any.whl (15 kB)\n'
  218. 'Collecting pycparser\n'
  219. ' Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)\n'
  220. 'Collecting parso<0.9.0,>=0.8.0\n'
  221. ' Using cached parso-0.8.3-py2.py3-none-any.whl (100 kB)\n'
  222. 'Collecting beautifulsoup4\n'
  223. ' Using cached beautifulsoup4-4.11.1-py3-none-any.whl (128 kB)\n'
  224. 'Collecting mistune>=0.8.4\n'
  225. ' Using cached mistune-0.8.4-py2.py3-none-any.whl (16 kB)\n'
  226. 'Collecting bleach\n'
  227. ' Using cached bleach-5.0.0-py3-none-any.whl (160 kB)\n'
  228. 'Collecting jupyterlab-pygments\n'
  229. ' Using cached jupyterlab_pygments-0.2.2-py2.py3-none-any.whl (21 kB)\n'
  230. 'Collecting defusedxml\n'
  231. ' Using cached defusedxml-0.7.1-py2.py3-none-any.whl (25 kB)\n'
  232. 'Collecting tinycss2\n'
  233. ' Using cached tinycss2-1.1.1-py3-none-any.whl (21 kB)\n'
  234. 'Collecting nbclient>=0.5.0\n'
  235. ' Using cached nbclient-0.6.4-py3-none-any.whl (71 kB)\n'
  236. 'Collecting pandocfilters>=1.4.1\n'
  237. ' Using cached pandocfilters-1.5.0-py2.py3-none-any.whl (8.7 kB)\n'
  238. 'Collecting ptyprocess>=0.5\n'
  239. ' Using cached ptyprocess-0.7.0-py2.py3-none-any.whl (13 kB)\n'
  240. 'Collecting wcwidth\n'
  241. ' Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)\n'
  242. 'Collecting argon2-cffi-bindings\n'
  243. ' Using cached argon2_cffi_bindings-21.2.0-cp36-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (86 kB)\n'
  244. 'Collecting debugpy>=1.0\n'
  245. ' Using cached debugpy-1.6.0-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (1.8 MB)\n'
  246. 'Collecting tzdata\n'
  247. ' Using cached tzdata-2022.1-py2.py3-none-any.whl (339 kB)\n'
  248. 'Collecting pure-eval\n'
  249. ' Using cached pure_eval-0.2.2-py3-none-any.whl (11 kB)\n'
  250. 'Collecting executing\n'
  251. ' Using cached executing-0.8.3-py2.py3-none-any.whl (16 kB)\n'
  252. 'Collecting asttokens\n'
  253. ' Using cached asttokens-2.0.5-py2.py3-none-any.whl (20 kB)\n'
  254. 'Collecting nbclient>=0.5.0\n'
  255. ' Using cached nbclient-0.6.3-py3-none-any.whl (71 kB)\n'
  256. 'Collecting soupsieve>1.2\n'
  257. ' Using cached soupsieve-2.3.2.post1-py3-none-any.whl (37 kB)\n'
  258. 'Collecting webencodings\n'
  259. ' Using cached webencodings-0.5.1-py2.py3-none-any.whl (11 kB)\n'
  260. 'Installing collected packages: webencodings, wcwidth, types-termcolor, types-Deprecated, termcolor, tabulate, Send2Trash, ratelimiter, '
  261. 'pytz, pure-eval, ptyprocess, pickleshare, mypy-extensions, mistune, ipython-genutils, fastjsonschema, executing, backcall, zipp, wrapt, '
  262. 'websocket-client, urllib3, tzdata, typing-extensions, traitlets, tqdm, tornado, toolz, toml, tinycss2, stackprinter, sqlalchemy, '
  263. 'soupsieve, six, ruamel.yaml.clib, pyzmq, PyYAML, python-utils, pyrsistent, pyparsing, pygments, pycparser, psycopg2-binary, psutil, '
  264. 'prompt-toolkit, prometheus-client, pexpect, parso, pandocfilters, numpy, nest-asyncio, markupsafe, jupyterlab-pygments, jsonpointer, '
  265. 'idna, humanfriendly, greenlet, expandvars, entrypoints, defusedxml, decorator, debugpy, colorama, click, charset-normalizer, certifi, '
  266. 'avro, attrs, typing-inspect, terminado, scipy, ruamel.yaml, requests, pytz-deprecation-shim, python-dateutil, pydantic, progressbar2, '
  267. 'packaging, matplotlib-inline, jupyter-core, jsonschema, jsonpatch, Jinja2, jedi, importlib-metadata, Deprecated, click-default-group, '
  268. 'cffi, bleach, beautifulsoup4, asttokens, tzlocal, stack-data, pandas, nbformat, mixpanel, jupyter-client, GeoAlchemy2, docker, '
  269. 'cryptography, argon2-cffi-bindings, nbclient, Ipython, avro-gen3, argon2-cffi, altair, nbconvert, ipykernel, acryl-datahub, notebook, '
  270. 'great-expectations\n'
  271. 'Successfully installed Deprecated-1.2.13 GeoAlchemy2-0.11.1 Ipython-8.4.0 Jinja2-3.0.3 PyYAML-6.0 Send2Trash-1.8.0 acryl-datahub-0.8.38 '
  272. 'altair-4.2.0 argon2-cffi-21.3.0 argon2-cffi-bindings-21.2.0 asttokens-2.0.5 attrs-21.4.0 avro-1.10.2 avro-gen3-0.7.4 backcall-0.2.0 '
  273. 'beautifulsoup4-4.11.1 bleach-5.0.0 certifi-2022.6.15 cffi-1.15.0 charset-normalizer-2.0.12 click-8.1.3 click-default-group-1.2.2 '
  274. 'colorama-0.4.5 cryptography-37.0.2 debugpy-1.6.0 decorator-5.1.1 defusedxml-0.7.1 docker-5.0.3 entrypoints-0.4 executing-0.8.3 '
  275. 'expandvars-0.9.0 fastjsonschema-2.15.3 great-expectations-0.15.2 greenlet-1.1.2 humanfriendly-10.0 idna-3.3 importlib-metadata-4.11.4 '
  276. 'ipykernel-6.15.0 ipython-genutils-0.2.0 jedi-0.18.1 jsonpatch-1.32 jsonpointer-2.3 jsonschema-4.6.0 jupyter-client-7.3.4 '
  277. 'jupyter-core-4.10.0 jupyterlab-pygments-0.2.2 markupsafe-2.0.1 matplotlib-inline-0.1.3 mistune-0.8.4 mixpanel-4.9.0 '
  278. 'mypy-extensions-0.4.3 nbclient-0.6.3 nbconvert-6.5.0 nbformat-5.4.0 nest-asyncio-1.5.5 notebook-6.4.12 numpy-1.22.4 packaging-21.3 '
  279. 'pandas-1.4.2 pandocfilters-1.5.0 parso-0.8.3 pexpect-4.8.0 pickleshare-0.7.5 progressbar2-4.0.0 prometheus-client-0.14.1 '
  280. 'prompt-toolkit-3.0.29 psutil-5.9.1 psycopg2-binary-2.9.3 ptyprocess-0.7.0 pure-eval-0.2.2 pycparser-2.21 pydantic-1.9.1 pygments-2.12.0 '
  281. 'pyparsing-2.4.7 pyrsistent-0.18.1 python-dateutil-2.8.2 python-utils-3.3.3 pytz-2022.1 pytz-deprecation-shim-0.1.0.post0 pyzmq-23.1.0 '
  282. 'ratelimiter-1.2.0.post0 requests-2.28.0 ruamel.yaml-0.17.17 ruamel.yaml.clib-0.2.6 scipy-1.8.1 six-1.16.0 soupsieve-2.3.2.post1 '
  283. 'sqlalchemy-1.3.24 stack-data-0.3.0 stackprinter-0.2.6 tabulate-0.8.9 termcolor-1.1.0 terminado-0.15.0 tinycss2-1.1.1 toml-0.10.2 '
  284. 'toolz-0.11.2 tornado-6.1 tqdm-4.64.0 traitlets-5.2.1.post0 types-Deprecated-1.2.8 types-termcolor-1.1.4 typing-extensions-4.2.0 '
  285. 'typing-inspect-0.7.1 tzdata-2022.1 tzlocal-4.2 urllib3-1.26.9 wcwidth-0.2.5 webencodings-0.5.1 websocket-client-1.3.3 wrapt-1.14.1 '
  286. 'zipp-3.8.0\n'
  287. '[2022-06-20 09:46:43,941] INFO {datahub.cli.ingest_cli:99} - DataHub CLI version: 0.8.38\n'
  288. '[2022-06-20 09:46:43,962] WARNING {urllib3.connectionpool:810} - Retrying (Retry(total=2, connect=None, read=None, redirect=None, '
  289. "status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7eff673b6400>: Failed to "
  290. "establish a new connection: [Errno 111] Connection refused')': /config\n"
  291. '[2022-06-20 09:46:47,965] WARNING {urllib3.connectionpool:810} - Retrying (Retry(total=1, connect=None, read=None, redirect=None, '
  292. "status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7eff673b6610>: Failed to "
  293. "establish a new connection: [Errno 111] Connection refused')': /config\n"
  294. '[2022-06-20 09:46:55,977] WARNING {urllib3.connectionpool:810} - Retrying (Retry(total=0, connect=None, read=None, redirect=None, '
  295. "status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7eff673b6820>: Failed to "
  296. "establish a new connection: [Errno 111] Connection refused')': /config\n"
  297. '[2022-06-20 09:46:56,770] ERROR {datahub.entrypoints:167} - File '
  298. '"/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/urllib3/connection.py", line 174, in '
  299. '_new_conn\n'
  300. ' 161 def _new_conn(self):\n'
  301. ' (...)\n'
  302. ' 170 if self.socket_options:\n'
  303. ' 171 extra_kw["socket_options"] = self.socket_options\n'
  304. ' 172 \n'
  305. ' 173 try:\n'
  306. '--> 174 conn = connection.create_connection(\n'
  307. ' 175 (self._dns_host, self.port), self.timeout, **extra_kw\n'
  308. '\n'
  309. 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/urllib3/util/connection.py", line 95, in '
  310. 'create_connection\n'
  311. ' 37 def create_connection(\n'
  312. ' 38 address,\n'
  313. ' 39 timeout=socket._GLOBAL_DEFAULT_TIMEOUT,\n'
  314. ' 40 source_address=None,\n'
  315. ' 41 socket_options=None,\n'
  316. ' 42 ):\n'
  317. ' (...)\n'
  318. ' 91 sock.close()\n'
  319. ' 92 sock = None\n'
  320. ' 93 \n'
  321. ' 94 if err is not None:\n'
  322. '--> 95 raise err\n'
  323. ' 96 \n'
  324. '\n'
  325. 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/urllib3/util/connection.py", line 85, in '
  326. 'create_connection\n'
  327. ' 37 def create_connection(\n'
  328. ' 38 address,\n'
  329. ' 39 timeout=socket._GLOBAL_DEFAULT_TIMEOUT,\n'
  330. ' 40 source_address=None,\n'
  331. ' 41 socket_options=None,\n'
  332. ' 42 ):\n'
  333. ' (...)\n'
  334. ' 81 if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT:\n'
  335. ' 82 sock.settimeout(timeout)\n'
  336. ' 83 if source_address:\n'
  337. ' 84 sock.bind(source_address)\n'
  338. '--> 85 sock.connect(sa)\n'
  339. ' 86 return sock\n'
  340. '\n'
  341. 'ConnectionRefusedError: [Errno 111] Connection refused\n'
  342. '\n'
  343. 'While handling the above exception, another exception occurred:\n'
  344. '\n'
  345. 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/urllib3/connectionpool.py", line 703, in '
  346. 'urlopen\n'
  347. ' 522 def urlopen(\n'
  348. ' 523 self,\n'
  349. ' 524 method,\n'
  350. ' 525 url,\n'
  351. ' 526 body=None,\n'
  352. ' 527 headers=None,\n'
  353. ' 528 retries=None,\n'
  354. ' 529 redirect=True,\n'
  355. ' 530 assert_same_host=True,\n'
  356. ' 531 timeout=_Default,\n'
  357. ' 532 pool_timeout=None,\n'
  358. ' 533 release_conn=None,\n'
  359. ' 534 chunked=False,\n'
  360. ' 535 body_pos=None,\n'
  361. ' 536 **response_kw\n'
  362. ' 537 ):\n'
  363. ' (...)\n'
  364. ' 699 if is_new_proxy_conn and http_tunnel_required:\n'
  365. ' 700 self._prepare_proxy(conn)\n'
  366. ' 701 \n'
  367. ' 702 # Make the request on the httplib connection object.\n'
  368. '--> 703 httplib_response = self._make_request(\n'
  369. ' 704 conn,\n'
  370. '\n'
  371. 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/urllib3/connectionpool.py", line 398, in '
  372. '_make_request\n'
  373. ' 361 def _make_request(\n'
  374. ' 362 self, conn, method, url, timeout=_Default, chunked=False, **httplib_request_kw\n'
  375. ' 363 ):\n'
  376. ' (...)\n'
  377. ' 394 try:\n'
  378. ' 395 if chunked:\n'
  379. ' 396 conn.request_chunked(method, url, **httplib_request_kw)\n'
  380. ' 397 else:\n'
  381. '--> 398 conn.request(method, url, **httplib_request_kw)\n'
  382. ' 399 \n'
  383. '\n'
  384. 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/urllib3/connection.py", line 239, in '
  385. 'request\n'
  386. ' 231 def request(self, method, url, body=None, headers=None):\n'
  387. ' (...)\n'
  388. ' 235 # Avoid modifying the headers passed into .request()\n'
  389. ' 236 headers = headers.copy()\n'
  390. ' 237 if "user-agent" not in (six.ensure_str(k.lower()) for k in headers):\n'
  391. ' 238 headers["User-Agent"] = _get_default_user_agent()\n'
  392. '--> 239 super(HTTPConnection, self).request(method, url, body=body, headers=headers)\n'
  393. '\n'
  394. 'File "/usr/local/lib/python3.9/http/client.py", line 1285, in request\n'
  395. ' 1282 def request(self, method, url, body=None, headers={}, *,\n'
  396. ' 1283 encode_chunked=False):\n'
  397. ' 1284 """Send a complete request to the server."""\n'
  398. '--> 1285 self._send_request(method, url, body, headers, encode_chunked)\n'
  399. '\n'
  400. 'File "/usr/local/lib/python3.9/http/client.py", line 1331, in _send_request\n'
  401. ' 1287 def _send_request(self, method, url, body, headers, encode_chunked):\n'
  402. ' (...)\n'
  403. ' 1327 if isinstance(body, str):\n'
  404. ' 1328 # RFC 2616 Section 3.7.1 says that text default has a\n'
  405. ' 1329 # default charset of iso-8859-1.\n'
  406. " 1330 body = _encode(body, 'body')\n"
  407. '--> 1331 self.endheaders(body, encode_chunked=encode_chunked)\n'
  408. '\n'
  409. 'File "/usr/local/lib/python3.9/http/client.py", line 1280, in endheaders\n'
  410. ' 1269 def endheaders(self, message_body=None, *, encode_chunked=False):\n'
  411. ' (...)\n'
  412. ' 1276 if self.__state == _CS_REQ_STARTED:\n'
  413. ' 1277 self.__state = _CS_REQ_SENT\n'
  414. ' 1278 else:\n'
  415. ' 1279 raise CannotSendHeader()\n'
  416. '--> 1280 self._send_output(message_body, encode_chunked=encode_chunked)\n'
  417. '\n'
  418. 'File "/usr/local/lib/python3.9/http/client.py", line 1040, in _send_output\n'
  419. ' 1031 def _send_output(self, message_body=None, encode_chunked=False):\n'
  420. ' (...)\n'
  421. ' 1036 """\n'
  422. ' 1037 self._buffer.extend((b"", b""))\n'
  423. ' 1038 msg = b"\\r\\n".join(self._buffer)\n'
  424. ' 1039 del self._buffer[:]\n'
  425. '--> 1040 self.send(msg)\n'
  426. ' 1041 \n'
  427. '\n'
  428. 'File "/usr/local/lib/python3.9/http/client.py", line 980, in send\n'
  429. ' 972 def send(self, data):\n'
  430. ' (...)\n'
  431. ' 976 """\n'
  432. ' 977 \n'
  433. ' 978 if self.sock is None:\n'
  434. ' 979 if self.auto_open:\n'
  435. '--> 980 self.connect()\n'
  436. ' 981 else:\n'
  437. '\n'
  438. 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/urllib3/connection.py", line 205, in '
  439. 'connect\n'
  440. ' 204 def connect(self):\n'
  441. '--> 205 conn = self._new_conn()\n'
  442. ' 206 self._prepare_conn(conn)\n'
  443. '\n'
  444. 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/urllib3/connection.py", line 186, in '
  445. '_new_conn\n'
  446. ' 161 def _new_conn(self):\n'
  447. ' (...)\n'
  448. ' 182 % (self.host, self.timeout),\n'
  449. ' 183 )\n'
  450. ' 184 \n'
  451. ' 185 except SocketError as e:\n'
  452. '--> 186 raise NewConnectionError(\n'
  453. ' 187 self, "Failed to establish a new connection: %s" % e\n'
  454. '\n'
  455. '---- (full traceback above) ----\n'
  456. 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/urllib3/connectionpool.py", line 703, in '
  457. 'urlopen\n'
  458. ' httplib_response = self._make_request(\n'
  459. 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/urllib3/connectionpool.py", line 398, in '
  460. '_make_request\n'
  461. ' conn.request(method, url, **httplib_request_kw)\n'
  462. 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/urllib3/connection.py", line 239, in '
  463. 'request\n'
  464. ' super(HTTPConnection, self).request(method, url, body=body, headers=headers)\n'
  465. 'File "/usr/local/lib/python3.9/http/client.py", line 1285, in request\n'
  466. ' self._send_request(method, url, body, headers, encode_chunked)\n'
  467. 'File "/usr/local/lib/python3.9/http/client.py", line 1331, in _send_request\n'
  468. ' self.endheaders(body, encode_chunked=encode_chunked)\n'
  469. 'File "/usr/local/lib/python3.9/http/client.py", line 1280, in endheaders\n'
  470. ' self._send_output(message_body, encode_chunked=encode_chunked)\n'
  471. 'File "/usr/local/lib/python3.9/http/client.py", line 1040, in _send_output\n'
  472. ' self.send(msg)\n'
  473. 'File "/usr/local/lib/python3.9/http/client.py", line 980, in send\n'
  474. ' self.connect()\n'
  475. 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/urllib3/connection.py", line 205, in '
  476. 'connect\n'
  477. ' conn = self._new_conn()\n'
  478. 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/urllib3/connection.py", line 186, in '
  479. '_new_conn\n'
  480. ' raise NewConnectionError(\n'
  481. '\n'
  482. 'NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7eff673b6a30>: Failed to establish a new connection: [Errno 111] '
  483. 'Connection refused\n'
  484. '\n'
  485. 'While handling the above exception, another exception occurred:\n'
  486. '\n'
  487. 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/requests/adapters.py", line 489, in '
  488. 'send\n'
  489. ' 436 def send(\n'
  490. ' 437 self, request, stream=False, timeout=None, verify=True, cert=None, proxies=None\n'
  491. ' 438 ):\n'
  492. ' (...)\n'
  493. ' 485 timeout = TimeoutSauce(connect=timeout, read=timeout)\n'
  494. ' 486 \n'
  495. ' 487 try:\n'
  496. ' 488 if not chunked:\n'
  497. '--> 489 resp = conn.urlopen(\n'
  498. ' 490 method=request.method,\n'
  499. '\n'
  500. 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/urllib3/connectionpool.py", line 813, in '
  501. 'urlopen\n'
  502. ' 522 def urlopen(\n'
  503. ' 523 self,\n'
  504. ' 524 method,\n'
  505. ' 525 url,\n'
  506. ' 526 body=None,\n'
  507. ' 527 headers=None,\n'
  508. ' 528 retries=None,\n'
  509. ' 529 redirect=True,\n'
  510. ' 530 assert_same_host=True,\n'
  511. ' 531 timeout=_Default,\n'
  512. ' 532 pool_timeout=None,\n'
  513. ' 533 release_conn=None,\n'
  514. ' 534 chunked=False,\n'
  515. ' 535 body_pos=None,\n'
  516. ' 536 **response_kw\n'
  517. ' 537 ):\n'
  518. ' (...)\n'
  519. ' 809 # Try again\n'
  520. ' 810 log.warning(\n'
  521. ' 811 "Retrying (%r) after connection broken by \'%r\': %s", retries, err, url\n'
  522. ' 812 )\n'
  523. '--> 813 return self.urlopen(\n'
  524. ' 814 method,\n'
  525. '\n'
  526. 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/urllib3/connectionpool.py", line 813, in '
  527. 'urlopen\n'
  528. ' 522 def urlopen(\n'
  529. ' 523 self,\n'
  530. ' 524 method,\n'
  531. ' 525 url,\n'
  532. ' 526 body=None,\n'
  533. ' 527 headers=None,\n'
  534. ' 528 retries=None,\n'
  535. ' 529 redirect=True,\n'
  536. ' 530 assert_same_host=True,\n'
  537. ' 531 timeout=_Default,\n'
  538. ' 532 pool_timeout=None,\n'
  539. ' 533 release_conn=None,\n'
  540. ' 534 chunked=False,\n'
  541. ' 535 body_pos=None,\n'
  542. ' 536 **response_kw\n'
  543. ' 537 ):\n'
  544. ' (...)\n'
  545. ' 809 # Try again\n'
  546. ' 810 log.warning(\n'
  547. ' 811 "Retrying (%r) after connection broken by \'%r\': %s", retries, err, url\n'
  548. ' 812 )\n'
  549. '--> 813 return self.urlopen(\n'
  550. ' 814 method,\n'
  551. '\n'
  552. 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/urllib3/connectionpool.py", line 813, in '
  553. 'urlopen\n'
  554. ' 522 def urlopen(\n'
  555. ' 523 self,\n'
  556. ' 524 method,\n'
  557. ' 525 url,\n'
  558. ' 526 body=None,\n'
  559. ' 527 headers=None,\n'
  560. ' 528 retries=None,\n'
  561. ' 529 redirect=True,\n'
  562. ' 530 assert_same_host=True,\n'
  563. ' 531 timeout=_Default,\n'
  564. ' 532 pool_timeout=None,\n'
  565. ' 533 release_conn=None,\n'
  566. ' 534 chunked=False,\n'
  567. ' 535 body_pos=None,\n'
  568. ' 536 **response_kw\n'
  569. ' 537 ):\n'
  570. ' (...)\n'
  571. ' 809 # Try again\n'
  572. ' 810 log.warning(\n'
  573. ' 811 "Retrying (%r) after connection broken by \'%r\': %s", retries, err, url\n'
  574. ' 812 )\n'
  575. '--> 813 return self.urlopen(\n'
  576. ' 814 method,\n'
  577. '\n'
  578. 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/urllib3/connectionpool.py", line 785, in '
  579. 'urlopen\n'
  580. ' 522 def urlopen(\n'
  581. ' 523 self,\n'
  582. ' 524 method,\n'
  583. ' 525 url,\n'
  584. ' 526 body=None,\n'
  585. ' 527 headers=None,\n'
  586. ' 528 retries=None,\n'
  587. ' 529 redirect=True,\n'
  588. ' 530 assert_same_host=True,\n'
  589. ' 531 timeout=_Default,\n'
  590. ' 532 pool_timeout=None,\n'
  591. ' 533 release_conn=None,\n'
  592. ' 534 chunked=False,\n'
  593. ' 535 body_pos=None,\n'
  594. ' 536 **response_kw\n'
  595. ' 537 ):\n'
  596. ' (...)\n'
  597. ' 781 e = ProxyError("Cannot connect to proxy.", e)\n'
  598. ' 782 elif isinstance(e, (SocketError, HTTPException)):\n'
  599. ' 783 e = ProtocolError("Connection aborted.", e)\n'
  600. ' 784 \n'
  601. '--> 785 retries = retries.increment(\n'
  602. ' 786 method, url, error=e, _pool=self, _stacktrace=sys.exc_info()[2]\n'
  603. '\n'
  604. 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/urllib3/util/retry.py", line 592, in '
  605. 'increment\n'
  606. ' 504 def increment(\n'
  607. ' 505 self,\n'
  608. ' 506 method=None,\n'
  609. ' 507 url=None,\n'
  610. ' 508 response=None,\n'
  611. ' 509 error=None,\n'
  612. ' 510 _pool=None,\n'
  613. ' 511 _stacktrace=None,\n'
  614. ' 512 ):\n'
  615. ' (...)\n'
  616. ' 588 history=history,\n'
  617. ' 589 )\n'
  618. ' 590 \n'
  619. ' 591 if new_retry.is_exhausted():\n'
  620. '--> 592 raise MaxRetryError(_pool, url, error or ResponseError(cause))\n'
  621. ' 593 \n'
  622. '\n'
  623. '---- (full traceback above) ----\n'
  624. 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/requests/adapters.py", line 489, in '
  625. 'send\n'
  626. ' resp = conn.urlopen(\n'
  627. 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/urllib3/connectionpool.py", line 813, in '
  628. 'urlopen\n'
  629. ' return self.urlopen(\n'
  630. 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/urllib3/connectionpool.py", line 813, in '
  631. 'urlopen\n'
  632. ' return self.urlopen(\n'
  633. 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/urllib3/connectionpool.py", line 813, in '
  634. 'urlopen\n'
  635. ' return self.urlopen(\n'
  636. 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/urllib3/connectionpool.py", line 785, in '
  637. 'urlopen\n'
  638. ' retries = retries.increment(\n'
  639. 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/urllib3/util/retry.py", line 592, in '
  640. 'increment\n'
  641. ' raise MaxRetryError(_pool, url, error or ResponseError(cause))\n'
  642. '\n'
  643. "MaxRetryError: HTTPConnectionPool(host='localhost', port=8080): Max retries exceeded with url: /config (Caused by "
  644. "NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7eff673b6a30>: Failed to establish a new connection: [Errno 111] "
  645. "Connection refused'))\n"
  646. '\n'
  647. 'While handling the above exception, another exception occurred:\n'
  648. '\n'
  649. 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/datahub/cli/ingest_cli.py", line 106, in '
  650. 'run\n'
  651. ' 88 def run(\n'
  652. ' 89 ctx: click.Context,\n'
  653. ' 90 config: str,\n'
  654. ' 91 dry_run: bool,\n'
  655. ' 92 preview: bool,\n'
  656. ' 93 strict_warnings: bool,\n'
  657. ' 94 preview_workunits: int,\n'
  658. ' 95 suppress_error_logs: bool,\n'
  659. ' 96 ) -> None:\n'
  660. ' (...)\n'
  661. ' 102 pipeline_config = load_config_file(config_file)\n'
  662. ' 103 \n'
  663. ' 104 try:\n'
  664. ' 105 logger.debug(f"Using config: {pipeline_config}")\n'
  665. '--> 106 pipeline = Pipeline.create(pipeline_config, dry_run, preview, preview_workunits)\n'
  666. ' 107 except ValidationError as e:\n'
  667. '\n'
  668. 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/datahub/ingestion/run/pipeline.py", line '
  669. '202, in create\n'
  670. ' 194 def create(\n'
  671. ' 195 cls,\n'
  672. ' 196 config_dict: dict,\n'
  673. ' 197 dry_run: bool = False,\n'
  674. ' 198 preview_mode: bool = False,\n'
  675. ' 199 preview_workunits: int = 10,\n'
  676. ' 200 ) -> "Pipeline":\n'
  677. ' 201 config = PipelineConfig.parse_obj(config_dict)\n'
  678. '--> 202 return cls(\n'
  679. ' 203 config,\n'
  680. '\n'
  681. 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/datahub/ingestion/run/pipeline.py", line '
  682. '134, in __init__\n'
  683. ' 123 def __init__(\n'
  684. ' 124 self,\n'
  685. ' 125 config: PipelineConfig,\n'
  686. ' 126 dry_run: bool = False,\n'
  687. ' 127 preview_mode: bool = False,\n'
  688. ' 128 preview_workunits: int = 10,\n'
  689. ' 129 ):\n'
  690. ' 130 self.config = config\n'
  691. ' 131 self.dry_run = dry_run\n'
  692. ' 132 self.preview_mode = preview_mode\n'
  693. ' 133 self.preview_workunits = preview_workunits\n'
  694. '--> 134 self.ctx = PipelineContext(\n'
  695. ' 135 run_id=self.config.run_id,\n'
  696. '\n'
  697. 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/datahub/ingestion/api/common.py", line '
  698. '54, in __init__\n'
  699. ' 45 def __init__(\n'
  700. ' 46 self,\n'
  701. ' 47 run_id: str,\n'
  702. ' 48 datahub_api: Optional[DatahubClientConfig] = None,\n'
  703. ' 49 pipeline_name: Optional[str] = None,\n'
  704. ' 50 dry_run: bool = False,\n'
  705. ' 51 preview_mode: bool = False,\n'
  706. ' 52 ) -> None:\n'
  707. ' 53 self.run_id = run_id\n'
  708. '--> 54 self.graph = DataHubGraph(datahub_api) if datahub_api is not None else None\n'
  709. ' 55 self.pipeline_name = pipeline_name\n'
  710. '\n'
  711. 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/datahub/ingestion/graph/client.py", line '
  712. '53, in __init__\n'
  713. ' 41 def __init__(self, config: DatahubClientConfig) -> None:\n'
  714. ' (...)\n'
  715. ' 49 retry_max_times=self.config.retry_max_times,\n'
  716. ' 50 extra_headers=self.config.extra_headers,\n'
  717. ' 51 ca_certificate_path=self.config.ca_certificate_path,\n'
  718. ' 52 )\n'
  719. '--> 53 self.test_connection()\n'
  720. ' 54 try:\n'
  721. '\n'
  722. 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/datahub/emitter/rest_emitter.py", line '
  723. '147, in test_connection\n'
  724. ' 146 def test_connection(self) -> dict:\n'
  725. '--> 147 response = self._session.get(f"{self._gms_server}/config")\n'
  726. ' 148 if response.status_code == 200:\n'
  727. '\n'
  728. 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/requests/sessions.py", line 600, in get\n'
  729. ' 591 def get(self, url, **kwargs):\n'
  730. ' (...)\n'
  731. ' 596 :rtype: requests.Response\n'
  732. ' 597 """\n'
  733. ' 598 \n'
  734. ' 599 kwargs.setdefault("allow_redirects", True)\n'
  735. '--> 600 return self.request("GET", url, **kwargs)\n'
  736. '\n'
  737. 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/requests/sessions.py", line 587, in '
  738. 'request\n'
  739. ' 500 def request(\n'
  740. ' 501 self,\n'
  741. ' 502 method,\n'
  742. ' 503 url,\n'
  743. ' 504 params=None,\n'
  744. ' 505 data=None,\n'
  745. ' 506 headers=None,\n'
  746. ' 507 cookies=None,\n'
  747. ' 508 files=None,\n'
  748. ' 509 auth=None,\n'
  749. ' 510 timeout=None,\n'
  750. ' 511 allow_redirects=True,\n'
  751. ' 512 proxies=None,\n'
  752. ' 513 hooks=None,\n'
  753. ' 514 stream=None,\n'
  754. ' 515 verify=None,\n'
  755. ' 516 cert=None,\n'
  756. ' 517 json=None,\n'
  757. ' 518 ):\n'
  758. ' (...)\n'
  759. ' 583 "timeout": timeout,\n'
  760. ' 584 "allow_redirects": allow_redirects,\n'
  761. ' 585 }\n'
  762. ' 586 send_kwargs.update(settings)\n'
  763. '--> 587 resp = self.send(prep, **send_kwargs)\n'
  764. ' 588 \n'
  765. '\n'
  766. 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/requests/sessions.py", line 701, in '
  767. 'send\n'
  768. ' 671 def send(self, request, **kwargs):\n'
  769. ' (...)\n'
  770. ' 697 # Start time (approximately) of the request\n'
  771. ' 698 start = preferred_clock()\n'
  772. ' 699 \n'
  773. ' 700 # Send the request\n'
  774. '--> 701 r = adapter.send(request, **kwargs)\n'
  775. ' 702 \n'
  776. '\n'
  777. 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/requests/adapters.py", line 565, in '
  778. 'send\n'
  779. ' 436 def send(\n'
  780. ' 437 self, request, stream=False, timeout=None, verify=True, cert=None, proxies=None\n'
  781. ' 438 ):\n'
  782. ' (...)\n'
  783. ' 561 if isinstance(e.reason, _SSLError):\n'
  784. ' 562 # This branch is for urllib3 v1.22 and later.\n'
  785. ' 563 raise SSLError(e, request=request)\n'
  786. ' 564 \n'
  787. '--> 565 raise ConnectionError(e, request=request)\n'
  788. ' 566 \n'
  789. '\n'
  790. '---- (full traceback above) ----\n'
  791. 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/datahub/cli/ingest_cli.py", line 106, in '
  792. 'run\n'
  793. ' pipeline = Pipeline.create(pipeline_config, dry_run, preview, preview_workunits)\n'
  794. 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/datahub/ingestion/run/pipeline.py", line '
  795. '202, in create\n'
  796. ' return cls(\n'
  797. 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/datahub/ingestion/run/pipeline.py", line '
  798. '134, in __init__\n'
  799. ' self.ctx = PipelineContext(\n'
  800. 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/datahub/ingestion/api/common.py", line '
  801. '54, in __init__\n'
  802. ' self.graph = DataHubGraph(datahub_api) if datahub_api is not None else None\n'
  803. 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/datahub/ingestion/graph/client.py", line '
  804. '53, in __init__\n'
  805. ' self.test_connection()\n'
  806. 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/datahub/emitter/rest_emitter.py", line '
  807. '147, in test_connection\n'
  808. ' response = self._session.get(f"{self._gms_server}/config")\n'
  809. 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/requests/sessions.py", line 600, in get\n'
  810. ' return self.request("GET", url, **kwargs)\n'
  811. 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/requests/sessions.py", line 587, in '
  812. 'request\n'
  813. ' resp = self.send(prep, **send_kwargs)\n'
  814. 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/requests/sessions.py", line 701, in '
  815. 'send\n'
  816. ' r = adapter.send(request, **kwargs)\n'
  817. 'File "/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/requests/adapters.py", line 565, in '
  818. 'send\n'
  819. ' raise ConnectionError(e, request=request)\n'
  820. '\n'
  821. "ConnectionError: HTTPConnectionPool(host='localhost', port=8080): Max retries exceeded with url: /config (Caused by "
  822. "NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7eff673b6a30>: Failed to establish a new connection: [Errno 111] "
  823. "Connection refused'))\n"
  824. '[2022-06-20 09:46:56,770] INFO {datahub.entrypoints:176} - DataHub CLI version: 0.8.38 at '
  825. '/tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/lib/python3.9/site-packages/datahub/__init__.py\n'
  826. '[2022-06-20 09:46:56,770] INFO {datahub.entrypoints:179} - Python version: 3.9.9 (main, Dec 21 2021, 10:03:34) \n'
  827. '[GCC 10.2.1 20210110] at /tmp/datahub/ingest/venv-baf06f55-65cb-47cd-97aa-6b4b85238eb9/bin/python3 on '
  828. 'Linux-5.13.0-51-generic-x86_64-with-glibc2.31\n'
  829. '[2022-06-20 09:46:56,770] INFO {datahub.entrypoints:182} - GMS config {}\n',
  830. "2022-06-20 09:46:57.668307 [exec_id=baf06f55-65cb-47cd-97aa-6b4b85238eb9] INFO: Failed to execute 'datahub ingest'",
  831. '2022-06-20 09:46:57.669094 [exec_id=baf06f55-65cb-47cd-97aa-6b4b85238eb9] INFO: Caught exception EXECUTING '
  832. 'task_id=baf06f55-65cb-47cd-97aa-6b4b85238eb9, name=RUN_INGEST, stacktrace=Traceback (most recent call last):\n'
  833. ' File "/usr/local/lib/python3.9/site-packages/acryl/executor/execution/default_executor.py", line 121, in execute_task\n'
  834. ' self.event_loop.run_until_complete(task_future)\n'
  835. ' File "/usr/local/lib/python3.9/site-packages/nest_asyncio.py", line 89, in run_until_complete\n'
  836. ' return f.result()\n'
  837. ' File "/usr/local/lib/python3.9/asyncio/futures.py", line 201, in result\n'
  838. ' raise self._exception\n'
  839. ' File "/usr/local/lib/python3.9/asyncio/tasks.py", line 256, in __step\n'
  840. ' result = coro.send(None)\n'
  841. ' File "/usr/local/lib/python3.9/site-packages/acryl/executor/execution/sub_process_ingestion_task.py", line 115, in execute\n'
  842. ' raise TaskError("Failed to execute \'datahub ingest\'")\n'
  843. "acryl.executor.execution.task.TaskError: Failed to execute 'datahub ingest'\n"]}
  844. Execution finished with errors.
Advertisement
Add Comment
Please, Sign In to add comment