Advertisement
Guest User

airflow variable error

a guest
Dec 12th, 2019
202
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
Python 4.39 KB | None | 0 0
  1. [2019-12-12 12:08:42,108] {{dagbag.py:207}} ERROR - Failed to import: /usr/local/airflow/dags/youtube_translation_encyclopedia.py
  2. Traceback (most recent call last):
  3.   File "/usr/local/lib/python3.7/site-packages/sqlalchemy/engine/base.py", line 1246, in _execute_context
  4.     cursor, statement, parameters, context
  5.   File "/usr/local/lib/python3.7/site-packages/sqlalchemy/engine/default.py", line 581, in do_execute
  6.     cursor.execute(statement, parameters)
  7. sqlite3.IntegrityError: UNIQUE constraint failed: variable.key
  8.  
  9. The above exception was the direct cause of the following exception:
  10.  
  11. Traceback (most recent call last):
  12.   File "/usr/local/lib/python3.7/site-packages/airflow/models/dagbag.py", line 204, in process_file
  13.     m = imp.load_source(mod_name, filepath)
  14.   File "/usr/local/lib/python3.7/imp.py", line 171, in load_source
  15.     module = _load(spec)
  16.   File "<frozen importlib._bootstrap>", line 696, in _load
  17.   File "<frozen importlib._bootstrap>", line 677, in _load_unlocked
  18.   File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  19.   File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  20.   File "/usr/local/airflow/dags/youtube_translation_encyclopedia.py", line 39, in <module>
  21.     Variable.set("youtube_translation_encyclopedia_BATCH_START", 0)
  22.   File "/usr/local/lib/python3.7/site-packages/airflow/utils/db.py", line 74, in wrapper
  23.     return func(*args, **kwargs)
  24.   File "/usr/local/lib/python3.7/site-packages/airflow/models/variable.py", line 142, in set
  25.     session.flush()
  26.   File "/usr/local/lib/python3.7/site-packages/sqlalchemy/orm/session.py", line 2470, in flush
  27.     self._flush(objects)
  28.   File "/usr/local/lib/python3.7/site-packages/sqlalchemy/orm/session.py", line 2608, in _flush
  29.     transaction.rollback(_capture_exception=True)
  30.   File "/usr/local/lib/python3.7/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__
  31.     compat.reraise(exc_type, exc_value, exc_tb)
  32.   File "/usr/local/lib/python3.7/site-packages/sqlalchemy/util/compat.py", line 153, in reraise
  33.     raise value
  34.   File "/usr/local/lib/python3.7/site-packages/sqlalchemy/orm/session.py", line 2568, in _flush
  35.     flush_context.execute()
  36.   File "/usr/local/lib/python3.7/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute
  37.     rec.execute(self)
  38.   File "/usr/local/lib/python3.7/site-packages/sqlalchemy/orm/unitofwork.py", line 589, in execute
  39.     uow,
  40.   File "/usr/local/lib/python3.7/site-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj
  41.     insert,
  42.   File "/usr/local/lib/python3.7/site-packages/sqlalchemy/orm/persistence.py", line 1137, in _emit_insert_statements
  43.     statement, params
  44.   File "/usr/local/lib/python3.7/site-packages/sqlalchemy/engine/base.py", line 982, in execute
  45.     return meth(self, multiparams, params)
  46.   File "/usr/local/lib/python3.7/site-packages/sqlalchemy/sql/elements.py", line 287, in _execute_on_connection
  47.     return connection._execute_clauseelement(self, multiparams, params)
  48.   File "/usr/local/lib/python3.7/site-packages/sqlalchemy/engine/base.py", line 1101, in _execute_clauseelement
  49.     distilled_params,
  50.   File "/usr/local/lib/python3.7/site-packages/sqlalchemy/engine/base.py", line 1250, in _execute_context
  51.     e, statement, parameters, cursor, context
  52.   File "/usr/local/lib/python3.7/site-packages/sqlalchemy/engine/base.py", line 1476, in _handle_dbapi_exception
  53.     util.raise_from_cause(sqlalchemy_exception, exc_info)
  54.   File "/usr/local/lib/python3.7/site-packages/sqlalchemy/util/compat.py", line 398, in raise_from_cause
  55.     reraise(type(exception), exception, tb=exc_tb, cause=cause)
  56.   File "/usr/local/lib/python3.7/site-packages/sqlalchemy/util/compat.py", line 152, in reraise
  57.     raise value.with_traceback(tb)
  58.   File "/usr/local/lib/python3.7/site-packages/sqlalchemy/engine/base.py", line 1246, in _execute_context
  59.     cursor, statement, parameters, context
  60.   File "/usr/local/lib/python3.7/site-packages/sqlalchemy/engine/default.py", line 581, in do_execute
  61.     cursor.execute(statement, parameters)
  62. sqlalchemy.exc.IntegrityError: (sqlite3.IntegrityError) UNIQUE constraint failed: variable.key
  63. [SQL: INSERT INTO variable ("key", val, is_encrypted) VALUES (?, ?, ?)]
  64. [parameters: ('youtube_translation_encyclopedia_BATCH_START', 'gAAAAABd8i3K7rF0RC2LP6qTcbCo1oQ9093gDEUAgmjw1tJBCxgT3c_Qg1KcCkowy5EK4EQEw3rcNQp5usxWHqnRMrxHuzfC_Q==', 1)]
  65. (Background on this error at: http://sqlalche.me/e/gkpj)
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement