msemochkin

long_task_log

Jan 13th, 2017
460
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 3.52 KB | None | 0 0
  1. [2017-01-13 09:01:55,470] {models.py:168} INFO - Filling up the DagBag from /opt/airflow/dags/long_task_new.py
  2. [2017-01-13 09:01:55,535] {jobs.py:2007} INFO - Subprocess PID is 33853
  3. [2017-01-13 09:01:56,910] {models.py:168} INFO - Filling up the DagBag from /opt/airflow/dags/long_task_new.py
  4. [2017-01-13 09:01:56,952] {models.py:1062} INFO - Dependencies all met for <TaskInstance: long_task_new_13.task1 2017-01-13 09:01:49.778417 [queued]>
  5. [2017-01-13 09:01:56,960] {models.py:1062} INFO - Dependencies all met for <TaskInstance: long_task_new_13.task1 2017-01-13 09:01:49.778417 [queued]>
  6. [2017-01-13 09:01:56,960] {models.py:1250} INFO -
  7. --------------------------------------------------------------------------------
  8. Starting attempt 1 of 1
  9. --------------------------------------------------------------------------------
  10.  
  11. [2017-01-13 09:01:56,982] {models.py:1273} INFO - Executing <Task(PythonOperator): task1> on 2017-01-13 09:01:49.778417
  12. [2017-01-13 10:02:49,814] {models.py:168} INFO - Filling up the DagBag from /opt/airflow/dags/long_task_new.py
  13. [2017-01-13 10:02:49,877] {jobs.py:2007} INFO - Subprocess PID is 6401
  14. [2017-01-13 10:02:51,418] {models.py:168} INFO - Filling up the DagBag from /opt/airflow/dags/long_task_new.py
  15. [2017-01-13 10:02:51,464] {models.py:1059} WARNING - Dependencies not met for <TaskInstance: long_task_new_13.task1 2017-01-13 09:01:49.778417 [running]>, dependency 'Task Instance State' FAILED: Task is in the 'running' state which is not a valid state for execution. The task must be cleared in order to be run.
  16. [2017-01-13 10:02:52,206] {jobs.py:2076} WARNING - Recorded hostname and pid of hostname.domain.com and 6401 do not match this instance's which are hostname.domain.com and 33853. Taking the poison pill. So long.
  17. [2017-01-13 10:02:52,401] {helpers.py:207} WARNING - Terminating descendant processes of ['/opt/anaconda2/bin/python /opt/anaconda2/bin/airflow run long_task_new_13 task1 2017-01-13T09:01:49.778417 --local -sd /opt/airflow/dags/long_task_new.py'] PID: 33652
  18. [2017-01-13 10:02:52,402] {helpers.py:210} WARNING - Terminating descendant process ['/opt/anaconda2/bin/python /opt/anaconda2/bin/airflow run long_task_new_13 task1 2017-01-13T09:01:49.778417 --job_id 544297 --raw -sd DAGS_FOLDER/long_task_new.py'] PID: 33853
  19. [2017-01-13 10:02:52,402] {helpers.py:213} WARNING - Waiting up to 5s for processes to exit...
  20. [2017-01-13 10:02:52,402] {models.py:1282} ERROR - Killing subprocess
  21. [2017-01-13 10:02:52,403] {models.py:1348} ERROR - Task received SIGTERM signal
  22. Traceback (most recent call last):
  23. File "/opt/anaconda2/lib/python2.7/site-packages/airflow-1.7.2.dev0-py2.7.egg/airflow/models.py", line 1300, in run
  24. result = task_copy.execute(context=context)
  25. File "/opt/anaconda2/lib/python2.7/site-packages/airflow-1.7.2.dev0-py2.7.egg/airflow/operators/python_operator.py", line 80, in execute
  26. return_value = self.python_callable(*self.op_args, **self.op_kwargs)
  27. File "/opt/airflow/dags/long_task_new.py", line 19, in run
  28. time.sleep(n)
  29. File "/opt/anaconda2/lib/python2.7/site-packages/airflow-1.7.2.dev0-py2.7.egg/airflow/models.py", line 1284, in signal_handler
  30. raise AirflowException("Task received SIGTERM signal")
  31. AirflowException: Task received SIGTERM signal
  32. [2017-01-13 10:02:52,406] {models.py:1372} INFO - Marking task as FAILED.
  33. [2017-01-13 10:02:52,437] {email.py:101} INFO - Sent an alert email to ['[email protected]']
  34. [2017-01-13 10:02:52,488] {models.py:1393} ERROR - Task received SIGTERM signal
  35. [2017-01-13 10:02:52,655] {helpers.py:216} WARNING - Done waiting
Advertisement
Add Comment
Please, Sign In to add comment