Guest User

onx.log.12222017.1

a guest
Dec 22nd, 2017
85
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 21.92 KB | None
  1. 17-12-23 00:56:31 dfe8c504c3c3 INFO [onyx.static.logging-configuration:34] - Starting Logging Configuration
  2. 17-12-23 00:56:31 dfe8c504c3c3 INFO [onyx.messaging.aeron.messaging-group:45] - Starting Aeron Peer Group
  3. 17-12-23 00:56:32 dfe8c504c3c3 INFO [onyx.monitoring.metrics-monitoring:114] - Started Metrics Reporting to JMX.
  4. 17-12-23 00:56:32 dfe8c504c3c3 WARN [onyx.peer.peer-group-manager:271] - Aeron media driver is healthy, thus starting all peers.
  5. 17-12-23 00:56:32 dfe8c504c3c3 INFO [onyx.log.zookeeper:118] - Starting ZooKeeper client connection. If Onyx hangs here it may indicate a difficulty connecting to ZooKeeper.
  6. 17-12-23 00:56:32 dfe8c504c3c3 INFO [onyx.log.zookeeper:118] - Starting ZooKeeper client connection. If Onyx hangs here it may indicate a difficulty connecting to ZooKeeper.
  7. 17-12-23 00:56:34 dfe8c504c3c3 INFO [onyx.peer.communicator:32] - Starting Log Writer
  8. 17-12-23 00:56:34 dfe8c504c3c3 INFO [onyx.peer.communicator:65] - Starting Replica Subscription
  9. 17-12-23 00:56:34 dfe8c504c3c3 INFO [onyx.static.logging-configuration:34] - Starting Logging Configuration
  10. 17-12-23 00:56:34 dfe8c504c3c3 INFO [onyx.peer.virtual-peer:17] - Starting Virtual Peer f18b1883-1fcc-182b-8c83-18bcf79372d4
  11. 17-12-23 00:56:34 dfe8c504c3c3 INFO [onyx.peer.virtual-peer:17] - Starting Virtual Peer fbac875b-198e-baa9-a35b-47ecd97be4a7
  12. 17-12-23 00:56:34 dfe8c504c3c3 INFO [onyx.peer.virtual-peer:17] - Starting Virtual Peer f18a35b0-e39a-bb99-effb-92b6c53cf519
  13. 17-12-23 00:56:34 dfe8c504c3c3 INFO [onyx.peer.virtual-peer:17] - Starting Virtual Peer ffd842b8-f578-7ead-e5f9-f667362852d7
  14. 17-12-23 00:56:35 dfe8c504c3c3 INFO [onyx.log.zookeeper:151] - Stopping ZooKeeper client connection
  15. 17-12-23 00:56:37 dfe8c504c3c3 INFO [onyx.peer.task-lifecycle:1157] - Job 0d4c49db-aba8-b94e-de0b-315e11373feb {:job-id #uuid "0d4c49db-aba8-b94e-de0b-315e11373feb", :job-hash "54abf674338274a6e0d58703c48b587fcc5375861a8f4c66c1a4cc3f52e9ad"} - Task {:id :scanner-command-result, :name :scanner-command-result, :ingress-tasks #{:ibgateway}, :egress-tasks-batch-sizes {}, :egress-tasks #{}} - Peer f18b1883-1fcc-182b-8c83-18bcf79372d4 - Compiling lifecycle
  16. 17-12-23 00:56:37 dfe8c504c3c3 INFO [onyx.peer.task-lifecycle:1157] - Job 0d4c49db-aba8-b94e-de0b-315e11373feb {:job-id #uuid "0d4c49db-aba8-b94e-de0b-315e11373feb", :job-hash "54abf674338274a6e0d58703c48b587fcc5375861a8f4c66c1a4cc3f52e9ad"} - Task {:id :scanner, :name :scanner, :ingress-tasks #{:ibgateway}, :egress-tasks-batch-sizes {}, :egress-tasks #{}} - Peer fbac875b-198e-baa9-a35b-47ecd97be4a7 - Compiling lifecycle
  17. 17-12-23 00:56:37 dfe8c504c3c3 INFO [onyx.peer.task-lifecycle:1157] - Job 0d4c49db-aba8-b94e-de0b-315e11373feb {:job-id #uuid "0d4c49db-aba8-b94e-de0b-315e11373feb", :job-hash "54abf674338274a6e0d58703c48b587fcc5375861a8f4c66c1a4cc3f52e9ad"} - Task {:id :scanner-command, :name :scanner-command, :ingress-tasks #{}, :egress-tasks-batch-sizes {:ibgateway 10}, :egress-tasks #{:ibgateway}} - Peer ffd842b8-f578-7ead-e5f9-f667362852d7 - Compiling lifecycle
  18. 17-12-23 00:56:37 dfe8c504c3c3 INFO [onyx.peer.task-lifecycle:1157] - Job 0d4c49db-aba8-b94e-de0b-315e11373feb {:job-id #uuid "0d4c49db-aba8-b94e-de0b-315e11373feb", :job-hash "54abf674338274a6e0d58703c48b587fcc5375861a8f4c66c1a4cc3f52e9ad"} - Task {:id :ibgateway, :name :ibgateway, :ingress-tasks #{:scanner-command}, :egress-tasks-batch-sizes {:scanner-command-result 10, :scanner 10}, :egress-tasks #{:scanner-command-result :scanner}} - Peer f18a35b0-e39a-bb99-effb-92b6c53cf519 - Compiling lifecycle
  19. 17-12-23 00:56:37 dfe8c504c3c3 INFO [onyx.peer.task-lifecycle:1227] - Job 0d4c49db-aba8-b94e-de0b-315e11373feb {:job-id #uuid "0d4c49db-aba8-b94e-de0b-315e11373feb", :job-hash "54abf674338274a6e0d58703c48b587fcc5375861a8f4c66c1a4cc3f52e9ad"} - Task {:id :scanner-command-result, :name :scanner-command-result, :ingress-tasks #{:ibgateway}, :egress-tasks-batch-sizes {}, :egress-tasks #{}} - Peer f18b1883-1fcc-182b-8c83-18bcf79372d4 - Warming up task lifecycle {:id :scanner-command-result, :name :scanner-command-result, :ingress-tasks #{:ibgateway}, :egress-tasks-batch-sizes {}, :egress-tasks #{}}
  20. 17-12-23 00:56:37 dfe8c504c3c3 INFO [onyx.peer.task-lifecycle:1227] - Job 0d4c49db-aba8-b94e-de0b-315e11373feb {:job-id #uuid "0d4c49db-aba8-b94e-de0b-315e11373feb", :job-hash "54abf674338274a6e0d58703c48b587fcc5375861a8f4c66c1a4cc3f52e9ad"} - Task {:id :ibgateway, :name :ibgateway, :ingress-tasks #{:scanner-command}, :egress-tasks-batch-sizes {:scanner-command-result 10, :scanner 10}, :egress-tasks #{:scanner-command-result :scanner}} - Peer f18a35b0-e39a-bb99-effb-92b6c53cf519 - Warming up task lifecycle {:id :ibgateway, :name :ibgateway, :ingress-tasks #{:scanner-command}, :egress-tasks-batch-sizes {:scanner-command-result 10, :scanner 10}, :egress-tasks #{:scanner-command-result :scanner}}
  21. 17-12-23 00:56:37 dfe8c504c3c3 INFO [onyx.peer.task-lifecycle:1227] - Job 0d4c49db-aba8-b94e-de0b-315e11373feb {:job-id #uuid "0d4c49db-aba8-b94e-de0b-315e11373feb", :job-hash "54abf674338274a6e0d58703c48b587fcc5375861a8f4c66c1a4cc3f52e9ad"} - Task {:id :scanner-command, :name :scanner-command, :ingress-tasks #{}, :egress-tasks-batch-sizes {:ibgateway 10}, :egress-tasks #{:ibgateway}} - Peer ffd842b8-f578-7ead-e5f9-f667362852d7 - Warming up task lifecycle {:id :scanner-command, :name :scanner-command, :ingress-tasks #{}, :egress-tasks-batch-sizes {:ibgateway 10}, :egress-tasks #{:ibgateway}}
  22. 17-12-23 00:56:37 dfe8c504c3c3 INFO [onyx.peer.task-lifecycle:1227] - Job 0d4c49db-aba8-b94e-de0b-315e11373feb {:job-id #uuid "0d4c49db-aba8-b94e-de0b-315e11373feb", :job-hash "54abf674338274a6e0d58703c48b587fcc5375861a8f4c66c1a4cc3f52e9ad"} - Task {:id :scanner, :name :scanner, :ingress-tasks #{:ibgateway}, :egress-tasks-batch-sizes {}, :egress-tasks #{}} - Peer fbac875b-198e-baa9-a35b-47ecd97be4a7 - Warming up task lifecycle {:id :scanner, :name :scanner, :ingress-tasks #{:ibgateway}, :egress-tasks-batch-sizes {}, :egress-tasks #{}}
  23. 17-12-23 00:56:37 dfe8c504c3c3 INFO [onyx.peer.task-lifecycle:68] - Job 0d4c49db-aba8-b94e-de0b-315e11373feb {:job-id #uuid "0d4c49db-aba8-b94e-de0b-315e11373feb", :job-hash "54abf674338274a6e0d58703c48b587fcc5375861a8f4c66c1a4cc3f52e9ad"} - Task {:id :scanner-command, :name :scanner-command, :ingress-tasks #{}, :egress-tasks-batch-sizes {:ibgateway 10}, :egress-tasks #{:ibgateway}} - Peer ffd842b8-f578-7ead-e5f9-f667362852d7 - Peer chose not to start the task yet. Backing off and retrying...
  24. 17-12-23 00:56:37 dfe8c504c3c3 INFO [onyx.peer.task-lifecycle:68] - Job 0d4c49db-aba8-b94e-de0b-315e11373feb {:job-id #uuid "0d4c49db-aba8-b94e-de0b-315e11373feb", :job-hash "54abf674338274a6e0d58703c48b587fcc5375861a8f4c66c1a4cc3f52e9ad"} - Task {:id :ibgateway, :name :ibgateway, :ingress-tasks #{:scanner-command}, :egress-tasks-batch-sizes {:scanner-command-result 10, :scanner 10}, :egress-tasks #{:scanner-command-result :scanner}} - Peer f18a35b0-e39a-bb99-effb-92b6c53cf519 - Peer chose not to start the task yet. Backing off and retrying...
  25. 17-12-23 00:56:37 dfe8c504c3c3 INFO [onyx.peer.task-lifecycle:68] - Job 0d4c49db-aba8-b94e-de0b-315e11373feb {:job-id #uuid "0d4c49db-aba8-b94e-de0b-315e11373feb", :job-hash "54abf674338274a6e0d58703c48b587fcc5375861a8f4c66c1a4cc3f52e9ad"} - Task {:id :scanner, :name :scanner, :ingress-tasks #{:ibgateway}, :egress-tasks-batch-sizes {}, :egress-tasks #{}} - Peer fbac875b-198e-baa9-a35b-47ecd97be4a7 - Peer chose not to start the task yet. Backing off and retrying...
  26. 17-12-23 00:56:37 dfe8c504c3c3 INFO [onyx.peer.task-lifecycle:68] - Job 0d4c49db-aba8-b94e-de0b-315e11373feb {:job-id #uuid "0d4c49db-aba8-b94e-de0b-315e11373feb", :job-hash "54abf674338274a6e0d58703c48b587fcc5375861a8f4c66c1a4cc3f52e9ad"} - Task {:id :scanner-command-result, :name :scanner-command-result, :ingress-tasks #{:ibgateway}, :egress-tasks-batch-sizes {}, :egress-tasks #{}} - Peer f18b1883-1fcc-182b-8c83-18bcf79372d4 - Peer chose not to start the task yet. Backing off and retrying...
  27. 17-12-23 00:56:37 dfe8c504c3c3 INFO [onyx.monitoring.metrics-monitoring:328] - Starting Task Metrics Reporter. Starting reporting to JMX.
  28. 17-12-23 00:56:37 dfe8c504c3c3 INFO [onyx.monitoring.metrics-monitoring:328] - Starting Task Metrics Reporter. Starting reporting to JMX.
  29. 17-12-23 00:56:37 dfe8c504c3c3 INFO [onyx.monitoring.metrics-monitoring:328] - Starting Task Metrics Reporter. Starting reporting to JMX.
  30. 17-12-23 00:56:37 dfe8c504c3c3 INFO [onyx.monitoring.metrics-monitoring:328] - Starting Task Metrics Reporter. Starting reporting to JMX.
  31. 17-12-23 00:56:37 dfe8c504c3c3 INFO [onyx.peer.task-lifecycle:1125] - Job 0d4c49db-aba8-b94e-de0b-315e11373feb {:job-id #uuid "0d4c49db-aba8-b94e-de0b-315e11373feb", :job-hash "54abf674338274a6e0d58703c48b587fcc5375861a8f4c66c1a4cc3f52e9ad"} - Task {:id :ibgateway, :name :ibgateway, :ingress-tasks #{:scanner-command}, :egress-tasks-batch-sizes {:scanner-command-result 10, :scanner 10}, :egress-tasks #{:scanner-command-result :scanner}} - Peer f18a35b0-e39a-bb99-effb-92b6c53cf519 - Starting task state machine: [[0 :lifecycle/poll-recover] [1 :lifecycle/offer-barriers] [2 :lifecycle/offer-barrier-status] [3 :lifecycle/unblock-subscribers] [4 :lifecycle/next-iteration] [5 :lifecycle/seal-barriers?] [6 :lifecycle/offer-barriers] [7 :lifecycle/offer-barrier-status] [8 :lifecycle/unblock-subscribers] [9 :lifecycle/read-batch] [10 :lifecycle/check-publisher-heartbeats] [11 :lifecycle/apply-fn] [12 :lifecycle/prepare-segments] [13 :lifecycle/prepare-batch] [14 :lifecycle/write-batch] [15 :lifecycle/offer-heartbeats]]
  32. 17-12-23 00:56:37 dfe8c504c3c3 INFO [onyx.peer.task-lifecycle:1250] - Job 0d4c49db-aba8-b94e-de0b-315e11373feb {:job-id #uuid "0d4c49db-aba8-b94e-de0b-315e11373feb", :job-hash "54abf674338274a6e0d58703c48b587fcc5375861a8f4c66c1a4cc3f52e9ad"} - Task {:id :ibgateway, :name :ibgateway, :ingress-tasks #{:scanner-command}, :egress-tasks-batch-sizes {:scanner-command-result 10, :scanner 10}, :egress-tasks #{:scanner-command-result :scanner}} - Peer f18a35b0-e39a-bb99-effb-92b6c53cf519 - Enough peers are active, starting the task
  33. 17-12-23 00:56:38 dfe8c504c3c3 INFO [onyx.messaging.aeron.subscriber:129] - Created subscriber {:subscription {:slot-id -1, :registration-id 1, :site {:address "0.0.0.0", :port 40200}, :blocked? true, :images [], :sources [], :channel "aeron:udp?endpoint=0.0.0.0:40200|term-length=4194304", :rv nil, :e nil, :stream-id 445614501, :closed? false, :channel-id "aeron:udp?endpoint=0.0.0.0:40200|term-length=4194304", :dst-task-id [#uuid "0d4c49db-aba8-b94e-de0b-315e11373feb" :ibgateway]}, :status-pubs {}}
  34. 17-12-23 00:56:38 dfe8c504c3c3 INFO [onyx.messaging.aeron.endpoint-status:80] - Started endpoint status on peer: f18a35b0-e39a-bb99-effb-92b6c53cf519
  35. 17-12-23 00:56:38 dfe8c504c3c3 INFO [onyx.messaging.aeron.publisher:199] - Starting publisher aeron:udp?endpoint=0.0.0.0:40200|term-length=524288
  36. 17-12-23 00:56:38 dfe8c504c3c3 INFO [onyx.messaging.aeron.endpoint-status:80] - Started endpoint status on peer: f18a35b0-e39a-bb99-effb-92b6c53cf519
  37. 17-12-23 00:56:38 dfe8c504c3c3 INFO [onyx.messaging.aeron.publisher:199] - Starting publisher aeron:udp?endpoint=0.0.0.0:40200|term-length=524288
  38. 17-12-23 00:56:38 dfe8c504c3c3 INFO [onyx.peer.coordinator:312] - Piggybacking coordinator on peer: f18a35b0-e39a-bb99-effb-92b6c53cf519
  39. 17-12-23 00:56:38 dfe8c504c3c3 INFO [onyx.messaging.aeron.endpoint-status:80] - Started endpoint status on peer: [:coordinator #uuid "f18a35b0-e39a-bb99-effb-92b6c53cf519"]
  40. 17-12-23 00:56:38 dfe8c504c3c3 INFO [onyx.messaging.aeron.publisher:199] - Starting publisher aeron:udp?endpoint=0.0.0.0:40200|term-length=524288
  41. 17-12-23 00:56:41 dfe8c504c3c3 INFO [onyx.plugin.kafka:310] - Job 0d4c49db-aba8-b94e-de0b-315e11373feb {:job-id #uuid "0d4c49db-aba8-b94e-de0b-315e11373feb", :job-hash "54abf674338274a6e0d58703c48b587fcc5375861a8f4c66c1a4cc3f52e9ad"} - Task {:id :scanner-command-result, :name :scanner-command-result, :ingress-tasks #{:ibgateway}, :egress-tasks-batch-sizes {}, :egress-tasks #{}} - Peer f18b1883-1fcc-182b-8c83-18bcf79372d4 - Starting kafka/write-messages task with producer opts: {"bootstrap.servers" ("kafka:9092"), "max.request.size" 307200}
  42. 17-12-23 00:56:41 dfe8c504c3c3 INFO [onyx.plugin.kafka:310] - Job 0d4c49db-aba8-b94e-de0b-315e11373feb {:job-id #uuid "0d4c49db-aba8-b94e-de0b-315e11373feb", :job-hash "54abf674338274a6e0d58703c48b587fcc5375861a8f4c66c1a4cc3f52e9ad"} - Task {:id :scanner, :name :scanner, :ingress-tasks #{:ibgateway}, :egress-tasks-batch-sizes {}, :egress-tasks #{}} - Peer fbac875b-198e-baa9-a35b-47ecd97be4a7 - Starting kafka/write-messages task with producer opts: {"bootstrap.servers" ("kafka:9092"), "max.request.size" 307200}
  43. 17-12-23 00:56:41 dfe8c504c3c3 INFO [onyx.plugin.kafka:127] - Job 0d4c49db-aba8-b94e-de0b-315e11373feb {:job-id #uuid "0d4c49db-aba8-b94e-de0b-315e11373feb", :job-hash "54abf674338274a6e0d58703c48b587fcc5375861a8f4c66c1a4cc3f52e9ad"} - Task {:id :scanner-command, :name :scanner-command, :ingress-tasks #{}, :egress-tasks-batch-sizes {:ibgateway 10}, :egress-tasks #{:ibgateway}} - Peerffd842b8-f578-7ead-e5f9-f667362852d7 - Starting kafka/read-messages task with consumer opts: {"bootstrap.servers" ("kafka:9092"), "group.id" "onyx", "enable.auto.commit" false, "receive.buffer.bytes" 65536, "auto.offset.reset" "earliest"}
  44. 17-12-23 00:56:41 dfe8c504c3c3 INFO [onyx.peer.task-lifecycle:1125] - Job 0d4c49db-aba8-b94e-de0b-315e11373feb {:job-id #uuid "0d4c49db-aba8-b94e-de0b-315e11373feb", :job-hash "54abf674338274a6e0d58703c48b587fcc5375861a8f4c66c1a4cc3f52e9ad"} - Task {:id :scanner, :name :scanner, :ingress-tasks #{:ibgateway}, :egress-tasks-batch-sizes {}, :egress-tasks #{}} - Peer fbac875b-198e-baa9-a35b-47ecd97be4a7 - Starting task state machine: [[0 :lifecycle/poll-recover] [1 :lifecycle/offer-barrier-status] [2 :lifecycle/recover-output] [3 :lifecycle/unblock-subscribers] [4 :lifecycle/next-iteration] [5 :lifecycle/seal-barriers?] [6 :lifecycle/checkpoint-output] [7 :lifecycle/offer-barrier-status] [8 :lifecycle/unblock-subscribers] [9 :lifecycle/read-batch] [10 :lifecycle/check-publisher-heartbeats] [11 :lifecycle/apply-fn] [12 :lifecycle/prepare-segments] [13 :lifecycle/prepare-batch] [14 :lifecycle/write-batch] [15 :lifecycle/offer-heartbeats]]
  45. 17-12-23 00:56:41 dfe8c504c3c3 INFO [onyx.peer.task-lifecycle:1250] - Job 0d4c49db-aba8-b94e-de0b-315e11373feb {:job-id #uuid "0d4c49db-aba8-b94e-de0b-315e11373feb", :job-hash "54abf674338274a6e0d58703c48b587fcc5375861a8f4c66c1a4cc3f52e9ad"} - Task {:id :scanner, :name :scanner, :ingress-tasks #{:ibgateway}, :egress-tasks-batch-sizes {}, :egress-tasks #{}} - Peer fbac875b-198e-baa9-a35b-47ecd97be4a7 - Enough peers are active, starting the task
  46. 17-12-23 00:56:41 dfe8c504c3c3 INFO [onyx.peer.task-lifecycle:1125] - Job 0d4c49db-aba8-b94e-de0b-315e11373feb {:job-id #uuid "0d4c49db-aba8-b94e-de0b-315e11373feb", :job-hash "54abf674338274a6e0d58703c48b587fcc5375861a8f4c66c1a4cc3f52e9ad"} - Task {:id :scanner-command-result, :name :scanner-command-result, :ingress-tasks #{:ibgateway}, :egress-tasks-batch-sizes {}, :egress-tasks #{}} - Peer f18b1883-1fcc-182b-8c83-18bcf79372d4 - Starting task state machine: [[0 :lifecycle/poll-recover] [1 :lifecycle/offer-barrier-status] [2 :lifecycle/recover-output] [3 :lifecycle/unblock-subscribers] [4 :lifecycle/next-iteration] [5 :lifecycle/seal-barriers?] [6 :lifecycle/checkpoint-output] [7 :lifecycle/offer-barrier-status] [8 :lifecycle/unblock-subscribers] [9 :lifecycle/read-batch] [10 :lifecycle/check-publisher-heartbeats] [11 :lifecycle/apply-fn] [12 :lifecycle/prepare-segments] [13 :lifecycle/prepare-batch] [14 :lifecycle/write-batch] [15 :lifecycle/offer-heartbeats]]
  47. 17-12-23 00:56:41 dfe8c504c3c3 INFO [onyx.peer.task-lifecycle:1250] - Job 0d4c49db-aba8-b94e-de0b-315e11373feb {:job-id #uuid "0d4c49db-aba8-b94e-de0b-315e11373feb", :job-hash "54abf674338274a6e0d58703c48b587fcc5375861a8f4c66c1a4cc3f52e9ad"} - Task {:id :scanner-command-result, :name :scanner-command-result, :ingress-tasks #{:ibgateway}, :egress-tasks-batch-sizes {}, :egress-tasks #{}} - Peer f18b1883-1fcc-182b-8c83-18bcf79372d4 - Enough peers are active, starting the task
  48. 17-12-23 00:56:41 dfe8c504c3c3 INFO [onyx.messaging.aeron.subscriber:129] - Created subscriber {:subscription {:slot-id -1, :registration-id 18, :site {:address "0.0.0.0", :port 40200}, :blocked? true, :images [], :sources [], :channel "aeron:udp?endpoint=0.0.0.0:40200|term-length=4194304", :rv nil, :e nil, :stream-id -301318080, :closed? false, :channel-id "aeron:udp?endpoint=0.0.0.0:40200|term-length=4194304", :dst-task-id [#uuid "0d4c49db-aba8-b94e-de0b-315e11373feb" :scanner]}, :status-pubs {}}
  49. 17-12-23 00:56:41 dfe8c504c3c3 INFO [onyx.messaging.aeron.subscriber:66] - Available network image -278868938 0 :correlation-id 21 [[#uuid "0d4c49db-aba8-b94e-de0b-315e11373feb" :scanner] -1 {:address "0.0.0.0", :port 40200}]
  50. 17-12-23 00:56:41 dfe8c504c3c3 INFO [onyx.messaging.aeron.subscriber:129] - Created subscriber {:subscription {:slot-id -1, :registration-id 23, :site {:address "0.0.0.0", :port 40200}, :blocked? true, :images [], :sources [], :channel "aeron:udp?endpoint=0.0.0.0:40200|term-length=4194304", :rv nil, :e nil, :stream-id -41818169, :closed? false, :channel-id "aeron:udp?endpoint=0.0.0.0:40200|term-length=4194304", :dst-task-id [#uuid "0d4c49db-aba8-b94e-de0b-315e11373feb" :scanner-command-result]}, :status-pubs {}}
  51. 17-12-23 00:56:41 dfe8c504c3c3 INFO [onyx.messaging.aeron.subscriber:66] - Available network image -278868939 0 :correlation-id 26 [[#uuid "0d4c49db-aba8-b94e-de0b-315e11373feb" :scanner-command-result] -1 {:address "0.0.0.0", :port 40200}]
  52. 17-12-23 00:56:42 dfe8c504c3c3 INFO [onyx.peer.task-lifecycle:1125] - Job 0d4c49db-aba8-b94e-de0b-315e11373feb {:job-id #uuid "0d4c49db-aba8-b94e-de0b-315e11373feb", :job-hash "54abf674338274a6e0d58703c48b587fcc5375861a8f4c66c1a4cc3f52e9ad"} - Task {:id :scanner-command, :name :scanner-command, :ingress-tasks #{}, :egress-tasks-batch-sizes {:ibgateway 10}, :egress-tasks #{:ibgateway}} - Peer ffd842b8-f578-7ead-e5f9-f667362852d7 - Starting task state machine: [[0 :lifecycle/poll-recover] [1 :lifecycle/offer-barriers] [2 :lifecycle/offer-barrier-status] [3 :lifecycle/recover-input] [4 :lifecycle/unblock-subscribers] [5 :lifecycle/next-iteration] [6 :lifecycle/input-poll-barriers] [7 :lifecycle/check-publisher-heartbeats] [8 :lifecycle/seal-barriers?] [9 :lifecycle/checkpoint-input] [10 :lifecycle/offer-barriers] [11 :lifecycle/offer-barrier-status] [12 :lifecycle/unblock-subscribers] [13 :lifecycle/read-batch] [14 :lifecycle/apply-fn] [15 :lifecycle/prepare-segments] [16 :lifecycle/prepare-batch] [17 :lifecycle/write-batch] [18 :lifecycle/offer-heartbeats]]
  53. 17-12-23 00:56:42 dfe8c504c3c3 INFO [onyx.peer.task-lifecycle:1250] - Job 0d4c49db-aba8-b94e-de0b-315e11373feb {:job-id #uuid "0d4c49db-aba8-b94e-de0b-315e11373feb", :job-hash "54abf674338274a6e0d58703c48b587fcc5375861a8f4c66c1a4cc3f52e9ad"} - Task {:id :scanner-command, :name :scanner-command, :ingress-tasks #{}, :egress-tasks-batch-sizes {:ibgateway 10}, :egress-tasks #{:ibgateway}} - Peer ffd842b8-f578-7ead-e5f9-f667362852d7 - Enough peers are active, starting the task
  54. 17-12-23 00:56:42 dfe8c504c3c3 INFO [onyx.messaging.aeron.subscriber:129] - Created subscriber {:subscription {:slot-id -1, :registration-id 28, :site {:address "0.0.0.0", :port 40200}, :blocked? true, :images [], :sources [], :channel "aeron:udp?endpoint=0.0.0.0:40200|term-length=4194304", :rv nil, :e nil, :stream-id -1922923590, :closed? false, :channel-id "aeron:udp?endpoint=0.0.0.0:40200|term-length=4194304", :dst-task-id [#uuid "0d4c49db-aba8-b94e-de0b-315e11373feb" :scanner-command]}, :status-pubs {}}
  55. 17-12-23 00:56:42 dfe8c504c3c3 INFO [onyx.messaging.aeron.endpoint-status:80] - Started endpoint status on peer: ffd842b8-f578-7ead-e5f9-f667362852d7
  56. 17-12-23 00:56:42 dfe8c504c3c3 INFO [onyx.messaging.aeron.publisher:199] - Starting publisher aeron:udp?endpoint=0.0.0.0:40200|term-length=524288
  57. 17-12-23 00:56:42 dfe8c504c3c3 INFO [onyx.messaging.aeron.subscriber:66] - Available network image -278868936 0 :correlation-id 33 [[#uuid "0d4c49db-aba8-b94e-de0b-315e11373feb" :ibgateway] -1 {:address "0.0.0.0", :port 40200}]
  58. 17-12-23 00:56:42 dfe8c504c3c3 INFO [onyx.messaging.aeron.subscriber:66] - Available network image -278868937 0 :correlation-id 36 [[#uuid "0d4c49db-aba8-b94e-de0b-315e11373feb" :scanner-command] -1 {:address "0.0.0.0", :port 40200}]
  59. 17-12-23 00:56:42 dfe8c504c3c3 INFO [onyx.peer.task-lifecycle:428] - Job 0d4c49db-aba8-b94e-de0b-315e11373feb {:job-id #uuid "0d4c49db-aba8-b94e-de0b-315e11373feb", :job-hash "54abf674338274a6e0d58703c48b587fcc5375861a8f4c66c1a4cc3f52e9ad"} - Task {:id :scanner-command, :name :scanner-command, :ingress-tasks #{}, :egress-tasks-batch-sizes {:ibgateway 10}, :egress-tasks #{:ibgateway}} - Peer ffd842b8-f578-7ead-e5f9-f667362852d7 - Recover pipeline checkpoint: nil
  60. 17-12-23 00:56:42 dfe8c504c3c3 INFO [onyx.plugin.kafka:44] - Job 0d4c49db-aba8-b94e-de0b-315e11373feb {:job-id #uuid "0d4c49db-aba8-b94e-de0b-315e11373feb", :job-hash "54abf674338274a6e0d58703c48b587fcc5375861a8f4c66c1a4cc3f52e9ad"} - Task {:id :scanner-command, :name :scanner-command, :ingress-tasks #{}, :egress-tasks-batch-sizes {:ibgateway 10}, :egress-tasks #{:ibgateway}} - Peer ffd842b8-f578-7ead-e5f9-f667362852d7 - Seeking to earliest offset on topic {:topic "scanner-command", :partition 0}
  61. 17-12-23 00:56:42 dfe8c504c3c3 INFO [onyx.peer.task-lifecycle:468] - Job 0d4c49db-aba8-b94e-de0b-315e11373feb {:job-id #uuid "0d4c49db-aba8-b94e-de0b-315e11373feb", :job-hash "54abf674338274a6e0d58703c48b587fcc5375861a8f4c66c1a4cc3f52e9ad"} - Task {:id :scanner-command-result, :name :scanner-command-result, :ingress-tasks #{:ibgateway}, :egress-tasks-batch-sizes {}, :egress-tasks #{}} - Peer f18b1883-1fcc-182b-8c83-18bcf79372d4 - Recover output pipeline checkpoint: nil
  62. 17-12-23 00:56:42 dfe8c504c3c3 INFO [onyx.peer.task-lifecycle:468] - Job 0d4c49db-aba8-b94e-de0b-315e11373feb {:job-id #uuid "0d4c49db-aba8-b94e-de0b-315e11373feb", :job-hash "54abf674338274a6e0d58703c48b587fcc5375861a8f4c66c1a4cc3f52e9ad"} - Task {:id :scanner, :name :scanner, :ingress-tasks #{:ibgateway}, :egress-tasks-batch-sizes {}, :egress-tasks #{}} - Peer fbac875b-198e-baa9-a35b-47ecd97be4a7 - Recover output pipeline checkpoint: nil
RAW Paste Data Copied